JP2009290852A - Function checking apparatus for equipment and device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a checking apparatus easily and automatically determining functions of operating buttons provided in equipment such as a cellular phone. <P>SOLUTION: A checking apparatus includes: an adapter unit 2 for setting a cellular phone 1 thereon; a camera 4 which images an LCD panel 3 that is a display part of the cellular phone 1, to capture an image; a plunger unit 7 including a plurality of releases 6 for pressing one of key buttons 5 of the cellular phone 1; a computer 8 for possibility decision or the like of operation of the plunger unit 7 and display contents on the LCD panel 3; and a monitor 9 for displaying an image of the LCD panel 3 or an image based on a signal from the computer 8. A still image, an animation image, audio output obtained by pressing the key buttons 5 using the releases 6 are compared with a prescribed expected image and expected audio to determine functions of the cellular phone 1. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a function check device for a device and an apparatus for determining whether an operation button or a lid opening / closing mechanism of a device such as a mobile phone functions as designed.

  The form and operation to be exposed to the outside change in response to the input from the outside, such as a mobile phone, PHS, PDA, game machine, notebook personal computer, car navigation device, panel display device, etc. As is well known, a large number of operation buttons and wired / wireless input terminals are provided, and the user appropriately operates these operation buttons or inputs signals according to the purpose. Further, in these devices and apparatuses, a folding unit is formed by connecting a display unit using a so-called panel display such as an LCD (not limited to one using liquid crystal) and an operation unit including operation buttons by a hinge. There are an increasing number of devices and the surface display device itself having a function of operating buttons and switches.

  Devices and devices such as these, such as mobile phones and PHS, are not only used for dialing for dialing and character input, but also for various settings as a telephone or computer. However, the setting can be quite diverse and complicated, such as auto lock, call charge display, usage time display, ringtone setting, user information setting, language setting, etc. Yes. In the case where a touch panel is used for the display unit, the above-described operation can be performed not only by hardware operation buttons but also by operation buttons displayed by software on the display unit.

  In the following description, unless otherwise specified, when an operation object such as an operation button is simply described, it includes not only hardware but also operable parts displayed by software.

  As described above, a manufacturer of a mobile phone or a display-use device has no problem in setting operation and operation, whether it is a hardware operation or a scan using software displayed before shipment. It has been demanded to check, determine and confirm whether or not it can be performed.

  The inventor of the present application has proposed an invention that can perform this kind of determination and confirmation work mechanically and systematically in a device such as a mobile phone, which has conventionally been performed in a state close to manual work (see Patent Documents 1 and 2).

Japanese Patent No. 3714660 International Publication WO2005 / 071930

The present invention is a further improvement of the above-described conventional invention, and is a device to be inspected such as a mobile phone, PHS, PDA, game machine, notebook personal computer, car navigation device, panel display device, or inspection. It is an object of the present invention to provide a function check device for equipment and devices that can determine whether or not a setting operation of a target device can be performed almost automatically and over multiple functions.
In addition, it is possible to provide a function check device for equipment and devices that can determine not only whether an expected output of an image or the like can be obtained as designed, but also whether an output of an unexpected image or the like is displayed. The purpose is to do.

  In order to achieve the above object, the function check device of the device or apparatus of the present invention is provided with one or more inspections provided with output means for changing the form and operation to be exposed to the outside in response to the input from the outside. A device for checking a target device or a device to be inspected, a function check device of the device, and generating the external representation form and operation state of the device to be inspected or the device to be inspected in a pseudo or practical manner and performing the inspection In the device for checking the function of the target device or the device to be inspected, the device function check device, a pseudo input means for applying a pseudo input corresponding to the input from the outside to the device to be inspected or the device to be inspected, A check target output for detecting the output to be checked generated by the output means of the inspection target device or the inspection target device according to the input by the pseudo input means. The operation or output of the check target output detection means by the pseudo input inputted according to the detection means, the pseudo input procedure setting means capable of designating the input procedure by the pseudo input means, and the procedure designated by the pseudo input procedure setting means And confirmation means for confirming consistency with the expected appearance value of the operation state and the external representation form of the inspection target device or inspection target device by the actual input corresponding to the pseudo input. Features.

  According to a second aspect of the present invention, in the function check device of the device or apparatus of the first aspect, the pseudo input unit is arranged for each of the inspection target device or the inspection target device, and the confirmation unit is the pseudo input unit. It is characterized in that even if there are plural numbers, they are shared.

  According to a third aspect of the present invention, in the function check device for the device or apparatus according to the first or second aspect, the confirmation unit includes a unit for performing a determination by fuzzy control to confirm the consistency. .

  Further, according to a fourth aspect of the present invention, in the function check device of the device or apparatus according to any one of the first to third aspects, the pseudo input procedure setting unit specifies the display unit included in the inspection target device or the inspection target device. The operation or output of the check target output detection means by the pseudo input input according to the procedure performed is displayed, the content displayed on the display means is recognized, and the pseudo input means is determined according to the position of the target content. It has the recognition means which varies the application position to the said inspection object apparatus or inspection object apparatus of the pseudo input by.

  Further, according to a fifth aspect of the present invention, in the function check device for the device or apparatus according to any one of the first to fourth aspects, the pseudo input means designates in advance during execution of a procedure of a certain pseudo input. It is characterized in that a procedure different from the procedure being executed can be executed every cycle or in a predetermined order.

  Further, according to a sixth aspect of the present invention, in the function check device for the device or apparatus according to any one of the first to fifth aspects, the pseudo input means is a voice input means and the contents of the voice input from the voice input means. And a voice determination unit that applies a pseudo input corresponding to the input event from the outside to the inspection target device or the inspection target device.

  Further, according to a seventh aspect of the present invention, in the function check device of the device or apparatus according to any one of the first to fifth aspects, development support for an embedded system used for the inspection target device or the inspection target device is performed. A means for cooperatively operating at least the pseudo input means based on an event generated by the CASE tool and a pseudo input to the inspection target device or inspection target apparatus based on at least the cooperative operation by the pseudo input means It has the means to create the input procedure by a means, It is characterized by the above-mentioned.

  Further, according to an eighth aspect of the present invention, there is provided the function check device of the device or apparatus according to any one of the fourth to seventh aspects, wherein the content displayed on the display means included in the inspection target device or the inspection target device is imaged. And an installation unit for mounting the inspection target device or the inspection target device in a predetermined state in a replaceable manner on the imaging unit.

  According to a ninth aspect of the present invention, there is provided the function check device of the device or apparatus according to any one of the first to eighth aspects, wherein the inspection target device or the inspection target device is an audio input means, an image signal input means, a wired signal input. Any one of means, radio input means using electromagnetic waves including radio waves and infrared rays is provided.

  According to a tenth aspect of the present invention, in the device or device function check device according to any one of the first to ninth aspects, a sound collecting microphone and / or a speaker is mounted on the adapter.

  Further, according to an eleventh aspect of the present invention, in the function check device for the device or apparatus according to any one of the first to tenth aspects, the adapter covers at least an operated part of the mounted inspection target device or inspection target device. And a hole or opening that allows input by the pseudo input means.

  According to a twelfth aspect of the present invention, in the function check device of the device or apparatus according to any one of the seventh to eleventh aspects, the imaging means is for obtaining a still image and / or a moving image. To do.

  Further, according to a thirteenth aspect of the present invention, in the function check apparatus of the device or apparatus according to any one of the seventh to twelfth aspects, the mounting means is a plurality of movable or position-fixed support members, In order to hold the apparatus to be inspected, an detachable elastic member is provided.

  The device and device function check device according to the present invention is capable of almost automatically determining whether or not the device to be inspected, such as a mobile phone or a panel display device, can perform various operations as designed, and is multifunctional. Judgment can be made.

  The best mode for carrying out the present invention will be described below with reference to the embodiments shown in the drawings. In the following, an example in which a mobile phone, a PDA, or the like is used as a device to be inspected will be described. However, it is clear that the present invention can be applied to the above-described devices, devices, and other devices and devices having similar configurations. Description of such devices is omitted.

  An embodiment of the present invention will be described below. The illustrated and described embodiments include external events including, for example, button presses, knob rotation, touch panel touch / draw input, voice input, image signal input from a camera, etc. The output changes to change the internal event corresponding to the input, wired signal input from the connector, radio input by radio wave or infrared, and the output event to send the external output including image and sound according to the change of the internal situation The equipment provided with the means is the inspection object.

  In the following, a plurality of means for checking the function of the inspection target device or the inspection target device generated in a pseudo or practical manner, that is, a plurality of pseudo input means for generating an output corresponding to an external input to the device. The button operation means having a pressing means capable of pressing one of the operation buttons is taken as an example, but this is a robot having an appropriate degree of freedom (for example, 3 axes, 6 axes) and sequentially pressing a plurality of buttons. It may be any one having a plurality of button operation means. In addition, the robot is not limited to the illustrated robot, and is not limited to operating buttons arranged in a plane. In particular, using a multi-axis robot, buttons and knobs arranged in three dimensions are used. Including any device that can be operated accurately, and in any case, the present invention is not limited to the illustrated example.

  Furthermore, the pseudo input means for applying the pseudo input for the inspection to the inspection target device or the inspection target device is such that the inspection target device is operated from the rotation of the knob, the touch / drawing input to the touch panel, the voice input, the camera, etc. In the case of an external input including an image signal input, a wired signal input from a connector, a radio input using radio waves or infrared rays, or the external input described above, an output corresponding to these may be made.

  FIG. 1 is a perspective view conceptually showing an embodiment of a function check apparatus for devices and apparatuses according to the present invention. The apparatus according to the present embodiment sets an evaluation object machine (PDA in the illustrated example) 1 to be determined and inspected in a predetermined state, images the LCD panel 3 that is a display unit of the PDA 1, and displays an image of the LCD panel 3. One of the operation buttons image displayed on the LCD panel 3 of the PDA 1 or the mechanical operation buttons provided in the PDA 1 (hereinafter collectively referred to as key buttons unless otherwise required) 5. Is depressed by a plunger unit 7 having a plurality of depressible release 6 as a depressing means, and the operation of the plunger unit 7 is controlled by the computer 8 and whether or not the display content of the LCD panel 3 corresponding to this operation control is determined. Control is performed. In the figure, reference numeral 9 denotes a monitor which serves as an image display means based on an image of the LCD panel 3 obtained by the camera 4 and a signal from the computer 8. The computer 8 is provided with a video capture board, an input / output board, a sound board, an Ethernet (registered trademark) board, or an equivalent component as hardware. It is preferable to incorporate OS software and, if necessary, a text editor, word processor, database software, and the like. A keyboard, mouse, network terminal (for terminal facing test), printer, and the like can also be included in the system configuration. In the figure, reference numeral 10 denotes a robot for driving the plunger unit 7. In the illustrated example, the XY-axis movement type is a single release 6; however, as will be described later, many plungers can be substituted for the release 6. The provided unit is also used. Therefore, the robot 10 is not limited to the illustrated type, and various known robots can be employed.

  FIG. 2 is a perspective view showing a plunger unit 20 having a plurality of plungers in place of the adapter unit 2 and the release 6 used when the inspection target device is a mobile phone. The cellular phone 1 is a foldable type in the illustrated example, and includes a display unit 11 having an LCD panel 3 and an operation unit 12 having key buttons 5, and this type of cellular phone to be inspected is of this type. However, the display unit 11 and the operation unit 12 can be any object such as a straight type or a flip type as long as they can be accessed from the outside. The present invention is not limited to the mobile phone 1, but is a device such as a PHS, PDA, game machine, notebook personal computer, car navigation device, panel display device, etc. Any device that is provided and can be operated can be applied to various devices.

  The adapter unit 2 also includes a rear camera 2a. The rear camera 2a can automatically test a liquid crystal display (not shown) that is positioned on the rear surface of the foldable mobile phone 1 (front surface in the folded state). It has become.

  The adapter unit 2 includes a base portion 21 for setting the surface of the LCD panel 3 of the foldable mobile phone 1 so as to be perpendicular to the optical axis of the camera 4, and the optical axis of the camera 4 in this state. In the state where the operation unit 12 of the mobile phone 1 is sandwiched between the inclined unit 22 and the inclined plate 22, the operation unit 12 of the mobile phone 1 can be set at a predetermined angle with respect to The release guide panel 23 is set substantially in parallel, and includes a pair of side plates that support these. In a straight type or flip type mobile phone or the like, there is often no need to configure the base plate 21 and the inclined plate 22 with an angle as in the illustrated example, so the configuration of the adapter unit 2 is the same as the illustrated example. It is not limited, What is necessary is just to form according to the shape and structure of object apparatus. The release guide panel 23 has a hole for inserting the release 6 in accordance with the number of the key buttons 5 of the operation unit 12 of the mobile phone 1 to be evaluated, and can be exchanged according to the target device. . The release guide panel 23 is provided with a hole (not shown) at a position corresponding to the microphone (not shown) of the mobile phone 1, and a speaker can be attached to the position of this hole.

  The plunger unit and XY type robot already described are the most frequently used devices for evaluation. However, when a plunger unit type robot is used, simultaneous pressing, quick pressing, opening and closing, You can test the rear LCD. On the other hand, if an XY type robot is used, it can be easily removed and fixed even if the evaluation equipment changes, and it can respond immediately when there is a change in the type of aircraft. In addition, an open / close test can be performed by using a mobile phone open / close sensor to create a pseudo closed state of the mobile phone. Furthermore, by linking with the base station simulator, it is possible to make outgoing calls, incoming calls, incoming calls with interruptions, changes in radio wave reception status, and inspection of overseas terminals.

  3 and 4 are perspective views conceptually showing a modification of the adapter unit 2 for holding the mobile phone. FIG. 3 shows a plurality of movable or position-fixing support members 101 with a lid portion. The mobile phone 1 with the open 102 is held, the holdability is improved by an elastic member 103 such as a removable rubber strap, and the mobile phone 1 is pressed.

  The plurality of support members 101 include a pair of guide support members 101a and 101a whose positions are fixed, and two parent sliders 101b and 101b that are slidably mounted so as to be slidable in their axial directions. A child slider 101c slidably mounted on the parent slider 101b in the axial direction thereof, that is, in a direction perpendicular to the sliding direction of the parent slider 101b, and a guide support member 101a parallel to the parent slider 101b and fixed in position. , 101a, a supporting member 101d for holding, the parent slider 101b supports the bottom surface of the mobile phone 1, the child slider 101c supports the side surface of the mobile phone 1, and the supporting member 101d for holding is a mobile phone. 1 is configured as a support member that improves the retaining property of 1.

  In the illustrated embodiment, only two parent sliders 101b on which the child slider 101c can be placed are provided. For example, the number is increased to four, and one of them is variably supporting the height of the lower part of the mobile phone. It is assumed that one side is not the main body 1a of the mobile phone 1 but the side of the lid 102 on the LCD panel 3 portion side. The remaining two may be configured to perform the same role as the illustrated embodiment.

Also, the slide parts of the child slider 101c can be replaced, and the following three types can be exchanged as necessary.
(1) What holds down both the height direction and the side direction of the mobile phone 1 (the illustrated embodiment)
(2) Holding the side of the LCD panel 3 portion of the cellular phone 1 (LCD panel 3 portions of various heights are conceivable, so that the height is about 10 cm, for example, so as to be able to cope with them. )
(3) Supporting only the height direction of the mobile phone 1 (with the same height as the embodiment shown in the figure, in a shape that does not obstruct side buttons or cables provided on the side of the main body portion 1a of the mobile phone 1 in particular. Preferably)

  Further, the height of the child slider 101c may be increased by, for example, about 1.5 cm so that the tip part does not collide even when the side button as described above is pressed.

  The child slider 101c may have a structure similar to that of, for example, a vernier caliper. However, in this structure, since a gear is used, there is a slight backlash when the mobile phone 1 is sandwiched, and one side is fixed. However, the other side can be rattled. When the side button is pressed, a slight backlash affects the camera image and the like, so it is necessary to firmly fix both sides of the mobile phone 1. For example, the child slider 101c can be screwed to fix the position. However, when it is difficult to eliminate the above-described play with one screw, the screwing may be performed at two locations.

  As described above, the elastic member 103 such as rubber straps is used from above so as to apply tension to align the child slider 101c with the center between the guide support members 101a and 101a and so that the LCD panel 3 side of the mobile phone 1 does not rise. The elastic member 103 has a hole formed in the component 101ba constituting the child slider 101b, and a spherical member or the like provided on the elastic member 103 is inserted and hooked there. It is preferable to leave the hole 101bb in all the parts of the child slider 101c so that the elastic member 103 can be attached anywhere. In the illustrated embodiment, the elastic member 103 such as rubber string is used, but a spring may be used instead.

  The horizontal width of the child slider 101c can be fixed even if the mobile phone 1 to be placed is large, so that it can be fixed in a PDA type which has been released one after another, or a display unit 11 having an LCD panel 3 called a turn type. It becomes possible to deal with various types such as a type that rotates horizontally.

  In addition, it is preferable to employ | adopt the screw which can be fastened even if it does not use a driver like a PC case as a fixing screw. Further, when the position of the child slider 101c is changed, it is preferable that the child slider 101c can be moved only by being loosened even if the screw is not completely removed. In addition, it is desirable that the child slider 101c can be fixed again at a predetermined position by, for example, shaking the scale on the parent slider 101b.

  Further, the fixed supporting members 101e and 101e for holding the end of the main body 1a of the mobile phone 1 are screwed to the base so as to correspond to the type of the mobile phone 1, specifically, the end shape and the end structure. It is preferable that the structure can be replaced so that it can be replaced.

  FIG. 5 is a side view of the base unit 30 for mounting the camera 4 and the like. The base unit 30 includes a base plate 31 and a tower portion 33 for mounting the camera 4 and the microphone 32. The adapter unit 2 is positioned by providing pins or the like (not shown) on the base plate 31. The camera unit 4 is mounted on the tower 33 so that the optical axis is vertically downward and movable up and down, and a microphone 35 is provided corresponding to the speaker 13 of the mobile phone 1. Of course, the optical axis of the camera 4 may be directed in a direction other than the vertically downward direction, and the attachment and arrangement form of the adapter unit 2 and the like may be changed accordingly. Although a mechanism for changing the position of the camera 4 is also provided, description thereof is omitted.

  As described above, the plunger unit 7 is a device that has a plurality of release 6, and more specifically, more than the number of key buttons 5 of the cellular phone 1 to be evaluated, and can selectively drive these. is there. Since the drive device itself is known, the description thereof is omitted. As shown in FIG. 6, the release 6 is a so-called release wire type comprising a tube 61 and a pin 62 passed through the tube 61. As shown in the drawing, the release guide panel 23 can be attached to and detached from the hole 25. In order to make it easy, the screw yama 64 of the metal tube 63 provided at the tip of the tube 61 is provided only in the vicinity of the base without extending over the entire length. A lock screw 65 and an adjustment screw 66 are provided at the base so that the protruding length of the pin 62 can be adjusted. However, in this type of release, the longer the protruding length of the pin 62, the more reliably it reaches the key button 5, but the pressing force becomes weaker. In addition, illustration and description about wiring of each unit, a camera, a drive system, a signal transmission system, and the like are omitted.

  In this embodiment, the desired release 6 of the plunger unit 7 is driven with respect to the key button 5 of the cellular phone 1 placed on the adapter unit 2 to depress the key button 5, and the LCD panel 3 changes by this depression. In the following description, it is determined whether or not an image as set at the time of design and manufacture appears on the LCD panel 3 when the desired key button 5 is pressed.

  FIG. 7 is a diagram showing the contents of the screen displayed on the monitor 9 as the main screen. This screen shows a composite of the image 3a of the LCD panel 3 taken by the camera 4 and the whole plane image 1a of the mobile phone 1 to be determined and inspected in advance obtained by, for example, a digital camera. ing. In addition,

Next, the flow of evaluation in the present embodiment apparatus will be described.
Evaluation,
(1) Model file creation (button setting, LCD screen adjustment)
(2) Scenario creation (preparation of design documents and specifications (expected value images and test items) and scenario creation) and debugging (3) First evaluation (execution, manual judgment, image replacement)
(4) Second and subsequent evaluations (execution / automatic determination)
It becomes the procedure.

Hereinafter, the evaluation procedure and the like in the apparatus of this embodiment will be described in detail. First, the model file creation will be described.
In starting the evaluation, first, a new model file is created and information on the mobile phone 1 is set. The model file is a file in which individual information of the mobile phone 1 is collected, and image adjustment and correspondence between the key button 5 and the release 6 of the mobile phone 1 are set.

  That is, an image file of the evaluation target mobile phone prepared in advance is used, and the entire image of the mobile phone 1 is displayed on the monitor screen so that the display unit 11 and the operation unit 12 can be seen. A screen corresponding to 3 is created. As the image file, for example, a bitmap file having a size that can be accommodated on the main screen is prepared. Then, the key button 5 necessary for determination and the release 6 are assigned. Key buttons 5 are set one by one. That is, as shown in FIG. 8, the range is specified by enclosing the key button 5 of the mobile phone 1 on the main screen, and the name and the number of the release 6 of the plunger unit 7 are specified by the number of the key buttons 5. 9 is a mobile phone information setting screen, FIG. 10 is a button information setting screen, FIG. 11 is a button information list screen, and FIG. 12 is a diagram showing an example of number input for release 6 in key button 5 information setting.

  Whether the release 6 corresponding to the key button 5 operates when the key button 5 created on the main screen is clicked is confirmed by actually operating the plunger unit 7. For example, when the key button 5 created by the operation on the main screen is clicked, the key button range is turned blue, and it is checked whether the release of the corresponding plunger unit presses the button of the mobile phone. It is also possible to check the operation on the model file editing screen described above.

  FIG. 13 shows an operation for returning the mobile phone to the standby screen (reset), which is a special operation procedure setting, an operation for turning off the power from the power supplied to the mobile phone (forced reset), and an opening / closing operation button of the folding mobile phone The screen to set up is shown. The function of the folding opening / closing operation can be used when the mobile phone 1 is a folding type, and the adapter unit and the plunger unit correspond to it, and the release 6 can be used to press the operation button of the opening / closing mechanism using a magnet, for example. Thus, it is possible to actually inspect and evaluate the mobile phone 1 without opening and closing the mobile phone 1 (in the illustrated embodiment, it has already been opened).

  The model file set as described above is stored in a storage medium with an appropriate name built in the computer 8 or as an external unit. Of course, the saved model file, that is, the created model file can be corrected. FIG. 14 is a diagram of a model file editing screen.

  FIG. 15 is an adjustment screen of the LCD panel 3 screen displayed on the monitor 9. If necessary, the image adjustment is performed in the order of obtaining distortion correction data, image correction based on the correction data, and fine adjustment of the corrected image. If necessary, adjust the size of the LCD screen. FIG. 15 also shows an LCD frame setting part and an LCD offset setting part. The adjustment on the adjustment screen of the LCD screen is completed. If necessary, the image is corrected, and the keystone correction of the corrected image is performed. FIG. 16 is a confirmation screen for the corrected image. You can also correct the color and brightness of the image. Further, as a fine adjustment of the corrected image, the keystone correction of the image can be performed, and the size and inclination of the LCD screen are finely adjusted based on the reference image.

  In the keystone correction, parameters such as the focal length and distortion of the camera 4 are obtained with reference to the calibration sheet 40 shown in FIG. 17, and the image is corrected using the parameters as correction data. In order to obtain the correction value, the calibration sheet 40 is placed on the mobile phone 1 and photographed by the camera 4 so that the black squares and dots of the image of the calibration sheet 40 displayed on the main screen can be clearly seen. Next, the calibration sheet 40 is removed and the screen of the LCD panel 3 of the mobile phone 1 is photographed. FIG. 18 is a diagram of a distortion condition acquisition wizard screen. Before acquiring the degree of distortion, first enter the measured values of the vertical and horizontal sizes as the size of the LCD panel 3 screen of the mobile phone 1 and press the distortion degree acquisition button to start acquiring the degree of distortion. indicate.

  Next, scenario creation will be described.

  FIG. 19 is a diagram showing a scenario creation / editing screen. This screen is composed of a scenario list box 50 for scenario display and an information setting section 52 that can be switched by a command setting tab 51.

  To create a scenario, first, an operation command for the key button 5 is input to the scenario list box 50. Next, the pressing condition of the key button 5 is set by the information setting unit 52. Here, multiple presses (commands for simultaneously pressing a plurality of key buttons 5), press times (setting of time for pressing a button on a mobile phone, press intervals (intervals from the end of one command to the next processing) The evaluation environment number radio button is used to set the number of the evaluation environment, and is used for setting the facing test.For folding part opening / closing, the interval for pressing the opening / closing operation button of the folding mobile phone is set. Of course, this function can be used only when the adapter unit of the foldable mobile phone and the plunger unit that can open and close the foldable mobile phone are prepared. Remote scenario call (command to execute a scenario on the opposite computer in the opposite test), wait, repeat, stop Each judgment command is set for obtaining an expected value of an image, making a judgment (immediate judgment) on the spot, and continuing or stopping scenario execution according to the judgment result. The obtained actual measurement is determined on a confirmation screen described later, but if this determination command is used, the determination is made on the spot, and the execution of the scenario can be interrupted if the determination result is not as expected. A scenario call command that enables another scenario to be called in a nested manner within one scenario can also be set, and Fig. 20 is a diagram showing an example of a plurality of calls.

  FIG. 21 is a diagram showing the contents of the expected value setting tab. On this screen, a command for recording the reaction of the mobile phone 1 can be input. What can be recorded is the screen image of the LCD panel 3 and the sound recorded by the microphone 35. In the figure, reference numeral 53 denotes an expected value image display space.

  The image acquisition command is used for performing a test by setting an expected value image and comparing it with an actual image. For example, a file having a format such as jpg, bmp, or emf is set in the expected value image. In addition, the timing for starting the recording is designated as the timing for recording the actual measurement value, and the image designation and determination range setting are performed. On the other hand, the voice acquisition command is used to record the voice collected by the microphone 35 so that the sound (DTMF sound) when the key button 5 is pressed can be determined on the confirmation screen.

  The input support unit in FIG. 19 is a part for automatically generating a scenario in which hiragana, numbers, alphabets, and symbols such as names and telephone numbers are input with the mobile phone 1. When the key button information button of this part is operated, the button correspondence table shown in FIG. 22 is displayed. The key button 5 of the cellular phone 1 used for character input and the key name registered in the model file are displayed. Can be set.

  Then, it is checked by debugging whether the created scenario operates correctly. The debug screen is the same as an execution screen (FIG. 23) described later. The result of the check is output as an error report as shown in FIG.

  Next, scenario execution will be described.

  FIG. 23 shows an execution screen. This screen includes a scenario list box 80, an execution time designation unit 81, and an execution status display unit 82. The execution status display unit 82 includes a scenario list list box 83, a current scenario box 84, an expected value image display unit 85, an execution LCD. An image display unit 86 is included. The scenario list box 80 displays the name of the scenario being executed or the scenario to be executed in the future. The execution time specification unit 81 includes a part for displaying a setting relating to the time for which the key button 5 is pressed, a part for displaying a setting for timing for recording an expected value, and a part for displaying a stop level. The scenario list list box 83 displays the selected scenario and scenario collection, and the current scenario box 84 displays the scenario selected in the scenario list list box 83. The expected value image display unit 85 displays an image set as an expected value when the image acquisition command is executed, and the execution LCD image display unit 86 displays the screen of the LCD panel 3 of the cellular phone 1 that is also photographed. FIG. 24 shows an error report.

  The facing test can be performed using two sets of the mobile phone automatic evaluation systems as described above. In the oncoming test, the computer of the partner system is connected via a LAN, and the same scenario is automatically executed on the connected system. That is, this is a test in which the server controls the client with one of the two mobile phone automatic evaluation systems as a server and the other as a client. When the scenario is executed on the server side, the server can operate the two mobile phones 1 by operating the plunger unit 7 on the client side. Therefore, it is possible to perform an inspection such that a call is made to another mobile phone 1 and the received mobile phone is called.

  The scenario can be automatically executed regardless of whether it is a face-to-face test, but it can be paused, stopped, and restarted manually in the middle, and the scenario is executed step by step and automatically executed from the middle. You can also set semi-automatic execution to switch to.

  In addition, a test that is close to the actual usage situation, such as receiving a mail while operating a mobile phone, by enabling so-called interrupt processing that allows another scenario to be executed for each specified period in the currently running scenario. Can be done automatically.

  After executing the first scenario for a certain mobile phone, confirmation (manual determination and image replacement) is performed. That is, for example, manual determination is performed once, and if the determination result is good, the images are replaced. First, the image is confirmed, and all the steps of the scenario are determined as to whether or not the expected value image matches the execution image. When executing a plurality of scenarios, all steps are determined for all scenarios. If the expected value image is not an image obtained by directly capturing the screen, the image determination cannot be performed, and the expected value image is replaced. If the replacement is performed, the next time the same scenario is executed, the replaced image is registered as an expected value in the database, and automatic image determination can be performed. In addition, when it is desired to use only a part of the prepared expected value image for automatic determination, the determination range can be set.

  Note that a default determination range and an individual determination range can be set as the determination range. In the former case, the same determination range is applied to all images, and in the latter case, the determination range is applied only to images whose range is set on the screen. A determination range and an exclusion range can also be set, and a complex shape can be determined by combining the determination range and the exclusion range. Since the system uses a computer, it is of course possible to specify the coordinates of the determination range.

  Then, the result of scenario execution for the second and subsequent times can be automatically determined if the expected value images are replaced. The automatic determination function automatically determines whether the expected value image and the actual measurement image match based on the prepared determination range. It can also be automatically determined whether the frequency of the expected value DTMF sound matches the frequency of the measured DTMF sound.

  Although not shown in the drawings, a foldable mobile phone having another display panel on the outer surface of the operation unit 12 having the key buttons 5 or a PDA having a similar structure has been developed and marketed in recent years. When these are to be evaluated, evaluation of the display on the LCD panel 3 in the open state and evaluation of the display panel on the outer surface of the operation unit 12 in the closed state are performed individually, or another It is possible to prepare and evaluate two screens of a mobile phone or the like that have been opened with two cameras at the same time and separately.

  In addition, the functions of the above-described embodiments can be integrated to enable image determination with ambiguity that is close to human judgment, and image determination is allowed by allowing subtle differences between expected value images and actual measurement value images. Can be done. For example, this makes it possible to greatly reduce the setup time when the camera 4 is reinstalled. Further, automatic determination can be performed even if a device such as a 45-inch large-screen TV, for which image determination is difficult, is an inspection target. Various methods have been proposed for applying fuzzy theory to image measurement, and it is only necessary to select an appropriate method in consideration of various conditions such as depending on the object to be inspected and incorporate it into the above-described image processing. The detailed explanation is omitted.

  Hereinafter, a method for evaluating the display content of the screen will be described. In this example, as shown in FIG. 25, in addition to evaluating still images and moving images, determination is also made on the sound generated by a device such as a mobile phone as shown in FIG.

  First, an outline of image evaluation will be described. In this example, as shown in FIG. 25, first, the image from the camera 4 is calibrated (S101). This calibration may be performed once in the entire system, and can be applied to an image acquired by a camera of a function check device of another device or apparatus constituting the system.

  Next, in the function check device of each device and apparatus, the operation button 5 of the mobile phone 1 to be inspected is operated (S102), and an image is displayed on the LCD panel 3 of the mobile phone 1. This image is acquired by the camera 4 and image determination is performed for each still image and moving image (S104).

  On the other hand, in the voice determination, in this example, the determination is made for the DTM sound, the BT / RBT sound, and the melody. As shown in FIG. 26, this determination is performed by operating the operation button 5 of the mobile phone 1 (S201), acquiring the generated voice with the microphone 35 (S202), and sending the voice signal to the device, the function check device of the device. The stored voice is stored, and the stored voice is determined (S203). First, the calibration of the imaging device for image acquisition of the device and the function check device of the device will be described in detail.

  In this calibration, the coordinates of 7 × 7 black dots displayed at the center of the calibration sheet shown in FIG. 17 are read from the captured image, and the actual calibration sheet and the points of the captured image are read. Is obtained to obtain the photographing characteristic data of the camera.

  First, a plurality of, for example, 20 images of a calibration sheet are taken. In taking these images, calibration sheets are arranged at various positions and angles. Thereby, the position coordinates of the point of the calibration sheet image under various conditions are acquired.

  Next, an image of the calibration sheet placed in parallel with the liquid crystal screen of the mobile phone to be actually inspected is taken. The position coordinates of the points are acquired from all the calibration sheet images, and the focal length of the camera, the center position of the radial distortion, and the degree of distortion are calculated from these data. This is calculated by the image processing library. The image processing library is commercially available software (for example, HALCON (trademark) manufactured by MVTec), and calculates each element. Then, correction is performed so as to eliminate distortion of the (last) calibration sheet image taken on the mobile phone screen.

  In this example, although the position of the point is detected from the calibration sheet, the image is captured within the covering of the apparatus, resulting in a dark image. In the image processing library, there is a function for acquiring a rectangular position of a sheet, and only a rectangle displayed by a specified color line can be acquired.

  This function passes a threshold value as an argument, but if it is too high, it cannot be detected in dark images. Conversely, if the threshold is low, an incorrect area is acquired. Also, the return value of the library does not know whether the rectangle has been acquired. If it continues with failure, an error may occur later, so it is necessary to acquire the rectangular area accurately here.

  For this reason, the function for obtaining the same rectangle as described above is executed while gradually decreasing the threshold from a high threshold so that a mark can be detected even in an image with dark unevenness. Stop when the acquired area is closest to the square.

  Next, parameters for correcting camera distortion are acquired from the image of the calibration sheet. The camera processing unit calculates the camera coordinates converted according to the focal length of the camera, the center position of the radial distortion, the degree of distortion, and the image of the last calibration sheet.

  The mobile phone image is converted using the parameters obtained above. Using the above values, conversion is performed on the calibration sheet obtained last and the LCD image of the mobile phone. The calibration sheet is now displayed as an undistorted square.

  Further, conversion is performed so that the image is displayed in an appropriate size in the center. Ultimately, the purpose is that the LCD screen of the mobile phone is displayed in the center without distortion, not the calibration sheet, so the conversion is repeated while converting the conversion parameters so that they are displayed in the center with an appropriate size.

  Then, correction is performed so that the image can be used by the function check device of another device or apparatus in accordance with the reference image of another model. The user selects one reference image and clicks the automatic correction button to correct the current image to the same size and brightness as the reference image.

  Apply automatic correction according to the reference image. That is, the affine transformation is performed so that the position, rotation, enlargement / reduction, and aspect ratio match the reference image. This correction is applied when a still image is acquired from an image taken with a camera.

  Next, the brightness and contrast of the camera are adjusted according to the reference image. If the brightness of the still image is changed later, the original image has only data of, for example, 0 to 255. Therefore, for example, when the image is too bright and white, the accurate color value is not known. Therefore, the setting value of the camera is directly changed instead of converting the captured image. By continuously shooting and comparing while changing the brightness and contrast of the camera, it matches the appropriate brightness and contrast.

  Next, comparison of still images will be described.

  In the image processing of the function check device of the device or device according to the present invention, it is impossible to predict what image will be input. Therefore, it is necessary to select an optimum determination logic according to the image that has entered and perform determination without any mistake. Specifically, the brightness is corrected so that it can be easily determined even when a fine image or a dark image enters, and a difference between regions having a certain area is determined.

  The bright area of the LCD is acquired as follows, for example.

  As shown in FIG. 27, an image histogram (0 to 255) is obtained and divided into three peaks. Threshold processing is performed with the value of the boundary dividing the first and second peaks counted from the darker.

  If the mountain is only divided into even numbers, the center is taken. The reason for taking the interval between dividing the first and second peaks is that in this example, the image is divided into a surrounding black frame and a bright LCD portion, so it is sufficient to remove the black areas. However, there are cases where some light leaks and becomes brighter in gray, so this method is adopted.

  If the brightness of the images is greatly different, whether to match them to the same level of brightness or to judge NG because the brightness is different can be determined by the value in the setting file, and the user can change Is also possible.

  If the brightness of the actual image differs from the value set here, the images are compared without correcting the position, and a result that they do not match is obtained.

  A template for alignment from the reference image is created. In order to eliminate the deviation between the reference image and the actual measurement image, position correction is performed in a subsequent process. A pattern matching template for that purpose is created based on the reference image. (Calculate with image processing library) Select an image for template creation.

  In this example, a registered image is obtained by narrowing down the image to the area of the LCD area (width 3 pixels). This enables accurate and fast position correction.

  Next, when the contrast of the original image is low, a correction for increasing the contrast is performed. This is not simply a gamma correction. As shown in FIG. 28, a portion brighter than the color average value is brighter, and a dark portion is Correct darker. The brightness enhancement conversion table is calculated from the average image value and the maximum / minimum values, and the contrast is corrected. Used to judge images with subtle hues. When the contrast is increased in this way, an inflection point occurs such that the upper part becomes brighter and the lower part becomes darker.

  Next, color correction of the measured image is performed according to the reference image. At this time, adjustment is made in a portion excluding a fine image and an edge region so that a slightly different image is color-corrected in the same manner. When the average color value differs between the reference image and the measured image by a threshold value (parameter specified by the user), correction is not performed. Furthermore, pattern matching is performed based on the template. Pattern matching is performed based on the template created earlier. This is calculated by the image processing library.

  When repeatedly determining, the second and subsequent determinations are made quickly using the first position information. The position data of the first reference image is taken, and in the second and subsequent determinations, the position data is read and read for image matching.

  As a result of the alignment, if there is a large shift, or if the user has moved more than specified by the user, the original position is returned and the determination is made by overlapping the positions as they are.

  Determination is performed by superimposing the reference image and the measured image as they are. If there is an element that seems to be NG, such as a greatly different color or a different position, a result of simply taking an image difference is obtained without performing position correction. Note that this determination can be an image determination that has ambiguity similar to human determination. If a determination function using so-called fuzzy control is used to perform image determination while allowing a subtle difference between an expected value image and an actual measurement value image, the setup time for camera re-installation can be greatly reduced.

  The image / determination range is converted based on the data acquired by the alignment. If the alignment is successful, affine transformation is performed based on the data. This processing is performed by an image processing library. Then, the reference image and the actually measured image are narrowed down in the determination target range designated by the user.

  Next, the difference between the reference image and the measured image is taken. In this example, an image difference is obtained between the reference image and the actually measured image for each of four types of RGB image and gray image. For the original image having a low contrast, it is effective to apply a process for enhancing the difference. This process makes the difference image for each of RGB and Gray acquired more clear.

  Threshold processing is performed between 255 (about 70, which can also be set by the user) and 255 for obtaining an area that is expected to be NG in the difference image by threshold processing. Different portions are extracted between the reference image and the measured image.

  In this example, for a large number of images, the results were compared while gradually changing the logic and parameters, and the result with the best threshold was adopted. It is desirable to change the threshold according to the brightness of the image. The reference threshold is read from the setting file, but if the image is dark, the threshold is lowered accordingly. Conversely, if it is bright, increase it.

  Next, noise processing is performed. In this process, noise is deleted from the NG area (image difference area) obtained by the threshold process, and only the area that is truly NG is left. First, only a portion that is largely recognized as NG is extracted from the NG candidate region. A portion brighter than the threshold is not set as an NG region, but only a portion including a bright portion and having a large peripheral area of a white portion as an NG candidate is set as a final NG region.

  For example, in the case shown in FIG. 29, even if the area on the left is large, the maximum brightness value is low, so it is not determined as NG. Since the right area has a high brightness at the center, the entire area is detected as NG.

  By the above processing, if the area of the area determined to be NG is zero, it is OK if the area is 1 or more, and NG area is displayed. FIG. 30 is a diagram showing the area specifying process during the still image determination process in the mobile phone inspection apparatus according to the present embodiment.

  As for noise processing, the image to be compared is moved by 0.5 pixels in 8 directions, and the noise increases when the alignment is slightly shifted. It is possible to adopt a method of optimizing the position with the least noise or a method of determining “deviation” and “difference” from the edge information of an area determined to be NG.

  Specifically, as shown in FIG. 31 and as described above, image size determination (S111), LCD area image acquisition (S112), brightness determination (S113), and alignment template creation (S114) , Contrast adjustment (S114), color correction (S116), pattern matching based on template (S117), position confirmation (S118), image determination range conversion (S119), or determination by superimposing the reference image and the actual image (S120) ), Narrowing down the image to the determination range (S121), extracting the difference between the reference image and the measured image (S122), obtaining a region that is expected to be defective (NG) in the threshold value processing (S123), and noise processing (S124) ) And a result output (S124).

  Next, the moving image determination process of the function check device of the device or apparatus according to the present invention will be described with reference to FIGS. FIG. 32 is a flowchart showing the moving image processing. In this example, the expected value and the actually measured value are each an avi file. The expected value and the actual measurement value have the same size when cut into a still image. However, the shooting time can be different. Furthermore, it is desirable that the frame around the image is displayed in black.

  First, a moving image is read from a moving image file (AVI file) shot and stored by the camera (S141). Then, the moving image is cut out into a still image (bitmap) every frame (30 f / s). This is the number of acquired frames of the imaging device that has read the image.

  Next, the read image is averaged. As shown in FIG. 35, images are read one by one, the previous image (FIG. 33 (a)), the previous image (the same (b)), and the focused image (the same (c)). Then, the average image of the three images is obtained (S143), and the average image of the three images is handled as one image (FIG. 33D). Even if the timing of cutting out is shifted, smoothing is achieved by averaging.

Further, data used for comparison is acquired after synchronizing the expected value and the actual measurement value in a later step (S144). Then, the averaged image is divided into four colors of RGB and Gray (S145). Each averaged image is divided into RGB and Gray images. The gray image is 0.299 * red + 0.587 * green + 0.144 * blue so that it is close to what the human eye sees. Then, the gray image is reduced to a half size (1/4 in area) and stored on the memory (S146). The acquired gray image is reduced to a half magnification and secured in the memory. At this time, the area is set to a quarter of the original size (S147). An image difference is obtained by subtraction from the previous image for each of RGB and Gray. A brighter part and a darker part are obtained, and the total gray value (integrated value of area and gray value (0 to 255)) is obtained (S148). This is due to the following processes (1) to (3).
(1) For each RGB, Gray image, the previous image is subtracted from the current image, and a portion that is brighter than the previous image is acquired as an image (FIGS. 34A, 34B, and 34C). )).
(2) Similarly, the current image is subtracted from the previous image, and a darker portion is acquired as an image.
(3) The total gray value (the integrated value of the area and brightness of the portion displayed in white) of the acquired difference image is acquired for each of RGB and Gray.
Thus, eight total gray values can be acquired per image when a moving image is cut into a still image. The brightened image and the darkened image have four channels of RGB and Gray, respectively.

Next, the difference images acquired for each of RGB and Gray are combined. An area having a difference is obtained by performing threshold processing on this image (S148). This is due to the following processes (1) to (2).
(1) The difference image acquired for each of RGB and Gray is added for four channels of RGB and Gray.
(2) The difference image obtained by adding four channels is subjected to threshold processing with a parameter (about 50) to obtain a bright part as an area (this parameter can be specified by the user).
As a result, a brighter area and a darker area can be acquired as a color image.

The brighter image and the darker image are combined, threshold processing is performed, and an area having a difference between the previous and subsequent images is acquired (S149). Find the center of gravity of this area. This is due to the following processes (1) to (4).
(1) The difference image indicating the brighter portion acquired in (S148) and the difference image indicating the darker portion are added to form one image, and the previous difference image is acquired.
(2) Threshold processing is performed with a parameter (about 50), and a bright part is acquired as a region. (This parameter can be specified by the user) This area is the difference area from the previous image.
(3) The center-of-gravity position of the area acquired in (2) is obtained. If there is no difference from the previous image and the area area of the difference is zero, the center position of the image is substituted.
(4) The difference image indicating the brighter portion and the difference image indicating the darker portion are reduced to half the size and secured on the memory (one quarter in area).

The moving time of the moving image is obtained, and the timing of photographing the actual measurement value and the expected value is matched (S150). Here, it is necessary to match the time so that the determination can be made even when the shooting timing of the expected value and the actual measurement value is different or when the shooting time is different. This is due to the following processes (1) to (4).
(1) The total gray value acquired in (S147) is compared while shifting the expected value and the actual measurement value one by one. Only when the expected value and the measured value overlap, the difference of the total gray value is taken for each frame, and the total value is obtained.
(2) Since the difference is a minimum value when the timing of the expected value and the actual measurement value matches, the candidate is a position that is smaller than the previous value and smaller than the next value. Then, n is calculated such that (f (n + 1) −f (n)) + (f (n−1) −f (n)) is the largest. A place where this difference is the largest is taken as a deviation time.
(3) If the times obtained for the four channels of RGB and Gray are different, the data are selected in descending order of 8 data candidates.
(4) If the time candidates acquired for each of RGB and Gray do not match, the data is summed up for all channels, and the place where the total value was the highest (the time when there was the difference between before and after) is shifted. Time.

Next, in a state where the deviation between the actual measurement value and the expected value is combined, the actual measurement value and the expected value data are compared (S151). That is, here, the barycentric positions of the areas moved compared with the previous image are compared (S152). This is due to the following processes (1) to (3). This is Comparative 1 in this example. In this comparison 1, the position of the center of gravity of the difference area is obtained, and the difference in location is obtained.
(1) After synchronizing the expected value and the actual measurement value, the center of gravity of each image of the expected value obtained in S159 and the actual measurement value is compared. The difference is calculated for each of the X and Y coordinates, and the ratio of each to the width / height of the image is determined (1−X difference / determining range width, 1−Y difference / determining range height).
(2) The above (1) is obtained for the cut-out image and the average value is taken. If this value is low, the coincidence rate is low (closer to 1, there is no difference).
(3) The value (0 to 1.0) obtained here is set as result 1 as a comparison result.

  The images shown in FIGS. 35A and 35B show images in which icons are blinking at different locations, and it can be determined that the images are different from this comparison 1.

  The moving area of the expected value and the actually measured value is compared for each of the brighter area and the darker area (S153). This is due to the following processes (1) to (5).

This is comparison 2 in this example. In this comparison 2, the difference between the movement areas is taken to see the difference in motion.
(1) After synchronizing the expected value and the actual measurement value, the difference between the expected value and the actual measurement value obtained in (S148) is obtained.
(2) Next, “the region where the expected value or the measured value has moved” is acquired. Both the expected value and the actually measured value are combined by adding all the images with increased brightness and the images with decreased brightness (total 4 types). This is subjected to threshold processing, and a brightly displayed portion is acquired as a region. This region is subjected to an expansion / contraction process to narrow it to a region having a certain area. This is referred to as “a region where movement has occurred”.
(3) The difference between the expected value and the actual measurement value is acquired for each image with increased and decreased luminance. If the expected value and the actual measurement value are changed in the same way, these differences are taken to cancel each other and the area disappears. However, if the moving parts are different, the area remains even if the difference is taken.
(4) The image of (3) is subjected to threshold processing with a parameter (about 50) to obtain a bright part as a region (this parameter can be specified by the user). The area of the image with the increased brightness and the area of the decreased image are added to obtain one movement difference area.
(5) The ratio of the difference area between the expected value acquired in (4) and the actually measured value with respect to the “region with movement” acquired in (2) is obtained. Next, the ratio of the “region with movement” obtained in (2) to the determination target area of the image is obtained. When this area is small, it is made smaller than the ratio of the difference area acquired in (5). The reason why the processing is required is that the moving area is smaller than the area of the determination range because the moving image is less moving. That is, the difference is small where the moving image portion of the expected value and the actually measured value is different. As described above, by subtracting the ratio of the difference area between the expected value and the actual measurement value (0 to 1) with respect to the “region with movement” from 1, the ratio (coincidence ratio) in which the expected value and the actual measurement value moved in the same way Can do. The greater this value (the closer to 1), the higher the coincidence rate.
(6) The value of (5) is obtained for all images, and the average value per image is obtained by dividing by the number of images. The value (0 to 1.0) obtained here is set as a comparison result result2.

  It can be determined that the two images shown in FIGS. 36A and 36B are different images based on this comparison 2.

Comparison is made by taking the image difference of the reduced images, and how much the entire image including the background is different is compared (S154). This is due to the following processes (1) to (2). This is comparison 3 in this example. In this comparison 3, determination is made based on the absolute value of the image, that is, in this comparison 3, the difference in the stationary state is seen.
(1) Synchronizing the expected value and the actual measurement value, and taking the difference between the expected value acquired in S156 and the image of the actual measurement value in the combined time. First, alignment is performed using expected values and measured values. Specifically, pattern matching is performed on the actual measurement value image based on the expected value, and the actual measurement value is moved to the found position by affine transformation. When the time of the expected value and the actual measurement value overlap, alignment is performed for all images. After alignment, an image difference between the expected value and the actual measurement value is obtained.
(2) From the difference area between the expected value and the actual measurement value acquired in (1), the area having the motion acquired in S163- (2) is subtracted. As a result, a difference only in the background (still image portion) can be acquired. Threshold processing is applied to the difference image, and the greater the area left, the lower the matching rate.
(3) Since this area can be seen to be sufficiently different in the human eye even if it does not differ by 100%, the value obtained by squaring the result (<1) is taken as the answer.
(4) The value (0 to 1.0) obtained here is further squared to obtain result 3 as a comparison result. Note that the absolute value comparison of images is not performed in other processes. This is because all the other processes are compared at relative positions, and therefore, when the brightness of the entire image is different, it is determined that the comparison is the same.

  It is possible to determine that the two images shown in FIGS. 37A and 37B are different images by this comparison 3.

  Then, the above comparison elements are multiplied to obtain a final result (S155). After synchronizing the expected value and the actual measurement value, the result of the result 1, result 2, and result 3 are acquired, and the product of these is obtained (the value is 0 to 1.0). Multiply this by 100 and return the result corresponding to%.

  And by returning a result (0-100) (S156), when this value is more than a threshold value, it is set as a pass, and when it is less than a threshold value, it is set as a failure. Next, the sound determination of the function check apparatus for the device and apparatus according to the present invention will be described with reference to FIGS. In this example, three determinations are made: DTMF determination (FIG. 38), BT / RBT determination (FIG. 39), and melody determination (FIG. 40).

First, DTMF determination will be described with reference to FIG.
DTMF (Dual Tone Multi Frequency) is an audio signal composed of two types of frequencies assigned to each telephone button (0 to 9, *, #). In the DTMF determination, an actual measurement value collected by the microphone is analyzed, and whether or not the type of the audio signal included in the actual measurement value matches the DTMF number (0 to 9, *, #) designated as the expected value. judge.

  Since the DTMF sound is a combination of predetermined specific frequencies, the frequency information of each DTMF is used as the expected value, and the sound data as the expected value is not retained. The frequency information corresponding to each number is as shown in FIG.

The determination procedure is shown below.
First, the push button is operated (S211), and two frequencies at which the maximum volume is recorded among the actually measured values are acquired (S212), and the expected value WAVE file is read with these values.

  Next, the read WAVE data is subjected to FFT (Fast Fourier Transform) to obtain a volume data array representing a volume level for each frequency (S213). Then, the array index represents the frequency band, and the data for each index is the volume level.

  Next, the acquired volume data is divided into two bands (650 Hz to 970 Hz, 1150 Hz to 1500 Hz) that are considered to be recorded with the frequency band of DTMF (S214). One point of data in which the highest volume level is recorded is acquired from each of the two divided bands (S214). These two data are used as the frequency of the actual measurement value of the DTMF sound.

  Further, the frequency of the DTMF number designated as the expected value (2 points) is compared with the low range and the high range of the frequency (2 points) calculated from the actual measurement values (S216), and a fixed tolerance is set. If it is within the error range (± 20 Hz), it is determined that they match (S217, S218). If it is out of this allowable error, it is determined to be defective (S219). Next, BT / RBT (busy tone / ringback tone) determination will be described with reference to FIG. Here, BT / RBT (busy tone / ringback tone) has the following meanings. That is, BT (Busy Tone) is a voice signal (poop-peep) (· is silent) that represents the busy state of the telephone, and RBT (Ring Back Tone) is a voice signal (PururuLuru) that represents the telephone ringing state. The part “Poo” or “Purururu” that is a sound of “Pururu Ruru” is called ON data, and the “·” part is called OFF data.

  In the BT / RBT determination, an actual measurement value collected by the microphone is analyzed, and it is determined whether or not the type of the audio signal included in the actual measurement value matches the BT designated as the expected value or the RBT.

  Since RBT and BT each have a unique ringing pattern (intermittent pattern of OFF data and ON data), a numerical value of the pattern is used as an expected value. Therefore, the sound data used in this process is only an actual measurement value.

The specific procedure for determination is shown below.
First, a push button is operated (S221) to obtain a ringing sound (S222), and an expected value WAVE file is read. Next, the read WAVE data is subjected to FFT to obtain a volume data array representing a volume level for each frequency (S223). In this process, the array index represents the frequency band, and the data for each index is the volume level (S224).

  Next, it is examined whether or not the content of the volume data array matches the BT / RBT frequency band (400 Hz ± 20 Hz) (S225). If they match within a predetermined allowable error range, it is determined that the data is ON data. Otherwise, it is determined that the data is OFF data. This is examined along the time axis, and a ringing pattern array in which the number of ON data and OFF data is calculated is acquired.

  Next, the expected pattern and the acquired ringing pattern are compared. For this, first, an effective portion of the actual measurement pattern is recognized. At this time, when OFF data is included at the beginning of the actual measurement value, the portion is discarded, and the portion starting from the ON data is regarded as the effective portion of the data.

  Then, the expected pattern and the actual measurement pattern are compared along the time axis from the effective portion of the actual measurement pattern. If the difference in the number of ON / OFF data elements for each ringing interval is less than the specified error range, the position is considered to be part of the specified tone pattern.

  Then, when the same pattern as the expected pattern is maintained for a certain range, it is determined that they are matched, and otherwise they are not matched.

  Next, melody determination will be described based on FIG. In this example, the melody refers to sound data having a scale change other than the above-described DTMF and BT / RBT.

  In the melody determination, an actual measurement value collected by the microphone is analyzed and included in the actual measurement value. The degree of coincidence represents how much the sound data matches the sound data designated as the expected value.

  For the process for obtaining the coincidence rate and for generating data for obtaining the coincidence rate, a generally used audio library (for example, VoiceBase II library from Animo) is used. Whether the determination result is acceptable or not is determined based on whether or not the value of the coincidence rate acquired by the determination process exceeds the system default value or the coincidence rate threshold set by the user.

  The sound data used in this process is two values, an expected value and an actual measurement value. First, each processing data is acquired based on an expected value and an actual measurement value. That is, a WAVE file of expected values and measured values is read (S231). Next, silent section detection (using a voice library) is performed, and the start position of valid data is acquired (S232). At this time, the data amount for each unit of processing data (one frame) is determined based on the effective data length of the expected value and the actually measured value.

  Next, the processing data is subjected to a window function (speech library), FFT filter bank analysis (speech library) is performed, and processing data for matching processing is acquired (S233). Next, a comparison process between the expected value and the actual measurement value by the DP method (voice library) is performed, and distance data of the comparison result is acquired (S234). Then, the coincidence rate is calculated from the acquired distance data (S236).

  Further, when the calculated match rate is larger than the specified match rate threshold value, it is determined that they match, and when it is less than the threshold value, it is determined that they do not match (S236 to S238).

  These processes are performed for a predetermined melody, and the voice determination process ends.

Next, an automatic test for the PDA 1 will be described with reference to FIGS.
As in the case of the mobile phone described above, first, as environment settings, teaching is performed at the position of the button 5 displayed on the touch panel (LCD panel 3) pressed by the release 6 of the robot 10 or the button 5 as hardware, and shooting from the camera. Set the screen to be used and the button display position. The same is true in that it is possible to handle a plurality of models by switching the setting of the evaluator. Next, a pseudo operation of the button 5 displayed on the touch panel or the button 5 as hardware is performed by operating the mouse 8a attached to the computer 8. That is, when the mouse is clicked on the pseudo screen as shown in FIG. 43, the release 6 of the robot 10 moves to that position, and the touch panel of the PDA that is actually the inspection object machine is pressed. For example, the robot looks for an icon and presses it, so even if the position of the button on the touch panel changes every time like a pop-up menu, it is okay if the button display position changes by registering the pressed position with an image. Can be recognized by the robot. The computer 8 creates a scenario by mouse click, pseudo operation, and actual operation as described above. Specifically, as described above, the test procedure is described in a script called a test scenario. Advanced branching and conditional statements can be easily written with a mouse click. That is, when a button is operated on the pseudo screen, the scenario is automatically written. Then, the robot 10 operates the evaluator 1 according to the scenario, and takes an image with the camera 4. All operation contents and images are registered in the database.

  Next, the image is determined. This is determined automatically such as still image determination, OCR determination, SEARCH determination, moving image determination, audio determination and the like. It is desirable that subtle differences such as “to”, “i”, and “j” can be reliably determined. Then, the result is confirmed, and a defective part is immediately found from the test result list. As a result report, necessary information is simply output using the CSV file output function or the print function.

  The plunger unit and XY type robot already described are the most frequently used devices for evaluation. However, when a plunger unit type robot is used, simultaneous pressing, quick pressing, opening and closing, You can test the rear LCD. On the other hand, if an XY type robot is used, it can be easily removed and fixed even if the evaluation equipment changes, and it can respond immediately when there is a change in the type of aircraft.

  Next, an embodiment in which the evaluation target devices are car navigation and car audio will be described with reference to FIG. The 6-axis robot 200 (FIG. 44A) and the plunger unit 20 (FIG. 45B) can be considered as the types of robots to be used. In any case, the touch panel 3 can be operated and the dial 202 can be pinched and turned. (Although the illustration of the mechanism of the plunger unit 20 is omitted, it is possible to use the adapter 204 with a simple structure), the volume can be adjusted. Even if the screen is tilted by three-dimensional operation, it is possible to press the screen from the front.

  If the 6-axis robot 200 is used, the CD changer 206 can be operated (FIG. 44C). In conjunction with the test of the device to be evaluated, the CD 208 can be automatically taken in and out. When the test target device is the car navigation system 210, the six-axis robot 200 automatically inserts and removes the CD 208 and the DVD 212, and the CD changer 206 and the car navigation system 210 can be controlled from the computer 8.

  In the car-related inspection, the power supply can be controlled as shown in FIG. By operating the programmable power supply from the QC, such as a low voltage state or a voltage state when the ignition is turned on, a test in which the voltage state is changed can be performed. The example shown in the figure shows an example in which there is no problem in display on the display at the supply voltage of 9.5V, and part of the display on the display disappears at the supply voltage of 7.5V (part indicated by the arrow X in the figure).

  In addition, as shown in FIG. 47, cooperation with the CAN simulator 300 can be achieved. That is, it is possible to perform a linkage test with a CAN simulator (product name: CANoe) widely used in the development and verification of in-vehicle devices having a CAN interface. By controlling the CAN simulator on the computer 8 side, it is possible to perform a collaborative test such as operating the actual machine while changing the CAN environment.

  It can also be used to determine spoken language. That is, it recognizes a person's spoken language and makes an automatic determination, thereby making it possible to automate the voice guidance of a car navigation system and the multi-language test of an embedded device that supports foreign languages. In the example of FIG. 48, voice guidance or the like is recorded by the microphone 302, and it is determined whether or not the recorded sound or voice has the same waveform as the expected value.

  Note that image data output by RGB input by the touch panel or the like that has been used as the inspection target device in the above description can be captured as it is. Since a high-resolution image without distortion can be captured, image determination can be performed with high accuracy, and it is possible to deal with a device equipped with a large display (see FIG. 49). In addition, the programmable display not only operates the touch panel 3, but can also operate in cooperation with various PLCs 3b to execute a test closer to the actual environment (see FIG. 50). Furthermore, based on the image which the character displayed on the screen 3a of the touch panel 3 image | photographed with the camera 4, character recognition can be performed by OCR, and the arm and plunger of a robot can also be guide | induced to the coordinate position of the found character. (See FIG. 51). In the illustrated example, the character string “certificate” in the actual measurement image (FIG. 51A) is recognized, and the robot actually operates the arm and the plunger at the position corresponding to the character string on the screen of the touch panel 3. .

  Furthermore, as shown in FIG. 52, the present embodiment can be configured such that the apparatus of this embodiment controls an infrared signal for a digital home appliance 400 capable of performing an infrared remote control operation. In the figure, 401 is a controller, and 402 is an infrared transmitter. That is, the apparatus of this embodiment controls the infrared signal instead of the normally used infrared remote controller. By registering an infrared signal in the controller 401 having the learning remote control function, the same operation as that of the learning remote control can be performed. When the same operation as that of the learning remote controller is performed on the screen of the monitor 9 of the present embodiment apparatus, an infrared signal corresponding to the operation is output from the infrared transmitter 402 via the controller 401. Then, if the contents of the screen that changes in accordance with the infrared input are captured by the camera or RGB input, a system for checking the functions of the devices and apparatuses as described above can be configured. 52 is a modification of the example of FIG. 52. For example, as shown in FIG. 53, by combining the infrared control by the plunger unit 7, the controller 401, and the infrared transmitter 402 that are physically operated, It is possible to automate a test in which a digital home appliance 400 is operated with an infrared signal and a button attached to the actual machine is pushed by the release 6 of the plunger unit 7.

  FIG. 54 shows an example of an infrared remote controller 500 having the function of directly changing the operation contents into a test scenario and the display contents thereof. When the button 501 of the infrared remote controller 500 is pressed, for example, a command “press button” can be realized in the scenario.

  In addition, the embodiment apparatus of the present invention can be used for automatic evaluation of Windows (registered trademark) applications. FIG. 55 shows such an embodiment. With such a configuration, for example, input from an input device such as a mouse or keyboard 601 of a personal computer 600 in which Windows (registered trademark) is installed can be pseudo-automatically operated, and simultaneously with other manipulators. Since it can be used, it is possible to perform a cooperation test with a PC while operating the mobile phone with the XY robot 10.

The flow of an application collaboration test performed using a personal computer (hereinafter referred to as a client PC) 600 in which Windows (registered trademark) is installed will be described with reference to FIGS. 55 and 56.
First, the client PC 600 is operated by the embodiment apparatus of the present invention. The desktop screen of the client PC 600 is displayed as a pseudo screen on the display of the monitor 9 of the embodiment of the present invention. When this pseudo screen is operated with the keyboard 8a and mouse 8b on the side of the embodiment of the present invention, the client PC 600 is simultaneously operated. The operation content is automatically input as a scenario (FIG. 56A).

  Next, both the robot 10 and the client PC 600 are operated. As shown in FIG. 56 (B), the pseudo screens of both the robot 10 and the client PC 600 can be operated by switching the screen. For example, by combining the operation of the robot 10 and the operation of the client PC 600, the mobile phone 1 from the client PC 600, for example. A test is performed in which the client PC 600 and the mobile phone 1 which is a test target device are linked, such as performing a music search by operating. Although not shown, the test result is stored in the database, and the expected value and the actual measurement value are automatically compared and determined. For example, images on both the mobile phone 1 side and the client PC 600 side that are evaluation target devices are determined. The determination result may be stored in a database, for example.

  In addition, as shown in FIG. 57A, the embodiment apparatus of the present invention can control one apparatus of the present invention and one robot 10 in correspondence with each other, as shown in FIG. It is also possible to control the two robots 10 and 20 with one device of the present invention. If the control of the two robots 10 is performed with one scenario created in advance, the maintenance work of the scenario is reduced, and the introduction cost can be reduced because only one computer 8 is used for the control. As shown in the figure, the robot may be a different model or the same model.

  As shown in FIG. 58, in the present invention, a state created with a CASE tool (for example, ZIPC: product name) that supports development for an embedded system used for an inspection target device or inspection target device such as the mobile phone 1 A configuration is also possible in which at least the pseudo-input means is cooperatively operated based on an event that changes, and a pseudo-input procedure for the mobile phone 1 or the like to be inspected is created based on the cooperative operation.

  The embodiment described above is about whether or not the expected value image and the execution image match. However, this embodiment does not match the expected value image and the execution image. It is intended to detect images that are difficult to display or cannot be displayed by comparing them with expected value images. For example, images due to software bugs, mechanical changes due to gear changes during vehicle operation, etc. Checking the functions of devices and apparatuses by an approach opposite to the previous embodiments 1 to 9, in which erroneous display such as a noise image generated on the screen of the car navigation device due to noise caused by the operation is detected in comparison with the expected value image. It is the Example of an apparatus. Since the basic configuration and software to be used are almost the same as those of the previous embodiment, a description thereof will be omitted, and a short-time erroneous display detection logic will be described.

  In this embodiment, still image real-time determination is performed for short-time erroneous display detection. The process and logic will be described. However, the above-described still image determination function may not be able to handle the above-described short-time erroneous display detection. In other words, it may be impossible to capture changes in the screen display that transition in a short time. In order to capture the situation where such a short-time transition screen occurs, it is possible to shorten the execution interval of still image determination. However, each time a still image determination process takes one image, the captured image is saved as a file. In addition, since the process of registering in the database for recording the test results of the apparatus according to the embodiment of the present invention is performed, it takes about 600 milliseconds at the minimum to shoot one still image. For this reason, it is impossible to reliably shoot and determine a short-time erroneous display screen that is displayed only for about 200 milliseconds by the processing of the above-described embodiment.

  Therefore, in this embodiment, in order to solve this problem, a still image real-time determination function is used. As an outline of this processing, still image determination using three expected value images is performed, and still images are continuously taken for a certain period of time, and a still image is acquired every time an image is acquired. A comparison determination process is performed to obtain a determination result.

As processing details,
(1) Three images before transition (A), during transition (B), and after transition (C) are set as an expected value group (see FIG. 59).
(2) Images are continuously acquired as still images, and determination is made immediately upon acquisition.
(3) In order to speed up the processing, the image data is handled on-memory without sequentially storing the acquired images in a file.
(4) The flow of processing is as follows.
The expected values A, B, and C are compared with the acquired image, and the expected value compared with the acquired image is performed according to the time series of screen transitions. That is, the order of screen transition is determined based on the premise that A → B → C, and the flow described below is performed.

That is,
(1) After the start of determination,
(2) Determine whether the acquired image is the same as the expected value A,
(3) When the image of the expected value A is obtained, it is determined whether it is the expected value A or the expected value B from the next time on,
(4) When an image of the expected value B is obtained, it is determined whether it is the expected value B or the expected value C after the next
(5) When an image of the expected value C is obtained, determine how long the expected value C is continuous, and then
(6) End the determination.

  According to the above processing flow, the expected value to be compared with the acquired image is a minimum of 1 and a maximum of 2 at each stage. Even if the expected value image exceeds three images, the expected value to be compared with one acquired image is “current image” and “next transition image”, and the two images are always sufficient. Become.

  Then, if a determination result that the content of the acquired image (see, for example, FIG. 60) is not one of the two expected values occurs at each stage, the number of frames that have continued is measured. If this measured value reaches the number of frames set as the determination threshold, the determination result is NG. This is a determination that pays attention to how long the number of frames of an image presumed to be not normal display (erroneous display) is displayed. In the case of normal screen transition, in the process of rewriting the display from the expected value A to the expected value B, an appropriate erroneous display and a corresponding number of frames (display time) are required for human recognition. On the contrary, when the display time is extremely short, the determination is based on the concept of being within the allowable range.

  Next, as the end condition of the determination process, the number of times that the expected value C is displayed (the number of times of continuation) is set. OK and the determination process ends. Further, in order to prevent a permanent loop of processing, a timeout is separately provided, and when the timeout is reached, it is regarded as a determination NG.

An example of the determination flow is shown below. A, B, and C are the above expected values.
Judgment start → A → A → A + B? → A + B? → A + B? → B → B → B → B + C? → B + C? → C → C → C → C → End of determination Here, in the above flow, A + B? , B + C? Represents an NG image (for example, an image as shown in FIG. 60) that does not match any of the three expected values. In this case, if the darkness value is set to 3, the determination NG is confirmed. Here, if the darkness value is set to 4, the determination is suspended and the process is continued. If the number of continuations of the expected value C is set to 4, the determination is terminated, and the determination result is OK.

The storage of data obtained by the above processing will be described.
In the embodiment described above, the acquired image is stored in the result database one by one. However, in the determination process of the present embodiment, a faster image acquisition operation is required, so the acquired image is stored in the database. Instead, after a series of processing is completed, it is saved as a file in a specified folder in the computer. Instead, only the path of the folder storing the acquired image and the determination processing result (OK / NG) are stored in the database. This can greatly reduce the time taken to save in the database.

Note that an RGB input frame grabber is preferably used for capturing an image. This
(1) Reduction of missing data by capturing up to 30 frames per second,
(2) Distortion correction unique to camera capture, improved processing speed by omitting position correction,
This is because high-speed operation can be expected.

  In addition, it is preferable that the user can set whether or not to continue the processing operation after determining and recognizing the image as an NG image, but it is automatically stopped or the processing is forcibly continued to the end. Various appropriate processing modes may be employed. In addition, as for the criteria for determining whether an image is NG, various criteria can be considered depending on the inspection device target, so that an optimum one may be considered and adopted, and is not limited to the example described and illustrated. .

  Next, an embodiment for performing still image determination using two expected value images will be described. In this embodiment, a still image is continuously taken for a certain period of time, a still image is acquired at every image acquisition timing, a comparison determination process with two expected values is performed, and a determination result is obtained.

As processing details,
(1) Two images before transition (A) and after transition (B) are set as expected values (for example, images A and B similar to those in FIG. 59 are set).
(2) Images are continuously acquired as still images, and determination is made immediately upon acquisition.
(3) The images A and B are compared with the acquired images, and an NG determination is made based on how many frames the determination result that is neither of the two images continues.
(4) The flow of processing is as follows.
That is, pay attention to how long the misdisplay time lasts.
For example, image transition
A → A → A + B? → A + B? → A + B? → B → B → B → B
(A + B? Is the same as in the previous embodiment in that it represents an image that does not match any of the expected values.) The end condition of the determination process is the circular (continuous) where image B is displayed. The image acquisition and determination process is terminated in a state where the number has been reached. In order to prevent an endless loop, it seems that an additional timeout may be provided.

The storage of data obtained by the above processing will be described.
As in the previous embodiment, since a high-speed image acquisition operation is required, the acquired image is not stored in the database, and the measured value file is stored in a designated folder in the computer after the series of processing is completed. Eliminates the time it takes to save

  A description of a scenario for the above processing will be described. First, invoking the image acquisition / determination operation, for example, without using a PIC / STILL command used for this type of processing, that is, not executing with a basic command, but adding a new dedicated plug-in command Can also be dealt with. In other words, a method of notifying a processing request to the pseudo screen via a plug-in command can be used. In addition, the plug-in command can be used for the determination result as well as the processing request. In that case, it is also possible to obtain the result of the pass / fail judgment by obtaining the judgment result from the return value of the plug-in command and writing the result in the database. Further, the path of the folder in which the actually measured value image is stored can be acquired by the plug-in command as well as the processing result, and the contents can be recorded in the database.

  Finally, reference to the determination result will be described. As described above, the saved folder path information obtained by the basic command or the plug-in command is referred to by the variable viewer on the result screen, and an explorer or the like is started from there to refer to the progress of the actually measured image.

  Note that it is preferable to use an RGB input frame grabber for capturing images, and the description is omitted because it is the same as in the previous embodiment.

  Although the present invention has been described above, input from an external contact with an article is, for example, pressing a button, rotating a knob, touch / drawing input to a touch panel, voice input, an image signal from a camera, etc. Output means for sending external output including image and sound in response to external input including input, internal signal changes corresponding to wired signal input from connector, radio input by radio wave and infrared, and changes in internal status It is possible to make a device provided with

  Further, a plurality of buttons can be sequentially or simultaneously pressed using a robot having an appropriate degree of freedom (for example, 3 axes, 6 axes). Particularly when a multi-axis robot is used, buttons and knobs arranged in a three-dimensional manner can be accurately operated.

  In addition, as a pseudo input means, the inspection target device is a knob rotation, touch / drawing input to the touch panel, audio input, external input including image signal input from a camera, etc., wired signal input from a connector, radio wave In the case of the wireless input by infrared rays, the external input can easily make an output corresponding to these.

  For testing when the device to be inspected is a mobile phone or car navigation system, test in an environment connected to externally connected devices such as programmable power supplies, radio wave generators, signal generators, measuring instruments, and their control software. However, in the present invention, as a function of external device control, by describing control statements to these external devices in a scenario, communication with external control module software that controls each device is performed. , You can perform linked tests. In this case, an external control module is prepared for each connected device, and the external device is controlled by the external control module through communication according to the protocol specified in the system, or a value is obtained and passed to the system of the present invention. It becomes.

  The present invention can be applied to a mobile phone, PHS, PDA, game machine, notebook personal computer, car navigation device, panel display device, and the like.

The perspective view which shows notionally one Example of the function check apparatus of the apparatus which concerns on this invention, and an apparatus The perspective view which shows the plunger unit provided with many adapter units and plungers used instead of a release when an inspection object apparatus is a mobile phone. The perspective view which shows notionally the modification of the adapter unit for hold | maintaining a mobile telephone The perspective view which shows notionally the modification of the adapter unit for hold | maintaining a mobile telephone Side view of base unit for mounting camera etc. Side view showing the structure of the release Diagram showing the contents of the screen displayed as the main screen on the monitor Figure showing key button range specification on the main screen Figure showing the mobile phone information setting screen Figure showing the button information setting screen Figure showing the button information list screen The figure which shows the example of the release number input in the information setting of the key button Figure showing the reset button setting screen Figure of model file editing screen The figure which shows the adjustment screen of the LCD panel screen which is displayed on the monitor Figure showing the screen for checking the corrected image Diagram showing calibration sheet Figure of distortion acquisition wizard screen Figure showing the scenario creation edit screen Diagram showing an example of calling multiple scenarios Figure showing the contents of the expected value setting tab Figure showing button correspondence table Figure showing the execution screen Figure showing an error report 6 is a flowchart showing an image determination processing operation of an embodiment of the mobile phone inspection device according to the present invention. Flow chart showing the voice determination processing operation The figure which shows the threshold value determination process during the still image determination processing operation The figure which shows the brightness correction processing during the still image determination processing operation The figure which shows an example of the same image determination processing operation The figure which shows the area | region identification process in the still image determination process operation Flowchart showing the still image determination processing operation Flow chart showing the same moving image determination processing operation The figure which shows an example of the moving image determination processing operation The figure which shows an example of the moving image determination processing operation The figure which shows an example of the moving image determination processing operation The figure which shows an example of the moving image determination processing operation The figure which shows an example of the moving image determination processing operation Flowchart showing the DTM sound determination processing operation Flowchart showing the same BT / RBT sound determination processing operation Flow chart showing the melody determination processing operation The figure which shows the frequency information corresponding to a DTMF number The figure which shows the robot used for the automatic test with respect to PDA, and the operation | movement of the robot Diagram showing the flow of the test The figure which shows the judgment of the same test result The figure which shows the example which made the evaluation object equipment car navigation and car audio The figure which shows the control example of the power source as inspection related to the car Diagram showing an example of cooperation with the CAN simulator Figure showing an example used to determine spoken language The figure which shows the example which handles the image data which a touch panel etc. output by RGB input Diagram showing an example of cooperation with a programmable display The figure which shows the example which performs character recognition by OCR and guides the arm and plunger of the robot to the coordinate position of the detected character The figure which shows the example for the digital household appliances which can perform infrared remote control operation The figure which shows the modification of the example of FIG. The figure which shows the example of the infrared remote control which has the function where the operation contents become the test scenario as it is The figure which shows the example which is used for automatic evaluation of Windows (registered trademark) application The figure which shows the flow of cooperation test of Windows (registered trademark) application The figure which shows the example which controls two robots with one device of the present invention Diagram showing an example of cooperation with the CASE tool that provides development support for embedded systems The figure which shows the image of before transition (A), in transition (B), and after transition (C) used in Example 10 The figure which shows the example of the image determined to be a NG image in Example 10.

Explanation of symbols

1 Evaluation machines (cell phones, PDAs, etc.)
2 Adapter unit 3 LCD panel 3a LCD panel image 4 Camera 5 Operation buttons (key buttons)
6 Release 7 Plunger Unit 8 Computer 8a Keyboard 8b Mouse 9 Monitor 10 Robot 11 Display Unit 12 Operation Unit Plunger Unit 20
21 Adapter unit base plate 22 Inclined plate 23 Release guide panel 24 Side plate 25 Hole 26 Speaker 30 Base unit 31 Base unit base plate 32 Microphone 33 Tower 35 Microphone 40 Calibration sheet 50 Scenario list box 51 Command setting tab 52 Information setting Part 53 Expected value image display space 61 Release tube 62 Pin 63 Metal pipe part 64 Screw thread 65 Lock screw 66 Adjustment screw 80 Scenario list box 81 Execution designation part 82 Execution status display part 83 Scenario list list box 84 Current scenario box 85 Expected value Image display unit 86 Execution LCD image display unit 101 Support member 101a Guide support member 101b Parent slider 101c Child slider 101d Support member 102 for holding Mobile phone lid 10 Elastic member 200 six-axis robot 202 dials 204 adapter 206 CD changer 208 CD
210 Car navigation system 212 DVD
300 CAN simulator 302 Microphone 400 Digital home appliance 401 Controller 402 Infrared transmitter 500 Infrared remote controller 501 Button 600 PC 601 Keyboard

Claims (13)

It is a function check device for an apparatus or device for checking one or more inspection target devices or inspection target devices having an output means that changes the form or operation to be exposed to the outside in response to an external input. ,
In the device for checking the function of the device to be inspected or the device to be inspected by generating the external display form and operation state of the device to be inspected or the device to be inspected in a pseudo or practical manner, the function check device of the device ,
A pseudo input means for applying a pseudo input corresponding to the input from the outside to the inspection target device or the inspection target device;
Check target output detection means for detecting the output to be checked generated by the output means of the inspection target device or the inspection target device in response to an input by the pseudo input means;
A pseudo input procedure setting unit capable of designating an input procedure by the pseudo input unit; and an operation or output of the check target output detection unit by a pseudo input inputted in accordance with a procedure designated by the pseudo input procedure setting unit; Confirmation means for confirming consistency with the expected expected value of the external state of the inspection target device or inspection target device by the actual input corresponding to the pseudo input, the operation state,
A device and device function check device. In the function check apparatus of the apparatus and apparatus of Claim 1,
An apparatus and a function check apparatus for an apparatus and apparatus, wherein the pseudo input unit is arranged for each inspection target device or inspection target device, and the confirmation unit is shared even if there are a plurality of pseudo input units. In the function check apparatus of the apparatus and apparatus of Claim 1 or 2,
The function checking device for a device or apparatus, wherein the checking means includes means for performing a determination by fuzzy control for checking the consistency. In the function check apparatus of the apparatus in any one of Claim 1 thru | or 3,
Display the operation or output of the check target output detection means by the pseudo input input according to the procedure specified by the pseudo input procedure setting means on the display means of the inspection target device or the inspection target device,
Recognizing means for recognizing the content displayed on the display means, and changing a position of application of the pseudo input by the pseudo input means to the inspection target device or inspection target device according to the position of the target content. Device and function check device for equipment. In the function check apparatus of the apparatus and apparatus in any one of Claims 1 thru | or 4,
The pseudo-input means is capable of executing a procedure different from the procedure being executed in a predetermined cycle or in a pre-specified order during execution of one procedure of a certain pseudo-input, Device function check device. In the function check apparatus of the apparatus and apparatus in any one of Claims 1 thru | or 5,
The pseudo input unit includes a voice input unit and a voice determination unit that automatically determines the content of the voice input from the voice input unit;
A function check apparatus for an apparatus or apparatus, wherein the voice determination means applies a pseudo input corresponding to the input event from the outside to the inspection target apparatus or the inspection target apparatus. In the function check apparatus of the apparatus and apparatus in any one of Claims 1 thru | or 5,
Means for cooperating at least the pseudo input means based on an event that changes a state created by a CASE tool that supports development for an embedded system used for the inspection target device or inspection target apparatus;
Based on at least the cooperative operation by the pseudo input means, and having means for creating an input procedure by the pseudo input means for the inspection target device or inspection target device,
A function check device for equipment and devices. In the function check apparatus of the apparatus in any one of Claim 4 thru | or 7,
Imaging means for obtaining an image by imaging the content displayed on the display means included in the inspection target device or the inspection target device;
A function check device for an apparatus or device, comprising: mounting means for mounting the inspection target device or the inspection target device in a predetermined state and interchangeably on the imaging means. In the function check apparatus of the apparatus and apparatus in any one of Claims 1 thru | or 8,
The inspection object device or the inspection object device is provided with any of voice input means, image signal input means, wired signal input means, radio input means using electromagnetic waves including radio waves and infrared rays. Function check device. In the function check apparatus of the apparatus and apparatus in any one of Claim 1 thru | or 9,
A function check device for equipment and devices, wherein the adapter is equipped with a sound collecting microphone and / or speaker. In the function check apparatus of the apparatus and apparatus in any one of Claims 1 thru | or 10,
The function check device for an apparatus or device, wherein the adapter covers at least an operated part of the mounted inspection target device or inspection target device, and has a hole or an opening that allows input by the pseudo input means.   12. A function check apparatus for a device or apparatus according to claim 7, wherein the imaging means is for obtaining a still image and / or a moving image. In the function check apparatus of the apparatus in any one of Claims 7 thru | or 12,
An apparatus and a function check apparatus for an apparatus, characterized in that the mounting means includes a removable elastic member for holding the inspection object apparatus or the inspection object apparatus by a plurality of movable or fixed support members.