JP2014010628A - Inspection device, inspection system, inspection method, portable terminal and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently and accurately inspect layout of icons in kitting of a portable terminal.SOLUTION: An inspection device 100 for inspecting a portable terminal comprises: a first acquisition unit which acquires an image of a prescribed screen displayed in a first portable terminal which is an inspection standard; a second acquisition unit which acquires an image of a prescribed screen displayed in a second portable terminal which is an inspection target; and a comparison unit which compares a first image acquired by the first acquisition unit with a second image acquired by the second acquisition unit for a prescribed comparison area and specifies a coincident area and a non-coincident area between the first image and the second image.

Description

  The present invention relates to an inspection apparatus, an inspection system, an inspection method, a portable terminal, and a program.

  2. Description of the Related Art An operation for setting a device such as a PC (Personal Computer) according to a customer's request before shipping the product to the customer (for example, also called “kitting”) is known. In this kitting, for example, an operator installs application software and tools designated by a customer on a PC to be shipped, or sets a communication environment setting designated by the customer.

  In recent years, kitting is performed not only on PCs but also on mobile terminals such as smartphones and tablet terminals. As a technique related to kitting for a portable terminal, for example, there is Patent Literature 1.

  Also, recent mobile terminals are mainly provided with a touch panel. In a mobile terminal equipped with such a touch panel, for example, icons corresponding to each application or tool are arranged on the home screen (also referred to as “top screen” or “desktop screen”), and the application can be made by touching the icon. And tools can be started easily.

JP 2011-3053 A

  For a mobile terminal having the above touch panel, there is a customer's request for the arrangement of icons displayed on the home screen (icon positions, order, etc.). And it is necessary to kit the icon arrangement requested by the customer on the portable terminal.

  However, the arrangement of the icons of the mobile terminal needs to be changed manually (for example, by a touch and drag operation). Therefore, an incorrect icon arrangement may be set due to an operator's mistake.

  Further, whether or not the icon arrangement is correctly set is determined by the operator confirming with eyes. For this reason, if there is an operator's judgment error, the incorrect icon arrangement is not set correctly. Here, since the data specifying the position of each icon on the home screen cannot be easily obtained from the portable terminal, it cannot be automatically inspected by the computer.

  Therefore, an object of the present invention is to provide a technique for efficiently and accurately inspecting icon arrangement in portable terminal kitting.

  The present application includes a plurality of means for solving at least a part of the above-described problems. Examples of such means are as follows.

  One aspect of the present invention that solves the above problem is an inspection device that inspects a mobile terminal, and a first acquisition unit that acquires an image of a predetermined screen displayed on the first mobile terminal that is an inspection standard A second acquisition unit that acquires an image of a predetermined screen displayed on the second portable terminal to be inspected, the first image acquired by the first acquisition unit, and the second acquisition A comparison unit that compares the second image acquired by the unit with respect to a predetermined comparison area and identifies a matching area and a mismatching area between the first image and the second image, It is characterized by that.

  Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

1 is a schematic diagram of an inspection system 1 according to a first embodiment of the present invention. The figure which shows the home screen (capture image) of the portable terminal 200. FIG. The flowchart explaining the setting of a home screen and the process of a test | inspection. 1 is a schematic diagram of an inspection apparatus 100. FIG. 1 is a schematic diagram of a computer 900. FIG. 6 is a flowchart of a home screen inspection process of the inspection apparatus 100. The figure which shows the image selection screen 1000 which the test | inspection apparatus 100 outputs. The figure which shows the comparison range setting screen 1100 which the test | inspection apparatus 100 outputs. The figure which shows the test result screen 1200 which the test | inspection apparatus 100 outputs. The figure which shows the setting screen (capture image) of the application of the portable terminal 200 which concerns on 2nd embodiment of this invention. The figure which shows the test result screen 1300 which the test | inspection apparatus 100 outputs.

<First embodiment>
An example of the first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic diagram of an inspection system 1 according to the first embodiment of the present invention. As illustrated, the inspection system 1 includes an inspection device 100 and mobile terminals 200 (200A, 200B).

  The inspection device 100 and the portable terminal 200 are connected by, for example, a USB (Universal Serial Bus) or the like, and can transmit and receive information to and from each other. The mobile terminal 200 may be connected to the inspection apparatus 100 with a separate USB cable, or may be bundled via a USB hub apparatus and connected to the inspection apparatus 100.

  Here, the mobile terminal 200A is a terminal that serves as an inspection standard (sample) of the home screen, and one mobile terminal is prepared. The mobile terminal 200B is a terminal to be inspected on the home screen, and at least one mobile terminal 200B is prepared.

  Although details will be described later, in the present embodiment, the home screen is set manually for the mobile terminal 200A. On the other hand, the same home screen setting is performed on the portable terminal 200B by using the portable terminal 200A as a sample. As the home screen setting, at least the icon arrangement is set. Setting of a wallpaper that is a background image may be performed.

  Whether the home screen of each mobile terminal 200B is set correctly by comparing the captured image of the home screen of the mobile terminal 200A with the captured image of the home screen of each mobile terminal 200B using the inspection apparatus 100. A check is made for no.

  In this embodiment, since inspection is performed by comparing captured images, it is assumed that the mobile terminal 200A and the mobile terminal 200B are the same model (for example, the display size of the display is the same). That is, it is assumed that the comparison results match between home screens set with the same icon arrangement and wallpaper. Of course, different models may be used as long as the comparison results of the home screens set with the same icon arrangement and wallpaper match.

  The configuration of the inspection system 1 in FIG. 1 is not limited to the above-described configuration because the main configuration has been described in describing the features of the present invention. Further, the configuration of a general inspection system is not excluded.

  For example, the mobile terminal 200 and the inspection apparatus 100 can transmit and receive information via a communication network (for example, a mobile phone network, a wireless LAN network, a wired LAN network, a combination of these networks, etc.). Good.

  FIG. 2 is a diagram illustrating a home screen (capture image) of the mobile terminal 200. As illustrated, the home screen of the mobile terminal 200 includes a notification area 210 and an icon area 220.

  In the notification area 210, for example, images such as the radio wave status of the mobile terminal 200, the current time, and the remaining battery level are displayed. The mobile terminal 200 updates the radio wave status, the current time, the remaining battery level, etc. at a predetermined timing, and updates and displays the corresponding image.

  In the icon area 220, an icon image 230 (A, B, C, D, E, and F in the figure) corresponding to an application installed in the mobile terminal 200 and a wallpaper image 240 that is a background image of the icon area 220 are displayed. (Omitted in the figure) is displayed. The positions where the icon images 230 can be arranged are determined in advance as a plurality of aligned predetermined positions (for example, four horizontal and four vertical). Of course, you may arrange | position freely in arbitrary positions.

  The operator can appropriately set which application icon image 230 is displayed in the icon area 220. Further, as described above, the arrangement of the icon images 230 and the selection of the wallpaper image 240 can be appropriately set by the operator.

  The display mode of the home screen in FIG. 2 is an example, and the present invention is not limited to this.

  FIG. 3 is a flowchart for explaining the home screen setting and inspection process. The following description is based on the assumption that an application requested by a customer has been installed in each mobile terminal 200.

  First, the kitting worker sets the home screen of the portable terminal 200A, which is an inspection standard, according to the home screen setting requested by the customer (S1). The icon arrangement and the wallpaper change can be realized by an existing operation method such as a touch and drag operation or a menu operation, and are not particularly limited.

  Then, the kitting worker captures the home screen of the mobile terminal 200A (S2). Capture of the home screen can be realized by an existing capture function (for example, capture is executed by a specific button operation and a captured image is stored in a predetermined folder) provided in the mobile terminal 200A in advance. There is no particular limitation. The captured image of the home screen generated by the capture function is stored, for example, in the memory or HDD (Hard Disk Drive) of the mobile terminal 200A.

  Then, the kitting worker stores the captured image of the home screen of the mobile terminal 200A generated in step S2 in the inspection apparatus 100 (S3). Transfer and storage of an image to the inspection apparatus 100 can be realized by an existing method such as transfer via a USB cable, and is not particularly limited.

  On the other hand, the kitting worker sets the home screen of the portable terminal 200B to be inspected for which setting has not been completed in accordance with the home screen setting requested by the customer or the home screen setting of the portable terminal 200A (S4). Further, the home screen of the mobile terminal 200B is captured (S5). Then, the captured image of the home screen of the mobile terminal 200B generated in step S5 is stored in the inspection apparatus 100 (S6).

  Then, the kitting worker determines whether or not the setting of the home screen and the saving of the captured images of all the portable terminals 200B to be inspected have been completed (S7). When the settings of all the mobile terminals 200B are not completed (S7: N), the process returns to step S4 to set the home screen for the mobile terminals 200B for which the settings have not been completed.

  When the setting of all the mobile terminals 200B is completed (S7: Y), the kitting worker uses the inspection device 100 to inspect the home screen of each mobile terminal 200B (S8). Further, the kitting worker checks the inspection result of each portable terminal 200B generated by the inspection device 100.

  Then, the kitting worker determines whether or not the inspection results of all the mobile terminals 200B are normal (the home screen setting matches the home screen setting of the mobile terminal 200A) (S9).

  If there is a mobile terminal 200B with an abnormal test result (S9: N), the kitting operator returns to step S4 to reset the home screen for the mobile terminal 200B with an abnormal test result.

  If the inspection results of all the mobile terminals 200B are normal (S9: Y), this flow ends.

  The home screen setting and inspection process in FIG. 3 is an example, and the present invention is not limited to this. For example, in FIG. 3, all the mobile terminals 200 </ b> B are inspected together, but may be performed one by one. Further, for example, if the inspection can be performed by storing the captured image in the inspection apparatus 100, the order of the processes in the flow is not particularly limited.

  Next, the configuration of the inspection apparatus 100 will be described in detail. The following description is based on the assumption that the captured image of the home screen of the mobile terminal 200A and the captured image of the home screen of each mobile terminal 200B are stored in the inspection apparatus 100.

  FIG. 4 is a schematic diagram of the inspection apparatus 100. As illustrated, the inspection apparatus 100 includes a control unit 110, a storage unit 120, an input unit 130, an output unit 140, a communication unit 150, and an interface unit 160.

  The control unit 110 includes an input / output control unit 111, an image acquisition unit 112, an image cutout unit 113, an image comparison unit 114, and an inspection result generation unit 115.

  The input / output control unit 111 outputs a user interface screen for receiving a predetermined operation from the operator via the output unit 140. In addition, a predetermined operation is received from the operator via the input unit 130.

  Although details will be described later, the input / output control unit 111, for example, from the captured image 121 stored in the storage unit 120, a captured image of the home screen of the inspection-standard mobile terminal 200A (hereinafter referred to as “inspection reference image”). And the selection of a captured image of the home screen of the portable terminal 200B to be inspected (hereinafter also referred to as “inspection image”).

  For example, the input / output control unit 111 receives a setting of a range (region) to be compared between the inspection reference image and the inspection target image.

  Further, for example, the input / output control unit 111 displays the result of comparison with the inspection reference image within the set comparison range for each inspection target image based on the inspection result 122 stored in the storage unit 120.

  The image acquisition unit 112 acquires from the storage unit 120 the inspection reference image and the inspection target image selected by the operator via the input / output control unit 111.

  The image cutout unit 113 cuts out an image included in the comparison range set by the input / output control unit 111 (hereinafter also referred to as “comparison reference image”) from the inspection reference image acquired by the image acquisition unit 112. In addition, an image included in the comparison range set by the input / output control unit 111 (hereinafter also referred to as “comparison target image”) is cut out from each inspection target image acquired by the image acquisition unit 112.

  The image comparison unit 114 compares each comparison target image cut out by the image cutout unit 113 with the comparison reference image cut out by the image cutout unit 113.

  Here, as described above, the sizes (for example, the number of pixels in the vertical and horizontal directions) of the home screen displayed on the mobile terminal 200A and the mobile terminal 200B are the same. Therefore, in this embodiment, for example, the comparison reference image and the comparison target image are compared by comparing pixel values (for example, RGB gradation values) of pixels at corresponding positions (for example, pixel coordinates). .

  Of course, it is not necessary to compare all the pixels of the comparison reference image and the comparison target image. For example, when a wallpaper image is excluded from the inspection target, a comparison may be performed for a region (icon image) in which a predetermined icon can be arranged. Further, for example, a comparison may be performed on a region where predetermined lines are thinned out (for example, every several lines). Further, a combination of these methods may be performed for a predetermined line in a region where a predetermined icon can be arranged. In this way, the speed of the comparison process can be improved.

  As described above, the image comparison unit 114 compares the comparison reference image with the comparison target image, and specifies an area where the pixel values (images) match and an area where the pixel values (images) do not match.

  The inspection result generation unit 115 generates the inspection result 122 of the inspection target image of each portable terminal 200 </ b> B based on the comparison result of the image comparison unit 114 and stores it in the storage unit 120.

  For example, the inspection result generation unit 115 associates information for specifying a mismatch area with the comparison reference image with the inspection target image of each mobile terminal 200B, and stores the information in the storage unit 120.

  The storage unit 120 stores a captured image 121, an inspection result 122, and the like.

  The input unit 130 receives input of information. For example, an operation of an operator is accepted.

  The output unit 140 outputs information. For example, a user interface screen is displayed.

  The communication unit 150 transmits and receives information via a communication network (not shown). For example, a capture image is received from the mobile terminal 200.

  The interface unit 160 reads / writes information from / to a portable storage medium connected to the inspection apparatus 100 or a storage medium built in the apparatus connected to the inspection apparatus 100. For example, a captured image is read from the mobile terminal 200.

  The inspection apparatus 100 described above communicates, for example, with a CPU (Central Processing Unit) 901, a memory 902, and an external storage device 903 such as an HDD, as shown in FIG. 5 (schematic diagram of a computer 900). A communication device 904 for connecting to a network, an input device 905 such as a mouse and a keyboard, an output device 906 such as a liquid crystal display, and a read / write device 907 for reading and writing information on a recording medium such as a DVD (Digital Versatile Disk) And a USB interface (I / F) 908 for USB connection and communication. More specifically, the computer 900 is a device such as a PC.

  For example, the control unit 110 can be realized by loading a predetermined program stored in the external storage device 903 into the memory 902 and executing it by the CPU 901. The storage unit 120 can be realized by the CPU 901 using the memory 902 or the external storage device 903. The input unit 130 can be realized by the CPU 901 using the input device 905. The output unit 140 can be realized by the CPU 901 using the output device 906. The communication unit 150 can be realized by the CPU 901 using the communication device 904. The interface unit 160 can be realized by the CPU 901 using the USB interface 908.

  The predetermined program may be downloaded from the network to the external storage device 903 via the communication device 904, and then loaded onto the memory 902 and executed by the CPU 901. Alternatively, it may be directly loaded onto the memory 902 from the network via the communication device 904 and executed by the CPU 901. Further, the computer 900 may load the predetermined program from the storage medium connected to the USB interface 908 into the external storage device 903 or the memory 902.

  The predetermined program can be realized by, for example, an application program that operates on an OS (Operating System) of the inspection apparatus 100. Of course, part or all of it may be realized by another program such as an OS.

  The mobile terminal 200 described above includes, for example, an unillustrated CPU, an external storage device such as a memory and an HDD, a wireless communication device for connecting to a communication network wirelessly, an input device such as a touch sensor and a touch panel, This can be realized by a computer including an output device such as a liquid crystal display, a voice input / output device such as a microphone or a speaker, a USB interface for connection and communication via USB, and an acceleration sensor such as a triaxial acceleration sensor module. More specifically, the computer is a device such as a smartphone, a mobile phone, a tablet terminal, or a PDA (Personal Digital Assistants).

  Note that the configuration of the inspection apparatus 100 in FIG. 4 is classified according to the main processing contents in order to facilitate understanding. The present invention is not limited by the way of classification and names of the constituent elements. The configuration of the inspection apparatus 100 can be classified into more components depending on the processing content. Moreover, it can also classify | categorize so that one component may perform more processes. Further, the processing of each component may be executed by one hardware or may be executed by a plurality of hardware. Further, the processing of each component may be realized by one program or may be realized by a plurality of programs.

  FIG. 6 is a flowchart of the inspection process on the home screen of the inspection apparatus 100. The process of this flowchart starts, for example, when the predetermined program is activated by an operator's operation. Note that the processing of this flowchart corresponds to the above-described step S8 (see FIG. 3).

  First, the input / output control unit 111 outputs a user interface screen that accepts selection of a captured image of the inspection standard portable terminal 200 </ b> A via the output unit 140, and selects an inspection standard image via the input unit 130. Accept from the worker (S101).

  In addition, the input / output control unit 111 outputs a user interface screen that accepts selection of a captured image of the portable terminal 200B to be inspected via the output unit 140, and selects the inspection target image via the input unit 130. Accepted from the worker (S102).

  For example, as shown in FIG. 7 (a diagram showing an image selection screen 1000 output by the inspection apparatus 100), the input / output control unit 111 selects an area 1010 for selecting an inspection reference image file and an inspection target image file. The image selection screen 1000 including the area 1020 to be displayed is displayed. In the area 1010 and the area 1020, for example, a list of files stored in the storage unit 120 can be displayed by specifying a file path, and one or more files can be selected.

  In the example of this figure, the inspection reference image file “ID_A.bmp” of the mobile terminal 200A is selected in the area 1010. In addition, an inspection target image file “ID_B.bmp” of a certain mobile terminal 200B and an inspection target image file “ID_C.bmp” of another mobile terminal 200B are selected in an area 1020.

  The input / output control unit 111 receives the selection of the inspection reference image and the selection of the inspection target image on the image selection screen 1000 as described above. For example, when the “OK” button on the image selection screen 1000 is selected, the input / output control unit 111 may confirm the image selection and hide the image selection screen 1000.

  Returning to FIG. 6, the image acquisition unit 112 acquires the inspection reference image selected in step S101 and the inspection target image selected in step S102 from the storage unit 120 (S103).

  Then, the input / output control unit 111 outputs a user interface screen that accepts the setting of a range to be compared between the inspection reference image and the inspection target image via the output unit 140, and also outputs the user interface screen via the input unit 130. The setting of the comparison range is accepted from the worker (S104).

  For example, as shown in FIG. 8 (a diagram showing the comparison range setting screen 1100 output from the inspection apparatus 100), the input / output control unit 111 displays an area 1110 for displaying an inspection reference image and an area for displaying each inspection target image. The comparison range setting screen 1100 including 1130 is displayed. In addition, the inspection reference image 1120 acquired in step S103 is displayed in the area 1110, and each inspection object image 1140 acquired in step S103 is displayed in the area 1130.

  In the example of this figure, the inspection reference image file “ID_A.bmp” of the mobile terminal 200 </ b> A is displayed in the area 1110. Further, the inspection target image file “ID_B.bmp” of a certain mobile terminal 200B and the inspection target image file “ID_C.bmp” of another mobile terminal 200B are displayed in the area 1130, respectively.

  In addition, the input / output control unit 111 accepts the setting of the comparison range 1150 (indicated by a broken line in the drawing) by, for example, a drag and drop operation in any of the region 1110 and each region 1130. Here, since the sizes of the captured images of the mobile terminal 200 are the same as described above, the comparison range is set for either the inspection reference image 1120 in the region 1110 and the inspection target image 1140 in each region 1130. The same applies to other images.

  In order to check whether the icon arrangement and wallpaper are set correctly, the operator basically uses the entire icon area 220 (see FIG. 2) or a part of the icon area 220 as a comparison range. Set. Since images (such as radio wave status and time) displayed in the capture image notification area 210 (see FIG. 2) differ depending on the mobile terminal, they are basically not included in the comparison range. By setting the comparison range in this way, it is possible to perform an efficient inspection specifying the inspection location.

  The input / output control unit 111 receives the setting of the comparison range between the inspection reference image and the inspection target image on the comparison range setting screen 1100 as described above. Note that, for example, when the “OK” button on the comparison range setting screen 1100 is selected, the input / output control unit 111 may confirm the setting of the comparison range and hide the comparison range setting screen 1100. When the “return” button on the comparison range setting screen 1100 is selected, the comparison range setting screen 1100 may be hidden and the process may return to step S101.

  In the above description, the comparison range is set as one connected region, but may be set in a plurality of regions, for example. Further, the shape of the comparison range is not limited to a rectangle, and for example, an operator may be able to freely set.

  Returning to FIG. 6, the image cutout unit 113 cuts out the comparison reference image included in the comparison range set in step S104 from the inspection reference image acquired in step S103 (S105).

  And the process of this flow progresses to the process (S106-S109) for every portable terminal 200B to be examined.

  First, the image cutout unit 113 selects one inspection target image that has not been inspected from the inspection target images acquired in step S103, and enters the comparison range set in step S104 from the inspection target image. The comparison target image included is cut out (S106).

  Then, the image comparison unit 114 compares the comparison reference image cut out in step S105 with the comparison target image cut out in step S106, and the pixel value (image) and the pixel value (image) match. A region that does not match is identified (S107). The comparison method is as described above. For example, the pixel values of the corresponding positions of the entire comparison range or a predetermined region may be compared.

  Then, the inspection result generation unit 115 generates the inspection result 122 of the inspection target image selected in S106 based on the comparison result in step S107, and stores it in the storage unit 120 (S108).

  For example, when a mismatch area with the comparison reference image is specified in step S107 in the comparison target image selected in step S106, the inspection result generation unit 115 adds the mismatch area to the inspection target image. Information to be identified and information indicating that the test result is abnormal are associated with each other and stored in the storage unit 120. On the other hand, when the mismatch area is not specified, information indicating that the inspection result is normal is associated with the inspection target image and stored in the storage unit 120.

  Then, the image cutout unit 113 determines whether or not the inspection has been completed for all of the inspection target images acquired in step S103 (S109). When the inspection of all the inspection target images is not completed (S109: N), the image cutout unit 113 returns the process to step S106.

  When the inspection of all the inspection target images is completed (S109: Y), the input / output control unit 111 displays the inspection result via the output unit 140 based on the inspection result 122 stored in the storage unit 120. (S110).

  For example, as shown in FIG. 9 (a diagram showing an inspection result screen 1200 output from the inspection apparatus 100), the input / output control unit 111 displays an area 1210 for displaying an inspection reference image and inspection results for each inspection target image. The inspection result screen 1200 including the area 1230 to be displayed is displayed. Further, the inspection reference image 1220 acquired in step S103 is displayed in the area 1210 together with the comparison range 1250 set in step S104. Further, each inspection target image 1240 for which the inspection result is generated in step S108 is displayed in each region 1230 together with the comparison range 1250 set in step S104.

  Further, the input / output control unit 111 displays an image 1260 indicating the mismatch area on the inspection target image 1240 based on the information for specifying the mismatch area for the inspection target image having an abnormal inspection result. In addition, an error is displayed. For the inspection target image whose inspection result is normal, the fact that it is normal is displayed.

  In the example of this figure, the inspection target image file “ID_B.bmp” of a certain mobile terminal 200B and the inspection target image file “ID_C.bmp” of another mobile terminal 200B are displayed in the area 1230, respectively. For the image file “ID_B.bmp” to be inspected, an image 1260 indicating a mismatch area is superimposed on the icons “C” and “B”. Also, “abnormal” characters are displayed in association with the file name. For the inspection target image file “ID_C.bmp”, “normal” characters are displayed in association with the file name.

  The operator can confirm the inspection result of the captured image of the portable terminal 200B to be inspected on the inspection result screen 1200 as described above. The input / output control unit 111 may hide the inspection result screen 1200 when, for example, the “OK” button on the inspection result screen 1200 is selected.

  Returning to FIG. 6, after the end of step S <b> 110, the control unit 110 ends the process of this flow. And an operator progresses to the process of step S9 of FIG.

  Note that the processing unit in the flowchart of FIG. 6 is divided according to the main processing contents in order to make the processing of the control unit 110 easy to understand. The present invention is not limited by the way of dividing the processing unit or the name. The processing of the control unit 110 can be divided into more processing units according to the processing contents. Moreover, it can also divide | segment so that one process unit may contain many processes. Further, the processing order of the above flowchart is not limited to the illustrated example.

  Moreover, the aspect of the user interface screen shown in FIGS. 7-9 is an example, and is not restricted to what was illustrated. For example, when the number of images to be inspected exceeds a predetermined number, it is difficult to display all the images on one screen, so that a predetermined number can be distributed and selectively displayed on a plurality of tabs or pages. What should I do? Further, for example, either one of the inspection target image and the inspection target image may be displayed on the comparison range setting screen 1100, and the inspection reference image may not be displayed on the inspection result screen 1200. .

  Further, for example, the image 1260 indicating the mismatch area is not limited to an image overlapping with the mismatch area specified by the inspection result as long as the operator can recognize the mismatch area. For example, it may be an image having a larger area than the non-matching region including the non-matching region, a ring image representing the outline of the non-matching region, or a ring image including the non-matching region.

  As described above, according to the first embodiment of the present invention, the inspection apparatus acquires the capture image of the home screen of the mobile terminal of the inspection reference and the capture image of the home screen of the mobile terminal to be inspected, and these Since the inconsistent area is identified by comparing the two, the icon arrangement and the wallpaper inspection in the kitting operation of the portable terminal can be efficiently and accurately performed.

<Second embodiment>
An example of the second embodiment of the present invention will be described focusing on differences from the first embodiment.

  In the first embodiment described above, the home screen on which the icons are arranged is the inspection target, but the inspection target is not limited to this. For example, data specifying the settings of each setting item of the application cannot be easily obtained from the mobile terminal, and therefore cannot be automatically inspected by a computer.

  Therefore, in the second embodiment, a setting screen displayed by the application is set as an inspection target. The application setting screen is, for example, a screen for accepting various settings related to the application displayed by a predetermined operation on the application after the application is started.

  FIG. 10 is a diagram illustrating an application setting screen (capture image) of the mobile terminal 200. As illustrated, the application setting screen includes a notification area 210, a finding area 260, and a setting item area 270. The notification area 210 is an area used in common with the home screen (see FIG. 2). That is, the display areas used by the application are the finding area 260 and the setting item area 270 other than the notification area 210 (see FIG. 2).

  In the heading area 260, a heading corresponding to the content of the screen displayed by the application is displayed. For the setting screen, for example, “setting” is displayed as shown in the figure.

  In the setting item area 270, one or more setting items 271 of the application are displayed so that the setting can be changed. The setting items include, for example, character size, volume, data communication permission, GPS position provision permission, etc., as shown. These setting items are displayed in a list as shown in the figure, for example. Of course, the above setting items are examples and are not limited. For example, setting items such as screen brightness and color may be included.

  As a user interface for changing the setting of the setting item, for example, a radio button capable of selecting one of options (in the figure, used for selecting a character size), a slide whose value can be continuously changed. It is used to set a bar (in the figure, used for setting the volume) and a check box (in the figure, availability of data communication, availability of GPS position provision) that can be selected to turn on or off the item. ),and so on. Of course, the above-described user interface for changing the setting is merely an example and is not limited. Other examples include a drop-down list, a button capable of selecting a plurality of options, and a color palette for selecting a color.

  The display mode of the application setting screen in FIG. 10 is an example, and the present invention is not limited to this.

  This embodiment is different from the first embodiment in that the inspection reference image and the inspection target image are application setting screens, but is basically the same as the first embodiment, and thus detailed description thereof is omitted. .

  The kitting worker manually displays the setting screen of the application for the same application of the portable terminal 200A and the portable terminal 200B, and sets each setting item according to the setting of the application requested by the customer. . And the setting screen of the said application of 200 A of portable terminals and the portable terminal 200B is captured, and it preserve | saves in the test | inspection apparatus 100. FIG.

  For example, as shown in FIG. 11 (a diagram showing an inspection result screen 1300 output by the inspection apparatus 100), the input / output control unit 111 displays an area 1310 for displaying an inspection reference image and inspection results for each inspection target image. The inspection result screen 1300 including the area 1330 to be displayed is displayed. Further, the acquired inspection reference image 1320 is displayed in the region 1310 together with the set comparison range 1350. In addition, each inspection target image 1340 in which the inspection result is generated is displayed in each region 1330 together with the set comparison range 1350.

  Further, the input / output control unit 111 displays an image 1360 indicating the mismatch area on the inspection target image 1340 based on the information specifying the mismatch area for the inspection target image having an abnormal inspection result. In addition, an error is displayed. For the inspection target image whose inspection result is normal, the fact that it is normal is displayed.

  In the example of this figure, for the inspection target image file “ID_B.bmp” of a certain mobile terminal 200B, the characters “abnormal” are displayed in association with the file name. The inspection standard image file “ID_A.bmp” and the inspection target image file “ID_B.bmp” have different character size settings, sound volume settings, and data communication permission settings within the comparison range 1350. An image 1360 indicating a mismatched area is displayed over the mismatched area of items.

  As described above, according to the second embodiment of the present invention, the inspection apparatus performs the capture image of the application setting screen of the inspection-standard mobile terminal and the capture image of the application setting screen of the inspection-target mobile terminal. Since the inconsistent area is identified by acquiring and comparing these, the application setting inspection in the kitting operation of the portable terminal can be performed efficiently and accurately.

<Third embodiment>
In the first to second embodiments described above, the inspection apparatus 100 inspects the inspection target screen of the mobile terminal 200B. In the third embodiment, the mobile terminal 200B inspects the inspection target screen of the own terminal. To do.

  For example, a predetermined program for realizing the control unit 110 of the inspection apparatus 100 described above is prepared as an application for a mobile terminal (hereinafter also referred to as “inspection application”). Then, the inspection application is installed in the portable terminal 200B to be inspected. By executing the inspection application on the mobile terminal 200B, a control unit having the same function as the control unit 110 described above is realized.

  In the portable terminal 200B, for example, the inspection reference image and the inspection target image of the own apparatus are stored in a storage unit such as a memory or an HDD. The inspection reference image may be transferred and stored in the mobile terminal 200B via, for example, USB, wireless communication, a portable recording medium, or the like. And the control part of the portable terminal 200B should just perform the inspection process similar to the above-mentioned 1st-2nd embodiment based on these test | inspection reference images and test object images.

  As described above, according to the third embodiment of the present invention, the portable terminal acquires the inspection reference image and the inspection target image of the own device and compares them to identify the inconsistent region. Inspection of icon arrangement, wallpaper, setting items, etc. in the kitting operation of the terminal can be performed efficiently and accurately.

  In addition, the above embodiment of this invention intends to illustrate the summary and scope of this invention, and does not limit it. For example, the following modifications may be made.

  In each of the above-described embodiments, the image acquisition unit 112 acquires the captured image selected by the operator from the storage unit 120, but may be acquired from each portable terminal 200. For example, the input / output control unit 111 enables the portable terminal 200 to be specified as a file path on the image selection screen. Then, the image acquisition unit 112 acquires a captured image from the designated mobile terminal 200 and stores it in the storage unit 120.

  In this way, it is possible to save the labor of transferring the captured image to the inspection apparatus 100 and storing it in advance.

  Here, when acquiring a capture image from the mobile terminal 200, the image acquisition unit 112 acquires identification information (for example, a device name, a MAC address, etc.) of the mobile terminal 200, and stores it in association with the acquired capture image. You may make it do. The identification information may be included in the file name of the captured image, or a folder having a name including the identification information may be created for each portable terminal 200 and the captured image may be stored in the folder.

  In this way, the operator can check which mobile terminal 200 the captured image is, so, for example, when selecting a file on the image selection screen, the operator selects the inspection reference image or the inspection target image incorrectly. It becomes easy to prevent this. In addition, for example, it is easy to determine which mobile terminal 200 capture image is displayed on the comparison range setting screen or the inspection result screen.

  Further, in each of the above-described embodiments, the inspection result generation unit 115 records information for specifying a mismatch area for an inspection target image having an abnormal inspection result. However, more detailed information may be displayed. . For example, the inspection result generation unit 115 determines whether or not the predetermined position is included in the inconsistent area based on information specifying a predetermined position (predetermined area) where the icon image 230 can be placed, and wallpaper other than the predetermined position. It is determined whether or not this area is included. If the predetermined position is included, information indicating that the icon arrangement is abnormal is recorded. If the wallpaper area is included, information indicating that the wallpaper is abnormal is recorded. Based on the inspection result recorded in this way, the input / output control unit 111 outputs that the icon arrangement is abnormal or that the wallpaper is abnormal.

  In this way, the worker can more easily grasp the abnormal part of the home screen and incorrect setting contents, and work efficiency is improved.

  Further, in each of the above-described embodiments, inspection result statistics are not performed, but inspection result statistics may be performed. For example, the inspection result generation unit 115 tabulates and records the frequency of occurrence of inconsistency for each corresponding pixel position based on information for specifying a mismatch area included in each generated inspection result. The input / output control unit 111 displays, for example, information indicating the mismatch area and information indicating the mismatch frequency on the image having the same size as the home screen based on the total mismatch frequency of the pixel positions. . Information indicating the discrepancy frequency can be expressed by, for example, displaying in a different color for each frequency.

  In this way, home screen kitting work analysis, productivity analysis, and the like can be performed.

  In each of the above-described embodiments and each modification, any two or more may be combined as appropriate.

  The present invention is not limited to the home screen and the setting screen, and can be applied to other screens.

1: inspection system, 100: inspection device, 110: control unit, 111: input / output control unit, 112: image acquisition unit, 113: image cutout unit, 114: image comparison unit, 115: inspection result generation unit, 120: storage Part: 121: captured image, 122: inspection result, 130: input part, 140: output part, 150: communication part, 160: interface part, 200 (200A, 200B): mobile terminal, 210: notification area, 220: icon Area: 230: Icon image, 240: Wallpaper image, 260: Heading area, 270: Setting item area, 271: Setting item, 900: Computer, 901: CPU, 902: Memory, 903: External storage device, 904: Communication device 905: input device 906: output device 907: read / write device 908: USB interface (I F), 1000: image selection screen, 1010: region, 1020: region, 1100: comparison range setting screen, 1110: region, 1120: inspection reference image, 1130: region, 1140: inspection object image, 1150: comparison range, 1200 : Inspection result screen, 1210: region, 1220: inspection reference image, 1230: region, 1240: inspection object image, 1250: comparison range, 1260: image, 1300: inspection result screen, 1310: region, 1320: inspection reference image, 1330: Area, 1340: Image to be inspected, 1350: Comparison range, 1360: Image

Claims (12)

An inspection device for inspecting a mobile terminal,
A first acquisition unit that acquires an image of a predetermined screen displayed on the first portable terminal that is an inspection standard;
A second acquisition unit that acquires an image of a predetermined screen displayed on the second portable terminal to be inspected;
The first image acquired by the first acquisition unit and the second image acquired by the second acquisition unit are compared for a predetermined comparison area, and the first image and the second image are compared. A comparison unit for identifying a matching area and a mismatching area between the images of
Inspection apparatus characterized by that. The inspection apparatus according to claim 1,
The predetermined screen displayed on the first mobile terminal and the second mobile terminal is a screen on which one or more icons are arranged,
The comparison unit compares at least the comparison area including the icon image and a background image;
Inspection apparatus characterized by that. The inspection apparatus according to claim 1 or 2,
The predetermined screen displayed on the first mobile terminal and the second mobile terminal is a screen on which one or more setting items are arranged,
The setting item includes a user interface for changing the setting of the item,
The comparison unit compares at least the comparison region including the user interface;
Inspection apparatus characterized by that. The inspection apparatus according to any one of claims 1 to 3,
The comparison unit compares the comparison area of the first image and the comparison area of the second image in corresponding pixel units, and specifies an area corresponding to a pixel having a different pixel value as the mismatch area. To
Inspection apparatus characterized by that. The inspection apparatus according to any one of claims 1 to 4,
An inspection result generation unit for generating inspection result information including information for specifying the mismatch area of the comparison area of the second image;
A result output unit that outputs an image obtained by superimposing an image indicating the mismatch region on the second image based on the inspection result information,
Inspection apparatus characterized by that. An inspection apparatus according to any one of claims 1 to 5,
Input / output control for outputting at least one of the first image and the second image and receiving an input of setting of the comparison area for at least one of the first image and the second image Having a part,
Inspection apparatus characterized by that. The inspection apparatus according to claim 2,
In the comparison area, the comparison unit is configured to (1) an area in which a predetermined icon can be arranged, (2) a predetermined line, or (3) a predetermined line in an area in which the icon can be arranged. Compare,
Inspection apparatus characterized by that. A program that causes a computer to function as an inspection device for inspecting a mobile terminal,
A first acquisition unit that acquires an image of a predetermined screen displayed on the first portable terminal that is an inspection standard;
A second acquisition unit that acquires an image of a predetermined screen displayed on the second portable terminal to be inspected;
The first image acquired by the first acquisition unit and the second image acquired by the second acquisition unit are compared for a predetermined comparison area, and the first image and the second image are compared. Causing the computer to function as a comparison unit that identifies matching areas and mismatching areas between the images of
A program characterized by that. An inspection system for inspecting a mobile terminal,
A first portable terminal serving as an inspection standard; a second portable terminal serving as an inspection target; and an inspection apparatus capable of communicating with the first and second portable terminals and inspecting the second portable terminal. Have
The first portable terminal is
A first transmission unit that transmits an image of a predetermined screen displayed on the terminal to the inspection device;
The second portable terminal is
A second transmission unit that transmits an image of a predetermined screen displayed on the terminal to the inspection device;
The inspection device includes:
A first acquisition unit for acquiring an image transmitted from the first portable terminal;
A second acquisition unit for acquiring an image transmitted from the second portable terminal;
The first image acquired by the first acquisition unit and the second image acquired by the second acquisition unit are compared for a predetermined comparison area, and the first image and the second image are compared. A comparison unit for identifying a matching area and a mismatching area between the images of
Inspection system characterized by that. An inspection method in an inspection system for inspecting a mobile terminal,
The inspection system is capable of communicating with the first portable terminal serving as an inspection standard, the second portable terminal serving as an inspection target, and the first and second portable terminals, and inspecting the second portable terminal. An inspection device,
The first portable terminal transmitting an image of a predetermined screen displayed on the terminal to the inspection device;
The second mobile terminal transmitting an image of a predetermined screen displayed on the terminal to the inspection device;
A first acquisition step in which the inspection apparatus acquires an image transmitted from the first portable terminal;
A second acquisition step in which the inspection device acquires an image transmitted from the second portable terminal;
The inspection apparatus compares the first image acquired in the first acquisition step with the second image acquired in the second acquisition step for a predetermined comparison area, and Comparing a matching region and a mismatching region between the image and the second image,
Inspection method characterized by that. A mobile device,
A first acquisition unit that acquires an image of a predetermined screen displayed on the first portable terminal that is an inspection standard;
A second acquisition unit that acquires an image of a predetermined screen displayed on the own terminal to be inspected;
The first image acquired by the first acquisition unit and the second image acquired by the second acquisition unit are compared for a predetermined comparison area, and the first image and the second image are compared. A comparison unit for identifying a matching area and a mismatching area between the images of
A portable terminal characterized by that. A mobile terminal program,
A first acquisition unit that acquires an image of a predetermined screen displayed on the first portable terminal that is an inspection standard;
A second acquisition unit that acquires an image of a predetermined screen displayed on the own terminal to be inspected;
The first image acquired by the first acquisition unit and the second image acquired by the second acquisition unit are compared for a predetermined comparison area, and the first image and the second image are compared. The mobile terminal is caused to function as a comparison unit that identifies a matching area and a mismatching area between the images of
A program characterized by that.

Images