JP2012108702A - Information processing apparatus, method for controlling information processing apparatus, program, and recording medium with program recorded thereon - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which, when a series of processes for image inspection is executed and image inspection and a process for displaying a result image after image inspection are simultaneously and plurally performed, since processing performance of an information processing apparatus is insufficient, although a load is reduced by decimating the result images of image inspection, a result image necessary for an operator is also decimated.SOLUTION: When a decimation process on an inspection result image occurs, it is determined whether an inspection result 1203 of the result image subjected to the decimation process is NG or not, the NG image is displayed without decimation when it is NG, and the result image is decimated when it is not NG.

Description

  The present invention provides an information processing apparatus that inspects an image by image processing, and automatically thins out the display of each image inspection result according to the load on the information processing apparatus. The present invention relates to an information processing apparatus that performs control so as not to exist, a control method for the information processing apparatus, a program, and a recording medium on which the program is recorded.

  2. Description of the Related Art Conventionally, for example, an image inspection apparatus that performs image inspection of image data to be inspected with a camera with a certain logic (processing flow) for the purpose of positioning a substrate or a component in a chip mounter or inspecting a finished product. Widely used.

  As such an image inspection apparatus, for example, a general-purpose type image inspection apparatus equipped with a predetermined image inspection logic, or a dedicated user that can construct a logic that meets the user's needs. There are types of image inspection devices.

  Here, the general-purpose type image inspection apparatus does not require the construction of a new image inspection logic, so it does not require the user's labor to introduce it into the actual manufacturing process, etc., but the logic completely satisfies the user's needs. There are few. On the other hand, the dedicated type image inspection device can construct the image inspection logic that completely satisfies the user's needs. However, since it is necessary to develop the image inspection logic each time, a great amount of development effort is required. The development period and the cost were high.

  Therefore, conventionally, for example, a technique for improving the efficiency of logic development as shown in Patent Document 1 below has been proposed. Specifically, in Patent Document 1, a module for developing a plurality of images is registered in advance in a computer that develops logic, and a developer selects a module that meets the needs of the user, and is necessary for the selected module. By setting parameters and creating source code after creating source code, logic development is made more efficient.

JP 2003-296112 A

  However, when executing such a series of image processing, images to be subjected to image inspection are input from a plurality of cameras, and the plurality of images are processed in parallel by a multi-thread or a multi-process of the information processing apparatus. Since there is one screen for display, the display may not be in time due to the limit of the processing capability of the information processing apparatus. That is, a plurality of images are processed by a plurality of CPUs, respectively, but since there is one display screen, it is necessary to display a plurality of images processed by the information processing apparatus one after another. However, depending on the processing capability of the information processing apparatus, there is a problem that display is delayed and images waiting to be displayed accumulate. Further, when a plurality of image inspection processes and a process for displaying a result image after the image inspection are performed at the same time, the technique of Patent Document 1 described above is insufficient in processing capability of the information processing apparatus, and the image inspection speed decreases. There is a problem.

  In order to solve such a problem, when a load is applied to the information processing apparatus, there is a mechanism in which image inspection is prioritized by thinning out the result image without displaying all the result images subjected to image processing. However, when an abnormal image is detected as a result of the image inspection, the cause of the abnormal image may be investigated and reflected in the parameter. In order to prevent detection of an image that does not necessarily have to be detected as abnormal, parameter setting is performed based on the image detected as abnormal and the parameter is changed to a more appropriate parameter. However, if the result image is thinned out, there is a problem that it is not known which image is detected as abnormal. That is, if the result image thinning process is simply performed, the result image that is originally necessary for the operator is also thinned.

  The present invention performs a plurality of image inspections and automatically thins out the result images after the image inspection when the load on the information processing apparatus increases, and does not thin out the result images required by the user. The purpose is to provide a display mechanism.

  In order to achieve the above object, an information processing apparatus according to claim 1 is an information processing apparatus that performs image processing on electronic image data and displays the electronic image data subjected to the image processing. An image processing execution unit that executes predetermined image processing on the electronic image data, electronic image data that has been subjected to image processing by the image processing execution unit, and image processing that is a result of the image processing Electronic image data storage means for associating and storing the results, display means for thinning and displaying at least one of the electronic image data stored in the electronic image data storage means, and the display An image processing result associated with the electronic image data thinned out by the means is acquired from the electronic image data storage means, and the image processing result is obtained according to the image processing result. A thinning determination unit that determines whether or not to display the child image data without thinning out, and the display unit is configured to display the electronic image data without thinning out by the thinning determination unit. Displays the electronic image data.

  According to the present invention, in the image processing for displaying the result image after the image inspection, the display of the result image is thinned out when the load on the information processing apparatus is high, but when the result image is necessary for the user, There is an effect that can be displayed without thinning.

1 is a schematic diagram illustrating an example of a schematic configuration of an image inspection system according to an embodiment of the present invention. It is a schematic diagram which shows an example of the hardware constitutions inside the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of the hardware constitutions of the image input controller 115f shown in FIG. It is a schematic diagram which shows an example of a function structure of the information processing apparatus 110 shown in FIG. FIG. 5 is a schematic diagram illustrating an example of a module / source code master table 411 illustrated in FIG. 4. FIG. 5 is a schematic diagram illustrating an example of a processing flow / input / output parameter table 412 illustrated in FIG. 4. It is a schematic diagram which shows an example of the process sequence of the control method by the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of the main menu of an image inspection system development screen. It is a flowchart which shows an example of the detailed process sequence of the online test | inspection process of the module in step S109 of FIG. It is a schematic diagram which shows an example of an online test | inspection screen. It is a schematic diagram which shows an example of the test | inspection parameter table 480 shown in FIG. It is a schematic diagram which shows an example of the test | inspection table 481 shown in FIG. 10 is a flowchart illustrating an example of a detailed processing procedure of a module inspection thread process in step S211 of FIG. 9. It is a schematic diagram which shows an example of the test result table 418 shown in FIG. It is a flowchart which shows an example of the detailed process sequence of the test result display process which operate | moves in parallel with the online test process of FIG. It is a schematic diagram which shows an example of the image of an image test result. 5 is a schematic diagram illustrating an example of a configuration of an image recording table 482. FIG. It is a schematic diagram which shows that an NG image operate | moves without being thinned out on an online test | inspection screen. It is a schematic diagram which shows an example of the detailed result display screen which shows the detail of the result currently displayed by the thumbnail. It is a schematic diagram which shows the folder structure of preserve | saved data. It is a schematic diagram which shows an example of an image processing flow construction screen. It is a schematic diagram which shows that an image processing flow operate | moves by parallel processing. 12 is a flowchart illustrating an example of a detailed processing procedure of an inspection result display process according to the second embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, Example 1 will be described. FIG. 1 is a schematic diagram illustrating an example of a schematic configuration of an image inspection system 100 according to an embodiment of the present invention. As shown in FIG. 1, the image inspection system 100 includes an information processing device 110, an input device 120, a display device 130, a camera 140, a lighting device controller 150, a lighting device 160, an external device controller 170, an inspection device, and the like. It has a stage 180 on which an object 181 is placed.

  The information processing apparatus 110 is an apparatus that comprehensively controls operations in the image inspection system 100. Here, in this embodiment, the information processing apparatus 110 is described as an example applied as an apparatus that supports development of an image inspection application program that operates on an image inspection apparatus introduced into an actual manufacturing process. However, the present invention is not limited to this. For example, the present invention includes a form applied as an image inspection apparatus introduced into an actual manufacturing process.

  The information processing apparatus 110 is configured to be able to communicate with a camera 140 that captures an image of the inspection target 181 via a predetermined cable or the like. Further, the information processing apparatus 110 is configured to be able to communicate with an illumination apparatus controller 150 that controls the illumination apparatus 160 via a predetermined cable or the like. The information processing apparatus 110 is configured to be able to communicate with an external device controller 170 such as a programmable controller (PCL) that controls the stage 180 via a predetermined cable or the like. Furthermore, the information processing device 110 is configured to be able to communicate with the input device 120 and the display device 130 via a predetermined cable or the like. In other words, the information processing apparatus 110 controls the input device 120, the display device 130, the camera 140, the illumination device controller 150, and the external device controller 170 connected via a predetermined cable or the like, so Control the overall operation.

  The input device 120 is operated by the user when the user inputs various instructions to the information processing apparatus 110, for example, and the input instruction is sent to the information processing apparatus 110 according to the input instruction operation from the user. In contrast, it is input. The input device 120 is composed of, for example, a keyboard (KB) and a pointing device.

  The display device 130 displays various images and various information on the display screen according to the control of the information processing device 110.

  The camera 140 performs imaging (imaging) of the inspection object 181 placed on the stage 180 under the control of the information processing apparatus 110, and transmits image data (electronic image data) obtained by imaging via a predetermined cable or the like. To the information processing apparatus 110.

  The lighting device controller 150 controls the lighting of the lighting device 160 according to the control of the information processing device 110. Based on the control of the lighting device controller 150, the lighting device 160 performs switching of lighting on / off of the lighting of the inspection target 181 and adjustment of brightness according to the inspection content of the inspection target 181.

  The external device controller 170 controls the stage 180 according to the control of the information processing apparatus 110. The stage 180 moves the placed inspection object 181 to a target position and carries in or out the inspection object 181 based on the control of the external device controller 170. The above is an example of the configuration of the image inspection system.

  Next, the hardware configuration of the information processing apparatus 110 will be described. FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of the information processing apparatus 110 illustrated in FIG. In FIG. 2, in addition to the internal configuration of the information processing apparatus 110, various apparatuses connected to the information processing apparatus 110 are also described.

As illustrated in FIG. 2, the information processing apparatus 110 includes a CPU 111, a RAM 112, a ROM 113, a system bus 114, various controllers 115 (115 a to 115 g), and an external memory 116. As various controllers 115, an input controller 115a, a video controller 115b, a memory controller 115c, communication I / F controllers 115d, 115e, and 115g, and an image input controller 115f are configured. The CPU 111 controls each device connected to the system bus 114 based on a program or the like stored in the ROM 113 or the external memory 116 so as to comprehensively control the operation in the information processing apparatus 110. The RAM 112 functions as a main memory and work area for the CPU 111. The CPU 111 implements various operations in the information processing apparatus 110 by loading a necessary program or the like into the RAM 112 and executing the program when executing the inspection. The ROM 113 has a BIOS (Basic Input) which is a control program of the CPU 111.
/ Output System) is stored.

  The system bus 114 connects the CPU 111, RAM 112, ROM 113, input controller 115a, video controller 115b, memory controller 115c, communication I / F controllers 115d and 115e, 115g, and image input controller 115f so that they can communicate with each other.

  The input controller 115a controls input from the input device 120 including a keyboard (KB) and a pointing device. The video controller 115b controls display on the display device 130 which is a display device. The memory controller 115 c controls access to the external memory 116. Here, the external memory 116 is composed of, for example, a hard disk (HD) or a flexible disk (FD), and stores a boot program, various application programs, editing files, various data, various information, and the like. In addition, the external memory 116 is an operating system (hereinafter referred to as “OS”), a program for causing the CPU 111 to execute various inspections described later, and various types used when performing inspections according to the control of the programs. A table, various inspection result information, and the like are also stored.

  The communication I / F controller 115d controls communication with the external device controller 170. Further, the communication I / F controller 115e controls communication with the lighting device controller 150. The image input controller 115 f is configured to be able to receive image data from the camera 140 by communicating with the camera 140. Here, the image input controller 115f may be equipped with hardware capable of performing arithmetic processing on the controller. In the present embodiment, the description is based on the assumption that image data is input from the camera 140, but an image file may be read and input. Further, the communication I / F controller 115g is connected to a network such as a local area network (LAN) 190, and controls communication with various devices connected to the network.

  Next, the hardware configuration of the image input controller 115f will be described with reference to FIG. As shown in FIG. 3, the image input controller 115 f includes a CPU (arithmetic chip) 301, a memory controller 302, an input controller 303, and an on-board memory 304.

  A CPU (arithmetic chip) 301 executes various image inspections described later. The memory controller 302 controls the input / output of various data to the on-board memory 304 according to the control of the CPU (arithmetic chip) 301. An input controller 303 controls input of image data from the camera 140. The on-board memory 304 functions as a main memory of the CPU (arithmetic chip) 301. The above is the description of the hardware configuration of the image input controller 115f.

  Next, an example of a functional configuration of the information processing apparatus 110 will be described. FIG. 4 is a schematic diagram illustrating an example of a functional configuration of the information processing apparatus 110 illustrated in FIG.

  As shown in FIG. 4, the information processing apparatus 110 includes a table storage unit 410, a flow creation unit 420, a source code conversion unit 430, a compilation unit 440, a (verification) execution unit 450, a data storage unit 460, and a data input Each functional configuration of the output unit 470 is configured. The table storage unit 410 stores a module / source code master table 411, a processing flow / input / output parameter table 412, a source code table 413, an object code table 414, and a project file table 415. In addition, a conditional expression table 416, a node processing flag table 417, an inspection result table 418, an inspection parameter table 480, and an inspection table 481 are also stored.

  Here, in the present embodiment, the table storage unit 410 of FIG. 4 is configured in the external memory 116 shown in FIG. 2, for example (including the case where it is configured once in the RAM 112 and then in the external memory 116). . Also, the flow creation unit 420, source code conversion unit 430, compilation unit 440, (verification) execution unit 450, data storage unit 460, and data input / output unit 470 of FIG. And a program stored in the external memory 116.

  The module / source code master table 411 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 5 is a schematic diagram showing an example of the configuration of the module / source code master table 411.

  As shown in FIG. 5, the module / source code master table 411 implements, for each index 501, a processing item 502 related to image inspection, a source code 503 corresponding to each processing item, and the processing item. An initial value 504 and a processing entity 505 for the module for doing so are associated. This source code is used when the source code conversion unit 430 converts a module to be inspected into a source code.

  Next, the processing flow / input / output parameter table 412 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 6 is a schematic diagram showing an example of the configuration of the processing flow / input / output parameter table 412 shown in FIG. As shown in FIG. 6, the processing flow / input / output parameter table 412 includes, for each index 601, a module 603 related to image inspection, an order 602 of each module 603, and a flow registration name 604 of each module 603. The input parameter 605 and the output parameter 606 in each module 603 are associated with each other. An input parameter 605 indicates an image buffer, a storage area, or the like in which various data used by each module is stored. The output parameter 606 indicates a storage area for storing a result image buffer when each module is executed, a threshold value used for various examinations, and the like. A next step 607 indicates an index 601 of a step to be processed next. The next step 607 may have a plurality of indexes. The branch reference 608 indicates a conditional expression table for designating which step is to be processed next by each condition (node) when the “iterative processing” module and the “conditional branch processing” module are set in the module 603. . Further, the processing main body 609 is an item indicating whether the processing is performed in each module by the CPU 111 or the CPU (arithmetic chip) 301 of the image input controller 115f.

  The index (Index) 601 in the processing flow / input / output parameter table 412 shown in FIG. 6 and the index (Index) in the module / source code master table 411 shown in FIG. In this case, each table may be created. In the processing flow / input / output parameter table T600, 2 and 3 of the index (Index) 601 are examples of iterative processing, and 2 to 4 of the index (Index) 601 of the processing flow / input / output parameter table T601 are examples of conditional branch processing. is there.

  The source code table 413 converts all the modules 603 stored in the processing flow / input / output parameter table 412 into source codes using the module / source code master table 411 and registers them. The source code in the module or a part of the modules is stored.

  The object code table 414 stores object code that is an executable module obtained by converting the source code stored in the source code table 413 by the compiling unit 440. The project file table 415 stores initial setting parameters relating to image inspection, a processing flow sequence, source code, input / output parameters, and the like. In addition, the conditional expression table 416 stores a conditional expression or the like when the “conditional branch processing” module is set, and the node processing flag table 417 stores the conditional expression when the “parallel branch processing” module is set. Stores the node name and the like.

  The inspection result table 418 stored in the table storage unit 410 in FIG. 4 will be described with reference to FIG. FIG. 14 is a schematic diagram illustrating an example of the configuration of the inspection result table 418.

  As shown in FIG. 14, the inspection result table 418 includes an index 1401 associated with the index 601 in the processing flow / input / output parameter table 412, an identification ID 1402 assigned for each inspection result, and an inspection target The identification location 1403 indicating the identification location in coordinates, the identification result 1404 indicating the inspection result of the identification location 1403, and the inspection image name 1405 indicating the image name to be inspected are associated with each other. The identification location 1403 is composed of coordinates with the upper left vertex of the inspection image as (0, 0), and is stored in combination with the upper left coordinate of the identification location and the lower right coordinate of the identification location. Since the identification location is rectangular, the identification location is not limited to this as long as the identification location can be specified.

  Next, the inspection parameter table 480 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 11 is a schematic diagram showing an example of the configuration of the inspection parameter table 480.

  As shown in FIG. 11, the inspection parameter table 480 is associated with NO 1101 allocated for each inspection parameter and a busy flag 1102 indicating whether or not the inspection parameter is in use.

  Next, the inspection table 481 (electronic image data storage means) stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 12 is a schematic diagram showing an example of the configuration of the inspection table 481.

  As shown in FIG. 12, the inspection table 481 includes an inspection thread 1201 indicating the thread name of the thread to be inspected, an execution flag 1202 indicating whether the inspection thread 1201 is being executed, and an inspection result 1203 indicating the inspection result. (Image processing result) Corresponding to the inspection image name 1405 in FIG. 14, the inspection image name 1204 indicating the image name to be inspected, and the inspection parameter 1205 indicating where the inspection thread is inspected in the inspection parameter table 480. Is associated.

  The image recording table 482 stored in the table storage unit 410 in FIG. 4 will be described with reference to FIG. FIG. 17 is a schematic diagram illustrating an example of the configuration of the image recording table 482.

  As shown in FIG. 17, in the image recording table 482, an index (Index) 1801 assigned in the order of image recording, a discriminating name (time stamp) 1802 used for discriminating data, and a continuous identical grouping are recorded. The number of images 1803 thus stored is stored. The discrimination name 1802 is not limited to this as long as data can be discriminated and specified.

  Next, the flow creation unit 420, the source code conversion unit 430, the compilation unit 440, the execution unit 450, the data storage unit 460, and the data input / output unit 470 of FIG. 4 will be described.

  The flow creation unit 420 creates a processing flow / input / output parameter table 412 for managing the processing sequence of modules included in the module / source code master table 411, and creates a processing flow drawing area 2102 (see FIG. 21). It has a function to draw a module.

  The source code conversion unit 430 collates the processing data of each module stored in the processing flow / input / output parameter table 412 created by the flow creation unit 420 with the module / source code master table 411 to source each module. It has a function of converting into code and storing it in the source code table 413.

  Note that the table modules shown in FIGS. 5 and 6 include not only the inspection for the image but also the processing for the external device including the pre-processing for acquiring the image and the post-processing for outputting the inspection result. But of course. For example, a control command for setting the imaging conditions of the camera 140, a control command for the lighting device controller 150 for controlling the lighting device 160, or a control command for the external device controller 170 for controlling movement of the stage, etc. A control command such as transmitting data to a PC connected on the LAN may be performed.

  The compiling unit 440 has a function of generating executable object code from the source code stored in the source code table 413 and storing the generated object code in the object code table 414.

  There are two types of compilation performed by the compiling unit 440: debug compilation and release compilation. Here, in the present embodiment, during processing flow creation, debugging / compilation that enables step execution at the source code level is performed, and when data is saved, a file that can be used for online inspection described later is generated.・ Compile. At this time, both the debug compilation and the release compilation refer to the source code generated by the same conversion method.

  The (verification) execution unit 450 executes the object code stored in the object code table 414 created by the compiling unit 440, results image display area 2103 (see FIG. 21), inspection image display area 1002, processing flow It has a function of updating the input / output parameter table 412.

  For example, the data storage unit 460 outputs the source code table 413, the object code table 414, and the project file table 415 in the RAM 112 to the external memory 116, and performs data storage processing.

  The data input / output unit 470 has a function of managing input / output parameters used in each module.

Next, a processing procedure of image inspection application program creation processing executed by the information processing apparatus 110 will be described. FIG. 7 is a flowchart illustrating an example of a processing procedure of image inspection program creation processing by the information processing apparatus 110 illustrated in FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S103 of FIG. 7, the CPU 111 of the information processing apparatus 110 displays a main menu for performing image inspection system development and system settings on the display device 130 based on an input instruction from the input device 120, for example. Process. The main menu is as shown in FIG.

  FIG. 8 is a schematic diagram showing an example of the main menu 800 of the image inspection system development screen. The main menu 800 of the image inspection system development screen shown in FIG. 8 is created by a “project construction” menu 801 and a “project construction” menu 801 for creating a new logic (processing flow) or editing a created processing flow. An “online inspection” menu 802 for executing the processing flow in the online inspection mode and an “end” menu 805 for ending the main menu are provided.

  Returning to the description of FIG. When the main menu display process in step S103 is completed, the CPU 111 advances the process to step S104. Then, the CPU 111 of the information processing apparatus 110 determines whether or not there is an input instruction from the input device 120 for each menu item on the main menu 800 of the image inspection system development screen displayed in step S103.

  As a result of the determination in step S104, when it is determined that there is no input instruction for each menu item of the main menu 800 from the input device 120 (step S104 / NO), the input device 120 continues until there is an input instruction in step S104. stand by. On the other hand, if it is determined that there is an input instruction from the input device 120 as a result of the determination in step 102 (step S104 / YES), the process proceeds to step S105.

  In step S <b> 105, the CPU 111 of the information processing apparatus 110 performs a process for determining the selected process content based on an input instruction from the input apparatus 120. In this example, the processing contents determined in step S105 are “project construction processing”, “online inspection processing”, and “end”. Note that the processing content given here is an example, and other menu items can be added to the main menu, and the other processing content corresponding to the menu item can be determined in step S105.

  Subsequently, in step S106, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “project construction processing”. As a result of the determination in step S106, if it is determined that the processing content determined in step S105 is “project construction processing” (step S106 / YES), the process proceeds to step S107.

  In step S107, the CPU 111 of the information processing apparatus 110 performs “project construction processing”. This “project construction process” is a process for constructing an image inspection program.

  First, the CPU 111 of the information processing apparatus 110 displays, for example, an image processing project development screen 2100 for developing the image processing system shown in FIG. 21 on the display device 130 based on an input instruction from the input device 120. I do.

  FIG. 21 is a schematic diagram showing an example of the image processing project development screen 2100. An image processing project development screen 2100 shown in FIG. 21 includes a tool box 2101 that displays available processing units (that is, modules related to image processing), and an execution order of image processing (that is, execution order of modules). A processing flow drawing area 2102 for drawing a flowchart, a result image display area 2103 for displaying a result image executed in each image processing (that is, processing of each module), a tool bar 2107, and a processing result for displaying a processing execution result A display area 2108, an image selection area 2109 for selecting an image when there are a plurality of processed images, a previous button 2110, a next button 2111 provided in the image selection area 2109, an image processing program There is also provided a close button (not shown) that is operated when the development is completed.

  In addition, the image processing project development screen 2100 shown in FIG. 21 includes parameters used in each step (that is, each module) in the flowchart of the processing flow drawing area 2102 when, for example, a new module is registered or a parameter is edited. A parameter editing screen 2104 for setting the image and a result image display area 2103 for displaying the result image executed by setting the parameter are displayed. The example of the project construction screen in FIG. 21 also includes a module that controls the flow by branch processing. Here, the result image display area 2103 is an area for displaying the result image of each module in the processing flow drawing area 2102. This may be a preview image or a reduced image. In the case of conditional branch processing, an image of a node (branch) that satisfies the condition is displayed, and a blackout image is displayed because processing is not performed for a node that does not satisfy the condition. In the present invention, the blacked-out image is displayed in the result image display area 2103, but the result image processed by the previous module may be displayed. At this time, if the result of all the processing flows does not fit in the result image display area 2103, the display area may be changed using horizontal and vertical scroll bars.

  The processing result display area 2108 is an area for displaying a result image of the module when one of the modules in the processing flow drawing area 2102 is selected by a user operation. When the module selected by the operation from the user is a module that does not involve image processing such as conditional branch processing, a blackout image is displayed in the processing result display area 2108. In the present invention, the blacked-out image is displayed in the processing result display area 2108, but the result image processed in the previous module may be displayed. The above is an example of the configuration of the image processing project development screen 2100.

  The modules stored in the module / source code master table 411 are combined in the flowchart in the order of image inspection in the processing flow drawing area 2102 by the operation from the user, and the combined result is stored in the processing flow / input / output parameter table 412. Store. After that, the source code conversion unit 430 generates a series of image inspection source codes from the module / source code master table 411 and the processing flow / input / output parameter table 412, and stores them in the source code table 413. The source code for image inspection stored in the source code table 413 is compiled by the compiling unit 440 to generate an executable object code, and the generated object code is stored in the object code table 414.

  In the present invention, image processing is performed on a plurality of images transmitted from a plurality of cameras 140 by causing the object code created in the flowchart format in this way to be operated in parallel by a multi-thread or multi-process of the information processing apparatus. That is, each image processing that operates in parallel processing is an image processing flow image processing constructed in the processing flow drawing area 2102.

  FIG. 22 is a conceptual diagram in which the image processing of the image processing flow constructed in the processing flow drawing area 2102 operates by parallel processing. As shown in FIG. 22, there are a plurality of inspection threads, and image processing of the image processing flow constructed in the processing flow drawing area 2102 operates for each thread. In this embodiment, image processing of the same image processing flow is performed in parallel in each thread, but image processing of a different image processing flow may be operated for each thread. For example, when the camera 140 is installed for different purposes, the same image processing flow is generally rarely used. Therefore, the CPU 111 of the information processing apparatus 110 can construct and execute an image processing flow that is different for each thread. In this case as well, different image processing flows constructed for each thread are operated by parallel processing.

  The above is the outline of the project construction process. When the process of step S107 is completed, the process returns to step S104 and waits until the next input instruction is received from the input device 120.

  On the other hand, as a result of the determination in step S106, if it is determined that the processing content determined in step S105 is not “project construction processing” (step S106 / NO), the process proceeds to step S108.

  In step S108, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “online inspection processing”.

  As a result of the determination in step S108, when it is determined that the processing content determined in step S105 is “online inspection processing” (step S108 / YES), the CPU 111 advances the processing to step S109.

  In step S109, the CPU 111 of the information processing apparatus 110 performs an “online inspection process” process. Details of the “online inspection process” will be described later with reference to FIG. When the process of step S109 ends, the process returns to step S104 and waits until the next input instruction is received from the input device 120.

  On the other hand, as a result of the determination in step S108, if it is determined that the processing content determined in step S105 is not “online inspection processing” (step S108 / NO), the CPU 111 advances the processing to step S114.

  In step S114, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “end processing”.

  As a result of the determination in step S114, when it is determined that the processing content determined in step S105 is “end processing” (step S114 / YES), the processing by this program is ended.

  On the other hand, as a result of the determination in step S114, if it is determined that the processing content determined in step S105 is not “end processing” (step S114 / NO), the process proceeds to step S104, and the input device 120 performs the next processing. Wait for input instructions.

Next, a detailed procedure of the online inspection process in step S109 of FIG. 7 will be described with reference to FIG. FIG. 9 is a flowchart showing an example of a detailed processing procedure of the “online inspection process” in step S109 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control. In this embodiment, an online inspection process, an inspection thread process (see FIG. 13) described later, and an inspection result display process (see FIG. 15) described later operate in parallel in the CPU 111 by multithread processing. It shall be.

  First, in step S201, the CPU 111 of the information processing apparatus 110 displays an online inspection screen 1000 (see FIG. 10) on the display device 130 from the video controller 115b, and accepts an operation from the user.

  FIG. 10 is a schematic diagram showing an example of the online inspection screen 1000. On the online inspection screen 1000 shown in FIG. 10, an inspection start button 1001 for executing the image inspection program constructed in step S107, and an inspection result image of the image inspection program executed when the inspection start button 1001 is pressed are displayed. Inspection image display area 1002, NG image display area 1003 for displaying an image (NG image) that has been determined to be abnormal or failed due to image processing, a count result for displaying the number of processes to be inspected and the result of thinning the display 1005. The above is an example of the configuration of the online inspection screen 1000.

  In step S202, the CPU 111 of the information processing apparatus 110 determines whether or not the examination start button 1001 has been pressed by an operation from the user. If it is determined that the examination start button 1001 has been pressed (step S202 / YES), the CPU 111 initializes (clears to 0) the examination counter and advances the process to step S203. The inspection counter is a variable for counting the number of image inspections. In this embodiment, the inspection counter is a variable for displaying the value of the inspection counter on the count result 1005 of the online inspection screen 1000 in step S308 described later. On the other hand, if it is not possible to determine that the inspection start button 1001 has been pressed in the determination process in step S202 (step S202 / NO), the process waits in step S202.

  In step S <b> 203, the CPU 111 of the information processing apparatus 110 captures an image input from the camera 140 from the image input controller 115 f and stores it in the RAM 112. Note that an image already stored in the external memory 116 may be developed in the RAM 112 and used.

  In step S <b> 204, the CPU 111 of the information processing apparatus 110 searches the inspection parameter table 480 and determines whether there is a record in which the in-use flag 1102 is “OFF”. If it is determined that there is a record whose busy flag 1102 is “OFF” (step S204 / YES), the CPU 111 advances the process to step S206. On the other hand, if the determination process in step S204 cannot determine that there is a record with the in-use flag 1102 “OFF” (step S204 / NO), the CPU 111 proceeds to step S205.

  In step S205, the CPU 111 of the information processing apparatus 110 stores “interruption” in the inspection result of the first record among the records stored in the inspection table 481, and forcibly terminates the corresponding inspection thread. In step S206, which will be described later, records are added to the inspection table 481 in the order of image capture, so the first record that is the oldest inspection is deleted. Thereby, even if a certain inspection is delayed, the efficiency of a series of image inspections can be improved by forcibly terminating the inspection.

  In step S206, the CPU 111 of the information processing apparatus 110 newly creates an inspection thread, adds a new record to the end of the record existing in the inspection table 481, and stores the inspection thread name in the inspection thread 1201. The inspection thread name may be any name as long as it does not overlap with other inspection thread names.

  In step S <b> 207, the CPU 111 of the information processing apparatus 110 searches the inspection parameter table 480 and determines whether there is a record in which the in-use flag 1102 is “OFF”. If it is determined that there is a record whose in-use flag 1102 is “OFF” (step S207 / YES), the CPU 111 advances the process to step S208.

  In step S208, the CPU 111 of the information processing apparatus 110 stores “ON” in the busy flag 1102 searched in step S207.

  In step S209, the CPU 111 of the information processing apparatus 110 stores “ON” in the executing flag 1202 of the record created in step S206.

  In step S210, the CPU 111 of the information processing apparatus 110 stores the image name of the image stored in the RAM 112 in step S203 in the inspection image name 1204 of the record created in step S206, and in the inspection parameter 1205 in step S208. Information indicating NO 1101 corresponding to the busy flag 1102 storing “ON” is stored. In this embodiment, the data is stored in the format of “inspection parameter table [NO]”, but other notation methods may be used. After the end of step S210, the CPU 111 of the information processing apparatus 110 performs the parallel processing of step S211 and step S214. That is, since the CPU 111 can execute the process of step S214 without waiting for the completion of the process of step S211, an efficient inspection can be performed.

  In step S <b> 211, the CPU 111 of the information processing apparatus 110 executes a check thread process that executes the check thread created in step S <b> 206. Details of the inspection thread processing in step S211 will be described later with reference to FIG.

  On the other hand, if it is not possible to determine in the determination process of step S207 that there is a record with the in-use flag 1102 “OFF” (step S207 / NO), the CPU 111 proceeds to step S212.

  In step S212, the CPU 111 of the information processing apparatus 110 stores “OFF” in the execution flag 1202 of the record created in step S206, and stores “not executed” in the inspection result 1203. Thereby, it is possible to count images in which inspection omissions have occurred.

  In step S213, the CPU 111 of the information processing apparatus 110 determines whether or not an instruction to stop capture has been given by an operation from the user. The capture stop instruction may be issued by pressing a preset button, or may be another method. If it is determined that an instruction to stop capture has been given (step S213 / YES), the process ends, and the process returns to step S109. On the other hand, if the determination process in step S213 cannot determine that an instruction to stop capturing has been issued (step S213 / NO), the CPU 111 returns the process to step S203. Thereby, the process of step S203 thru | or step S213 is repeated until acquisition stop is made | formed.

Next, with reference to FIG. 13, the detailed procedure of the inspection thread process in step S211 of FIG. 9 will be described. FIG. 13 is a flowchart illustrating an example of a detailed processing procedure of the inspection thread process in step S211 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received, the CPU 111 loads the program into the RAM 112 and performs the process according to control by the loaded program. Will be executed. In this embodiment, the above-described online inspection processing (see FIG. 9), inspection thread processing, and inspection result display processing (see FIG. 15) described later operate in parallel in the CPU 111 by multithread processing. It shall be.

  In step S301, the CPU 111 of the information processing apparatus 110 executes the image inspection program constructed in step S107, and inspects an image corresponding to the inspection image name 1204 set in step S210 (image processing execution unit). The image inspection program to be executed is stored as an object code stored in the object code table 414.

  In step S302, the CPU 111 of the information processing apparatus 110 stores the result executed in step S301 in the inspection result table 418. The index (Index) 1401 stores the index (Index) 601 of the module that performed the process, the identification ID 1402 is assigned a number for identifying each process for each module, and the identification point 1403 is inspected in step S301. As a result, the identified location is stored in a coordinate format, the identification result 1404 stores the identification result of the identified location 1403, and the inspection image name 1405 stores the image name of the image inspected in step S301. To do.

  In step S303, the CPU 111 of the information processing apparatus 110 stores the image inspected in step S301 from the RAM 112 into the external memory 116. However, when considering the display speed for displaying the image in step S409, which will be described later, it may be stored in the RAM 112 having a higher reading speed. Further, it may be stored in the external memory 116 in step S416 described later. In this case, step S303 is not necessary.

  In step S304, the CPU 111 of the information processing apparatus 110 stores “OFF” in the executing flag 1202 of the record created in step S206.

  In step S305, the CPU 111 of the information processing apparatus 110 stores “OFF” in the busy flag 1102 searched in step S207.

  In step S306, the CPU 111 of the information processing apparatus 110 stores the inspection result in the inspection result 1203 of the record created in step S206. When the image inspection is successful, “OK” is stored, and when it is unsuccessful, “NG” is stored. The information to be stored is not limited to this. Thus, by storing the results of the image inspection in the inspection results 1203, the image inspection results can be totaled.

  In step S307, the CPU 111 of the information processing apparatus 110 increments the inspection counter initialized in step S202. Specifically, every time the image inspection in step S301 ends, the inspection counter is incremented by one. Thereby, the number of inspections counted by the inspection counter can be displayed in step S308 described later.

  In step S308, the CPU 111 of the information processing apparatus 110 displays the inspection counter incremented in step S307 on the count result 1005 of the online inspection screen 1000. By displaying the inspection counter in the count result 1005, it is possible to notify the user that the image processing is operating normally even if the result image is thinned out in step S408 described later.

Next, a detailed procedure of the inspection result display process for displaying the result image inspected in the inspection thread process of FIG. 13 will be described with reference to FIG. FIG. 15 is a flowchart illustrating an example of a detailed processing procedure of the inspection result display processing. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received, the CPU 111 loads the program into the RAM 112 and performs the process according to control by the loaded program. Will be executed. In this embodiment, the above-described online inspection process (see FIG. 9), the above-described inspection thread process (see FIG. 13), and the inspection result display process operate in parallel in the CPU 111 by multi-thread processing. It shall be. Further, in this embodiment, an example will be described in which an image (NG image) whose inspection result 1203 is NG is displayed without being thinned out.

  First, in step S401, the CPU 111 of the information processing apparatus 110 receives an OK number setting (allowable value setting means). The OK number is an allowable value for performing grouping as an NG image. First, grouping in the present embodiment will be described. If the product flowing through the production line is inspected and an abnormality is found, the same error may occur continuously. This occurs when the machine that produces the product or the material of the same lot is a problem, and many of them should be regarded as the same error. That is, since consecutive NG images are likely to have the same error, they are grouped as one group. Thereby, it is possible to obtain a collective data for the error image, which is useful for subsequent parameter setting and cause identification. In the online inspection screen 1000 shown in FIG. 18, NG images grouped in the NG image display area 1003 are displayed. For example, grouped NG images such as a grouping image 1004 are displayed in an overlapping manner.

  In such grouping, a result image that should originally be an NG image may be determined as a successful image inspection or a normal image (OK image). Specifically, when the determination “NG, NG, NG, OK, NG, NG, NG” is made, there is a high possibility that an OK image sandwiched by only one is erroneously determined due to insufficient parameter setting. Therefore, these seven result images are grouped as one NG image group. At this time, the number of OKs described above indicates an allowable value for grouping OK images. For example, when the number of OK is set to “2”, grouping is performed when there are two or less OK images sandwiched between NG images, and there are more than three OK images sandwiched between NG images. If it does, grouping is not performed. By providing such a setting, a flexible grouping setting can be performed. The setting reception in step S401 may display an input reception screen or may be other methods. It may be set in advance or is not limited to this.

  In step S402, the CPU 111 of the information processing apparatus 110 initializes (clears to 0) the display counter. The display counter is a variable that counts the number of inspection result images displayed in the inspection image display area 1002. In this embodiment, the display counter is a variable for displaying the value of the display counter in the count result 1005 of the online inspection screen 1000. In step S410, which will be described later, the display counter is incremented and displayed in the count result 1005.

  In step S404, the CPU 111 of the information processing apparatus 110 initializes (clears 0) the NG counter. The NG counter is a variable for counting the grouped NG images.

  In step S405, the CPU 111 of the information processing apparatus 110 initializes (clears to 0) the OK counter. The OK counter is a variable used to determine whether or not OK images are continuous for the number of OKs described above.

  In step S406, the CPU 111 of the information processing apparatus 110 refers to the first record among the records stored in the inspection table 481.

  In step S407, the CPU 111 of the information processing apparatus 110 determines whether or not the executing flag 1202 of the record referred to in step S406 is “OFF”. If it is determined that the executing flag 1202 is “OFF” (step S407 / YES), the CPU 111 advances the process to step S408. On the other hand, if it is not possible to determine that the execution flag 1202 is “OFF” in the determination process in step S407 (step S407 / NO), the CPU 111 returns the process to step S406. Thereby, the display of the inspection result of the inspection thread that has not been inspected can be prevented.

  In step S <b> 408, the CPU 111 of the information processing apparatus 110 determines whether the currently referenced record is the first record in the inspection table 481. When determining that it is the first record (step S408 / YES), the CPU 111 advances the process to step S409. That is, only when the top record of the inspection table 481 is referred to (the image processed in the inspection thread 1), inspection in step S404 described later is performed and an image of the inspection result is displayed.

  In step S409, the CPU 111 of the information processing apparatus 110 displays the inspection result in step S301 from the inspection result table 418 and the inspection table 481 in the inspection image display area 1002 on the display device 130 from the video controller 115b (display unit). In this embodiment, the inspection result image is displayed during the online inspection in step S109. However, it may be displayed in the processing result display area 2108 in order to confirm the operation of the image processing flow constructed in the project construction processing in step S107.

  Specifically, first, an image that matches the inspection image name 1204 stored in the first record currently referenced is acquired from the external memory 116 or the RAM 112. All records corresponding to the inspection image name 1405 that matches the inspection image name 1204 are acquired from the inspection result table 418 and stored in the RAM 112. Using the identification part 1403 of the acquired record, the identification part is displayed on the acquired image. When data is stored in the identification result 1404, the identification result 1404 corresponding to the identification part 1403 is displayed. For example, in the inspection result screen 1600 shown in FIG. 16, the matching part 1602 displays the identification part in an identifiable manner, and the character recognition part 1601 additionally displays the identification result 1404.

  FIG. 16 is a schematic diagram illustrating an example of an inspection result screen 1600. The examination result screen 1600 shown in FIG. 16 includes a character recognition portion 1601 indicating the result of character recognition and a matching portion 1602 indicating the result of comparison with a predetermined image. The above is an example of the configuration of the inspection result screen 1600.

  In step S410, the CPU 111 of the information processing apparatus 110 increments the display counter. Specifically, “1” is added to the numerical value stored in the display counter. The value of the display counter is displayed in the count result 1005 of the online inspection screen 1000. By displaying the count result 1005 together with the above-described inspection counter, it is possible to display the number of inspections of images and the number of displays. That is, when the display thinning of the result image is performed, “inspection number> display number”. The number of thinned images can be obtained by subtracting the number of displays from the number of inspections.

  On the other hand, if it is not possible to determine that it is the first record in the determination process in step S408 (step S408 / NO), the CPU 111 advances the process to step S411. That is, the fact that the currently referenced record is not the first record of the inspection table 481 indicates that a plurality of records are accumulated in the inspection table 481. Therefore, since it can be determined that the processing of the image transmitted from the camera 140 is not in time for one thread and that parallel processing is performed in multiple threads, the result image is not displayed in step S404 (the display is thinned out). In this embodiment, when a plurality of records are accumulated in the inspection table 481, the image display of the inspection result other than the top record is thinned out, but “ON” is more than a certain number in the in-use flag 1102 of the inspection parameter table 480. If it exists, or the load on the CPU 111 or the like is measured, the image display may be thinned out when the load exceeds a certain level. The criterion for thinning out the image display of the inspection result is not limited to this. Further, the number of thinned out sheets may be any number and can be set by the user. As a result, it is possible to reduce the load of displaying the result image, and to prioritize the image inspection operating in parallel processing.

  In step S411, the CPU 111 of the information processing apparatus 110 determines whether or not the result of the currently referenced record is “NG” (decimation determination unit). Specifically, it is determined whether or not the inspection result 1203 of the currently referenced record is “NG”. If it is determined to be “NG” (step S411 / YES), the process proceeds to step S412. Steps S412 to S419 described later are processes for controlling so as not to be thinned out even for NG images.

  In step S412, the CPU 111 of the information processing apparatus 110 determines whether “0” is stored in the NG counter. As a result of the determination in step S412, if the processing content determined in step S412 determines that the NG counter is “0” (step S412 / YES), the process proceeds to step S413. That is, it is determined whether or not to create a storage destination for grouping and storing an NG image. In the present embodiment, in order to group NG images, a folder for saving the grouped NG images in the external memory 116 is created. An NG image is stored in the created folder and handled as a grouped image. The grouping method is not limited to this. It may be associated with a table, or any other method may be used.

  In step S413, the CPU 111 of the information processing apparatus 110 creates a parent folder 2001 as a storage destination of the inspection result in step S301. In this embodiment, the time stamp of the information processing apparatus 110 is acquired and used as the folder name, but this is not limitative. Note that the parent folder 2001 may be created in the RAM 112. FIG. 20 is a schematic diagram illustrating an example of a folder configuration in the present embodiment. In step S413, a parent folder 2001 is first created as a storage location for the NG image. The folder structure is not limited to this.

  In step S414, the CPU 111 of the information processing apparatus 110 adds a new record to the image recording table 482, uniquely assigns a value to the index 1801, and stores the current time in the discriminant name 1802. With the processing in step S413 and step S414, preparation for grouping NG images is completed.

  On the other hand, if it is determined in step S412 that the NG counter is not 0 (step S412 / NO), the CPU 111 proceeds to step S415. That is, since there is already a storage location for the NG image and the result image can be stored in the grouped folder, the processes in steps S413 and S414 are not performed.

  In step S415, the CPU 111 of the information processing apparatus 110 creates a child folder 2002 under the parent folder 2001 created in step S413 as a storage destination of the inspection result in step S301. In this embodiment, the time stamp of the information processing apparatus 110 is acquired and used as the folder name of the child folder, but the present invention is not limited to this.

  In step S416, the CPU 111 of the information processing apparatus 110 stores the result image of the record in the inspection table 481 that is currently being referenced, under the child folder created in step S415. Further, the contents of the inspection result 1203 of the record created in step S306 are stored. As the saved content, the result executed in each image process (that is, the process of each module) may be saved. In the schematic diagram shown in FIG. 20, a child folder 2002 is created under the parent folder 2001, and a result image 2003 of a record of the examination table 481 currently being referenced is stored. In addition, a result 2004 executed in each image processing (that is, processing of each module) can be stored together.

  In step S417, the CPU 111 of the information processing apparatus 110 increments the NG counter (increments by 1) and stores the number of NG counters in the NG number 1703 of the record created in step S414. The NG number 1703 indicates the number of grouped result images.

  In step S418, the CPU 111 of the information processing apparatus 110 displays the inspection result in step S301 from the video controller 115b in the NG image display area 1003 on the display device 130 from the inspection result table 418 and the inspection table 481 (display unit). Further, the numerical value stored in the NG number 1703 is also identified and displayed. Thereby, it is possible to notify the user of the number of grouped result images. When a group of displayed NG images is selected by the user, a list of grouped NG image results is displayed as shown in FIG. When one of the results displayed in the result list 1901 is selected, an NG image or an OK image of the result is displayed. Detailed parameters and inspection results of the results may be displayed.

In step S419, the CPU 111 of the information processing apparatus 110 initializes the OK counter “0”.
To do. This is processing when the processing in steps S412 to S419 is an NG image.

  On the other hand, if it is determined in step S411 that the test result cannot be determined to be NG (step S411 / NO), the CPU 111 proceeds to step S426.

  In step S426, the CPU 111 of the information processing apparatus 110 determines whether the NG counter is other than “0”. That is, that the NG counter is other than “0” indicates that the NG counter is incremented in step S417. Therefore, since an NG image has occurred, it can be determined that grouping of NG images is being performed. As described above, even if it is an OK image, if the number of continuous OK images is equal to or less than the number of OK images, grouping as an NG image is performed, and a determination is made on the NG counter in step S426. If it is determined that the NG counter is other than “0” (step S426 / YES), the process proceeds to step S427.

  On the other hand, if it is determined in step S426 that the NG counter is “0” (step S426 / NO), the CPU 111 proceeds to step S420. That is, the processing is performed assuming that no NG image is generated and an OK image continues.

  In step S427, the CPU 111 of the information processing apparatus 110 increments the OK counter (increases by 1).

  In step S428, the CPU 111 of the information processing apparatus 110 determines whether or not the OK counter is greater than the number of OK set in step S401. As a result of the determination in step S428, if it is determined that the OK counter is greater than the OK number (step S428 / YES), the process proceeds to step S429. That is, since the OK images continue continuously for the number of OK or more, display as NG images is not performed.

  On the other hand, if it is determined in the determination process in step S428 that the OK counter is not larger than the OK number (step S428 / NG), the CPU 111 advances the process to step S415. That is, even an OK image is stored as an NG image. As described above, since the result image that should be determined as an NG image may be displayed as an OK image depending on the parameter setting, the image is temporarily stored as an NG image.

  In step S429, the CPU 111 of the information processing apparatus 110 determines that the OK counter is greater than the OK number in step S428. Therefore, since it cannot be determined in step S428 that the OK counter is greater than the OK number, it is stored in step S416. The OK image that has been deleted is deleted, and the display of the OK image is erased from the NG image display area 1003. Specifically, for example, when the number of OK is “2” and the result images are output in the order of “NG, OK, OK, OK”, grouping is started because there is an NG image first. Since the NG counter of the second OK image is “1”, the process proceeds to step S427 in the determination process of step S426, and the process proceeds to step S415 in the determination process of step S428. That is, grouping is performed as an OK image but an NG image. However, since three OK images are continuous, the OK image is larger than “2”. That is, it should be determined that these OK images are not NG images. Therefore, in step S429, the OK image stored in step S416 is deleted, and the thumbnail image displayed in step S418 is not displayed.

  In step S430, the CPU 111 of the information processing apparatus 110 initializes (clears to 0) the NG counter. Since it is determined in step S428 that the OK counter is greater than the OK number, the NG counter is initialized to end the grouping of NG images. This is processing when the processing in steps S426 to S430 is an OK image.

  When step S419 or step S430 is completed, in step S420, the CPU 111 of the information processing apparatus 110 performs various processes set by the user according to the result of the image inspection in step S301. Specifically, if “NG” is stored in the inspection result 1203, the external image is controlled to exclude the object of the image flowing through the production line from the production line, or the inspection image is stored in step S303. If not, inspection image storage stored in the external memory 116, various information transmission of inspection results, and the like are performed.

  Note that the inspection results can be transmitted in the order of image inspection by transmitting the inspection result information to the external device in step S420. That is, the inspection thread processing (see FIG. 13) of each record stored in the inspection table 481 operates in parallel, and the inspection speed varies depending on the image, so the inspection thread that has been inspected later ends first. May end up. Therefore, in the inspection thread process, when the inspection result information is transmitted to the external device, there is a possibility that an inconsistency occurs in the image inspection order and the inspection result transmission order. However, such inconsistency can be prevented by processing in the inspection result display process. It should be noted that the same effect can be obtained in the case of a process such as an external control process in which a malfunction occurs when inconsistency occurs.

  In step S422, the CPU 111 of the information processing apparatus 110 deletes the currently referenced record from the inspection table 481.

  In step S423, the CPU 111 of the information processing apparatus 110 determines whether a record exists in the inspection table 481. If it is determined that a record exists (step S423 / YES), the CPU 111 advances the process to step S424.

  In step S424, the CPU 111 of the information processing apparatus 110 refers to the record next to the record deleted in step S422, and returns the process to step S407.

  On the other hand, if it is not possible to determine that a record exists in the determination process in step S423 (step S423 / NO), the CPU 111 advances the process to step S425.

  In step S425, the CPU 111 of the information processing apparatus 110 determines whether or not the online inspection process (see FIG. 9) has ended. Since the online inspection process and the inspection result display process operate in parallel, it may be referred to whether the online inspection process is being processed or may be in another form. If it is determined that the online inspection process has ended (step S425 / YES), the CPU 111 ends the process. On the other hand, if it is not possible to determine in step S425 that the online inspection process has been completed (step S425 / NO), the CPU 111 proceeds to step S406. As a result, as long as the online inspection process continues to operate, the inspection result of the image can be displayed.

  Next, Example 2 will be described. In the second embodiment, another form of the inspection result display process (see FIG. 15) in the first embodiment will be described. Therefore, other system configurations, hardware configurations, functional configurations, and table configurations are the same as those in the first embodiment. The flow of each process is the same. Of course, other configurations may be used.

  In the second embodiment, when the result image after the inspection is displayed, the display of the result image is thinned. However, when the result image is an NG image, the display is performed without thinning the display. Will be described.

  First, with reference to FIG. 23, the detailed procedure of the inspection result display process for displaying the result image inspected in the inspection thread process of FIG. 13 will be described. FIG. 23 is a flowchart illustrating an example of a detailed processing procedure of the inspection result display processing. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received, the CPU 111 loads the program into the RAM 112 and performs the process according to control by the loaded program. Will be executed. In this embodiment, the above-described online inspection process (see FIG. 9), the above-described inspection thread process (see FIG. 13), and the inspection result display process operate in parallel in the CPU 111 by multi-thread processing. It shall be. Further, in this embodiment, an example will be described in which an image (NG image) whose inspection result 1203 is NG is displayed without being thinned out.

  Each step from step S406 to step S407 is the same as step S406 to step S408 in FIG.

  In step S501, the CPU 111 of the information processing apparatus 110 determines whether the currently referenced record is the first record in the inspection table 481. If it is determined that it is the first record (step S501 / YES), the CPU 111 advances the process to step S503. That is, only when the top record of the inspection table 481 is referred to (the image processed in the inspection thread 1), inspection in step S404 described later is performed and an image of the inspection result is displayed.

  On the other hand, when the determination process in step S501 cannot determine that the record is the first record (step S501 / NO), the CPU 111 advances the process to step S502. That is, the fact that the currently referenced record is not the first record of the inspection table 481 indicates that a plurality of records are accumulated in the inspection table 481. Therefore, since it can be determined that the processing of the image transmitted from the camera 140 is not in time for one thread and that parallel processing is performed in multiple threads, the result image is not displayed in step S503 (the display is thinned out). In this embodiment, when a plurality of records are accumulated in the inspection table 481, the image display of the inspection result other than the top record is thinned out, but “ON” is more than a certain number in the in-use flag 1102 of the inspection parameter table 480. If it exists, or the load on the CPU 111 or the like is measured, the image display may be thinned out when the load exceeds a certain level. The criterion for thinning out the image display of the inspection result is not limited to this. Further, the number of thinned out sheets may be any number and can be set by the user. As a result, it is possible to reduce the load of displaying the result image, and to prioritize the image inspection operating in parallel processing.

  In step S502, the CPU 111 of the information processing apparatus 110 determines whether or not the result of the currently referenced record is “NG”. Specifically, it is determined whether or not the inspection result 1203 of the currently referenced record is “NG”. If it is determined to be “NG” (step S502 / YES), the process proceeds to step S503. On the other hand, if it is not possible to determine that the result of the currently referenced record is “NG” in the determination process in step S502 (step S502 / NO), the CPU 111 advances the process to step S420 described above. Thereby, even if the result image is thinned out in step S501, if the result image is determined to be NG as a result of the inspection, the inspection result can be displayed.

  In step S503, the CPU 111 of the information processing apparatus 110 displays the inspection result in step S301 from the video controller 115b in the inspection image display area 1002 on the display device 130 from the inspection result table 418 and the inspection table 481. In this embodiment, the inspection result image is displayed during the online inspection in step S109. However, it may be displayed in the processing result display area 2108 in order to confirm the operation of the image processing flow constructed in the project construction processing in step S107.

  Specifically, first, an image that matches the inspection image name 1204 stored in the first record currently referenced is acquired from the external memory 116 or the RAM 112. All records corresponding to the inspection image name 1405 that matches the inspection image name 1204 are acquired from the inspection result table 418 and stored in the RAM 112. Using the identification part 1403 of the acquired record, the identification part is displayed on the acquired image. When data is stored in the identification result 1404, the identification result 1404 corresponding to the identification part 1403 is displayed. For example, in the inspection result screen 1600 shown in FIG. 16, the matching part 1602 displays the identification part in an identifiable manner, and the character recognition part 1601 additionally displays the identification result 1404.

  Steps S410, S420, and S423 to S425 are the same as steps S410, S420, and S423 to S425 in FIG.

  As described above, according to the present embodiment, in the image processing for displaying the result image after the image inspection, the display of the result image is thinned out when the load on the information processing apparatus is high. If it is, there is an effect that can be displayed without thinning out.

  Although the embodiment has been described in detail above, the present invention can take an embodiment as a method, a program, a storage medium, or the like.

  The program according to the present invention is a program that allows a computer to execute (read) each processing method, and the storage medium according to the present invention stores a program that allows the computer to execute each processing method.

  The program in the present invention may be a program for each processing method of each device.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by performing reading.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board or It goes without saying that the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device.

  Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network by a communication program, the system or apparatus can enjoy the effects of the present invention.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Image inspection system 110 Information processing apparatus 120 Input device 130 Display apparatus 140 Camera 150 Illumination apparatus controller 160 Illumination apparatus 170 External apparatus controller 180 Stage 181 Inspection object 190 LAN (Local Area Network)
111 CPU
112 RAM
113 ROM
114 System bus 115a Input controller 115b Video controller 115c Memory controller 115d, 115e, 115g Communication I / F controller 115f Image input controller 116 External memory

In order to achieve the above object, the information processing apparatus according to claim 1 executes image processing on electronic image data generated by imaging one inspection object, and the image processing is executed. An information processing apparatus for displaying the electronic image data, wherein the electronic image data is subjected to image processing execution means for performing predetermined image processing on the electronic image data, and the electronic image subjected to image processing by the image processing execution means. Electronic image data storage means for storing image data and an image processing result indicating the result of the image processing in association with each other, and predetermined image processing is executed by the image processing execution means, and the electronic image data storage means Predetermined image processing is executed by a plurality of storage determination means for determining whether or not a plurality of image data is stored and the image processing execution means, and the electronic image data recording is performed. Display means for acquiring and displaying one piece of electronic image data out of the electronic image data stored in the storage means, and the display means is stored in the electronic image data storage means by the plurality of accumulation determination means. When it is determined that a plurality of electronic image data are accumulated, the display number of at least one or more electronic image data out of the electronic image data stored in the electronic image data storage means is thinned and displayed, If the accumulation determining means determines that a plurality of the electronic image data is not accumulated in the electronic image data storage means, the display number of the electronic image data stored in the electronic image data storage means is not thinned out. And the display means displays the image processing corresponding to the electronic image data that has been subjected to image processing by the image processing execution means. The electronic image data obtained by acquiring the result from the electronic image data storage means and indicating that the image processing result is abnormal or failed in processing is stored in the electronic image data storage means by the plurality of accumulation determination means. Regardless of whether or not it is determined that a plurality of images are stored, the number of displayed images is displayed without being thinned out.

Claims (10)

An information processing apparatus that performs image processing on electronic image data and displays the electronic image data subjected to the image processing,
Image processing execution means for executing predetermined image processing on the electronic image data;
Electronic image data storage means for storing electronic image data that has been subjected to image processing by the image processing execution means and an image processing result that is a result of the image processing in association with each other;
Display means for thinning and displaying the display of at least one electronic image data among the electronic image data stored in the electronic image data storage means;
An image processing result associated with the electronic image data thinned out by the display unit is acquired from the electronic image data storage unit, and the electronic image data is displayed without being thinned out according to the image processing result. And a thinning determination means for determining whether or not
The display device displays the electronic image data when the thinning determination unit determines that the electronic image data is to be displayed without being thinned.   When the image processing results of the electronic image data displayed by the display device continuously show the same image processing results, the display means collects the electronic image data corresponding to the image processing results. The information processing apparatus according to claim 1, wherein the information processing apparatus displays the information processing apparatus. When electronic image data corresponding to the image processing result is displayed together, the image processing apparatus further includes an allowable value setting unit that sets an allowable value that may include electronic image data of different image processing results,
When the electronic image data of the different image processing result is equal to or less than the allowable value among the image processing results of the electronic image data displayed by the display unit, the display unit outputs the electronic of the different image processing result. The electronic image data including the image data is collectively displayed, and when the electronic image data of the different image processing results is larger than the allowable value, the electronic image data of the different image processing results are collectively displayed. The information processing apparatus according to claim 2.   4. The information processing apparatus according to claim 2, wherein the collected number of the electronic image data collectively displayed is identified and displayed. Electronic image data storage means for storing electronic image data that has been subjected to image processing by the image processing execution step and an image processing result that is a result of the image processing in association with each other, and performing image processing on the electronic image data And a method of controlling the information processing apparatus for displaying the electronic image data on which the image processing has been performed,
An image processing execution step for executing predetermined image processing on the electronic image data;
A display step of decimating and displaying at least one of the electronic image data stored in the electronic image data storage means;
An image processing result associated with the electronic image data thinned out by the display step is acquired from the electronic image data storage means, and the electronic image data is displayed without being thinned according to the image processing result. And a decimation determination step for determining whether or not
The method of controlling an information processing apparatus, wherein the display step displays the electronic image data when the thinning determination step determines that the electronic image data is displayed without being thinned.   In the case where the image processing results of the electronic image data displayed by the display step continuously show the same image processing result, the display step collectively combines the electronic image data corresponding to the image processing result. The information processing apparatus control method according to claim 5, wherein the information processing apparatus is displayed. Electronic image data storage means for storing the electronic image data that has been subjected to image processing by the image processing execution means and the image processing result that is the result of the image processing in association with each other, and performing image processing on the electronic image data A computer-readable program that allows a computer to execute a control method of an information processing apparatus that displays electronic image data subjected to the image processing,
Image processing execution means for executing predetermined image processing on the electronic image data;
Display means for thinning and displaying the display of at least one electronic image data among the electronic image data stored in the electronic image data storage means;
An image processing result associated with the electronic image data thinned out by the display unit is acquired from the electronic image data storage unit, and the electronic image data is displayed without being thinned out according to the image processing result. Function as a decimation determining means for determining whether or not
The display means displays the electronic image data when the thinning determination means determines that the electronic image data is to be displayed without being thinned out.   When the image processing results of the electronic image data displayed by the display device continuously show the same image processing results, the display means collects the electronic image data corresponding to the image processing results. 8. The computer-readable program executable according to claim 7, wherein the computer-readable program is displayed.   A computer-readable recording medium storing the program according to claim 5.   A computer-readable recording medium storing the program according to claim 7.

Images