JP2002251603A - Image processing program formation method and system for it - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a user to form an image processing program for an image processor without requiring any knowledge about image processing. SOLUTION: An image processing program formation function arranged in the image processor 4 displays an objective image obtained by photographing the image processing object on an input/output display device 1, and from at least a single pair of combination of a plurality of kinds of image processing objects and inspection purposes stored in an image processing storage part 431, a matching image processing subroutine candidate set is selected according to an item selected by inputting operation through an operation inputting device 3. Each of a plurality of kinds of image processing subroutine candidates is executed on all or a part of the objective images inside a designated area designated by inputting operation through the operation inputting device 3, and on the basis of the respective execution results of the selected plural kinds of image processing subroutine candidates, the image processing subroutine candidate selected from the set is incorporated into the image processing program as an image processing subroutine to an image inside the designated area.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a method and system for creating an image processing program for creating an image processing program for an image processing apparatus.

[0002]

2. Description of the Related Art Japanese Patent Laid-Open No.
Japanese Patent Application Laid-Open No. 60843 discloses a storage means for storing a plurality of image processing subroutines for executing predetermined image processing, a display means for displaying a menu of image processing subroutines stored in the storage means, An image recognition program construction apparatus is disclosed which includes selection means for selecting a desired subroutine, and construction means for calling a subroutine selected by the selection means and constructing an image recognition program including execution of the called subroutine. . In this device, when an operator selects a desired image processing subroutine, the result of the image processing is displayed on a monitor. If the operator is satisfied with the result of the image processing, the operator registers the image processing subroutine in the image recognition program, and if not satisfied with the result, the operator repeats the selection again. Registration is performed by writing an image processing subroutine in a table. By calling a registered image processing subroutine from the image processing library, an image recognition program for executing desired image processing is realized. In this image recognition program construction device, a user with knowledge about the algorithm
The menu is traced from the knowledge of the image processing, and the result of the selected image processing subroutine is discarded. Also, it is determined whether or not to register the image processing subroutine by seeing the display of one result selected by the user with knowledge of the image processing on the menu.

Japanese Patent Application Laid-Open No. 2000-56958 has a plurality of software components each having input and output arguments for performing various processes on image data. An automatic generation method of image processing software that realizes a desired image processing function by combining software components is disclosed. According to this method, image processing software is automatically generated by searching for a connection candidate between software components based on the input / output relationship of the software components.

Japanese Patent Application Laid-Open No. 63-191278 stores an operation specification of an algorithm and know-how of an image processing expert regarding the use of the algorithm in an external storage device. There is disclosed a user support method at the time of executing an image processing algorithm for explaining a criterion for determining an input selection to an input, limiting an input selection range, or automatically selecting an input. This scheme assists the user in determining the input when it is required to select a sub-function or set a parameter value.

The appearance inspection program creating device of Japanese Patent Application No. 2000-193408 combines an image processing algorithm stored in an image processing algorithm storage unit with an inspection parameter stored in an inspection object type standard inspection flow storage unit. Create a visual inspection program.

Japanese Patent Application Laid-Open No. Hei 9-288568 discloses an image storage means for storing an input image, a processing unit storage means for storing a plurality of types of processing units using a series of processing to be performed on the image as a processing unit, An execution flow storing means for storing an execution flow describing a procedure for selecting and using a processing unit stored in the unit storage means, and an execution flow stored in the processing unit storage means in accordance with the execution flow stored in the execution flow storage means An image processing apparatus including a processing unit that detects a specific property of an object from an image stored in an image storage unit by using each processing unit in combination and an output unit that outputs a processing result by the processing unit is disclosed. ing. The apparatus operates a plurality of types of processing units in accordance with an execution flow describing a procedure, with a series of processing for applying an image as a processing unit. In addition, a method of creating an execution flow of the image processing apparatus is described, and a method of prohibiting creation of a flowchart in a process when there is an undefined variable name has been proposed.

Incidentally, the image processing apparatus is set and used so as to be suitable for the inspection of the image processing object such as the appearance inspection, the dimension measurement inspection, the position measurement inspection, the flaw crack inspection, the character inspection and the like. The setting method includes a first method of setting image processing by selecting and selecting parameters included in the image processing apparatus through a menu and setting parameters, and a method of performing image processing on the image processing apparatus. This is roughly classified into a second method of setting image processing by moving and selecting a program as a basic function.

[0008] By improving the inspection capability of the image processing apparatus,
In recent years in which a variety of objects are being handled, the above-mentioned program is provided to the user as a library and provided to the user rather than the first method which needs to predict the use mode of the image processing apparatus. In many cases, the setting is performed by the second method that can be set to an image processing apparatus suitable for a specific purpose.

In the second method (program method),
In many cases, libraries that are difficult for users to create, such as hardware performance of image processing apparatuses and image processing algorithms, are stored in libraries. And the library is
For example, it is provided in a C language as a C language library or in a dedicated language as a library dedicated to an image processing apparatus.

[0010]

However, in the case of the above-mentioned second method, the user must naturally learn how to use the library as a prerequisite for mastering the library, in addition to the programming language. You will need to learn the skills of designing and creating programs in
There is a problem that a considerable number of man-hours (training) must be completed.

For this reason, a method has been proposed in which the setting of image processing (conditions) is automated to reduce the number of steps (automation of programming). For example, there is automatic teaching, in which an inspection target (object) is captured in the field of view of an image processing apparatus, and a data feature of the image is extracted by an operation such as pressing a button, and the extracted data feature is passed through a predetermined determination algorithm to obtain a predetermined feature. Is determined, and the parameters of the image processing are set based on the determination (for example, see JP-A-2000-134467).

However, this method is applied to a single-function image processing sensor or the like in which image processing is to be inspected in advance, and is applied to a general-purpose image processing apparatus in which image processing is not determined. Is not suitable. The reason is that, in the case of a general-purpose image processing apparatus, if the image to be processed is an image of a red circle on a white background such as a Japanese flag, the area of the red circle can be obtained from the image,
Alternatively, while it is possible to determine the position of the center of gravity of the red circle, it is not possible to determine which of them should be determined by a determination algorithm alone without depending on human judgment.

For this reason, in the image processing apparatus, an area is designated for an image to be image-processed so that it is possible to determine which image processing is to be used for the inspection, and data characteristics of the image in this area are specified. It has been attempted to automatically set (automatically set) which image processing is to be used for inspection by limiting the number of images.

[0014] However, this automatic setting makes it easier to determine which image processing the image processing apparatus performs the inspection by taking in the user's judgment by an operation input of area designation, but is essentially equivalent to automatic teaching. It has the same problem, and only the image processing assumed in advance can be set.

As another automatic program creation method, there is a method of acquiring a user's judgment through an interactive interface and creating a template program. However, in this method, it is necessary to prepare a question for determining what the purpose of the user is in advance.
If a question matching the user's purpose is not prepared, the user needs to answer the question so that a template program considered to be close to the user's purpose is created.
In this case, it is necessary to know what model program is created according to the answer to the question. In addition, at the time of creation of a template program, it is necessary to make a determination in a state where data by image processing is not presented.

Each of the above-mentioned conventional methods is a method for setting an assumed function. The image data extracted by the set function is not fed back to the user, and the automatic setting itself is not adjusted by the user. There has been a problem in that it lacks the growth potential for itself to meet the needs of the user.

The present invention has been made in view of the above circumstances, and an image processing program creating method and an image processing program creating method capable of easily creating an image processing program for an image processing apparatus without a user having knowledge of image processing. The purpose is to provide a system.

[0018]

According to a first aspect of the present invention, there is provided an image processing program creating method comprising: a display unit for displaying an image; an input unit for inputting various operations; Storage means for storing an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates for at least one set of the plurality of types of image processing target items and the plurality of types of inspection target items, An image processing program creating function for creating an image processing program of the image processing apparatus, wherein a step of displaying a target image obtained by imaging the image processing target on the display unit; and Image processing corresponding to an item selected by an operation input through the input means from at least one set of a plurality of types of inspection purpose items And selecting a plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set in a designated area designated by operation input through the input means Selecting from the selected image processing subroutine candidate set based on each execution result of the selected plurality of types of image processing subroutine candidates. Incorporating the selected image processing subroutine candidate into an image processing program of the image processing apparatus as an image processing subroutine for an image in the designated area.

According to this method, the user can input an operation input through the input means to select from at least one of a plurality of types of image processing target items and a plurality of types of inspection target items.
When a desired item is selected and an area is specified for the target image displayed on the display means and information on the specified area is input, an image processing subroutine candidate set corresponding to the selected item is selected, and Each of the plurality of types of image processing subroutine candidates included in the image processing subroutine candidate set is executed on the image in the designated area, and subsequently, the selected image The image processing subroutine candidate selected from the processing subroutine candidate set is incorporated into the image processing program as an image processing subroutine for the image in the designated area. A processing program can be created.

Here, for example, when an image obtained by imaging an inspection target having a defect obtained on a production line is used as the target image, a simple method such as setting a defective region of the target image as a designated region is used. With a simple operation, an image processing program can be created. The plurality of types of image processing subroutine candidates include, for example, various types of inspections such as a foreign substance inspection, a crack inspection, and a crack inspection. By simply performing the above, a plurality of types of image processing subroutine candidates optimal for the inspection purpose are automatically selected, so that the user can input through the input unit without knowing the specific image processing inspection type. The above operation input can be easily performed. Further, when the image processing apparatus is used to confirm whether there is a defect that may occur in the inspection target, a user at the site using the image processing apparatus can perform inspection even if the image processing apparatus has no knowledge of image processing. In general, defects that may occur in the target image processing are known as empirical know-how. Will be.

In short, according to the first aspect of the present invention,
Even if the user does not have the knowledge of the image processing, the image processing program of the image processing apparatus can be easily created, and since the knowledge of the image processing is not required, the learning time can be reduced. Further, since the user sets the designated area, there is no need to create an image processing program for inspecting a wrong portion of the image processing target. Further, since an item is selected from at least one set of a plurality of types of image processing target items and a plurality of types of inspection items, an image processing program suitable for the image processing target and the inspection purpose can be created, and unnecessary Since the items are eliminated, the execution time by the image processing program can be reduced.

According to a second aspect of the present invention, in the method of the first aspect, each of the plurality of selected image processing subroutine candidates is executed on an image in the designated area. Displaying the respective execution results of the image processing subroutine candidates on the display means. In the step of incorporating the image processing subroutine into the image processing program, based on the respective execution results displayed on the display means, The image processing subroutine candidate selected by the operation input through the input unit from the selected image processing subroutine candidate set is incorporated in the image processing program as an image processing subroutine for an image in the designated area. I do. According to this method, when each of the plurality of selected image processing subroutine candidates is executed on an image in the designated area, the execution result of each of the image processing subroutine candidates is calculated. The image processing subroutine is displayed on the display means. After that, based on each execution result displayed on the display means, the user selects an image processing subroutine from the selected image processing subroutine candidate set by an operation input through the input means. When a candidate is selected, the candidate is incorporated into the image processing program as an image processing subroutine for an image in the designated area, so that the image processing program of the image processing apparatus can be created without the user having knowledge of image processing. . Further, since a plurality of types of image processing subroutine candidates corresponding to the item are selected, those image processing subroutine candidates include those corresponding to the item, and those not corresponding to the item are not included. The problem that the number of plural types of image processing subroutine candidates becomes unnecessarily large does not occur, and the operation of selecting an image processing subroutine candidate based on each execution result becomes easy. In addition, the image processing subroutine that does not answer the troublesome interactive questions, and therefore does not need to provide the function, and has a satisfactory execution result by the user,
It is possible to create an image processing program that matches the inspection purpose of the user, and it is not necessary to modify the image processing program.

According to a third aspect of the present invention, in the image processing program creating method according to the first aspect, after each of the plurality of selected image processing subroutine candidates is executed on an image in the designated area. And a step of calculating a degree of deviation indicating a degree of deviation from a predetermined reference from the execution results of these image processing subroutine candidates. In the step of incorporating the image processing subroutine into the image processing program, Automatically selecting an image processing subroutine candidate from the selected image processing subroutine candidate set based on a plurality of divergence degrees, and incorporating the candidate in the image processing program as an image processing subroutine for an image in the designated area. Features. According to this method, when each of the selected plurality of types of image processing subroutine candidates is executed for an image in the designated area,
The degree of divergence is calculated from the execution results of these image processing subroutine candidates, and based on these degrees of divergence, image processing subroutine candidates are automatically selected from the selected image processing subroutine candidate set, and designated. Since the image processing subroutine for the image in the area is incorporated in the image processing program, the image processing program of the image processing apparatus can be more easily created without the user having knowledge of the image processing. Also,
For example, when a defect is detected by each of the different image processing subroutine candidates (image processing algorithms) included in the image processing subroutine candidate set, an image processing subroutine candidate optimal for defect detection is automatically detected therefrom. In this case, it is possible to eliminate a case where a non-optimal image processing subroutine candidate is selected due to a user's erroneous judgment.

According to a fourth aspect of the present invention, in the image processing program creating method of the third aspect, the target image is
In the step of obtaining a plurality of non-defective products and defective products from a plurality of image processing targets, and displaying the target images on the display unit, displaying at least one of the plurality of target images on the display unit, In the step of executing each of the plurality of types of image processing subroutine candidates, the step of executing each of the image processing subroutine candidates on an image in each designated region of the plurality of target images and calculating the degree of divergence is performed. From the execution results of the plurality of types of image processing subroutine candidates for each of the target images,
In the step of statistically calculating the degree of divergence for each image processing subroutine candidate and incorporating the image processing subroutine into the image processing program, the selected image processing subroutine is performed based on the statistically calculated degree of divergence. An image processing subroutine candidate is automatically selected from a subroutine candidate set, and this is incorporated in the image processing program as an image processing subroutine for an image in the designated area. According to this method, the user selects a desired item from at least one of a plurality of types of image processing target items and a plurality of types of inspection target items by an operation input through the input unit, and displays the desired item on the display unit. When an area is designated for at least one target image and information on the designated area is input, an image processing subroutine candidate set corresponding to the selected item is selected, and a plurality of image processing subroutine candidate sets included in the image processing subroutine candidate set are selected. Each type of image processing subroutine candidate is executed on an image in each designated area of the plurality of target images, and subsequently, the plurality of types of selected image processing The degree of divergence of each of the subroutine candidates is calculated statistically, and subsequently, based on these degrees of divergence, the selected image processing subroutine is selected. The image processing subroutine candidate is automatically selected from the image candidate set and is incorporated into the image processing program as an image processing subroutine for the image in the designated area. An image processing program for the device can be created more easily. For example, when an image processing program is created, a plurality of non-defective and defective products flowing on a production line are imaged to obtain a plurality of target images, and the plurality of target images are applied to the invention according to claim 4. Then, the degree of divergence of each image processing subroutine candidate included in the selected image processing subroutine candidate set is statistically calculated, so that the image processing subroutine candidate having the optimum inspection accuracy is automatically statistically determined as an image processing subroutine. You can choose. In addition, a non-defective image and a defective image to be subjected to image processing are acquired and stored before the program is created, and by using this, the program can be efficiently created and the same image data can be repeatedly used and confirmed. .

According to a fifth aspect of the present invention, in the image processing program creating method according to any one of the first to fourth aspects,
The image processing subroutine candidate set includes a plurality of image processing subroutine candidates of the same flow to which different parameter values are assigned. According to this method, a more suitable image processing program can be created with a suitable image processing subroutine candidate set to which suitable parameter values are assigned.

According to a sixth aspect of the present invention, there is provided the image processing program creating method according to any one of the first to fourth aspects,
At least one of the image processing target item and the inspection purpose item input and operated through the input unit and all types of image processing subroutine candidates stored in the storage unit are selected by the operation input through the input unit. According to a plurality of types of image processing subroutine candidates, the image processing subroutine candidates are stored in the storage unit in association with the items input by the operation.
According to this method, the user sets desired items by an operation input through the input unit, and selects a plurality of desired image processing subroutine candidates from all types of image processing subroutine candidates stored in the storage unit. Upon selection, the plurality of types of selected image processing subroutine candidates are stored in the storage unit corresponding to the set items. Such registration is performed, for example, by requesting a production engineer from a manufacturing department engineer, and the manufacturing department engineer who receives the request performs registration according to the site. This makes it possible to create an image processing program that is more suitable for the site.

According to a seventh aspect of the present invention, in the image processing program creating method according to any one of the first to fourth aspects,
When a plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set have a common processing portion, the plurality of types of image processing subroutine candidates also serve as the common processing portion. And Here, a plurality of types of image processing subroutine candidates included in the image processing subroutine candidate set include, for example, a case where the image processing subroutine candidate set performs the same preprocessing in a relationship corresponding to at least one of the image processing target item and the inspection target item. When the pre-processing is executed for each of a plurality of types of image processing subroutine candidates one by one, the entire execution time increases.
According to the seventh aspect of the present invention, the common processing portion is shared by each of the plurality of types of image processing subroutine candidates, and the common processing portion needs to be processed only once. Execution time can be greatly reduced.

According to an eighth aspect of the present invention, there is provided the image processing program creating method according to any one of the first to fourth aspects,
In the step of executing each of the selected plurality of types of image processing subroutine candidates on the image in the designated area, the parameters included in each of the plurality of types of image processing subroutine candidates are selected through the input unit. In accordance with the parameter selected by the operation input and the variable condition specified for this parameter, each of the plurality of selected image processing subroutine candidates is replaced with the selected parameter included therein. The step of executing the image processing subroutine in the image processing program while executing the image processing in the image in the specified area while changing under the specified variable condition, sets the value of the selected parameter in the image processing subroutine to , Set to the center value of the appropriate range of the parameter obtained from each execution result To. According to this method, the user selects a desired parameter from among the parameters included in each of the plurality of types of image processing subroutine candidates already selected by an operation input through the input unit,
If you specify the variable conditions (such as range and increment), according to the selected parameter and the specified variable condition,
Each of the plurality of selected image processing subroutine candidates is executed on an image in a specified area while changing selected parameters included in the selected image processing subroutines under specified variable conditions. The value of the selected parameter in the image processing subroutine candidate selected based on each execution result of the plurality of types of image processing subroutine candidates obtained is determined by the appropriate range of the parameter obtained from each execution result (for example, each execution result (The limit of the appropriate range is determined by the peak of the histogram in (1)), and the image processing subroutine candidate set to this central value is incorporated in the image processing program as an image processing subroutine. With this, when the pass / fail judgment is constant in a specific range, the value of a desired parameter in the image processing subroutine to be incorporated into the image processing program is set to the center value of the appropriate range and set to the most representative parameter. become.

According to a ninth aspect of the present invention, in the image processing program creating method of the second aspect, the step of displaying each execution result of the selected plurality of types of image processing subroutine candidates on the display means includes the steps of: Along with each execution result, the target image or an image that has been subjected to image processing on the target image by an image processing subroutine candidate that has issued each execution result is displayed on the display means. According to this method, the target image or each image-processed image is displayed on the display unit together with each execution result of the selected plurality of types of image processing subroutine candidates, so that the visibility of each execution result is improved, and for example, When it is difficult to select an image processing subroutine candidate based only on each execution result, it is possible to select an appropriate image processing subroutine candidate as an image processing subroutine with reference to the image that has undergone image processing.

According to a tenth aspect of the present invention, in the image processing program creating method according to any one of the first to fourth aspects, a processing portion common to the image processing program created by incorporating the image processing subroutine. If there is, the method further comprises the step of integrating these processing parts as one processing part. According to this method, the capacity of the image processing program can be reduced, and the speed of the execution can be increased. Also,
The image processing program is shortened, and the entire picture is easily grasped.

According to an eleventh aspect of the present invention, in the image processing program creating method according to any one of the first to fourth aspects, a flow chart of the image processing program created by incorporating the image processing subroutine is displayed on the display means. Is displayed. According to this method, it is possible to easily grasp where each image processing subroutine is incorporated in the image processing program. For example, if a flowchart of the image processing program is displayed on the display unit every time the image processing subroutine is incorporated into the image processing program, even if the user is not accustomed to character programming, it is possible to confirm that the number of symbols in the flowchart increases. Thus, it is possible to intuitively grasp where the image processing subroutine is incorporated in the image processing program.

According to a twelfth aspect of the present invention, in the image processing program creating method according to the eleventh aspect, the step of displaying the flowchart of the image processing program on the display means includes the symbol of the image processing subroutine in the flowchart. An image processed by the image processing subroutine with respect to the target image is displayed at the associated position. According to this method, it is possible to easily verify the execution result of each image processing subroutine for an image in each specified area of the target image.

According to a thirteenth aspect of the present invention, in the image processing program creating method according to the eleventh aspect, the step of displaying the flowchart of the image processing program on the display means includes: In accordance with an operation input through the input means, images in respective image processing steps by a corresponding image processing subroutine are sequentially switched and displayed. According to this method, it is possible to confirm whether each image processing step and the image processing result by the image processing subroutine are appropriate.

According to a fourteenth aspect of the present invention, in the image processing program creating method according to the eleventh aspect, the step of displaying the flowchart of the image processing program on the display means includes displaying the flowchart of the image processing program on the display means. In the displaying step, first, a flowchart of the image processing program is displayed on the display unit, and then the selected flowchart is displayed at a position designated by an operation input through the input unit with respect to the flowchart displayed on the display unit. The image processing subroutine candidate is incorporated as an image processing subroutine, and a flowchart of an image processing program created by incorporating the image processing subroutine is displayed on the display means. According to this method, the image processing subroutine can be incorporated at a desired position of the image processing program, and a new image processing subroutine can be easily incorporated at a desired position of the previously created image processing program. In addition, the time (man-hours) for creating another image processing program can be significantly reduced by using the previously created image processing program as a basis.

According to a fifteenth aspect of the present invention, in the image processing program creating method according to any one of the first to fourth aspects, in the step of displaying the target image on the display means, an image of the image processing apparatus is firstly displayed. A flowchart of a processing program is displayed on the display unit together with a symbol for an image processing subroutine, and subsequently, the target image is displayed on the display unit in accordance with selection of the symbol on the flowchart by an operation input through the input unit. And incorporating the image processing subroutine into the image processing program, incorporating the selected image processing subroutine candidate at a position corresponding to the selected symbol in the image processing program as an image processing subroutine. It is characterized by. According to this method, the entire image processing program can be configured before it is created. The user can understand where in the image processing program the image processing subroutine candidate to be selected is incorporated as the image processing subroutine. Even after the image processing program is created, the image processing subroutine can be changed by performing the same steps again. For example, it is not necessary to change the entire image processing program by changing the image processing target, but it is possible to cope with a case where a certain image processing subroutine needs to be changed.

According to a sixteenth aspect of the present invention, in the image processing program creating method according to any one of the first to fourth aspects, after the image processing subroutine is incorporated in the image processing program, the designated area is added together with the target image. On the display means, and in response to an operation input through the input means for copying and pasting the designated area displayed on the display means to another designated area, an image corresponding to an image in the another designated area Modifying the image processing program by allocating the selected image processing subroutine candidate as a processing subroutine. According to this method, the image processing subroutine to be applied is simply determined by focusing on the defect of the specific portion to be inspected, and the same image processing subroutine is easily applied to another portion where the defect is likely to occur. can do. As a result, the time for creating the image processing program can be significantly reduced. When the designated area to be actually inspected is a polygon or the like and it is difficult to represent the area with a typical area shape such as a rectangle, the image processing subroutine is determined in advance in another area having a typical area shape such as a rectangle. In advance, by copying the set contents of the determined image processing subroutine to a designated area having a desired shape, the image processing subroutine of the designated area can be set.

According to a seventeenth aspect of the present invention, there is provided a display means for displaying an image, an input means for inputting various operations, and at least one of a plurality of types of image processing target items and a plurality of types of inspection purpose items which are classified in advance. A storage means for storing an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates for each set item, and an image processing program creating function for creating an image processing program of the image processing apparatus. An image processing program creation function, wherein the image processing program creation function displays a target image obtained by imaging the image processing target on the display unit, and displays the plurality of types of image processing target items and a plurality of types of inspection purposes. From at least one set of items, according to the item selected by the operation input through the input means,
A corresponding image processing subroutine candidate set is selected from the storage unit, and each of a plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set is designated by an operation input through the input unit. Executes on all or a part of the target image in the area, and selects from the selected image processing subroutine candidate set based on each execution result of the selected plural types of image processing subroutine candidates Each of the image processing subroutine candidates is executed as an image processing subroutine for an image in the designated area, which is incorporated in an image processing program of the image processing apparatus. According to this configuration, it is possible to easily create an image processing program of the image processing apparatus even if the user does not have knowledge of image processing, and it is not necessary to have knowledge of image processing, so that learning time is reduced. be able to. Further, since the user sets the designated area, there is no need to create an image processing program for inspecting a wrong portion of the image processing target. Further, since an item is selected from at least one set of a plurality of types of image processing target items and a plurality of types of inspection items, an image processing program suitable for the image processing target and the inspection purpose can be created, and unnecessary Since the items are eliminated, the execution time by the image processing program can be reduced.

[0038]

FIG. 1 is a block diagram of an image processing program creation system, FIG. 2 is an explanatory diagram of an image processing algorithm storage section of FIG. 1, and FIG. 3 is an image processing program provided in the image processing program creation system of FIG. FIG. 4 is an explanatory diagram of the operation flow of the program creation function, and FIG. 4 is an explanatory diagram of the operation flow of FIG. 3. The first embodiment of the present invention will be described with reference to these drawings.

The image processing program creating system shown in FIG. 1 is an image input / output display device 1 composed of a CRT or LCD, and an image processing target (for example, an inspection target such as a product). The image processing apparatus includes an imaging device 2, an operation input device 3 configured by a keyboard and a mouse for various operation inputs, and an image processing device 4.

The image processing apparatus 4 comprises a CPU, various memories, a hard disk, and the like. , An image processing program execution unit 46, a processed image / result storage unit 47, and an image / setting display memory 48
And has a normal image processing function constituted by these units and an image processing program creation function which is a feature of the first embodiment.

Of these two functions, the ordinary image processing function is the same as the conventional one, so that the description thereof is omitted, and the image processing program creation function which is a feature of the first embodiment will be described below. In the example of FIG. 1, the program creation unit 44 includes an automatic execution data storage unit 441, an image processing subroutine insertion position designation unit 442, an area designation unit 443,
It includes a “plurality of image processing subroutine candidate execution units” 444, an image processing subroutine candidate selection / designation unit 445, and an “incorporation unit into image processing program” 446. Further, the image processing algorithm storage unit 43 includes an image processing storage unit 431 and a plurality of image processing subroutine candidate set setting information units 432.

First, the problem to be solved by the image processing program creation function will be described. Conventionally, as described above, the use of the image processing apparatus requires a certain number of learning steps. Therefore, actually, only a technician who has learned image processing tends to use the image processing apparatus, and the range of use cannot be expanded. In order to reduce these man-hours, there are image processing apparatuses having an automatic setting function and a template program creating function. However, these apparatuses convert image processing into a subroutine and select an image processing subroutine through a menu or an interactive interface. An image processing program is created, and usually has a selection interface corresponding to each image processing function, so that the user is often forced to recognize the contents of the image processing.

For example, in the image recognition program construction apparatus disclosed in Japanese Patent Application Laid-Open No. Hei 7-160843, the coding and compiling work is not required by selecting a menu, and the creation of the image processing program is simplified. The user is expected to have knowledge of the data, and the image processing subroutine is selected based on the knowledge. However, in a general-purpose image processing device,
Its functions are also diverse, there are many image processing subroutines (often more than 100 image processing subroutines are prepared), and an image processing subroutine suitable for a user without image processing knowledge to realize desired processing. It is difficult to make a choice.

Therefore, in the first embodiment, in order to solve the above problems, the input / output display device 1, the operation input device 3, and the image processing storage unit 431 included in the image processing algorithm storage unit 43 are used. An image processing program creation function for creating an image processing program for the image processing apparatus 4 is provided.

The image processing storage unit 431 stores an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates for each of a plurality of types of image processing target items and a plurality of types of inspection target items which are classified in advance. It is remembered. As shown in the example of FIG. 2, the inspection purpose items are classified in advance into items such as appearance inspection, dimension measurement, presence / absence detection (position detection), and character detection, and an image processing subroutine candidate set corresponds to each of these items. And stored in the image processing storage unit 431. In the case of the appearance inspection item, each image processing subroutine candidate set includes a plurality of types of image processing subroutine candidates for foreign matter inspection, crack inspection, crack inspection, and chipping inspection. Similarly, dimension measurement,
Each set of image processing subroutine candidates for presence / absence detection and character detection also includes a plurality of types of image processing subroutine candidates as shown in FIG. Then, a plurality of types of image processing subroutine candidates included in each of these image processing subroutine candidate sets are represented by a GU shown in FIG.
It is selectable through I (graphical user interface). For example, as shown in FIG. 2C, if the foreign matter inspection item included in the visual inspection image processing subroutine candidate set is activated and the operation of turning on the “setting” button of the GUI through the operation input device 3 is performed. Then, an image processing subroutine candidate for foreign substance inspection is selected.

Although not shown in the example of FIG. 2, each image processing target item is also associated with an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates. As an example of the image processing target item, when the image processing target is a product, a product classification item such as a switch, which has a stable shape as a product, is used, and the image processing target is a person or an animal. Is used for site items such as hands, feet, and face. Further, the image processing subroutine candidate set may be associated with both the image processing target and the inspection purpose as one item.

The image processing program creation function is mainly composed of an automatic execution setting section 42 and a program creation section 44, and executes various processes for creating an image processing program for the image processing apparatus 4. For example, the data of the target image obtained by the imaging of the image processing target and stored in the imaging memory 41 is transferred to the image / setting display memory 48, and the target image is displayed on the screen of the input / output display device 1. Is performed. In addition, from at least one of a plurality of types of image processing target items and a plurality of types of inspection target items, a corresponding image processing subroutine candidate set is subjected to image processing in accordance with an item selected by an operation input through the operation input device 3. A process of selecting from the storage unit 431 is performed.
Further, each of the plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set is
A process is executed for all or a part of the target image in the designated area designated by the operation input through the operation input device 3, and the result of each execution is displayed on the screen of the input / output display device 1. Be executed. Further, based on each execution result displayed on the screen, the image processing subroutine candidate selected by the operation input through the operation input device 3 is replaced with the image processing subroutine candidate selected from the selected image processing subroutine candidate set in the designated area. Is executed in the image processing program of the image processing apparatus 4 as an image processing subroutine corresponding to.

Next, the operation of the image processing program creation function which is a feature of the first embodiment will be described. First, G
Using the UI, a process for switching the screen of the input / output display device 1 to a screen for designating a position in the image processing program in which an image processing subroutine candidate to be selected by the user from now on is to be inserted as an image processing subroutine is executed. You. Thereafter, in step S1, when the position where the image processing subroutine is to be inserted is designated by the operation input through the operation input device 3, the designated position information is temporarily held, and then the target image is input / output. Processing for displaying on the screen of the display device 1 is performed. These are executed by the automatic execution setting unit 42 and the image processing subroutine insertion position designation unit 442.

Thereafter, in step S 2, a designated area for all or a part of the target image (see the “area creation” frame in FIG. 4A) is designated by an operation input through the operation input device 3. Then, the information of the designated area is temporarily held (443 in FIG. 1), and subsequently, a desired item is selected from at least one set of a plurality of types of image processing target items and a plurality of types of inspection target items using the GUI. Is performed to switch the screen of the input / output display device 1 to the screen for prompting the user to select.

Thereafter, when a desired item is selected from at least one of a plurality of types of image processing target items and a plurality of types of inspection target items by an operation input through the operation input device 3, the process proceeds to step S3. A process of selecting an image processing subroutine candidate set corresponding to the item from the image processing storage unit 431 is performed.

Subsequently, in step S4, a process of selecting one image processing subroutine candidate from the selected image processing subroutine candidate set in accordance with the registration order and executing the selected image processing subroutine for an image in the designated area is performed. (4 in FIG. 1)
44).

Subsequently, in step S5, it is determined whether or not an unexecuted image processing subroutine candidate remains in the selected image processing subroutine candidate set.
If unexecuted image processing subroutine candidates remain (S
5), return to step S4, otherwise (NO in S5), input and output the execution results of each of the above image processing subroutine candidates in step S8, as shown in the example of FIG. A process of displaying on the screen of the device 1 and receiving a desired image processing subroutine candidate is executed (445 in FIG. 1).

Then, in steps S9 and S10, based on the execution results displayed on the screen, a desired image processing subroutine is selected from the selected image processing subroutine candidate set by an operation input through the operation input device 3. Candidate (Fig. 4
When “crack inspection” is selected in (d), the selected image processing subroutine candidate is set as the image processing subroutine for the image in the specified area, and the position specified in step S1 in the image processing program. (See "Inspection of crack in region 1" in FIG. 4C).

Here, for example, when an image obtained by imaging an inspection target having a defect obtained on a production line is used as the above-mentioned target image, it is possible to simply use a defective region of the target image as a designated region. With a simple operation, an image processing program can be created. In fact, on the production line, an image processing program is created while referring to an image of the inspection target itself having a defect. It is possible to create an image processing program while pointing out a region where the occurrence is possible.

The plurality of types of image processing subroutine candidates include those for various kinds of inspections such as a foreign matter inspection, a crack inspection and a crack inspection. By simply selecting the inspection purpose such as detection, a plurality of types of image processing subroutine candidates that are optimal for the inspection purpose are automatically selected. Therefore, the user does not know the inspection type of the specific image processing described above. However, the operation input through the operation input device 3 can be easily performed.

The image processing generally includes an appearance inspection,
There are types such as dimension measurement and presence / absence detection, and even if the image processing target is different, the same image processing algorithm is used in the process of matching the characteristics of the image data when performing the same inspection Tend. That is, image processing can be performed as long as a small number of image processing algorithms can be used at least at the initial stage among many image processing algorithms mounted on the image processing apparatus. Further, when handling similar inspection targets, processing is often performed by incorporating a similar image processing program. Therefore, the representative (frequently used) image processing is automatically executed, and a part where the judgment incorporated in the image processing apparatus alone is not sufficient is fed back to the user as an automatic processing result, and the user's judgment is asked. Thus, it becomes possible to create an optimal image processing program.

Further, when the image processing apparatus 4 is used for confirming whether or not there is a defect that may occur in the inspection object, a user at the site using the image processing apparatus 4 has knowledge of image processing. Even if there is no defect, the defect that can occur in the image processing target as the inspection target (for example, a defect part of the inspection target or a place where a defect is likely to occur) is usually grasped as empirical know-how. An image processing program is created that incorporates empirical know-how relating to possible problems.

As described above, according to the first embodiment, even if the user does not have knowledge of image processing, the image processing program of the image processing apparatus 4 (for example, an application program suitable for an image processing object such as visual inspection and measurement) can be simplified. In addition to this, it is not necessary to have knowledge of image processing, so that the learning time (man-hours) can be reduced. Further, since the user sets the designated area, there is no need to create an image processing program for inspecting a wrong portion of the image processing target.
Further, since an item is selected from at least one set of a plurality of types of image processing target items and a plurality of types of inspection items, an image processing program suitable for the image processing target and the inspection purpose can be created, and unnecessary Since the items are eliminated, the execution time by the image processing program can be reduced.

Further, since a plurality of types of image processing subroutine candidates corresponding to the items are selected, these image processing subroutine candidates include those corresponding to the items and those not corresponding to the items are not included. The problem that the number of the selected plural types of image processing subroutine candidates becomes unnecessarily large does not occur, and the operation of selecting the image processing subroutine candidates based on each execution result becomes easy. further,
It is possible to create an image processing program that meets the user's inspection purpose by using the image processing subroutine candidates that have been executed satisfactorily by the user without answering the troublesome interactive questions and therefore without providing the function. Can,
Modification of the image processing program can be made unnecessary.

In the first embodiment, the image processing program creation function is provided in the image processing apparatus. However, the image processing program creation function is provided separately from the image processing apparatus. A configuration provided as a device may be used.

FIG. 5 is an operation flowchart of another image processing program creation function provided in the image processing program creation system, and FIG. 6 is an explanatory diagram of the operation flow of FIG. 5. Two embodiments will be described.
However, FIG. 1 is commonly used in the following embodiments.

The image processing program creation system according to the second embodiment includes an input / output display device 1, an image pickup device 2, and an operation input device 3 in the same manner as in the first embodiment. An image processing apparatus 4 having the same configuration as that of the first embodiment except that the image processing program creation function further has a parameter setting function for.

That is, as shown in FIG.
Steps S6 and S7 are added between the steps S5 and S8. In the step S6, G such as the "parameter correction screen" shown in FIG.
Using the UI, a correction input of a parameter for a desired image processing subroutine candidate is received, and if there is a correction (YES in S7), the parameter for the desired image processing subroutine candidate is corrected to the received parameter. When the process returns to step S4 and there is no correction (NO in S7), the process proceeds to step S8.

As described above, according to the second embodiment, it is possible to modify a parameter for a desired image processing subroutine candidate, so that a more suitable image processing program can be created.

FIG. 7 is an operation flowchart of another image processing program creation function provided in the image processing program creation system, and FIGS. 8 and 9 are explanatory diagrams of the operation flow of FIG.
The third embodiment of the present invention will be described with reference to these drawings.

The image processing program creation system according to the third embodiment displays on the screen of the input / output display device 1 the results of execution of the selected plural types of image processing subroutine candidates.
On the basis of each execution result displayed on this screen, instead of the processing procedure of selecting an image processing subroutine candidate by an operation input through the operation input device 3 from the selected image processing subroutine candidate set, a plurality of selected image processing subroutine candidates are selected. From the respective execution results of the image processing subroutine candidates, a degree of deviation indicating a degree of deviation from a predetermined reference is calculated, and based on the plurality of degrees of deviation, an image is automatically extracted from a selected image processing subroutine candidate set. The configuration is the same as that of the first embodiment except that the image processing device 4 is provided with an image processing program creation function including a processing procedure for selecting a processing subroutine candidate.

In the third embodiment, image processing targets of one good product and one defective product are respectively imaged to obtain two target images, and a selected image processing subroutine candidate set is set for each of these target images. The image processing subroutine candidates included in are executed, and from these execution results, the value is small for the non-defective target image and large for the defective target image. When the image is defective, an image processing subroutine candidate having the largest divergence value is selected, and the image processing subroutine is incorporated into the image processing program as an image processing subroutine.

In FIG. 7, when two target images are input to the image processing apparatus 4, the processing of steps S11 and S12 is performed on the defective target image, and thereafter, the process proceeds to steps S13 and S14. Then, the process is switched to a non-defective image, and the process returns to step S11 to execute the processes of steps S11 and S12 on the non-defective target image, and then proceeds to step S17 via steps S13 and S15.

In step S11, as in the first embodiment, a process for switching to a screen for designating an insertion position of the image processing subroutine, a process for temporarily storing designated position information and displaying a target image, and a process for designating a designated area Is temporarily held and the screen is switched to a screen for selecting a desired item, an image processing subroutine candidate set corresponding to the selected item is selected from the image processing storage unit 431, and each image processing subroutine candidate is executed. Is performed. In step S12, a process of storing the execution results of the respective image processing subroutine candidates in a predetermined memory or the like is executed (441 in FIG. 1).

When the process proceeds to step S17, the process of calculating the normalization value of the non-defective product is executed. Subsequently, in steps S18 to S20, the process of calculating the normalized value of the non-defective product, and Processing for calculating the ratio of the degree of divergence (degree of separation) and processing for selecting the algorithm for the maximum degree of divergence are sequentially executed, and thereafter, the image processing subroutine candidate automatically selected based on the degree of divergence is converted to an image processing subroutine. The processing to be incorporated in the image processing program of the image processing apparatus 4 is executed.

Here, as shown in FIG. 8 (a), in steps S17 and S18, a normalized value (percentage) is calculated with the measured value based on the non-defective product in order to make the determination based on the same standard. The present invention is not limited to this, and normalization may be performed using an average value of a plurality of non-defective standards, or a maximum reference value or a minimum reference value obtained from the average value and the standard deviation.

In step S19, it is considered that the measurement result of the non-defective product is sufficiently close to the non-defective product standard, and the ratio of the deviation of the non-defective product from the non-defective product standard (see the following equation). ) Is calculated as shown in FIG. 8B. In step S20, the image processing subroutine candidate with the largest ratio of divergence is selected as the image processing subroutine that best separates good / bad.

Ratio = | Defective Product Normalized Value−100 | / | Normal Product Normalized Value−100 | More specifically, when the black circular image shown in FIG. Although a large number of data obtained by the image processing are conceivable, here, it is assumed that the data is a correlation value obtained by area, perimeter detection, projection width, and pattern matching. When the image shown in FIG. 9B is defined as a non-defective image, it is slightly smaller and biased than the non-defective standard.
Although there is a difference from the non-defective product standard, the above data obtained from this non-defective product image is considered to be sufficiently close to the non-defective product standard. With this setting,
For example, comparing the images A, B, and C shown in FIGS.
In the case of, the divergence of the area value and the perimeter does not change much, and the divergence of the projection width and the pattern matching increases. Also,
In the case of the image B, the divergence between the projection width and the perimeter does not change much, and the divergence between the area value and the pattern matching increases. In the case of the image C, the projection width, the area value, and the divergence of the pattern matching do not change much, and the divergence of the peripheral length increases. As described above, the image processing effective for accurate determination differs depending on the state of the defect. Therefore, it is an object of the third embodiment to select image processing suitable for the state of the defect to be extracted.

As described above, according to the third embodiment, an image processing program of an image processing apparatus can be more easily created without a user having knowledge of image processing.

In the flow of FIG. 7, one non-defective image and one defective image are to be used. However, if a plurality of non-defective images are used, the deviation degree from a larger number of sample images can be determined. The ratio is obtained statistically. As a result, a more suitable image processing subroutine candidate can be selected, and a more suitable image processing program can be created. Also, in the manufacturing process, after confirming the non-defective product standards, the staff flows the non-defective product group and the defective product group into the process, and trains them so that they can accurately determine the mixture of non-defective products and defective products, and gains experience. However, the above-described image processing program creation system can be applied as it is.

FIG. 10 is an explanatory diagram of another image processing program creating function provided in the image processing program creating system. FIG. 11 is an illustration of selecting an image processing subroutine candidate, correcting its parameters, and registering a new image processing subroutine candidate. It is a figure and a 4th embodiment of the present invention is described using these figures.

The image processing program creation system according to the fourth embodiment is similar to the first embodiment except that the image processing subroutine candidate set includes a plurality of image processing subroutine candidates of the same flow to which mutually different parameter values are assigned. The configuration is the same as that of the form.

That is, as shown in FIG. 10, for each of a plurality of types of image processing subroutine candidates such as a foreign substance inspection, a crack inspection, and a fray inspection included in the image processing subroutine candidate set, an image processing subroutine candidate having the same flow is used. A plurality of parameters are provided, and different values are assigned to the respective parameters in advance. For example, "40", "5"
Different values of “0” and “60” are assigned, and “10” and “5” are assigned to the “light amount difference threshold value” of the same flow of crack inspection.
A different value of “0” is assigned, and different values of “15” and “10” are assigned to “the number of lines” of the same flow of the gating inspection.

As shown in FIG. 11A, a plurality of types of image processing subroutine candidates included in the image processing subroutine candidate set have respective execution results (“O” in the figure).
K ”,“ NG ”), and a desired item can be selected through the GUI. For example, if the user activates a desired image processing subroutine candidate and turns on the “setting” button of the GUI through the operation input device 3, the image processing subroutine candidate is selected as the image processing subroutine. To cancel, an operation of turning on a “cancel” button on the GUI may be performed.

If the operation of turning on the "parameter setting" button of the GUI is performed through the operation input device 3, the screen is switched to the "parameter setting / registration" screen shown in FIG. Then, by performing an operation of inputting a parameter item whose desired value is to be corrected through the operation input device 3, and then performing an operation of turning on a “setting” button of the GUI,
The value of the parameter of the corresponding image processing subroutine candidate shown in FIG. 10 is corrected to the input value. G
If an operation of turning on the “register” button of the UI is performed, the same flow as the corresponding image processing subroutine candidate is copied, and a series of parameters shown in FIG. Candidates are added to the corresponding image processing subroutine candidate set.

As described above, according to the fourth embodiment, a more suitable image processing program can be created with a suitable image processing subroutine candidate set to which suitable parameter values are assigned.

FIG. 12 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system. A fifth embodiment of the present invention will be described with reference to FIG.

The image processing program creation system according to the fifth embodiment includes at least one of an image processing target item and an inspection target item input through the operation input device 3 and all of the items stored in the image processing storage unit 431. In accordance with the plurality of types of image processing subroutine candidates selected by the operation input through the operation input device 3 from the types of image processing subroutine candidates, the image processing subroutine candidates are stored in the image processing corresponding to the items input by the operation. Part 43
1 is configured in the same manner as the first embodiment except that the image processing program creation function further performs the processing to be stored in 1.

That is, as shown in FIG. 12A, a large number of image processing subroutine candidates are stored in the image processing storage section 431, and the "image processing object / purpose selection" shown in FIG. When the screen is called, the image processing storage unit 4
All types of image processing subroutine candidates stored in 31 are displayed on the input / output display device 1. Then, at least one of the image processing target item and the inspection purpose item is input through the operation input device 3, and a plurality of types of image processing desired from all types of image processing subroutine candidates displayed on the input / output display device 1 are performed. When a subroutine candidate is selected, these image processing subroutine candidates are stored in the image processing storage unit 431 corresponding to the input items. In the examples of FIGS. 12B, 12C, and 12D, the item of the appearance inspection is selected, and corresponding to this item, the image processing subroutine candidates of the foreign substance inspection, the crack inspection, the crack inspection, and the chipping inspection are displayed as images. It is stored in the processing storage unit 431. Such registration is performed, for example, by requesting a production engineer from a manufacturing department engineer, and the manufacturing department engineer who receives the request performs registration according to the site. FIG.
2 (d) shows the result of automatic execution by the newly registered image processing subroutine candidate set.

As described above, according to the fifth embodiment, it is possible to create an image processing program that is more suitable for the site.
In addition, by registering or deleting a plurality of image processing subroutine candidates to be automatically executed and customizing the image processing subroutine candidate set and making it easy to select each image processing subroutine candidate set, the productivity of image processing program creation can be improved. It is to improve.

FIG. 13 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system, and a sixth embodiment of the present invention will be described with reference to FIG.

The image processing program creation system according to the sixth embodiment, when a plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set have a common processing portion, the plurality of types of image processing subroutine candidates The configuration is the same as that of the first embodiment except that the processing subroutine candidate also serves as the common processing part.

In the examples shown in FIGS. 13A to 13D, the image processing subroutine candidate set includes a plurality of types of image processing subroutine candidates for presence / absence determination, area detection, center of gravity position detection, and crack inspection. Each includes a plurality of types of processing. At the time of designing this image processing subroutine candidate set, it is possible to know what kind of pre-processing or common processing is included in each image processing subroutine candidate. Common information is set.

Here, the processing of binarization, differentiation and thinning is set as common information (binarization, differentiation and thinning). Specifically, among a plurality of types of image processing subroutine candidates, image processing subroutine candidates for presence / absence determination, area detection, and center-of-gravity position detection include binarization processing of common information, and differential processing of common information. (1, 0, 0) is assigned to each of them instead of the algorithm of each process of the common information.
In contrast, the remaining image processing subroutine candidates include:
Since differentiation processing and thinning of the common information are included and binary processing of the common information is not included, (0, 1, 1) is assigned instead of the algorithm of each processing of the common information. . The algorithm of each process of the common information is included in the image processing subroutine candidate set.

As described above, when each image processing subroutine candidate to which common information is assigned is first called instead of the algorithm of each of the binarization, differentiation and thinning processing, first, the common information Each process is executed, and output data of the common process is temporarily held. Thereafter, the output data is copied and used in accordance with the common information stored in each image processing subroutine candidate, and the individual processing of each image processing subroutine candidate excluding each processing of the common information (in FIG. Part) is executed.

Since the parameters may be different even in the same binarization, the parameters may be added to correspond to the flags as shown in FIG. However, in the figure, alphabets such as A, B, and C are parameter conditions, and numbers 0 and 1 are common flags.

A plurality of types of image processing subroutine candidates included in the image processing subroutine candidate set include, for example, a case where the image processing subroutine candidate set performs the same preprocessing because of a relationship corresponding to at least one of the image processing target item and the inspection target item. When the pre-processing is executed for each of a plurality of types of image processing subroutine candidates one by one, the overall execution time increases, but according to the sixth embodiment, a plurality of types of common processing parts are used. The image processing subroutine candidates are also used in common, and only one processing is required for the common processing part, so that the execution time for creating the image processing program can be greatly reduced.

FIG. 14 is an operation flow diagram of another image processing program creation function provided in the image processing program creation system, and FIGS. 15 and 16 are explanatory diagrams of the operation flow of FIG. A seventh embodiment of the invention will be described.

When the image processing program creating system of the seventh embodiment executes each of a plurality of selected image processing subroutine candidates on an image in a designated area, the plurality of image processing subroutine candidates are selected. Each of the plurality of selected image processing subroutine candidates is selected according to a parameter selected by an operation input through the operation input device 3 and a variable condition specified for the parameter among the parameters included in each of the parameters. Is performed on the image in the designated area while changing the selected parameter included in the designated condition under the designated variable condition,
When incorporating the selected image processing subroutine candidate into an image processing program as an image processing subroutine, set the value of the selected parameter in the image processing subroutine to the center value of the appropriate range of the parameter obtained from each execution result The configuration is the same as that of the first embodiment except that the image processing program creation function further performs the processing to be performed.

That is, if the variable parameter flag is 1,
If a parameter is selected and this variable condition is specified (YES in S21), the process proceeds to step S22, otherwise (NO in S22), the process proceeds to step S28.

At step S22, the value of the selected parameter is changed to the initial value of the variable condition.
In step 3, a process of executing an image processing subroutine of the changed parameter is performed. Subsequently, step S24
Then, it is determined whether or not the execution result is within the proper range. If the result is proper (YES in S24), the parameter is stored in step S25, and thereafter, the process proceeds to step S26. (NO in S24), Step S26
Proceed to.

At step S26, it is determined whether or not the value of the parameter has exceeded the variable condition (variable range). If it has exceeded (YES at S26), the parameter is set at the center of the appropriate range at step S27. Thereafter, the process proceeds to step S28, but if not exceeded (NO in S26), the process returns to step S22 after changing the parameter value. In step S28, the same processing as the flow shown in FIG. 3 of the first embodiment is executed.

In the case of detecting the position of the center of gravity shown in the example of FIG. 15, when the variable parameter flag is 1 in steps S22 to S27, the parameter is determined by referring to the variable parameter information section and executing this part. That is, the “plurality of image processing subroutine candidate execution units” 444 in FIG.
Determines the parameters using the variable parameter information in the image processing subroutine candidate set, and then proceeds to step S
It proceeds to automatic execution of 28. A variable parameter flag indicating the presence or absence of a variable parameter is prepared for each image processing subroutine candidate.
At this time, the parameter determination routine of steps S22 to S27 functions.

When the upper and lower limits and the amount of change of a specific parameter are set, the "plurality of image processing subroutine candidate execution units"
444 executes all of them, and stores the parameters if the inspection result is within the appropriate range. After the execution of all the variable parameters, the parameters are determined from the upper and lower limits of the appropriate parameters. In step S27 of FIG. 14, an average value or a median value of the appropriate parameters closest to the upper limit and the appropriate parameters closest to the lower limit is obtained. For the left image shown in the example of FIG.
When it is desired to obtain the center of gravity position around the center of the portion, the variable parameter is set as a threshold value for binarization, the upper limit value of the threshold value is 200, the lower limit value is 100, and the change amount is 1,
Assuming that the appropriate range of the inspection result (center of gravity position) is the rectangular region R1, the position of the center of gravity is obtained between the binarization thresholds 151 to 180, and the binarization threshold determined by automatic execution is 165. Become.

Here, in the prior art in which a series of processes of selecting and executing the image processing subroutine, displaying the execution result, and selecting or canceling the image processing subroutine are repeated to create an image processing program, the image processing subroutine is used. However, since parameters predicted in advance are used, there is a problem that an appropriate image processing program cannot be created unless the inspection target is within the expected range.

On the other hand, according to the seventh embodiment, the parameters of the image processing subroutine are set to appropriate values, so that an appropriate image processing program can be realized. Also,
When the pass / fail judgment is constant in a specific range, the value of a desired parameter in the image processing subroutine to be incorporated in the image processing program is set to the center value of the appropriate range, and set to the most representative parameter.

FIG. 17 is an operation flow diagram of another image processing program generation function provided in the image processing program generation system, and FIG. 18 is an explanatory diagram of the operation flow of FIG. 14. Eighth embodiment will be described.

The image processing program creating system according to the eighth embodiment, when displaying the execution results of a plurality of types of selected image processing subroutine candidates on the screen of the input / output display device 1, displays the execution results together with the respective execution results. Except that the image processing program creating function further includes a processing unit that displays an image or an image that has been subjected to image processing on the target image by the image processing subroutine candidate that has issued each execution result on the screen of the input / output display device 1. The configuration is the same as that of the first embodiment.

That is, as in the first embodiment, when the execution results of a plurality of selected image processing subroutine candidates are obtained in step S31, the respective execution results (the processing results in FIG. ) Is stored, and in step S33, a process of storing the image indicated by the image processing flag is performed. Here, the image display flag shown in the example of FIGS. 18A and 18B is used. This image display flag is added to each image processing subroutine candidate in the image processing subroutine candidate set, and the target image (the original image in the figure)
Alternatively, the input / output display device 1 has a flag indicating which of the processes of the added image processing subroutine candidates is to be displayed on the screen of the input / output display device 1 after the image processing. For example, as for the image processing subroutine candidates of the foreign matter inspection and the fray inspection in the image processing subroutine candidate set, since the flag of the original image is 1, the original image is displayed on the screen of the input / output display device 1, and the crack inspection is performed. All flags are 0 for the image processing subroutine candidate
, The image is not displayed.

In step S34, 1 is set in the image display flag.
It is determined whether or not there is a flag. If the flag is 1 (YES in S34), the corresponding image is combined with the processing result in step S35, and a list of processing results is created in step S36. If there is no 1 flag (NO in S34), the process proceeds to step S36. Thereafter, each execution result is displayed on the screen of the input / output display device 1 according to the created list. FIG. 18C shows FIG.
8A and 8B show display examples corresponding to the image display flags. In the example of FIG. 18C, one image is displayed in one image processing subroutine candidate, but a plurality of images may be displayed.

As described above, according to the eighth embodiment, the visibility of each execution result is improved. For example, when it is difficult to select an image processing subroutine candidate using only each execution result, referring to an image that has been subjected to image processing, It is possible to select an appropriate image processing subroutine candidate.

FIG. 19 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system. The ninth embodiment of the present invention will be described with reference to FIG.

In the image processing program creating system according to the ninth embodiment, if an image processing program created by incorporating an image processing subroutine has common processing parts, these processing parts are integrated as one processing part. The configuration is the same as that of the first embodiment except that the processing is further performed by the image processing program creation function.

For example, as shown in FIG. 19A, in response to an operation input for selecting an image processing subroutine candidate for presence / absence judgment from an image processing subroutine candidate set, this is incorporated into an image processing program, and then another image processing subroutine is selected. In response to an operation input for selecting an image processing subroutine candidate for area detection from the processing subroutine candidate set, the image processing subroutine is incorporated into the image processing program, and the image processing program is created. Then, the screen is switched to the screen shown in FIG. Processing is performed.

Thereafter, in response to an operation input for checking “edit” on the screen shown in FIG.
Processing for editing the processing order of (c) to the processing order of FIG. 19D is performed. In the processing order before the editing shown in FIG. 19C, the processing shifts from the presence / absence determination to the detection of the center of gravity. However, an instruction to edit the commonization is given by a menu or the like, and FIG. As shown in (2), processing for integrating common processing parts as one processing part is performed so that the binarization processing is performed before the presence / absence determination.

The area information in the figure is generated by the “embedding unit into image processing program” 446 based on the information input by the user in the image processing subroutine insertion position specifying unit 442. The content of the area information includes an area number (I which indicates which area each image processing targets).
D), area type (rectangle, circle, polygon, etc.), area shape (vertex coordinates, center coordinates / radius, etc.), and the like.

As described above, according to the ninth embodiment, the capacity of the image processing program can be reduced, and the execution speed thereof can be increased. In addition, the image processing program is shortened, the entire image is easily grasped, and the productivity of image processing can be improved.

FIG. 20 is an operation flow diagram of another image processing program generation function provided in the image processing program generation system, and FIG. 21 is an explanatory diagram of the operation flow of FIG. 20. Tenth embodiment will be described.

The image processing program creating system according to the tenth embodiment displays a flowchart of an image processing program created by incorporating an image processing subroutine on the screen of the input / output display device 1, and displays the image processing subroutine in the flowchart. The configuration is the same as that of the first embodiment except that the image processing program creating function further performs a process of displaying an image that has been subjected to image processing on the target image by the image processing subroutine at a position associated with the symbol, for example, the symbol. Is done.

In FIG. 20, when an image processing subroutine candidate is selected in step 41, "configuration of an additional program by image processing subroutine" in step S42, "display data reading" in step S43, and "image data" in step S44. "Read icon of processing subroutine", "Read output image" in step S45, "Synthesize display icon and output image" in step S46, "Create display position information of display icon" in step S47,
The processes of “create icon connection information” in step S48 and “write display data” in step S49 are sequentially executed.

Here, the additional program in step S42 is obtained by replacing the image processing subroutine candidate selected in the automatic execution of the inspection area with a source program, and is stored in the image processing storage unit 431 shown in FIG. The image processing subroutine is linked with the stored image processing subroutine candidate, and is incorporated into the image processing program by the image processing subroutine insertion position selection unit 442. The display data of step S43 is
It consists of icons, display positions, and connection information between the icons.
The image processing program is read out from the image processing program storage unit 45 shown in FIG. 21A, is recalculated in consideration of the appearance at the time of insertion into the flowchart, is inserted into the selected image processing subroutine icon, and is restored. The output image in step S45 is read from the automatic execution data storage unit 441.
When the image of the execution result is automatically executed, the output image stored in the automatic execution data storage unit 441 is synthesized with the icon,
It is displayed as one icon. The image processing program execution unit 46 analyzes the information and writes it in the image / setting display memory 48, so that the information is displayed on the input / output display device 1 as shown in FIG. Note that the icon information is stored in the image processing storage unit 431.

That is, a flowchart of the image processing program created by incorporating the image processing subroutine candidates is displayed on the screen of the input / output display device 1 as shown in FIG. At the position associated with the symbol of the image processing subroutine, an image on which the image processing has been performed on the target image by the image processing subroutine is displayed. Since the image and the icon of the corresponding image processing subroutine are one icon, is there.

As described above, according to the tenth embodiment, it is possible to easily grasp where each image processing subroutine candidate is incorporated in the image processing program, and to perform each image processing subroutine on the image in each designated area of the target image. The execution result of the subroutine candidate can be easily verified. Also, if the programmer modifies the image processing program,
Since the image processing subroutine is not hidden in the image processing program, and it can be easily grasped where the image processing subroutine is incorporated in the image processing program, the correction becomes easy.

FIG. 22 is an operation flow diagram according to another image processing program creation function provided in the image processing program creation system, and FIGS. 23 to 25 are explanatory diagrams of the operation flow of FIG. 22. An eleventh embodiment of the present invention will be described.

When the flowchart of the image processing program is displayed on the screen of the input / output display device 1, the image processing program creation system according to the eleventh embodiment displays symbols (icons) of the image processing subroutine in the flowchart.
The configuration is the same as that of the tenth embodiment except that the image processing program creation function further performs a process of sequentially switching and displaying the images in each image processing process by the corresponding image processing subroutine according to the operation input through the operation input device 3 for Is done.

In FIG. 22, if the operation input device 3 is operated to double-click the icon of the image processing subroutine shown in FIG.
"Execution of image processing subroutine", "Storing of processed image / result" in step S53, "Reading of display data" in step S54, "Reading of icon of image processing subroutine" in step S55, and "Wait for redisplay input" in step S56. ", And the process of" Is there an undisplayed processed image / result? "In step S57. Step S57
If the determination result indicating that there is an undisplayed processed image / result is obtained (YES in S57), the process proceeds to step S58; otherwise (NO in S57), the process ends.

At step S58, "output image / result reading" processing is executed, and thereafter, step S5 is executed.
9, “Synthesis of display icon and output image / result”, “Creation of display position information of display icon” in step S60,
The process of “creating icon connection information” of step S61 and the process of “writing display data” of step S62 are sequentially performed, and thereafter, the process returns to step S56.

If the above flow is supplemented, step S54
Are read out from the image processing program storage unit 45 shown in FIG. Steps S56 to S6
2, when sequentially displaying images, for example, the input / output display device 1
When the icon displayed on the screen is clicked, the operation for displaying the next processed image / result is started. There may be a case where the processed image is displayed and there is no waiting for redisplay input. In this case, if there are a plurality of processed images, a moving image is displayed. The number of processed images / results varies depending on the type of image processing subroutine. In accordance with an operation on a component (icon) of the flowchart displayed on the screen of the input / output display device 1, a detailed image and a processed image / result of the image processing are displayed in order to enable confirmation of the progress. In the flow of FIG. 22, an image is displayed as shown in FIG. 23 (b). However, as shown in a subroutine of "apply inspection" in FIG. It may be displayed.

Here, in each embodiment of the present invention, the image processing subroutine incorporated in the image processing program is as follows:
Indirectly, a large selection corresponding to at least one of the plurality of types of image processing target items and the plurality of types of inspection target items corresponds to the conventional "plurality" of image processing subroutines. However, there may be times when it is desired to confirm the image in each image processing step by the “large” image processing subroutine in this case.

Therefore, as shown in the example of FIG.
24 (f) and 25 (b) by default in the subroutine "Crack inspection" on the screen of the input / output display device 1.
, A final processing result image of the image processing subroutine is displayed. In this state, FIG.
Each time the icon of the “crack inspection” subroutine shown in the example of (a) is clicked, an image of each image processing process by the “crack inspection” image processing subroutine is displayed as shown in FIG.
The target image (original image) as shown in FIG.
(C), a differential value image as shown in FIG.
(D), differential direction value images as shown in FIG. 25 (d), thinned images as shown in FIGS. 24 (e) and 25 (e), and FIGS. 24 (f) and 25 (b). The image is periodically switched to the image of the image processing result as shown. Note that FIG.
FIG. 5F shows an example in which an image whose edge is extended is displayed.

As described above, according to the eleventh embodiment, it is possible to confirm whether each image processing step by the image processing subroutine and the image processing result are appropriate.

FIGS. 26 and 27 are operation flow charts of another image processing program creation function provided in the image processing program creation system. The twelfth embodiment of the present invention will be described with reference to these figures.

When displaying the flowchart of the image processing program on the screen of the input / output display device 1, the image processing program creation system of the twelfth embodiment first displays the flowchart of the image processing program on the screen of the input / output display device 1. Then, with respect to the flowchart displayed on the screen of the input / output display device 1, the selected image processing subroutine candidate is incorporated as an image processing subroutine at a position designated by an operation input through the operation input device 3,
Except that the image processing program creation function further performs a process of displaying a flowchart of the image processing program created by incorporating the program on the screen of the input / output display device 1,
The configuration is the same as that of the first embodiment.

In FIG. 26, after passing from the area designation section to the image processing subroutine selection designation section, step S71 is performed.
"Reading entire program (image processing program)", "designation of insertion position by input device" in step S72, "insertion of program into designated position" in step S73, "storing of entire program" in step S74, and step S75. "Read display data", step S7
No. 6, "read icon of image processing subroutine", step S77 "create display position information of display icon", step S78 "create icon connection information", and step S79 "write display data" are sequentially executed. You. Note that the display data in step S75 is read from the image processing program storage unit 45 in FIG.

In other words, when the space between “test 1” and “test 2” shown in S70 of FIG. 26 is designated, FIG.
As shown in (2), the selected image processing subroutine candidate is incorporated as an image processing subroutine at the designated position. In the figure, an image processing subroutine for foreign substance inspection and fray inspection is incorporated between “inspection 1” and “inspection 2”. Then, a flowchart of the image processing program created by incorporating these image processing subroutines is displayed on the screen of the input / output display device 1.

As described above, according to the twelfth embodiment, the image processing subroutine can be incorporated at a desired position of the image processing program, and a new image processing subroutine can be added at a desired position of the previously created image processing program. Since it can be easily incorporated, the time required to create another image processing program can be significantly reduced by using the previously created image processing program as a base.

FIG. 28 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system. The thirteenth embodiment of the present invention will be described with reference to FIG.

When the target image is displayed on the screen of the input / output display device 1, the image processing program creation system of the thirteenth embodiment first sets the flowchart of the image processing program of the image processing device 4 to the symbol for the image processing subroutine. Is displayed on the screen of the input / output display device 1 along with
When the target image is displayed on the screen of the input / output display device 1 in accordance with the selection of the symbol on the flowchart by the operation input through the operation input device, and the image processing subroutine is incorporated in the image processing program, the selected image processing is performed. The configuration is the same as that of the first embodiment, except that the image processing program creation function further performs a process of incorporating a subroutine candidate into a position corresponding to the selected symbol in the image processing program as an image processing subroutine.

In FIG. 28A, the image processing storage unit 4
31 stores default icons for default processing. Then, in the first embodiment, step S
Before step 1, a screen for allowing the user to specify a position in the image processing program to insert an image processing subroutine candidate to be selected as an image processing subroutine,
The process of switching the screen of the input / output display device 1 is executed. At this time, a flowchart of the image processing program including the default icon is displayed on the screen of the input / output display device 1, as shown in FIG. It is. Thereafter, as in the first embodiment, when an image processing subroutine candidate is selected, as shown in FIG. 28C, the selected image processing subroutine candidate is incorporated as an image processing subroutine from the position of the default icon. It is.

As described above, according to the thirteenth embodiment, the entire image processing program can be constructed before the image processing program is created, and the user can select the image processing subroutine candidate to be selected anywhere in the image processing program. Is incorporated as an image processing subroutine. Even after the image processing program is created, the image processing subroutine can be changed by performing the same steps again. For example, by changing the image processing target,
It is not necessary to change the entire image processing program, but it is possible to cope with a case where a certain image processing subroutine needs to be changed.

FIG. 29 is an operation flow diagram according to another image processing program generation function provided in the image processing program generation system, and FIG. 30 is an explanatory diagram of the operation flow of FIG. 29. A fourteenth embodiment will be described.

The image processing program creating system according to the fourteenth embodiment, after incorporating the image processing subroutine into the image processing program, displays the designated area together with the target image on the screen of the input / output display device 1. In response to an operation input through the operation input device 3, the specified area displayed on the screen is copied and pasted into another specified area.
As an image processing subroutine for an image in another designated area, the image processing subroutine is configured in the same manner as in the first embodiment except that the image processing program creation function further performs processing for allocating the selected image processing subroutine candidate and correcting the image processing program. You.

In FIG. 29, "area selection" in step S81, "copy area" in step S82, "creation of image processing program for copy destination area" in step S83, "read entire program" in step S84, "Addition of image processing subroutine for copied area" in S85, "Storing entire program" in step S86, "Reading display data" in step S87, "Creating display position information of display icon" in step S88, step S89 "Create icon connection information" and "Write display data" in step S90
Are sequentially executed.

In steps S81 and S82, the area of the image is operated to copy the area. For example, as shown in FIG. 30A, the region R2 is selected and copied by the operation input device 3, and the region R3 is pasted to another place. In step S83, data of the image processing program automatically generated in the copy source area is copied, except that the area information is changed by the operation input device 3, and a program is generated (see FIG. 30B).

Here, in the case of a symmetrical image, when a defect is found at one location, there is a high possibility that a defect will occur at a location similar to the others. When the program is adjusted in the inspection area of the copy source, it is highly likely that the same inspection needs to be performed in the inspection area of the copy destination. The storage content is an area number (I indicating which area each image processing is targeted for).
D), area type (rectangular, circular, polygonal, etc.) and area shape (vertex coordinates, center coordinates / radius, etc.), which are changed at the stage of copying by operation of the operation input device.

That is, as shown in FIG. 30A, by copying and pasting the region R2 to the region R3, as shown in FIG.
The processing of "foreign substance inspection of area R2" and the processing of "overlapping inspection of area R2" are copied, and the processing of "foreign substance inspection of area R3" and "overlapping inspection of area R3" for area R3 are added below. FIG. 30A shows an image of the wiring pattern.

As described above, according to the fourteenth embodiment, only the image processing subroutine to be applied is determined by focusing on the defect in the specific portion to be inspected, and the same applies to another portion where the defect is likely to occur. The image processing subroutine can be easily applied, whereby the time required to create the image processing program can be greatly reduced. When the designated area to be actually inspected is a polygon or the like and it is difficult to represent the area with a typical area shape such as a rectangle, the image processing subroutine is determined in advance in another area having a typical area shape such as a rectangle. In advance, by copying the set contents of the determined image processing subroutine to a designated area having a desired shape, the image processing subroutine of the designated area can be set.

[0143]

As is apparent from the above description, the method for creating an image processing program according to the first aspect of the present invention comprises a display means for displaying an image, an input means for inputting various operations, and a plurality of pre-classified input means. Storage means for storing an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates for at least one set of types of image processing target items and a plurality of types of inspection target items,
An image processing program creation function for creating an image processing program of the image processing apparatus, wherein a step of displaying a target image obtained by imaging of the image processing target on the display unit; and A step of selecting a corresponding image processing subroutine candidate set from the storage unit from at least one set of a plurality of types of inspection target items in accordance with an item selected by an operation input through the input unit; Each of a plurality of types of image processing subroutine candidates included in the image processing subroutine candidate set is executed for all or a part of the target image in a specified area specified by an operation input through the input unit. And selecting the selected image processing subroutine candidates based on respective execution results of the plurality of selected image processing subroutine candidates. Incorporating the image processing subroutine candidate selected from the processing subroutine candidate set into the image processing program of the image processing apparatus as an image processing subroutine for an image in the designated area, so that the user has no knowledge of image processing. Also, the image processing program of the image processing apparatus can be easily created, and knowledge of image processing is not required, so that the learning time can be reduced. Further, since the user sets the designated area, there is no need to create an image processing program for inspecting a wrong portion of the image processing target. Further, since an item is selected from at least one set of a plurality of types of image processing target items and a plurality of types of inspection items, an image processing program suitable for the image processing target and the inspection purpose can be created, and unnecessary Since the items are eliminated, the execution time by the image processing program can be reduced.

According to the second aspect of the present invention, in the image processing program creating method according to the first aspect, each of the plurality of selected image processing subroutine candidates is executed on an image in the designated area. After that, the method further comprises the step of displaying each execution result of these image processing subroutine candidates on the display means. In the step of incorporating the image processing subroutine into the image processing program, each execution result displayed on the display means is displayed. Based on the selected image processing subroutine candidate set, the image processing subroutine candidate selected by the operation input through the input unit is incorporated into the image processing program as an image processing subroutine for an image in the designated area.
An image processing program for an image processing apparatus can be created without a user having knowledge of image processing. In addition, the problem that the number of the selected plural types of image processing subroutine candidates becomes unnecessarily large does not occur, and the operation of selecting the image processing subroutine candidates based on each execution result becomes easy.
Furthermore, it is possible to create an image processing program that meets the user's inspection purpose by using an image processing subroutine that has a satisfactory execution result without answering the troublesome interactive questions and therefore without providing the function. Therefore, it is not necessary to modify the image processing program.

According to a third aspect of the present invention, in the image processing program creating method according to the first aspect, each of the plurality of selected image processing subroutine candidates is executed on an image in the designated area. After that, from the execution results of these image processing subroutine candidates, the method further comprises a step of calculating a degree of deviation indicating a degree of deviation from a predetermined reference. In the step of incorporating the image processing subroutine into the image processing program, An image processing subroutine candidate is automatically selected from the selected image processing subroutine candidate set based on the plurality of divergence degrees thus determined, and is incorporated in the image processing program as an image processing subroutine for an image in the designated area. Therefore, even if the user does not have knowledge of image processing, the image processing It is possible to create the ram more easily. Further, for example, when a defect is detected by each of the different image processing subroutine candidates (image processing algorithms) included in the image processing subroutine candidate set,
From these, it is possible to automatically detect an optimal image processing subroutine candidate for defect detection. In this case, it is possible to prevent a non-optimal image processing subroutine candidate from being selected due to a user's misjudgment.

According to a fourth aspect of the present invention, in the image processing program creating method according to the third aspect, a plurality of the target images are obtained from a plurality of non-defective and defective image processing targets, respectively. In the step of displaying on the display unit, at least one of the plurality of target images is displayed on the display unit, and in the step of executing each of the plurality of selected image processing subroutine candidates, the image processing subroutine candidate is selected. Is performed on an image in each designated region of the plurality of target images, and in the step of calculating the degree of divergence, the execution results of the plurality of types of image processing subroutine candidates for the respective target images are respectively determined. Statistically calculates the degree of deviation from the image processing subroutine candidate, and executes the image processing subroutine in the image processing program. In the step of incorporating the image processing subroutine, the image processing subroutine candidate is automatically selected from the selected image processing subroutine candidate set based on each of the statistically calculated divergence degrees. Since the image processing program is incorporated in the image processing program as an image processing subroutine, the image processing program of the image processing apparatus can be more easily created without the user having knowledge of image processing. In addition, an image processing subroutine candidate having the optimum inspection accuracy can be automatically selected statistically as an image processing subroutine.

According to the invention set forth in claim 5, claims 1 to 5 are provided.
5. In the image processing program creating method according to any one of the aspects 4, the image processing subroutine candidate set includes a plurality of image processing subroutine candidates of the same flow to which different parameter values are assigned. A simple image processing program can be created.

According to the invention described in claim 6, claims 1 to 1 are provided.
4. The image processing program creating method according to any one of 4, wherein at least one of an image processing target item and an inspection target item operated and input through the input unit;
According to a plurality of types of image processing subroutine candidates selected by an operation input through the input unit from all types of image processing subroutine candidates stored in the storage unit,
Since these image processing subroutine candidates are stored in the storage means in association with the items input by the operation, it is possible to create an image processing program more suitable for the site.

According to the invention described in claim 7, claims 1 to
5. In the image processing program creating method according to any one of the above, when the plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set have a common processing portion, the plurality of types of image processing subroutines Since the candidate also serves as the common processing portion, the execution time for creating the image processing program can be significantly reduced.

According to the invention of claim 8, claims 1 to
5. The method according to claim 4, wherein the step of executing each of the plurality of selected image processing subroutine candidates on the image in the designated area includes the plurality of image processing subroutines. Among the parameters included in each of the candidates, the plurality of types of the selected image processing subroutine candidates are selected in accordance with a parameter selected by an operation input through the input unit and a variable condition specified for the parameter. Executing each of the selected parameters included therein, while changing the selected parameters under the specified variable condition, on the image in the specified area, and incorporating the image processing subroutine into the image processing program; The value of the selected parameter in the image processing subroutine is obtained from each of the execution results. If the pass / fail judgment is constant in a specific range, the value of a desired parameter in the image processing subroutine incorporated in the image processing program is set to the center value of the appropriate range. , Set to the most representative parameters.

According to the ninth aspect of the present invention, in the image processing program creating method according to the second aspect, the step of displaying each execution result of the selected plurality of types of image processing subroutine candidates on the display means, Along with each of these execution results, the target image or an image that has been subjected to image processing on the target image by the image processing subroutine candidate that has issued each execution result is displayed on the display unit.
When the visibility of each execution result is enhanced, and, for example, it is difficult to select an image processing subroutine candidate only with each execution result, an appropriate image processing subroutine candidate is selected as an image processing subroutine candidate with reference to the image that has been subjected to image processing. It is possible to do.

According to the tenth aspect, the first aspect is provided.
In the image processing program creating method according to any one of claims 1 to 4, when the image processing program created by incorporating the image processing subroutine has a common processing part, these processing parts are regarded as one processing part. Since the method further includes an integration step, the capacity of the image processing program can be reduced, and the speed of the execution can be increased. In addition, the image processing program is shortened, and it is easy to grasp the whole.

According to the eleventh aspect, according to the first aspect,
5. The image processing program creating method according to any one of the items 1 to 4, further comprising the step of displaying on the display means a flowchart of the image processing program created by incorporating the image processing subroutine. It can be easily grasped where the image processing program is incorporated. For example, if a flowchart of the image processing program is displayed on the display unit every time the image processing subroutine is incorporated into the image processing program, even if the user is not accustomed to character programming, it is possible to confirm that the number of symbols in the flowchart increases. Thus, it is possible to intuitively grasp where the image processing subroutine is incorporated in the image processing program.

According to the twelfth aspect, according to the first aspect,
In the image processing program creating method according to the first aspect, in the step of displaying the flowchart of the image processing program on the display unit, at a position associated with the symbol of the image processing subroutine in the flowchart,
Since the image that has been subjected to the image processing on the target image by the image processing subroutine is displayed, it is possible to easily verify the execution result of each image processing subroutine on the image in each designated area of the target image.

According to the thirteenth aspect, the first aspect is provided.
In the image processing program creating method according to the first aspect, the step of displaying the flowchart of the image processing program on the display means corresponds to an operation input to the symbol of the image processing subroutine in the flowchart through the input means. Since the images in each image processing process by the image processing subroutine are sequentially switched and displayed,
It is possible to confirm whether each image processing step and the image processing result by the image processing subroutine are appropriate.

According to the fourteenth aspect, the first aspect is provided.
In the image processing program creating method according to the first aspect, in the step of displaying the flowchart of the image processing program on the display unit, first, the flowchart of the image processing program is displayed on the display unit, and then the flowchart displayed on the display unit On the other hand, the selected image processing subroutine candidate is incorporated as an image processing subroutine at a position designated by an operation input through the input means, and a flowchart of an image processing program created by incorporating the selected image processing subroutine is displayed on the display means. , The image processing subroutine can be incorporated at a desired position in the image processing program, and the time (man-hours) for creating another image processing program is based on the previously created image processing program. This can greatly reduce the cost.

According to the fifteenth aspect, the first aspect is provided.
In the image processing program creating method according to any one of Items 1 to 4, in the step of displaying the target image on the display unit, first, a flowchart of an image processing program of the image processing apparatus is displayed together with a symbol for an image processing subroutine. Displaying the target image on the display unit in response to the selection of the symbol on the flowchart by the operation input through the input unit, and displaying the image processing subroutine on the image processing program. In the incorporating step, the selected image processing subroutine candidate is incorporated as an image processing subroutine at a position corresponding to the selected symbol in the image processing program. You can keep. The user can understand where in the image processing program the image processing subroutine candidate to be selected is incorporated as the image processing subroutine. Even after the image processing program is created, the image processing subroutine can be changed by performing the same steps again. For example, it is not necessary to change the entire image processing program by changing the image processing target, but it is possible to cope with a case where a certain image processing subroutine needs to be changed.

According to the sixteenth aspect of the present invention, the first aspect is provided.
In the image processing program creating method according to any one of the above (1) to (4), after incorporating the image processing subroutine into the image processing program, displaying the designated area together with the target image on the display means; In response to an operation input through the input means for copying and pasting the displayed designated area to another designated area,
Correcting the image processing program by allocating the selected image processing subroutine candidate as an image processing subroutine for an image in the another designated area, thereby focusing on a defect in a specific portion to be inspected. By simply determining the image processing subroutine to be applied, the same image processing subroutine can be easily applied to another portion where the defect is likely to occur. As a result, the time for creating the image processing program can be significantly reduced.

According to a seventeenth aspect of the present invention, there is provided a display means for displaying an image, an input means for inputting various operations, and at least one of a plurality of types of image processing target items and a plurality of types of inspection target items which are classified in advance. A storage means for storing an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates for each set item, and an image processing program creating function for creating an image processing program of the image processing apparatus. An image processing program creation function, wherein the image processing program creation function displays a target image obtained by imaging the image processing target on the display unit, and displays the plurality of types of image processing target items and a plurality of types of inspection purposes. From at least one set of items, according to the item selected by the operation input through the input means,
A corresponding image processing subroutine candidate set is selected from the storage means, and each of a plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set is designated by an operation input through the input means. Executes on all or a part of the target image in the area, and selects from the selected image processing subroutine candidate set based on each execution result of the selected plural types of image processing subroutine candidates The image processing subroutine candidate is used as an image processing subroutine for an image in the designated area, and is executed in the image processing program of the image processing apparatus. Image processing programs can be easily created, and no knowledge of image processing is required Because, it is possible to reduce the acquisition time. Further, since the user sets the designated area, there is no need to create an image processing program for inspecting a wrong portion of the image processing target. Furthermore, since an item is selected from at least one set of a plurality of types of image processing target items and a plurality of types of inspection items, it is possible to create an image processing program suitable for image processing targets and inspection purposes,
Since unnecessary items are eliminated, the execution time by the image processing program can be reduced.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an image processing program creation system.

FIG. 2 is an explanatory diagram of an image processing algorithm storage unit in FIG. 1;

FIG. 3 is an operation flowchart of an image processing program creation function provided in the image processing program creation system of FIG. 1;

FIG. 4 is an explanatory diagram of the operation flow of FIG. 3;

FIG. 5 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

6 is an explanatory diagram of the operation flow of FIG.

FIG. 7 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 8 is an explanatory diagram of the operation flow of FIG. 7;

FIG. 9 is an explanatory diagram of the operation flow of FIG. 7;

FIG. 10 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system.

FIG. 11 is an explanatory diagram of selecting an image processing subroutine candidate, correcting its parameters, and registering a new image processing subroutine candidate.

FIG. 12 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system.

FIG. 13 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system.

FIG. 14 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 15 is an explanatory diagram of the operation flow in FIG. 14;

FIG. 16 is an explanatory diagram of the operation flow in FIG. 14;

FIG. 17 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

18 is an explanatory diagram of the operation flow in FIG.

FIG. 19 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system.

FIG. 20 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 21 is an explanatory diagram of the operation flow in FIG. 20;

FIG. 22 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 23 is an explanatory diagram of the operation flow in FIG. 22;

24 is an explanatory diagram of the operation flow of FIG. 22, which is a photograph replacing a drawing obtained by printing out an intermediate image displayed on a display device (input / output display device) by a printer.

FIG. 25 is an explanatory diagram of the operation flow of FIG. 22, which is a photograph replacing a drawing obtained by printing out an intermediate image displayed on a display device (input / output display device) by a printer.

FIG. 26 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 27 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 28 is an explanatory diagram of another image processing program creation function provided in the image processing program creation system.

FIG. 29 is an operation flowchart of another image processing program creation function provided in the image processing program creation system.

FIG. 30 is an explanatory diagram of the operation flow in FIG. 29;

[Explanation of symbols]

 Reference Signs List 1 input / output display device 2 imaging device 3 operation input device 4 image processing device 4

 ────────────────────────────────────────────────── ─── Continuing from the front page (72) Inventor Mitsuru Shirasawa 1048 Kazuma Kadoma, Osaka Prefecture F-term in Matsushita Electric Works Co., Ltd. EA07 FA02 FA12 5B057 AA03 BA02 BA26 CA02 CA08 CA12 CA16 CB02 CB08 CB12 CB16 CC01 CE12 DA03 DB02 DB05 DB09 DC03 DC04 DC08 5B076 DC02 DD06 5E501 BA05 CA03 CA04 CB02 CB09 DA05 DA12 DA13 EB05 FA05

Claims (17)

[Claims] A display unit for displaying an image, an input unit for inputting various operations, and at least one set of a plurality of types of image processing target items and a plurality of types of inspection target items classified in advance, A storage means for storing an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates, wherein the image processing program creating function creates an image processing program of the image processing apparatus. Displaying a target image obtained by imaging on the display unit; and an item selected by an operation input through the input unit from at least one set of the plurality of types of image processing target items and the plurality of types of inspection target items Selecting a corresponding image processing subroutine candidate set from the storage means in accordance with Executing each of a plurality of types of image processing subroutine candidates included in the routine candidate set on all or a part of the target image in a designated area designated by an operation input through the input unit. An image processing subroutine candidate selected from the selected image processing subroutine candidate set is used as an image processing subroutine for an image in the designated area, based on each execution result of the selected plurality of types of image processing subroutine candidates. Incorporating the image processing program into the image processing program of the image processing apparatus. 2. A step of executing each of the plurality of selected image processing subroutine candidates on an image in the designated area, and displaying each execution result of the image processing subroutine candidates on the display unit. In the step of incorporating the image processing subroutine into the image processing program, based on each execution result displayed on the display means, an operation through the input means from the selected image processing subroutine candidate set 2. The image processing program creating method according to claim 1, wherein the image processing subroutine candidate selected by the input is incorporated in the image processing program as an image processing subroutine for an image in the designated area. 3. After executing each of the plurality of selected image processing subroutine candidates on the image in the designated area, each of the plurality of types of image processing subroutine candidates deviates from a predetermined reference from execution results of the image processing subroutine candidates. Calculating a divergence indicating a degree; and incorporating the image processing subroutine into the image processing program, based on the calculated plurality of divergence, from the selected image processing subroutine candidate set. 2. The method according to claim 1, wherein an image processing subroutine candidate is automatically selected and incorporated into the image processing program as an image processing subroutine for an image in the designated area. 4. The method according to claim 1, wherein a plurality of the target images are obtained from a plurality of non-defective and defective image processing targets, and the displaying the target images on the display means includes:
In the step of displaying at least one of the plurality of target images on the display means and executing each of the selected plurality of types of image processing subroutine candidates, each of the plurality of image processing subroutine candidates is referred to as the plurality of target image subroutines. The step of calculating the degree of divergence is performed on the image in each of the designated areas, and the degree of divergence for each image processing subroutine candidate is determined from the execution results of the plurality of types of image processing subroutine candidates for each of the target images. In the step of statistically calculating and incorporating the image processing subroutine into the image processing program, the image processing subroutine is automatically selected from the selected image processing subroutine candidate set based on each of the statistically calculated divergence degrees. Select a suggestion,
4. The image processing program creating method according to claim 3, wherein this is incorporated in the image processing program as an image processing subroutine for an image in the designated area. 5. The image processing subroutine candidate set according to claim 1, wherein the image processing subroutine candidate set includes a plurality of image processing subroutine candidates of the same flow to which different parameter values are assigned. The method for creating an image processing program according to the item 1. 6. An operation through the input unit from at least one of an image processing target item and an inspection target item operated and input through the input unit and all kinds of image processing subroutine candidates stored in the storage unit. The image processing subroutine candidate is stored in the storage means in accordance with the plurality of types of image processing subroutine candidates selected by the input, in association with the operation-input item. An image processing program creation method according to any one of the above. 7. When a plurality of types of image processing subroutine candidates included in the selected image processing subroutine candidate set include a common processing portion, the plurality of types of image processing subroutine candidates determine the common processing portion. 5. The image processing program creating method according to claim 1, wherein the image processing program is shared. 8. The step of executing each of the plurality of selected image processing subroutine candidates for an image in the designated area includes the step of executing the selected one of the parameters included in each of the plurality of image processing subroutine candidates. According to a parameter selected by an operation input through the input means and a variable condition specified for the parameter, each of the plurality of types of selected image processing subroutine candidates is included in the selected Executing the parameters on the image in the designated area while varying the parameters under the designated variable condition. In the step of incorporating the image processing subroutine into the image processing program, the selected Parameter value set to the center value of the appropriate range of the parameter obtained from each execution result The image processing program creation method according to any one of claims 1 to 4, characterized in Rukoto. 9. A step of displaying each execution result of the plurality of selected image processing subroutine candidates on the display means, the image processing subroutine outputting the target image or each execution result together with each execution result. 3. The image processing program creating method according to claim 2, wherein an image that has been subjected to image processing on the target image by a candidate is displayed on the display unit. 10. If the image processing program created by incorporating the image processing subroutine has a common processing portion, the image processing program further includes a step of integrating these processing portions as one processing portion. An image processing program creating method according to claim 1. 11. The image according to claim 1, further comprising a step of displaying on the display means a flowchart of the image processing program created by incorporating the image processing subroutine. Processing program creation method. 12. A step of displaying the flowchart of the image processing program on the display means, at a position associated with the symbol of the image processing subroutine in the flowchart, after the image processing on the target image by the image processing subroutine is completed. The method according to claim 11, wherein the image is displayed. 13. The step of displaying the flow chart of the image processing program on the display means, in response to an operation input to the symbol of the image processing subroutine in the flow chart through the input means, the corresponding image processing subroutine 12. The method according to claim 11, wherein the images in the image processing process are sequentially switched and displayed. 14. In the step of displaying the flowchart of the image processing program on the display means, first, the flowchart of the image processing program is displayed on the display means. Incorporating the selected image processing subroutine candidate as an image processing subroutine at a position designated by an operation input through the input means, and displaying a flowchart of an image processing program created by incorporating the selected image processing subroutine on the display means. The method for creating an image processing program according to claim 11, wherein: 15. In the step of displaying the target image on the display means, first, a flowchart of an image processing program of the image processing apparatus is displayed on the display means together with a symbol for an image processing subroutine. Displaying the target image on the display unit in accordance with the selection of the symbol on the flowchart by an operation input through an input unit; and incorporating the image processing subroutine into the image processing program. 5. The method according to claim 1, wherein a subroutine candidate is incorporated as an image processing subroutine in a position corresponding to the selected symbol in the image processing program. 16. After the image processing subroutine is incorporated in the image processing program, displaying the designated area together with the target image on the display means, and replacing the designated area displayed on the display means with another designated area. Modifying the image processing program by assigning the selected image processing subroutine candidate as an image processing subroutine for an image in the another designated area in response to an operation input through the input means for copying and pasting the image processing program. 2. The method according to claim 1, further comprising:
5. The method according to any one of claims 1 to 4, wherein 17. A display unit for displaying an image, an input unit for inputting various operations, and an item of at least one of a plurality of types of image processing target items and a plurality of types of inspection target items which are classified in advance. An image processing program creating system configured to have an image processing program creating function of creating an image processing program of an image processing apparatus using a storage unit that stores an image processing subroutine candidate set including a plurality of types of image processing subroutine candidates The image processing program creation function displays a target image obtained by imaging the image processing target on the display unit, and sets at least one of the plurality of types of image processing target items and the plurality of types of inspection target items. From the corresponding image processing subroutine candidate set according to the item selected by the operation input through the input means. Each of a plurality of types of image processing subroutine candidates selected from the storage unit and included in the selected image processing subroutine candidate set is stored in a designated area designated by an operation input through the input unit. The image processing subroutine candidate selected from the selected image processing subroutine candidate set is executed based on each execution result of the plurality of selected image processing subroutine candidates executed on all or a part of the images.
An image processing program creation system, which executes each processing incorporated in an image processing program of the image processing apparatus as an image processing subroutine for an image in the designated area.