WO2020012939A1 - Image processing device, image processing method and image processing program - Google Patents

Image processing device, image processing method and image processing program Download PDF

Info

Publication number
WO2020012939A1
WO2020012939A1 PCT/JP2019/024996 JP2019024996W WO2020012939A1 WO 2020012939 A1 WO2020012939 A1 WO 2020012939A1 JP 2019024996 W JP2019024996 W JP 2019024996W WO 2020012939 A1 WO2020012939 A1 WO 2020012939A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
defect
peripheral
defective
pointer
Prior art date
Application number
PCT/JP2019/024996
Other languages
French (fr)
Japanese (ja)
Inventor
藤枝 紫朗
Original Assignee
オムロン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オムロン株式会社 filed Critical オムロン株式会社
Publication of WO2020012939A1 publication Critical patent/WO2020012939A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination

Definitions

  • the present invention relates to an image processing device, an image processing method, and an image processing program.
  • a photographing unit for photographing the edge of a substrate a defect detecting unit for detecting a defect based on an image of the edge of the substrate acquired by the photographing unit, and determining the degree of the defect detected by the defect detecting unit
  • a defect state determination unit a defect registration unit that registers the position of the defect detected by the defect detection unit 7 and the degree of the defect determined by the defect state determination unit in association with each other.
  • a defect monitoring system that determines the degree of a defect registered in a defect registration unit over time (see Patent Document 1).
  • the defect state determination unit determines the degree of the registered defect over time, thereby making it possible to monitor a change in the degree of the defect. Even if there is, if it is growing in the subsequent judgment, it can be repaired before it becomes unrecoverable.
  • the present invention provides an image processing apparatus, an image processing method, and an image processing program that can easily generate a good-quality image from a defective product image obtained by photographing a defective product including a defect.
  • An image processing apparatus includes a specification unit that specifies a defect image corresponding to a defect in a defective product image obtained by capturing a defective product including a defect, and a peripheral unit that determines a peripheral image from an image existing around the specified defect image.
  • the image processing apparatus includes a determining unit that determines an image, and a combining unit that combines the determined peripheral image with the designated defect image.
  • the determined peripheral image is combined with the designated defect image.
  • the determined peripheral image is combined with the designated defect image.
  • the specifying unit may specify the defective image by using the pointer displayed on the defective product image, and the determining unit may determine the peripheral image based on the moving direction of the pointer.
  • the peripheral image is determined based on the moving direction of the pointer.
  • the peripheral image based on the moving direction of the pointer is automatically determined without selecting from the images existing around the defective image. Therefore, a good image can be easily generated from the defective image.
  • the determining unit may determine the peripheral image based on the moving direction of the pointer and from the image on the center side of the defective image.
  • the peripheral image is determined from the image on the center side of the defective image based on the moving direction of the pointer.
  • the possibility that a defect exists at the center of a defective product image is smaller. Therefore, the defective image can be easily repaired by determining the peripheral image from the image on the center side of the defective image based on the moving direction of the pointer.
  • the determining unit may determine the peripheral image by the peripheral pointer displayed at a position in a predetermined direction with respect to the pointer in the defective product image.
  • the peripheral image is determined by the peripheral pointer displayed at a position in a predetermined direction with respect to the pointer. This makes it possible to select an image in a region where no defect exists around the defect image. Therefore, a good image can be more easily generated from a defective image.
  • a setting unit for setting the size of the peripheral pointer may be further provided.
  • the size of the peripheral pointer is set. This makes it possible to determine a peripheral image having a desired size.
  • an image processing method includes a specifying step of specifying a defect image corresponding to a defect in a defective product image obtained by photographing a defective product including a defect, wherein the specifying step exists around the specified defect image.
  • the determined peripheral image is combined with the designated defect image.
  • the determined peripheral image is combined with the designated defect image.
  • the specifying step may include specifying a defective image with a pointer displayed on the defective product image
  • the determining step may include determining a peripheral image based on a moving direction of the pointer
  • the peripheral image is determined based on the moving direction of the pointer.
  • the peripheral image based on the moving direction of the pointer is automatically determined without selecting from the images existing around the defective image. Therefore, a good image can be easily generated from the defective image.
  • the determining step may include determining a peripheral image from an image on the center side of the defective image based on the moving direction of the pointer.
  • the peripheral image is determined from the image on the center side of the defective image based on the moving direction of the pointer.
  • the possibility that a defect exists at the center of a defective product image is smaller. Therefore, the defective image can be easily repaired by determining the peripheral image from the image on the center side of the defective image based on the moving direction of the pointer.
  • the determining step may include determining the peripheral image using a peripheral pointer displayed at a position in a predetermined direction with respect to the pointer in the defective product image.
  • the peripheral image is determined by the peripheral pointer displayed at a position in a predetermined direction with respect to the pointer. This makes it possible to select an image in a region where no defect exists around the defect image. Therefore, a good image can be more easily generated from a defective image.
  • a setting step of setting the size of the peripheral pointer may be further included.
  • the size of the peripheral pointer is set. This makes it possible to determine a peripheral image having a desired size.
  • An image processing program is an image processing program to be executed by a computer, comprising: a designation step of designating a defect image corresponding to a defect in a defective product image obtained by photographing a defective product including a defect. A determining step of determining a peripheral image from an image existing around the designated defect image; and a combining step of combining the determined peripheral image with the designated defect image.
  • the determined peripheral image is combined with the designated defect image.
  • the determined peripheral image is combined with the designated defect image.
  • an image processing apparatus an image processing method, and an image processing program that can easily generate a good-quality image from a defective-quality image.
  • FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to an embodiment.
  • FIG. 2 is a diagram illustrating a setting screen of the image processing apparatus illustrated in FIG.
  • FIG. 3 is a diagram illustrating an example of combining images in the image processing apparatus illustrated in FIG. 1.
  • FIG. 4 is a flowchart illustrating a first example of a schematic operation of the image processing apparatus illustrated in FIG.
  • FIG. 5 is a diagram illustrating a defective product image of the image processing apparatus shown in FIG.
  • FIG. 6 is a diagram illustrating a non-defective image of the image processing apparatus illustrated in FIG.
  • FIG. 7 is a flowchart illustrating a second example of the schematic operation of the image processing apparatus illustrated in FIG.
  • FIG. 8 is a diagram illustrating peripheral images in a second example of the schematic operation of the image processing apparatus illustrated in FIG. 1.
  • FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus 100 according to an embodiment.
  • FIG. 2 is a diagram illustrating a setting screen of the image processing apparatus 100 shown in FIG.
  • FIG. 3 is a diagram exemplifying image synthesis in the image processing apparatus 100 shown in FIG.
  • the image processing apparatus 100 is for generating a good image from a defective image.
  • the defective image and the good image are both images of the target object.
  • the defective product image is obtained by photographing an object including a defect. Therefore, the defective product image includes a defect image corresponding to the defect.
  • the type of the defect is not particularly limited, for example, the defect is a visible one such as a scratch, a crack, an attached matter, and a dent.
  • the non-defective image is obtained by photographing an object that does not include the defect described above.
  • the non-defective image can be generated from the defective image by repairing a defective image included in the defective image.
  • the non-defective image is used, for example, as learning data for constructing a determination model for determining the acceptability of an object from an image of the object.
  • the non-defective image may be used as evaluation data for evaluating the quality of the target from an image of the target.
  • the image processing apparatus 100 includes an image processing device 100, a calculation device 50, an imaging device 60, an input device 70 and an output device 80.
  • the arithmetic device 50 is, for example, an information processing device such as a computer.
  • the arithmetic device 50 includes an input / output I / F (interface) 10, a storage unit 20, and a control unit 30.
  • the arithmetic device 50 further includes a bus 40 configured to transmit signals and data between the units of the arithmetic device 50.
  • the input / output I / F 10 is an interface between the arithmetic unit 50 and an external device.
  • the input / output I / F 10 is configured to exchange data and signals with external devices. Further, the input / output I / F 10 is configured to control communication with an external device.
  • the input / output I / F 10 includes, for example, connection terminals of standardized interfaces such as USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), and IEEE1394.
  • the input / output I / F 10 is connected to the imaging device 60, the input device 70, and the output device 80.
  • the storage unit 20 is configured to store programs, data, and the like.
  • the storage unit 20 includes, for example, a hard disk drive, a solid state drive, and the like.
  • the storage unit 20 stores in advance various programs executed by the control unit 30, data necessary for executing the programs, and the like. Further, the storage unit 20 stores a defective product image 21 input from the imaging device 60 via the input / output I / F 10 and a good product image 22 generated from the defective product image 21 by the control unit 30.
  • the control unit 30 is configured to control the operation of each unit of the arithmetic device 50, such as the input / output I / F 10 and the storage unit 20. Further, the control unit 30 is configured to realize each function described later by executing a program stored in the storage unit 20 or the like.
  • the control unit 30 includes, for example, a processor such as a CPU (Central Processing Unit), a memory such as a ROM (Read Only Memory), a RAM (Random Access Memory), and a buffer storage device such as a buffer.
  • the control unit 30 includes, for example, a setting unit 31, a specifying unit 32, a determining unit 33, and a combining unit 34 as its functional configuration.
  • the setting unit 31 is configured to set a plurality of items in a non-defective image generation process described later.
  • the content of each item is input by the user (user) operating the input device 70 or the like.
  • the setting unit 31 causes the output device 80 or the like to display a setting screen for the user to input each item.
  • the setting screen 310 includes, for example, “mode”, “brightness setting area”, and “paint radius” as parameter items.
  • “composite (4)” is selected as the mode
  • “10” is set in the brightness setting area
  • “10” is set in the paint radius.
  • the paint radius corresponds to an example of the “size of the peripheral pointer” of the present invention.
  • the setting screen 310 also includes “folder name” and “file name” as image items. For example, by inputting a “folder name” and a “file name” and pressing a read button, it is possible to set a defective image 21 read from the storage unit 20. By inputting the “folder name” and the “file name” and pressing the save button, the non-defective image 22 generated from the defective image 21 to be stored (written) in the storage unit 20 can be set. It becomes possible.
  • the specifying unit 32 is configured to specify a defect image corresponding to a defect in the defective product image 21. Specifically, the specifying unit 32 displays a pointer on the defective product image 21 displayed on the output device 80 or the like. The pointer is for designating a widened area. Then, by moving the pointer in accordance with the operation of the user via the input device 70 or the like, the specifying unit 32 can specify the defective image with the pointer.
  • the determiner 33 is configured to determine a peripheral image from images existing around the defective image designated in the defective product image 21.
  • the number of peripheral images to be determined is not limited to one, and may be plural.
  • Various methods can be adopted for determining the peripheral image. Some of the methods for determining the peripheral image will be described later, but are not particularly limited.
  • the synthesizing unit 34 is configured to synthesize the peripheral image determined on the defective image 21 with the designated defective image.
  • the designated defect image is set as the center image CI
  • the synthesis unit 34 calculates the density average value of the four peripheral images, and replaces the calculated density average value with the density value of the center image CI.
  • the four peripheral images are combined with the center image CI.
  • the synthesizing unit 34 may set eight surrounding images as the peripheral images with respect to the central image CI (see (b)), and replace the density average value of the eight peripheral images with the density value of the central image CI.
  • eight peripheral images are combined with the center image CI.
  • the combining unit 34 calculates an average value of RGB (Red, Green, Blue), and calculates a density average value based on the average value. Alternatively, the combining unit 34 calculates an average value for each of the R image, the G image, and the B image, and calculates based on each average value.
  • RGB Red, Green, Blue
  • FIG. 3 shows an example in which the density value of the center image CI, which is the designated defect image, is replaced with the density average value of four or eight peripheral images and synthesized, but the present invention is not limited to this.
  • the combining unit 34 may combine the designated defect image with the determined peripheral image by Poisson image combining (Poisson Image Editing). As a result, the defect image and the peripheral image can be blended (blending), and it is possible to generate the non-defective image 22 in which the boundary of the original defect image is smooth (seamless).
  • synthesis of images is not limited to the meaning of combining two or more images into one image, and one image is copied to another image in two or more images. That is, it includes replacing another image with the average value of the density of one image, and mixing one image with another image.
  • each function of the control unit 30 can be realized by a program executed by a computer (microprocessor). Therefore, each function of the control unit 30 can be realized by hardware, software, or a combination of hardware and software, and is not limited to any one of the cases.
  • control unit 30 When each function of the control unit 30 is realized by software or a combination of hardware and software, the processing can be executed by multitasking, multithreading, or both multitasking and multithreading. It is not limited to such a case.
  • the imaging device 60 is configured to capture an image and record it as data.
  • the imaging device 60 is a digital camera, and includes, for example, optical components such as a lens and electronic components such as an imaging device (light receiving device). Note that the optical system component may include a plurality of lenses.
  • the electronic component may include a light emitting device such as a flash.
  • the imaging device 60 outputs the captured image to the arithmetic device 50 via the input / output I / F 10.
  • the control unit 30 performs necessary processing on the image input from the imaging device 60 to generate a file of the non-defective product image or the defective product image 21, and causes the storage unit 20 to store the file of the defective product image 21.
  • the input device 70 is configured so that information can be input by an operation of a user (user).
  • the input device 70 includes, for example, a keyboard, a keypad, a mouse, a trackball, a touch panel, a microphone, and the like. It is possible to do.
  • the input device 70 transmits data or a signal corresponding to the operation.
  • the data is output to the arithmetic unit 50 via the input / output I / F 10.
  • the control unit 30 When the control unit 30 generates data based on the data or the signal, it becomes possible to input information to the arithmetic unit 50.
  • the output device 80 is configured to output information.
  • the output device 80 includes, for example, a display device such as a liquid crystal display, an EL (Electro Luminescence) display, and a plasma display.
  • the output device 80 can output information by displaying image data on a display device.
  • FIG. 4 is a flowchart illustrating a first example of the schematic operation of the image processing apparatus 100 shown in FIG.
  • FIG. 5 is a diagram illustrating a defective product image 21 of the image processing apparatus 100 shown in FIG.
  • FIG. 6 is a diagram illustrating a non-defective image 22 of the image processing apparatus 100 illustrated in FIG.
  • the image processing apparatus 100 executes the non-defective image generation processing S200 shown in FIG. 3 when the program is activated by, for example, a user operation.
  • the program is activated by, for example, a user operation.
  • an example in which “automatic combination” is set as the “mode” on the setting screen 310 will be described.
  • the setting unit 31 outputs the setting screen 310 shown in FIG. 2 to the output device 80 and displays it (S201). As a result, parameters can be input.
  • the setting unit 31 stores the data in the storage unit according to the input folder name and the file name.
  • the defective image 21 stored in the storage unit 20 is read, and the read defective image 21 is output to the output device 80 and displayed together with the setting screen 310 (S202).
  • the designation unit 32 displays a pointer on the defective product image 21 (S203).
  • a defect image included in the defective product image 21 can be specified.
  • the specifying unit 32 specifies a defect image corresponding to the defect in the defective product image 21 (S204). For example, as shown in FIG. 5, when the defective product image 21 includes a linear defect image 21a, the user moves the pointer P1 displayed on the defective product image 21 using the input device 70, and moves the pointer P1. By overlapping with a part of the defect image 21a, the specifying unit 32 specifies the defect image 21a.
  • the determination unit 33 determines the peripheral image of the defect image 21a specified in Step S204 (S205).
  • the determination unit 33 determines the peripheral image based on the moving direction of the pointer P1. To determine. That is, for example, when the pointer P1 moves in the vertical direction of the defective product image 21, the determination unit 33 determines the images in the left and right regions of the pointer P1 as peripheral images. On the other hand, for example, when the pointer P1 is moved in the left-right direction of the defective product image 21, the determination unit 33 determines the image in the area above and below the pointer P1 as the peripheral image.
  • the peripheral image based on the moving direction of the pointer P1 is automatically determined without selecting from the images existing around the defective image 21a. You. Therefore, the good image 22 can be easily generated from the defective image 21.
  • the determination unit 33 may determine the peripheral image based on the moving direction of the pointer P1 and from the image on the center side of the defective image 21.
  • the linear defect image 21a extends in the vertical direction, and one end (the upper end in FIG. 4) is located on the left side when viewed from the center of the defective product image 21, and the other end (in FIG. (Lower end) is located on the right side when viewed from the center of the defective product image 21.
  • the determination unit 33 determines the image in the area on the right side of the pointer P1 as the peripheral image at one end of the defective image 21a, and the other end of the defective image 21a halfway.
  • the image in the area on the side of the pointer P1 is determined as the peripheral image.
  • the possibility that a defect exists at the center of the defective product image 21 is smaller. Therefore, the defective image 21a can be easily repaired by determining the peripheral image from the image on the center side of the defective product image 21 based on the moving direction of the pointer P1.
  • the combining unit 34 combines the peripheral image determined in step S205 with the defect image 21a specified in step S204 (S206).
  • the combining unit 34 combines the images of the left and right regions of the pointer P1 with the defect image 21a by moving the pointer P1 downward so as to follow the linear defect image 21a.
  • the defect image 21a shown in FIG. 5 is repaired as shown in FIG.
  • the combining unit 34 displays the input folder name and file name.
  • the restored defective image 21 is stored in the storage unit 20 as a good image 22 (S207).
  • step S207 the control unit 30 ends the non-defective image generation processing S200.
  • the defective image 21 has one defect image 21a corresponding to the defect, but the present invention is not limited to this.
  • the processing from step S203 to step S206 may be repeated by the number of defective images 21a in the non-defective image generation processing S200.
  • FIG. 7 is a flowchart illustrating a second example of the schematic operation of the image processing apparatus 100 illustrated in FIG.
  • FIG. 8 is a diagram illustrating a peripheral image in a second example of the schematic operation of the image processing apparatus 100 shown in FIG.
  • the image processing apparatus 100 executes a non-defective image generation process S250 shown in FIG. 7 when the program is started by, for example, a user operation.
  • a non-defective image generation process S250 shown in FIG. 7 when the program is started by, for example, a user operation.
  • synthesis is set as the “mode” of the setting screen.
  • the same parts as those in the above-described first embodiment are denoted by the same reference numerals, and description thereof will be omitted as appropriate.
  • Steps S201 to S204 are the same as those in the first embodiment described above, and thus description thereof is omitted.
  • the determination unit 33 displays a peripheral pointer on the defective product image 21 (S251).
  • the peripheral pointer is for designating a widened area, similarly to the pointer P1 described above.
  • the peripheral pointer is displayed at a position in a predetermined direction with respect to the pointer P1. Therefore, the peripheral pointer moves together with the pointer P1.
  • the setting unit 31 sets the size of the peripheral pointer based on the value input to “paint radius” on the setting screen 310 via the input device 70 by the user. This makes it possible to determine a peripheral image having a desired size.
  • the determination unit 33 determines a peripheral image using the peripheral pointer (S252). For example, as shown in FIG. 8, the determining unit 33 first displays the peripheral pointer P2 on the pointer P1 (see (a)). In response to a user operation via the input device 70, for example, a right click of a mouse, the determination unit 33 moves the position of the peripheral pointer P2 to the upper right of the pointer P1 (see (b)) and to the right of the pointer P1 ((c)). Reference), lower right of pointer P1 (see (d)), lower pointer P1 (see (e)), lower left of pointer P1 (see (f)), left of pointer P1 (see (g)), pointer P1 In the upper left (see (h)).
  • the peripheral pointer P2 displayed at a position in the predetermined direction with respect to the pointer P1
  • Steps S206 and S207 performed after step S252 are the same as those in the first embodiment described above, and thus description thereof will be omitted.
  • the determined peripheral image is combined with the designated defect image 21a.
  • the defect image 21a it is considered that an image of a region without a defect exists around the defect image 21a. Therefore, it is possible to repair the defect image 21a by determining an image of a region without a defect around the defect image 21a as the peripheral image and combining the peripheral image with the defect image 21a. Therefore, the good image 22 can be easily generated from the defective image 21.
  • An image processing program to be executed by a computer A designation step of designating a defect image (21a) corresponding to a defect in a defective product image (21) obtained by photographing a defective product including a defect; A determination step of determining a peripheral image from images existing around the designated defect image (21a); Synthesizing the determined peripheral image with the designated defect image (21a).
  • Image processing program A designation step of designating a defect image (21a) corresponding to a defect in a defective product image (21) obtained by photographing a defective product including a defect; A determination step of determining a peripheral image from images existing around the designated defect image (21a); Synthesizing the determined peripheral image with the designated defect image (21a).
  • Reference numeral 20 storage unit
  • 50 arithmetic unit 60 imaging device, 70 input device, 80 output device, 100 image processing device, 310 setting screen, CI central image, P1 pointer, P2 peripheral pointer, S200, S250 non-defective Image generation processing.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Image Processing (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

An image processing device, image processing method and image processing program are provided which enable easily generating good product images from bad product images. This image processing device is provided with: a designation unit which designates a defect image, corresponding to a defect, in a defective product image taken of a defective product including the defect; a determination unit which determines peripheral images from the images present in the periphery of a designated defect image; and a synthesis unit which synthesizes peripheral images determined in the designated defect image. Here, it is thought that there are images of defect-free regions in the periphery of the defect image. Therefore, the images of the defect-free regions in the periphery of the defect image are determined as peripheral images, and, by synthesizing the peripheral images with the defect image, it is possible to repair the defect image.

Description

画像処理装置、画像処理方法及び画像処理プログラムImage processing apparatus, image processing method, and image processing program
 本発明は、画像処理装置、画像処理方法及び画像処理プログラムに関する。 The present invention relates to an image processing device, an image processing method, and an image processing program.
 従来、基板のエッジを撮影する撮影部と、該撮影部により取得された基板のエッジの画像に基づいて欠陥を検出する欠陥検出部と、該欠陥検出部により検出された欠陥の程度を判定する欠陥状態判定部と、欠陥検出部7により検出された欠陥の位置と、欠陥状態判定部により判定された欠陥の程度とを対応づけて登録する欠陥登録部とを備え、欠陥状態判定部が、欠陥登録部に登録された欠陥の程度を経時的に判定する欠陥監視システムが知られている(特許文献1参照)。この欠陥監視システムでは、欠陥状態判定部が登録された欠陥の程度を経時的に判定することにより、欠陥の程度の変化を監視することが可能となるので、検出当初においては修復不要な欠陥であった場合においても、その後の判定において成長している場合には、修復不能となる前にこれを修復することが可能となる。 Conventionally, a photographing unit for photographing the edge of a substrate, a defect detecting unit for detecting a defect based on an image of the edge of the substrate acquired by the photographing unit, and determining the degree of the defect detected by the defect detecting unit A defect state determination unit; and a defect registration unit that registers the position of the defect detected by the defect detection unit 7 and the degree of the defect determined by the defect state determination unit in association with each other. There is known a defect monitoring system that determines the degree of a defect registered in a defect registration unit over time (see Patent Document 1). In this defect monitoring system, the defect state determination unit determines the degree of the registered defect over time, thereby making it possible to monitor a change in the degree of the defect. Even if there is, if it is growing in the subsequent judgment, it can be repaired before it becomes unrecoverable.
特開2008-82949号公報JP 2008-82949 A
 ところで、欠陥を含む不良品を撮影した不良品画像から良品画像を生成する場合、不良品画像において欠陥に対応する欠陥画像を修復する必要がある。しかしながら、従来の画像処理装置では欠陥画像の修復に時間が掛かるため、不良品画像から良品画像を生成することは容易ではなかった。 When a non-defective product image is generated from a defective product image of a defective product including a defect, it is necessary to repair a defective image corresponding to the defect in the defective product image. However, in the conventional image processing apparatus, it takes a long time to repair a defective image, and it is not easy to generate a good image from a defective image.
 そこで、本発明は、欠陥を含む不良品を撮影した不良品画像から良品画像を容易に生成することのできる画像処理装置、画像処理方法及び画像処理プログラムを提供する。 Therefore, the present invention provides an image processing apparatus, an image processing method, and an image processing program that can easily generate a good-quality image from a defective product image obtained by photographing a defective product including a defect.
 本発明の一態様に係る画像処理装置は、欠陥を含む不良品を撮影した不良品画像において欠陥に対応する欠陥画像を指定する指定部と、指定された欠陥画像の周辺に存在する画像から周辺画像を決定する決定部と、指定された欠陥画像に決定された周辺画像を合成する合成部と、を備える。 An image processing apparatus according to one embodiment of the present invention includes a specification unit that specifies a defect image corresponding to a defect in a defective product image obtained by capturing a defective product including a defect, and a peripheral unit that determines a peripheral image from an image existing around the specified defect image. The image processing apparatus includes a determining unit that determines an image, and a combining unit that combines the determined peripheral image with the designated defect image.
 この態様によれば、指定された欠陥画像に決定された周辺画像が合成される。ここで、欠陥画像の周辺には欠陥のない領域の画像が存在すると考えられる。よって、欠陥画像の周辺にある欠陥のない領域の画像を周辺画像に決定し、欠陥画像に周辺画像を合成することにより、欠陥画像を修復することが可能となる。従って、不良品画像から良品画像を容易に生成することができる。 According to this aspect, the determined peripheral image is combined with the designated defect image. Here, it is considered that there is an image of a region without a defect around the defect image. Therefore, it is possible to repair the defective image by determining the image of the area without the defect around the defective image as the peripheral image and combining the peripheral image with the defective image. Therefore, a good image can be easily generated from the defective image.
 前述した態様において、指定部は、不良品画像上に表示されるポインタによって欠陥画像を指定し、決定部は、ポインタの移動方向に基づいて周辺画像を決定してもよい。 In the aspect described above, the specifying unit may specify the defective image by using the pointer displayed on the defective product image, and the determining unit may determine the peripheral image based on the moving direction of the pointer.
 この態様によれば、ポインタの移動方向に基づいて周辺画像が決定される。これにより、欠陥画像の周辺に存在する画像から選択することなく、ポインタの移動方向に基づく周辺画像が自動的に決定される。従って、不良品画像から良品画像を簡便に生成することができる。 According to this aspect, the peripheral image is determined based on the moving direction of the pointer. Thus, the peripheral image based on the moving direction of the pointer is automatically determined without selecting from the images existing around the defective image. Therefore, a good image can be easily generated from the defective image.
 前述した態様において、決定部は、ポインタの移動方向に基づき、かつ、不良品画像の中心側の画像から周辺画像を決定してもよい。 In the aspect described above, the determining unit may determine the peripheral image based on the moving direction of the pointer and from the image on the center side of the defective image.
 この態様によれば、ポインタの移動方向に基づき、かつ、不良品画像の中心側の画像から周辺画像が決定される。一般に、不良品画像の中心に欠陥が存在する可能性は、より少ないと考えられる。よって、ポインタの移動方向に基づき、かつ、不良品画像の中心側の画像から周辺画像を決定することにより、欠陥画像を容易に修復することができる。 According to this aspect, the peripheral image is determined from the image on the center side of the defective image based on the moving direction of the pointer. Generally, it is considered that the possibility that a defect exists at the center of a defective product image is smaller. Therefore, the defective image can be easily repaired by determining the peripheral image from the image on the center side of the defective image based on the moving direction of the pointer.
 前述した態様において、決定部は、不良品画像においてポインタに対して所定方向の位置に表示される周辺ポインタによって周辺画像を決定してもよい。 In the aspect described above, the determining unit may determine the peripheral image by the peripheral pointer displayed at a position in a predetermined direction with respect to the pointer in the defective product image.
 この態様によれば、ポインタに対して所定方向の位置に表示される周辺ポインタによって周辺画像が決定される。これにより、欠陥画像の周辺において欠陥が存在しない領域の画像を選択することができる。従って、不良品画像から良品画像をさらに容易に生成することができる。 According to this aspect, the peripheral image is determined by the peripheral pointer displayed at a position in a predetermined direction with respect to the pointer. This makes it possible to select an image in a region where no defect exists around the defect image. Therefore, a good image can be more easily generated from a defective image.
 前述した態様において、周辺ポインタのサイズを設定する設定部をさらに備えてもよい。 In the above-described embodiment, a setting unit for setting the size of the peripheral pointer may be further provided.
 この態様によれば、周辺ポインタのサイズが設定される。これにより、所望の大きさの周辺画像を決定することが可能となる。 According to this aspect, the size of the peripheral pointer is set. This makes it possible to determine a peripheral image having a desired size.
 また、本発明の他の態様に係る画像処理方法は、欠陥を含む不良品を撮影した不良品画像において欠陥に対応する欠陥画像を指定する指定ステップと、指定された欠陥画像の周辺に存在する画像から周辺画像を決定する決定ステップと、指定された欠陥画像に決定された周辺画像を合成する合成ステップと、を含む。 In addition, an image processing method according to another aspect of the present invention includes a specifying step of specifying a defect image corresponding to a defect in a defective product image obtained by photographing a defective product including a defect, wherein the specifying step exists around the specified defect image. A determining step of determining a peripheral image from the image; and a combining step of combining the determined peripheral image with the designated defect image.
 この態様によれば、指定された欠陥画像に決定された周辺画像が合成される。ここで、欠陥画像の周辺には欠陥のない領域の画像が存在すると考えられる。よって、欠陥画像の周辺にある欠陥のない領域の画像を周辺画像に決定し、欠陥画像に周辺画像を合成することにより、欠陥画像を修復することが可能となる。従って、不良品画像から良品画像を容易に生成することができる。 According to this aspect, the determined peripheral image is combined with the designated defect image. Here, it is considered that there is an image of a region without a defect around the defect image. Therefore, it is possible to repair the defective image by determining the image of the area without the defect around the defective image as the peripheral image and combining the peripheral image with the defective image. Therefore, a good image can be easily generated from the defective image.
 前述した態様において、指定ステップは、不良品画像上に表示されるポインタによって欠陥画像を指定することを含み、決定ステップは、ポインタの移動方向に基づいて周辺画像を決定することを含んでもよい。 In the aspect described above, the specifying step may include specifying a defective image with a pointer displayed on the defective product image, and the determining step may include determining a peripheral image based on a moving direction of the pointer.
 この態様によれば、ポインタの移動方向に基づいて周辺画像が決定される。これにより、欠陥画像の周辺に存在する画像から選択することなく、ポインタの移動方向に基づく周辺画像が自動的に決定される。従って、不良品画像から良品画像を簡便に生成することができる。 According to this aspect, the peripheral image is determined based on the moving direction of the pointer. Thus, the peripheral image based on the moving direction of the pointer is automatically determined without selecting from the images existing around the defective image. Therefore, a good image can be easily generated from the defective image.
 前述した態様において、決定ステップは、ポインタの移動方向に基づき、かつ、不良品画像の中心側の画像から周辺画像を決定することを含んでもよい。 In the aspect described above, the determining step may include determining a peripheral image from an image on the center side of the defective image based on the moving direction of the pointer.
 この態様によれば、ポインタの移動方向に基づき、かつ、不良品画像の中心側の画像から周辺画像が決定される。一般に、不良品画像の中心に欠陥が存在する可能性は、より少ないと考えられる。よって、ポインタの移動方向に基づき、かつ、不良品画像の中心側の画像から周辺画像を決定することにより、欠陥画像を容易に修復することができる。 According to this aspect, the peripheral image is determined from the image on the center side of the defective image based on the moving direction of the pointer. Generally, it is considered that the possibility that a defect exists at the center of a defective product image is smaller. Therefore, the defective image can be easily repaired by determining the peripheral image from the image on the center side of the defective image based on the moving direction of the pointer.
 前述した態様において、決定ステップは、不良品画像においてポインタに対して所定方向の位置に表示される周辺ポインタによって周辺画像を決定することを含んでもよい。 In the aspect described above, the determining step may include determining the peripheral image using a peripheral pointer displayed at a position in a predetermined direction with respect to the pointer in the defective product image.
 この態様によれば、ポインタに対して所定方向の位置に表示される周辺ポインタによって周辺画像が決定される。これにより、欠陥画像の周辺において欠陥が存在しない領域の画像を選択することができる。従って、不良品画像から良品画像をさらに容易に生成することができる。 According to this aspect, the peripheral image is determined by the peripheral pointer displayed at a position in a predetermined direction with respect to the pointer. This makes it possible to select an image in a region where no defect exists around the defect image. Therefore, a good image can be more easily generated from a defective image.
 前述した態様において、周辺ポインタのサイズを設定する設定ステップをさらに含んでもよい。 In the above-described embodiment, a setting step of setting the size of the peripheral pointer may be further included.
 この態様によれば、周辺ポインタのサイズが設定される。これにより、所望の大きさの周辺画像を決定することが可能となる。 According to this aspect, the size of the peripheral pointer is set. This makes it possible to determine a peripheral image having a desired size.
 また、本発明の他の態様に係る画像処理プログラムは、コンピュータに実行させる画像処理プログラムであって、欠陥を含む不良品を撮影した不良品画像において欠陥に対応する欠陥画像を指定する指定ステップと、指定された欠陥画像の周辺に存在する画像から周辺画像を決定する決定ステップと、指定された欠陥画像に決定された周辺画像を合成する合成ステップと、を含む。 An image processing program according to another aspect of the present invention is an image processing program to be executed by a computer, comprising: a designation step of designating a defect image corresponding to a defect in a defective product image obtained by photographing a defective product including a defect. A determining step of determining a peripheral image from an image existing around the designated defect image; and a combining step of combining the determined peripheral image with the designated defect image.
 この態様によれば、指定された欠陥画像に決定された周辺画像が合成される。ここで、欠陥画像の周辺には欠陥のない領域の画像が存在すると考えられる。よって、欠陥画像の周辺にある欠陥のない領域の画像を周辺画像に決定し、欠陥画像に周辺画像を合成することにより、欠陥画像を修復することが可能となる。従って、不良品画像から良品画像を容易に生成することができる。 According to this aspect, the determined peripheral image is combined with the designated defect image. Here, it is considered that there is an image of a region without a defect around the defect image. Therefore, it is possible to repair the defective image by determining the image of the area without the defect around the defective image as the peripheral image and combining the peripheral image with the defective image. Therefore, a good image can be easily generated from the defective image.
 本発明によれば、不良品画像から良品画像を容易に生成することのできる画像処理装置、画像処理方法及び画像処理プログラムを提供することができる。 According to the present invention, it is possible to provide an image processing apparatus, an image processing method, and an image processing program that can easily generate a good-quality image from a defective-quality image.
図1は、一実施形態に係る画像処理装置の概略構成を例示するブロック図である。FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to an embodiment. 図2は、図1に示した画像処理装置の設定画面を例示する図である。FIG. 2 is a diagram illustrating a setting screen of the image processing apparatus illustrated in FIG. 図3は、図1に示した画像処理装置における画像の合成を例示する図である。FIG. 3 is a diagram illustrating an example of combining images in the image processing apparatus illustrated in FIG. 1. 図4は、図1に示した画像処理装置の概略動作の第1実施例を例示するフローチャートである。FIG. 4 is a flowchart illustrating a first example of a schematic operation of the image processing apparatus illustrated in FIG. 図5は、図1に示した画像処理装置の不良品画像を例示する図である。FIG. 5 is a diagram illustrating a defective product image of the image processing apparatus shown in FIG. 図6は、図1に示した画像処理装置の良品画像を例示する図である。FIG. 6 is a diagram illustrating a non-defective image of the image processing apparatus illustrated in FIG. 図7は、図1に示した画像処理装置の概略動作の第2実施例を例示するフローチャートである。FIG. 7 is a flowchart illustrating a second example of the schematic operation of the image processing apparatus illustrated in FIG. 図8は、図1に示した画像処理装置の概略動作の第2実施例における周辺画像を例示する図である。FIG. 8 is a diagram illustrating peripheral images in a second example of the schematic operation of the image processing apparatus illustrated in FIG. 1.
 添付図面を参照して、本発明の好適な実施形態について説明する。なお、各図において、同一の符号を付したものは、同一又は同様の構成を有する。 A preferred embodiment of the present invention will be described with reference to the accompanying drawings. In each of the drawings, the components denoted by the same reference numerals have the same or similar configurations.
 まず、図1から図3を参照しつつ、本実施形態に係る画像処理装置の構成の一例について説明する。図1は、一実施形態に係る画像処理装置100の概略構成を例示するブロック図である。図2は、図1に示した画像処理装置100の設定画面を例示する図である。
図3は、図1に示した画像処理装置100における画像の合成を例示する図である。
First, an example of the configuration of the image processing apparatus according to the present embodiment will be described with reference to FIGS. FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus 100 according to an embodiment. FIG. 2 is a diagram illustrating a setting screen of the image processing apparatus 100 shown in FIG.
FIG. 3 is a diagram exemplifying image synthesis in the image processing apparatus 100 shown in FIG.
 画像処理装置100は、不良品画像から良品画像を生成するためのものである。不良品画像及び良品画像は、ともに対象物の画像である。不良品画像は、欠陥を含む対象物を撮影したものでる。そのため、不良品画像には、当該欠陥に対応する欠陥画像が含まれる。欠陥の種類は、特に限定されるものではないが、例えば、傷、クラック、付着物、打痕等、視認可能なものである。一方、良品画像は、前述した欠陥を含まない対象物を撮影したものである。また、良品画像は、不良品画像に含まれる欠陥画像を修復することで、不良品画像から生成することも可能である。良品画像は、例えば、対象物を撮像した画像から対象物の良否を判定する判定モデルを構築するための学習用データとして用いられる。あるいは、良品画像は、対象物を撮像した画像から対象物の品質を評価するための評価用データとして用いられてもよい。 The image processing apparatus 100 is for generating a good image from a defective image. The defective image and the good image are both images of the target object. The defective product image is obtained by photographing an object including a defect. Therefore, the defective product image includes a defect image corresponding to the defect. Although the type of the defect is not particularly limited, for example, the defect is a visible one such as a scratch, a crack, an attached matter, and a dent. On the other hand, the non-defective image is obtained by photographing an object that does not include the defect described above. In addition, the non-defective image can be generated from the defective image by repairing a defective image included in the defective image. The non-defective image is used, for example, as learning data for constructing a determination model for determining the acceptability of an object from an image of the object. Alternatively, the non-defective image may be used as evaluation data for evaluating the quality of the target from an image of the target.
 図1に示すように、画像処理装置100と、演算装置50と、撮像装置60と、入力装置70と、出力装置80と、を備える。 。As shown in FIG. 1, the image processing apparatus 100 includes an image processing device 100, a calculation device 50, an imaging device 60, an input device 70 and an output device 80.
 演算装置50は、例えば、コンピュータ等の情報処理装置である。演算装置50は、入出力I/F(インターフェース)10と、記憶部20と、制御部30と、を備える。また、演算装置50は、演算装置50の各部の間で信号やデータを伝送するように構成されたバス40をさらに備える。 The arithmetic device 50 is, for example, an information processing device such as a computer. The arithmetic device 50 includes an input / output I / F (interface) 10, a storage unit 20, and a control unit 30. The arithmetic device 50 further includes a bus 40 configured to transmit signals and data between the units of the arithmetic device 50.
 入出力I/F10は、演算装置50と外部の機器とのインターフェースである。入出力I/F10は、外部の機器との間でデータや信号をやり取りするように構成されている。また、入出力I/F10は、外部の機器との通信を制御するように構成されている。入出力I/F10は、例えば、USB(Universal Serial Bus)、HDMI(登録商標)(High-Definition Mutimedia Interface)、IEEE1394等の規格化されたインターフェースの接続端子を含んで構成される。入出力I/F10は、撮像装置60、入力装置70、及び出力装置80に接続されている。 The input / output I / F 10 is an interface between the arithmetic unit 50 and an external device. The input / output I / F 10 is configured to exchange data and signals with external devices. Further, the input / output I / F 10 is configured to control communication with an external device. The input / output I / F 10 includes, for example, connection terminals of standardized interfaces such as USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), and IEEE1394. The input / output I / F 10 is connected to the imaging device 60, the input device 70, and the output device 80.
 記憶部20は、プログラムやデータ等を記憶するように構成されている。記憶部20は、例えば、ハードディスクドライブ、ソリッドステートドライブ等を含んで構成される。記憶部20は、制御部30が実行する各種プログラムやプログラムの実行に必要なデータ等をあらかじめ記憶している。また、記憶部20は、撮像装置60から入出力I/F10を介して入力される不良品画像21と、制御部30によって不良品画像21から生成される良品画像22と、を記憶する。 The storage unit 20 is configured to store programs, data, and the like. The storage unit 20 includes, for example, a hard disk drive, a solid state drive, and the like. The storage unit 20 stores in advance various programs executed by the control unit 30, data necessary for executing the programs, and the like. Further, the storage unit 20 stores a defective product image 21 input from the imaging device 60 via the input / output I / F 10 and a good product image 22 generated from the defective product image 21 by the control unit 30.
 制御部30は、入出力I/F10及び記憶部20等、演算装置50の各部の動作を制御するように構成されている。また、制御部30は、記憶部20に記憶されたプログラムを実行する等によって、後述する各機能を実現するように構成されている。制御部30は、例えば、CPU(Central Processing Unit)等のプロセッサ、ROM(Read Only Memory)、RAM(Random Access Memory)等のメモリ、及びバッファ等の緩衝記憶装置を含んで構成される。制御部30は、その機能構成として、例えば、設定部31と、指定部32と、決定部33と、合成部34と、を備える。 The control unit 30 is configured to control the operation of each unit of the arithmetic device 50, such as the input / output I / F 10 and the storage unit 20. Further, the control unit 30 is configured to realize each function described later by executing a program stored in the storage unit 20 or the like. The control unit 30 includes, for example, a processor such as a CPU (Central Processing Unit), a memory such as a ROM (Read Only Memory), a RAM (Random Access Memory), and a buffer storage device such as a buffer. The control unit 30 includes, for example, a setting unit 31, a specifying unit 32, a determining unit 33, and a combining unit 34 as its functional configuration.
 設定部31は、後述する良品画像生成処理における複数の項目を設定するように構成されている。各項目の内容は、利用者(ユーザ)が入力装置70等を操作することによって入力される。設定部31は、利用者が各項目を入力するための設定画面を出力装置80等に表示させる。 The setting unit 31 is configured to set a plurality of items in a non-defective image generation process described later. The content of each item is input by the user (user) operating the input device 70 or the like. The setting unit 31 causes the output device 80 or the like to display a setting screen for the user to input each item.
 図2に示すように、設定画面310は、パラメータの項目として、例えば、「モード」と、「明るさ設定領域」と、「ペイント半径」と、を含む。図2に示す例では、モードとして「合成(4)」が選択され、明るさ設定領域に「10」が設定され、ペイント半径に「10」が設定されている。ペイント半径は、本発明の「周辺ポインタのサイズ」の一例に相当する。 As shown in FIG. 2, the setting screen 310 includes, for example, “mode”, “brightness setting area”, and “paint radius” as parameter items. In the example shown in FIG. 2, “composite (4)” is selected as the mode, “10” is set in the brightness setting area, and “10” is set in the paint radius. The paint radius corresponds to an example of the “size of the peripheral pointer” of the present invention.
 また、設定画面310は、画像の項目として、「フォルダ名」と、「ファイル名」と、を含む。例えば、「フォルダ名」及び「ファイル名」を入力して読込ボタンを押下することで、記憶部20から読み込まれる不良品画像21を設定することが可能となる。また、「フォルダ名」及び「ファイル名」を入力して保存ボタンを押下することで、記憶部20に保存される(書き込まれる)、不良品画像21から生成した良品画像22を設定することが可能となる。 The setting screen 310 also includes “folder name” and “file name” as image items. For example, by inputting a “folder name” and a “file name” and pressing a read button, it is possible to set a defective image 21 read from the storage unit 20. By inputting the “folder name” and the “file name” and pressing the save button, the non-defective image 22 generated from the defective image 21 to be stored (written) in the storage unit 20 can be set. It becomes possible.
 図1に戻り、指定部32は、不良品画像21において欠陥に対応する欠陥画像を指定するように構成されている。具体的には、指定部32は、出力装置80等に表示された不良品画像21の上にポインタを表示させる。ポインタは、広がりを持った領域を指定するためのものである。そして、入力装置70等を介する利用者の操作に応じてポインタを移動させることで、指定部32はポインタによって欠陥画像を指定することが可能となる。 Returning to FIG. 1, the specifying unit 32 is configured to specify a defect image corresponding to a defect in the defective product image 21. Specifically, the specifying unit 32 displays a pointer on the defective product image 21 displayed on the output device 80 or the like. The pointer is for designating a widened area. Then, by moving the pointer in accordance with the operation of the user via the input device 70 or the like, the specifying unit 32 can specify the defective image with the pointer.
 決定部33は、不良品画像21において指定された欠陥画像の周辺に存在する画像から、周辺画像を決定するように構成されている。決定される周辺画像は、1つである場合には限定されず、複数であってもよい。周辺画像の決定は、様々な方法が採用され得る。周辺画像の決定方法のうちの幾つかについては後述するが、特に限定されるものではない。 The determiner 33 is configured to determine a peripheral image from images existing around the defective image designated in the defective product image 21. The number of peripheral images to be determined is not limited to one, and may be plural. Various methods can be adopted for determining the peripheral image. Some of the methods for determining the peripheral image will be described later, but are not particularly limited.
 合成部34は、不良品画像21において、指定された欠陥画像に決定された周辺画像を合成するように構成されている。例えば、図3に示すように、指定された欠陥画像を中心画像CIとし、中心画像CIと同サイズであって、中心画像CIに対して上下左右の4画像を周辺画像とする((a)参照)。そして、合成部34は、4つの周辺画像の濃度平均値を算出し、算出した濃度平均値を中心画像CIの濃度値と置換する。これにより、中心画像CIに4つの周辺画像が合成される。あるいは、中心画像CIに対して周囲の8画像を周辺画像とし((b)参照)、合成部34は、8つの周辺画像の濃度平均値を中心画像CIの濃度値と置換してもよい。これにより、中心画像CIに8つの周辺画像が合成される。 The synthesizing unit 34 is configured to synthesize the peripheral image determined on the defective image 21 with the designated defective image. For example, as shown in FIG. 3, the designated defect image is set as the center image CI, and four images, which are the same size as the center image CI and are upper, lower, left, and right with respect to the center image CI, are set as peripheral images ((a)). reference). Then, the synthesis unit 34 calculates the density average value of the four peripheral images, and replaces the calculated density average value with the density value of the center image CI. As a result, the four peripheral images are combined with the center image CI. Alternatively, the synthesizing unit 34 may set eight surrounding images as the peripheral images with respect to the central image CI (see (b)), and replace the density average value of the eight peripheral images with the density value of the central image CI. Thus, eight peripheral images are combined with the center image CI.
 なお、不良品画像21がカラーの画像である場合、合成部34は、RGB(Red Green Blue)の平均値を求め、当該平均値に基づいて濃度平均値を算出する。あるいは、合成部34は、R画像、G画像、B画像のそれぞれについて平均値を求め、各平均値に基づいて算出する。 When the defective image 21 is a color image, the combining unit 34 calculates an average value of RGB (Red, Green, Blue), and calculates a density average value based on the average value. Alternatively, the combining unit 34 calculates an average value for each of the R image, the G image, and the B image, and calculates based on each average value.
 ここで、欠陥画像の周辺には欠陥のない領域の画像が存在すると考えられる。よって、欠陥画像の周辺にある欠陥のない領域の画像を周辺画像に決定し、欠陥画像に周辺画像を合成することにより、欠陥画像を修復することが可能となる。従って、不良品画像21から良品画像22を容易に生成することができる。 Here, it is considered that an image of an area without a defect exists around the defect image. Therefore, it is possible to repair the defective image by determining the image of the area without the defect around the defective image as the peripheral image and combining the peripheral image with the defective image. Therefore, the good image 22 can be easily generated from the defective image 21.
 図3では、指定された欠陥画像である中心画像CIの濃度値を4又は8つの周辺画像の濃度平均値に置換して合成する例を示したが、これに限定されるものではない。合成部34は、指定された欠陥画像と決定された周辺画像との合成を、ポアソン画像合成(Poisson Image Editing)によって行ってもよい。これにより、欠陥画像と周辺画像とを混合すること(blending)ができ、元の欠陥画像の境界が滑らかな(シームレスな)良品画像22を生成することが可能となる。 FIG. 3 shows an example in which the density value of the center image CI, which is the designated defect image, is replaced with the density average value of four or eight peripheral images and synthesized, but the present invention is not limited to this. The combining unit 34 may combine the designated defect image with the determined peripheral image by Poisson image combining (Poisson Image Editing). As a result, the defect image and the peripheral image can be blended (blending), and it is possible to generate the non-defective image 22 in which the boundary of the original defect image is smooth (seamless).
 なお、本願において、画像の「合成」とは、2以上の画像を結び付けて1つの画像とする意味に限定されず、2以上の画像において、一の画像を他の画像に複写(コピー)すること、一の画像の濃度の平均値で他の画像を置換すること、及び一の画像と他の画像とを混合することを含む意味である。 In the present application, “synthesis” of images is not limited to the meaning of combining two or more images into one image, and one image is copied to another image in two or more images. That is, it includes replacing another image with the average value of the density of one image, and mixing one image with another image.
 図1に戻り、制御部30の各機能は、コンピュータ(マイクロプロセッサ)で実行されるプログラムによって実現することが可能である。したがって、制御部30が備える各機能は、ハードウェア、ソフトウェア、若しくはハードウェア及びソフトウェアの組み合わせによって実現可能であり、いずれかの場合に限定されるものではない。 Returning to FIG. 1, each function of the control unit 30 can be realized by a program executed by a computer (microprocessor). Therefore, each function of the control unit 30 can be realized by hardware, software, or a combination of hardware and software, and is not limited to any one of the cases.
 また、制御部30の各機能が、ソフトウェア、若しくはハードウェア及びソフトウェアの組み合わせによって実現される場合、その処理は、マルチタスク、マルチスレッド、若しくはマルチタスク及びマルチスレッドの両方で実行可能であり、いずれかの場合に限定されるものではない。 When each function of the control unit 30 is realized by software or a combination of hardware and software, the processing can be executed by multitasking, multithreading, or both multitasking and multithreading. It is not limited to such a case.
 撮像装置60は、画像を撮影してデータとして記録するように構成されている。撮像装置60は、デジタルカメラであり、例えば、レンズ等の光学系部品と、撮像素子(受光素子)等の電子系部品とを含んで構成される。なお、光学系部品は、複数のレンズを備えていてもよい。また、電子系部品は、フラッシュ等の発光装置を備えていてもよい。撮像装置60は、撮影した画像を入出力I/F10を介して演算装置50に出力する。制御部30は、撮像装置60から入力された画像に必要な処理を施して良品画像又は不良品画像21のファイルを生成し、不良品画像21のファイルを記憶部20に記憶させる。 The imaging device 60 is configured to capture an image and record it as data. The imaging device 60 is a digital camera, and includes, for example, optical components such as a lens and electronic components such as an imaging device (light receiving device). Note that the optical system component may include a plurality of lenses. The electronic component may include a light emitting device such as a flash. The imaging device 60 outputs the captured image to the arithmetic device 50 via the input / output I / F 10. The control unit 30 performs necessary processing on the image input from the imaging device 60 to generate a file of the non-defective product image or the defective product image 21, and causes the storage unit 20 to store the file of the defective product image 21.
 入力装置70は、利用者(ユーザ)の操作により情報を入力できるように構成されている。入力装置70は、例えば、キーボード、キーパッド、マウス、トラックボール、タッチパネル、マイク等を含んで構成される。することが可能である。例えば、利用者が、キーボード、キーパッド、マウス、トラックボール、タッチパネル、マイク等を操作(マイクを用いた音声操作を含む)したときに、入力装置70は、当該操作に対応するデータ又は信号を入出力I/F10を介して演算装置50に出力する。制御部30が、このデータまた信号に基づいてデータを生成することで、演算装置50に情報を入力することが可能になる。 The input device 70 is configured so that information can be input by an operation of a user (user). The input device 70 includes, for example, a keyboard, a keypad, a mouse, a trackball, a touch panel, a microphone, and the like. It is possible to do. For example, when the user operates a keyboard, a keypad, a mouse, a trackball, a touch panel, a microphone, and the like (including a voice operation using a microphone), the input device 70 transmits data or a signal corresponding to the operation. The data is output to the arithmetic unit 50 via the input / output I / F 10. When the control unit 30 generates data based on the data or the signal, it becomes possible to input information to the arithmetic unit 50.
 出力装置80は、情報を出力するように構成されている。出力装置80は、例えば、液晶ディスプレイ、EL(Electro Luminescence)ディスプレイ、プラズマディスプレイ等の表示装置を含んで構成される。例えば、出力装置80が、画像データを表示装置に表示することで、情報を出力することが可能になる。 The output device 80 is configured to output information. The output device 80 includes, for example, a display device such as a liquid crystal display, an EL (Electro Luminescence) display, and a plasma display. For example, the output device 80 can output information by displaying image data on a display device.
 次に、図4から図6を参照しつつ、本実施形態に係る画像処理装置100の動作の第1実施例について説明する。図4は、図1に示した画像処理装置100の概略動作の第1実施例を例示するフローチャートである。図5は、図1に示した画像処理装置100の不良品画像21を例示する図である。図6は、図1に示した画像処理装置100の良品画像22を例示する図である。 Next, a first example of the operation of the image processing apparatus 100 according to the present embodiment will be described with reference to FIGS. FIG. 4 is a flowchart illustrating a first example of the schematic operation of the image processing apparatus 100 shown in FIG. FIG. 5 is a diagram illustrating a defective product image 21 of the image processing apparatus 100 shown in FIG. FIG. 6 is a diagram illustrating a non-defective image 22 of the image processing apparatus 100 illustrated in FIG.
 画像処理装置100は、例えば利用者の操作によってプログラムが起動されると、図3に示す良品画像生成処理S200を実行する。第1実施例では、設定画面310の「モード」として「自動合成」が設定される例を説明する。 The image processing apparatus 100 executes the non-defective image generation processing S200 shown in FIG. 3 when the program is activated by, for example, a user operation. In the first embodiment, an example in which “automatic combination” is set as the “mode” on the setting screen 310 will be described.
 最初に、設定部31は、図2に示した設定画面310を出力装置80に出力し、表示させる(S201)。これにより、パラメータが入力可能となる。 First, the setting unit 31 outputs the setting screen 310 shown in FIG. 2 to the output device 80 and displays it (S201). As a result, parameters can be input.
 次に、利用者によって入力装置70を介して設定画面310のフォルダ名及びファイル名が入力され、読込ボタンが押下されると、設定部31は、入力されたフォルダ名及びファイル名に従い、記憶部20に記憶された不良品画像21を読み出し、読み出した不良品画像21を出力装置80に出力して設定画面310ととともに表示させる(S202)。 Next, when the user inputs a folder name and a file name on the setting screen 310 via the input device 70 and presses the read button, the setting unit 31 stores the data in the storage unit according to the input folder name and the file name. The defective image 21 stored in the storage unit 20 is read, and the read defective image 21 is output to the output device 80 and displayed together with the setting screen 310 (S202).
 次に、指定部32は、不良品画像21上にポインタを表示させる(S203)。これにより、不良品画像21に含まれる欠陥画像が指定可能になる。 Next, the designation unit 32 displays a pointer on the defective product image 21 (S203). Thus, a defect image included in the defective product image 21 can be specified.
 次に、入力装置70を介する利用者の操作に基づいて、指定部32は不良品画像21において欠陥に対応する欠陥画像を指定する(S204)。例えば、図5に示すように、不良品画像21が線状の欠陥画像21aを含む場合、不良品画像21上に表示されるポインタP1を利用者が入力装置70を用いて動かし、ポインタP1を欠陥画像21aの一部に重ねることで、指定部32は欠陥画像21aを指定する。 Next, based on the operation of the user via the input device 70, the specifying unit 32 specifies a defect image corresponding to the defect in the defective product image 21 (S204). For example, as shown in FIG. 5, when the defective product image 21 includes a linear defect image 21a, the user moves the pointer P1 displayed on the defective product image 21 using the input device 70, and moves the pointer P1. By overlapping with a part of the defect image 21a, the specifying unit 32 specifies the defect image 21a.
 次に、決定部33は、ステップS204において指定された欠陥画像21aの周辺画像を決定する(S205)。図5に示す例の場合、ポインタP1が欠陥画像21aの上を沿うように、利用者の操作によってポインタP1を移動させることで、決定部33は、ポインタP1の移動方向に基づいて、周辺画像を決定する。すなわち、例えば、ポインタP1が不良品画像21の上下方向に移動する場合、決定部33は、ポインタP1の左右の領域の画像を周辺画像として決定する。一方、例えば、ポインタP1を不良品画像21の左右方向に移動させる場合、決定部33は、ポインタP1の上下の領域の画像を周辺画像として決定する。このように、ポインタP1の移動方向に基づいて周辺画像を決定することにより、欠陥画像21aの周辺に存在する画像から選択することなく、ポインタP1の移動方向に基づく周辺画像が自動的に決定される。従って、不良品画像21から良品画像22を簡便に生成することができる。 Next, the determination unit 33 determines the peripheral image of the defect image 21a specified in Step S204 (S205). In the case of the example shown in FIG. 5, by moving the pointer P1 by a user's operation so that the pointer P1 follows the defect image 21a, the determination unit 33 determines the peripheral image based on the moving direction of the pointer P1. To determine. That is, for example, when the pointer P1 moves in the vertical direction of the defective product image 21, the determination unit 33 determines the images in the left and right regions of the pointer P1 as peripheral images. On the other hand, for example, when the pointer P1 is moved in the left-right direction of the defective product image 21, the determination unit 33 determines the image in the area above and below the pointer P1 as the peripheral image. In this manner, by determining the peripheral image based on the moving direction of the pointer P1, the peripheral image based on the moving direction of the pointer P1 is automatically determined without selecting from the images existing around the defective image 21a. You. Therefore, the good image 22 can be easily generated from the defective image 21.
 なお、決定部33は、ポインタP1の移動方向に基づき、かつ、不良品画像21の中心側の画像から周辺画像を決定してもよい。図5に示す例の場合、線状の欠陥画像21aは上下方向に伸びており、一端(図4において上端)が不良品画像21の中心から見て左側に位置し、他端(図4において下端)が不良品画像21の中心から見て右側に位置している。この欠陥画像21aを辿ってポインタP1を移動させる場合、決定部33は、欠陥画像21aの一端側ではポインタP1の右側の領域の画像を周辺画像として決定し、途中から欠陥画像21aの他端側ではポインタP1の側の領域の画像を周辺画像として決定する。一般に、不良品画像21の中心に欠陥が存在する可能性は、より少ないと考えられる。よって、ポインタP1の移動方向に基づき、かつ、不良品画像21の中心側の画像から周辺画像を決定することにより、欠陥画像21aを容易に修復することができる。 Note that the determination unit 33 may determine the peripheral image based on the moving direction of the pointer P1 and from the image on the center side of the defective image 21. In the example shown in FIG. 5, the linear defect image 21a extends in the vertical direction, and one end (the upper end in FIG. 4) is located on the left side when viewed from the center of the defective product image 21, and the other end (in FIG. (Lower end) is located on the right side when viewed from the center of the defective product image 21. When the pointer P1 is moved by following the defective image 21a, the determination unit 33 determines the image in the area on the right side of the pointer P1 as the peripheral image at one end of the defective image 21a, and the other end of the defective image 21a halfway. In, the image in the area on the side of the pointer P1 is determined as the peripheral image. Generally, it is considered that the possibility that a defect exists at the center of the defective product image 21 is smaller. Therefore, the defective image 21a can be easily repaired by determining the peripheral image from the image on the center side of the defective product image 21 based on the moving direction of the pointer P1.
 次に、合成部34は、ステップS204で指定された欠陥画像21aに、ステップS205で決定された周辺画像を合成する(S206)。前述した例の場合、ポインタP1を線状の欠陥画像21aを辿るように下方に移動させることで、合成部34は、欠陥画像21aにポインタP1の左右の領域の画像を合成する。その結果、図5に示す欠陥画像21aは、図6に示すように修復される。 Next, the combining unit 34 combines the peripheral image determined in step S205 with the defect image 21a specified in step S204 (S206). In the case of the above-described example, the combining unit 34 combines the images of the left and right regions of the pointer P1 with the defect image 21a by moving the pointer P1 downward so as to follow the linear defect image 21a. As a result, the defect image 21a shown in FIG. 5 is repaired as shown in FIG.
 次に、利用者によって入力装置70を介して設定画面310の「フォルダ名」及び「ファイル名」が入力され、保存ボタンが押下されると、合成部34は、入力されたフォルダ名及びファイル名に従い、修復された不良品画像21を良品画像22として記憶部20に記憶させる(S207)。 Next, when the “folder name” and “file name” of the setting screen 310 are input by the user via the input device 70 and the save button is pressed, the combining unit 34 displays the input folder name and file name. The restored defective image 21 is stored in the storage unit 20 as a good image 22 (S207).
 ステップS207の後、制御部30は、良品画像生成処理S200を終了する。 (4) After step S207, the control unit 30 ends the non-defective image generation processing S200.
 第1実施例では、不良品画像21において欠陥に対応する欠陥画像21aが1つである例を示したが、これに限定されるものではない。例えば、不良品画像21が複数の欠陥画像21aを含む場合、良品画像生成処理S200において、ステップS203からステップS206までの処理を欠陥画像21aの数だけ繰り返すようにしてもよい。 In the first embodiment, an example is shown in which the defective image 21 has one defect image 21a corresponding to the defect, but the present invention is not limited to this. For example, when the defective image 21 includes a plurality of defective images 21a, the processing from step S203 to step S206 may be repeated by the number of defective images 21a in the non-defective image generation processing S200.
 次に、図7及び図8を参照しつつ、本実施形態に係る画像処理装置100の動作の第2実施例について説明する。図7は、図1に示した画像処理装置100の概略動作の第2実施例を例示するフローチャートである。図8は、図1に示した画像処理装置100の概略動作の第2実施例における周辺画像を例示する図である。 Next, a second example of the operation of the image processing apparatus 100 according to the present embodiment will be described with reference to FIGS. FIG. 7 is a flowchart illustrating a second example of the schematic operation of the image processing apparatus 100 illustrated in FIG. FIG. 8 is a diagram illustrating a peripheral image in a second example of the schematic operation of the image processing apparatus 100 shown in FIG.
 画像処理装置100は、例えば利用者の操作によってプログラムが起動されると、図7に示す良品画像生成処理S250を実行する。第2実施例では、設定画面の「モード」として、「合成」が設定される例を説明する。また、第2実施例において、前述した第1実施例と同一部分については同一符号を付し、その説明を適宜省略する。 The image processing apparatus 100 executes a non-defective image generation process S250 shown in FIG. 7 when the program is started by, for example, a user operation. In the second embodiment, an example will be described in which “synthesis” is set as the “mode” of the setting screen. In the second embodiment, the same parts as those in the above-described first embodiment are denoted by the same reference numerals, and description thereof will be omitted as appropriate.
 ステップS201からステップS204は、前述した第1実施例と同様であるため、その説明を省略する。ステップS204の後、決定部33は、不良品画像21上に周辺ポインタを表示させる(S251)。周辺ポインタは、前述したポインタP1と同様に、広がりを持った領域を指定するためのものである。周辺ポインタは、ポインタP1に対して所定方向の位置に表示される。そのため、周辺ポインタは、ポインタP1とともに移動する。また、周辺ポインタのサイズは、利用者によって入力装置70を介して設定画面310の「ペイント半径」に入力された値に基づいて、設定部31が設定する。これにより、所望の大きさの周辺画像を決定することが可能となる。 Steps S201 to S204 are the same as those in the first embodiment described above, and thus description thereof is omitted. After step S204, the determination unit 33 displays a peripheral pointer on the defective product image 21 (S251). The peripheral pointer is for designating a widened area, similarly to the pointer P1 described above. The peripheral pointer is displayed at a position in a predetermined direction with respect to the pointer P1. Therefore, the peripheral pointer moves together with the pointer P1. The setting unit 31 sets the size of the peripheral pointer based on the value input to “paint radius” on the setting screen 310 via the input device 70 by the user. This makes it possible to determine a peripheral image having a desired size.
 次に、決定部33は、周辺ポインタによって周辺画像を決定する(S252)。例えば、図8に示すように、決定部33は、最初に、周辺ポインタP2をポインタP1の上に表示する((a)参照)。入力装置70を介した利用者の操作、例えばマウスの右クリック等によって、決定部33は、周辺ポインタP2の位置を、ポインタP1の右上((b)参照)、ポインタP1の右((c)参照)、ポインタP1の右下((d)参照)、ポインタP1の下((e)参照)、ポインタP1の左下((f)参照)、ポインタP1の左((g)参照)、ポインタP1の左上((h)参照)、の順に変更する。このように、ポインタP1に対して所定方向の位置に表示される周辺ポインタP2によって周辺画像を決定することにより、欠陥画像21aの周辺において欠陥が存在しない領域の画像を選択することができる。従って、不良品画像21から良品画像22をさらに容易に生成することができる。 Next, the determination unit 33 determines a peripheral image using the peripheral pointer (S252). For example, as shown in FIG. 8, the determining unit 33 first displays the peripheral pointer P2 on the pointer P1 (see (a)). In response to a user operation via the input device 70, for example, a right click of a mouse, the determination unit 33 moves the position of the peripheral pointer P2 to the upper right of the pointer P1 (see (b)) and to the right of the pointer P1 ((c)). Reference), lower right of pointer P1 (see (d)), lower pointer P1 (see (e)), lower left of pointer P1 (see (f)), left of pointer P1 (see (g)), pointer P1 In the upper left (see (h)). As described above, by determining the peripheral image by the peripheral pointer P2 displayed at a position in the predetermined direction with respect to the pointer P1, it is possible to select an image of a region where no defect exists around the defect image 21a. Therefore, the good image 22 can be more easily generated from the defective image 21.
 ステップS252の後に行われるステップS206及びステップS207は、前述した第1実施例と同様であるため、その説明を省略する。 Steps S206 and S207 performed after step S252 are the same as those in the first embodiment described above, and thus description thereof will be omitted.
 以上、本発明の例示的な実施形態について説明した。本発明の一実施形態に係る画像処理装置100、画像処理方法、及び画像処理プログラムによれば、指定された欠陥画像21aに決定された周辺画像が合成される。ここで、欠陥画像21aの周辺には欠陥のない領域の画像が存在すると考えられる。よって、欠陥画像21aの周辺にある欠陥のない領域の画像を周辺画像に決定し、欠陥画像21aに周辺画像を合成することにより、欠陥画像21aを修復することが可能となる。従って、不良品画像21から良品画像22を容易に生成することができる。 The exemplary embodiments of the present invention have been described above. According to the image processing apparatus 100, the image processing method, and the image processing program according to the embodiment of the present invention, the determined peripheral image is combined with the designated defect image 21a. Here, it is considered that an image of a region without a defect exists around the defect image 21a. Therefore, it is possible to repair the defect image 21a by determining an image of a region without a defect around the defect image 21a as the peripheral image and combining the peripheral image with the defect image 21a. Therefore, the good image 22 can be easily generated from the defective image 21.
 以上説明した実施形態は、本発明の理解を容易にするためのものであり、本発明を限定して解釈するためのものではない。実施形態が備える各要素並びにその配置、材料、条件、形状及びサイズ等は、例示したものに限定されるわけではなく適宜変更することができる。また、異なる実施形態で示した構成同士を部分的に置換し又は組み合わせることが可能である。 The embodiments described above are intended to facilitate understanding of the present invention, and are not intended to limit the present invention. The components included in the embodiment and their arrangement, material, condition, shape, size, and the like are not limited to those illustrated, but can be appropriately changed. It is also possible to partially replace or combine the configurations shown in different embodiments.
 (附記)
 1.欠陥を含む不良品を撮影した不良品画像(21)において欠陥に対応する欠陥画像(21a)を指定する指定部(32)と、
 指定された欠陥画像(21a)の周辺に存在する画像から周辺画像を決定する決定部(33)と、
 指定された欠陥画像(21a)に決定された周辺画像を合成する合成部(34)と、を備える、
 画像処理装置(100)。
 6.欠陥を含む不良品を撮影した不良品画像(21)において欠陥に対応する欠陥画像(21a)を指定する指定ステップと、
 指定された欠陥画像(21a)の周辺に存在する画像から周辺画像を決定する決定ステップと、
 指定された欠陥画像(21a)に決定された周辺画像を合成する合成ステップと、を含む、
 画像処理方法。
 11.コンピュータに実行させる画像処理プログラムであって、
 欠陥を含む不良品を撮影した不良品画像(21)において欠陥に対応する欠陥画像(21a)を指定する指定ステップと、
 指定された欠陥画像(21a)の周辺に存在する画像から周辺画像を決定する決定ステップと、
 指定された欠陥画像(21a)に決定された周辺画像を合成する合成ステップと、を含む、
 画像処理プログラム。
(Appendix)
1. A designation unit (32) for designating a defect image (21a) corresponding to a defect in a defective product image (21) obtained by photographing a defective product including a defect;
A determining unit (33) for determining a peripheral image from images existing around the designated defect image (21a);
A combining unit (34) for combining the determined peripheral image with the designated defect image (21a).
Image processing device (100).
6. A designation step of designating a defect image (21a) corresponding to a defect in a defective product image (21) obtained by photographing a defective product including a defect;
A determination step of determining a peripheral image from images existing around the designated defect image (21a);
Synthesizing the determined peripheral image with the designated defect image (21a).
Image processing method.
11. An image processing program to be executed by a computer,
A designation step of designating a defect image (21a) corresponding to a defect in a defective product image (21) obtained by photographing a defective product including a defect;
A determination step of determining a peripheral image from images existing around the designated defect image (21a);
Synthesizing the determined peripheral image with the designated defect image (21a).
Image processing program.
 20…記憶部、21…不良品画像、21a…欠陥画像、22…良品画像、30…制御部、31…設定部、32…指定部、33…決定部、34…合成部、40…バス、50…演算装置、60…撮像装置、70…入力装置、80…出力装置、100…画像処理装置、310…設定画面、CI…中心画像、P1…ポインタ、P2…周辺ポインタ、S200,S250…良品画像生成処理。 Reference numeral 20: storage unit, 21: defective image, 21a: defective image, 22: good image, 30: control unit, 31: setting unit, 32: specifying unit, 33: determining unit, 34: combining unit, 40: bus, 50 arithmetic unit, 60 imaging device, 70 input device, 80 output device, 100 image processing device, 310 setting screen, CI central image, P1 pointer, P2 peripheral pointer, S200, S250 non-defective Image generation processing.

Claims (11)

  1.  欠陥を含む不良品を撮影した不良品画像において前記欠陥に対応する欠陥画像を指定する指定部と、
     前記指定された欠陥画像の周辺に存在する画像から周辺画像を決定する決定部と、
     前記指定された欠陥画像に前記決定された周辺画像を合成する合成部と、を備える、
     画像処理装置。
    A designation unit that designates a defect image corresponding to the defect in a defective product image of a defective product including a defect,
    A determining unit that determines a peripheral image from an image present around the designated defect image;
    A synthesizing unit that synthesizes the determined peripheral image with the specified defect image,
    Image processing device.
  2.  前記指定部は、前記不良品画像上に表示されるポインタによって前記欠陥画像を指定し、
     前記決定部は、前記ポインタの移動方向に基づいて前記周辺画像を決定する、
     請求項1に記載の画像処理装置。
    The specifying unit specifies the defective image by a pointer displayed on the defective image,
    The determining unit determines the peripheral image based on a moving direction of the pointer,
    The image processing device according to claim 1.
  3.  前記決定部は、前記ポインタの移動方向に基づき、かつ、前記不良品画像の中心側の画像から前記周辺画像を決定する、
     請求項2に記載の画像処理装置。
    The determining unit is configured to determine the peripheral image from an image on the center side of the defective image based on a moving direction of the pointer,
    The image processing device according to claim 2.
  4.  前記決定部は、前記不良品画像において前記ポインタに対して所定方向の位置に表示される周辺ポインタによって前記周辺画像を決定する、
     請求項2又は3に記載の画像処理装置。
    The determining unit determines the peripheral image by a peripheral pointer displayed at a position in a predetermined direction with respect to the pointer in the defective product image,
    The image processing device according to claim 2.
  5.  前記周辺ポインタのサイズを設定する設定部をさらに備える、
     請求項4に記載の画像処理装置。
    Further comprising a setting unit for setting the size of the peripheral pointer,
    The image processing device according to claim 4.
  6.  欠陥を含む不良品を撮影した不良品画像において前記欠陥に対応する欠陥画像を指定する指定ステップと、
     前記指定された欠陥画像の周辺に存在する画像から周辺画像を決定する決定ステップと、
     前記指定された欠陥画像に前記決定された周辺画像を合成する合成ステップと、を含む、
     画像処理方法。
    A designation step of designating a defect image corresponding to the defect in a defective product image of a defective product including a defect,
    A determining step of determining a peripheral image from an image present around the specified defect image;
    Synthesizing the determined peripheral image with the specified defect image,
    Image processing method.
  7.  前記指定ステップは、前記不良品画像上に表示されるポインタによって前記欠陥画像を指定することを含み、
     前記決定ステップは、前記ポインタの移動方向に基づいて前記周辺画像を決定することを含む、
     請求項6に記載の画像処理方法。
    The specifying step includes specifying the defective image by a pointer displayed on the defective product image,
    The determining step includes determining the peripheral image based on a moving direction of the pointer,
    The image processing method according to claim 6.
  8.  前記決定ステップは、前記ポインタの移動方向に基づき、かつ、前記不良品画像の中心側の画像から前記周辺画像を決定することを含む、
     請求項7に記載の画像処理方法。
    The determining step is based on a moving direction of the pointer, and includes determining the peripheral image from an image on the center side of the defective image.
    The image processing method according to claim 7.
  9.  前記決定ステップは、前記不良品画像において前記ポインタに対して所定方向の位置に表示される周辺ポインタによって前記周辺画像を決定することを含む、
     請求項7又は8に記載の画像処理方法。
    The determining step includes determining the peripheral image by a peripheral pointer displayed at a position in a predetermined direction with respect to the pointer in the defective product image,
    The image processing method according to claim 7.
  10.  前記周辺ポインタのサイズを設定する設定ステップをさらに含む、
     請求項9に記載の画像処理方法。
    The method further includes a setting step of setting a size of the peripheral pointer,
    The image processing method according to claim 9.
  11.  コンピュータに実行させる画像処理プログラムであって、
     欠陥を含む不良品を撮影した不良品画像において前記欠陥に対応する欠陥画像を指定する指定ステップと、
     前記指定された欠陥画像の周辺に存在する画像から周辺画像を決定する決定ステップと、
     前記指定された欠陥画像に前記決定された周辺画像を合成する合成ステップと、を含む、
     画像処理プログラム。
    An image processing program to be executed by a computer,
    A designation step of designating a defect image corresponding to the defect in a defective product image of a defective product including a defect,
    A determining step of determining a peripheral image from an image present around the specified defect image;
    Synthesizing the determined peripheral image with the specified defect image,
    Image processing program.
PCT/JP2019/024996 2018-07-11 2019-06-24 Image processing device, image processing method and image processing program WO2020012939A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018131534A JP7194348B2 (en) 2018-07-11 2018-07-11 Image processing device, image processing method and image processing program
JP2018-131534 2018-07-11

Publications (1)

Publication Number Publication Date
WO2020012939A1 true WO2020012939A1 (en) 2020-01-16

Family

ID=69143006

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/024996 WO2020012939A1 (en) 2018-07-11 2019-06-24 Image processing device, image processing method and image processing program

Country Status (2)

Country Link
JP (1) JP7194348B2 (en)
WO (1) WO2020012939A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023050857A (en) 2021-09-30 2023-04-11 オムロン株式会社 Image inspection method, and image inspection device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006339875A (en) * 2005-05-31 2006-12-14 Kyocera Mita Corp Image processor
JP2009063685A (en) * 2007-09-05 2009-03-26 Sharp Corp Display method and projector
JP2010197221A (en) * 2009-02-25 2010-09-09 Hitachi High-Technologies Corp Method and device for observing defect

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10150571A (en) * 1996-09-20 1998-06-02 Dainippon Screen Mfg Co Ltd Method, device for correcting defective pixel in digital image and recording medium
WO2001027688A2 (en) 1999-10-08 2001-04-19 Applied Science Fiction, Inc. System and method for correcting defects in digital images through selective fill-in from surrounding areas
JP4251635B2 (en) 2004-06-30 2009-04-08 キヤノン株式会社 Image processing apparatus and method
JP4513962B2 (en) 2005-01-12 2010-07-28 横河電機株式会社 Pseudo defect image creation method and apparatus using the same
JP2013045316A (en) 2011-08-25 2013-03-04 Sanyo Electric Co Ltd Image processing device and image processing method
JP6458569B2 (en) 2015-03-12 2019-01-30 オムロン株式会社 Image processing apparatus and image processing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006339875A (en) * 2005-05-31 2006-12-14 Kyocera Mita Corp Image processor
JP2009063685A (en) * 2007-09-05 2009-03-26 Sharp Corp Display method and projector
JP2010197221A (en) * 2009-02-25 2010-09-09 Hitachi High-Technologies Corp Method and device for observing defect

Also Published As

Publication number Publication date
JP7194348B2 (en) 2022-12-22
JP2020008488A (en) 2020-01-16

Similar Documents

Publication Publication Date Title
US11194993B2 (en) Display apparatus and display control method for displaying images
CN101049008A (en) Image processing apparatus and image processing method
JP2012244337A (en) Image processing apparatus, image processing method, program, and imaging apparatus
JP2007163450A (en) Multiple angle measuring system and method for display
US8698963B1 (en) Projection system and operation method thereof
US11790583B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
JP2006081151A (en) Graphical user interface for keyer
CN111787240B (en) Video generation method, apparatus and computer readable storage medium
WO2020012939A1 (en) Image processing device, image processing method and image processing program
JP2006350936A (en) Image forming device and image forming program
CN108632553B (en) Image processing device, projector, image processing method, and storage medium
JP2006350521A (en) Image forming device and image forming program
JP7154786B2 (en) Image processing device, image processing method and program
JP2006189318A (en) Object image display device
JP2011044094A (en) Display device
JP2006133055A (en) Unevenness defect detection method and device, spatial filter, unevenness defect inspection system, and program for unevenness defect detection method
JP2008176190A (en) Image display device
WO2019054235A1 (en) Information processing device, information processing method, and program
US11762532B2 (en) Image processing device, control method therefor, imaging device, and recording medium
CN113554659B (en) Image processing method, device, electronic equipment, storage medium and display system
US20240233259A1 (en) Information processing apparatus, information processing method, and storage medium
JP6942493B2 (en) Display device and display control method
JP2007026388A (en) Image editing device and image editing program
JP2008250960A (en) Screen position detecting device and screen position detection method
US20130070155A1 (en) Method for displaying on-screen display image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19833018

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19833018

Country of ref document: EP

Kind code of ref document: A1