KR20150106579A - Testing system of the device with free-form surface or 3 dimensional form and operating method for the testing system - Google Patents

Abstract

The present invention discloses an inspecting system which can inspect an object to be inspected having a free-form surface or a three dimensional form in a shot time with flexible inspecting freedom degree and an operating method of the inspecting system. The inspecting system according to the present invention comprises a module for acquiring multiple images, a driving unit and a processor, the operating method of the inspecting system according to the present invention is a method for operating the inspecting system described in fig. 2 and claim 1 and performs the following steps of: setting up inspection conditions; acquiring basic images; acquiring final images and inspecting.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an inspection system for an inspection object having a free-form surface or a three-dimensional shape and a method for operating the inspection system,

The present invention relates to an inspection system, and more particularly, to an inspection system that can be used adaptively to an object to be inspected having a free-form surface or a three-dimensional shape, comprising: a plurality of frames, Module and an operating method for operating the inspection system.

In order to automate the production of a product having a free-form surface or a three-dimensional shape, an inspection automation system (hereinafter referred to as an inspection system) into which an optical system including a camera, a lens and an illumination is introduced is used. Here, a free-form surface is a surface that is expressed as a group of connected surfaces that are difficult to express with a simple expression and meet a condition of constant continuity.

The optical system used in the inspection system generally has a specific image acquisition area (FOV) and a depth of focus (DOF) according to a predetermined specification.

Figure 1 illustrates the image acquisition area and focal depth of the optical system.

Referring to FIG. 1, the meaning of the limited area that can be captured by the camera 110, that is, the image acquisition area (FOV) and the depth of focus (DOF) of the optical system can be known. The difference between Figs. 1 (a) and 1 (b) is due to the difference in curvature of the surface of the object 120 to be inspected.

The distance WD between the optical system and the object to be inspected 120 is determined within a limited area that can be captured by the camera 110 included in the optical system and within a depth at which the focus of the lens is secured. In order to inspect the entire inspection object or a plurality of areas of the inspection object, images of the inspection object are acquired and inspected while moving the optical system or the inspection object continuously or discontinuously.

The production line of a general product simultaneously produces a single product of various shapes or a plurality of kinds of products at the same time. Due to the limited inspection condition of the inspection system, that is, the limit of the degree of freedom of inspection operation and the limit of the flexibility of changing the model of the object to be inspected, It is almost impossible to replace the inspector with a 1: 1 inspection automation system or inspection system.

Particularly, when inspecting a product having a free-form surface or a three-dimensional shape, since the image focusing ability of the optical system included in the inspection system is poor compared to the ability of the human eye to focus in real time, The time required for the inspection increases, which is a great burden to introduce automation.

Industrial optical systems used in the inspection system require a bulky or heavy camera in comparison with popular cameras such as digital cameras due to their specific use purpose, This is a large limitation in minimizing the plant layout.

In general, the following two methods are mainly used for inspecting the entire inspection object.

First, a plurality of cameras are fixedly mounted on the entire area of the object to be inspected. This method is advantageous in that the inspection time is short, but there is a disadvantage in that it can not flexibly cope with each inspection object.

Secondly, a driving unit such as a robot or a stage is provided in the inspection equipment so that the inspection equipment can flexibly cope with the change of the inspection object, thereby enabling the photographing at various positions. This method has a disadvantage in that it can take a long time for inspection although it can flexibly cope with the change of the inspection object.

As described above, when an object to be inspected is intended to be inspected for a product having a free-form surface or a three-dimensional shape, an inspection system capable of quickly inspecting the object while having flexible inspection freedom as described above is required for automating inspection.

An object of the present invention is to provide a multiple image acquisition module in which a plurality of frames each having a plurality of cameras mounted in series are arranged two-dimensionally, so that inspection of a test object having a free-form surface or a three- And to provide an inspection system capable of inspecting flexible inspection freely within the inspection time.

It is another object of the present invention to provide a method of operating the inspection system.

According to an aspect of the present invention, there is provided an inspection system including a multi-image acquisition module, a driver, a signal processor, and a processor. The multiple image acquisition module arranges a plurality of frames in two dimensions, in which at least one panel in which a plurality of cameras are arranged in two dimensions or a plurality of cameras in which a plurality of cameras are mounted in series. The driving unit controls the curvature of each of the plurality of frames or the panel in response to the position control signal. The signal processing unit receives and processes a video signal photographed by the plurality of cameras. The processor generates the position control signal and controls the operation of the signal processing unit.

According to another aspect of the present invention, there is provided a method of operating an inspection system according to the present invention, comprising the steps of: setting inspection conditions, acquiring a basic image, And an inspection step. In the inspection condition setting step, the processor performs the preset curvatures of the panel or the plurality of frames according to the curved surface characteristics of the inspection object. In the basic image acquisition step, the test object is captured using a camera mounted on the multiple image acquisition module to acquire a basic image. In the final image acquisition step, the multiple image acquisition module transmits the base image to the signal processing unit, and the signal processing unit removes the overlapping regions included in the plurality of base images and combines them to generate a final image. In the inspecting step, the processor extracts a region of interest image from the final image, and examines a defect in the region of interest image.

When the inspection object is inspected using the inspection system according to the present invention, the inspection system can be set within a short time even if the object to be inspected is changed into various forms, the time required for the inspection can be shortened, It is possible to minimize the installation space of the inspection system.

Figure 1 illustrates the image acquisition area and focal depth of the optical system.
2 is a block diagram of an inspection system according to the present invention.
Figure 3 shows an embodiment of a multiple image acquisition module in the form of a panel.
Figure 4 shows an embodiment of a multiple array module in the form of a nodal frame.
Figure 5 shows an embodiment of a multiple array module in the form of a continuous frame.
Figure 6 illustrates an example of the use of a multiple image acquisition module in accordance with the present invention.
7 illustrates a method of operating an inspection system according to the present invention.

In order to fully understand the present invention and the operational advantages of the present invention and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings, which are provided for explaining exemplary embodiments of the present invention, and the contents of the accompanying drawings.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

2 is a block diagram of an inspection system according to the present invention.

2, the inspection system 200 includes a multiple image acquisition module 210, a driving unit 220, a signal processing unit 230, and a processor 240.

The multiple image acquiring module 210 arranges a plurality of frames in two dimensions in which at least one panel in which a plurality of cameras are arranged in two dimensions or a plurality of cameras in which a plurality of cameras are mounted in series is arranged. Driver 220 is positioned in response to the control signals (C_ _PO), to control the panel or each of the curvature of the plurality of frames. The signal processing unit 230 receives and processes video signals photographed by a plurality of cameras. Processor 240 generates a position control signal (C_ _PO), to control the operation of the signal processor 230.

Each component will be described in detail below.

First, the multi-image acquisition module will be described.

Figure 3 shows an embodiment of a multiple image acquisition module in the form of a panel.

Figure 4 shows an embodiment of a multiple image acquisition module in the form of a nodal frame.

Figure 5 shows an embodiment of a multiple image acquisition module in the form of a continuous frame.

A plurality of cameras 211 indicated by dotted circle circles are provided on one panel 210 shown in FIG. 3, and a plurality of cameras 211 are installed in each of the frames shown in FIG. 4 and FIG. The location and number of cameras shall be determined by the type of curved surface of the test object and the type of test. And the dotted line in the camera 211 denotes the photographing direction of the camera 211, respectively.

In order to make it easier to compare the embodiments shown in FIGS. 3 to 5, FIG. 3 shows an example in which a total of nine cameras arranged in parallel in a vertical direction and in a horizontal direction, Figs. 4 and 5 illustrate examples in which three cameras are installed in one frame positioned in the horizontal direction and three frames are arranged in parallel in the vertical direction.

As described above, the curvature of the panel and each frame is determined according to the shape of the object 250 to be inspected.

The curved surface characteristic of the object to be inspected 250 is obtained by installing the object to be inspected 250 under the multiple image acquiring module 210 and then using the image captured by the camera 211 installed in the multiple image acquiring module 210, The controller 240 may recognize the surface characteristic of the object to be inspected or examine the curved surface characteristic of the object to be inspected before starting the inspection.

The panel shown in FIG. 3 selects and uses a material having an elastic force in a specific direction. At this time, the driving unit 220 adjusts the curvature of the frame by adjusting the positions of both ends of the panel in the up, down, left, .

Each of the frames shown in FIG. 4 has a coupling structure in which a plurality of connectors 512 are connected at a predetermined angle to a plurality of nodes 511 formed at an intermediate portion. In this case, the driving unit 220 includes a plurality of connectors 512, The curvature of the frames can be adjusted by adjusting the angle at which the curved portions are connected to the plurality of nodes 511. [

Each of the frames shown in FIG. 5 has one integral connection structure having an elastic force in a specific direction. At this time, the driving unit 220 adjusts the positions of both end portions of each frame in the up, down, left, The curvature of the frame can be adjusted.

Figure 6 illustrates an example of the use of a multiple image acquisition module in accordance with the present invention.

6 (a) shows a reference form for convenience of explanation. In this case, the position of the edge of the panel 210 or the frame 210 is represented by two-dimensional coordinates (x1, y1) and (x2, y2) .

6 (b) shows the position of the left edge of the panel 210 or the frame 210 moved by a1 in the x direction, -b1 in the y direction, and the position of the right edge by -a1 And moves by -b1 in the y direction.

6 (c) shows the position of the left edge of the panel 210 or the frame 210 moved by -a2 in the x direction and by b2 in the y direction, while the position of the right edge is shifted by a2 in the x direction And moves in the y direction by b2.

6 (a), 6 (b), 6 (b), 6 (c), 6 (c) 6 (a), it can be seen that the curvature is small. Accordingly, it can be seen that the multiple array module 210 according to the present invention can be adaptively used for the inspection according to the curvature of the object to be inspected by adjusting the positions of both ends of the panel 210 or the frame 210. [

7 illustrates a method of operating an inspection system according to the present invention.

Referring to FIG. 7, an operation method 700 of the inspection system according to the present invention is a method of operating the inspection system 200 shown in FIG. 2, and includes a checking condition setting step 710, a basic image obtaining step 720, A final image acquisition step 730, an inspection step 740, an image synthesis step 750, and a test result image generation step 760 are performed.

The inspection condition setting step 710 is performed by the processor 240 and presets the curvature of the panel or a plurality of frames according to the curved surface characteristics of the inspection object 250. The base image acquisition step 720 captures the test object using the camera 211 mounted on the multiple image acquisition module 210 to acquire a base image. In the final image acquiring step 730, the multiple image acquiring module 210 transmits the basic image to the signal processing unit 230, and the signal processing unit 230 removes the overlapping areas included in the plurality of basic images, Create an image. In an inspection step 740, the processor 240 extracts the ROI image from the final image and checks for defects in the ROI image. In the image synthesis step 750, the processor 240 synthesizes a plurality of ROI images into one ROI image. In the inspection result image generation step 760, the processor 240 combines the inspection results obtained in the inspection step 740 into one image to generate the inspection result image.

Here, the curved surface characteristics of the object to be inspected may be recognized by the processor using the image captured by the camera installed in the multiple image acquisition module after the object to be inspected is installed in the lower part of the multiple image acquisition module, or before the inspection condition setting step The surface characteristics of the object to be inspected are examined and input to the processor 240.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the scope of the present invention.

210: Multiple image acquisition module
211: camera
220:
230: Signal processor
240: Processor

Claims (10)

At least one panel in which a plurality of cameras are arranged in two dimensions or a multiple image acquiring module in which a plurality of frames in which a plurality of cameras are mounted in series are arranged two-dimensionally;
A driver for adjusting the curvature of each of the plurality of frames or the panel in response to the position control signal;
A signal processing unit for receiving and processing a video signal photographed by the plurality of cameras; And
A processor for generating the position control signal and controlling an operation of the signal processing unit;
The inspection system comprising: 2. The apparatus of claim 1, wherein the multi-
Wherein three cameras are connected in series at regular intervals in each frame. 3. The method of claim 2,
Wherein the curvature of the panel and each frame is determined according to the shape of the object to be inspected. The method of claim 3,
The panel has an elastic force in a specific direction,
Wherein the driving unit adjusts the positions of both end portions of the panel in the up, down, left, and right directions to adjust the curvature of the frame. The method of claim 3,
Wherein each of the frames has an integral connection structure having an elastic force in a specific direction,
Wherein the driving unit adjusts the positions of both end portions of the respective frames in the up, down, left, and right directions to adjust the curvature of the frame. The method of claim 3,
Wherein each of the frames has a coupling structure in which a plurality of connectors are connected at a predetermined angle to a plurality of nodes formed in the middle,
Wherein the driving unit adjusts the curvature of the frames by adjusting the angle at which the plurality of connectors are connected to the plurality of nodes.
A method for operating an inspection system according to claim 1,
A test condition setting step of presetting a curvature of the panel or the plurality of frames according to curved surface characteristics of the inspection object performed by the processor;
A basic image acquiring step of acquiring a basic image by photographing the test object using a camera mounted on the multiple image acquiring module;
Wherein the multi-image acquisition module transmits the base image to the signal processing unit, the signal processing unit includes a final image acquisition step of removing a superimposed area included in the plurality of base images and combining the combined images to generate a final image; And
The processor extracting a region of interest image from the final image and examining a defect in the region of interest image;
The inspection system comprising: 8. The method of claim 7,
Wherein the processor further performs an image synthesis step of synthesizing a plurality of ROI images into one ROI image. 9. The method of claim 8,
Wherein the processor further performs a test result image generation step of generating a test result image by combining the test results obtained in the test step with one image. 8. The method of claim 7,
Wherein the inspection object is installed in a lower portion of the multi-image acquiring module and is recognized by the processor using an image taken by a camera installed in the multi-image acquiring module,
Wherein the surface characteristic of the inspection object is inspected before the inspection condition setting step and then inputted to the processor.

Images