KR102615503B1 - Apparatus for outer inspection of inspecting object using line scan camera and color lighting - Google Patents

Abstract

The present invention relates to an apparatus and method for inspecting the external appearance of an inspection object using a line scan camera and color vision, which is installed at a certain distance perpendicular to the direction of movement of the inspection object, has an opening in the center, and is installed on the inspection object. A multi-color ring lighting module that irradiates light with a plurality of different colors inclined at a certain angle in a ring shape on the surface of the object is installed at a certain distance perpendicular to the direction of movement of the subject to be inspected, and is provided in the multi-color ring lighting module. A line scan camera module acquires an image with a two-dimensional image by scanning the upper surface image of the subject in question line by line through the opening, and the light with each color output from the multi-color ring lighting module is directed to the subject. In addition to controlling the operation of the multi-color ring lighting module so that the light of each color output from the multi-color ring lighting module is sequentially irradiated to the subject, the subject is photographed line by line. Controls the operation of the line scan camera module, receives the entire image with the 2-dimensional image of the object being inspected obtained from the line scan camera module, and uses this to separate and separate the 2-dimensional image of the object by color name. After creating a combined image for each color name by overlapping the two-dimensional images of the subject for each color name into one, the combined image for each color name created is compared and analyzed with the preset reference image to combine the color name that is most similar to the reference image. After selecting the image, it includes a control module that controls the appearance inspection of the object to be inspected while irradiated with light having a color corresponding to the selected color name combination image, thereby controlling the color change of the object to be inspected. Appearance inspection can be performed automatically and efficiently on the subject of inspection without changing the color name, and inspection of defects on the subject can be performed more precisely and effectively.

Description

Apparatus for inspecting the appearance of an inspected object using a line scan camera and color lighting {APPARATUS FOR OUTER INSPECTION OF INSPECTING OBJECT USING LINE SCAN CAMERA AND COLOR LIGHTING}

The present invention relates to an apparatus and method for inspecting the appearance of an inspected object using a line scan camera and color lighting.

In general, when manufacturing liquid crystal display (TFT-LCD) panels or substrates for electronic devices such as TVs, PCs, and mobile phones, a resin layer (or sealant) such as silicone or epoxy is used to fix the panel or device and maintain airtightness. Apply.

In addition, if the resin layer is not precisely applied to a certain thickness and width around the edge of the panel in contact with the lower substrate, the fixing force of the panel will be weakened and airtightness will be reduced, which may cause a malfunction during future use. During the process, it is required to check (inspect) for defects.

However, the process of inspecting the quality and defects of the resin layer inevitably requires significant manpower, time, and consequent enormous costs, so each company is making significant efforts to reduce the process and costs.

In other words, it is inefficient for workers to directly check for defects with the naked eye because it not only requires a lot of manpower and work time, but also has limitations in inspection precision and ultimately has a negative impact on the quality and marketability of electronic devices.

To overcome this, we have recently operated an imaging system that determines defects using a CCD (Charge Coupled Device) camera and a computer (PC) that analyzes the images, greatly reducing the time and manpower invested in the resin layer inspection process. By reducing costs and significantly increasing inspection precision, it is helping to some extent to stabilize the quality of electronic devices.

However, due to the transparency of the resin layer, it is not easy to accurately detect, analyze, and determine the appearance of the resin layer using only the image of the CCD camera. Therefore, in most cases, the inspection process is repeated several times or a certain level of defectiveness is unavoidably accepted. .

Meanwhile, domestic patent registration No. 10-1528349 (liquid resin application inspection method), which is a prior art, relates to a method of applying liquid resin to a substrate with a semiconductor chip attached and inspecting the application state, where the liquid resin is applied on the substrate. It is stated that the condition can be inspected more effectively.

However, since this is also a method of inspection using only images or images captured by a camera, the reality is that there are bound to be certain limitations in the reliability of precise analysis of the appearance of the transparent resin layer and determination of defects.

Meanwhile, the back coating test of the display panel was not normally performed, but as bezel-less products have recently become a trend, the importance of the back coating test is being highlighted.

Due to the nature of the display resin back application process, the color of the coating liquid varies depending on the product and process, so when applying lighting of one color, problems often occur when the lighting changes when the product or process is changed.

Domestic registered patent No. 10-1528349 (announced on June 16, 2015)

The present invention was developed to solve the above-mentioned problems. The purpose of the present invention is to scan the surface image of the object in question line by line through a line scan camera module while sequentially irradiating a plurality of color names to the object to be inspected. After acquiring an image with a two-dimensional image, the entire image with the acquired two-dimensional image of the object to be inspected is used to select a two-dimensional image for the optimal color tone and perform an external inspection of the object to be inspected. It is possible to automatically and efficiently inspect the appearance of the object to be inspected without changing the color name according to the color change of the body, and is a line that allows more precise and effective inspection of defects in the object to be inspected. The aim is to provide a device and method for inspecting the appearance of an inspected object using a scan camera and color identification.

In order to achieve the above-mentioned object, the first aspect of the present invention is installed at a certain distance apart perpendicular to the direction of movement of the object to be inspected, has an opening in the center, and is inclined at a certain angle in a ring shape on the surface of the object to be inspected. A multi-color ring lighting module that irradiates light with a plurality of different colors; It is installed at a certain distance perpendicular to the direction of movement of the object to be inspected, and scans the upper surface image of the object to be inspected in line units through the opening provided in the multi-color ring lighting module to obtain a two-dimensional image. Line scan camera module; And controlling the operation of the multi-color ring lighting module so that the light of each color output from the multi-color ring lighting module is sequentially irradiated to the subject to be inspected, and also controls the operation of the multi-color ring lighting module with each color output from the multi-color ring lighting module. The operation of the line scan camera module is controlled so that the subject is photographed in line units while light is sequentially irradiated to the subject, and a two-dimensional image of the subject obtained from the line scan camera module is obtained. After receiving the image and using it to separate two-dimensional images of the subject for each color name, create a combined image for each color name by overlapping the two-dimensional images of the subject for each color name into one, After comparing and analyzing the generated combined image for each color name and a preset reference image to select the color name combined image that is most similar to the reference image, light with a color corresponding to the selected color name combined image is irradiated. The aim is to provide a line scan camera that includes a control module that controls the external appearance of the subject to be inspected and a device for inspecting the external appearance of the subject using color vision.

Here, the multi-color ring lighting module is installed at a certain distance perpendicular to the direction of movement of the subject to be inspected, and has a circular shape that forms an opening in the center and has an inclined surface on the inside extending in the circumferential direction at a certain angle. Or a lighting body having an oval ring shape; A plurality of red LED light-emitting elements are arranged in at least one row at regular intervals in the circumferential direction along the inclined surface provided in the lighting main body and emit red (R) light toward the upper surface and side of the subject to be inspected. red LED lighting unit; A plurality of green LED light-emitting elements are arranged in at least one row at regular intervals in the circumferential direction along the inclined surface provided in the lighting main body and emit green (G) light toward the top and side surfaces of the subject to be inspected. green LED lighting unit; And a plurality of blue LED light-emitting elements arranged in at least one row at regular intervals in the circumferential direction along the inclined surface provided in the lighting main body and emitting blue (B) light toward the top and side surfaces of the subject to be inspected. It is preferable to include a blue LED lighting unit provided.

Preferably, a plurality of white LEDs are arranged in at least one row at regular intervals in the circumferential direction along the inclined surface provided in the lighting main body and emit white (W) light toward the top and side surfaces of the subject to be inspected. A white LED lighting unit equipped with an element may be further included.

Preferably, the red LED lighting unit, the green LED lighting unit, and the blue LED lighting unit may be sequentially arranged at regular intervals in the circumferential direction of the inclined surface provided in the lighting body unit.

Preferably, the object to be inspected may be made of a silicone resin layer or an epoxy resin layer having transparent or translucent characteristics.

Preferably, the object to be inspected is a bonded portion of the TFT substrate of the display panel and the CF (Color Filter) substrate, between the interface of the driver-IC (Integrated Circuit) attached to the TFT substrate of the display panel, and between the driver-IC and the printed circuit. It may be made of a silicone resin layer or an epoxy resin layer with transparent or translucent properties applied to at least one of the bonded interfaces of the substrate (PCB).

Preferably, an object transfer module that seats the object to be inspected and transports it in one direction may be further included.

Preferably, the control module controls the operation of the multi-color ring lighting module so that light with a color corresponding to the selected color name combination image is irradiated, and at the same time, the color corresponding to the selected color name combination image is irradiated. The operation of the line scan camera module is controlled so that the object to be inspected is photographed in line units while the excitation light is irradiated, and the entire image containing the two-dimensional image of the object to be inspected obtained from the line scan camera module is provided. After creating one combined image by overlapping the two-dimensional images of the object to be inspected obtained for each line unit, an external appearance inspection of the object to be inspected can be performed based on the generated combined image.

Preferably, the control module may perform an external appearance inspection of the object to be inspected using a preset rule base-based machine vision algorithm based on the generated single combined image.

Preferably, the preset rule base-based machine vision algorithm includes at least one of pattern matching, point/line/plane fitting, edge, color, and location algorithms. It can be done with one algorithm.

Preferably, when inspecting the appearance of the subject to be inspected, the control module compares the difference between the brightness value of the inspection area to be inspected and the brightness value of the surrounding area for the inspection area to be referenced for inspection, and determines the brightness of the comparison result. An area whose difference value does not fall within a preset reference brightness difference range may be determined as defective.

Preferably, when inspecting the external appearance of the subject to be inspected, the control module compares the difference between the width value of the inspection area to be inspected and the width value of the surrounding area for the inspection area to be referenced for inspection, and the width of the comparison result is Depending on the difference value, the application state of at least one of non-coating, over-coating, disconnection, partial dent, or partial derivation of the subject to be inspected can be inspected and determined.

Preferably, the entire image having a two-dimensional image of the object to be inspected obtained from the line scan camera module, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name generated, and A storage module that stores at least one of the selected color name combination image and the appearance inspection result information of the subject to be inspected may be further included.

Preferably, the control module includes an entire image having a two-dimensional image of the object to be inspected obtained from the line scan camera module, a two-dimensional image of the object to be inspected separated by each color name, and one generated for each color name. The test object separated by each color name, including the entire image with a two-dimensional image for each test object using at least one information of the combined image, the selected color name combined image, and the external inspection result information of the test object. At least one piece of information among the two-dimensional image, one combined image for each color name generated, the selected color name combined image, and the external appearance inspection result information of the subject to be inspected is converted into a database (DB) and stored in the storage module. It can be controlled as much as possible.

Preferably, the entire image having a two-dimensional image of the object to be inspected obtained from the line scan camera module, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name generated, and A display module that displays at least one piece of information among the selected color name combination image and the appearance test result information of the subject to be inspected may be further included on the display screen.

Preferably, the control module includes an entire image having a two-dimensional image of the object to be inspected obtained from the line scan camera module, a two-dimensional image of the object to be inspected separated by each color name, and one for each color name generated. The test object separated by each color name, including the entire image with a two-dimensional image for each test object using at least one information of the combined image, the selected color name combined image, and the external inspection result information of the test object. An operation of the display module to display at least one information of a two-dimensional image, one combined image for each color name generated, a combined image of the selected color name, and external appearance inspection result information of the subject to be inspected on the display screen. You can control it.

Preferably, the entire image having a two-dimensional image of the object to be inspected obtained from the line scan camera module, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name generated, and A communication module that transmits at least one of the selected color name combination image and the external inspection result information of the subject to be inspected through a wired or wireless communication method may be further included.

Preferably, the control module includes an entire image having a two-dimensional image of the object to be inspected obtained from the line scan camera module, a two-dimensional image of the object to be inspected separated by each color name, and one for each color name generated. The operation of the communication module can be controlled so that at least one piece of information among the combined image, the selected color name combined image, and the external inspection result information of the subject to be inspected is transmitted to an external terminal or server through wired or wireless communication. there is.

Preferably, the external terminal or server displays the entire image with a two-dimensional image of the subject being inspected transmitted from the communication module through a pre-installed external appearance inspection-related application of the subject being inspected, as well as the image of the subject being inspected separated by each color name. A full image with a two-dimensional image for each object using at least one of the following information: a two-dimensional image, one combined image for each color name generated above, a combined image of the selected color name, and external appearance test result information of the object to be inspected. Including a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name created above, a combined image of the selected color name, and at least one information of the external inspection result information of the object to be inspected. Services can be provided to be displayed on the display screen.

The second aspect of the present invention is a method of inspecting the appearance of an object to be inspected using a device including a multi-color ring lighting module, a line scan camera module, and a control module, (a) through the multi-color ring lighting module sequentially irradiating light of different colors to the subject to be inspected; (b) Through the line scan camera module, each time light of each color from the multi-color ring lighting module is sequentially irradiated to the object to be inspected in step (a), an image of the upper surface of the object to be inspected is recorded in line units. Obtaining an image having a two-dimensional image by scanning; (c) separating the two-dimensional image of the subject for each color name using the entire image containing the two-dimensional image of the subject obtained in step (b) through the control module; (d) generating a combined image for each color name by overlapping the two-dimensional images of the subject for each color name separated in step (c) into one through the control module; (e) comparing and analyzing the combined image for each color tone generated in step (d) and a preset reference image through the control module to select a color combination image that is most similar to the reference image; and (f) performing an external appearance inspection of the object to be inspected in a state in which light having a color corresponding to the color name combination image selected in step (e) is irradiated through the control module. It provides a method for inspecting the appearance of an inspected object using a line scan camera and color identification.

Here, in step (a), light having any one preset color among lights having red (R), green (G), blue (B), and white (W) is transmitted through the multi-color ring lighting module. Starting with , the remaining lights of different colors are sequentially irradiated to the subject in question in a preset order, but it is desirable to irradiate the light of each color toward the top and side of the subject in a circumferential direction at an incline at a certain angle. .

Preferably, in step (b), when scanning the image of the upper surface of the object to be inspected through the line scan camera module, the upper surface of the object to be inspected is passed through the opening formed in the center of the multi-color ring lighting module in line units. You can scan images.

Preferably, the object to be inspected may be made of a silicone resin layer or an epoxy resin layer having transparent or translucent characteristics.

Preferably, the object to be inspected is a bonded portion of the TFT substrate of the display panel and the CF (Color Filter) substrate, between the interface of the driver-IC (Integrated Circuit) attached to the TFT substrate of the display panel, and between the driver-IC and the printed circuit. It may be made of a silicone resin layer or an epoxy resin layer with transparent or translucent properties applied to at least one of the bonded interfaces of the substrate (PCB).

Preferably, before step (a), a step of transporting the test object in one direction through a test object transport module on which the test object is seated may be further included.

Preferably, step (f) includes (f-1) irradiating light having a color corresponding to the color name combination image selected in step (e) to the subject through the multi-color ring lighting module. ; (f-2) Using the line scan camera module, the upper surface image of the object to be inspected is scanned in line units while colored light is irradiated to the object to be inspected in step (f-1) to create a two-dimensional image. acquiring an image; (f-3) Using the entire image with the two-dimensional image of the object to be inspected obtained in step (f-2) through the control module, overlapping the two-dimensional images of the object to be inspected obtained for each line unit into one. generating a single combined image; and (f-4) performing an external appearance inspection of the subject to be inspected based on the single combined image generated in step (f-3) through the control module.

Preferably, in the step (f-4), the control module uses a preset rule base-based machine vision algorithm based on one combined image generated in the step (f-3) to identify the object to be inspected. Appearance inspection can be performed.

Preferably, the preset rule base-based machine vision algorithm includes at least one of pattern matching, point/line/plane fitting, edge, color, and location algorithms. It can be done with one algorithm.

Preferably, in the step (f-4), when inspecting the appearance of the subject to be inspected through the control module, the difference between the brightness value of the inspection area to be inspected and the brightness value of the surrounding area for the inspection area to be referenced for inspection By comparing, an area in which the brightness difference value of the comparison result does not fall within a preset reference brightness difference range can be determined to be defective.

Preferably, in the step (f-4), when inspecting the external appearance of the object to be inspected through the control module, the difference between the width value of the inspection area to be inspected and the width value of the surrounding area for the inspection area to be referenced for inspection By comparing, it is possible to inspect and determine the application state of at least one of non-coating, over-coating, disconnection, partial dent, or partial derivation of the subject to be inspected according to the width difference value of the comparison result.

Preferably, after step (f), the entire image having a two-dimensional image of the subject obtained in step (b) through the control module, as well as the subject for each color name separated in step (c). A two-dimensional image of the corpse, one combined image for each color name generated in step (d), a combined image of the color name selected in step (e), and the external appearance test of the subject performed in step (f). Using at least one piece of result information, an entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name created, and the selected image. It may further include the step of converting at least one of the color-name combination image and the external inspection result information of the subject into a database (DB) in a separate storage module to store and manage the information.

Preferably, after step (f), the entire image having a two-dimensional image of the subject obtained in step (b) through the control module, as well as the subject for each color name separated in step (c). A two-dimensional image of the corpse, one combined image for each color name generated in step (d), a combined image of the color name selected in step (e), and the external appearance test of the subject performed in step (f). Using at least one piece of result information, an entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name created, and the selected image. The method may further include displaying at least one piece of information among the color-name combination image and the external appearance inspection result information of the subject to be inspected on a display screen of a separate display module.

Preferably, after step (f), the entire image having a two-dimensional image of the subject obtained in step (b) through the control module, as well as the subject for each color name separated in step (c). A two-dimensional image of the corpse, one combined image for each color name generated in step (d), a combined image of the color name selected in step (e), and the external appearance test of the subject performed in step (f). Using at least one piece of result information, an entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name created, and the selected image. The method may further include transmitting at least one of the color-name combination image and the external appearance inspection result information of the subject to be inspected to an external terminal or server through wired or wireless communication.

Preferably, the external terminal or server provides a two-dimensional image of the subject, separated by each color name, as well as an entire image with a two-dimensional image of the subject, transmitted through a pre-installed external appearance inspection-related application of the subject. , using at least one information of one combined image for each color name generated above, the combined image of the selected color name, and the external inspection result information of the corresponding inspected object, including the entire image with a two-dimensional image for each inspected object, A two-dimensional image of the object to be inspected separated by color name, one combined image for each color name created above, a combined image of the selected color name, and external inspection result information of the object to be inspected are displayed on the display screen. We can provide services so that it is displayed.

A third aspect of the present invention provides a computer-readable recording medium recording a program capable of executing the above-described line scan camera and a method for inspecting the appearance of an inspection object using color names.

The method for inspecting the appearance of an inspection object using a line scan camera and color recognition according to the present invention can be implemented as a computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system.

For example, computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, hard disk, floppy disk, removable storage, and non-volatile memory (Flash Memory). , optical data storage devices, etc.

According to the apparatus and method for inspecting the appearance of an object to be inspected using a line scan camera and a color name of the present invention as described above, a plurality of color names are sequentially irradiated to the object to be inspected and then inspected in a line-by-line manner through a line scan camera module. After scanning the surface image of the subject to be inspected to obtain an image with a two-dimensional image, the entire image containing the acquired two-dimensional image of the subject to be inspected is used to select a two-dimensional image for the optimal color brightness to select the image of the subject to be inspected. By performing an external appearance inspection, the appearance inspection of the subject can be performed automatically and efficiently without changing the color name according to the color change of the subject, and the defect inspection of the subject can be more easily performed. It has the advantage of being able to be performed precisely and effectively.

Figure 1 is an overall block diagram illustrating an apparatus for inspecting the appearance of an inspection object using a line scan camera and color names according to an embodiment of the present invention.
Figures 2 and 3 are perspective views to explain the arrangement of the multi-color ring lighting module and line scan camera module applied to one embodiment of the present invention.
Figure 4 is a diagram for explaining an object to be inspected applied to an embodiment of the present invention.
Figures 5 and 6 are overall flowcharts to explain a method for inspecting the appearance of an inspection object using a line scan camera and color names according to an embodiment of the present invention.

The above-mentioned objects, features, and advantages will be described in detail later with reference to the attached drawings, so that those skilled in the art will be able to easily implement the technical idea of the present invention. In describing the present invention, if it is determined that a detailed description of known technologies related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted.

Terms containing ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise.

The terms used in the present invention are general terms that are currently widely used as much as possible while considering the function in the present invention, but this may vary depending on the intention or precedent of a person working in the art, the emergence of new technology, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the relevant invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than simply the name of the term.

When it is said that a part "includes" a certain element throughout the specification, this means that, unless specifically stated to the contrary, it does not exclude other elements but may further include other elements. In addition, terms such as "... unit" and "module" used in the specification refer to a unit that processes at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention illustrated below can be modified into various other forms, and the scope of the present invention is not limited to the embodiments detailed below. Examples of the present invention are provided to more completely explain the present invention to those skilled in the art.

The combination of each block in the attached block diagram and each step in the flow chart may be performed by computer program instructions (execution engine), and these computer program instructions can be installed on a processor of a general-purpose computer, special-purpose computer, or other programmable data processing equipment. Since it can be mounted, the instructions executed through a processor of a computer or other programmable data processing equipment create a means of performing the functions described in each block of the block diagram or each step of the flow diagram. These computer program instructions may also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular manner, so that the computer-usable or computer-readable memory The instructions stored in can also produce manufactured items containing instruction means that perform the functions described in each block of the block diagram or each step of the flow diagram.

In addition, computer program instructions can be mounted on a computer or other programmable data processing equipment, so a series of operation steps are performed on the computer or other programmable data processing equipment to create a process that is executed by the computer and run on the computer or other program. Instructions that perform possible data processing equipment may also provide steps for executing functions described in each block of the block diagram and each step of the flow diagram.

Additionally, each block or each step may represent a module, segment, or portion of code containing one or more executable instructions for executing specified logical functions, and in some alternative embodiments, the blocks or steps referred to in the blocks or steps may represent a portion of code. It should be noted that it is possible for functions to occur out of order. For example, it is possible for two blocks or steps shown in succession to be performed substantially at the same time, and it is also possible for the blocks or steps to be performed in the reverse order of the corresponding functions, if necessary.

Figure 1 is an overall block diagram illustrating an apparatus for inspecting the external appearance of an inspection object using a line scan camera and color code according to an embodiment of the present invention, and Figures 2 and 3 are a multi-block diagram applied to an embodiment of the present invention. It is a perspective view and a cross-sectional view for explaining the arrangement of the color ring lighting module and the line scan camera module, and Figure 4 is a diagram for explaining an object to be inspected applied to an embodiment of the present invention.

Referring to FIGS. 1 to 4, the apparatus for inspecting the appearance of an inspection object using a line scan camera and a color code according to an embodiment of the present invention largely includes a multi-color ring lighting module 100 and a line scan camera module 200. , a control module 300, and a power supply module 400. In addition, the apparatus for inspecting the appearance of an object to be inspected using a line scan camera and a color code according to an embodiment of the present invention includes an object transport module 500, a storage module 600, a communication module 700, and/or a display module. (800) may further be included. Meanwhile, since the components shown in FIGS. 1 to 4 are not essential, the apparatus for inspecting the appearance of an inspection object using a line scan camera and color code according to an embodiment of the present invention has more or fewer components. It may also have components.

Hereinafter, we will look in detail at the components of the apparatus for inspecting the appearance of an inspection object using a line scan camera and color code according to an embodiment of the present invention.

The multi-color ring lighting module 100 is installed at a certain distance perpendicular to the moving direction of the object to be inspected (1), has an opening 111 in the center, and has a ring shape on the surface of the object to be inspected (1). It performs the function of irradiating light with a plurality of different colors at an incline at a certain angle.

As shown in FIGS. 2 and 3, this multi-color ring lighting module 100 largely consists of a lighting body unit 110, a red LED lighting unit 120, a green LED lighting unit 130, and a blue LED lighting unit 140. This may include, etc. In addition, the multi-color ring lighting module 100 applied in one embodiment of the present invention may further include a white LED lighting unit 150, etc. Meanwhile, since the components shown in FIGS. 2 and 3 are not essential, the multi-color ring lighting module 100 applied in an embodiment of the present invention may have more or fewer components than those. .

Here, the lighting main body 110 is installed at a certain distance apart perpendicular to the direction of movement of the object 1 to be inspected, forms an opening 111 in the center, and extends in the circumferential direction inclined at a certain angle on the inside. Preferably, it has a circular or oval ring shape with an inclined surface 112.

The red LED lighting unit 120 is arranged in at least one row at regular intervals in the circumferential direction along the inclined surface 112 provided on the lighting main body 110, and is arranged in at least one row on the upper and side surfaces of the subject 1 (e.g., A plurality of red LED (Light Emitting Diode) light emitting devices 121 that emit red (R) light toward the front, back, left side, and right side are provided.

The green LED lighting unit 130 is arranged in at least one row at regular intervals in the circumferential direction along the inclined surface 112 provided on the lighting main unit 110, and is arranged in at least one row on the top and side surfaces of the subject 1 (e.g., A plurality of green LED light-emitting devices 131 are provided that emit green (G) light toward the front, rear, left side, and right side, etc.

The blue LED lighting unit 140 is arranged in at least one row at regular intervals in the circumferential direction along the inclined surface 112 provided on the lighting main body 110, and is arranged in at least one row on the upper and side surfaces of the subject 1 (e.g., A plurality of blue LED light-emitting devices 141 that emit blue (B) light are provided toward the front, rear, left side, and right side, etc.

Additionally, the white LED lighting unit 150 is arranged in at least one row at regular intervals in the circumferential direction along the inclined surface 112 provided on the lighting main unit 110, and the upper and side surfaces of the subject 1 ( For example, a plurality of white LED light emitting devices 151 that emit white (W) light toward the front, rear, left side, and right side are provided.

Meanwhile, the red LED lighting unit 120, the green LED lighting unit 130, the blue LED lighting unit 140, and/or the white LED lighting unit 150 are located in the circumferential direction of the inclined surface 112 provided in the lighting body unit 100. It is desirable to arrange them sequentially at regular intervals vertically.

On the other hand, the object to be inspected (1) is preferably made of a silicone resin layer and/or an epoxy resin layer with transparent and/or translucent characteristics. For example, as shown in FIG. 4, the object to be inspected (1) in one embodiment of the present invention is the bonded portion (shaded portion) of the TFT substrate and the CF (Color Filter) substrate of the display panel, the display panel. At least between the interface between the driver-IC (Integrated Circuit) attached to the TFT substrate of the (Panel) (shaded portion) and/or between the bonded interface between the driver-IC and the printed circuit board (PCB) (hatched portion). It is preferable that it consists of a silicone resin layer and/or an epoxy resin layer with transparent and/or translucent properties, but is not limited to this, and any resin applied on/under the substrate or panel can be applied. possible.

The line scan camera module 200 is installed at a certain distance perpendicular to the direction of movement of the subject to be inspected (1), and penetrates the opening 111 provided in the multi-color ring lighting module 100 to produce line-by-line signals. It performs the function of acquiring an image with a two-dimensional image by scanning the upper surface image of the object to be inspected (1).

That is, the line scan camera module 200 includes a plurality of red LED lighting units 120, green LED lighting units 130, blue LED lighting units 140, and/or white LED lighting units provided in the multi-color ring lighting module 100. In the state in which one of the LED lighting units in the corresponding order among (150) irradiates light, the imaging surface of the subject (1) is photographed, and the captured line scan image of the subject (1) is transmitted to the control module (300). do.

This line scan camera module 200 does not acquire images on an area basis, but only one line (or several lines), that is, a one-dimensional linear structure CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide). Semiconductor) It is a camera that acquires a two-dimensional image by scanning in line units through an image sensor. In order to generate an image of the subject (1) under inspection by the line scan camera module (200), a line scan camera module is required. (200) Alternatively, the object to be inspected (1) moves at a constant speed, and the entire image of the object to be inspected (1) is created as an image by combining images taken of parts of the object to be inspected (1) at the moment of movement. .

The control module 300 is a module responsible for overall control of the external appearance inspection device of the inspection object using the line scan camera and color name according to an embodiment of the present invention, and in particular, the angle output from the multi-color ring lighting module 100 Controls the operation of the multi-color ring lighting module 100 so that light of color (e.g., red, green, blue, and/or white, etc.) is irradiated sequentially to the subject 1, and multi-color ring lighting is provided. Controlling the operation of the line scan camera module 200 so that the inspected object 1 is photographed line by line while the light of each color output from the module 100 is sequentially irradiated to the inspected object 1. performs its function.

In addition, the control module 300 receives the entire image with a two-dimensional image of the subject 1 obtained from the line scan camera module 200 and uses this to determine 2 images of the subject 1 for each color name. After separating the dimensional images, the separated two-dimensional images of the object 1 for each color name are overlapped into one to create a combined image for each color name.

In addition, the control module 300 performs a function of comparing and analyzing the generated combined image for each color tone and a preset reference image to select a color combination image that is most similar to the reference image.

At this time, the reference image has a color of clear image quality in which the appearance of the inspection object 1 is most clearly visible among the colors reflected from the inspection object 1 by varying the lighting color depending on the color of the inspection object 1. It is desirable to pre-set it to the optimal image.

In addition, the control module 300 performs a control function to perform an external appearance inspection of the object 1 to be inspected in a state in which light having a color corresponding to the selected color name combination image is irradiated.

In addition, the control module 300 controls the operation of the multi-color ring lighting module 100 so that light with a color corresponding to the selected color name combination image is irradiated, and also controls the operation of the multi-color ring lighting module 100 to emit light with a color corresponding to the selected color name combination image. The operation of the line scan camera module 200 is controlled so that the object 1 is photographed in line units while colored light is irradiated, and the object 1 obtained from the line scan camera module 200 is captured. After receiving the entire image with the two-dimensional image of Based on this, it can function to perform an external inspection of the subject to be inspected (1).

In addition, the control module 300 performs a function of performing an external appearance inspection of the object to be inspected (1) using a preset rule base-based machine vision algorithm based on the single combined image generated above. You can.

At this time, the preset rule base-based machine vision algorithm is, for example, pattern matching, point/line/surface fitting, edge, color, and/or position. It is desirable to use at least one of the (Location) algorithms.

In addition, when inspecting the appearance of the subject 1, the control module 300 compares the difference between the brightness value of the inspection area to be inspected and the brightness value of the surrounding area for the inspection area to be referenced for inspection, and performs the comparison. A function may be performed to determine that an area in which the resulting brightness difference value does not fall within a preset reference brightness difference range is defective.

In addition, when inspecting the appearance of the subject 1, the control module 300 compares the difference between the width value of the inspection area to be inspected and the width value of the surrounding area for the inspection area to be referenced for inspection. Depending on the width difference value of the result, the function of inspecting and determining the application state of at least one of non-coating, over-coating, disconnection, partial dent, and/or partial derivation of the subject 1 to be inspected can be performed.

In addition, the control module 300 includes an entire image with a two-dimensional image of the object 1 obtained from the line scan camera module 200, as well as a two-dimensional image of the object 1 separated by each color name. , having a two-dimensional image for each object to be inspected using at least one information of one combined image generated for each color name, the combined image of the selected color name, and/or the external inspection result information of the subject to be inspected (1). A two-dimensional image of the subject (1) separated by each color name, including the entire image, one combined image for each color name created above, a combined image of the selected color name, and/or the subject (1) It is possible to perform a function of controlling at least one of the appearance inspection result information to be converted into a database (DB) and stored in the storage module 600.

In addition, the control module 300 includes an entire image with a two-dimensional image of the object 1 obtained from the line scan camera module 300, as well as a two-dimensional image of the object 1 separated by each color name. , one combined image for each color name generated, the selected color name combined image, and/or the external inspection result information of the subject 1 to be inspected through wired and/or wireless communication method. It can perform the function of controlling the operation of the communication module 700 so that it is transmitted to the terminal 20 and/or server (not shown).

In addition, the control module 300 includes an entire image with a two-dimensional image of the object 1 obtained from the line scan camera module 200, as well as a two-dimensional image of the object 1 separated by each color name. , having a two-dimensional image for each object to be inspected using at least one information of one combined image for each color name generated, the combined image of the selected color name, and/or the external inspection result information of the subject to be inspected (1). A two-dimensional image of the subject (1) separated by each color name, including the entire image, one combined image for each color name created above, a combined image of the selected color name, and/or the subject (1) It may perform a function of controlling the operation of the display module 800 so that at least one piece of information about the appearance inspection results is displayed on the display screen.

Various embodiments described herein may be implemented, for example, in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs). , may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented by control module 300.

According to software implementation, embodiments such as procedures or functions may be implemented with a separate software module that performs at least one function or operation. Software code can be implemented by a software application written in an appropriate programming language. Additionally, the software code can be stored in the storage module 600 and executed by the control module 300.

In addition, the power supply module 400 includes each of the above-described modules, that is, the multi-color ring lighting module 100, the line scan camera module 200, the control module 300, the subject transport module 500, and the storage module ( 600), the communication module 700, and/or the display module 800, etc. perform the function of supplying power required for the operation, and for continuous power supply, a commercial alternating current (AC) power source (e.g., AC 220V or 380V, etc.) is preferably converted to direct current (DC) and/or alternating current (AC) power, but is not limited to this and can also be implemented using a typical portable battery.

Additionally, the power supply module 400 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an ESD (Electro Static Damage) protector, a power detector, a rectifier, and a power breaker.

Here, the ESD protector is configured to protect electrical components from static electricity or sudden power shock. The power detector is configured to send a cut-off signal to the power breaker when a voltage outside the allowable voltage range is introduced, and to transmit a step-up or step-down signal to the rectifier according to voltage changes within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to the signal from the power detector to minimize fluctuations in input voltage and supply a constant voltage. The power breaker is configured to cut off power supplied from the battery according to a cutoff signal transmitted from the power detector.

Additionally, the test subject transport module 500 is connected to the control module 300, and performs the function of seating the test subject 1 and transporting it in one direction under the control of the control module 300. Since this test subject transport module 500 can be applied by selecting a two-dimensional transport device of various structures, including conveyor rollers or conveyor belts that are widely used in the industrial field, the present invention provides specific The description of the structure and its operation will be omitted.

The storage module 600 is connected to the control module 300, and stores the entire image containing the two-dimensional image of the subject 1 obtained from the line scan camera module 200 under the control of the control module 300. Including a two-dimensional image of the subject (1) separated by each color name, one combined image for each color name created above, a combined image of the selected color name, and/or the external appearance test result of the subject (1) It performs the function of storing at least one piece of information.

Additionally, the storage module 600 may perform a function of storing and maintaining at least one program code executed through the control module 300 and at least one data set used by the program code.

These storage modules 600 include, for example, a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (e.g., SD or XD memory). etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), It may include at least one type of storage medium among magnetic memory, magnetic disk, and optical disk.

The communication module 700 is connected to the control module 300 and, under the control of the control module 300, displays the entire image containing the two-dimensional image of the subject 1 obtained from the line scan camera module 200. Including a two-dimensional image of the subject (1) separated by each color name, one combined image for each color name created above, a combined image of the selected color name, and/or the external appearance test result of the subject (1) It performs the function of transmitting at least one piece of information through the communication network 10 through wired and/or wireless communication.

At this time, the communication network 10 is a communication network that is a high-speed backbone network of a large communication network capable of high-capacity, long-distance voice and data services, and includes Wi-Fi, WiGig, and It may be a next-generation wireless communication network including Wireless Broadband Internet (Wibro) and Wimax (World Interoperability for Microwave Access, Wimax).

The Internet includes the TCP/IP protocol and various services existing at its upper layer, such as HTTP (Hyper Text Transfer Protocol), Telnet, FTP (File Transfer Protocol), DNS (Domain Name System), SMTP (Simple Mail Transfer Protocol), It refers to a global open computer network structure that provides SNMP (Simple Network Management Protocol), NFS (Network File Service), NIS (Network Information Service), etc., and the communication module 700 is connected to the external terminal 20 and/or Provides an environment that allows connection to a server (not shown). Meanwhile, the Internet may be wired or wireless Internet, or it may also be a core network integrated with a wired public network, wireless mobile communication network, or portable Internet.

If the communication network 10 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. An example of the asynchronous mobile communication network may be a WCDMA (Wideband Code Division Multiple Access) communication network. In this case, although not shown in the drawing, the mobile communication network may include, for example, a Radio Network Controller (RNC). Meanwhile, although the WCDMA network was used as an example, it may be a next-generation communication network such as a cellular-based 3G network, an LTE network, a 4G network, and a 5G network, and other IP-based IP networks. This communication network 10 serves to mutually transfer signals and data between the communication module 700 and an external terminal 20 and/or server (not shown).

This communication module 800, for example, Bluetooth, ZigBee, Beacon, UWB (Ultra Wideband), RFID (Radio Frequency Identification), and/or infrared, depending on the control of the control module 300. At least one short-distance communication method may be used during (IR) communication.

The display module 800 is connected to the control module 300, and displays the entire image including the two-dimensional image of the subject 1 obtained from the line scan camera module 200 under the control of the control module 300. Including a two-dimensional image of the subject (1) separated by each color name, one combined image for each color name created above, a combined image of the selected color name, and/or the external appearance test result of the subject (1) It performs the function of displaying at least one piece of information on the display screen.

These display modules 800 include, for example, a liquid crystal display (LCD), a light emitting diode (LED), a thin film transistor-liquid crystal display (TFT LCD), and an organic light emitting diode. (Organic Light Emitting Diode, OLED), Flexible Display, Plasma Display Panel (PDP), Alternate Surface Lighting (ALiS), Digital Light Source Processing (DLP), Liquid Crystal of Silicon (LCoS), Surface Conductivity type electron-emitting device display (SED), field emission display (FED), laser TV (quantum dot laser, liquid crystal laser), optoelectric liquid display (FLD), interferometric modulator display (iMoD), thick film dielectric display (TDEL), It may include, but is not limited to, at least one of quantum dot display (QD-LED), telescopic pixel display (TPD), organic light emitting transistor (OLET), laser fluorescent display (LPD), and three-dimensional display (3D display). It can include anything as long as it can display at least one of external image, text, or document data, or can display external image information of the subject 1 to be inspected.

In addition, the external terminal 20 and/or the server includes the entire image with a two-dimensional image of the subject 1 transmitted from the communication module 700 through a pre-installed external appearance inspection-related application. A two-dimensional image of the subject (1) separated by each color name, one combined image for each color name created above, a combined image of the selected color name, and/or the appearance test result information of the subject (1). Using at least one piece of information, an entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object to be inspected (1) separated by each color name, one combined image for each color name created, and the selection It performs a function of providing a service so that at least one information of the color name combination image and/or the appearance inspection result information of the subject 1 is displayed on the display screen.

These external terminals 20 include various mobile terminals that communicate through wireless Internet or mobile Internet, and in addition, Palm PC, Smart phone, Smart Pad, and Smart Note. ), mobile game consoles (Mobile play-stations), DMB (Digital Multimedia Broadcasting) phones with communication functions, tablet PCs, iPads, etc. All wired and wireless home appliances/communications having a user interface for accessing the communication module 700 It can refer to a device comprehensively.

In particular, when the external terminal 20 is implemented as a regular smartphone, the smartphone, unlike a general mobile phone (so-called feature phone), can be freely used by downloading various application programs desired by the user. It is a phone based on an open operating system that can be used and deleted. In addition to commonly used functions such as voice/video calls and Internet data communication, all mobile phones with mobile office functions or Internet without voice call functions are available. It is desirable to understand it as a communication device that includes all accessible Internet phones or tablet PCs.

Below, a method for inspecting the appearance of an inspection object using a line scan camera and color code according to an embodiment of the present invention will be described in detail.

Figures 5 and 6 are overall flowcharts to explain a method for inspecting the appearance of an inspection object using a line scan camera and color names according to an embodiment of the present invention.

Referring to FIGS. 1 to 6, the method for inspecting the appearance of an inspection object using a line scan camera and color chromaticity according to an embodiment of the present invention first uses a multi-color ring lighting module 100 to inspect the appearance of an object with different colors. Light is sequentially irradiated to the subject to be inspected (1) (S100).

At this time, step S100 generates any one preset color among lights having red (R), green (G), blue (B), and/or white (W) through the multi-color ring lighting module 100. Starting with the excitation light, the remaining lights of different colors are sequentially irradiated to the subject (1) in a preset order, and the light of each color is slanted at a certain angle in the circumferential direction to the upper surface and surface of the subject (1). It is desirable to irradiate towards the side.

Thereafter, in step S100, each time light of each color is sequentially irradiated to the subject of inspection (1) from the multi-color ring lighting module (100) through the line scan camera module (200), the subject of inspection is inspected in line units. An image with a two-dimensional image is obtained by scanning the upper surface image of (1) (S200).

At this time, in step S200, when the image of the upper surface of the object 1 to be inspected is scanned through the line scan camera module 200, the line unit passes through the opening 111 formed in the center of the multi-color ring lighting module 100. It is desirable to scan the upper surface image of the subject to be inspected (1).

Then, the two-dimensional image of the subject (1) is separated for each color name using the entire image containing the two-dimensional image of the subject (1) obtained in step S200 through the control module (300). (S300).

Next, the control module 300 overlaps the two-dimensional images of the object 1 for each color name separated in step S300 into one to create a combined image for each color name (S400).

For example, the control module 300 performs a filtering operation to remove image noise on the two-dimensional image of the object 1 for each color tone separated in step S300, and then performs a filtering operation to remove image noise. Image mapping can be performed on the two-dimensional image of the subject (1) for each color name based on the trigger position. Then, one combined image can be created for each color name through arithmetic and logical operations (eg, addition, subtraction, average, difference, OR, AND, etc.) on the mapped images.

Thereafter, the control module 300 compares and analyzes the combined image for each color name generated in step S400 and a preset reference image to select the color combination image that is most similar to the reference image (S500).

Then, an external appearance inspection of the subject 1 is performed through the control module 300 while light having a color corresponding to the color-name combination image selected in step S500 is irradiated (S600).

Additionally, step S600 can be specifically performed as shown in FIG. 6. That is, light having a color corresponding to the color name combination image selected in step S500 is irradiated to the subject 1 through the multi-color ring lighting module 100 (S610).

Afterwards, in the step S610 through the line scan camera module 200, the upper surface image of the object 1 to be inspected is scanned in line units while colored light is irradiated to the object 1 to be inspected, thereby creating a two-dimensional image. Acquire a video with an image (S620).

Then, through the control module 300, a two-dimensional image of the subject 1 obtained for each line is obtained by using the entire image having the 2-dimensional image of the subject 1 obtained in step S620. One combined image is created by overlapping them (S630).

Next, the control module 300 performs an external appearance inspection of the object 1 to be inspected based on the single combined image generated in step S630 (S640).

At this time, in step S640, when inspecting the appearance of the object 1 to be inspected through the control module 300, for example, it may be performed using a machine vision algorithm based on a preset rule base. The machine vision algorithm is a method of deriving a result value for a given input (if-then method), and is a method of inspection according to firm rules, and is a composition of the boundary line and shape of the input object, that is, the subject to be inspected (1). The presence or absence of a crystal is determined by comparing the characteristics of the object such as the characteristics of the already stored reference model.

That is, the preset rule base-based machine vision algorithm is, for example, pattern matching, point/line/surface fitting, edge, color, and/or location algorithm. It is preferable that it consists of at least one algorithm.

In addition, in step S640, as another example, when inspecting the appearance of the inspection object 1 through the control module 300, the brightness value of the inspection area to be inspected and the brightness value of the surrounding area for the inspection area to be referenced for inspection. It is preferable to compare the difference and determine the area in which the brightness difference value of the comparison result does not fall within the preset reference brightness difference range to be defective.

In addition, in step S600, as another example, when inspecting the appearance of the inspection object 1 through the control module 300, the width value of the inspection area to be inspected and the width of the surrounding area for the inspection area to be referenced for inspection are used. By comparing the difference in values, the application state of at least one of uncoated, over-coated, broken, partially dented, and/or partially drawn of the subject (1) is inspected and determined according to the width difference value of the comparison result. You can.

Additionally, although not shown in the drawing, before step S100, a step of transporting the test object 1 in one direction through the test object transfer module 500 on which the test object 1 is seated may be further included. .

Moreover, although not shown in the drawing, after step S600, each image separated in step S300, including the entire image with a two-dimensional image of the subject 1 acquired in step S200 through the control module 300 A two-dimensional image of the subject (1) for each color name, one combined image for each color name generated in step S400, a combined image of the color name selected in step S500, and/or the subject performed in step S600. Using at least one of the appearance test result information in (1), a two-dimensional image of the subject (1) separated by color name, including an entire image with a two-dimensional image for each subject, and each color tone generated above. At least one information of one combined image for each person, the selected color name combined image, and/or the external inspection result information of the subject 1 is stored in a separate storage module 600 in a database (DB) and Additional management steps may be included.

In addition, after step S600, the entire image having a two-dimensional image of the subject 1 obtained in step S200 through the control module 300, as well as the corresponding subject for each color name separated in step S300 ( The two-dimensional image of 1), one combined image for each color name generated in step S400, the color name combined image selected in step S500, and/or the external appearance inspection of the subject (1) performed in step S600. Using at least one piece of result information, an entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object (1) separated for each color name, one combined image for each color name created above, It may further include displaying at least one piece of information among the selected color name combination image and/or the external appearance inspection result information of the corresponding object 1 on the display screen of a separate display module 800.

In addition, after step S600, the entire image having a two-dimensional image of the object 1 obtained in step S200 through the control module 300, as well as the corresponding object for each color name separated in step S300 ( The two-dimensional image of 1), one combined image for each color name generated in step S400, the color name combined image selected in step S500, and/or the external appearance inspection of the subject (1) performed in step S600. Using at least one piece of result information, an entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object (1) separated for each color name, one combined image for each color name created above, At least one of the selected color name combination image and/or the external inspection result information of the subject 1 is sent to the external terminal 20 and/or server through wired and/or wireless communication. A transmitting step may be further included.

At this time, the external terminal 20 and/or the server is the entire image with a two-dimensional image of the subject 1 transmitted through a pre-installed application related to the inspection of the external appearance of the subject 1, as well as the corresponding images separated by each color name. Using at least one of the following information: a two-dimensional image of the object 1 to be inspected, one combined image for each color name generated above, a combined image of the selected color name, and/or external inspection result information of the object 1 to be inspected. Thus, the entire image with a two-dimensional image for each subject, a two-dimensional image of the subject (1) separated by each color name, one combined image for each color name created, a combined image of the selected color name, and /Or, a service may be provided so that at least one piece of information on the appearance test results of the subject to be inspected (1) is displayed on the display screen.

Meanwhile, after step S600 described above, additional steps may be performed sequentially or randomly as needed, or may be performed by arbitrarily changing the order.

On the other hand, the method for inspecting the appearance of an inspection object using a line scan camera and color recognition according to an embodiment of the present invention can also be implemented as a computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system.

For example, computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, hard disk, floppy disk, removable storage, and non-volatile memory (Flash Memory). , optical data storage devices, etc.

Additionally, the computer-readable recording medium can be distributed to a computer system connected through a computer communication network, and stored and executed as code that can be read in a distributed manner.

Although the above-described preferred embodiments of the apparatus and method for inspecting the external appearance of an inspection object using a line scan camera and a color code according to the present invention have been described, the present invention is not limited thereto and includes the scope of the patent claims and the detailed description and description of the invention. It is possible to implement various modifications within the scope of the attached drawings, and these also belong to the present invention.

100: lighting module,
200: Line scan camera module,
300: control module,
400: power supply module,
500: Test object transport module,
600: storage module,
700: communication module,
800: Display module

Claims (10)

A multi-color ring light that is installed at a certain distance perpendicular to the direction of movement of the object to be inspected, has an opening in the center, and irradiates light with a plurality of different colors at a certain angle in a ring shape on the surface of the object to be inspected. module;
It is installed at a certain distance perpendicular to the direction of movement of the object to be inspected, and scans the upper surface image of the object to be inspected in line units through the opening provided in the multi-color ring lighting module to obtain a two-dimensional image. Line scan camera module;
The operation of the multi-color ring lighting module is controlled so that the light of each color output from the multi-color ring lighting module is irradiated sequentially to the subject under inspection, and the light of each color output from the multi-color ring lighting module is controlled. The operation of the line scan camera module is controlled so that the subject is photographed in line units while the subject is sequentially irradiated, and the entire image with a two-dimensional image of the subject is obtained from the line scan camera module. is provided and is used to separate a two-dimensional image of the subject for each color name, and to create a combined image for each color name by overlapping the separated two-dimensional images of the subject for each color name into one. After comparing and analyzing the generated combined image for each color name and the preset reference image to select the color name combined image that is most similar to the reference image, the color name combined image is irradiated with light corresponding to the selected color name combined image. A control module that controls the external appearance inspection of the object to be inspected;
The entire image with the two-dimensional image of the subject being inspected obtained from the line scan camera module, as well as the two-dimensional image of the subject being inspected separated by each color name, one combined image for each color name generated, and the selected color tone. a storage module that stores at least one information of a name combination image and appearance test result information of the subject to be inspected;
The entire image with the two-dimensional image of the subject being inspected obtained from the line scan camera module, as well as the two-dimensional image of the subject being inspected separated by each color name, one combined image for each color name generated, and the selected color tone. A display module that displays at least one information of a name combination image and appearance test result information of the subject to be inspected on a display screen; and
The entire image with the two-dimensional image of the subject being inspected obtained from the line scan camera module, as well as the two-dimensional image of the subject being inspected separated by each color name, one combined image for each color name generated, and the selected color tone. It includes a communication module that transmits at least one of the name combination image and the external inspection result information of the subject to be inspected through a wired or wireless communication method,
The multi-color ring lighting module is installed at a certain distance perpendicular to the direction of movement of the subject to be inspected, and has a circular or oval shape that forms an opening in the center and has an inclined surface on the inside extending in the circumferential direction at a certain angle. a lighting body having a ring shape, and arranged in at least one row at regular intervals in the circumferential direction along an inclined surface provided in the lighting body, emitting red (R) light toward the upper surface and side of the object to be inspected. A red LED lighting unit equipped with a plurality of red LED light-emitting elements emitting red light, arranged in at least one row at regular intervals in the circumferential direction along an inclined surface provided in the lighting main unit, and emitting green light toward the upper and side surfaces of the subject to be inspected. (G) A green LED lighting unit equipped with a plurality of green LED light-emitting elements emitting light, and arranged in at least one row at regular intervals in the circumferential direction along an inclined surface provided in the lighting main unit, A blue LED lighting unit equipped with a plurality of blue LED light-emitting elements that emit blue (B) light toward the top and side surfaces, and arranged in at least one row at regular intervals in the circumferential direction along an inclined surface provided in the lighting main unit. It includes a white LED lighting unit equipped with a plurality of white LED light-emitting elements that emit white (W) light toward the upper surface and side of the subject, wherein the red LED lighting unit, the green LED lighting unit, and the blue LED The lighting units are sequentially arranged at regular intervals perpendicular to the circumferential direction of the inclined surface provided in the lighting main unit,
The object to be inspected is the bonded portion of the TFT substrate of the display panel and the CF (Color Filter) substrate, the interface between the driver-IC (Integrated Circuit) attached to the TFT substrate of the display panel, and the interface between the driver-IC and the printed circuit board (PCB). ) is composed of a silicone resin layer or an epoxy resin layer with transparent or translucent properties applied to at least one of the bonded interfaces,
The control module controls the operation of the multi-color ring lighting module so that light with a color corresponding to the selected color name combination image is irradiated, and at the same time, light with a color corresponding to the selected color name combination image is irradiated. In the irradiated state, the operation of the line scan camera module is controlled so that the subject to be inspected is photographed line by line, and the entire image containing the two-dimensional image of the subject to be inspected obtained from the line scan camera module is provided and used for each subject. After creating one combined image by overlapping the two-dimensional images of the object to be inspected obtained for each line unit, the object to be inspected is generated using a preset rule base-based machine vision algorithm based on the created combined image. Perform an external appearance inspection, and when inspecting the external appearance of the subject, compare the difference between the width value of the inspection area to be inspected and the width value of the surrounding area for the inspection area to be referenced for inspection, and compare the width value of the comparison result. Depending on the value, the application status of at least one of the following: non-coating, over-coating, breakage, partial dent, or partial derivation of the object to be inspected is inspected and determined, and a two-dimensional image of the object to be inspected obtained from the line scan camera module is inspected and determined. At least one of the entire image, a two-dimensional image of the object to be inspected separated by each color name, one combined image generated for each color name, a combined image of the selected color name, and external appearance inspection result information of the object to be inspected. Using the information, the entire image with a two-dimensional image for each object to be inspected, a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name created above, a combined image of the selected color name, and At least one piece of information on the appearance test results of the object to be inspected is converted into a database (DB) and controlled to be stored in the storage module, including the entire image with a two-dimensional image of the object to be inspected obtained from the line scan camera module. Using at least one of the following information: a two-dimensional image of the object to be inspected separated by each color name, one combined image for each color name created above, the combined image of the selected color name, and the external inspection result information of the object to be inspected. A two-dimensional image of the subject being inspected separated by each color name, including an entire image with a two-dimensional image for each subject, one combined image for each color name created above, a combined image of the selected color name, and the image of the subject being inspected. Controls the operation of the display module so that at least one piece of appearance inspection result information is displayed on the display screen, and separates the entire image with a two-dimensional image of the object obtained from the line scan camera module, as well as each color name. At least one piece of information among the two-dimensional image of the object to be inspected, one combined image for each color name generated above, the combined image of the selected color name, and the external inspection result information of the object to be inspected is externally transmitted through wired or wireless communication. Controls the operation of the communication module so that it is transmitted to the terminal or server of
The preset rule base-based machine vision algorithm is at least one of pattern matching, point/line/surface fitting, edge, color, and location algorithms. It comes true,
The external terminal or server displays a two-dimensional image of the subject, separated by each color name, including the entire image with a two-dimensional image of the subject, transmitted from the communication module through a pre-installed external appearance inspection-related application. , using at least one information of one combined image for each color name generated above, the combined image of the selected color name, and the external inspection result information of the corresponding inspected object, including the entire image with a two-dimensional image for each inspected object, A two-dimensional image of the object to be inspected separated by color name, one combined image for each color name created above, a combined image of the selected color name, and external inspection result information of the object to be inspected are displayed on the display screen. A line scan camera that provides a display service and a device for inspecting the appearance of an inspected object using a color code. delete delete delete delete delete delete delete delete delete

Images