KR101741767B1

KR101741767B1 - Scan method using camera for warper

Info

Publication number: KR101741767B1
Application number: KR1020150101040A
Authority: KR
Inventors: 조웅희; 김인중; 김수경
Original assignee: 조웅희
Priority date: 2015-07-16
Filing date: 2015-07-16
Publication date: 2017-05-30
Also published as: KR20170009273A

Abstract

The method of scanning scenes using a camera according to the present invention includes the steps of the device control unit 130 receiving a video image from the camera control unit 120; Controlling the contrast of the input image by the device controller 130; The device controller 130 may detect a boundary line in the light and dark image; The device control unit 130 removes noise from a border image and calculates a morphology; Wherein the device controller 130 removes the overlapping points from the borderless image from which the noise is removed and performs sharpening. The step of controlling the contrast includes adjusting the height of the ROI image to 100 pixels Organizing; Constructing a minimum rectangle region (MRR) divided by 100 pixels from the left pixel 0 to the last pixel n; And adjusting the contrast for each minimum right angle region (MRR).
According to the canonical scanning method using the camera of the present invention, by using a camera, it is possible to monitor a cutout (breakage of a thread) or a change in thread bend (wrapping a thread on a beam) and a change in thread thickness , It is possible to fundamentally block the process errors that may occur in the future, and significantly improve the quality of the company.

Description

{SCAN METHOD USING CAMERA FOR WARPER}

The present invention relates to a canonical scanning system using a camera. More particularly, the present invention relates to a canonical scanning system using a camera. More particularly, the present invention relates to a canonical scanning system using a camera, And more particularly, to a scanning method of a canonical process using a camera that monitors the operation of the canonical camera to prevent a process error that may occur in the future, and improves the quality of the canon image.

Generally, a fabric is a cloth that is woven in a flat manner by crossing a weaving yarn (weft yarn, picks or warp yarns) and a warp yarn (ends or warp yarns) at right angles, A preparation weaving process for preparing a warp and weft after obtaining a processed yarn from an original yarn, a weaving process for obtaining a fabric from warp and weft yarns, And can be subdivided into a dyeing finishing process.

The weaving preparation process includes a winding step of rewinding the yarn in the form of a bobbin or a cone and a step of loosening the yarn from the plurality of bobbins or cones to match the length, width and density conditions. And a warping step of winding the warp yarn or the warp yarn around the warp's beam with a uniform tension after arranging them in parallel with each other.

On the other hand, in order to detect the cutting (cutting of yarn), the bending of the yarn (the yarn leaning on the beam), and the change in the yarn thickness, the image inspection system using a camera is required Do.

That is, a thin thread continuously arranged at narrow intervals is acquired as a camera image, and a boundary line of each thread is obtained using a canny boundary detector. If a first derivative is taken as a specific direction component, The right border image can be obtained.

As shown in FIG. 1, in the Korean Patent Registration No. 10-0605027, regarding the image inspection method, "the angle of view of the camera according to the relative moving direction of the camera is divided into the same number of split angle of view A light source specifying step of specifying each of the plurality of light sources to operate in correspondence with the angle of each division angle; and a light source specifying step of, when the inspection object is located within each of the divided angles of view, And an image acquiring step of acquiring an image of the object to be inspected by the light source by turning on a light source specified to be operated in accordance with the divided angle of view at which the object to be inspected is located, Lt; / RTI >

Regarding the regulation apparatus, in Korean Patent Registration No. 10-1007731, as shown in FIG. 2, there are provided a crick unit in which a plurality of yarn bobbins are mounted, and a yarn wound around the yarn bobbins is taken out; A regular separator including a main separator for aligning the yarns drawn out from the crill part so as to have a constant interval and guiding the yarns to the beam; And a beam portion that winds the yarn guided by the diameter portion, wherein the beam portion includes: a beam that is rotated by a motor and into which a yarn is wound; a yarn formed in the beam and first guided by the diameter portion is inserted; A groove formed in a bottom surface of the base plate along a longitudinal direction thereof and having an insertion groove formed along the longitudinal direction of the beam; And a yarn fixing means formed in a bar shape to be fitted in the groove and having an auxiliary separator arranged in the insertion groove and having the yarns guided by the main separator arranged at regular intervals, .

However, in order to improve the quality of Jung Kyung Co., the quality of the commercialized quality inspection equipments is expensive, maintenance cost is high, and the applicable range is limited for the equipment using the laser detector. There is a problem in that a lot of it falls.

KR 10-0605027 B1 KR 10-1007731 B1

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a high-speed camera for realizing a high- The present invention provides a canonical scanning method using a camera that can effectively cope with the occurrence of defects by confirming whether or not an abnormality has occurred,

In order to achieve the above-mentioned object, a canonical scanning method using a camera according to the present invention includes: a camera for acquiring a continuous image of a fast moving image in real time; a camera for receiving a real-time continuous image of a fast moving still image obtained from the camera; And a device controlling the external control device including the display device, the beacon light and the positive game relay after reading the defect through the preprocessing and feature extraction step of the video image from the real-time continuous video image outputted from the camera control part, And a control unit for controlling the operation of the display unit based on a control signal generated from the device control unit according to a defect detected by the camera control unit, A lightning And a positive game relay operated to adjust an operation of a regular game according to an electric signal generated from the camera controller, the method comprising the steps of:
Receiving a video image from the camera controller; Controlling contrast of the input image by the device controller; Wherein the device control unit comprises: detecting a boundary line in a brightness-adjusted image; Removing the noise from the border line image and calculating a morphology; Wherein the device control unit removes overlapping points from the borderless image from which the noise has been removed, thereby reducing the contrast. The Contrast Control step includes arranging the height of the ROI image at 100 pixels ; Constructing a minimum rectangle region (MRR) divided by 100 pixels from the left pixel 0 to the last pixel n; And adjusting the contrast for each minimum right angle region (MRR).
The step of detecting the boundary may include: selecting only the x-direction differential value of the desired room; Calculating a differential value, constructing a first image by obtaining a left boundary line of the corresponding room if the x-direction primary differential value is positive; and obtaining a right boundary line of the corresponding room if the x-direction primary differential value is a negative number, and constructing a second image, wherein the step of removing noise from the boundary image and calculating the blooming process comprises: A step of performing dilate convolution of vertically consecutive pixels of the left boundary line image obtained in the constructing step and the right boundary line image obtained in the step of constructing the second image, and a step of applying Erode Convolution And partially removing the noise.
And removing the overlapping points from the borderline image, the step of moving the pixels from the 0th row to the nth row to the left borderline image and the right borderline image obtained in the borderline detection process, And expressing consecutive vertical lines in which pixels are connected to each other in the direction of the row with respect to the left borderline image and the right borderline image by one vertical line through close correlation calculation, A first step of processing the image according to a canine boundary detection algorithm to obtain a left boundary image and a right boundary image; A second step of removing the discontinuity line from the left / right boundary line image, respectively; A third step of subjecting the left / right boundary line image from which the discontinuity line is removed to an arithmetic operation to obtain a left discontinuity and a right discontinuity; A fourth step of analyzing a close association between the left single line and the right single line; And synthesizing the left cut line and the right cut line according to the analysis result and outputting the final cut line image.

delete

Therefore, according to the canonical scanning system and the scanning method using the camera of the present invention configured as described above, by using a camera, it is possible to reduce the number of cuts (thread breakage) ) And the change of the thread thickness can be monitored. Thus, it is possible to fundamentally block the process errors that may occur in the future, and to significantly improve the quality of the screen maker.

1 is a flow chart showing a method of inspecting an image by image acquisition during movement of an inspection object according to the related art,
2 is a view showing a canonical apparatus according to the prior art,
FIG. 3 is a schematic view showing a canonical scanning system using cameras according to the present invention,
4 is a flowchart illustrating a video image processing procedure according to a canonical scanning system using a camera of the present invention.
FIG. 5 is a block diagram illustrating a process of setting a region of interest with respect to a raw image input to a camera in the scanning system of the regularity process of the present invention,
6 shows an example of a contrast adjustment effect profile and a contrast adjusted image,
7, (a) shows an application example of an algorithm for boundary line detection, (b) shows an example of boundary line detection image,
8, (a) is a schematic diagram illustrating a noise reduction and morphology calculation process, and (b) is an example of an image obtained through a noise reduction and morphology calculation.
9 shows an example of an image according to a duplicate point removal operation,
FIG. 10 shows an example of an image obtained through the process of linearization of a vertical line,
Fig. 11 is a flow chart showing the steps of the truncation reading and the fine truncation reading,
FIG. 12 is a schematic view showing arrangement of equipment considering various variables in the scan system of the present invention,
Figure 13 is a schematic diagram illustrating various embodiments in which one or more cameras are disposed above the inspection area;

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features, and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings. The following examples are merely illustrative of the present invention and are not intended to limit the scope of the present invention.

FIG. 3 is a schematic view showing a regular scanning system using cameras according to the present invention installed around a fixed game, FIG. 12 is a schematic diagram showing the arrangement of equipment considering various variables in the scanning system of the present invention, 13 is a schematic diagram showing various embodiments in which one or more cameras are disposed above the inspection area.

3 and 12, a canonical scanning system 100 using a camera according to the present invention includes a camera 110 for acquiring a video image of a high-speed moving image scanner in real time, a CPU 121, The camera control unit 120 receives the real-time continuous image of the fast moving still image data obtained from the camera control unit 110, and a preprocessing and feature extraction step of the image image from the real-time continuous image image output from the camera control unit 120, A device control unit 130 for controlling an external control device including the display device 140, the beacon light 150, and the game relay 160 after the reading process, A display device 140 for outputting the result in real time so that the result can be confirmed, and a device controller 140 for controlling the device 121 according to a defect detected by the CPU 121 of the camera control unit 120 And a game relay (160) operated to adjust an operation of a game (Wa) according to an electric signal generated from a CPU (121) of the camera control unit (120) .

3 and 12, the camera 110 is installed in the upper direction of the regular game Wa, and the inspection area (inspection area) (Corresponding to W in Fig. 12), and is a technique for real-time monitoring and quality inspection of fast-running warp yarns fed at a high speed, and monitoring a change in warp yarns, warp yarns, yarn thickness, It is a component that can acquire a video signal so that it can send and respond appropriately.

At this time, the camera 110 includes an imaging device that can convert a video image incident through a lens into an electric signal.

The solid-state image pickup device (FIXED FOCAL LENS LENS) is an image pickup device in which a video signal is read by a semiconductor scanning circuit. The light-receiving portion receives a signal charge by incident light And accumulates a plurality of pixels.

In addition, there is a LINEAR sensor in which pixels are read in a predetermined order via a switching tester, signal light accumulated in each pixel is smaller in size and weight than a vacuum type image pickup device such as an image pickup tube, and has excellent durability and operability. , There is a two-dimensional AREA sensor. It is widely used in various fields such as office cameras, home video cameras, office equipment, medical and business, and it is mainstream to use low-noise CCD as a scanning circuit.

3, the camera control unit 120 includes an autofocus optical system control unit, and optimizes the method of illuminating the LC light source, It is a component that is operated to output the final image by preprocessing low level image data.

At this time, the image generated by the camera controller 120 is input to a separate CPU 121.

In the canonical scanning system 100 using the camera of the present invention, the device control unit 130 receives a signal output from the CPU 121, performs image preprocessing, extracts features, Defective / defective / defective V grooves.

Accordingly, the display device 140, the beacon light 150, and the game relay 160 are operated as the device control unit 130 is operated.

That is, when the device control unit 130 is operated to read defects such as cut / warp curves / normal V grooves, the warning light 150 is activated by a control signal so that a worker in the field can take necessary emergency measures And the game relay 160 is operated according to an electric signal generated from the CPU 121 of the camera controller 120 so that the operation of the game Wa can be adjusted.

According to the display device 140, the user can set a condition by utilizing the CPU 121 of the camera control unit 120, and can visually confirm the operation process and its result in real time So that it is displayed on the display screen.

12, the inspection area (w) and the inspection height (L) are displayed as shown in the figure according to the size (width: length, h) of the image sensor as an image pickup element mounted on the camera and the focus (f) The inspection area and the inspection height can be appropriately selected depending on the specification of the sensor and the type of the lens.

More specifically, as shown in FIG. 13, one or more cameras 110 may be installed above the inspection area. Depending on the size of the inspection area, one camera 110 may be installed, and two cameras 110 -1, and 110-2 may be provided, and three cameras 110-1, 110-2, and 110-3 may be installed, which can be determined depending on the size of the inspection area.

FIG. 4 is a flowchart illustrating a video image processing procedure according to a canonical scanning system using a camera according to the present invention. FIG. 5 is a flowchart illustrating a scan process of a canonical process according to an exemplary embodiment of the present invention. FIG. 11 is a flowchart illustrating a process of reading out a thin image and reading a thin image. FIG.

7 is an example of an application of an algorithm for boundary line detection, FIG. 8 (b) is an example of a boundary line detection image, and FIG. 8 (A) is a schematic diagram illustrating a noise reduction and morphology calculation process, and (b) is an example of an image obtained through a noise reduction and morphology calculation.

9 is an example of an image according to a duplicated point elimination operation, and FIG. 10 is an example of an image subjected to a line segmentation process of a vertical line.

4 to 11, the image processing procedure according to the canonical scanning system 100 using the camera of the present invention includes an image image input step S810; Contrast Control step S820; A boundary detection step (S830); Noise reduction and morphology operation step S840; A duplicate point removal operation step (S850); And a linear line generation step (S860).

The truncation readout and thin thread readout procedure according to the canonical scanning system 100 using the camera of the present invention sequentially generates the intensities of intensity 255 from the pixel row 0 to the last row in the center row of the generated left boundary line image (S1510) in which the current strand count is calculated by counting the number of times the pixel of the pixel is counted; A step S1520 of judging the cut-off if the number is smaller than the initially set number of strands, and a step S1530 of judging whether a thin thread has occurred when there is no abnormality.

Here, a process of inputting a video image for processing a video image using a camera scanning system using the camera of the present invention will be described. A raw video input to the camera 110 includes a wide area image, The region to be used for is partly referred to as the region of interest (ROI).

In the present invention, if the region of interest is initially set, it can be effectively used until the next resetting.

At this time, the size of the area of interest should be minimized within a range that can be analyzed, so that the speed (frame / sec) of the image transmitted per second can be maximized.

In addition, it is possible to increase the accuracy of the calculation required for the contrast adjustment, which is the next procedure, and to minimize the time required for the calculation.

An image generated by setting the region of interest of the initial input image is as shown in FIG.

A brief description of the contrast adjustment process for a video image using a canonical scanning system using a camera according to the present invention is as follows. A video image captured as a region of interest is changed into a more distinct image through contrast adjustment.

When numbers are assigned from the left pixel 0 to the last pixel n, the pixels located at the center are relatively different in contrast due to differences in illumination, but the difference in contrast between adjacent pixels becomes weaker toward the left and right ends.

Therefore, it is difficult to obtain a greatly improved image if the entire image is subjected to a contrast adjustment operation.

Therefore, a minimum rectangular region (MRR) is constructed by rearranging the region of interest image to a height of h = 100 pixels, dividing the pixels from the left pixel 0 to the last pixel n by 100 pixels, When the contrast is adjusted for MRR, the distribution of light in each region becomes similar, so that a maximum contrast adjustment effect can be obtained, and a homogeneous new image is formed by matching the same.

An example of the contrast adjustment effect profile and the contrast adjustment image is as shown in FIG.

In addition, when a boundary line is detected by applying a Canny edge detector (Canny edge detector) algorithm as a background technique, a boundary line detection process utilizing a camera scanning scan system using the camera of the present invention is briefly described. And if the change is small, only one boundary line is created, which results in undesirable results.

Therefore, in the present invention, the boundary line of the thick yarn is obtained through the following steps, and it is judged whether the value is valid or not.

That is, ① take only the directional differential value of the desired thread.

② When calculation of derivative value, the first left image is obtained by obtaining the corresponding left boundary line only when the direction primary differential value is positive.

③ Then, only when the first direction differential value is negative, the corresponding boundary line is obtained and the second image is obtained.

(4) The two images obtained through this process are applied to the following computation procedures, respectively, and finally used for truncation and thin thread reading.

Here, in Fig. 7, (a) shows an example of application of an algorithm for detecting a boundary, and Fig. 7 (b) shows an example of a boundary detection image.

In addition, the noise removal and morphology calculation process utilizing the canonical scanning system using the camera of the present invention is applied to the left side border image and the right side border image obtained in the above process, respectively.

At this time, when acquiring the initial image, there may be a case where a noise area unintentionally buried in the back background occurs, or a white area and a black area may be obtained wider or narrower than intended.

In this case, the vertically consecutive pixels are dilated to a wider range, and then Erode Convolution is applied to narrow the pixels to effectively remove the partial noise.

In addition, erosion mask and expansion mask size determination

The proper specification of the mask used in the operation is related to the slope of the yarns being conveyed.

② Apply square mask of vertical 1 pixel with vertical line shape.

A schematic diagram illustrating the noise elimination and morphology calculation process is shown in FIG. 8A, and an example of the image subjected to the noise elimination and morphology calculation is shown in FIG. 8B.

In addition, a duplicate point elimination calculation process using a canonical scanning system utilizing the camera of the present invention is briefly described. The left and the right border images obtained by the above process are respectively applied equally to each other. Due to the tilt angle of each room, the image will show overlapping pixels on the vertical line.

A preprocessing step for creating a linear line, in which each pixel is traversed horizontally from the 0th column to the nth column, and all 255 consecutive pixels are removed.

Here, an example of the image according to the duplicate point removal operation is as shown in FIG.

The vertical line cutting process using the camera of the present invention will be described briefly. The vertical lines connecting the pixels in the direction of the row of the image are connected to each other through a vertical line Express.

Here, an example of an image subjected to the process of linearization of a vertical line is shown in FIG.

11, the left edge boundary line line image of the generated image is scanned from the 0th row pixel to the left edge pixel of the center line of the generated left boundary line line image. The current number of strands is calculated by counting the number of times the pixel of intensity 255 is sequentially displayed sequentially to the line.

Then, if the number is smaller than the initial number of strands, "cut" is read.

Then, if there is no abnormality, it is read whether or not a 'thin thread' has occurred.

According to the canonical scanning system and the scanning method using the camera according to the embodiment of the present invention configured as described above, by utilizing the camera 110, it is possible to reduce the number of cuts (broken yarn) It is possible to observe a change in the thread thickness and to observe a process error that may occur in the future in advance to fundamentally cut off the quality of the film and to improve the quality of the film.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the invention.

100: Scene scanning system using camera
110: camera
120: camera control unit
121: CPU
130:
140: Display device
150: warning light
160: regular game relay
Wa: Jeong-kyung

Claims

delete

A camera control unit 120 for receiving a real-time continuous image of the fast moving still image obtained from the camera 110, a camera controller 120 for controlling the camera controller 120, And then controls the external control device including the display device 140, the beacon light 150, and the positive game relay 160. In this case, A display device 140 for outputting a job process and a result thereof in real time according to a condition set by a user, a device control unit 130 for controlling the device control unit 130 according to a defect detected by the camera control unit, (150) which is operated by a control signal generated from the camera control unit (120) A regular scanning method using a regular scanning system including a regular game relay (160) operated to adjust an operation of a regular game (Wa) according to an electric signal,
Receiving a video image from the camera controller 120 by the device controller 130;
Controlling the contrast of the input image by the device controller 130;
The device controller 130 may detect a boundary line in the light and dark image;
The device control unit 130 removes noise from a border image and calculates a morphology;
The device control unit 130 removing the overlapping points from the borderless image from which noise has been removed,

The step of Contrast Control
Organizing the height of the ROI image into 100 pixels;
Constructing a minimum rectangle region (MRR) divided by 100 pixels from the left pixel 0 to the last pixel n; And
And adjusting brightness and darkness for each minimum right angle region (MRR).

5. The method of claim 4, wherein detecting the boundary comprises:
Selecting only the x-direction differential value of the desired thread;
Calculating a differential value, constructing a first image by obtaining a left boundary line of the corresponding room if the x-direction primary differential value is positive;
obtaining a right boundary line of the corresponding room if the x-direction primary differential value is negative, and constructing a second image,

The step of removing noise from the boundary image and computing the blob
Performing dilate convolution of vertically contiguous pixels of the left boundary image obtained in the step of constructing the first image and the right boundary image obtained in the step of constructing the second image, Convolution is applied to remove the noise partially.

delete

5. The method of claim 4, wherein removing the overlapping points in the borderline image
Removing all 255 consecutive pixels while visiting each pixel from the 0th column to the nth column for the left borderline image and the right borderline image obtained in the borderline detection process,
Expressing successive vertical lines of pixels in the direction of a row with respect to the left borderline image and the right borderline image as one vertical line through close correlation calculation
The close-
A first step of processing the photographed image according to a canine boundary detection algorithm to obtain a left side border image and a right side border image;
A second step of removing the discontinuity line from the left / right boundary line image, respectively;
A third step of subjecting the left / right boundary line image from which the discontinuity line is removed to an arithmetic operation to obtain a left discontinuity and a right discontinuity;
A fourth step of analyzing a close association between the left single line and the right single line; And
And outputting a final monaural image by synthesizing the left single line and the right single line according to the analysis result.

delete