KR20160032909A - Apparatus for preprocessing of multi-image and method thereof - Google Patents

Abstract

Provided are an apparatus and method for preprocessing multiple images. According to an embodiment of the present invention, the apparatus for preprocessing multiple images comprises: an image reception unit for receiving encoded multiple images; an image separation unit for decoding the received multiple images, and separating the same as a plurality of unit images; a merging unit for merging the unit images to a predetermined bit; a separation unit for separating the merged image by bit field; a preprocessing unit for preprocessing the image separated by bit field to obtain defect data; and a transmission unit for transmitting the defect data.

Description

[0001] Apparatus for preprocessing of multi-image and method [

The present invention relates to a multi-image preprocessing apparatus and method, and more particularly, to a multi-image preprocessing apparatus and method for encoded multi-image.

In general, the development of the Internet and the development of computer hardware have made it possible to distribute more information, and a great deal of this information is multimedia data. Therefore, it is becoming very important to quickly compress media files, such as still images, moving pictures and multimedia information, and to quickly transmit desired data.

On the other hand, in a defect inspection for detecting an object defect, a vision inspection using an image of an object is performed. Generally, a multi-image inspection is performed to visually check an object at various points in time. . In this case, the multi-image uses a plurality of images using various angles or lights, and thus has a problem in that the transmission speed is slow to transmit desired information.

Therefore, there is a demand for development of a technique for quickly preprocessing and transferring a large-capacity multi-image.

Korean Patent Publication No. KR 2013-0142661 (December 30, 2013)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a multi-image preprocessing apparatus and method for rapidly preprocessing and transmitting a coded large-capacity multi-image.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other matters not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a multi-image preprocessing apparatus including: an image receiving unit for receiving encoded multi-images; An image separator for decoding the received multi-image and separating the received multi-image into a plurality of unit images; A merging unit for merging the plurality of unit images into predetermined bits; A separator for separating the merged images into bit fields; A preprocessor for preprocessing an image separated by the bit field to obtain defect data; And a transmitter for transmitting the defect data.

Also, an area extracting unit extracts a region of interest from the plurality of separated unit images; And a synchronization unit for synchronizing the plurality of separated unit images, wherein the preprocessor can binarize and separate the images separated by the bit fields.

The apparatus may further include a plurality of image acquiring units for acquiring the multi-image, wherein the image acquiring unit acquires a panorama image through a plurality of cameras that surround the object in all directions.

The apparatus may further include a plurality of image acquiring units for acquiring the multi-image, wherein the image acquiring unit acquires the panorama image through one camera rotating around the object.

The image acquiring unit may further include a plurality of lights having different wavelengths and a single camera that photographs an object irradiated by the plurality of lights, Can be obtained.

According to another aspect of the present invention, there is provided a method for pre-processing a multi-image, the method comprising: receiving an encoded multi-image; Decoding the received multi-image into a plurality of unit images; Extracting a region of interest from the plurality of separated unit images; Synchronizing the separated plurality of unit images; Merging the synchronized plurality of unit images into predetermined bits; Separating the merged image into predetermined bit fields; Obtaining defect data by preprocessing an image separated for each bit field; And transmitting the defect data.

Other specific details of the invention are included in the detailed description and drawings.

According to the multi-image preprocessing apparatus and method of the present invention, one or more of the following effects can be obtained.

According to the present invention, a coded large-capacity multi-image can be quickly preprocessed and transmitted.

1 and 2 are block diagrams of a multi-image preprocessing apparatus according to an embodiment of the present invention.
3 is a schematic diagram illustrating a multi-image preprocessing process according to an embodiment of the present invention.
4 is a block diagram illustrating a process of encoding and decoding an image according to an embodiment of the present invention.
5 and 6 are operation diagrams of a multi-image preprocessing apparatus according to an embodiment of the present invention.
7 and 8 are views showing an image acquiring unit according to one and other embodiments of the present invention.
FIG. 9 is a schematic view of a panoramic image acquired by an image acquisition unit according to one or more embodiments of the present invention.
10 is a diagram illustrating an image acquisition unit according to another embodiment of the present invention.
11 and 12 are schematic views of an image obtained by an image acquisition unit according to another embodiment of the present invention.
13 is a flowchart of a multi-image preprocessing method according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

Also, terms used herein are for the purpose of illustrating embodiments and are not intended to limit the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It should be understood that the terms comprising and / or comprising the terms used in the specification do not exclude the presence or addition of one or more other elements, steps and / or operations in addition to the stated elements, steps and / use. And "and / or" include each and any combination of one or more of the mentioned items.

Hereinafter, the present invention will be described with reference to embodiments of the present invention. At this point, it will be appreciated that the combinations of blocks and flowchart illustrations in the process flow diagrams may be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, so that those instructions, which are executed through a processor of a computer or other programmable data processing apparatus, Thereby creating means for performing functions. These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory The instructions stored in the block diagram (s) are also capable of producing manufacturing items containing instruction means for performing the functions described in the flowchart block (s). Computer program instructions may also be stored on a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible for the instructions to perform the processing equipment to provide steps for executing the functions described in the flowchart block (s).

The term 'part' or 'module' as used herein refers to a hardware component such as software or an FPGA or ASIC, and the 'part' or 'module' performs certain roles. However, " part " or " module " is not meant to be limited to software or hardware. The term " part " or " module " may be configured to reside on an addressable storage medium and configured to play one or more processors. Thus, by way of example, 'a' or 'module' is intended to be broadly interpreted as encompassing any type of process, including features such as software components, object-oriented software components, class components and task components, Microcode, circuitry, data, databases, data structures, tables, arrays, and variables, as used herein, Or " modules " or " modules " or " modules " or " modules " Can be further separated.

1 and 2 are block diagrams of a multi-image preprocessing apparatus according to an embodiment of the present invention. FIG. 3 is a schematic diagram showing a multi-image preprocessing process according to an embodiment of the present invention. FIG. 8 is a block diagram illustrating a process of encoding and decoding an image according to an embodiment;

1 and 2, a multi-image preprocessing apparatus 10 according to an embodiment of the present invention includes an image acquiring unit 110, an image receiving unit 120, an image separating unit 130, an area extracting unit 140 A synchronization unit 150, a merging unit 160, a separating unit 170, a preprocessing unit 180, and a transmitting unit 190, but does not exclude other components.

The image acquisition unit 110 acquires (210) a multi-image obtained by photographing an object through at least one camera.

However, if the plurality of images can be acquired, the detailed configuration of the image obtaining unit 110 is not limited.

A detailed description thereof will be described later.

The image receiving unit 120 receives the multi-image encoded by the image obtaining unit 110 or externally.

That is, a multi-image captured through at least one camera may be encoded (220) and received, or an externally encoded multi-image may be received.

However, if the encoded multi-image can be received, the image receiving unit 120 may include all configurations that are easily applicable to those skilled in the art.

Referring to FIG. 4, the encoding process may be a process of generating encoded image data by performing arithmetic processing on the quantized image data through a coding filter of a predetermined rule.

In the following description, decoding means that the encoded video data transmitted from the transmitting apparatus is processed through a decryption filter and converted into original video data, but the present invention is not limited thereto.

The image separating unit 130 decodes the received multi-image into a plurality of unit images.

For example, as shown in FIG. 2, a first image 232, a second image 234, a third image 236, and a fourth image 236, which are obtained by decoding the first through fourth encoded images, 238).

Thus, the encoded multi-image is decoded and separated into unit images, thus enabling pre-processing of the image.

However, in the embodiment of the present invention, the method of encoding, decoding and multi-image separation of an image can be performed by any method applicable to the ordinary art in the technical field of the present invention, and the number of unit images is not limited.

The region extracting unit 140 sets an ROI (ROI) 240 on the separated image. That is, since the area for extracting the defect data to be described later is set in advance among the separated images, the preprocessing data can be reduced and the preprocessing speed can be improved.

In this case, the region of interest extracted from the separated image may mean the same region in all of the plurality of separated unit images (for example, the first image to the fourth image).

As shown in FIG. 3, the synchronization unit 150 synchronizes a plurality of separated unit images to each other to synchronize a plurality of unit images, which will be described later, with predetermined bits, thereby synchronizing the plurality of unit images with each other. do.

However, the region extracting unit 140 and the synchronizing unit 150 according to an embodiment of the present invention may include all the detailed structures applicable for extracting a region of interest and synchronizing a plurality of images in the technical field of the present invention have.

Referring to FIGS. 2 and 3, the merging unit 160 merges gray values of all pixels (an array of Xn-Pixel and Yn-Pixel) (The array of Yn).

For example, as shown in FIG. 2 and FIG. 3, the density value of all the pixels (the arrangement of Xn-Pixel and Yn-Pixel) of the decoded first image 232 is represented by a matching data space Xn And the decoded second image 234 is allocated to 8-15 bits of the matched data space (array of Xn and Yn), and the decoded third image 236 ≪ / RTI > is an array of matched data spaces (Xn and Yn) And the decoded fourth image 238 may be allocated to bits 24-31 of the matched data space (array of Xn and Yn).

That is, a plurality of decoded unit images are respectively allocated to bit fields of a predetermined area, so that images can be merged into a single data space (array of Xn and Yn).

The separator 190 separates the bit fields of the first to fourth images merged into a single data space (array of Xn and Yn).

For example, as shown in FIG. 2 and FIG. 3, in a single data space (arrangement of Xn and Yn) in which first to fourth images are merged, data spaces (Xn and Yn) Only the 0-7 bit region filled with the pixels of the first image (Xn-Pixel and Yn-Pixel arrays) in the data space (Xn and Yn) Only the 8-15 bit regions filled with the pixels of the second image (Xn-Pixel and Yn-Pixel arrays) of the second image are bit-separated 264, and the data spaces (arrangement of Xn and Yn) Only the 16-23 bit region filled with the pixels of the third image (Xn-Pixel and Yn-Pixel) is bit-separated 266 and the data space (arrangement of Xn and Yn) Only the 24-31 bit region filled with the pixels of the fourth image (Xn-Pixel and Yn-Pixel arrays) can be bit-separated (268).

However, the plurality of decoded unit images are respectively allocated to the bit fields of the predetermined area, merged into a single data space (array of Xn and Yn) for each image, and the merged data space (array of Xn and Yn) If the bit fields are sorted by a bit field and the bit fields can be aligned in order to preprocess the separated images, there is no limitation on the method of separating or aligning the images.

The preprocessing unit 180 is a process of preprocessing a separated unit image having a gray value to acquire defect data, and may be composed of a combination of various mathematical operators and various filters. The defect data may include defect information for calculating the total number of defects, the size of the width and height, the center position, the area, and the outline information.

2, the separated first image 262 is preprocessed 272 to acquire the defect data 282, and the separated second image 264 is preprocessed 274 to generate the defect data 282. For example, The separated third image 266 is preprocessed 276 to obtain the defect data 286 and the separated fourth image 268 is preprocessed 278 to acquire the defect data 288 can do.

Here, techniques for preprocessing images include a smoothing filter (eg, averaging or Gaussian) for removing noise, an edge filter (eg, Sobel filter or Canny filter) for detecting contour, a morphological morphology processing technique (erosion, (Such as a single binarization technique or a dynamic binarization technique), and the like. However, the present invention is not limited thereto and may include all techniques for recognizing defects of an object in an image .

The preprocessing unit 180 may merge the original images 292 and merge the acquired defect data 282, 284, 286, and 288 in each of the original images 296), or may combine blank images from which an original image has been deleted, or may merge at least one of them to obtain a merged image and / or data, but the present invention is not limited thereto.

The transmitting unit 190 transmits (294, 298) the merged defect data, the original image, and / or the blank image to the outside by the preprocessing unit 180. In this case, the transmitting unit 190 may transmit the merged data in parallel to a plurality of data buses instead of one data bus in order to improve the transmission speed.

However, the configuration of the transmission unit 190 for transmitting data to the outside is not limited thereto, and any configuration that can be implemented by a person skilled in the art can be applied to the present invention.

5 and 6 are operation diagrams of a multi-image preprocessing apparatus according to an embodiment of the present invention.

FIG. 5 shows a decoded image 310, and defects 312, 314, 316, and 318 exist therein. At this time, the preprocessing unit 180 may obtain the defect data by binarizing and preprocessing the decoded and separated unit image 310.

For example, referring to FIG. 6, a total number of defects, a size of a horizontal and a vertical size, a center position, an area (size) of a defect through an image 320 obtained by preprocessing a decoded and separated image 310 324, 326, and 328 including the defect information, the outline information, and the like. That is, it is easy to process various defect data in the image through the preprocessing of the image.

However, the preprocessing (e.g., binarization) method of the image includes all methods applicable to the ordinary artisan in the technical field of the present invention.

FIGS. 7 and 8 are views showing an image acquisition unit according to one and other embodiments of the present invention, and FIG. 9 is a schematic view of a panoramic image acquired by the image acquisition unit according to one and other embodiments of the present invention.

7 and 9, an image acquisition unit 110 according to an embodiment of the present invention includes a plurality of cameras 412, 414, 416, 418, 420, 422, and 424 , 426, 428, 430, and 432).

For example, when the twelfth camera 432 acquires the twelfth image in the manner of acquiring the first image with the first camera 412 and acquiring the second image with the second camera 414, One panoramic image 450 can be acquired.

Therefore, since the image can be acquired by the fixed imaging devices without using a separate driving device, there is a simple structure.

8 and 9, an image acquisition unit 110 according to another embodiment of the present invention acquires a panoramic image 450 through one camera 440 rotating around an object 220 can do.

For example, when one camera 440 acquires a first image at a first position and acquires a second image at a second position rotated by a predetermined angle to a twelfth image, The panorama image 450 can be acquired.

Therefore, it is possible to acquire images with a minimum number of cameras, thereby reducing costs.

The preprocessing operation may be performed as described above through the panoramic image 450 according to one and other embodiments of the present invention.

FIG. 10 is a view showing an image obtaining unit according to another embodiment of the present invention, and FIGS. 11 and 12 are schematic views of an image obtained by an image obtaining unit according to another embodiment of the present invention.

10, an image obtaining unit 110 according to another embodiment of the present invention includes a plurality of lights 520 and 530 having different wavelengths and an object 520 irradiated by a plurality of lights 520 and 530 An image may be acquired 540 through one camera 510 photographing the image 30.

For example, when the object is in the first position, the image even1 photographed by the line scan camera 510 using the light emitted from the first illuminator 530 located below the object 30, And the image odd2 photographed by the line scan camera 510 can be obtained by using the light emitted from the second illuminator 520 located at the upper portion of the first illuminator 520. When the object is moved from the second position to the nth position, Images can be taken.

At this time, as shown in FIG. 11, it is possible to obtain a multi-image in which an image (odd) using light irradiated from the upper portion and an image (even) using light irradiated from the lower portion are combined.

In this case, the image is separated as described above to acquire the defect data 552 and 554 from the separated first image 550, acquire the defect data 562 and 564 from the separated second image 560, can do.

13 is a flowchart of a multi-image preprocessing method according to an embodiment of the present invention.

Referring to FIG. 13, a method for preprocessing a multi-image according to an exemplary embodiment of the present invention includes a step S610 of receiving a coded multi-image, a step S620 of decoding the received multi-image S620, A step S630 of extracting a region of interest from the separated image, a step S650 of synchronizing a plurality of unit images, a step of merging a plurality of synchronized unit images into a predetermined bit S660), separating and merging a plurality of merged images by predetermined bit fields (S670), acquiring defect data by preprocessing the separated image (S680), and transmitting image data and / or defect data S690). However, the present invention can be carried out with only some of these steps without excluding additional steps.

This may be understood to be performed by the multi-image preprocessing apparatus 10 according to an embodiment of the present invention, but is not limited thereto.

In addition, the step of transmitting the defect data may transmit not only the defect data but also the original image, the blank image, or the data in which at least one of the defect data, the original image, and the blank image is merged, but the present invention is not limited thereto.

Therefore, the image preprocessing apparatus 10 and method according to the embodiments of the present invention can preprocess and transmit only information to be decoded for a large-capacity multi-encoded image, thereby improving the transmission speed and eliminating the need for a separate processing device , The risk of data loss is reduced.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

10: Image preprocessing device
110:
120:
130:
140:
150: synchronization unit
160:
170:
180:
190:

Claims (6)

An image receiving unit for receiving the encoded multi-image;
An image separator for decoding the received multi-image and separating the received multi-image into a plurality of unit images;
A merging unit for merging the plurality of unit images into predetermined bits;
A separator for separating the merged images into bit fields;
A preprocessor for preprocessing an image separated by the bit field to obtain defect data; And
And a transmitter for transmitting the defect data. The method according to claim 1,
An area extracting unit extracting a region of interest from the plurality of separated unit images; And
Further comprising a synchronization unit for synchronizing the separated plurality of unit images,
The pre-
And binarizes and preprocesses the separated image for each bit field. The method according to claim 1,
Further comprising a plurality of image acquiring units for acquiring the multi-images,
The image acquiring unit may acquire,
And acquires a panoramic image through a plurality of cameras enclosing an object in all directions. The method according to claim 1,
Further comprising a plurality of image acquiring units for acquiring the multi-images,
The image acquiring unit may acquire,
A panorama image is acquired through a single camera rotating around an object. The method according to claim 1,
Further comprising a plurality of image acquiring units for acquiring the multi-images,
The image acquiring unit may acquire,
And acquires an image through a single camera that photographs a plurality of lights having different wavelengths and an object irradiated by the plurality of lights. Receiving an encoded multi-image;
Decoding the received multi-image into a plurality of unit images;
Extracting a region of interest from the plurality of separated unit images;
Synchronizing the separated plurality of unit images;
Merging the synchronized plurality of unit images into predetermined bits;
Separating the merged image into predetermined bit fields;
Obtaining defect data by preprocessing an image separated for each bit field; And
And transmitting the defect data.

Images