KR100679333B1 - System for mesauring fine movemet of a object and method thereof - Google Patents

Abstract

A system and a method for measuring a fine movement of an object are provided to measure a fine movement of an object in real time without using an additional apparatus for measuring the fine movement and visually confirm the measurement result. A system for measuring a fine movement of an object includes a display unit(210), an input unit(220), and a controller(230). The display unit displays an magnified image output from a camera(100), measurement coordinates extracted from the image and a movement of an object according to movement of the measurement coordinates. The input unit receives an operating command from a user. The controller controls the system, extracts the measurement coordinates from the magnified image inputted from the camera, calculates the movement of the object and displays the movement through the display unit.

Description

System for mesauring fine movemet of a object and method

1 is a schematic diagram schematically showing a system for measuring a fine movement amount of an object according to an exemplary embodiment of the present invention.

FIG. 2 is a block diagram schematically showing a measuring device according to FIG. 1.

3 is a schematic diagram schematically illustrating a process of calculating measurement coordinates according to another aspect of the present invention.

4 is a schematic diagram illustrating a moving amount measurement screen displayed through a display unit of a measuring apparatus according to an exemplary embodiment of the present invention.

5 is a flowchart schematically illustrating a process of measuring an amount of fine movement of an object according to an exemplary embodiment of the present invention.

The present invention relates to a technique for measuring an amount of movement of an object, and more particularly, a technique for calculating a measurement coordinate from an image of an enlarged image of an object, and detecting the fine movement amount of the calculated measurement coordinate in real time to calculate the fine movement amount of the corresponding object. It is about.

In general, in order to measure microscopic movements of microscopic movements or micro movements of objects requiring precision such as cutting of the lens surface, precision measuring devices, machine tools, robots, etc. It had to be checked every time.

For example, in order to observe the movement of the microorganism, the user observes the movement of the microorganism using a device such as a microscope, and the trajectory according to the movement has to be recorded by a separate recording device or directly by the observer.

As another example, in the case of a process that requires precise polishing, such as the surface processing of the lens, there was a hassle of periodically observing the machined surface using a separate measuring equipment and confirming the accuracy of the machining state.

The present invention was devised to solve the above problems, and its purpose is that there is no need to install a separate equipment for measuring the fine movement amount of the moving object, the system for measuring the fine movement amount of the object that can measure the fine movement amount of the object in real time And a method thereof.

Furthermore, the present invention provides a system and method for measuring the amount of fine movement of an object that can visually confirm the process and the result of the amount of fine movement of an object.

The fine movement amount measuring system of an object according to the aspect of the present invention described above extracts a measurement coordinate from a camera outputting an enlarged image of an object input from a lens system, and an enlarged image output from the camera, and detects a change in the measurement coordinate. It is configured to include a measuring device for calculating and outputting the fine movement amount of the object.

Therefore, there is an advantage that can accurately measure / provide the precise movement amount and the movement trajectory of the microorganism and the movement trajectory of the transfer object and the device, such as precision machine tools, robots in real time.

According to a characteristic aspect of the present invention, the measuring apparatus according to the present invention is a display unit for displaying the magnified image output from the camera, the measurement coordinates extracted from the image and the amount of movement of the object according to the movement of the measurement coordinates, and input the operation command from the user And a control unit for controlling the receiving input unit and the entire measuring apparatus, extracting the measurement coordinates from the enlarged image input from the camera, calculating an amount of movement of the object according to the change in the coordinates of the measurement coordinates, and outputting the measured coordinates.

According to a characteristic aspect of the present invention, the fine movement amount measuring system of an object according to the present invention processes the image input from the camera into a gray image, and by using the processed gray image, it is possible to calculate the movement amount more quickly, thereby real-time Measurable advantage.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily understand and reproduce the present invention.

1 is a schematic diagram schematically showing a system for measuring a fine movement amount of an object according to an exemplary embodiment of the present invention. As shown, the fine movement amount measuring system of the object according to the present invention is a measurement coordinates from the camera 100 and a magnified image output from the camera 100 to take a portion of the magnified image of the object input from the lens system; It is configured to include a measuring device 200 for extracting the, and detecting the change in the measurement coordinate to calculate and output the amount of movement of the object.

For example, the camera 100 may be a digital camera having a CCD or a CMOS image pickup device, and outputs an image obtained by enlarging an object to be measured to the measurement apparatus 200.

The camera 100 includes a lens system, an imaging unit for converting an optical signal from the lens system into an analog electric signal, and a format suitable for input of the measuring device 200 after processing and converting the signal output from the imaging unit into digital. And a camera controller 230 for controlling the operation of the camera 100 as a whole.

The lens system includes a small one or a plurality of lenses to enable a zoom function, and collects and supplies light to the imaging unit. The imaging unit is usually composed of a CMOS imaging device or CCD imaging device, and is a known device that converts light into an electrical signal for each pixel and sequentially outputs it in synchronization with a clock. The converting unit converts the current or voltage proportional to the image brightness output from the imaging unit into digital data after a little processing, and converts the data value into a format suitable for the input of the measuring device 200 and outputs the converted data. In another embodiment, the conversion unit may further include a codec for compressing the photographed image in the JPEG format or the MPEG format, as in the known digital camera module.

The camera 100 photographs an object and transmits the photographed image to the measuring device 200, and an image of magnifying one surface of the moving object by using a zoom lens to measure the fine movement amount of the object, which is a preferred aspect of the present invention. It is preferable to output. The enlarged image photographed by the camera 100 is displayed by the measuring apparatus 200 and provided to the user.

The measuring device 200 includes, for example, a computer system for various purposes including a monitor, a keyboard and a mouse, and a personal computer electrically connected to the camera 100, and is enlarged and photographed by the camera 100. It receives the output image and provides it to the user, calculates the measurement coordinates from the corresponding image according to the measurement command input from the user, calculates the amount of fine movement of the object by detecting the change amount of the measurement coordinates and outputs it. The description of the measuring device 200 will be described in more detail with reference to FIG. 2.

FIG. 2 is a block diagram schematically showing a measuring device according to FIG. 1. As shown in the drawing, the measurement apparatus 200 includes a display unit 210 for displaying an enlarged image output from the camera 100, a measurement coordinate extracted from the image, and an amount of movement of an object according to the movement of the measurement coordinate, and an operation command from a user. The control unit 220 receives the input unit 220 and the overall measuring device 200, extracts the measurement coordinates from the magnified image input from the camera 100, calculates the movement amount of the object according to the coordinate change of the measurement coordinates, and displays the display unit ( It is configured to include a control unit 230 for output through the 210.

The display unit 210 may be a monitor connected to the computer system described above, and displays the magnified image captured by the camera 100, displays the measured coordinates calculated by the controller 230, and displays the measured coordinates on the controller 230. A user interface for outputting a change amount of the coordinates of the measured coordinates calculated by the step, and calculating and outputting the moving amount of the object according to the change amount is provided.

The input unit 220 may be a mouse or a keyboard connected to the main body of the computer system. The input unit 220 receives an operation command such as, for example, a driving command of the measuring device 200, a control command of the camera 100, and an overall control command of the device from the user and transmits it to the control unit 230. In addition, the display unit 210 and the input unit 220 of the measurement apparatus 200 according to the present invention may be implemented as a touch panel capable of simultaneously outputting and inputting an image.

Since the display unit 210 and the input unit 220 are well known techniques widely used as input / output means of a computer system, detailed description thereof will be omitted.

The controller 230 may be implemented as, for example, a computer processing unit (CPU) of the computer system, and controls the overall measurement apparatus 200.

Search for a spot, which is referred to as a “spot,” from the user in the magnified image output by the camera 100, having a predetermined color value and having the largest value in the y-axis direction of the spot. The x-axis coordinates are obtained from a pixel having a value, a pixel retrieval unit 231 for retrieving a pixel having the largest value in the x-axis direction, and a pixel having a largest value in the y-axis direction retrieved by the pixel retrieval unit 231. The measurement coordinate calculation unit 232 for calculating the measurement coordinates by extracting the y-axis coordinates from the pixel having the largest value in the x-axis direction, and the amount of change in the measurement coordinates calculated by the measurement coordinate calculation unit 232. It is configured to include a movement amount calculation unit 233 to detect and output the movement amount of the object through the display unit 210.

Each configuration of the controller 230 may be configured with dedicated hardware, but is preferably implemented as an application mounted on the controller 230 and driven.

The pixel search unit 231 searches for a pixel having a predetermined color value as a spot input from a user in an image, preferably an enlarged image, of an object input through the camera 100 and output through the display unit 210. Among the pixels searched, the pixel having the largest value in the y-axis direction and the pixel having the largest value in the x-axis direction are searched for and output.

For example, the pixel search unit 231 searches in the x-axis and y-axis directions based on the center of the spot selected by the user. The pixel search unit 231 searches for pixels having predetermined color information while searching for pixels. The pixel search unit 231 of the retrieved pixels has the maximum value in the y-axis direction, that is, the pixel found at the top of the spot, and the maximum value in the x-axis direction, that is, the pixel found in the rightmost part of the image. To print.

According to a characteristic aspect of the present invention, the pixel search unit 231 scans a pixel within a predetermined range from the center of the spot input from the input unit 220, but when the searched pixel has a predetermined color value, And resetting the search range to search for the pixel having the largest value in the y-axis direction and the pixel having the largest value in the x-axis direction.

This is to more quickly search for a pixel having the maximum value in the y-axis direction, that is, the pixel retrieved at the top of the image, and a pixel having the maximum value in the x-axis direction, that is, the pixel found in the rightmost part of the image. The pixel search method of the pixel search unit 231 will be described in detail later with reference to FIG. 3.

The measurement coordinate calculation unit 232 calculates the measurement coordinates from the two pixels searched by the pixel search unit 231. This measurement coordinate calculation method will be described in more detail with reference to FIG. 3.

3 is a schematic diagram schematically illustrating a process of calculating measurement coordinates according to another aspect of the present invention. As illustrated, the pixel search unit 231 searches the x and y axis directions based on the center of the spot selected by the user. The pixel search unit 231 searches for pixels having predetermined color information while searching for pixels. The pixel search unit 231 searches for and outputs a pixel having a maximum value in the y-axis direction, that is, a pixel found at the top of the corresponding spot, and a pixel having a maximum value in the x-axis direction, that is, a pixel found on the rightmost side of the image.

The pixel search method having the maximum value in the y-axis direction of the pixel search unit 231 searches from left to right and top to bottom within a predetermined range of the search range based on the center of the spot. If a pixel with the desired color value comes out during the search, the search range is reset by searching again. Repeatedly searching this way will always find the best point of the target and always retrieve the coordinates (X, Y) of the best point even if the target moves.

The pixel search method having the maximum value in the x-axis direction of the pixel search unit 231 searches from top to bottom, left to right, within a predetermined range of the search range based on the center of the spot. If a pixel with the desired color value comes out during the search, the search range is reset by searching again. Repeatedly searching this way will always find the target's highest point, and you'll always find the coordinates of the highest point even if the target moves.

The measurement coordinate calculator 232 extracts the x-axis coordinates from the pixel having the largest value in the y-axis direction searched by the pixel search unit 231, and calculates the y-axis coordinates from the pixel having the largest value in the x-axis direction. The measured coordinates are calculated by combining the extracted coordinates. In addition, the extracted x and y coordinates are calculated as measurement coordinates, the calculated measurement coordinates are displayed on the display unit 210, and output to the movement amount calculation unit 233.

The movement amount calculator 233 receives the measurement coordinates output from the measurement coordinate calculator 232, and detects the change in the measurement coordinates to calculate the movement amount of the object. The movement amount calculation unit 233 measures a measurement coordinate that changes as the coordinate values of the pixel having the maximum value in the y-axis direction and the pixel having the maximum value in the x-axis direction are searched by the predetermined period or the pixel search unit 231. The amount of change is detected to calculate the amount of movement of the object, and the calculated amount of movement is provided through the display unit 210.

Therefore, by selecting two spots as one measurement coordinate and calculating the movement amount of the object, it is possible to improve the reliability of the movement calculation process that is more accurate and can be changed according to the external environment change.

According to a characteristic aspect of the present invention, the measuring device 200 according to the present invention further includes an image converter 240 for converting an image input from the camera 100 into a gray image and outputting the pixel search unit 231. Searches for the pixels for calculating the measurement coordinates in the gray image output from the image converter 240.

The image converter 240 converts the image acquired by the camera 100 into a gray scale image for easy image processing and outputs the gray scale image. In order to process the image acquired by the camera 100, the pattern recognition of the spot is required. Pattern recognition is an image data processing process for recognizing a feature of an object included in a target image. As the type of the target image in the pattern recognition, a color image, a gray scale image, a binary image, or the like is used as an input image.

The measurement apparatus 200 of the present invention converts a gray image into an input image and processes the gray image.

In a binary image, one pixel is very simply displayed as 1 and 0, that is, white and black. In a color image, one pixel is generally represented by RGB having three values of red, green, and blue.

Color image has delicate and precise image information in the image because each pixel has three data of RGB, but it has a disadvantage that it takes a lot of complexity and processing time for image processing, so it is difficult to process in real time. There is this.

Binary image is effective to separate the background and the object we want to recognize, and it has the advantage of simplifying the image processing calculation, but because it loses the delicate and precise image information in the image, the recognition result is not precise and the desired recognition rate is achieved. There is a drawback that you do not get.

In contrast, gray images have the advantages of both color and binary images. Gray images typically have a density value between 0 and 255, with one pixel assigned to one byte.

Accordingly, the real-time movement amount can be calculated by processing for a faster time than processing and calculating a color image, and has an advantage of more accurate recognition than a binary image.

Additionally, the measurement apparatus 200 according to the present invention may further include a memory 250 in which movement trajectory information of the measurement coordinates calculated by the movement amount calculation unit 233 is accumulated and stored.

The memory 250 is composed of, for example, a nonvolatile memory device such as an EEPROM or a flash memory, and the measuring device 200 of the present invention is implemented as a large capacity storage means such as a hard disk due to the characteristics of the computer system. desirable. The memory 250 accumulates and stores the operation program of the system for measuring the fine movement amount of the object according to the present invention and the movement trajectory information of the measurement coordinates calculated by the movement amount calculation unit 233.

The operating program and the accumulated movement trajectory information stored in the memory 250 are accessed and controlled by the controller 230 and may be used as main analysis data for calculating the movement trajectory of the object or microorganism later.

4 is a schematic diagram illustrating a moving amount measurement screen displayed through a display unit of a measuring apparatus according to an exemplary embodiment of the present invention. As shown, the fine movement amount measuring system of the object according to the present invention displays an enlarged image of the object output from the camera 100 on the upper left, the image display window in which the measured coordinates calculated according to the user's measurement command is displayed Is provided. The image displayed by the image display window is a real time image captured by the camera 100. On the right side of the image display window is a movement trajectory display window that displays the calculated movement trajectory of the measured coordinates. The movement trajectory shown is a display of the movement trajectory of the measurement coordinates during the circular motion in the two-axis feeder.

In addition, at the bottom of the image display window and the movement trajectory display window, a user input window for inputting a plurality of parameters used for a user's operation command and measurement, and a movement amount display window in which the coordinate values of the measurement coordinates measured in real time and the movement amount according to the movement are displayed are displayed. do.

Therefore, the user can track the transport trajectory of the precise transport device in real time, and has the advantage that the microscopic movements such as the movement of microorganisms can be easily visually confirmed.

5 is a flowchart schematically illustrating a process of measuring an amount of fine movement of an object according to an exemplary embodiment of the present invention. As shown in the drawing, the method for measuring the amount of fine movement of an object according to the present invention receives and displays an enlarged image output from the camera 100 and receives an arbitrary spot from a user in the displayed enlarged image. Searching for pixels having a predetermined color value and having the largest value in the y-axis direction of the corresponding spot, pixels having the largest value in the x-axis direction, and x-axis from the pixels having the largest value in the searched y-axis direction. Extracting the coordinates, extracting the y-axis coordinates from the pixel having the largest value in the x-axis direction, calculating the measurement coordinates, sensing the calculated change in the measured coordinates, calculating the movement amount of the corresponding object, and outputting the measured coordinates. Characterized in that it comprises a step.

Accordingly, the user installs a camera 100 having an appropriate magnification so as to capture an image of an object and a device or a microorganism for which fine motion is to be measured, and connects the camera 100 and the measuring device 200.

When the driving command of the program for measuring the fine movement amount of the object mounted in the measuring device 200 is input (S101), the camera 100 transmits an image of an enlarged image of the object to the measuring device 200. The 240 receives the image, converts the image into a gray image, and outputs the gray image to the display unit 210 (S103).

The user inputs an arbitrary spot displayed in 255, that is, white in the enlarged image of the object, by using the input unit 220, for example, a mouse (S107). In the input spot, the pixel search unit 231 searches for a pixel having the maximum value in the y-axis direction, that is, the pixel searched at the top of the spot, and a pixel having the maximum value in the x-axis direction, that is, the pixel searched on the rightmost side of the image. And outputs it (S109).

The measurement coordinate calculator 232 extracts the x-axis coordinates from the pixel having the largest value in the y-axis direction searched by the pixel search unit 231, and calculates the y-axis coordinates from the pixel having the largest value in the x-axis direction. The measured coordinates are calculated by combining the extracted coordinates. The calculated measurement coordinates are displayed on the display unit 210 and output to the movement amount calculation unit 233 (S111).

The movement amount calculation unit 233 receives the measurement coordinates output from the measurement coordinate calculation unit 232, and the movement amount calculation unit 233 changes the coordinate value of the pixel of the spot searched by the pixel search unit 231 for a predetermined period. The amount of change of the measured coordinates is changed according to the change (S113), the amount of movement of the object according to the amount of change is calculated, and the calculated amount of movement is provided through the display unit 210 (S115).

According to a characteristic aspect of the present invention, in a pixel search for calculating measurement coordinates in the method for measuring the fine movement amount of an object according to the present invention, the pixel search unit 231 has a pixel within a predetermined range from the center of the spot input from the input unit 220. If the pixel to be searched has a predetermined color value, the search range is reset around the pixel to search for the pixel having the largest value in the y-axis direction and the pixel having the largest value in the x-axis direction. It is characterized by.

This is to more quickly search for a pixel having the maximum value in the y-axis direction, that is, the pixel retrieved at the top of the image, and a pixel having the maximum value in the x-axis direction, that is, the pixel found in the rightmost part of the image.

According to an additional aspect of the present invention, the method for measuring the fine movement amount of an object according to the present invention stores the movement amount information measured according to the change amount of the measurement coordinates in the memory 250 (S117), and the stored movement amount information is later associated with the corresponding object and device or It can be used as data to predict the movement trajectory of microorganisms.

In the process of measuring the amount of fine movement of the object, the above-described steps are repeated until an end command is input by the user (S119).

As described above, the system and method for measuring the fine movement amount of an object according to the present invention obtain an enlarged image of the object using the camera 100, and calculate the coordinate change amount of the measured coordinate calculated through image processing on the acquired image. By detecting and calculating the amount of movement of the object, it has the advantage of accurately measuring / providing the precise movement amount of the transported object and device such as precision machine tool and robot and the movement trajectory of microorganisms with only the input image without installing additional measuring device. .

In addition, by selecting two spots as the measurement coordinates and calculating the movement amount of the object, the spots have an advantage of improving the reliability of the movement calculation process that is more accurate and can be changed according to the change of the external environment.

In addition, by processing the image input from the camera as a gray image, and using the processed gray image, it is possible to calculate a faster amount of movement, through which has the advantage that can be measured in real time.

In addition, by accumulating and storing the calculated movement trajectory information of the measured coordinates, there is an advantage that can be used as the main analysis data for calculating the movement trajectory of the object or microorganism later.

On the other hand, the present invention has been described with reference to the embodiments shown in the drawings but this is only exemplary, those skilled in the art will understand that various modifications and equivalent other embodiments are possible therefrom. . Therefore, the true technical protection scope of the present invention should be defined only by the appended claims.

Claims (10)

In the system for measuring the fine movement of an object, A camera for outputting an enlarged image of an object input from the lens system; A measuring device extracting measurement coordinates from the magnified image output from the camera and calculating and outputting a fine movement amount of a corresponding object by detecting a change in the measurement coordinates; Fine movement amount measurement system of an object comprising a. The device of claim 1, wherein the measuring device is: A display unit configured to display an enlarged image output from the camera, and an amount of movement of an object according to movement of the measurement coordinates and the measurement coordinates extracted from the image; An input unit which receives an operation command from a user; A control unit which controls the whole measuring device, extracts measurement coordinates from an enlarged image input from the camera, calculates an amount of movement of an object according to a change in coordinates of the measurement coordinates, and outputs the measured coordinates through the display unit; Fine movement amount measurement system of an object comprising a. The method of claim 2, wherein the control unit: Search for a spot received from the user in the magnified image output by the camera, the pixel having a predetermined color value and having the largest value in the y-axis direction of the spot, and having the largest value in the x-axis direction. A pixel search unit for searching for pixels; Calculate measurement coordinates by extracting x-axis coordinates from the pixel having the largest value in the y-axis direction retrieved by the pixel search unit and extracting y-axis coordinates from the pixel having the largest value in the x-axis direction Wealth; A moving amount calculating unit for detecting a change amount of the measuring coordinate calculated by the measuring coordinate calculating unit, calculating a moving amount of the corresponding object and outputting the moving amount through the display unit; Fine movement amount measurement system of an object comprising a. The device of claim 3, wherein the measuring device is: And an image converter configured to convert the enlarged image input from the camera into a gray image and output the gray image. The pixel search unit: And a pixel for calculating a measurement coordinate using a gray image output from the image converter. The apparatus of claim 4, wherein the pixel search unit comprises: Scanning a pixel within a predetermined range from the center of the spot input from the input unit, and if the searched pixel has a predetermined color value, the pixel having the largest value in the y-axis direction by resetting the search range around the pixel; A system for measuring the small amount of movement of an object, characterized by searching for the pixel having the largest value in the x-axis direction. The device of claim 2, wherein the measuring device is: And a memory for storing the calculated movement path information of the measured coordinates. In the fine movement amount measuring method of the object for measuring the fine movement amount of the object through the magnified image input from the camera, a) receiving and displaying an enlarged image output from the camera; b) Search for a spot received from the user in the enlarged image being displayed, and search for a pixel having a predetermined color value and having the largest value in the y-axis direction of the spot and a pixel having the largest value in the x-axis direction. Making a step; c) extracting x-axis coordinates from the pixel having the largest value in the searched y-axis direction, and extracting y-axis coordinates from the pixel having the largest value in the x-axis direction to calculate measurement coordinates; d) calculating the movement amount of the object by sensing the calculated variation of the measured coordinates and outputting the movement amount of the corresponding object; Fine movement amount measuring method of the object comprising a. 8. The method of claim 7, wherein step a) comprises: And a magnified image input from the camera is converted into a gray image and outputted. 8. The method of claim 7, wherein step b) comprises: If a pixel within a predetermined range is scanned from the center of the input spot, and the searched pixel has a predetermined color value, the pixel has the largest value in the y-axis direction by resetting the search range around the pixel, and the x-axis direction. The method of measuring the fine movement amount of the object, characterized in that for searching for the pixel having the largest value. The method of claim 6 wherein the method is: e) storing the calculated movement path information of the measured coordinates in the storage means.

Images