TWI765587B - Intelligent imaging and measurement system and method - Google Patents

Abstract

To immediately display an actual size of an object after shooting the object, and further virtual measurement, an intelligent imaging and measurement system and method are provided. The system includes a ranging and photography device, an image processing device, and a display device. The ranging and photography device is used for capturing the image of the object and recording the capturing distance. The image processing device is used to calculate the actual size of the image and perform the virtual measurement. The display device is used to display the image of the object.

Description

System and method for intelligent image acquisition and measurement

The present invention relates to a system and method for intelligent image capturing and measurement, especially a technology for outputting the actual size of a photographed object in real time.

At present, the imaging system for measuring the actual size needs to be erected at a position with a fixed and known height, and a control object (usually a ruler with a specific unit scale) is placed in the imaging field of view. The imaging system simultaneously shoots the object and the control object to compare the actual size of the object.

The above-mentioned method must rely on artificially to estimate the actual size of the object through the control object in the image, which is more suitable for processing a small number of images. If it is used on a production line, the above method will not be effective due to the large number of objects to be inspected, and the imaging system of the above method must also be calibrated regularly in order to maintain the accuracy of the image and increase the cost of many production lines. .

According to the deficiencies in the prior art, there is a need in the technical field for an imaging system that does not require a fixed height, does not require a contrast, and can instantly calculate the actual size of an object in an image. Therefore, how to achieve an imaging system that meets the above conditions becomes a problem to be overcome in the technical field.

To solve the above problem, an embodiment of the present invention develops an intelligent image capturing and measuring system, which integrates the functions of image capturing, ranging and calculation, and can calculate the actual size of the object in the image at any image capturing distance. In addition to calculating the two-dimensional size information (X, Y), the above-mentioned system can further obtain height information for irregularly shaped objects through the built-in ranging unit to generate the three-dimensional size information of the object ( X, Y, Z). In the smart imaging and measurement system of the present invention, there is a database of standard size information, and the standard size information includes a plurality of pixel matrices and actual size information corresponding to imaging distance information and resolution information. Therefore, through the object image captured by the present invention, the actual size of the object in the image can be calculated in real time. The calculation method is to use the regression analysis method to calculate the actual size of the object's length, width and height through the standard size information of the above-mentioned database in the system. The ability to instantly calculate the actual size of objects in an image.

Specifically, embodiments of the present invention provide an intelligent imaging and measurement system. The above-mentioned intelligent imaging and measurement system includes at least one ranging imaging device, an image processing device and a display device. The above-mentioned ranging and imaging device includes at least one imaging unit and at least one ranging unit. After the image capturing unit captures the image of the object, at least one original image file is generated, and the resolution information of the original image file is obtained. The distance measuring unit measures the image capturing distance between the image capturing unit and the object to generate image capturing distance information. The above image processing device includes a database and a computing module. The signal of the above-mentioned image processing device is connected to the above-mentioned distance measuring and imaging device, and the actual size of the object in the above-mentioned original image file is calculated. The above-mentioned database is used for storing a plurality of standard size information, and each of the above-mentioned standard size information respectively includes the resolution per unit area, the image capturing distance, the corresponding pixel matrix and the corresponding actual size. The above-mentioned calculation module signal is connected to the above-mentioned database, and according to the above-mentioned resolution information and the above-mentioned acquisition distance information of the above-mentioned original image file, the above-mentioned standard size information in the above-mentioned database is compared, and the actual size information is calculated and generated. The processed image file. The above-mentioned display device is for displaying the above-mentioned original image file or the above-mentioned processed image file.

According to yet another embodiment, the above-mentioned image processing apparatus further includes a stacking module. When the above-mentioned object has a design drawing, the superimposing module superimposes the above-mentioned design drawing and the above-mentioned processed image file, and simultaneously displays it on the above-mentioned display device.

According to yet another embodiment, the image processing apparatus further includes a measurement module for manually performing virtual measurement on the processed image file and generating dimension measurement data.

According to yet another embodiment, the distance measuring unit includes a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor.

According to yet another embodiment, the above-mentioned objects may include, for example, printed circuit boards, semiconductor wafers, or other electronic products.

According to yet another embodiment, the calculation method of the above-mentioned calculation module includes a regression analysis method.

Embodiments of the present invention further provide an intelligent image acquisition and measurement method, which includes the following steps. A plurality of standard size information are prepared, wherein each standard size information respectively includes a resolution per unit area, an imaging distance, a corresponding pixel matrix and a corresponding actual size. Capture the image of the object, obtain the original image file, and capture the resolution information and the distance information of the original image file. The actual size information of the original image file is calculated through the plurality of standard size information, and added to the original image file to obtain a processed image file. After superimposing the above-mentioned design drawing of the object and the above-mentioned processed image file, a superimposed image obtained is displayed on the display device. A virtual measurement is performed on the above-mentioned superimposed image.

According to yet another embodiment, the method for calculating the actual size information of one of the original image files includes a regression analysis method.

Combining the technical features of the above embodiments, the following effects can be specifically claimed.

(1) There is no need to perform system calibration regularly, and there is no need to measure the image acquisition distance in advance, which can simplify the process of setting up the imaging system.

(2) The system can immediately calculate the actual size of the object in the image after taking the image, and can cooperate with a compatible virtual measurement module to measure the specific position of the object. For example, the user can view the processed image through the display device, And when at least two points (ie coordinates) are clicked, the actual distance between the two points is calculated in real time. It can also be applied to virtual measurement of the defect position of the product, unlike the need for manual field measurement in the past.

(3) For objects with irregular shapes, the ranging unit of the system can obtain multiple imaging distances by completely scanning the upper surface of the object or obtaining multiple sampling points on the object to obtain complete height information of the object. For example, 100,000 points are sampled on the upper surface of the object, and the distance information corresponding to these sampling points is obtained respectively, so as to estimate the height information of the surface of the object. Therefore, when the user views the 2D image through the display device, he is actually looking down on a three-dimensional object. Therefore, when the upper surface of the object has inconsistent heights, the user clicks two points in the processed image to perform virtual calculation, in fact, the distance between the two three-dimensional coordinates (X, Y, Z) is calculated to obtain the actual object. size, which is closer to the actual measurement result.

100:Intelligent imaging and measurement system

120: Ranging and imaging device

122: Acquisition unit

124: Ranging unit

140: Image processing device

142:Database

144: Computing Module

146: Stacking module

148: Measurement module

160: Display device

200:Object

220: Original image file

240: processed image file

301-307: Steps

In order to make the above and other objects, features, advantages and embodiments of the present invention more clearly understood, the accompanying drawings are described as follows:

FIG. 1 is a schematic diagram of a device of an intelligent imaging and measurement system according to an embodiment of the present invention.

FIG. 2 is a flowchart of an intelligent imaging and measurement system according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of an image display of an intelligent imaging and measurement system according to an embodiment of the present invention.

In order to describe the various embodiments of the present invention more specifically, the following description is supplemented by the accompanying drawings.

Please refer to FIG. 1 . FIG. 1 is a schematic diagram illustrating the structure of an intelligent imaging and measurement system according to an embodiment of the present invention. In FIG. 1 , according to an embodiment, an intelligent imaging and measurement system 100 is provided. The intelligent imaging and measurement system 100 includes at least one ranging imaging device 120 , an image processing device 140 and a display device 160 .

The above-mentioned ranging and imaging system 120 includes at least one imaging unit 122 and at least one ranging unit 124 . The above-mentioned image capturing unit 122 performs static or dynamic image capturing of the object 200 and generates an original image file 220 . The image capturing unit 122 can adjust the resolution of the captured image before capturing the image of the object 200 , and additionally stores the resolution information in the original image file 220 after capturing. The above-mentioned image capturing unit 122 may be a camera, a video camera or a scanner with the function of capturing still or moving images. The distance measuring unit 124 can measure the image capturing distance between the image capturing unit 122 and the object 200 , and store the image capturing distance information in the original image file 220 . According to another embodiment of the present invention, the distance measuring unit 124 includes a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor.

The above-mentioned image processing device 140 calculates the above-mentioned resolution information and the above-mentioned image capturing distance information of the above-mentioned original image file 220 to generate a processed image file 240 with actual size information, and can further perform image overlay or virtual measurement according to requirements. Measurement. The above-mentioned image processing device 140 is a computer or a portable device with computing functions. The above-mentioned image processing device 140 includes a database 142 , a calculation module 144 , a stacking module 146 and a measurement module 148 .

The above-mentioned database 142 stores a plurality of standard size information in advance, and each standard size information includes a resolution corresponding to a unit area, an imaging distance, and a corresponding pixel matrix. Under the condition of image capture with high resolution, the pixel matrix corresponding to a unit area of 1mm ² is a 2×2 matrix, that is, a unit area of 1mm ² is displayed using 4 pixels of the display device. The above-mentioned database 142 is a hard disk with a storage function, such as a mechanical hard disk, a solid-state hard disk or an external hard disk.

The calculation module 144 searches for the standard size information with the same image capturing conditions among the plurality of standard size information in the database 142 according to the resolution information and the image capturing distance information of the original image file 220 , used to calculate the actual size of the object 200. Then, the actual size information of the object 200 is appended to the original image file 220 to become the processed image file 240 . According to another embodiment of the present invention, the calculation method of the calculation module 144 includes a regression analysis method.

When the object 200 has a design drawing, the superimposing module 146 can overlay the design drawing with the processed image file 240 and display it on the display device 160 at the same time, so that the user can compare the object 200 Design drawings and processed images 240 .

The measurement module 148 can manually perform virtual measurement on the processed image file 240 to generate dimensional measurement data.

According to another embodiment of the present invention, when the height of the object 200 fluctuates within a tolerance value, such as ±0.1 mm, which can be regarded as a flat object, the distance measuring unit 124 can obtain the corresponding reference point through the reference point preset on the object 200 For the image capturing distance information of the point, the calculation module 144 then calculates the actual size of the object 200 in other regions other than the reference point according to the image capturing distance information. The purpose of obtaining the above-mentioned imaging distance information through the reference point can be applied to the manufacturing process of the printed circuit board. For example, the above-mentioned object 200 is a printed circuit board, and a reference point can be preset on the above-mentioned printed circuit board as a position for obtaining the above-mentioned imaging distance information. Since the printed circuit boards are objects of approximately the same height, the image capturing distance information obtained by single-point ranging of the reference point can be used to calculate the actual size of the printed circuit board in other areas outside the reference point. The above-mentioned reference point can be any point on the printed circuit board, for example: a point marked in advance on the printed circuit board or a position where no solder resist ink is applied.

According to an embodiment of the present invention, please refer to FIG. 1 and FIG. 2 and FIG. 3 simultaneously. FIG. 2 is a flowchart of a method for intelligent imaging and measurement according to an embodiment of the present invention.

In Figure 2, step 301 is the start.

In step 302, a plurality of standard size information for comparison and calculation are stored in the database 142 of the image processing device 140 in advance. The above standard size information is described in detail as above, and will not be repeated here.

In step 303 , the distance measuring and imaging device 120 captures at least one image of the object 200 and saves it as a corresponding original image file 220 . The above-mentioned original image file 220 includes resolution information and imaging distance information. The sources of the resolution information and imaging distance information are as described above, and will not be repeated here.

In step 304 , the image processing device 140 calculates the actual size information of the object 200 in the original image file 220 according to the resolution information and the acquisition distance information of the original image file 220 , and generates the processed image file 240 . For example, under the conditions of image capture with an image capture distance of 1m and an image capture resolution of 1920*1080, the pixel matrix corresponding to a unit area of 1mm ² is a 2×2 matrix, and the above-mentioned object 200 is in the original image file 220 The middle length and width are composed of a matrix of 200×200, that is, the actual area of the object 200 is calculated to be 10000mm ² . The calculated actual size information is appended to the above-mentioned original image file 220 to generate a processed image file 240 .

In step 305 , according to the resolution set by the display device 160 , the processed image file 240 to be displayed is proportionally enlarged or reduced and displayed on the display device 160 . Also refer to FIG. 3 , which is a schematic diagram of an image display, which is a schematic diagram of an image display of an intelligent imaging and measurement system according to an embodiment of the present invention. When the object 200 has an irregular shape, the three-dimensional size of the object 200 can be recorded through the ranging function of the distance measuring and imaging device 120 , and the height information can be further marked on the 2D image display in the display device 160 . In FIG. 3 , the height information of the upper surface of the object 200 is presented in the form of shades of color. However, it is not limited to the above-mentioned presentation methods, and the height information can also be presented in other suitable manners. The ranging function of the above-mentioned ranging and imaging device 120 may be single-point ranging, scanning ranging or multi-point ranging. The single-point ranging is suitable for the object 200 having a uniform height; the scanning ranging or multi-point ranging is suitable for the upper surface of the object 200 having irregular heights.

In step 306 , the user is provided to perform virtual measurement through the processed image file 240 displayed on the display device 160 . For example, the user may click on two points in the processed image displayed by the above-mentioned display device 160 to calculate the actual distance between the above-mentioned two points. In fact, the measuring device 148 of the image processing device 140 will calculate the distance between the two points on the three-dimensional coordinates (X, Y, Z), not the distance on the two-dimensional coordinates (X, Y). Therefore, an accurate virtual measurement result can be achieved.

In step 307, the process ends.

In view of the above, an embodiment of the present invention is an intelligent image capturing and measuring system, which can provide the user without the need to measure the size of the object 200 on the spot, but by capturing the image of the object 200 and then executing it through the display device 160 . Virtual measurement to effectively save the cost of manual measurement. Furthermore, after calculating the length, width and height information of the object 200 in the image through the system of the present invention, the size of the irregularly shaped object 200 can be easily measured virtually on the display device 160, effectively overcoming the difficulty of manual measurement.

The present invention is only disclosed by preferred embodiments herein, however, any person skilled in the art should understand that the above-mentioned embodiments are only used to describe the present invention, and are not intended to limit the scope of the patent rights claimed by the present invention. All changes or substitutions that are equal or equivalent to the above-mentioned embodiments should be construed as being covered within the spirit or scope of the present invention. Therefore, the protection scope of the present invention should be defined by the following patent application scope.

100:Intelligent imaging and measurement system

120: Ranging and imaging device

122: Acquisition unit

124: Ranging unit

140: Image processing device

142:Database

144: Computing Module

146: Stacking module

148: Measurement module

160: Display device

200:Object

220: Original image file

240: processed image file

Claims (10)

An intelligent image capturing and measuring system, the system includes: at least one ranging image capturing device, including: at least one image capturing unit, used to capture an image of an object, and generate at least one original image file, and obtain the original image file A resolution information of the image file; at least one distance measuring unit for measuring a distance between the imaging unit and the object to generate a picture distance information; an image processing device, the signal is connected to the distance measuring and imaging an apparatus for calculating the actual size of the object in the original image file, the image processing apparatus includes: a database for storing a plurality of standard size information, each of which respectively includes a resolution per unit area , the acquisition distance, the corresponding pixel matrix and the corresponding actual size; a calculation module, the signal is connected to the database, according to the resolution information and the acquisition distance information of the original image file, compare the data in the database The standard size information is calculated to generate a processed image file with actual size information; and a display device is connected to the image processing device with a signal for displaying the original image file or the processed image file. The intelligent imaging and measurement system according to claim 1, wherein the system further comprises a superimposing module, when the object has a design drawing, for superimposing the design drawing and the processed image file, and Also displayed on the display device. The intelligent imaging and measurement system according to claim 1, wherein the system further includes a measurement module for manually performing virtual measurement on the processed image file to generate a size measurement data. The intelligent imaging and measurement system according to claim 1, wherein the distance measuring unit comprises a laser range finder, a visible light range finder, an infrared range finder or a stepping motor. The intelligent imaging and measurement system according to claim 1, wherein the calculation method of the calculation module includes a regression analysis method. A method for intelligent image acquisition and measurement, comprising the following steps: preparing a plurality of standard size information, wherein each of the standard size information includes resolution per unit area, image acquisition distance, corresponding pixel matrix and corresponding actual size information respectively. size; capture an image of an object, obtain an original image file, and capture resolution information and image-taking distance information of the original image file; calculate an actual size information of the original image file through the standard size information , and append it to the original image file to obtain a processed image file; after superimposing the design drawing of the object with the processed image file, display the resulting superimposed image on a display device; and The superimposed image is subjected to virtual measurement. The intelligent image acquisition method as claimed in claim 6, wherein the method for calculating the actual size information of the original image file includes a regression analysis method. A method for intelligent image acquisition and measurement, comprising the following steps: preparing a plurality of standard size information, wherein each of the standard size information includes resolution per unit area, image acquisition distance, corresponding pixel matrix and corresponding actual size information respectively. size; Capture an image of an object, obtain an original image file, and capture resolution information and image capturing distance information of the original image file; calculate an actual size information of the original image file through the standard size information, and Attaching to the original image file to obtain a processed image file; and displaying the processed image file on a display device. The intelligent image capturing method according to claim 8 further includes the step of displaying the processed image file on the display device: performing virtual measurement on the processed image file. The intelligent image acquisition method as claimed in claim 8, wherein the method for calculating the actual size information of the original image file includes a regression analysis method.

Images