TWM616271U - Smart image taking and measurement system - Google Patents

Abstract

In order to obtain the actual size of the object in the image in real time after capturing the image of the object, and further perform virtual measurement. The present model provides an intelligent image capturing and measuring system. The system includes a distance measuring image capturing device, an image processing device and a display device. The above-mentioned distance measuring and capturing device is used for capturing the image of the object and recording the capturing distance. The image processing device is used to calculate the actual size of the object and perform virtual measurement. The above-mentioned display device is used for displaying the image of the above-mentioned object.

Description

Smart imaging and measurement system

This model is a system and method for intelligent image capturing and measurement, especially a technology for real-time output of the actual size of the photographed object.

At present, the imaging system for measuring the actual size needs to be erected at a fixed and known height, and a control object (usually a ruler with a specific unit scale) is placed in the imaging field of view. The imaging system then photographs the object and the reference object at the same time to compare the actual size of the object.

The above-mentioned method must rely on artificially penetrating the control object in the image to estimate the actual size of the object, which is more suitable for processing a small number of images. If it is used on a production line, the above method will not be effective due to the large quantity to be inspected, and the imaging system of the above method must also be calibrated regularly to maintain the accuracy of the image and increase the cost of many production lines. .

According to the deficiencies in the prior art, the technical field requires an imaging system that does not require a fixed height, does not require a reference object, and can calculate the actual size of the object in the image in real time. Therefore, how to achieve an imaging system that meets the above conditions has become a problem to be overcome in the technical field.

In order to solve the above-mentioned problems, the embodiment of the present invention develops a smart imaging and measurement system. The above-mentioned system integrates the functions of imaging, ranging and calculation, and can calculate at any imaging distance. The actual size of the object in the image. In addition to calculating the two-dimensional size information (X, Y) of the above-mentioned system, the above-mentioned system can obtain further height information for irregularly shaped objects through the built-in distance measurement unit to generate the three-dimensional size information of the object ( X, Y, Z). In the smart imaging and measurement system of the present invention, a database of standard size information is provided. The standard size information has a plurality of pixel matrix and actual size information corresponding to the imaging distance information and the resolution information. Therefore, the actual size of the object in the image can be calculated in real time through the object image captured by the present invention. The calculation method is to use regression analysis to calculate the actual size of the object’s length, width, and height by using the standard size information of the database in the above-mentioned system to calculate the actual size of the pixel matrix corresponding to the imaging distance information and the resolution information, so as to achieve The effect of real-time calculation of the actual size of the object in the image.

Specifically, the embodiment of the present invention provides a smart imaging and measurement system. The above-mentioned smart imaging and measurement system includes at least one distance measuring and imaging device, an image processing device and a display device. The aforementioned distance measuring and imaging device includes at least one imaging unit and at least one distance measuring unit. After the image capturing unit captures the image of the object, at least one original image file is generated, and the resolution information of the original image file is obtained. The distance measuring unit measures the image capturing distance between the image capturing unit and the object to generate image capturing distance information. The above-mentioned image processing device includes a database and a calculation module. The image processing device is signaled to connect the distance measuring and capturing device, and the actual size of the object in the original image file is calculated. The database is used to store a plurality of standard size information, each of the standard size information includes the resolution per unit area, the imaging distance, the corresponding pixel matrix, and the corresponding actual size. The calculation module signal is connected to the database, and based on the resolution information of the original image file and the imaging distance information, the standard size information in the database is compared, and the processed image with actual size information is calculated files. The signal of the display device is connected to the image processing device to display the original image file or the processed image file.

According to another embodiment, the above-mentioned image processing device further includes a stacking module. When the object has a design drawing, the superimposing module superimposes the design drawing and the processed image file, and simultaneously displays the design drawing on the display device.

According to another embodiment, the above-mentioned image processing device further includes a measurement module, which provides manual virtual measurement of the above-mentioned processed image file and generates size measurement data.

According to another embodiment, the above-mentioned distance measuring unit includes a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor.

According to another embodiment, the above-mentioned object may include, for example, a printed circuit board, a semiconductor wafer, or other electronic products.

According to another embodiment, the calculation method of the calculation module includes a regression analysis method.

The embodiment of the present invention further provides a smart image capturing and measurement method, including the following steps. A plurality of standard size information is prepared, and each standard size information includes the resolution of a unit area, the imaging distance, the corresponding pixel matrix, and the corresponding actual size. Capture the image of the object, obtain the original image file, and capture the resolution information and the image capturing distance information of the original image file. According to the multiple standard size information, the actual size information of the original image file is calculated and appended to the original image file to obtain the processed image file. After superimposing the design drawing of the above-mentioned object and the above-mentioned processed image file, one of the obtained superimposed images is displayed on the display device. Perform virtual measurement on the above-mentioned superimposed images.

According to another embodiment, the method for calculating the actual size information of one of the original image files includes regression analysis.

Based on the technical features of the above embodiments, the following effects can be specifically claimed.

(1) There is no need to perform system calibration regularly, and there is no need to measure the imaging distance in advance, which can simplify the process of setting up the imaging system.

(2) This system can calculate the actual size of the object in the image in real time after taking the image, and can cooperate with a compatible virtual measurement module to measure the specific position of the object. For example, the user can view the processed image through the display device. And when at least two points (ie coordinates) are clicked, the actual distance between the two points is calculated instantly. It can also be used for virtual measurement of the defect location of the product, unlike the previous manual field measurement.

(3) For objects with irregular shapes, the distance measurement unit of this system can obtain multiple image acquisition distances by completely scanning the upper surface of the object or obtaining multiple sampling points on the object to obtain the complete height information of the object. For example: Take a sample of 100,000 points on the upper surface of the object, and obtain the imaging distance information corresponding to these sampling points to estimate the height information of the surface of the object. Therefore, when the user views the 2D image through the display device, it is actually looking down on a three-dimensional object. Therefore, when the upper surface of the object has inconsistent heights, the user clicks on the two points of the processed image to perform virtual calculations. In fact, the distance between the two three-dimensional coordinates (X, Y, Z) is calculated to obtain the actual object. The size is closer to the actual measurement result.

100: Smart imaging and measurement system

120: Ranging imaging device

122: Acquisition unit

124: Ranging unit

140: Image processing device

142: Database

144: Computing Module

146: Laminated Module

148: Measurement Module

160: display device

200: Object

220: Original image file

240: Processed image file

301-307: steps

In order to make the above and other objects, features, advantages and embodiments of the present invention more obvious and understandable, the description of the attached drawings is as follows: Figure 1 depicts a smart image capture and measurement according to one embodiment of the present invention Schematic diagram of the system's installation.

FIG. 2 is a flowchart of a smart image capturing and measurement system according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of image display of a smart image capturing and measuring system according to an embodiment of the present invention.

In order to more specifically describe the various embodiments of the present invention, the following description is supplemented with the accompanying drawings.

Please refer to FIG. 1. FIG. 1 is a schematic diagram of the architecture of a smart imaging and measurement system according to an embodiment of the present invention. In FIG. 1, according to an embodiment, a smart imaging and measurement system 100 is provided. The smart imaging and measurement system 100 includes at least one distance measuring and imaging device 120, an image processing device 140 and a display device 160.

The aforementioned distance measuring and imaging system 120 includes at least one imaging unit 122 and at least one distance measuring unit 124. The above-mentioned image capturing unit 122 performs static or dynamic image capturing of the object 200 and generates an original image file 220. The image capturing unit 122 can adjust the resolution of image capturing before capturing the image of the object 200, and after capturing, append the resolution information to the original image file 220. The above-mentioned image capturing unit 122 may be a camera, a video camera or a scanner with a static or dynamic image capturing function. The distance measuring unit 124 can measure the image capturing distance between the image capturing unit 122 and the object 200 and store the image capturing distance information in the original image file 220. According to another embodiment of the present invention, the above-mentioned distance measuring unit 124 includes a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor.

The image processing device 140 calculates the resolution information and the image capturing distance information of the original image file 220 to generate a processed image file with actual size information. 240, and can further perform image overlay or virtual measurement according to requirements. The aforementioned image processing device 140 is a computer or a portable device with arithmetic function. The above-mentioned image processing device 140 includes a database 142, a calculation module 144, an overlay module 146, and a measurement module 148.

The aforementioned database 142 stores a plurality of standard size information in advance, and each standard size information includes the resolution corresponding to a unit area, the imaging distance, and the corresponding pixel matrix, for example: the imaging distance of 1m and 1920×1080 Under the condition of image capture with the image capturing resolution, ^{the pixel matrix corresponding to a unit area of 1mm 2} is a 2×2 matrix, that is, ^{a unit area of 1mm 2} is displayed using 4 pixels of the display device. The aforementioned database 142 is a hard disk with storage function, for example, a mechanical hard disk, a solid-state hard disk, or an external hard disk.

The calculation module 144 searches for standard size information with the same image capturing conditions among the multiple standard size information in the database 142 based on the resolution information and the imaging distance information of the original image file 220 , Used to calculate the actual size of the object 200. Then, the actual size information of the object 200 is appended to the original image file 220 to become the processed image file 240. According to another embodiment of the present invention, the calculation method of the calculation module 144 includes a regression analysis method.

When the object 200 has a design drawing, the superimposing module 146 can superimpose the design drawing and the processed image file 240 and display it on the display device 160 at the same time, so that the user can compare the design drawing of the object 200. Design drawing and processed image 240.

The measurement module 148 can manually perform virtual measurement on the processed image file 240 to generate size measurement data.

According to another embodiment of the present invention, when the height of the object 200 fluctuates within a tolerable value, such as ±0.1 mm, which can be regarded as a flat object, the distance measuring unit 124 can obtain the corresponding reference point through the reference point set by the object 200 in advance. The imaging distance information of the point, the calculation module 144 mentioned above is based on The above-mentioned image capturing distance information calculates the actual size of the above-mentioned object 200 in other areas other than the reference point. The purpose of obtaining the above-mentioned image capturing distance information through the reference point can be applied to the manufacturing process of the printed circuit board. For example, the above-mentioned object 200 is a printed circuit board, and a reference point can be preset on the manufacturing of the above-mentioned printed circuit board as a position for obtaining the image capturing distance information. Because the printed circuit board is an object with approximately the same height, the imaging distance information obtained by the single-point distance measurement of the reference point can be used to calculate the actual size of the printed circuit board in other areas outside the reference point. The above-mentioned reference point can be any point on the printed circuit board, for example: a point marked in advance on the printed circuit board or a position where solder resist ink is not applied.

According to the embodiment of the present invention, please refer to FIG. 1 and FIG. 2 and FIG. 3 at the same time. FIG. 2 is a flowchart of a method for smart image capturing and measurement according to an embodiment of the present invention.

In Figure 2, step 301 is the beginning.

In step 302, a plurality of standard size information used for comparison calculation is stored in the database 142 of the image processing device 140 in advance. The above standard size information is detailed as above, so I won’t repeat it here.

In step 303, the distance measuring and capturing device 120 captures at least one image of the object 200 and saves it as a corresponding original image file 220. The original image file 220 includes resolution information and image capturing distance information. The source of the resolution information and image capturing distance information is as described above, and will not be repeated here.

In step 304, the image processing device 140 calculates the actual size information of the object 200 in the original image file 220 according to the resolution information and the imaging distance information of the original image file 220, and generates a processed image file 240. For example, under the condition of capturing images with a capturing distance of 1m and a capturing resolution of 1920*1080, ^{the pixel matrix corresponding to a unit area of 1mm 2} is a 2×2 matrix. The above object 200 is in the original image file 220 It is composed of a matrix with a medium length and a width of 200×200, that is, the actual area of the above object 200 is calculated to be 10000 mm ² . The calculated actual size information is appended to the original image file 220 to generate a processed image file 240.

In step 305, according to the resolution set by the display device 160, the processed image file 240 to be displayed is scaled up or down and displayed on the display device 160. Please refer to FIG. 3 for the schematic diagram of image display, which is a schematic diagram of the image display of a smart imaging and measurement system according to an embodiment of the present invention. When the object 200 has an irregular shape, the three-dimensional size of the object 200 can be recorded through the distance measuring function of the distance measuring and imaging device 120, and the height information can be further marked on the 2D image display in the display device 160. In FIG. 3, the height information of the upper surface of the object 200 is presented in a gradual way of color shades. But it is not limited to the above-mentioned presentation method, and the height information can also be expressed in other suitable ways. The distance measurement function of the above-mentioned distance measurement and imaging device 120 may be single-point distance measurement, scanning distance measurement or multi-point distance measurement. The above-mentioned single-point ranging is suitable for the object 200 with a uniform height; the above-mentioned scanning ranging or multi-point ranging is suitable for the upper surface of the object 200 with irregular height.

In step 306, the processed image file 240 displayed on the above-mentioned display device 160 is provided for the user to perform virtual measurement. For example, the user clicks on two points in the processed image displayed by the display device 160 to calculate the actual distance between the two points. In fact, the measuring device 148 of the image processing device 140 will calculate the distance between the above two points on the three-dimensional coordinates (X, Y, Z), not simply the distance on the two-dimensional coordinates (X, Y). Therefore, an accurate virtual measurement result can be achieved.

In step 307, the process ends.

In summary, the embodiment of the present invention is a smart image capturing and measuring system that can provide users with no need to measure the size of the object 200 on the spot, but by capturing the image of the object 200 and then executing it through the display device 160. Virtual measurement to effectively save the cost of manual measurement. Furthermore, through this After calculating the length, width, and height of the object 200 in the image, the new system can easily measure the size of the irregularly shaped object 200 on the display device 160, effectively overcoming the difficulty of manual measurement.

The present invention is disclosed in the preferred embodiments in this text. However, anyone familiar with the technical field should understand that the above-mentioned embodiments are only used to describe the present invention and are not intended to limit the scope of the patent rights claimed by the present invention. Any changes or substitutions that are equal or equivalent to the above-mentioned embodiments should be interpreted as being covered by the spirit or scope of the present invention. Therefore, the scope of protection of this new model shall be subject to the scope of the following patent applications.

100: Smart imaging and measurement system

120: Ranging imaging device

122: Acquisition unit

124: Ranging unit

140: Image processing device

142: Database

144: Computing Module

146: Laminated Module

148: Measurement Module

160: display device

200: Object

220: Original image file

240: Processed image file

Claims (5)

A smart image capturing and measuring system, the system includes: at least one range-finder image capturing device, including: at least one image capturing unit for capturing an image of an object, generating at least one original image file, and obtaining the original image One of the resolution information of the image file; at least one ranging unit for measuring the imaging distance between the imaging unit and the object to generate an imaging distance information; an image processing device, signal connected to the ranging imaging A device for calculating the actual size of the object in the original image file, the image processing device includes: a database for storing a plurality of standard size information, each of the standard size information includes a resolution of a unit area , The image capturing distance, the corresponding pixel matrix and the corresponding actual size; a calculation module, the signal is connected to the database, according to the resolution information of the original image file and the image capturing distance information, compare the data in the database The standard size information is calculated to generate a processed image file with actual size information; and a display device is connected to the image processing device in signal to display the original image file or the processed image file. The smart image capturing and measurement system according to claim 1, wherein the system further includes a stacking module, when the object has a design drawing, the design drawing is used for superimposing the design drawing with the processed image file, and Simultaneously displayed on the display device. The smart imaging and measurement system according to claim 1, wherein the system further includes a measurement module for manually performing virtual measurement on the processed image file to generate a size measurement data. The smart imaging and measurement system according to claim 1, wherein the distance measuring unit includes a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor. The smart imaging and measurement system according to claim 1, wherein the calculation method of the calculation module includes a regression analysis method.

Images