CN114963971A - Intelligent image taking and measuring system and method - Google Patents
Intelligent image taking and measuring system and method Download PDFInfo
- Publication number
- CN114963971A CN114963971A CN202110219372.3A CN202110219372A CN114963971A CN 114963971 A CN114963971 A CN 114963971A CN 202110219372 A CN202110219372 A CN 202110219372A CN 114963971 A CN114963971 A CN 114963971A
- Authority
- CN
- China
- Prior art keywords
- image
- image file
- capturing
- information
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/022—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by means of tv-camera scanning
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
In order to obtain the actual size of the object in the image and further perform virtual measurement after capturing the image of the object. The application provides an intelligent image capturing and measuring system, which comprises a distance measuring image capturing device, an image processing device and a display device. The distance measuring and image capturing device is used for capturing images of objects and recording image capturing distances. The image processing device is used for calculating the actual size of the object and executing virtual measurement. The display device is used for displaying the image of the object.
Description
Technical Field
The present application relates to a system and method for intelligent image capture and measurement, and more particularly to a technique for outputting the actual size of a shot object in real time.
Background
Currently, an image capturing system for measuring actual dimensions needs to be erected at a fixed known height, and a contrast object (usually a ruler with specific unit scales) is placed in an image capturing field of view. The image capturing system simultaneously captures an object of the object and a comparison object, so as to compare the actual size of the object.
The above method relies on manual work to estimate the actual size of the object through the contrast in the image, and is suitable for processing a small number of images. If the method is used in production line, the number of the detected images is large, the method is not good for benefit, and the image capturing system of the method also needs to perform calibration periodically, so as to maintain the image accuracy and increase the cost of many production lines.
According to the current technical shortcomings, there is a need in the art for an image capturing system that does not require a fixed height, does not require a reference, and can calculate the actual size of an object in an image in real time. Therefore, how to achieve an image capturing system meeting the above requirements is a problem to be overcome in the technical field.
Disclosure of Invention
In order to solve the above problems, embodiments of the present application develop an intelligent image capturing and measuring system, which integrates the functions of image capturing, distance measuring and calculating, and can calculate the actual size of the object in the image at any image capturing distance. In addition to calculating two-dimensional size information (X, Y), the system can further obtain height information for an irregularly shaped object through a built-in ranging unit to generate three-dimensional size information (X, Y, Z) of the object. The intelligent image capturing and measuring system of the present application has a database of standard dimension information, which has a plurality of pixel matrixes corresponding to image capturing distance information and resolution information, and actual dimension information. Therefore, the actual size of the object in the image can be calculated in real time through the object image captured by the application. The calculation method uses regression analysis method to calculate the actual size of the object length, width and height by using the standard size information of the database in the system to calculate the actual size of the object in the image.
Specifically, the embodiment of the present application provides an intelligent image capturing and measuring system. The intelligent image capturing and measuring system comprises at least one distance measuring image capturing device, an image processing device and a display device. The distance measuring and image capturing device comprises at least one image capturing unit and at least one distance measuring unit. After the image of the object is captured by the image capturing unit, at least one original image file is generated, and the resolution information of the original image file is obtained. The distance measuring unit measures the image capturing distance between the image capturing unit and an object to generate image capturing distance information. The image processing device comprises a database and a calculation module. The image processing device is in signal connection with the distance measuring and image capturing device and calculates the actual size of the object in the original image file. The database is used for storing a plurality of standard size information, and each standard size information respectively comprises a resolution ratio of a unit area, an image capturing distance, a corresponding pixel matrix and a corresponding actual size. The calculation module is in signal connection with the database, compares the standard size information in the database according to the resolution information and the image capturing distance information of the original image file, and calculates and generates a processed image file with actual size information. The display device displays the original image file or the processed image file.
According to another embodiment, the image processing apparatus further includes a stacking module. When the object has a design drawing, the superposition module superposes the design drawing and the processed image file and simultaneously displays the image file on the display device.
According to another embodiment, the image processing apparatus further includes a measurement module for manually performing virtual measurement on the processed image file and generating size measurement data.
According to another embodiment, the distance measuring unit comprises a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor.
According to another embodiment, the object may comprise a printed circuit board, a semiconductor wafer, or other electronic product.
According to another embodiment, the calculation method of the calculation module comprises a regression analysis method.
The embodiment of the present application further provides an intelligent image capturing and measuring method, which includes the following steps. A plurality of standard size information are prepared, wherein each standard size information respectively comprises a resolution of a unit area, an image capturing distance, a corresponding pixel matrix and a corresponding actual size. Capturing an image of an object, obtaining an original image file, and capturing resolution information and image capturing distance information of the original image file. Calculating the actual size information of the original image file through the plurality of standard size information, and adding the actual size information to the original image file to obtain a processed image file. And superposing the design drawing of the object and the processed image file, and displaying an obtained superposed image on a display device. And performing virtual measurement on the superposed image.
According to another embodiment, the method of calculating the actual size information of the original image file includes a regression analysis method.
In combination with the above-mentioned technical features of the embodiments, the following effects can be specifically claimed.
(1) The system calibration is not required to be executed regularly, and the image capturing distance is not required to be measured in advance, so that the process of setting the image capturing system can be simplified.
(2) The system can calculate the actual size of the object in the image in real time after image capture, and can be matched with a compatible virtual measurement module to measure the specific position of the object, such as: the user views the processed image through the display device, and calculates the actual distance between two points in real time when at least two points (i.e. coordinates) are clicked. And can be applied to virtually measure the flaw location of the product, unlike manual field measurements that were required in the past.
(3) For an irregular object, the distance measuring unit of the system can obtain a plurality of image capturing distances by completely scanning the upper surface of the object or obtaining a plurality of sampling points on the object so as to obtain the height information of the complete object. For example: sampling 10 ten thousand points on the upper surface of the object, and respectively obtaining the image-taking distance information corresponding to the sampling points so as to estimate the height information of the surface of the object. Therefore, when the user views the 2D image through the display device, the user actually looks down a stereoscopic object. Therefore, when the upper surface of the object has inconsistent height, the user clicks two points of the processed image to perform virtual calculation, and actually calculates the distance between two three-dimensional coordinates (X, Y, Z) so as to obtain the actual size of the object and to be closer to the result of real measurement.
Drawings
In order to make the aforementioned and other objects, features, advantages and embodiments of the present application more comprehensible, the following description is given:
fig. 1 is a schematic diagram illustrating an apparatus of an intelligent image capture and measurement system according to an embodiment of the present application.
Fig. 2 is a flowchart illustrating an intelligent image capture and measurement system according to an embodiment of the present application.
Fig. 3 is a schematic diagram illustrating an image display of an intelligent image capture and measurement system according to an embodiment of the present application.
Description of reference numerals:
100: the smart image capture and measurement system 120: distance measuring and image taking device
122: the image capturing unit 124: distance measuring unit
140: image processing device 142: database with a plurality of databases
144: the calculation module 146: laminated module
148: the measurement module 160: display device
200: an item 220: original image file
240: processed image file 300-307: step (ii) of
Detailed Description
To more particularly describe the embodiments of the present application, reference is made to the following description taken in conjunction with the accompanying drawings.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an architecture of an intelligent image capturing and measuring system according to an embodiment of the present disclosure. In fig. 1, an intelligent imaging and metrology system 100 is provided, according to one embodiment. The smart image capture and measurement system 100 includes at least one distance measurement image capture device 120, an image processing device 140, and a display device 160.
The distance-measuring image-capturing system 120 includes at least one image-capturing unit 122 and at least one distance-measuring unit 124. The image capturing unit 122 performs static or dynamic image capturing on the object 200 and generates an original image file 220. The image capturing unit 122 may adjust the resolution of image capturing before capturing the image of the object 200, and after capturing, add the resolution information to the original image file 220. The image capturing unit 122 may be a camera, a video camera or a scanner with a still or moving image capturing function. The distance measuring unit 124 measures the image capturing distance between the image capturing unit 122 and the object 200, and stores the image capturing distance information in the original image file 220. According to another embodiment of the present application, the distance measuring unit 124 includes a laser distance meter, a visible light distance meter, an infrared distance meter or a stepping motor.
The image processing device 140 calculates the resolution information of the original image file 220 and the image-capturing distance information to generate a processed image file 240 having actual size information, and further performs image overlay or virtual measurement according to the requirement. The image processing device 140 is a calculator or a portable device with an operation function. The image processing apparatus 140 includes a database 142, a calculation module 144, a superposition module 146, and a measurement module 148.
The database 142 stores a plurality of standard size information in advance, each standard size information includes a resolution, an image-capturing distance, and a corresponding pixel matrix corresponding to a unit area, for example: under the condition of image capture with the imaging distance of 1m and the imaging resolution of 1920 × 1080, 1mm 2 The pixel matrix corresponding to the unit area of (1) is a 2 x 2 matrix, i.e., 1mm 2 The unit area of the display device is displayed by using 4 pixels. The database 142 is a hard disk with a storage function, such as a mechanical hard disk, a solid state hard disk, or an external hard disk.
The calculating module 144 searches for standard size information having the same image capturing condition from the plurality of standard size information of the database 142 according to the resolution information and the image capturing distance information of the original image file 220, and calculates the actual size of the object 200. The actual size information of the object 200 is then appended to the original image file 220 to form a processed image file 240. According to another embodiment of the present application, the calculation method of the calculating module 144 includes a regression analysis method.
When the object 200 has a design drawing, the overlay module 146 can overlay the design drawing and the processed image file 240 and display the overlay on the display device 160, so that a user can compare the design drawing of the object 200 with the processed image file 240.
The measurement module 148 allows manual virtual measurement of the processed image file 240 to generate dimensional measurement data.
According to another embodiment of the present disclosure, when the height fluctuation of the object 200 is within a tolerance value, such as ± 0.1mm, and the object can be regarded as a flat object, the distance measuring unit 124 can obtain the image capturing distance information corresponding to the reference point through the reference point previously set by the object 200, and the calculating module 144 calculates the actual size of the other area of the object 200 outside the reference point according to the image capturing distance information. The purpose of obtaining the image-capturing distance information through the datum point can be applied to the manufacturing process of the printed circuit board. For example: the object 200 is a printed circuit board, and a reference point is previously set on the printed circuit board as a position for acquiring the image capturing distance information. Because the printed circuit board is an object with approximately consistent height, the image-capturing distance information obtained by single-point ranging of the datum point can be used for calculating the actual size of other areas of the printed circuit board outside the datum point. The reference point may be any point on the printed circuit board, for example: a dot or a position not covered with solder resist ink is marked in advance on the printed circuit board.
According to an embodiment of the present application, please refer to fig. 1 and fig. 2 and fig. 3 simultaneously. FIG. 2 is a flowchart illustrating a method for smart imaging and measurement according to an embodiment of the present application.
In fig. 2, step 301 is the start.
In step 302, the standard size information for comparison calculation is stored in the database 142 of the image processing apparatus 140 in advance. The above standard size information is described in detail above, and will not be described herein again.
In step 303, the range finder 120 captures at least one image of the object 200 and stores the captured image into the corresponding original image file 220. The original image file 220 includes resolution information and image capturing distance information, which are derived as described above and will not be described herein again.
In step 304, the image processing device 140 calculates the actual size information of the object 200 in the original image file 220 according to the resolution information and the image capturing distance information of the original image file 220, and generates a processed image file 240. For example, under the condition of image capture with the imaging distance of 1m and the imaging resolution of 1920 × 1080, 1mm 2 The pixel matrix corresponding to the unit area of (2) is a 2 x 2 matrix, and the object 200 is composed of a 200 x 200 matrix with a length and a width in the original image file 220, i.e. the actual area of the object 200 is calculated to be 10000mm 2 . And adds the calculated actual size information to the original image file 220 to generate a processed image file 240.
In step 305, the processed image file 240 to be displayed is displayed on the display device 160 in an enlarged or reduced scale according to the resolution set by the display device 160. Referring to fig. 3, an image display diagram is shown, and fig. 3 is a diagram illustrating an image display of an intelligent image capturing and measuring system according to an embodiment of the present disclosure. When the object 200 is irregular, the distance measurement function of the distance measurement and image capture device 120 can record the three-dimensional size of the object 200, and further mark the height information on the 2D image displayed on the display device 160. In fig. 3, the height information of the upper surface of the object 200 is presented in a manner of gradually changing color shades. But is not limited to the above presentation, the height information may also be presented in other suitable ways. The distance measurement function of the distance measurement and image capture device 120 may be single-point distance measurement, scanning distance measurement or multi-point distance measurement. The single point ranging described above is suitable for use with objects 200 of a highly uniform type; the above-described scanning ranging or multi-point ranging is suitable for the upper surface of the object 200 having an irregular height.
In step 306, the processed image file 240 displayed on the display device 160 is provided to the user for performing the virtual measurement. For example, the user may calculate the actual distance between two points by clicking the two points in the processed image displayed by the display device 160. In practice, the measuring device 148 of the image processing apparatus 140 will calculate the distance between the two points in three-dimensional coordinates (X, Y, Z), not simply in two-dimensional coordinates (X, Y). Therefore, an accurate virtual measurement result can be achieved.
In step 307, the process ends.
In summary, the embodiment of the present application provides an intelligent image capturing and measuring system, which allows a user to perform a virtual measurement through the display device 160 after capturing an image of the object 200 without actually measuring the size of the object 200, so as to effectively save the cost of manual measurement. Moreover, after the system calculates the length, width and height information of the object 200 in the image, the size of the irregular-shaped object 200 can be easily measured virtually on the display device 160, thereby effectively overcoming the difficulty in manual measurement.
The present application discloses only preferred embodiments, but any person skilled in the art should understand that the above embodiments are only used for describing the present application, and not for limiting the claims of the present application. All changes and substitutions that are equivalent or equivalent to the above-described embodiments are intended to be included within the spirit and scope of the present application. Therefore, the protection scope of the present application shall be defined by the claims to be described below.
Claims (7)
1. A smart imaging and metrology system, the system comprising:
at least one distance measuring and image capturing device, comprising:
the image capturing unit is used for capturing an image of an object, generating at least one original image file and acquiring resolution information of the original image file;
at least one distance measuring unit for measuring an image capturing distance between the image capturing unit and the object to generate image capturing distance information;
an image processing device in signal connection with the distance-measuring and image-capturing device for calculating the actual size of the object in the original image file, the image processing device comprising:
a database for storing a plurality of standard size information, each of the plurality of standard size information respectively including a resolution of a unit area, an image capture distance, a corresponding pixel matrix and a corresponding actual size;
a calculation module, which is in signal connection with the database, compares the standard size information in the database according to the resolution information and the image capturing distance information of the original image file, and calculates and generates a processed image file with actual size information; and
and the display device is used for displaying the original image file or the processed image file.
2. The intelligent imaging and metrology system of claim 1, wherein the system further comprises a overlay module for overlaying a design drawing on the object with the processed image file and displaying the same on the display device when the object has the design drawing.
3. The intelligent imaging and metrology system of claim 1, wherein the system further comprises a metrology module configured to manually perform virtual metrology on the processed image file to generate a dimensional metrology data.
4. The smart imaging and metrology system of claim 1, wherein the ranging unit comprises a laser rangefinder, a visible range finder, an infrared rangefinder, or a stepper motor.
5. The system for smart imaging and metrology of claim 1, wherein the computing module is configured to perform a calculation based on regression analysis.
6. A method for smart imaging and measurement includes the following steps:
preparing a plurality of standard size information, wherein each standard size information respectively comprises a resolution ratio of a unit area, an image-taking distance, a corresponding pixel matrix and a corresponding actual size;
capturing an image of an object, obtaining an original image file, and capturing resolution information and image capturing distance information of the original image file;
calculating actual size information of the original image file through the plurality of standard size information, and adding the actual size information to the original image file to obtain a processed image file;
superposing the design drawing of the object with the processed image file, and displaying an obtained superposed image on a display device; and
and performing virtual measurement on the superposed image.
7. The method for intelligently imaging as claimed in claim 6, wherein the method for calculating a physical dimension information of said original image file comprises regression analysis.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110219372.3A CN114963971A (en) | 2021-02-26 | 2021-02-26 | Intelligent image taking and measuring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110219372.3A CN114963971A (en) | 2021-02-26 | 2021-02-26 | Intelligent image taking and measuring system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114963971A true CN114963971A (en) | 2022-08-30 |
Family
ID=82973848
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110219372.3A Pending CN114963971A (en) | 2021-02-26 | 2021-02-26 | Intelligent image taking and measuring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114963971A (en) |
-
2021
- 2021-02-26 CN CN202110219372.3A patent/CN114963971A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10825198B2 (en) | 3 dimensional coordinates calculating apparatus, 3 dimensional coordinates calculating method, 3 dimensional distance measuring apparatus and 3 dimensional distance measuring method using images | |
| US10724848B2 (en) | Method and apparatus for processing three-dimensional vision measurement data | |
| EP3848901A2 (en) | Method and apparatus for calibrating external parameters of image acquisition device, device and storage medium | |
| Sun et al. | An empirical evaluation of factors influencing camera calibration accuracy using three publicly available techniques | |
| CN100458359C (en) | Small-displacement measuring system in long-distance plane | |
| JP2010008352A (en) | Size measuring method and size measuring device | |
| CN111872544B (en) | Calibration method and device for laser light-emitting indication point and galvanometer coaxial vision system | |
| JP2014102246A (en) | Position attitude detection system | |
| CN104729422A (en) | Method for calibrating a laser measuring device and system therefor | |
| CN111192235A (en) | Image measuring method based on monocular vision model and perspective transformation | |
| CN113281723B (en) | AR tag-based calibration method for structural parameters between 3D laser radar and camera | |
| US20060008268A1 (en) | Three-dimensional image processing apparatus, optical axis adjusting method, and optical axis adjustment supporting method | |
| Boehm | Accuracy investigation for structured-light based consumer 3D sensors | |
| WO2018168757A1 (en) | Image processing device, system, image processing method, article manufacturing method, and program | |
| CN115797359A (en) | Detection method and device based on solder paste on circuit board and storage medium | |
| Wang et al. | Measurement and analysis of depth resolution using active stereo cameras | |
| CN102759788A (en) | Surface multi-point focusing system and surface multi-point focusing method | |
| JP2018009927A (en) | Image processing device, image processing method and program | |
| CN114963971A (en) | Intelligent image taking and measuring system and method | |
| CN111121637A (en) | Grating displacement detection method based on pixel coding | |
| TWI765587B (en) | Intelligent imaging and measurement system and method | |
| CN113391298B (en) | Parameter calibration method and device for laser radar | |
| AU2009249003B2 (en) | Stereoscopic measurement system and method | |
| CN108627094A (en) | A kind of 3D laser measurement methods of parts height dimension | |
| CN110726996B (en) | Depth module ranging method, depth camera and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |