US20220044422A1 - Monocular vision-based method for measuring displacement and trajectory of planar motion - Google Patents
Monocular vision-based method for measuring displacement and trajectory of planar motion Download PDFInfo
- Publication number
- US20220044422A1 US20220044422A1 US17/507,968 US202117507968A US2022044422A1 US 20220044422 A1 US20220044422 A1 US 20220044422A1 US 202117507968 A US202117507968 A US 202117507968A US 2022044422 A1 US2022044422 A1 US 2022044422A1
- Authority
- US
- United States
- Prior art keywords
- edge
- displacement
- motion
- feature
- working surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000033001 locomotion Effects 0.000 title claims abstract description 144
- 238000006073 displacement reaction Methods 0.000 title claims abstract description 108
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000005259 measurement Methods 0.000 claims abstract description 50
- 238000003708 edge detection Methods 0.000 claims abstract description 5
- 238000005286 illumination Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 2
- 238000000691 measurement method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011076 safety test Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M7/00—Vibration-testing of structures; Shock-testing of structures
- G01M7/02—Vibration-testing by means of a shake table
- G01M7/06—Multidirectional test stands
-
- G06K9/3233—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V10/225—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30241—Trajectory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/06—Recognition of objects for industrial automation
Abstract
A monocular vision-based method for measuring displacement and trajectory of planar motion. In this method, a sequence image of a motion of a high-contrast feature mark fixed on a moving plane to be measured is collected using a camera. A sub-pixel coordinate of a feature edge of a linear motion of the sequence in an X direction and a Y direction is extracted using a sub-pixel edge detection method, and the sub-pixel coordinate is converted into a corresponding world coordinate. The world coordinate of the feature edge is fitted based on a least squares principle to obtain a straight line of the feature edge to realize decoupling measurement of a displacement in the X direction and the Y direction. The planar motion trajectory is obtained through measuring the displacement in the X direction and the Y direction.
Description
- This application claims the benefit of priority from Chinese Patent Application No. 202011139972.0, filed on Oct. 22, 2020. The content of the aforementioned application, including any intervening amendments thereto, is incorporated herein by reference in its entirety.
- The application relates to motion measurement, and more particularly to a monocular vision-based method for measuring a displacement and a trajectory of a planar motion.
- The displacement and trajectory measurement of planar motion has been widely used in pose estimation, inertial navigation and structure safety test of bridges and buildings. The planar motion measurement is the basis for measuring the multi-degree-of-freedom motion, and the measurement precision directly affects the overall performance of the system or device in practical engineering applications. The precision for measuring the displacement and trajectory of the planar motion has to be improved, so as to meet the increasing demand for high-precision measurement in practical engineering applications. Therefore, it is necessary to study a method for precisely measuring the displacement and trajectory of the planar motion.
- At present, the commonly used methods for measuring the displacement and trajectory of the planar motion include the laser interferometric method and the sensor-based measuring method. The laser interferometric method based on Doppler velocity measurement and laser interference principle has strong anti-interference ability, good dynamic performance, wide measurement frequency range and high linearity, and can realize a high-precision measurement of the displacement and trajectory of the planar motion. However, the measurement system of the interferometric method is of high complexity, high cost, and poor flexibility, and is difficult to be used for measuring the low-frequency motion with a large displacement range. The sensor-based measuring method merely requires a two-axis or three-axis vibration sensor to measure the displacement and trajectory of the planar motion. This method has simple measurement system, low cost, high flexibility and high efficiency. Nevertheless, the frequency of the sensor itself limits the precision of the measurement. Whereas the monocular vision method has high efficiency, high flexibility, high precision and low cost, and the existing monocular vision method is able to meet a measurement precision of up to 10 μm in the displacement measurement, which is being widely used in practical engineering applications. Therefore, the monocular vision method can be used to measure the displacement and trajectory of the planar motion. Since any planar motion can be decomposed into linear motions in the X and Y directions, the displacement and trajectory of the planar motion can be obtained through decoupling the motion displacement of the planar motion in in the X and Y directions using the monocular vision method, which improves the measurement precision and reduces the complexity and cost of the measurement system at the same time, and has a high flexibility.
- In view of the problems that the existing method for measuring the displacement and trajectory of the planar motion has a measurement system of high complexity, poor flexibility, high cost and limited measurement range, and fails to meet the requirement of the low-frequency and high-precision measurement, the present disclosure provides an efficient, precise, flexible and low-cost monocular vision-based measurement method. A decoupling measurement of the planar motion based on the monocular vision converts the measurement of a multi-component planar motion into the measurement of a single-component linear motion, which improves the metrological traceability of the monocular vision method, and is the basis for the measurement of a six-degree-of-freedom motion.
- To solve the problems that the existing method for measuring the displacement and trajectory of the planar motion has a measurement system of high complexity, poor flexibility, high cost and limited measurement range, and fails to meet the requirement of the low-frequency measurement, this disclosure provides an effective and flexible method for accurately measuring a displacement and a trajectory of a planar motion, comprising:
- (I) collecting a sequence image of a motion of the high-contrast feature mark;
- fixing a high-contrast feature mark on a working surface of a low-frequency two-component shaker; collecting enough sequence images of a motion of the high-contrast feature mark using a camera, to ensure that a displacement of the planar motion can be precisely measured;
- (II) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image in an X direction and a Y direction;
- template matching is adopted to determine a region of interest in the sequence image of the high-contrast feature mark; extracting a sub-pixel coordinate of a feature edge point in the region of interest using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into the world coordinate;
- (III) solving the displacement of the feature edge of the linear motion in the X direction and the Y direction;
- respectively performing least-square fitting on the world coordinate of the feature edge point of the linear motion in the X direction and Y direction to obtain a corresponding fitting straight line; selecting a feature edge of the motion of the sequence image of high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; by calculating a distance between the feature edge of the linear motion of the sequence image and the corresponding edge of the reference image to obtain a displacement of the motion of the feature edge in the X direction and the Y direction; and
- (IV) solving the trajectory of the planar motion
- obtaining the corresponding peak value and the initial phase of the displacement, further solving to obtain the trajectory of the planar motion, based on the measured motion displacement of the feature edge in the X and Y directions fitted using a sine-approximation method.
- Specifically, the method comprises the following steps:
- (S1) fixing a high-contrast feature mark consisting of a rectangle and four circles around the rectangle on a working surface of a low-frequency two-component shaker, such that a displacement of the rectangle in the high-contrast feature mark is consistent with a displacement of the wording surface; and collecting a sequence image of a motion of the high-contrast feature mark using a camera;
- (S2) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image of the high-contrast feature mark in an X direction and a Y direction using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into a corresponding world coordinate;
- (S3) respectively performing least-square fitting on the world coordinate of the feature edge of the linear motion in the X direction and Y direction to obtain a straight line of the feature edge; selecting a feature edge of the motion of the of the sequence image of high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; calculating a distance between the feature edge of the linear motion of the sequence image and the zero-displacement reference edge to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction; and
- (S4) obtaining a planar motion trajectory of the working surface according to the displacement of the working surface in the X direction and the displacement of the working surface in the Y direction; and saving and displaying a measurement result of the displacement and the planar motion trajectory of the working surface.
- In some embodiments, the extraction of the feature edge of the linear motion of the sequence image in the X direction and the Y direction comprise:
- (1) determining a rectangular region in the sequence image of the high-contrast feature mark;
- wherein template matching is adopted to determine four circular regions in the sequence image of the high-contrast feature mark to improve stability and precision in extracting the feature edge of the linear motion; the rectangle is located in a region of interest formed by centers of the four circular regions; and the feature edge is extracted in the region of interest to avoid a disturbance from an edge with similar background;
- (2) extracting a sub-pixel of an edge point of a long edge and a short edge of the rectangle;
- extracting the edge point of the long edge and the short edge of a pixel-level rectangle of a sequence image Fj(x,y) of the motion of the high-contrast feature mark using Canny operator, where j=1, 2, . . . , N, and N is the number of collected sequence image;
- obtaining a position error compensation of the long edge and the short edge of the rectangle through calculating Zernike moment of the sequence image Fj(x,y) to obtain a sub-pixel coordinate of the long edge and the short edge of the rectangle; and
- converting the sub-pixel coordinate of the long edge and the short edge of the rectangle into a corresponding world coordinate according to the relationship between the pixel coordinate and the world coordinate of the image; and
- (3) fitting the feature edge of the linear motion in the X direction and the Y direction;
- respectively fitting the world coordinate of the feature edge of the X direction and the Y direction based on the least squares principle to obtain a straight line {lj, X} of the feature edge of the linear motion in the X direction and a straight line {lj, Y} of the feature edge of the linear motion in the Y direction, where the sub-pixel coordinate of the long edge and the short edge of the rectangle is the feature edge of the linear motion in the X direction and the Y direction, respectively, and lj, X and lj, Y are equivalent edges of two long edges and two short edges of the rectangle in the sequence image Fj(x,y), respectively; and obtaining a straight line lr, X of the feature edge of linear motion in the X direction and a straight line lr, Y of the feature edge of linear motion in the Y direction of an image Fr(x,y) of the high-contrast feature mark at the zero position of the working surface.
- In some embodiments, a motion of the working surface of the low-frequency two-component shaker is obtained by decoupling an edge displacement in the X direction and the Y direction; and the planar motion is described as a displacement sX(t) in the X direction and a displacement sY(t) in the Y direction:
-
- where, ωv is an angular frequency of vibration; ŝX and ŝ′Y are peak values of the displacement sX(t) and the displacement sY(t), respectively; φX and φY are initial phases of the displacement sX(t) and the displacement sY(t), respectively;
- the straight line lr, X and the straight line lr, Y of the feature edge of the image Fr(x,y) are selected as the zero-displacement reference edge; a distance dj, X between the straight line lj, X of the feature edge of the sequence image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sX(tj) at a collecting moment tj; a distance dj, Y between the straight line lj, Y of the feature edge of the sequence image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sY(tj) at the collecting moment tj.
- In some embodiments, the displacement sX(tj) and the displacement sY(tj) at the collecting moment tj are respectively fitted using a sine-approximation method shown as follows:
-
- wherein parameters AX, BX, CX, AY, BY and CY are obtained by solving N corresponding equations, respectively; the peak value ŝX and the initial phase φX of the displacement of the planar motion in the X direction and the peak value ŝY and the initial phase φY of the planar motion in the Y direction are obtained as follows:
-
- a phase difference PD is defined as follows:
-
P D=|φX−φY| (4); - when the phase difference PD is 0° or 180°, the planer motion provided by the working surface has a linear trajectory; if and only if ŝX=ŝY and the phase difference PD is 90°, the planar motion provided by the working surface has a circular trajectory; and planar motions under other conditions all have an elliptical trajectory.
- In some embodiments, a device for implementing the method mentioned above, comprising:
- a low-frequency two-component shaker;
- a working surface;
- a high-contrast feature mark;
- an illumination device;
- a camera;
- a fixing device;
- an image transmission device; and
- an image processing and displaying unit;
- where the working surface of the low-frequency two-component shaker is configured to provide a motion of any trajectory in a plane; the high-contrast feature mark is fixed on the working surface, such that a motion of the high-contrast feature mark is consistent with a motion of the working surface; the illumination device is configured to provide illumination for the camera; the fixing device is configured for fixing the camera to allow an optical axis of the camera to be perpendicular to the high-contrast feature mark; the camera is configured to collect the sequence image of motion of the high-contrast feature mark; the image transmission device is configured to transmit the sequence image collected by the camera; the image processing and displaying unit is configured to process the sequence image collected by the camera, save and display a measurement result of the displacement and the trajectory of the planar motion.
- The beneficial effects of a method for measuring a displacement and a trajectory of a planar motion provided herein are described as follows.
- (1) This method is stable, reliable and practical, and can measuring the displacement and trajectory of the planar motion with different frequency and displacement range at the same time.
- (2) The measuring process of this method is simple, flexible and effective, and the system for this method has a low cost. A camera can meet the requirement for measuring the planar motion in different frequency ranges.
- (3) A displacement of the planar motion is accurately measured through decoupling measuring displacements of the planar motion in the X and Y directions.
- (4) This method is one of the methods for measuring the planar motion, and can realize a high-precision measurement of the displacement and trajectory of the planar motion within a certain frequency range.
- (5) This method decouples the measurement of the displacement and trajectory of the planar motion into the measurement of the displacements in the X and Y directions, which improves the metrological traceability of the monocular vision-based displacement measurement of the planar motion, and provides an effective way for accurately measuring a six-degree-of-freedom movement at the same time.
-
FIG. 1 schematically depicts a device for implementing a method for measuring a displacement and a trajectory of a planar motion based on monocular vision in accordance with an embodiment of the present disclosure; -
FIG. 2 is a flow chart for measuring the displacement and the trajectory of the planar motion based on monocular vision; -
FIG. 3 is a flow chart of a decoupling measurement of a displacement of the planar motion based on monocular vision; -
FIG. 4 shows a measurement result of a displacement and a trajectory of a motion of a working surface of a low-frequency two-component shaker in accordance with an embodiment of the present disclosure; -
FIG. 5 shows a measurement result of a displacement and a trajectory of a motion of a working surface of a low-frequency two-component shaker in accordance with an embodiment of the present disclosure; and -
FIG. 6 shows a measurement result of a displacement and a trajectory of a motion of a working surface of a low-frequency two-component shaker in accordance with an embodiment of the present disclosure. - To solve the problems that the existing method for measuring the displacement and trajectory of the planar motion has a measurement system of high complexity, poor flexibility, high cost and limited measurement range, this disclosure provides a monocular vision-based method for measuring displacement and trajectory of planar motion. Through decoupling the motion displacement of the planar motion in in the X and Y directions, this method realizes the high-precision measurement of the displacement and trajectory of the planar motion in the low frequency range. The following describes this disclosure in detail with reference to the drawings and specific embodiments.
-
FIG. 1 schematically depicts a device for implementing a method for measuring a displacement and a trajectory of a planar motion based on monocular vision. The device includes a low-frequency two-component shaker 1, a workingsurface 2, a high-contrast feature mark 3, anillumination device 4, a fixingdevice 5, acamera 6, animage transmission device 7, and an image processing and displayingunit 8. The workingsurface 2 of the low-frequency two-component shaker 1 is configured to provide a motion of any trajectory in a plane. The high-contrast feature mark 3 is fixed on the working surface, such that a motion of the high-contrast feature mark 3 is consistent with a motion of the workingsurface 2. Theillumination device 4 is configured to provide illumination for thecamera 6. The fixingdevice 5 is configured for fixing thecamera 6 to allow an optical axis of thecamera 6 to be perpendicular to the high-contrast feature mark 3. Thecamera 6 is configured to collect the sequence image of motion of the high-contrast feature mark 3. Theimage transmission device 7 is configured to transmit the sequence image collected by the camera. The image processing and displayingunit 8 is configured to process the sequence image collected by thecamera 6, save and display a measurement result of the displacement and the trajectory of the planar motion. -
FIG. 2 is a flow chart for measuring the displacement and the trajectory of the planar motion based on monocular vision. The measurement method provided herein mainly includes following steps. - (S1) A high-contrast feature mark is fixed on a working surface of a low-frequency two-component shaker. Enough sequence images of a motion of the high-contrast feature mark are collected using a camera.
- (S2) A sub-pixel coordinate of a feature edge of a linear motion of the sequence image in an X direction and a Y direction is extracted which includes the following steps. The region of interest in the mark image is determined; a sub-pixel of an edge point of a long edge and a short edge of the rectangle in the region of interest is extracted. The world coordinate of the feature edge point of the linear motion in the X direction and the Y direction is solved.
- (S3) The solution of the displacement of the motion of the feature edges in the X direction and the Y direction includes the following steps. The world coordinates of the feature edge of the linear motion in the X direction and the Y direction are fitted, respectively, based on a least squares principle to obtain a straight line of the feature edge. By calculating a distance between the feature edge of the linear motion in the X direction and the Y direction of the sequence image and the reference edge of the sequence image of the high-contrast feature mark at a zero position of the working surface to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction.
- (S4) The planar motion trajectory is solved as follows. The displacement of the motion in the X direction and the Y direction is fitted based on the sine approximation method, respectively, to obtain the peak value and initial phase of the corresponding displacement, so as to obtain the planar motion trajectory.
-
FIG. 3 is a flow chart of a decoupling measurement of a displacement of the planar motion based on monocular vision. The method provided herein includes the following steps. - (S11) The collected sequence image of the motion of the high-contrast feature mark is read in.
- (S12) The sub-pixel coordinate of a feature edge of a linear motion of the sequence image in an X direction and a Y direction is extracted using a Zernike moment-based sub-pixel edge detection method.
- (S13) According to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, the extracted sub-pixel coordinate is converted into the world coordinate.
- (S14) The world coordinates of the feature edge of the linear motion in the X direction and Y direction are fitted based on a least squares principle to obtain a straight line of the feature edge.
- (S15) The feature edge in the X direction and the Y direction of the sequence image of the high-contrast feature mark at a zero position of the low-frequency two-component shaker is selected as a zero-displacement reference edge. A distance between the feature edge in the X direction and the Y direction of the sequence image and the zero-displacement reference edge is calculated.
- (S16) The distance of the feature edge in the X direction and the Y direction in the sequence image is the displacement of motion of the working surface in the X direction and Y direction, respectively.
- The specific parameters of the device provided herein are described as follows. The low-frequency two-component shaker is of the frequency range from 0.01 to 100 Hz and the peak value displacement of 200 mm at the peak. The high-contrast feature mark is a metal plate consisted of a rectangle with the size of 60 mm×40 mm and four circles with the radius of 15 mm around the rectangle. The camera is an industrial camera (IDT OS10-V3-4K) with the maximum resolution of 9 million pixels and the maximum frame rate of 1000 fps. The camera lens (Kowa Company, Ltd, Japan) is with a focal length of 16 mm. The illumination device is an incandescent lamp of 60 W.
- In order to verify the precision of the method provided herein, the method is used to measure a displacement and a planar motion trajectory in a frequency range of 0.5-10 Hz. Table 1 shows the measurement results of a motion of a low-frequency two-component working table using the method provided herein and a laser interferometric method in a single peak displacement range of 2.5-80 mm, respectively. Table 1 shows that the measurement results of the monocular vision method and the laser interferometric method are similar; a maximum relative deviation is about 0.1%; and a maximum difference of a phase difference is less than 0.4°.
-
TABLE 1 Measurement results of a displacement of a planar motion using the monocular vision method and the laser interferometric method Monocular vision method Frequency SX (mm) SY (mm) PD (°) 0.5 79.719 80.089 45.411 0.8 80.430 80.795 44.710 1 80.458 80.822 44.566 2 62.296 62.545 44.673 5 10.014 10.015 44.254 8 3.938 3.949 44.379 10 2.520 2.529 44.510 Laser interferometric method Frequency SX (mm) SY (mm) PD (°) 0.5 79.700 80.017 44.615 0.8 80.394 80.802 44.371 1 80.484 80.845 44.487 2 62.315 62.552 44.322 5 10.013 10.014 44.522 8 3.936 3.948 44.351 10 2.518 2.529 44.396 -
FIGS. 4-6 respectively show a measurement result of a displacement and a trajectory of a motion of the working surface of the low-frequency two-component shaker. The measurement result shown inFIG. 4 is three linear trajectories: SX=81.057 mm, SY=80.905 mm and PD=0.063°; SX=80.576 mm, SY=40.047 mm and PD=−0.014°; SX=40.832 mm, SY=79.866 mm and PD=0.002°. The measurement result shown inFIG. 5 is three elliptical trajectories: SX=80.778 mm, SY=79.942 mm and PD=44.404°; SX=80.322 mm, SY=40.047 mm and PD=44.538°; SX=40.681 mm, SY=79.841 mm and PD=44.048°. The measurement result shown inFIG. 6 is a circular trajectory and two elliptical trajectories: SX=80.094 mm, SY=79.841 mm and PD=89.991°; SX=80.120 mm, SY=39.997 mm and PD=89.277°; SX=40.123 mm, SY=79.892 mm and PD=88.346°. - The embodiments mentioned above are illustrative, and are not intended to limit the present disclosure. Any replacements, improvements and modifications made by those skilled in the art without departing from the spirit of this disclosure should fall within the scope of the present application defined by the appended claims.
Claims (5)
1. A method for measuring a displacement and a trajectory of a planar motion based on monocular vision, comprising:
(S1) fixing a high-contrast feature mark consisting of a rectangle and four circles around the rectangle on a working surface of a low-frequency two-component shaker such that a displacement of the rectangle in the high-contrast feature mark is consistent with a displacement of the wording surface; and collecting a sequence image of a motion of the high-contrast feature mark using a camera;
(S2) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image of the high-contrast feature mark in an X direction and a Y direction using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into a corresponding world coordinate;
(S3) respectively performing least-square fitting on the world coordinate of the feature edge of the linear motion in the X direction and Y direction to obtain a straight line of the feature edge; selecting a feature edge of the motion of the sequence image of the high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; calculating a distance between the feature edge of the linear motion of the sequence image and the zero-displacement reference edge to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction; and
(S4) obtaining a planar motion trajectory of the working surface according to the displacement of the working surface in the X direction and the displacement of the working surface in the Y direction; and saving and displaying a measurement result of the displacement and the planar motion trajectory of the working surface.
2. The method of claim 1 , wherein the extraction of the feature edge of the linear motion of the sequence image in the X direction and the Y direction comprises:
(1) determining a rectangular region in the sequence image of the high-contrast feature mark;
wherein template matching is adopted to determine four circular regions in the sequence image of the high-contrast feature mark to improve stability and precision in extracting the feature edge of the linear motion; the rectangle is located in a region of interest formed by centers of the four circular regions; and the feature edge is extracted in the region of interest to avoid a disturbance from an edge with similar background;
(2) extracting a sub-pixel of an edge point of a long edge and a short edge of the rectangle;
extracting the edge point of the long edge and the short edge of a pixel-level rectangle of a sequence image Fj(x,y) of the motion of the high-contrast feature mark using Canny operator, where j=1, 2, . . . , N, and N is the number of collected sequence image;
obtaining a position error compensation of the long edge and the short edge of the rectangle through calculating Zernike moment of the sequence image Fj(x,y) to obtain a sub-pixel coordinate of the long edge and the short edge of the rectangle; and
converting the sub-pixel coordinate of the long edge and the short edge of the rectangle into a corresponding world coordinate according to the relationship between the pixel coordinate and the world coordinate of the image; and
(3) fitting the feature edge of the linear motion in the X direction and the Y direction;
respectively fitting the world coordinate of the feature edge of the X direction and the Y direction based on the least squares principle to obtain a straight line {lj, X} of the feature edge of the linear motion in the X direction and a straight line {lj, Y} of the feature edge of the linear motion in the Y direction, where the sub-pixel coordinate of the long edge and the short edge of the rectangle is the feature edge of the linear motion in the X direction and the Y direction, respectively, and lj, X and lj, Y are equivalent edges of two long edges and two short edges of the rectangle in the sequence image Fj(x,y), respectively; and obtaining a straight line lr, X of the feature edge of linear motion in the X direction and a straight line lr, Y of the feature edge of linear motion in the Y direction of an image Fr(x,y) of the high-contrast feature mark at the zero position of the working surface.
3. The method of claim 2 , wherein a motion of the working surface of the low-frequency two-component shaker is obtained by decoupling an edge displacement in the X direction and the Y direction; and the planar motion is described as a displacement sX(t) in the X direction and a displacement sY(t) in the Y direction:
wherein, ωv is an angular frequency of vibration; ŝX and ŝY are peak values of the displacement sX(t) and the displacement sY(t), respectively; and φX and φY are initial phases of the displacement sX(t) and the displacement sY(t), respectively;
the straight line lr, X and the straight line lr, Y of the feature edge of the image Fr(x,y) are selected as the zero-displacement reference edge; a distance dj, X between the straight line lj, X of the feature edge of the image Fj(x,y) and a corresponding edge of the image Fr(x,y) is calculated as the displacement sX(tj) at a collecting moment tj; a distance dj, Y between the straight line lj, Y of the feature edge of the image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sY(tj) at the collecting moment tj.
4. The method of claim 3 , wherein the displacement sX(tj) and the displacement sY(tj) at the collecting moment tj are respectively fitted using a sine-approximation method shown as follows:
wherein parameters AX, BX, CX, AY, BY and CY are obtained by solving N corresponding equations, respectively; the peak value ŝX and the initial phase φX of the displacement of the planar motion in the X direction and the peak value ŝY and the initial phase φY of the planar motion in the Y direction are obtained as follows:
a phase difference PD is defined as follows:
P D=|φX−φY| (4);
P D=|φX−φY| (4);
when the phase difference PD is 0° or 180°, the planer motion provided by the working surface has a linear trajectory; if and only if ŝX=ŝY and the phase difference PD is 90°, the planar motion provided by the working surface has a circular trajectory; and planar motions under other conditions all have an elliptical trajectory.
5. A device for implementing the method of claim 1 , comprising:
a low-frequency two-component shaker;
a working surface;
a high-contrast feature mark;
an illumination device;
a fixing device;
a camera;
an image transmission device; and
an image processing and displaying unit;
wherein the working surface of the low-frequency two-component shaker is configured to provide a motion of any trajectory in a plane; the high-contrast feature mark is fixed on the working surface such that a motion of the high-contrast feature mark is consistent with a motion of the working surface; the illumination device is configured to provide illumination for the camera; the fixing device is configured for fixing the camera to allow an optical axis of the camera to be perpendicular to the high-contrast feature mark; the camera is configured to collect the sequence image of motion of the high-contrast feature mark; the image transmission device is configured to transmit the sequence image collected by the camera; the image processing and displaying unit is configured to process the sequence image collected by the camera, save and display a measurement result of the displacement and the trajectory of the planar motion.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011139972.0A CN112444233B (en) | 2020-10-22 | 2020-10-22 | Monocular vision-based plane motion displacement and track measurement method |
CN202011139972.0 | 2020-10-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220044422A1 true US20220044422A1 (en) | 2022-02-10 |
Family
ID=74735522
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/507,968 Pending US20220044422A1 (en) | 2020-10-22 | 2021-10-22 | Monocular vision-based method for measuring displacement and trajectory of planar motion |
Country Status (2)
Country | Link |
---|---|
US (1) | US20220044422A1 (en) |
CN (1) | CN112444233B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114233800A (en) * | 2022-02-28 | 2022-03-25 | 聚时领臻科技(浙江)有限公司 | Mounting support for quickly and manually adjusting rigidity and damping and rigidity adjusting method |
CN117119325A (en) * | 2023-08-24 | 2023-11-24 | 合肥埃科光电科技股份有限公司 | Area array sensor camera and mounting position adjusting method thereof |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113074766B (en) * | 2021-03-19 | 2023-01-10 | 广东工业大学 | Micro-nano visual motion tracking system |
CN112964352A (en) * | 2021-03-22 | 2021-06-15 | 天津大学 | Ultrasonic elliptical vibration device measuring system and method based on mechanical arm |
CN114088088B (en) * | 2021-11-15 | 2023-08-04 | 贵州大学 | Angular velocity and angular acceleration measuring method based on monocular vision |
CN114427832A (en) * | 2021-12-17 | 2022-05-03 | 中国计量科学研究院 | Cone motion measurement method based on machine vision |
CN116091488B (en) * | 2023-03-07 | 2023-07-14 | 西安航天动力研究所 | Displacement testing method and displacement testing system for engine swing test |
CN117606362A (en) * | 2023-11-23 | 2024-02-27 | 湖南科天健光电技术有限公司 | Detection method and detection system for slope displacement |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104677340B (en) * | 2013-11-30 | 2017-01-11 | 中国科学院沈阳自动化研究所 | Point character based monocular vision pose measurement method |
WO2019039997A1 (en) * | 2017-08-25 | 2019-02-28 | Maker Trading Pte Ltd | A general monocular machine vision system and method for identifying locations of target elements |
CN109238235B (en) * | 2018-06-29 | 2020-07-31 | 华南农业大学 | Method for realizing rigid body pose parameter continuity measurement by monocular sequence image |
CN109632085B (en) * | 2018-12-29 | 2021-04-27 | 中国计量科学研究院 | Monocular vision-based low-frequency vibration calibration method |
CN109727267B (en) * | 2018-12-29 | 2020-02-11 | 中国计量科学研究院 | Standard virtual sine linear vibration measurement method |
CN109978900A (en) * | 2019-02-28 | 2019-07-05 | 中国人民解放军国防科技大学 | Monocular camera circle characteristic translational motion measuring method |
CN110672040B (en) * | 2019-09-24 | 2021-07-30 | 中国计量科学研究院 | High-precision rotation angle measuring method based on vision |
-
2020
- 2020-10-22 CN CN202011139972.0A patent/CN112444233B/en active Active
-
2021
- 2021-10-22 US US17/507,968 patent/US20220044422A1/en active Pending
Non-Patent Citations (1)
Title |
---|
Ye, Zhen ("An Improved Subpixel Phase Correlation Method with Application in Videogrammetric Monitoring of Shaking Table Tests") Phomogrammetric Engineering & Remote Sensing Vol. 84, No. 9 (Year: 2018) * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114233800A (en) * | 2022-02-28 | 2022-03-25 | 聚时领臻科技(浙江)有限公司 | Mounting support for quickly and manually adjusting rigidity and damping and rigidity adjusting method |
CN117119325A (en) * | 2023-08-24 | 2023-11-24 | 合肥埃科光电科技股份有限公司 | Area array sensor camera and mounting position adjusting method thereof |
Also Published As
Publication number | Publication date |
---|---|
CN112444233A (en) | 2021-03-05 |
CN112444233B (en) | 2022-08-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220044422A1 (en) | Monocular vision-based method for measuring displacement and trajectory of planar motion | |
CN102798350B (en) | Method, device and system for measuring deflection of arm support | |
EP3029418A2 (en) | Tilt detecting system and tilt detecting method | |
CN101539422B (en) | Monocular vision real time distance measuring method | |
CN102798456B (en) | Method, device and system for measuring working range of engineering mechanical arm frame system | |
CN106225708A (en) | A kind of generic video deflection metrology system insensitive to ambient light | |
US20130113897A1 (en) | Process and arrangement for determining the position of a measuring point in geometrical space | |
CN110702946B (en) | Monocular vision-based low-frequency multi-axis accelerometer sensitivity calibration method | |
Charalampous et al. | Measuring sub-mm structural displacements using QDaedalus: a digital clip-on measuring system developed for total stations | |
CN112129263B (en) | Distance measurement method of separated mobile stereo distance measurement camera | |
US20040004706A1 (en) | Surveying system | |
JPWO2018135063A1 (en) | Pose estimation method and position pose estimation method using a marker and a marker | |
JP2001296124A (en) | Method and apparatus for measurement of three- dimensional coordinates | |
US11816844B2 (en) | Method for measuring angular velocity and angular acceleration based on monocular vision | |
CN103455038B (en) | A kind of electronic equipment and the method for adjustment direction | |
CN102519671B (en) | Space position and gesture measuring device based on binocular vision and used for measuring gyroscope static balance | |
Wagner¹ et al. | Monitoring concepts using image assisted total stations | |
WO2020113978A1 (en) | Method for calculating center position of hole located on plane | |
US11754595B2 (en) | Method for calibrating linear vibration and angular vibration based on monocular vision | |
CN102519672B (en) | Monocular-principle-based six-degree-of-freedom position and attitude measuring device for measuring static balance of gyroscope | |
US11788831B2 (en) | Six-degree-of-freedom measurement method by machine vision based on physical decoupling | |
CN105841636B (en) | Optical axis and object plane measuring for verticality method based on parts moving linearly error compensation | |
JPS6281508A (en) | Optical 3-dimensional position measuring apparatus | |
CN113063367A (en) | Full-field deflection real-time measurement system and measurement method based on oblique optical axis digital image correlation method | |
CN113847872A (en) | Discrete single-point displacement static monitoring device and method based on laser ranging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |