US20220044422A1 - Monocular vision-based method for measuring displacement and trajectory of planar motion - Google Patents

Monocular vision-based method for measuring displacement and trajectory of planar motion Download PDF

Info

Publication number
US20220044422A1
US20220044422A1 US17/507,968 US202117507968A US2022044422A1 US 20220044422 A1 US20220044422 A1 US 20220044422A1 US 202117507968 A US202117507968 A US 202117507968A US 2022044422 A1 US2022044422 A1 US 2022044422A1
Authority
US
United States
Prior art keywords
edge
displacement
motion
feature
working surface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US17/507,968
Inventor
Ming Yang
Chenguang Cai
Zhihua Liu
Wen Ye
Ying ZAHNG
Yan Xia
Lei Fu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Institute of Metrology
Guizhou University
Original Assignee
National Institute of Metrology
Guizhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Institute of Metrology, Guizhou University filed Critical National Institute of Metrology
Publication of US20220044422A1 publication Critical patent/US20220044422A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/246Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M7/00Vibration-testing of structures; Shock-testing of structures
    • G01M7/02Vibration-testing by means of a shake table
    • G01M7/06Multidirectional test stands
    • G06K9/3233
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G06V10/225Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30241Trajectory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06Recognition of objects for industrial automation

Abstract

A monocular vision-based method for measuring displacement and trajectory of planar motion. In this method, a sequence image of a motion of a high-contrast feature mark fixed on a moving plane to be measured is collected using a camera. A sub-pixel coordinate of a feature edge of a linear motion of the sequence in an X direction and a Y direction is extracted using a sub-pixel edge detection method, and the sub-pixel coordinate is converted into a corresponding world coordinate. The world coordinate of the feature edge is fitted based on a least squares principle to obtain a straight line of the feature edge to realize decoupling measurement of a displacement in the X direction and the Y direction. The planar motion trajectory is obtained through measuring the displacement in the X direction and the Y direction.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit of priority from Chinese Patent Application No. 202011139972.0, filed on Oct. 22, 2020. The content of the aforementioned application, including any intervening amendments thereto, is incorporated herein by reference in its entirety.
  • TECHNICAL FIELD
  • The application relates to motion measurement, and more particularly to a monocular vision-based method for measuring a displacement and a trajectory of a planar motion.
  • BACKGROUND
  • The displacement and trajectory measurement of planar motion has been widely used in pose estimation, inertial navigation and structure safety test of bridges and buildings. The planar motion measurement is the basis for measuring the multi-degree-of-freedom motion, and the measurement precision directly affects the overall performance of the system or device in practical engineering applications. The precision for measuring the displacement and trajectory of the planar motion has to be improved, so as to meet the increasing demand for high-precision measurement in practical engineering applications. Therefore, it is necessary to study a method for precisely measuring the displacement and trajectory of the planar motion.
  • At present, the commonly used methods for measuring the displacement and trajectory of the planar motion include the laser interferometric method and the sensor-based measuring method. The laser interferometric method based on Doppler velocity measurement and laser interference principle has strong anti-interference ability, good dynamic performance, wide measurement frequency range and high linearity, and can realize a high-precision measurement of the displacement and trajectory of the planar motion. However, the measurement system of the interferometric method is of high complexity, high cost, and poor flexibility, and is difficult to be used for measuring the low-frequency motion with a large displacement range. The sensor-based measuring method merely requires a two-axis or three-axis vibration sensor to measure the displacement and trajectory of the planar motion. This method has simple measurement system, low cost, high flexibility and high efficiency. Nevertheless, the frequency of the sensor itself limits the precision of the measurement. Whereas the monocular vision method has high efficiency, high flexibility, high precision and low cost, and the existing monocular vision method is able to meet a measurement precision of up to 10 μm in the displacement measurement, which is being widely used in practical engineering applications. Therefore, the monocular vision method can be used to measure the displacement and trajectory of the planar motion. Since any planar motion can be decomposed into linear motions in the X and Y directions, the displacement and trajectory of the planar motion can be obtained through decoupling the motion displacement of the planar motion in in the X and Y directions using the monocular vision method, which improves the measurement precision and reduces the complexity and cost of the measurement system at the same time, and has a high flexibility.
  • In view of the problems that the existing method for measuring the displacement and trajectory of the planar motion has a measurement system of high complexity, poor flexibility, high cost and limited measurement range, and fails to meet the requirement of the low-frequency and high-precision measurement, the present disclosure provides an efficient, precise, flexible and low-cost monocular vision-based measurement method. A decoupling measurement of the planar motion based on the monocular vision converts the measurement of a multi-component planar motion into the measurement of a single-component linear motion, which improves the metrological traceability of the monocular vision method, and is the basis for the measurement of a six-degree-of-freedom motion.
  • SUMMARY
  • To solve the problems that the existing method for measuring the displacement and trajectory of the planar motion has a measurement system of high complexity, poor flexibility, high cost and limited measurement range, and fails to meet the requirement of the low-frequency measurement, this disclosure provides an effective and flexible method for accurately measuring a displacement and a trajectory of a planar motion, comprising:
  • (I) collecting a sequence image of a motion of the high-contrast feature mark;
  • fixing a high-contrast feature mark on a working surface of a low-frequency two-component shaker; collecting enough sequence images of a motion of the high-contrast feature mark using a camera, to ensure that a displacement of the planar motion can be precisely measured;
  • (II) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image in an X direction and a Y direction;
  • template matching is adopted to determine a region of interest in the sequence image of the high-contrast feature mark; extracting a sub-pixel coordinate of a feature edge point in the region of interest using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into the world coordinate;
  • (III) solving the displacement of the feature edge of the linear motion in the X direction and the Y direction;
  • respectively performing least-square fitting on the world coordinate of the feature edge point of the linear motion in the X direction and Y direction to obtain a corresponding fitting straight line; selecting a feature edge of the motion of the sequence image of high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; by calculating a distance between the feature edge of the linear motion of the sequence image and the corresponding edge of the reference image to obtain a displacement of the motion of the feature edge in the X direction and the Y direction; and
  • (IV) solving the trajectory of the planar motion
  • obtaining the corresponding peak value and the initial phase of the displacement, further solving to obtain the trajectory of the planar motion, based on the measured motion displacement of the feature edge in the X and Y directions fitted using a sine-approximation method.
  • Specifically, the method comprises the following steps:
  • (S1) fixing a high-contrast feature mark consisting of a rectangle and four circles around the rectangle on a working surface of a low-frequency two-component shaker, such that a displacement of the rectangle in the high-contrast feature mark is consistent with a displacement of the wording surface; and collecting a sequence image of a motion of the high-contrast feature mark using a camera;
  • (S2) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image of the high-contrast feature mark in an X direction and a Y direction using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into a corresponding world coordinate;
  • (S3) respectively performing least-square fitting on the world coordinate of the feature edge of the linear motion in the X direction and Y direction to obtain a straight line of the feature edge; selecting a feature edge of the motion of the of the sequence image of high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; calculating a distance between the feature edge of the linear motion of the sequence image and the zero-displacement reference edge to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction; and
  • (S4) obtaining a planar motion trajectory of the working surface according to the displacement of the working surface in the X direction and the displacement of the working surface in the Y direction; and saving and displaying a measurement result of the displacement and the planar motion trajectory of the working surface.
  • In some embodiments, the extraction of the feature edge of the linear motion of the sequence image in the X direction and the Y direction comprise:
  • (1) determining a rectangular region in the sequence image of the high-contrast feature mark;
  • wherein template matching is adopted to determine four circular regions in the sequence image of the high-contrast feature mark to improve stability and precision in extracting the feature edge of the linear motion; the rectangle is located in a region of interest formed by centers of the four circular regions; and the feature edge is extracted in the region of interest to avoid a disturbance from an edge with similar background;
  • (2) extracting a sub-pixel of an edge point of a long edge and a short edge of the rectangle;
  • extracting the edge point of the long edge and the short edge of a pixel-level rectangle of a sequence image Fj(x,y) of the motion of the high-contrast feature mark using Canny operator, where j=1, 2, . . . , N, and N is the number of collected sequence image;
  • obtaining a position error compensation of the long edge and the short edge of the rectangle through calculating Zernike moment of the sequence image Fj(x,y) to obtain a sub-pixel coordinate of the long edge and the short edge of the rectangle; and
  • converting the sub-pixel coordinate of the long edge and the short edge of the rectangle into a corresponding world coordinate according to the relationship between the pixel coordinate and the world coordinate of the image; and
  • (3) fitting the feature edge of the linear motion in the X direction and the Y direction;
  • respectively fitting the world coordinate of the feature edge of the X direction and the Y direction based on the least squares principle to obtain a straight line {lj, X} of the feature edge of the linear motion in the X direction and a straight line {lj, Y} of the feature edge of the linear motion in the Y direction, where the sub-pixel coordinate of the long edge and the short edge of the rectangle is the feature edge of the linear motion in the X direction and the Y direction, respectively, and lj, X and lj, Y are equivalent edges of two long edges and two short edges of the rectangle in the sequence image Fj(x,y), respectively; and obtaining a straight line lr, X of the feature edge of linear motion in the X direction and a straight line lr, Y of the feature edge of linear motion in the Y direction of an image Fr(x,y) of the high-contrast feature mark at the zero position of the working surface.
  • In some embodiments, a motion of the working surface of the low-frequency two-component shaker is obtained by decoupling an edge displacement in the X direction and the Y direction; and the planar motion is described as a displacement sX(t) in the X direction and a displacement sY(t) in the Y direction:
  • { s X ( t ) = s ^ X cos ( ω v t + φ X ) s Y ( t ) = s ^ Y cos ( ω v t + φ Y ) ; ( 1 )
  • where, ωv is an angular frequency of vibration; ŝX and ŝ′Y are peak values of the displacement sX(t) and the displacement sY(t), respectively; φX and φY are initial phases of the displacement sX(t) and the displacement sY(t), respectively;
  • the straight line lr, X and the straight line lr, Y of the feature edge of the image Fr(x,y) are selected as the zero-displacement reference edge; a distance dj, X between the straight line lj, X of the feature edge of the sequence image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sX(tj) at a collecting moment tj; a distance dj, Y between the straight line lj, Y of the feature edge of the sequence image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sY(tj) at the collecting moment tj.
  • In some embodiments, the displacement sX(tj) and the displacement sY(tj) at the collecting moment tj are respectively fitted using a sine-approximation method shown as follows:
  • { s X ( t j ) = A X cos ( ω v t j ) - B X sin ( ω v t j ) + C X s Y ( t j ) = A Y cos ( ω v t j ) - B Y sin ( ω v t j ) + C Y ; ( 2 )
  • wherein parameters AX, BX, CX, AY, BY and CY are obtained by solving N corresponding equations, respectively; the peak value ŝX and the initial phase φX of the displacement of the planar motion in the X direction and the peak value ŝY and the initial phase φY of the planar motion in the Y direction are obtained as follows:
  • { s ^ X = A X 2 + B X 2 , φ X = arctan ( B X / A X ) · 180 / π s ^ Y = A Y 2 + B Y 2 , φ Y = arctan ( B Y / A Y ) · 180 / π ; ( 3 )
  • a phase difference PD is defined as follows:

  • P D=|φX−φY|  (4);
  • when the phase difference PD is 0° or 180°, the planer motion provided by the working surface has a linear trajectory; if and only if ŝXY and the phase difference PD is 90°, the planar motion provided by the working surface has a circular trajectory; and planar motions under other conditions all have an elliptical trajectory.
  • In some embodiments, a device for implementing the method mentioned above, comprising:
  • a low-frequency two-component shaker;
  • a working surface;
  • a high-contrast feature mark;
  • an illumination device;
  • a camera;
  • a fixing device;
  • an image transmission device; and
  • an image processing and displaying unit;
  • where the working surface of the low-frequency two-component shaker is configured to provide a motion of any trajectory in a plane; the high-contrast feature mark is fixed on the working surface, such that a motion of the high-contrast feature mark is consistent with a motion of the working surface; the illumination device is configured to provide illumination for the camera; the fixing device is configured for fixing the camera to allow an optical axis of the camera to be perpendicular to the high-contrast feature mark; the camera is configured to collect the sequence image of motion of the high-contrast feature mark; the image transmission device is configured to transmit the sequence image collected by the camera; the image processing and displaying unit is configured to process the sequence image collected by the camera, save and display a measurement result of the displacement and the trajectory of the planar motion.
  • The beneficial effects of a method for measuring a displacement and a trajectory of a planar motion provided herein are described as follows.
  • (1) This method is stable, reliable and practical, and can measuring the displacement and trajectory of the planar motion with different frequency and displacement range at the same time.
  • (2) The measuring process of this method is simple, flexible and effective, and the system for this method has a low cost. A camera can meet the requirement for measuring the planar motion in different frequency ranges.
  • (3) A displacement of the planar motion is accurately measured through decoupling measuring displacements of the planar motion in the X and Y directions.
  • (4) This method is one of the methods for measuring the planar motion, and can realize a high-precision measurement of the displacement and trajectory of the planar motion within a certain frequency range.
  • (5) This method decouples the measurement of the displacement and trajectory of the planar motion into the measurement of the displacements in the X and Y directions, which improves the metrological traceability of the monocular vision-based displacement measurement of the planar motion, and provides an effective way for accurately measuring a six-degree-of-freedom movement at the same time.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 schematically depicts a device for implementing a method for measuring a displacement and a trajectory of a planar motion based on monocular vision in accordance with an embodiment of the present disclosure;
  • FIG. 2 is a flow chart for measuring the displacement and the trajectory of the planar motion based on monocular vision;
  • FIG. 3 is a flow chart of a decoupling measurement of a displacement of the planar motion based on monocular vision;
  • FIG. 4 shows a measurement result of a displacement and a trajectory of a motion of a working surface of a low-frequency two-component shaker in accordance with an embodiment of the present disclosure;
  • FIG. 5 shows a measurement result of a displacement and a trajectory of a motion of a working surface of a low-frequency two-component shaker in accordance with an embodiment of the present disclosure; and
  • FIG. 6 shows a measurement result of a displacement and a trajectory of a motion of a working surface of a low-frequency two-component shaker in accordance with an embodiment of the present disclosure.
  • DETAILED DESCRIPTION OF EMBODIMENTS
  • To solve the problems that the existing method for measuring the displacement and trajectory of the planar motion has a measurement system of high complexity, poor flexibility, high cost and limited measurement range, this disclosure provides a monocular vision-based method for measuring displacement and trajectory of planar motion. Through decoupling the motion displacement of the planar motion in in the X and Y directions, this method realizes the high-precision measurement of the displacement and trajectory of the planar motion in the low frequency range. The following describes this disclosure in detail with reference to the drawings and specific embodiments.
  • FIG. 1 schematically depicts a device for implementing a method for measuring a displacement and a trajectory of a planar motion based on monocular vision. The device includes a low-frequency two-component shaker 1, a working surface 2, a high-contrast feature mark 3, an illumination device 4, a fixing device 5, a camera 6, an image transmission device 7, and an image processing and displaying unit 8. The working surface 2 of the low-frequency two-component shaker 1 is configured to provide a motion of any trajectory in a plane. The high-contrast feature mark 3 is fixed on the working surface, such that a motion of the high-contrast feature mark 3 is consistent with a motion of the working surface 2. The illumination device 4 is configured to provide illumination for the camera 6. The fixing device 5 is configured for fixing the camera 6 to allow an optical axis of the camera 6 to be perpendicular to the high-contrast feature mark 3. The camera 6 is configured to collect the sequence image of motion of the high-contrast feature mark 3. The image transmission device 7 is configured to transmit the sequence image collected by the camera. The image processing and displaying unit 8 is configured to process the sequence image collected by the camera 6, save and display a measurement result of the displacement and the trajectory of the planar motion.
  • FIG. 2 is a flow chart for measuring the displacement and the trajectory of the planar motion based on monocular vision. The measurement method provided herein mainly includes following steps.
  • (S1) A high-contrast feature mark is fixed on a working surface of a low-frequency two-component shaker. Enough sequence images of a motion of the high-contrast feature mark are collected using a camera.
  • (S2) A sub-pixel coordinate of a feature edge of a linear motion of the sequence image in an X direction and a Y direction is extracted which includes the following steps. The region of interest in the mark image is determined; a sub-pixel of an edge point of a long edge and a short edge of the rectangle in the region of interest is extracted. The world coordinate of the feature edge point of the linear motion in the X direction and the Y direction is solved.
  • (S3) The solution of the displacement of the motion of the feature edges in the X direction and the Y direction includes the following steps. The world coordinates of the feature edge of the linear motion in the X direction and the Y direction are fitted, respectively, based on a least squares principle to obtain a straight line of the feature edge. By calculating a distance between the feature edge of the linear motion in the X direction and the Y direction of the sequence image and the reference edge of the sequence image of the high-contrast feature mark at a zero position of the working surface to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction.
  • (S4) The planar motion trajectory is solved as follows. The displacement of the motion in the X direction and the Y direction is fitted based on the sine approximation method, respectively, to obtain the peak value and initial phase of the corresponding displacement, so as to obtain the planar motion trajectory.
  • FIG. 3 is a flow chart of a decoupling measurement of a displacement of the planar motion based on monocular vision. The method provided herein includes the following steps.
  • (S11) The collected sequence image of the motion of the high-contrast feature mark is read in.
  • (S12) The sub-pixel coordinate of a feature edge of a linear motion of the sequence image in an X direction and a Y direction is extracted using a Zernike moment-based sub-pixel edge detection method.
  • (S13) According to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, the extracted sub-pixel coordinate is converted into the world coordinate.
  • (S14) The world coordinates of the feature edge of the linear motion in the X direction and Y direction are fitted based on a least squares principle to obtain a straight line of the feature edge.
  • (S15) The feature edge in the X direction and the Y direction of the sequence image of the high-contrast feature mark at a zero position of the low-frequency two-component shaker is selected as a zero-displacement reference edge. A distance between the feature edge in the X direction and the Y direction of the sequence image and the zero-displacement reference edge is calculated.
  • (S16) The distance of the feature edge in the X direction and the Y direction in the sequence image is the displacement of motion of the working surface in the X direction and Y direction, respectively.
  • The specific parameters of the device provided herein are described as follows. The low-frequency two-component shaker is of the frequency range from 0.01 to 100 Hz and the peak value displacement of 200 mm at the peak. The high-contrast feature mark is a metal plate consisted of a rectangle with the size of 60 mm×40 mm and four circles with the radius of 15 mm around the rectangle. The camera is an industrial camera (IDT OS10-V3-4K) with the maximum resolution of 9 million pixels and the maximum frame rate of 1000 fps. The camera lens (Kowa Company, Ltd, Japan) is with a focal length of 16 mm. The illumination device is an incandescent lamp of 60 W.
  • In order to verify the precision of the method provided herein, the method is used to measure a displacement and a planar motion trajectory in a frequency range of 0.5-10 Hz. Table 1 shows the measurement results of a motion of a low-frequency two-component working table using the method provided herein and a laser interferometric method in a single peak displacement range of 2.5-80 mm, respectively. Table 1 shows that the measurement results of the monocular vision method and the laser interferometric method are similar; a maximum relative deviation is about 0.1%; and a maximum difference of a phase difference is less than 0.4°.
  • TABLE 1
    Measurement results of a displacement of a planar
    motion using the monocular vision method
    and the laser interferometric method
    Monocular vision method
    Frequency SX (mm) SY (mm) PD (°)
    0.5 79.719 80.089 45.411
    0.8 80.430 80.795 44.710
    1 80.458 80.822 44.566
    2 62.296 62.545 44.673
    5 10.014 10.015 44.254
    8 3.938 3.949 44.379
    10 2.520 2.529 44.510
    Laser interferometric method
    Frequency SX (mm) SY (mm) PD (°)
    0.5 79.700 80.017 44.615
    0.8 80.394 80.802 44.371
    1 80.484 80.845 44.487
    2 62.315 62.552 44.322
    5 10.013 10.014 44.522
    8 3.936 3.948 44.351
    10 2.518 2.529 44.396
  • FIGS. 4-6 respectively show a measurement result of a displacement and a trajectory of a motion of the working surface of the low-frequency two-component shaker. The measurement result shown in FIG. 4 is three linear trajectories: SX=81.057 mm, SY=80.905 mm and PD=0.063°; SX=80.576 mm, SY=40.047 mm and PD=−0.014°; SX=40.832 mm, SY=79.866 mm and PD=0.002°. The measurement result shown in FIG. 5 is three elliptical trajectories: SX=80.778 mm, SY=79.942 mm and PD=44.404°; SX=80.322 mm, SY=40.047 mm and PD=44.538°; SX=40.681 mm, SY=79.841 mm and PD=44.048°. The measurement result shown in FIG. 6 is a circular trajectory and two elliptical trajectories: SX=80.094 mm, SY=79.841 mm and PD=89.991°; SX=80.120 mm, SY=39.997 mm and PD=89.277°; SX=40.123 mm, SY=79.892 mm and PD=88.346°.
  • The embodiments mentioned above are illustrative, and are not intended to limit the present disclosure. Any replacements, improvements and modifications made by those skilled in the art without departing from the spirit of this disclosure should fall within the scope of the present application defined by the appended claims.

Claims (5)

What is claimed is:
1. A method for measuring a displacement and a trajectory of a planar motion based on monocular vision, comprising:
(S1) fixing a high-contrast feature mark consisting of a rectangle and four circles around the rectangle on a working surface of a low-frequency two-component shaker such that a displacement of the rectangle in the high-contrast feature mark is consistent with a displacement of the wording surface; and collecting a sequence image of a motion of the high-contrast feature mark using a camera;
(S2) extracting a sub-pixel coordinate of a feature edge of a linear motion of the sequence image of the high-contrast feature mark in an X direction and a Y direction using a Zernike moment-based sub-pixel edge detection method; and according to a relationship between a pixel coordinate and a world coordinate of an image determined through calibration using the camera, converting the sub-pixel coordinate of the feature edge into a corresponding world coordinate;
(S3) respectively performing least-square fitting on the world coordinate of the feature edge of the linear motion in the X direction and Y direction to obtain a straight line of the feature edge; selecting a feature edge of the motion of the sequence image of the high-contrast feature mark at a zero position of the working surface as a zero-displacement reference edge; calculating a distance between the feature edge of the linear motion of the sequence image and the zero-displacement reference edge to obtain a displacement of the working surface in the X direction and a displacement of the working surface in the Y direction; and
(S4) obtaining a planar motion trajectory of the working surface according to the displacement of the working surface in the X direction and the displacement of the working surface in the Y direction; and saving and displaying a measurement result of the displacement and the planar motion trajectory of the working surface.
2. The method of claim 1, wherein the extraction of the feature edge of the linear motion of the sequence image in the X direction and the Y direction comprises:
(1) determining a rectangular region in the sequence image of the high-contrast feature mark;
wherein template matching is adopted to determine four circular regions in the sequence image of the high-contrast feature mark to improve stability and precision in extracting the feature edge of the linear motion; the rectangle is located in a region of interest formed by centers of the four circular regions; and the feature edge is extracted in the region of interest to avoid a disturbance from an edge with similar background;
(2) extracting a sub-pixel of an edge point of a long edge and a short edge of the rectangle;
extracting the edge point of the long edge and the short edge of a pixel-level rectangle of a sequence image Fj(x,y) of the motion of the high-contrast feature mark using Canny operator, where j=1, 2, . . . , N, and N is the number of collected sequence image;
obtaining a position error compensation of the long edge and the short edge of the rectangle through calculating Zernike moment of the sequence image Fj(x,y) to obtain a sub-pixel coordinate of the long edge and the short edge of the rectangle; and
converting the sub-pixel coordinate of the long edge and the short edge of the rectangle into a corresponding world coordinate according to the relationship between the pixel coordinate and the world coordinate of the image; and
(3) fitting the feature edge of the linear motion in the X direction and the Y direction;
respectively fitting the world coordinate of the feature edge of the X direction and the Y direction based on the least squares principle to obtain a straight line {lj, X} of the feature edge of the linear motion in the X direction and a straight line {lj, Y} of the feature edge of the linear motion in the Y direction, where the sub-pixel coordinate of the long edge and the short edge of the rectangle is the feature edge of the linear motion in the X direction and the Y direction, respectively, and lj, X and lj, Y are equivalent edges of two long edges and two short edges of the rectangle in the sequence image Fj(x,y), respectively; and obtaining a straight line lr, X of the feature edge of linear motion in the X direction and a straight line lr, Y of the feature edge of linear motion in the Y direction of an image Fr(x,y) of the high-contrast feature mark at the zero position of the working surface.
3. The method of claim 2, wherein a motion of the working surface of the low-frequency two-component shaker is obtained by decoupling an edge displacement in the X direction and the Y direction; and the planar motion is described as a displacement sX(t) in the X direction and a displacement sY(t) in the Y direction:
{ s X ( t ) = s ^ X cos ( ω v t + φ X ) s Y ( t ) = s ^ Y cos ( ω v t + φ Y ) ; ( 1 )
wherein, ωv is an angular frequency of vibration; ŝX and ŝY are peak values of the displacement sX(t) and the displacement sY(t), respectively; and φX and φY are initial phases of the displacement sX(t) and the displacement sY(t), respectively;
the straight line lr, X and the straight line lr, Y of the feature edge of the image Fr(x,y) are selected as the zero-displacement reference edge; a distance dj, X between the straight line lj, X of the feature edge of the image Fj(x,y) and a corresponding edge of the image Fr(x,y) is calculated as the displacement sX(tj) at a collecting moment tj; a distance dj, Y between the straight line lj, Y of the feature edge of the image Fj(x,y) and a corresponding edge of the mark image Fr(x,y) is calculated as the displacement sY(tj) at the collecting moment tj.
4. The method of claim 3, wherein the displacement sX(tj) and the displacement sY(tj) at the collecting moment tj are respectively fitted using a sine-approximation method shown as follows:
{ s X ( t j ) = A X cos ( ω v t j ) - B X sin ( ω v t j ) + C X s Y ( t j ) = A Y cos ( ω v t j ) - B Y sin ( ω v t j ) + C Y ; ( 2 )
wherein parameters AX, BX, CX, AY, BY and CY are obtained by solving N corresponding equations, respectively; the peak value ŝX and the initial phase φX of the displacement of the planar motion in the X direction and the peak value ŝY and the initial phase φY of the planar motion in the Y direction are obtained as follows:
{ s ^ X = A X 2 + B X 2 , φ X = arctan ( B X / A X ) · 180 / π s ^ Y = A Y 2 + B Y 2 , φ Y = arctan ( B Y / A Y ) · 180 / π ; ( 3 )
a phase difference PD is defined as follows:

P D=|φX−φY|  (4);
when the phase difference PD is 0° or 180°, the planer motion provided by the working surface has a linear trajectory; if and only if ŝXY and the phase difference PD is 90°, the planar motion provided by the working surface has a circular trajectory; and planar motions under other conditions all have an elliptical trajectory.
5. A device for implementing the method of claim 1, comprising:
a low-frequency two-component shaker;
a working surface;
a high-contrast feature mark;
an illumination device;
a fixing device;
a camera;
an image transmission device; and
an image processing and displaying unit;
wherein the working surface of the low-frequency two-component shaker is configured to provide a motion of any trajectory in a plane; the high-contrast feature mark is fixed on the working surface such that a motion of the high-contrast feature mark is consistent with a motion of the working surface; the illumination device is configured to provide illumination for the camera; the fixing device is configured for fixing the camera to allow an optical axis of the camera to be perpendicular to the high-contrast feature mark; the camera is configured to collect the sequence image of motion of the high-contrast feature mark; the image transmission device is configured to transmit the sequence image collected by the camera; the image processing and displaying unit is configured to process the sequence image collected by the camera, save and display a measurement result of the displacement and the trajectory of the planar motion.
US17/507,968 2020-10-22 2021-10-22 Monocular vision-based method for measuring displacement and trajectory of planar motion Pending US20220044422A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011139972.0A CN112444233B (en) 2020-10-22 2020-10-22 Monocular vision-based plane motion displacement and track measurement method
CN202011139972.0 2020-10-22

Publications (1)

Publication Number Publication Date
US20220044422A1 true US20220044422A1 (en) 2022-02-10

Family

ID=74735522

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/507,968 Pending US20220044422A1 (en) 2020-10-22 2021-10-22 Monocular vision-based method for measuring displacement and trajectory of planar motion

Country Status (2)

Country Link
US (1) US20220044422A1 (en)
CN (1) CN112444233B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114233800A (en) * 2022-02-28 2022-03-25 聚时领臻科技(浙江)有限公司 Mounting support for quickly and manually adjusting rigidity and damping and rigidity adjusting method
CN117119325A (en) * 2023-08-24 2023-11-24 合肥埃科光电科技股份有限公司 Area array sensor camera and mounting position adjusting method thereof

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113074766B (en) * 2021-03-19 2023-01-10 广东工业大学 Micro-nano visual motion tracking system
CN112964352A (en) * 2021-03-22 2021-06-15 天津大学 Ultrasonic elliptical vibration device measuring system and method based on mechanical arm
CN114088088B (en) * 2021-11-15 2023-08-04 贵州大学 Angular velocity and angular acceleration measuring method based on monocular vision
CN114427832A (en) * 2021-12-17 2022-05-03 中国计量科学研究院 Cone motion measurement method based on machine vision
CN116091488B (en) * 2023-03-07 2023-07-14 西安航天动力研究所 Displacement testing method and displacement testing system for engine swing test
CN117606362A (en) * 2023-11-23 2024-02-27 湖南科天健光电技术有限公司 Detection method and detection system for slope displacement

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104677340B (en) * 2013-11-30 2017-01-11 中国科学院沈阳自动化研究所 Point character based monocular vision pose measurement method
WO2019039997A1 (en) * 2017-08-25 2019-02-28 Maker Trading Pte Ltd A general monocular machine vision system and method for identifying locations of target elements
CN109238235B (en) * 2018-06-29 2020-07-31 华南农业大学 Method for realizing rigid body pose parameter continuity measurement by monocular sequence image
CN109632085B (en) * 2018-12-29 2021-04-27 中国计量科学研究院 Monocular vision-based low-frequency vibration calibration method
CN109727267B (en) * 2018-12-29 2020-02-11 中国计量科学研究院 Standard virtual sine linear vibration measurement method
CN109978900A (en) * 2019-02-28 2019-07-05 中国人民解放军国防科技大学 Monocular camera circle characteristic translational motion measuring method
CN110672040B (en) * 2019-09-24 2021-07-30 中国计量科学研究院 High-precision rotation angle measuring method based on vision

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Ye, Zhen ("An Improved Subpixel Phase Correlation Method with Application in Videogrammetric Monitoring of Shaking Table Tests") Phomogrammetric Engineering & Remote Sensing Vol. 84, No. 9 (Year: 2018) *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114233800A (en) * 2022-02-28 2022-03-25 聚时领臻科技(浙江)有限公司 Mounting support for quickly and manually adjusting rigidity and damping and rigidity adjusting method
CN117119325A (en) * 2023-08-24 2023-11-24 合肥埃科光电科技股份有限公司 Area array sensor camera and mounting position adjusting method thereof

Also Published As

Publication number Publication date
CN112444233A (en) 2021-03-05
CN112444233B (en) 2022-08-02

Similar Documents

Publication Publication Date Title
US20220044422A1 (en) Monocular vision-based method for measuring displacement and trajectory of planar motion
CN102798350B (en) Method, device and system for measuring deflection of arm support
EP3029418A2 (en) Tilt detecting system and tilt detecting method
CN101539422B (en) Monocular vision real time distance measuring method
CN102798456B (en) Method, device and system for measuring working range of engineering mechanical arm frame system
CN106225708A (en) A kind of generic video deflection metrology system insensitive to ambient light
US20130113897A1 (en) Process and arrangement for determining the position of a measuring point in geometrical space
CN110702946B (en) Monocular vision-based low-frequency multi-axis accelerometer sensitivity calibration method
Charalampous et al. Measuring sub-mm structural displacements using QDaedalus: a digital clip-on measuring system developed for total stations
CN112129263B (en) Distance measurement method of separated mobile stereo distance measurement camera
US20040004706A1 (en) Surveying system
JPWO2018135063A1 (en) Pose estimation method and position pose estimation method using a marker and a marker
JP2001296124A (en) Method and apparatus for measurement of three- dimensional coordinates
US11816844B2 (en) Method for measuring angular velocity and angular acceleration based on monocular vision
CN103455038B (en) A kind of electronic equipment and the method for adjustment direction
CN102519671B (en) Space position and gesture measuring device based on binocular vision and used for measuring gyroscope static balance
Wagner¹ et al. Monitoring concepts using image assisted total stations
WO2020113978A1 (en) Method for calculating center position of hole located on plane
US11754595B2 (en) Method for calibrating linear vibration and angular vibration based on monocular vision
CN102519672B (en) Monocular-principle-based six-degree-of-freedom position and attitude measuring device for measuring static balance of gyroscope
US11788831B2 (en) Six-degree-of-freedom measurement method by machine vision based on physical decoupling
CN105841636B (en) Optical axis and object plane measuring for verticality method based on parts moving linearly error compensation
JPS6281508A (en) Optical 3-dimensional position measuring apparatus
CN113063367A (en) Full-field deflection real-time measurement system and measurement method based on oblique optical axis digital image correlation method
CN113847872A (en) Discrete single-point displacement static monitoring device and method based on laser ranging

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER