CN114119764A - Automatic guard board target positioning and aligning algorithm - Google Patents

Automatic guard board target positioning and aligning algorithm Download PDF

Info

Publication number
CN114119764A
CN114119764A CN202111125334.8A CN202111125334A CN114119764A CN 114119764 A CN114119764 A CN 114119764A CN 202111125334 A CN202111125334 A CN 202111125334A CN 114119764 A CN114119764 A CN 114119764A
Authority
CN
China
Prior art keywords
image
guardrail
algorithm
training
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202111125334.8A
Other languages
Chinese (zh)
Inventor
费树岷
王彬彬
陈叶亮
张明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Dongqi Intelligent Manufacturing Research Institute Co ltd
Original Assignee
Nanjing Dongqi Intelligent Manufacturing Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Dongqi Intelligent Manufacturing Research Institute Co ltd filed Critical Nanjing Dongqi Intelligent Manufacturing Research Institute Co ltd
Priority to CN202111125334.8A priority Critical patent/CN114119764A/en
Publication of CN114119764A publication Critical patent/CN114119764A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85Stereo camera calibration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/66Analysis of geometric attributes of image moments or centre of gravity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75Determining position or orientation of objects or cameras using feature-based methods involving models

Abstract

The invention discloses an automatic guard board target positioning and aligning algorithm, which comprises the following steps: acquiring a three-dimensional distance image of a target related in the installation process of the guardrail plate and a training image limited by the three-dimensional distance image with model characteristics by using a CCD (charge coupled device) camera; image dithering processing; estimating an error; selecting, by the vision processor: analyzing at least one training area of a training image having model features and determining a distribution of surface normal vectors within the at least one training area; and selecting at least one three-dimensional alignment algorithm from a plurality of available three-dimensional alignment algorithms based on the characteristics of the distribution to align features of the model with features of the runtime object. The invention replaces the observation of human eyes, is more accurate compared with the human eyes, adopts a conventional image processing mode, does not need to adopt a learning algorithm, has small calculated amount and real-time error estimation, provides a basis for real-time parameter correction of the controller and overcomes the image shaking interference under the CCD motion state.

Description

Automatic guard board target positioning and aligning algorithm
Technical Field
The invention relates to the technical field of intelligent construction sites, in particular to an automatic guard board target positioning and aligning algorithm.
Background
At present, the highway guardrail plate is installed by manual operation, and the labor intensity of the manual operation is high. The installation of the guard rail is carried out by a person (or persons) lifting the guard rail (usually a standard three-wave plate weighing 102 Kg) from the ground, leaning on the guard rail piles and then screwing the screws.
Because the side of the guardrail plate opposite to the guardrail pile is upward on the ground, the guardrail plate can be turned over to lean against the guardrail pile when being lifted in a mechanical mode, and then the screw is screwed, however, the aim of positioning and aligning the target cannot be provided in the moving process of the guardrail plate mounting equipment, and the aim of automatic mounting cannot be realized.
Disclosure of Invention
Based on the technical problems in the background art, the invention provides an automatic guard board target positioning and aligning algorithm.
The invention provides an automatic guard board target positioning and aligning algorithm, which comprises the following steps:
s1, acquiring a three-dimensional distance image of a target related in the installation process of the guard rail plate and a training image defined by the three-dimensional distance image with model characteristics by using a CCD camera;
s2 image dithering process:
generating a jitter matrix configuration file by software simulation according to the requirement of jitter processing;
writing the generated jitter matrix configuration file into the storage unit through an external main control unit in a form of software interface or hardware programming;
the content written into the storage unit and the image jitter overcoming algorithm circuit act together to realize image jitter processing;
the image is subjected to dithering and display to observe whether the processing effect accords with the software simulation effect; if the configuration meets the requirements, the configuration is finished; if the requirements are not met, processing is carried out again until the requirements are met;
s3 error estimation:
determining a target for the processed image, acquiring a coordinate origin of the target, and providing an error range estimation value for a controller in real time by adopting an estimation value of points and straight line points within a certain range and a fitting straight line;
s4 is selected by the vision processor: analyzing at least one training area of a training image having model features and determining a distribution of surface normal vectors within the at least one training area; and selecting at least one three-dimensional alignment algorithm from a plurality of available three-dimensional alignment algorithms based on the characteristics of the distribution to align features of the model with features of the runtime object.
Preferably, the target of step S1 includes: the edge and the gradient of the road surface, the height of the guardrail pile and the position of the screw hole, and the edge and the center line position of the movable guardrail plate.
Preferably, the "within certain range" and "point and straight line" estimated values and error range estimated values in step S3 all refer to: the relative error under standard illumination is 1%.
Preferably, the CCD camera comprises a plurality of discrete cameras at spaced apart locations to capture a scene of a plurality of angular objects.
Preferably, the training image is provided as a composite image acquired by a CCD being a camera, and the training is performed by locating at least one training area within the training image.
Preferably, the step S3 adopts an error estimation algorithm to obtain the estimation error.
Preferably, the step S3 obtains coordinates of the road surface edge in the target, a distance between the road surface edge and the guardrail pile, and a horizontal slope of the installation equipment; the height of the guardrail pile horizontal to the installation equipment, the position distance of the screw hole from the top of the guardrail pile and whether the three guardrail piles are parallel or not are judged; whether the edge of the guardrail plate is parallel to the central line and whether the edge of the guardrail plate is parallel to the guardrail pile in the moving process.
According to the automatic guardrail plate target positioning and aligning algorithm, observation of human eyes is replaced, the algorithm is more accurate compared with the human eyes, a conventional image processing mode is adopted, a learning algorithm is not needed, the calculated amount is small, real-time error estimation is achieved, a basis is provided for real-time parameter correction of a controller, and image shaking interference is overcome under the CCD motion state.
Drawings
Fig. 1 is a schematic flow chart of an automatic guard rail target positioning and aligning algorithm according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments.
Referring to fig. 1, an automated guardrail plate target positioning and alignment algorithm includes the steps of:
s1, acquiring a three-dimensional distance image of a target related in the installation process of the guard rail plate and a training image defined by the three-dimensional distance image with model characteristics by using a CCD camera;
s2 image dithering process:
generating a jitter matrix configuration file by software simulation according to the requirement of jitter processing;
writing the generated jitter matrix configuration file into the storage unit through an external main control unit in a form of software interface or hardware programming;
the content written into the storage unit and the image jitter overcoming algorithm circuit act together to realize image jitter processing;
the image is subjected to dithering and display to observe whether the processing effect accords with the software simulation effect; if the configuration meets the requirements, the configuration is finished; if the requirements are not met, processing is carried out again until the requirements are met;
s3 error estimation:
determining a target for the processed image, acquiring a coordinate origin of the target, and providing an error range estimation value for a controller in real time by adopting an estimation value of points and straight line points within a certain range and a fitting straight line;
s4 is selected by the vision processor: analyzing at least one training area of a training image having model features and determining a distribution of surface normal vectors within the at least one training area; and selecting at least one three-dimensional alignment algorithm from a plurality of available three-dimensional alignment algorithms based on the characteristics of the distribution to align features of the model with features of the runtime object.
In the present invention, the target of step S1 includes: the edge and the gradient of the road surface, the height of the guardrail pile and the position of the screw hole, and the edge and the center line position of the movable guardrail plate.
In the present invention, the "within certain range" and "point and straight line" estimated values and error range estimated values in step S3 all refer to: the relative error under standard illumination is 1%.
In the present invention, the CCD camera includes a plurality of dispersed cameras at spaced apart locations to capture a scene of a plurality of angular objects.
In the invention, the training image is provided by synthesizing images acquired by a CCD camera, and at least one training area is positioned in the training image to perform training.
In the present invention, the step S3 uses an error estimation algorithm to obtain the estimation error.
In the invention, the step S3 is to obtain the coordinates of the road surface edge in the target, the distance between the road surface edge and the guardrail pile and the horizontal gradient of the installation equipment; the height of the guardrail pile horizontal to the installation equipment, the position distance of the screw hole from the top of the guardrail pile and whether the three guardrail piles are parallel or not are judged; whether the edge of the guardrail plate is parallel to the central line and whether the edge of the guardrail plate is parallel to the guardrail pile in the moving process.
The invention comprises the following steps: acquiring a three-dimensional distance image of a target related in the installation process of the guardrail plate and a training image limited by the three-dimensional distance image with model characteristics by using a CCD (charge coupled device) camera; image dithering processing: generating a jitter matrix configuration file by software simulation according to the requirement of jitter processing; writing the generated jitter matrix configuration file into the storage unit through an external main control unit in a form of software interface or hardware programming; the content written into the storage unit and the image jitter overcoming algorithm circuit act together to realize image jitter processing; the image is subjected to dithering and display to observe whether the processing effect accords with the software simulation effect; if the configuration meets the requirements, the configuration is finished; if the requirements are not met, processing is carried out again until the requirements are met; and (3) error estimation: determining a target for the processed image, acquiring a coordinate origin of the target, and providing an error range estimation value for a controller in real time by adopting an estimation value of points and straight line points within a certain range and a fitting straight line; selecting, by the vision processor: analyzing at least one training area of a training image having model features and determining a distribution of surface normal vectors within the at least one training area; and selecting at least one three-dimensional alignment algorithm from a plurality of available three-dimensional alignment algorithms based on the characteristics of the distribution to align features of the model with features of the runtime object.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.

Claims (7)

1. An automated guardrail plate target positioning and alignment algorithm, comprising the steps of:
s1, acquiring a three-dimensional distance image of a target related in the installation process of the guard rail plate and a training image defined by the three-dimensional distance image with model characteristics by using a CCD camera;
s2 image dithering process:
generating a jitter matrix configuration file by software simulation according to the requirement of jitter processing;
writing the generated jitter matrix configuration file into the storage unit through an external main control unit in a form of software interface or hardware programming;
the content written into the storage unit and the image jitter overcoming algorithm circuit act together to realize image jitter processing;
the image is subjected to dithering and display to observe whether the processing effect accords with the software simulation effect; if the configuration meets the requirements, the configuration is finished; if the requirements are not met, processing is carried out again until the requirements are met;
s3 error estimation:
determining a target for the processed image, acquiring a coordinate origin of the target, and providing an error range estimation value for a controller in real time by adopting an estimation value of points and straight line points within a certain range and a fitting straight line;
s4 is selected by the vision processor: analyzing at least one training area of a training image having model features and determining a distribution of surface normal vectors within the at least one training area; and selecting at least one three-dimensional alignment algorithm from a plurality of available three-dimensional alignment algorithms based on the characteristics of the distribution to align features of the model with features of the runtime object.
2. The automated guardrail board target positioning and alignment algorithm of claim 1 wherein the targets of step S1 comprise: the edge and the gradient of the road surface, the height of the guardrail pile and the position of the screw hole, and the edge and the center line position of the movable guardrail plate.
3. The automated balustrade target positioning and aligning algorithm of claim 1, wherein the "within range", "point and line" point estimates, error range estimates of step S3 are: the relative error under standard illumination is 1%.
4. The automated guardrail target positioning and alignment algorithm of claim 1 wherein the CCD cameras comprise a plurality of discrete cameras at spaced apart locations to capture a scene of a plurality of angular objects.
5. The automated guardrail board target positioning and alignment algorithm of claim 1 wherein the training images are provided as composite images captured by a CCD camera, and wherein training is performed to position at least one training area within the training images.
6. The automated balustrade target positioning and aligning algorithm of claim 1, wherein step S3 uses an error estimation algorithm to obtain the estimated error.
7. The automated guardrail board target positioning and alignment algorithm of claim 1 wherein step S3 obtains the coordinates of the road edges, the distance from the guardrail posts, and the slope from the installation equipment level in the target; the height of the guardrail pile horizontal to the installation equipment, the position distance of the screw hole from the top of the guardrail pile and whether the three guardrail piles are parallel or not are judged; whether the edge of the guardrail plate is parallel to the central line and whether the edge of the guardrail plate is parallel to the guardrail pile in the moving process.
CN202111125334.8A 2021-09-26 2021-09-26 Automatic guard board target positioning and aligning algorithm Withdrawn CN114119764A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111125334.8A CN114119764A (en) 2021-09-26 2021-09-26 Automatic guard board target positioning and aligning algorithm

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111125334.8A CN114119764A (en) 2021-09-26 2021-09-26 Automatic guard board target positioning and aligning algorithm

Publications (1)

Publication Number Publication Date
CN114119764A true CN114119764A (en) 2022-03-01

Family

ID=80441203

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111125334.8A Withdrawn CN114119764A (en) 2021-09-26 2021-09-26 Automatic guard board target positioning and aligning algorithm

Country Status (1)

Country Link
CN (1) CN114119764A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117532624A (en) * 2024-01-10 2024-02-09 南京东奇智能制造研究院有限公司 Automatic positioning and aligning method and system for guardrail plate installation

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117532624A (en) * 2024-01-10 2024-02-09 南京东奇智能制造研究院有限公司 Automatic positioning and aligning method and system for guardrail plate installation
CN117532624B (en) * 2024-01-10 2024-03-26 南京东奇智能制造研究院有限公司 Automatic positioning and aligning method and system for guardrail plate installation

Similar Documents

Publication Publication Date Title
CN112793564B (en) Autonomous parking auxiliary system based on panoramic aerial view and deep learning
EP3641298B1 (en) Method and device for capturing target object and video monitoring device
CN103716594B (en) Panorama splicing linkage method and device based on moving target detecting
KR101205428B1 (en) Target position identifying apparatus
JP2008204384A (en) Image pickup device, object detection method and posture parameter calculation method
CN110956069B (en) Method and device for detecting 3D position of pedestrian, and vehicle-mounted terminal
CN103167270B (en) Personnel's head image pickup method, system and server
KR20160013337A (en) Apparatus and method for correcting image distortion of wide angle camera for vehicle
US20090128652A1 (en) Image processing apparatus
JP6174968B2 (en) Imaging simulation device
CN112307912A (en) Method and system for determining personnel track based on camera
CN114119764A (en) Automatic guard board target positioning and aligning algorithm
KR100811832B1 (en) Device for calculating actual size of the object in the image captured from single camera and the method thereof
CN112352261A (en) Object detection device and object detection method for construction machine
KR100647750B1 (en) Image processing apparatus
TWI383690B (en) Method for image processing
JPWO2020153264A1 (en) Calibration method and calibration equipment
CN110728696A (en) Student standing detection method of recording and broadcasting system based on background modeling and optical flow method
US7990417B2 (en) Targeted object pursuit system
CN113034458B (en) Indoor personnel track analysis method, device and storage medium
CN112702513B (en) Double-optical-pan-tilt cooperative control method, device, equipment and storage medium
US20220135379A1 (en) Cargo container image capturing method and system applied to bridge crane
JP6492603B2 (en) Image processing apparatus, system, image processing method, and program
US11089220B2 (en) Electronic test device, method and computer-readable medium
CN112634356A (en) Tracking method and system and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20220301