CN105800464A - Positioning method based on automatic lifting hook system - Google Patents

Positioning method based on automatic lifting hook system Download PDF

Info

Publication number
CN105800464A
CN105800464A CN201610284223.4A CN201610284223A CN105800464A CN 105800464 A CN105800464 A CN 105800464A CN 201610284223 A CN201610284223 A CN 201610284223A CN 105800464 A CN105800464 A CN 105800464A
Authority
CN
China
Prior art keywords
lifting hook
parameter
suspension hook
positioning
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610284223.4A
Other languages
Chinese (zh)
Other versions
CN105800464B (en
Inventor
方勇纯
郝敬乾
钱辰
李彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nankai University
Original Assignee
Nankai University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nankai University filed Critical Nankai University
Priority to CN201610284223.4A priority Critical patent/CN105800464B/en
Publication of CN105800464A publication Critical patent/CN105800464A/en
Application granted granted Critical
Publication of CN105800464B publication Critical patent/CN105800464B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/04Auxiliary devices for controlling movements of suspended loads, or preventing cable slack
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66CCRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES
    • B66C13/00Other constructional features or details
    • B66C13/16Applications of indicating, registering, or weighing devices

Abstract

The invention relates to a positioning method based on an automatic lifting hook system. The method is the positioning method based on the automatic lifting hook system combining ultrasonic ranging and machine vision. The automatic lifting hook system is designed, and therefore accurate positioning of a lifting hook positioning point and a load positioning point is achieved. Z-direction positioning is achieved through an ultrasonic ranging method. A sensor is connected with a lifting hook main controller, the lifting hook main controller sends out a ranging command, a timer obtains the return time of ultrasonic waves, and the system calculates the distance H of a lifting hook in the Z direction. A visual positioning method is adopted to achieve positioning in the X direction and the Y direction. A visual positioning algorithm is designed by using load information in a known scene, expected positional information for work of the lifting hook system serves as a reference road sign, a road sign database is built to serve as reference conditions, real-time images and video information are subject to object identification and feature matching treatment, relative positional information needed by the lifting hook system is obtained, and accurate positioning of the lifting hook in the X direction and the Y direction is achieved.

Description

A kind of localization method based on automatic hanging hook system
Technical field
The invention belongs to technical field of engineering machinery, be specifically related to a kind of localization method towards the application of crane gear automatic hanging hook system.
Background technology
Automatic hanging hook system, for completing automatic job task, is determined the relative position of load and suspension hook by suspension hook anchor point and the combination of suspension ring anchor point, and the location of suspension hook and suspension ring needs to meet certain positioning precision, and otherwise automatic hanging hook system cannot normal operation.GPS and cellular radio location, positioning precision respectively 5 meters and 150 meters is had under outdoor environment.Technology such as mainly adopting optics, A-GPS, infrared ray, ultrasound wave, RFID, WIFI is positioned under indoor environment.The positioning precision of RFID technique is relevant with the distributed quantity of read write line, and representative is SPOTON system and LANDMARC system.Company of Qihoo adopts the location mode that GPS, WiFi, base station and gravity sensitive combine, and researches and develops a intelligent watch and realizes indoor 20 meters, the location of outdoor 5 meters, the real time position of real-time positioning wearer.The application of automatic hanging hook system needs to reach higher positioning precision, and traditional location technology cannot realize.It is furnished with one block of Magnet bottom the electromagnetic type automatic hanging hook of CarlStahl company of Germany R & D design, is caught suspension ring or hoist cable position by sucking action.Owing to suspension hook and periphery are all ferromagnetic materials, the positioning capturing operation of severe jamming hoist cable position, position inaccurate.Being accurately positioned of hanger system in the vertical direction can be realized for automatic hanging hook system location requirement, laser and ultrasonic ranging method.Consider shortage cost performance and the practicality of laser sensor, and ultrasonic sensor cost performance is high and simple in construction.
Summary of the invention
Present invention aim to address that what how to be effectively improved crane automatic hanging hook is accurately positioned problem, it is provided that the localization method of a kind of Engineering Oriented plant equipment automatic hanging hook system application.
Automatic hanging hook alignment system target is to realize being accurately positioned between suspension hook anchor point and load orientation point, Unify legislation under O-XYZ coordinate system.Wherein, X-direction is the direction that hanger system follows that crane horizontal cross moves, and Y-direction is the direction that hanger system follows that crane horizontally vertically moves, and Z-direction is the direction that lifting rope vertically moves;
Technical solution of the present invention
A kind of localization method based on automatic hanging hook system, the localization method that the method combines with machine vision based on ultrasonic ranging, designs automatic hanging hook system positioning method, it is achieved suspension hook anchor point 1 is accurately positioned with load orientation point 2.
Specifically comprising the following steps that of the method
1st, the connection circuit of ultrasonic sensor with suspension hook master controller composition is arranged on suspension hook anchor point, adopts ultrasonic ranging method to realize Z-direction location;Ultrasonic sensor is connected with suspension hook master controller starts working, and controller sends range finding order, and intervalometer obtains hyperacoustic time of return, the distance H in system-computed suspension hook Z-direction;
2nd, video camera and operating circuit are arranged on suspension hook anchor point, based on reference road sign (3) and scene load (4), adopt vision positioning method to realize X-direction and Y-direction location;Utilize known scene load information design vision localization algorithm, the desired locations information of automatic hanging hook system work is as reference road sign, set up landmark database as reference conditions, real time imaging and video information process through target recognition, characteristic matching, obtain the relative position information that hanger system needs, it is achieved suspension hook being accurately positioned in the x-direction and the z-direction.
Specifically comprising the following steps that of described vision positioning method
2.1st, the acquisition process of picture signal;Initializing program parameter, K=0, K represents location algorithm number of run;Video camera gathers video image information according to actual needs, and sets up the picture material storehouse of automatic hanging hook system vision localization;Video camera shooting image F (0), F (1) ..., F (i);F (0) is with reference to road sign initial pictures, represents optimum visual anchor point image;F (i) represents that suspension hook is at image captured by the i moment;
2.2nd, vision localization parameter detecting and assessment result;Software load image, is loaded into image processing operators by collection image and positional parameter processes in operator;When geometry and the threedimensional model of known reference object, application camera marking method estimates the homography matrix of automatic hanging hook System planes and the plane of delineation, construct the constraint equation of camera intrinsic parameter and homography matrix, utilize method of least square that camera interior and exterior parameter carries out linear solution and nonlinear optimization, estimate camera intrinsic parameter, outer parameter and lens distortion parameter, eliminate the impact of optical distortion in image;Perform image processing operators;Image procossing obtain outer parameter matrix t (x, y, z), obtain positional parameter t (0), t (1) ..., t (i-1);T (i) represents the translation vector parameter matrix between F (i-1) and F (i);Calculation of position errors error;Error e rror represents the framing point in i moment and with reference to the position error between road sign initial alignment picture point;Obtain the real time kinematics carrier element local relative position information relative to the hanger system specific object of reference of three-dimensional scenic desired locations;
e r r o r = ( x - x ^ ) 2 + ( y - y ^ ) 2 + ( z - z ^ ) 2 ;
2.3rd, output result;Be automatically performed out hook smoothly according to suspension hook with close hook operation need effective orientation distance, carry out error threshold correction;When error e rror is less than predetermined threshold value, meet expectation requirement;Otherwise, according to relative position information, drive crane system, mobile lift hook position, until it reaches target, it is achieved suspension hook automation remote accurately controls, complete the vision localization of automatic hanging hook system.
Advantages of the present invention and good effect:
The present invention is based on actual demands of engineering, design one automatic hanging hook system positioning method.It is hooked into row by vision localization technology and supersonic sensing range finder module auxiliary hanging to be accurately positioned, it is ensured that the safe and reliable work of automatic hanging hook system, is no longer rely on suction device and obtains location information by traditional methods such as artificial observations.Utilize vision localization information realization suspension hook to be accurately positioned, improve work efficiency, undoubtedly to realizing suspension hook Unmanned operation, promote safety and accuracy, there is clear advantage and good effect.
Accompanying drawing explanation
Fig. 1 is automatic hanging hook system positioning method schematic diagram;
Fig. 2 is automatic hanging hook system vision positioning system block diagram;
Fig. 3 is automatic hanging hook system vision localization algorithm;
Fig. 4 is that angular coordinate extracts result;
Fig. 5 is vision localization testing result;
Fig. 6 is vision localization experiment suspension hook characteristics of motion figure;
Fig. 7 is vision localization experimental test procedures;
Fig. 8 is vision localization experiment X, Y-direction test result;Wherein, a is 10mm positioning result, and b is 20mm positioning result, and c is 30mm positioning result, and d is 40mm positioning result;
Fig. 9 is vision localization experiment Z-direction test result;
Figure 10 is vision localization experimental results;
Figure 11 is the localization method application of overhead crane control system;
In figure, 1 suspension hook anchor point, 2 load orientation points, 3 with reference to road sign, 4 scene loads.
Detailed description of the invention
Embodiment 1:
1. automatic hanging hook system positioning method principle design involved in the present invention is as shown in Figure 1.Its target is to realize being accurately positioned between suspension hook anchor point 1 and load orientation point 2.Suspension hook anchor point determines the relative position of load and suspension hook with the combination of suspension ring anchor point, and vision localization result meets certain precision, and otherwise automatic hanging hook system cannot normal operation.
Design automatic hanging hook system location hardware platform:
Based on the localization method that ultrasonic ranging combines with machine vision, adopt automatic hanging hook system positioning method, it is achieved suspension hook anchor point 1 is accurately positioned with load orientation point 2.The connection circuit installation site that ultrasonic sensor and suspension hook master controller form is positioned at suspension hook anchor point, adopts ultrasonic ranging method to realize Z-direction location;Based on reference road sign 3 and scene load 4, video camera and operating circuit installation site are positioned at suspension hook anchor point, and the reference road sign designed in advance is fixed on load orientation point lower end.Selecting ultrasonic sensor to be connected with suspension hook master controller, controller sends range finding order, and intervalometer obtains hyperacoustic time of return, the distance H in system-computed suspension hook Z-direction.Vision positioning method is adopted to realize X-direction and Y-direction location.Utilize known scene load information design vision localization algorithm, the desired locations information of automatic hanging hook system work is as reference road sign, set up landmark database as reference conditions, real time imaging and video information process through target recognition, characteristic matching, obtain the relative position information that hanger system needs, it is achieved suspension hook being accurately positioned in the x-direction and the z-direction.
2. automatic hanging hook system vision positioning system block diagram is as shown in Figure 2.When geometry and the threedimensional model of known reference object, method with reference to camera calibration, computer vision algorithms make is combined with suspension hook automatic control technology, the visual image signal obtained with video camera carries out real-time feedback, obtain outer parameter matrix, design automatic hanging hook system vision localization algorithm, it is thus achieved that real time kinematics carrier element is relative to the local relative pose of the hanger system specific object of reference of three-dimensional scenic desired locations, it is achieved suspension hook automation remote accurately controls.Automatic hanging hook system vision localization algorithm is as it is shown on figure 3, specifically comprise the following steps that
1st, the acquisition process of picture signal.Initializing program parameter, K=0, K represents location algorithm number of run;Video camera gathers video image information according to actual needs, and sets up the picture material storehouse of hanger system vision localization;Video camera shooting image F (0), F (1) ..., F (i);F (0) is with reference to road sign initial pictures, represents optimum visual anchor point image;F (i) represents that suspension hook is at image captured by the i moment.For realizing the experiment effect of the best, use 10~20 width lossless compress pictures.The scene of design object load comprises gridiron pattern image information, and gridiron pattern image is often taken as typical image and is applied to camera calibration technology.Harris-SIFT method can reflect the notable structure of image, and coupling correctness is high, and database volume is little, and algorithm real-time is good, therefore adopts Harris-SIFT feature extraction operator detection X-comers.The target of corner detection operator is the gridiron pattern image of detection hanger system load, extracts angular coordinate, as shown in Figure 4, and sets up imaging model.Application Matlab computer vision workbox processes hanger system vision localization algorithm, obtains vision localization parameter, it is achieved the precise positioning of suspension hook.Before location algorithm program brings into operation, the actual measured value of the input target gridiron pattern length of side, then image characteristic point detection processes each width checkerboard image that Programmable detection is loaded into.If image repeats, smudgy or the deviation of extreme angle occurs, then window can be pointed out out of court, result display total number of images and being accepted and picture number out of court.Pane display checkerboard image, circle instruction detection corner location, detected image uses label to carry out labelling, it is possible to the state plateau of real-time monitored arbitrary image test point can indicate coordinate information, including direction in chessboard plane of initial point, x-axis and y-axis.
Angle point minor shifts in any direction, the gray scale of its neighborhood all can change a lot.Detective operators realizes method: first look for the extreme point in DOG as candidate feature point, then passes through sub-pixel interpolation and improves positioning precision, filters the point of mobile rim.Directly detecting angle point in graphical rule space, the extreme point of metric space represents the extreme point of original image relevant position, is reused by Harris operator, saves amount of calculation.Harris operator formula:
μ ( x , σ I , σ s ) = g ( σ I ) × L x 2 ( x , σ s ) L x L y ( x , σ s ) L x L y ( x , σ s ) L y 2 ( x , σ s ) - - - ( 1 )
Cornerness=D (μ (x, σIs))-αT2(μ(x,σIs))(2)
In Harris operator formula, cornerness is Corner Feature value, and u is metric space second-order matrix, σIFor integral scale, σsFor characteristic point yardstick, LαFor gradient operator.Owing to the error of approximation of convolution smooth operation and DoG can cause that candidate feature point and angle point are misaligned, there is the error of certain pixel, to neighborhood image processor.Eigenvalue is calculated, it may be judged whether there is angle point, if being absent from, then filtering candidate point, otherwise generating feature description for each point in the region that radius near candidate point is 2 or 3.Screening has the SIFT feature point of Corner Feature, it is desirable to each characteristic point, close to angle point, omits other not remarkable characteristics.
2nd, vision localization parameter detecting and assessment result.
Software load image, is loaded into image processing operators by collection image and positional parameter processes in operator;When geometry and the threedimensional model of known reference object, application camera marking method estimates the homography matrix of hanger system plane and the plane of delineation, construct the constraint equation of camera intrinsic parameter and homography matrix, utilize method of least square that camera interior and exterior parameter carries out linear solution and nonlinear optimization, estimate camera intrinsic parameter, outer parameter and lens distortion parameter, eliminate the impact of optical distortion in image.The geometric properties information of vision localization parameter processing operator application known target hook load, obtains homography transformation matrix according to projective transformation.Pose parameter between design vision localization parameter processing operator extraction suspension hook anchor point, homography matrix represents the pose transformation relation between load and video camera, comprises rotation relationship and translation relation.
Covering load plane by fixing for black and white gridiron pattern plane, demarcationization processes, and utilizes the resolution process algorithm of homography matrix to obtain outer parameter matrix solution, namely obtains spin matrix and translation matrix, obtains suspension hook positional parameter.Hanger system load orientation point Xw=(Xw,Yw,Zw)TTransform to imaging point m=(u, v)T.As shown in Equation 3, matrix P=K [R, t] is called perspective projection matrix, αuAnd αvRepresenting focal length, matrix K is camera intrinsic parameter matrix, the obliquity factor of behalf pixel.
Z c u v 1 = α u s u 0 0 α v v 0 0 0 1 ( R X w Y w Z w + t ) = K ( RX w + t ) - - - ( 3 )
If λ=Zc, picture point coordinateThe coordinate of world point M isFrom P3To P2Linear projective transformation imaging model be
Suspension hook alignment system as shown in Figure 1, gridiron pattern plane, at XOY plane, uses riRepresent each column vector of R.The projective transformation relation of the angle point corresponding diagram picture point of gridiron pattern plane is as shown in Equation 4.
s u v 1 = K [ r 1 r 2 r 3 t ] X Y 0 1 = K [ r 1 r 2 t ] X Y 1 = H 1 X Y 1 - - - ( 4 )
H 1 = K [ r 1 r 2 t ] = h 11 h 12 h 13 h 21 h 22 h 23 h 31 h 32 h 33 - - - ( 5 )
H1For homography matrix, there are 8 unknown quantitys to wait to solve, after arrangement, obtain linear equation.
X Y 1 0 0 0 - u X - u Y 0 0 0 X Y 1 - v X - v Y h = u v - - - ( 6 )
H=[h11h12h13h21h22h23h31h32]T(7)
Choose the corresponding point of more than four groups in two width gridiron pattern plane pictures, utilize least squares identification unknown parameter, solve h, after normalization, obtain H1.Homography matrix H1Being Intrinsic Matrix and the coupling of outer parameter matrix, extracting pose parameter needs first to solve Intrinsic Matrix, then solves out parameter matrix.
H1=[h1h2h3]=K [r1r2t](8)
According to internal two constraints: one, r1,r2Orthogonal;Its two, rotating vector modulus value is 1.The K that inside enters a match comprises αu、αv、u0、v0And s, it is necessary to three homography matrixes solve intrinsic parameter.
Mobile suspension hook anchor point and the relative position of load orientation point, collect at least three width images as vision localization material database, under internal constraints, obtain at least six relational expression, and enter a match in thus solving K.Then, out parameter spin matrix R and translation matrix t is solved.Error e rror represents the framing point in i moment and with reference to the position error between road sign initial alignment picture point, image procossing obtains outer parameter matrix t (x, y, z), image testing result is as it is shown in figure 5, obtain one group of outer parameter matrix, positional parameter t (0) can be obtained, t (1) ..., t (i-1).T (i) represents the translation vector parameter matrix between F (i-1) and F (i), it is thus achieved that real time kinematics carrier element is relative to the local relative position information of the hanger system specific object of reference of three-dimensional scenic desired locations.Calculation of position errors error;
e r r o r = ( x - x ^ ) 2 + ( y - y ^ ) 2 + ( z - z ^ ) 2 - - - ( 10 )
3rd, output result;Be automatically performed out hook smoothly according to suspension hook with close hook operation need effective orientation distance, carry out error threshold correction;When error e rror is less than predetermined threshold value, meet expectation requirement;Otherwise, according to relative position information, drive crane system, mobile lift hook position, until it reaches target, it is achieved suspension hook automation remote accurately controls, complete automatic hanging hook system vision localization.
1) X, Y-direction positioning experiment
Planning crane moves at XOY plane, and photographic head distance load is 302mm, and the position keeping Z-direction is constant.Positioning experiment is arranged: the vision localization experiment suspension hook characteristics of motion is shown in Fig. 6, and black color dots represents target object initial position point, and target object according to arrow direction indication, moves the distance of setting successively every time along X or Y-direction.Vision localization experimental test procedures is as shown in Figure 7;Fig. 8 is vision localization experiment X, and Y-direction test result, wherein, a is 10mm positioning result, and b is 20mm positioning result, and c is 30mm positioning result, and d is 40mm positioning result;
2) Z-direction positioning experiment
The focal distance f of video camera is 4mm, and the displaced posi of load is all the time outside the focus of video camera, and the moving orthogonal scaling in Z-direction is 2.5, and positioning result is as shown in Figure 9.
As shown in Figure 10, the mean error of experiment value and theoretical value is 1mm to vision localization experimental error result, and position error fluctuation range is within 5mm, and location algorithm precision meets automatic hanging hook systematic difference requirement.
3) experiment test
Experiment test vision localization algorithm controls systematic difference at actual crane automatic hanging hook.Automatic hanging hook experimental prototype is put in overhead crane experiment porch, and application experiment is as shown in figure 11.By vision localization result, it is judged that X-direction needs mobile 315mm, using the X=315mm expectation input position as overhead crane automatic hanging hook system, drive trolley movement absolute distance 315mm by trolley movement controller, it is achieved the precise positioning of suspension hook.
List of references
[1] Ma Songde, Zhang Zhengyou. computer vision-theory of computation and algorithm basis [M]. Beijing: Science Press, 2003.
[2] ZZhang.Aflexiblenewtechniqueforcameracalibration [J] .IEEETransactiononPatternAnalysisandMachineIntelligence. 2000,22 (11): 1330-1334.
[3] Yang Shanhu, Li Yanming, Liu Chengliang. based on the tower crane picture control [J] of suspension hook action intelligent-tracking. electromechanical integration .2010,5 (4): 25-28.
[4] RichardHartley, AndrewZisserman work. Wei Sui, Yang Shangjun, Zhang Quanbing, Hu Maolin translate. the multi-view geometry [M] in computer vision. publishing house of University of Anhui .2002.
[5] Meng Xianyao, Han Xinjie, white wide next. the control of operation on the sea multipupose vessel automatic control system-dynamic positioning system and redundancy [J]. Worldwide Shipping .2004,27 (3).
[6] Yang Zhida, Liu Shaoyou. Precise Orientation Technique for Auto-Control of Cranes for Nuclear Waste Storehouse [J]. Nuclear Power Engineering .2006,27 (6): 94~98.
[7] WEIGQ, MASD.Implicitandexlicitcameracalibration:Theoryandexperi ments [J] .IEEETransactionsonPatternAnalysisandMachineIntelligence .1994,16 (5): 469-480.
[8] Faugeras, D.&Toscani, G.Cameracalibrationfor3Dcomputervision.ProcIntemationalW orkshoponIndustrial [J] .ApplicationsofMachineVisionandMachineIntelligence.Silke n, Japan, 1987:240-247.
[9]J.HeikkilaandO.Silven.Afour-stepcameracalibrationprocedurewithimplicitimagecorrection[J].ComputerVisionandPatternRecognition.1997.。

Claims (2)

1. the localization method based on automatic hanging hook system, it is characterized in that, the localization method that the method combines with machine vision based on ultrasonic ranging, designs automatic hanging hook system positioning method, it is achieved suspension hook anchor point (1) is accurately positioned with load orientation point (2);
Wherein, X-direction is the direction that hanger system follows that crane horizontal cross moves, and Y-direction is the direction that hanger system follows that crane horizontally vertically moves, and Z-direction is the direction that lifting rope vertically moves;
Specifically comprising the following steps that of the method
1st, the connection circuit of ultrasonic sensor with suspension hook master controller composition is arranged on suspension hook anchor point, adopts ultrasonic ranging method to realize Z-direction location;Ultrasonic sensor is connected with suspension hook master controller starts working, and controller sends range finding order, and intervalometer obtains hyperacoustic time of return, the distance H in system-computed suspension hook Z-direction;
2nd, video camera and operating circuit are arranged on suspension hook anchor point, based on reference road sign (3) and scene load (4), adopt vision positioning method to realize X-direction and Y-direction location;Utilize known scene (4) load information design vision localization algorithm, the desired locations information of automatic hanging hook system work is as reference road sign (3), set up landmark database as reference conditions, real time imaging and video information process through target recognition, characteristic matching, obtain the relative position information that hanger system needs, it is achieved suspension hook being accurately positioned in the x-direction and the z-direction.
2. localization method according to claim 1, it is characterised in that specifically comprising the following steps that of the vision positioning method described in the 2nd step
2.1st, the acquisition process of picture signal;Initializing program parameter, K=0, K represents location algorithm number of run;Video camera gathers video image information according to actual needs, and sets up the picture material storehouse of automatic hanging hook system vision localization;Video camera shooting image F (0), F (1) ..., F (i);F (0) is with reference to road sign initial pictures, represents optimum visual anchor point image;F (i) represents that suspension hook is at image captured by the i moment;
2.2nd, vision localization parameter detecting and assessment result;Software load image, is loaded into image processing operators by collection image and positional parameter processes in operator;When geometry and the threedimensional model of known reference object, application camera marking method estimates the homography matrix of automatic hanging hook System planes and the plane of delineation, construct the constraint equation of camera intrinsic parameter and homography matrix, utilize method of least square that camera interior and exterior parameter carries out linear solution and nonlinear optimization, estimate camera intrinsic parameter, outer parameter and lens distortion parameter, eliminate the impact of optical distortion in image;Perform image processing operators;Image procossing obtain outer parameter matrix t (x, y, z), obtain positional parameter t (0), t (1) ..., t (i-1);T (i) represents the translation vector parameter matrix between F (i-1) and F (i);Calculation of position errors error;Error e rror represents the framing point in i moment and with reference to the position error between road sign initial alignment picture point;Obtain the real time kinematics carrier element local relative position information relative to the hanger system specific object of reference of three-dimensional scenic desired locations;
error = ( x - x ^ ) 2 + ( y - y ^ ) 2 + ( z - z ^ ) 2 ;
2.3rd, export result;Be automatically performed out hook smoothly according to suspension hook with close hook operation need effective orientation distance, carry out error threshold correction;When error e rror is less than predetermined threshold value, meet expectation requirement;Otherwise, according to relative position information, drive crane system, mobile lift hook position, until it reaches target, it is achieved suspension hook automation remote accurately controls, complete the vision localization of automatic hanging hook system.
CN201610284223.4A 2016-04-29 2016-04-29 A kind of localization method based on automatic hanging hook system Active CN105800464B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610284223.4A CN105800464B (en) 2016-04-29 2016-04-29 A kind of localization method based on automatic hanging hook system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610284223.4A CN105800464B (en) 2016-04-29 2016-04-29 A kind of localization method based on automatic hanging hook system

Publications (2)

Publication Number Publication Date
CN105800464A true CN105800464A (en) 2016-07-27
CN105800464B CN105800464B (en) 2018-12-18

Family

ID=56458074

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610284223.4A Active CN105800464B (en) 2016-04-29 2016-04-29 A kind of localization method based on automatic hanging hook system

Country Status (1)

Country Link
CN (1) CN105800464B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109019335A (en) * 2018-09-04 2018-12-18 大连理工大学 A kind of Hoisting Security distance detection method based on deep learning
CN109052170A (en) * 2018-09-30 2018-12-21 中国水利水电第七工程局有限公司 A kind of large equipment single hook hauling positioning device and localization method
CN110893269A (en) * 2019-11-26 2020-03-20 北京新松融通机器人科技有限公司 Fire-fighting robot water-supply hose joint butt joint method and system based on visual measurement
CN111017726A (en) * 2019-11-19 2020-04-17 中联重科股份有限公司 Crane hook positioning method, device and system and engineering machinery
CN111849516A (en) * 2020-07-28 2020-10-30 华泰永创(北京)科技股份有限公司 Control method, system and device of coke dry quenching coke loading equipment
CN112208512A (en) * 2020-09-15 2021-01-12 中冶宝钢技术服务有限公司 Automatic tank holding control device and control method for tank holding vehicle and tank holding vehicle
CN112465874A (en) * 2021-01-28 2021-03-09 河南工学院 Crane lifting appliance guiding and positioning method and system based on image sensing
CN113184727A (en) * 2021-04-29 2021-07-30 海航航空技术有限公司 Combined tool for assisting in dismounting and mounting aircraft brake hub

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040124803A1 (en) * 2003-07-28 2004-07-01 Jim Rodnunsky System and method for moving objects within three-dimensional space
CN2732708Y (en) * 2004-06-11 2005-10-12 岳阳千盟电子有限公司 Three-dimensional automatic-location control device for travelling cranes and bridge cranes
CN101143686A (en) * 2007-09-28 2008-03-19 天津理工大学 Traveling crane positioning system and positioning method
CN201485188U (en) * 2009-05-15 2010-05-26 北京工业大学 Long rail loading and transporting automatic grasping system with position identification function
CN102087521A (en) * 2009-12-08 2011-06-08 鞍钢集团矿业公司 Remotely operable mixed material picking and conveying apparatus and picking and conveying method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040124803A1 (en) * 2003-07-28 2004-07-01 Jim Rodnunsky System and method for moving objects within three-dimensional space
CN2732708Y (en) * 2004-06-11 2005-10-12 岳阳千盟电子有限公司 Three-dimensional automatic-location control device for travelling cranes and bridge cranes
CN101143686A (en) * 2007-09-28 2008-03-19 天津理工大学 Traveling crane positioning system and positioning method
CN201485188U (en) * 2009-05-15 2010-05-26 北京工业大学 Long rail loading and transporting automatic grasping system with position identification function
CN102087521A (en) * 2009-12-08 2011-06-08 鞍钢集团矿业公司 Remotely operable mixed material picking and conveying apparatus and picking and conveying method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
徐宁: ""单目摄像头实时视觉定位"", 《万方数据库》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109019335A (en) * 2018-09-04 2018-12-18 大连理工大学 A kind of Hoisting Security distance detection method based on deep learning
CN109052170A (en) * 2018-09-30 2018-12-21 中国水利水电第七工程局有限公司 A kind of large equipment single hook hauling positioning device and localization method
CN111017726A (en) * 2019-11-19 2020-04-17 中联重科股份有限公司 Crane hook positioning method, device and system and engineering machinery
CN111017726B (en) * 2019-11-19 2020-08-21 中联重科股份有限公司 Crane hook positioning method, device and system and engineering machinery
CN110893269A (en) * 2019-11-26 2020-03-20 北京新松融通机器人科技有限公司 Fire-fighting robot water-supply hose joint butt joint method and system based on visual measurement
CN111849516A (en) * 2020-07-28 2020-10-30 华泰永创(北京)科技股份有限公司 Control method, system and device of coke dry quenching coke loading equipment
CN112208512A (en) * 2020-09-15 2021-01-12 中冶宝钢技术服务有限公司 Automatic tank holding control device and control method for tank holding vehicle and tank holding vehicle
CN112465874A (en) * 2021-01-28 2021-03-09 河南工学院 Crane lifting appliance guiding and positioning method and system based on image sensing
CN113184727A (en) * 2021-04-29 2021-07-30 海航航空技术有限公司 Combined tool for assisting in dismounting and mounting aircraft brake hub

Also Published As

Publication number Publication date
CN105800464B (en) 2018-12-18

Similar Documents

Publication Publication Date Title
CN105800464A (en) Positioning method based on automatic lifting hook system
Chen et al. High-accuracy multi-camera reconstruction enhanced by adaptive point cloud correction algorithm
CN103954221B (en) The binocular photogrammetric survey method of large-size pliable structure vibration displacement
Kim et al. SLAM-driven robotic mapping and registration of 3D point clouds
CN111127568B (en) Camera pose calibration method based on spatial point location information
CN102917171B (en) Based on the small target auto-orientation method of pixel
Protopapadakis et al. Autonomous robotic inspection in tunnels
CN102788572B (en) Method, device and system for measuring attitude of lifting hook of engineering machinery
CN102589523A (en) Method and equipments for remotely monitoring displacement of building
CN105352975A (en) Bridge cable appearance detecting method
CN102778207A (en) Measurement method, device and system for stress and strain of structural part
CN109472778B (en) Appearance detection method for towering structure based on unmanned aerial vehicle
Xu et al. Fast registration methodology for fastener assembly of large-scale structure
CN103398669A (en) Multi-axis linkage visual inspection method and equipment used for measuring free-form surface
CN113240747A (en) Outdoor structure vibration displacement automatic monitoring method based on computer vision
JP5019478B2 (en) Marker automatic registration method and system
CN103707300A (en) Manipulator device
Mi et al. A vision-based displacement measurement system for foundation pit
KR101093793B1 (en) Method for measuring 3d pose information using virtual plane information
CN205472298U (en) Automatic calibration system that detects of container crane
CN203636826U (en) Robot device
CN105354855A (en) High-rise structure appearance detection device and method
CN205158453U (en) Structure outward appearance detection device stands tall and erects
CN110307829B (en) Hoisting equipment perpendicularity detection method and system based on unmanned aerial vehicle video
CN109342439B (en) Unmanned aerial vehicle-based cable structure appearance detection method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant