CN202164053U - Infrared structured light based intelligent sensing system for container grabbing of spreader - Google Patents

Abstract

The utility model discloses an infrared structured light based intelligent sensing system for container grabbing of a spreader, which comprises at least two infrared laser sets and a camera with an infrared filter. The two infrared laser sets are mounted at two ends of the inner side of a front grab. The infrared structured light based intelligent sensing system for container grabbing of the spreader is low in cost and high in precision, and container grabbing efficiency of a front crane is improved to some extent.

Description

Grab the casing working intelligent perception system based on the container spreader of infrared structure light

Technical field:

The utility model relates to laser positioning and field of image recognition, refers in particular in the harbour front and hangs in the operation, uses infrared ray location set vanning particular location, and grabs the system of case automatically.

Background technology:

In terminal operation, hang in the front is a kind of important transportation device, and it is as shown in Figure 1 that it grabs casing working.Freight container is mentioned in the operation, and the driver hangs handgrip through adjusting the front, with the handgrip aligning and after being adjacent to freight container it is mentioned.Aligning also is adjacent to freight container, is an operation that difficulty is higher, and apprentice driver often need adjust handgrip repeatedly for handgrip is aimed at chest, causes unnecessary consumption oil and consuming time, has reduced the harbour operating efficiency.

The utility model content:

The problem of mentioning alignment difficulties in the operation to freight container; The utility model aims to provide a kind of container spreader based on infrared structure light and grabs the casing working intelligent perception system; Through gathering infrared structure light and position thereof relation, handgrip and the actual deviation amount of freight container at 5 degree of freedom are hung in the perception front automatically, realize aligning thereby make crane adjust handgrip step by step according to these 5 actual deviation amounts automatically; Subtract the low oil consumption cost, increase work efficiency.

For realizing above-mentioned purpose; The solution that the utility model proposes is: a kind of container spreader based on infrared structure light is grabbed the casing working intelligent perception system; Comprise that being installed in the front hangs camera and the infrared laser that at least two groups at the inboard two ends of handgrip have infrared fileter; The laser center line direction of the shooting direction of said camera and infrared laser is a gravity direction, and wherein following requirement need be satisfied in the installation site of camera and infrared laser:

(1) wherein laser rays of sending of infrared laser is vertical with the long sideline of handgrip;

(2) the vertical laser rays in the long sideline of above-mentioned and handgrip is vertical direction in the image of camera collection.

Grab the influence of case vibrations for reducing at every turn, need to guarantee that laser and camera are fixed,, can install shock ring additional in the first side of shooting as preferred version to equipment.

As specific embodiments, the emitting head of said infrared laser is the cross laser head or is two vertical word laser heads of placing.

The said container spreader based on infrared structure light of the utility model is grabbed the principle of work and the process of casing working intelligent perception system and is described in detail as follows:

(1) device part

The device part comprises two groups of camera and infrared lasers that have infrared fileter at least, is installed in the both sides of crane handgrip respectively, like position among Fig. 13,4; Fig. 2 has provided the birds-eye view after the installation of crane handgrip, and wherein dotted line is represented the visual field that pick up camera can photograph; Two image such as Fig. 4 that pick up camera photographs.Mount scheme provides at " specific embodiments " joint more in detail.

Install in the process of three group equipment, require below need guaranteeing to satisfy:

(1) adjustment infrared laser makes the vertical line of departure of infrared laser P among Fig. 2, Q vertical with handgrip inboard (AB line).

(2) the adjustment camera makes the vertical infrared ray among Fig. 4 in photographic images, be vertical direction (1,2 vertical lines are perpendicular to the image lower edge).

(3) camera and infrared laser head all need be installed by gravity direction, refer to that promptly the shooting direction of camera and the direction of illumination of laser center line all are gravity directions.

Infrared laser P, Q can be the cross laser head, also can replace with two word laser heads of vertically laying; This laser can be installed in the left side of camera, also can be on the right side; Install in a word and have certain alerting ability.

Possibly exist in the actual installation to install and forbidden; Be that aforementioned 3 installation requirements can't reach fully; The utility model has been considered the inaccurate influence that estimation is caused of above-mentioned installation, after state part and point out, install inaccurate, detect the error of being forbidden to cause all in tolerance interval.

(2) estimation algorithm of each degree of freedom deviation

Need the degree of freedom of 5 directions of estimation to be respectively:

(1) the translation Δ x of long limit (AB direction among Fig. 2) is hung in front, horizontal direction upper edge;

(2) the translation Δ y of minor face (AE direction among Fig. 2) is hung in front, horizontal direction upper edge;

(3) the feathering angle α (α among Fig. 7) on handgrip and freight container top;

(4) diff-H on handgrip and freight container top is apart from h (h among Fig. 6);

(5) handgrip is at the flip angle β (β among Fig. 6) of self left and right directions;

Fig. 3 has reflected generally, the deviation of the Δ x that crane handgrip and freight container exist, Δ y, α.

Estimating algorithm can be summarized and be: around two images that camera photographs, judge at first whether the initial position of handgrip needs coarse adjustment all the time, the coarse adjustment method is seen the step of the 3rd in " specific embodiment ", and the purpose of coarse adjustment is that the follow-up estimation of assurance can be carried out.After coarse adjustment put in place, two images according to photographing directly calculated handgrip left and right sides flip angle β, diff-H h, feathering angle α according to formula.After then these three departures being corrected, take once more and obtain two new images, directly calculated level translation Δ x, Δ y.

The calculating of ■ flip angle β and diff-H h

The estimation of flip angle β and diff-H h is estimated through 2 vertical lines in 2 width of cloth images.When handgrip does not need coarse adjustment (follow-up chapters and sections are pointed out), this moment camera C ₁, C ₂The image that photographs is as shown in Figure 5, and the side of handgrip and top case relation is as shown in Figure 6 simultaneously.

Fig. 6 has showed the lateral plan (being P among Fig. 2, Q) of infrared laser P, Q, and PM and QN represent their lasing area, C ₁With C ₂Represent two avris cameras respectively.Measure the distance P Q between two infrared lasers through meter ruler when mounted, infrared laser P is to camera C ₁Between distance P C ₁, infrared laser Q is to camera C ₂Between apart from QC ₂Be known quantity, and in Fig. 4 M ' O ₁' with N ' O ₂' (M ' O ₁', N ' O ₂The pixel of infrared horizontal line is long in the ' presentation graphs 4) all can in image, measure, also be known quantity.

In the egative film, establish pick up camera C ₁With C ₂Focal length be f because

$\left\{\begin{array}{c}\frac{M^{\&prime;}{{\mathrm{<figure-callout\; id="2"\; label="O"\; filenames="HDA0000056493500000014.png,HDA0000056493500000021.png"\; state="\{\{state\}\}">O</figure-callout>}}_2}^{\&prime;}}{\mathrm{<figure-callout\; id="2"\; label="P\; C"\; filenames="HDA0000056493500000014.png,HDA0000056493500000021.png"\; state="\{\{state\}\}">P</figure-callout>}{C}_{}{}_2}=\frac{f}{\mathrm{PM}}\\ \frac{N^{\&prime;}{{\mathrm{<figure-callout\; id="3"\; label="O"\; filenames="HDA0000056493500000011.png"\; state="\{\{state\}\}">O</figure-callout>}}_3}^{\&prime;}}{\mathrm{<figure-callout\; id="3"\; label="Q\; C"\; filenames="HDA0000056493500000011.png"\; state="\{\{state\}\}">Q</figure-callout>}{C}_{}{}_3}=\frac{f}{\mathrm{QN}}\\ \mathrm{PM}-\mathrm{QN}=(\mathrm{<figure-callout\; id="2"\; label="Q\; C"\; filenames="HDA0000056493500000014.png,HDA0000056493500000021.png"\; state="\{\{state\}\}">Q</figure-callout>}{C}_{}{}_2+{\mathrm{PC}}_2)*\tan \mathrm{\&beta;}\end{array}\right.$

Each equation can be tried to achieve handgrip left and right sides flip angle β above the simultaneous.

In the formula: MO ₁, NO ₂Ultrared actual (tube) length, M ' O are gone up in the freight container top in the presentation graphs 5 ₁' expression MO ₁Be mapped in the number of pixels in the image, N ' O ₂' expression NO ₂Be mapped in the number of pixels in the image, f representes focal length of camera, the side-looking length of lasing area in PM, the QN presentation graphs 6, and PQ representes the spacing of two laser heads.

Again because of

PM＝(h/sinβ-WP)*tanβ

＝h/cosβ-WP*tanβ

And

simultaneous two formulas and bring β into can be in the hope of h.In the formula, WP representes the actual length of S. A. laser head apart from the left side, PM, M ' O ₁', PC ₁Continue to use the front definition.

The calculating of ■ feathering angle α

2 vertical lines 1,2 that still use Fig. 4 to take the photograph during calculated level angle of rotation α.When not needing coarse adjustment, (see specific embodiments), the image that photographs is as shown in Figure 4; This moment, feathering angle α can pass through

$\mathrm{\&alpha;}=\arctan \left(\frac{M^{\&prime;}{T^{\&prime;}}_1-N^{\&prime;}{T^{\&prime;}}_2}{M^{\&prime;}{{\mathrm{<figure-callout\; id="1"\; label="O"\; filenames="HDA0000056493500000014.png,HDA0000056493500000021.png"\; state="\{\{state\}\}">O</figure-callout>}}_1}^{\&prime;}+N^{\&prime;}{{\mathrm{<figure-callout\; id="2"\; label="O"\; filenames="HDA0000056493500000014.png,HDA0000056493500000021.png"\; state="\{\{state\}\}">O</figure-callout>}}_2}^{\&prime;}}\right)$

Calculate.Install with the inaccurate situation of straight-line detection under error still lower, reach ± 2 ° in.In the formula, M ' T ' ₁, N ' T ' ₂The length in pixels of infrared ordinate in the presentation graphs 4, M ' O ₁', N ' O ₂The pixel of infrared horizontal line is long in the ' presentation graphs 4.

The calculating of ■ horizontal translation Δ y

For the calculating of horizontal translation Δ x, Δ y, the method that the utility model adopts is: after correcting anglec of rotation α (making α=0), take the set of diagrams picture again, carry out the measurement of translational movement.Calculating behind the correction α is in order to evade centre of gration again; Centre of gration is relevant with handgrip structure, size etc., can increase computation complexity.The position relation on handgrip after the correction and case top is shown in figure 11.

Estimation Δ y adopts 2 vertical lines in the image, and concrete calculation procedure is:

(1) at first artificial with crane handgrip aligning freight container; Record Fig. 5 middle conductor this moment M ' T ₁' number of pixels, be designated as M ' T ' ₀, and record height h at this moment ₀If actual ST this moment is long is M ' T _Real(the unknown) then has

$\frac{M^{\&prime;}{T^{\&prime;}}_0}{{\mathrm{MT}}_{\mathrm{real}}}=\frac{f}{h_0}$

(2), establish punctual M ' T for arbitrary height h ₁' number of pixels be M ' T ' _Acu(can ask) then has

$\frac{M^{\&prime;}{T^{\&prime;}}_{\mathrm{acu}}}{{\mathrm{MT}}_{\mathrm{real}}}=\frac{f}{h}$

Pass through ST _RealSimultaneous (1) then can be obtained M ' T ' _Acu:

(3) for arbitrary height h, not long to punctual image is M ' T ₁', calculative real offset is MT-MT _Acu, simultaneous (2) has

$\frac{M^{\&prime;}{T}^{\&prime;}}{\mathrm{MT}}=\frac{M^{\&prime;}{T^{\&prime;}}_{\mathrm{acu}}}{{\mathrm{MT}}_{\mathrm{real}}}$

With (3) first formula simultaneous, the real offset of Δ y direction:

MT-MT _acu＝(M′T ₁′-M′T′ _acu)*h/f

The concrete rule that moves handgrip is:

MT-MT _AcuRepresent that actual suspender needs amount of movement; If MT-MT _Acu＞0, then move inwards (near the crane direction), otherwise outwards move.

The calculating of ■ horizontal translation Δ x

For the estimation of left and right sides translation Δ x, adopted the method identical with Δ y.In the camera of the left and right sides, must there be a camera can photograph image like Fig. 5.If two cameras can both photograph above-mentioned image, then select the bigger piece image of S ' U ' to carry out computing, principle is the same with the method for Δ y.

A the same joint of computation process, the real offset OU-OU of Δ x direction _AcuFor

$\left\{\begin{array}{c}\mathrm{OU}-O{U}_{\mathrm{acu}}=\left(O^{\&prime;}{{\mathrm{<figure-callout\; id="1"\; label="U"\; filenames="HDA0000056493500000014.png,HDA0000056493500000021.png"\; state="\{\{state\}\}">U</figure-callout>}}_1}^{\&prime;}{O}^{\&prime;}{U^{\&prime;}}_{\mathrm{acu}}\right)*h/f\\ O^{\&prime;}{U^{\&prime;}}_{\mathrm{acu}}=O^{\&prime;}{U^{\&prime;}}_0*h_0/h\end{array}\right.$

The concrete rule that moves handgrip is:

OU-OU _AcuRepresent that actual suspender needs amount of movement; If right pick up camera OU-OU _Acu＞0, then move right, otherwise be moved to the left.

In sum, the said sensory perceptual system of the utility model is based on infrared ray and penetrates the straight line at the freight container end face, perception handgrip and the freight container deviation on 5 degree of freedom automatically, and adjust handgrip according to these 5 amount substeps, realize aiming at.Using laser to carry out target positioning has had comparatively ripe application in fields such as numerically-controlled machine tool, robot perception, about its position error, error compensation theory certain research is arranged also.When the driver moves to freight container when top with handgrip, and when between freight container lateral clearance being arranged, native system can be discerned the minor deviations of handgrip and freight container, error ± 2cm, ± 2 ° within.

Description of drawings:

Fig. 1 is the installation site scheme drawing of the said system of the utility model;

Fig. 2 is the birds-eye view behind the crane handgrip erecting equipment;

Fig. 3 is the crane handgrip birds-eye view that native system generally has been installed;

Fig. 4 is 2 width of cloth images of generally being taken by 2 pick up cameras;

Fig. 5 is the image that photographs after when flip angle β and feathering angle α are set to zero;

2 width of cloth images that Fig. 6 uses when being estimation flip angle β and diff-H h;

Fig. 7 is the first kind of situation scheme drawing that when measuring feathering angle α, needs coarse adjustment;

Fig. 8 is the infrared line chart of taking under first kind of coarse adjustment situation;

Fig. 9 is the second kind of situation scheme drawing that when measuring feathering angle α, needs coarse adjustment;

Figure 10 is the infrared line chart of taking under second kind of coarse adjustment situation;

Figure 11 be with handgrip horizontally rotate correct with self upset after, to the birds-eye view of handgrip;

In the accompanying drawings:

P, Q-infrared laser C ₁, C ₂The infrared vertical line 3 that-camera 1,2-camera photograph, 4-install the inboard A of position 5-pick up camera coverage 6-front sling, the upper left angle point U ' of B-suspender lower surface right ends point E-suspender of camera ₁, M ', O ' ₁, T ' ₁-to the artificial lower surface C of some W-suspender self left and right sides trip shaft WZ line-suspender after leveling that marks of the infrared figure that photographs ₁C ₂Lower surface β-the handgrip of line-suspender before leveling is at the flip angle α-handgrip of self left and right directions and the feathering angle on freight container top

The specific embodiment:

This instance provides the method that handgrip is aimed at freight container is automatically hung in the front, relates to the work such as compatibility of installation, adjusting and the estimation program of awareness apparatus.

The first step, the preliminary installation of sensory perceptual system.

Sensory perceptual system comprises two groups of cameras and infrared laser; Be installed in the inboard two ends of crane handgrip, position 3,4 as shown in Figure 1, the birds-eye view after the installation such as Fig. 2; When handgrip and freight container exist when concerning like Fig. 3 position, two pick up cameras can photograph the image like Fig. 4.For making things convenient for subsequent calculations, equipment is equipped with following requirement:

(1) the adjustment infrared laser makes vertical laser rays (the vertical line infrared ray of cross infrared laser P, Q among Fig. 2) vertical with handgrip inside cord AB.

(2) the adjustment camera makes the vertical laser rays (Fig. 4 center line 1, line 2) among the figure be vertical direction in the drawings, and promptly line 1, line 2 are perpendicular to the image lower edge.

(3) camera and laser head all need be installed by gravity direction, and promptly the direction of illumination of the shooting direction of camera and laser center line is a gravity direction.

(4) in order to make pick up camera photograph infrared ray, infrared fileter is installed before camera lens.The selection standard of infrared ray and filter wave band is: each pick up camera can only photograph 2 infrared rays, can not photograph other any objects.

Grab the influence of case vibrations to equipment for reducing, present embodiment is on the right side of infrared laser P at every turn, and the left side of infrared laser Q adds shock ring, and its particular location also can be decided according to crane, and is fixed to guarantee laser and camera.

Camera and the laser head installed in two frames among Fig. 1 can have multiple mode, and for example the cross laser head of side can replace with two word laser heads of vertically laying; Laser can also can be on the right side in the left side of camera.Therefore, mounting means is comparatively flexible.

Possibly exist in the actual installation to install and forbidden, this comprises:

(1) camera and laser can't be pressed the gravity direction installation utterly

(2) laser can't be utterly inboard perpendicular to handgrip, or the installation of camera do not make vertical laser rays in image vertically.

Present embodiment has considered that above-mentioned 2 kinds are installed the inaccurate influence that estimation is caused, and experimental result points out, comprises the error of being forbidden to cause being installed in tolerance interval.

Second step, the repeatedly measurement and the record of constant.

For estimating, must measure or write down some constant, point out that the constant that will add up is summarized as follows here in this point utility model content in front:

(1) the cooresponding actual length k of each pixel in focal length of camera f, the photographic images.Find f easily, k can't obtain separately, and only demand goes out f/k.

(2) constant that installs on the handgrip of using during estimation flip angle β, i.e. PQ among Fig. 6, PC ₁, QC ₂

The constant that installs on the handgrip of using when (3) estimating diff-H h, i.e. WP among Fig. 6.

(4) need the amount of record during the Δ y of estimation horizontal translation after manual the aligning, i.e. M ' T ' among Fig. 5 ₀, h ₀

(5) need the amount of record during the Δ x of estimation horizontal translation after manual the aligning, i.e. O ' U ' among Fig. 5 ₀, h ₀Notice the h in this step ₀H with a last step ₀Identical, expression can once be noted 3 amounts after handgrip is aimed at.

Above 5 groups of amounts, all need take multiple measurements reducing error, preferred measure also for 5 times of present embodiment averaged.

In the 3rd step, operation deviation estimation program draws the estimation result.

After accomplishing preceding two steps, need the operation estimation algorithm, obtain the result of each degree of freedom deviation.Whole estimation program is that handgrip is moved on the limit, and the limit is estimated, and mainly is divided into coarse adjustment and goes on foot greatly with estimation two.

Coarse adjustment and estimation algorithm operating procedure are such (carrying out successively):

(1) if when left and right sides avris camera does not all have image, explain deviations is excessive, needs the driver manually handgrip to be moved to the freight container top.

(2) at first calculate flip angle β, diff-H h.If a certain camera is taken less than vertical line, need coarse adjustment that handgrip is moved to the driving compartment direction, until photographing.When the avris camera all can photograph vertical line (like Fig. 5), calculate β, h according to the fwd formula.

(3) calculated level angle of rotation α.If a certain camera is clapped less than vertical line, need coarse adjustment that handgrip is moved to the driving compartment direction, until photographing; In addition, if when a certain vertical line in the image presents full full figure (seeing Fig. 7, Fig. 9), also need coarse adjustment that handgrip is moved to the driving compartment direction,, be converted into machine language and be until discontented full figure:

When M ' E ' (or N ' F ') equals 0.5*Height _ImgThe time, handgrip is near crane direction motion, wherein 0.5*Height _ImgBe meant the picture altitude that photographs.

As M ' E ' (or N ' F ') when equaling 0, promptly there is not intersection point M ', handgrip is to moving away from the crane direction.

When coarse adjustment is accomplished or when not needing coarse adjustment, pick up camera can photograph the image like Fig. 5.

This moment, feathering angle α can pass through

$\mathrm{\&alpha;}=\arctan \left(\frac{M^{\&prime;}E-N^{\&prime;}F}{M^{\&prime;}{N}^{\&prime;}}\right)$

Calculate.Install with the inaccurate situation of straight-line detection under error still lower, reach ± 2 ° in.

(4) calculating of horizontal translation Δ x, Δ y.

At α, β after three measurement amounts of h are accomplished, needs the adjustment handgrip to make α ≈ 0 and β ≈ 0, and this moment, handgrip concerned shown in figure 11 with the position on case top.According to formula

MT ₁-MT _acu＝(M′T ₁′*h-M′T′ ₀*h ₀)/f

Calculate the real offset MT of Δ y ₁-MT _AcuMT wherein ₁Represent under the current height the vertical ultrared actual length of freight container end face.MT _AcuRepresent under the current height the vertical infrared line length behind the aligning, so MT ₁-MT _AcuRepresented in order to aim at the amount that suspender need move.M ' T ₁Under the current height of ' expression, M ' T among Fig. 5 ₁' pixel long, h is current height.M ' T ' ₀For for the first time to M ' T in the punctual images recorded ₁' pixel long, h ₀It is the height that writes down for the first time.

According to formula

O ₁U ₁-O ₁U _acu＝(O ₁′U ₁′*h-O ₁′U′ ₀*h ₀)/f

Calculate the real offset O of Δ x ₁U ₁-O ₁U _AcuWherein OU representes under the current height, the ultrared actual length of freight container end face level, O ₁U _AcuRepresent under the current height the infrared line length of the level behind the aligning, so O ₁U ₁-O ₁U _AcuRepresented in order to aim at the amount that suspender need move.O ₁' U ₁Under the current height of ' expression, O ' U among Fig. 5 ₁' pixel long, h is current height.O ' U ' ₀For for the first time to O in the punctual images recorded ₁' U ₁' pixel long, h ₀It is the height that writes down for the first time.

Notice that above step carries out successively.

The 4th step, based on adjusting device as a result to reduce error

Experiment points out that the result who initially obtains has than mistake, and particularly flip angle β installs comparatively responsive to equipment.

The first step points out that 3 mounting conditions only need naked eyes range estimations to reach requirement and get final product, the error that can guarantee most of amount this moment ± 2 ° and ± 2cm within.The sensitivity of flip angle β is higher, and control method is: the driver slightly regulates laser then and makes β=0 at first with the handgrip leveling, and the foundation of standard can be with reference to hypothesis testing method in the theory of chances).

The 5th step made awareness program and crane system compatible, and real offset is converted into the gear amount of movement.

For freight container is picked up, the self-aligning step of crane handgrip is:

(1) left and right sides flip angle β with handgrip self is adjusted to zero;

(2) handgrip feathering angle α is adjusted to zero;

(3) the adjustment handgrip makes horizontal translation amount Δ x, Δ y be zero;

(4) put down handgrip, make that diff-H h is zero

Above-mentioned motion relates to the specific procedure that moves arm, and this step must be accomplished by crane system.Present embodiment only is responsible for estimating and real offset, and the work that is translated into the gear amount of movement should be accomplished by crane production firm.

Claims (3)

1. the container spreader based on infrared structure light is grabbed the casing working intelligent perception system; It is characterized in that; Comprise that being installed in the front hangs camera and the infrared laser that at least two groups at the inboard two ends of handgrip have infrared fileter; The laser center line direction of the shooting direction of said camera and infrared laser is a gravity direction, and wherein following requirement need be satisfied in the installation site of camera and infrared laser:

(1) wherein laser rays of sending of infrared laser is vertical with the long sideline of handgrip;

(2) the vertical laser rays in the long sideline of above-mentioned and handgrip is vertical direction in the image of camera collection.

2. grab the casing working intelligent perception system according to the said container spreader of claim 1, it is characterized in that, install shock ring additional in the first side of said shooting based on infrared structure light.

3. grab the casing working intelligent perception system according to claim 1 or 2 said container spreaders based on infrared structure light, it is characterized in that, the emitting head of said infrared laser is the cross laser head or is two vertical word laser heads of placing.

Images