CN106504288A - A kind of domestic environment Xiamen localization method based on binocular vision target detection - Google Patents

A kind of domestic environment Xiamen localization method based on binocular vision target detection Download PDF

Info

Publication number
CN106504288A
CN106504288A CN201610924452.8A CN201610924452A CN106504288A CN 106504288 A CN106504288 A CN 106504288A CN 201610924452 A CN201610924452 A CN 201610924452A CN 106504288 A CN106504288 A CN 106504288A
Authority
CN
China
Prior art keywords
line segment
line
doubtful
group
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610924452.8A
Other languages
Chinese (zh)
Other versions
CN106504288B (en
Inventor
薛林
王玉亮
乔涛
王巍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Evolver Xiaopang Robot Technology Co ltd
Original Assignee
Beijing Science And Technology Ltd Of Evolution Person Robot
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Science And Technology Ltd Of Evolution Person Robot filed Critical Beijing Science And Technology Ltd Of Evolution Person Robot
Priority to CN201610924452.8A priority Critical patent/CN106504288B/en
Publication of CN106504288A publication Critical patent/CN106504288A/en
Priority to HK17105132.9A priority patent/HK1231614A1/en
Priority to PCT/CN2017/107499 priority patent/WO2018077165A1/en
Application granted granted Critical
Publication of CN106504288B publication Critical patent/CN106504288B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image

Abstract

The invention discloses a kind of domestic environment Xiamen localization method based on binocular vision target detection, the method includes:Image is obtained by binocular vision video camera;Intercept image and obtain binary image;Obtain to be a serial of line sections of doorjamb;Find the line segment pair matched in left images;Optimum Matching line segment is obtained to queue using the principle that global optimum mates;Doubtful door line pair is obtained to the distance of corresponding actual line by mating line segment;Doubtful door optimal solution is obtained using characteristic-integration principle, so as to opposite house is positioned.Technical solution of the present invention adopts binocular vision, by the bilateral frame of highly effective algorithm recognitiion gate, effectively realizes the door positioning under domestic environment, with low cost, easy to use and flexible, the extensive advantage of application scenarios.

Description

A kind of domestic environment Xiamen localization method based on binocular vision target detection
Technical field
The present invention relates to robot vision field, is a kind of real-time object localization method, especially a kind of based on binocular The domestic environment Xiamen localization method of sensation target detection.
Background technology
In recent years, roboticses have obtained constantly developing, in family, office, hospital and work as high and new technology Factory etc. is widely adopted.It is used for the industrial robot of Intelligent assembly to for public service, home services from workshop Intellect service robot, robot have increasingly been pressed close to and have been entered in our work and life.Server emerging at present Qi Ren enterprises and service robot application market are also constantly increasing, so amusement miscellaneous, rescue, monitoring robot The every aspect of we life is gradually penetrated into.With to the more and more high of service robot degree of intelligence demand, to people Work technology of identification, human-computer interaction technology, autonomous patrol technology and intelligent control technology etc. require also to heal for the intellectual technology of representative Come higher.For home-services robot, robot is especially monitored, indoor navigation and independently go on patrol the work(being commonly necessary Energy.Therefore for the maximum challenge of such robot be on the basis of limited understanding is carried out to surrounding enviroment, can be autonomous hold The increasing complex task of row.Wherein to robot, map structuring, indoor navigation, autonomous patrol in domestic environment have door Extremely important meaning.Its reason is as follows:
1. it is geostationary in the position of domestic environment;
2. it is the unique passage for connecting a room and another room;
3. width and shape has unified standard.
But some home services humanoid robots are more because of its integrated functionality, and volume is relatively bulky, but under domestic environment Door is relatively small.Realize that opposite house is positioned, and pass through door, become the difficult point of robotics development.It is achieved that to household The positioning of environment Xiamen, for the development tool of roboticses and industry is of great significance.
There are a lot of scientific research institutions and manufacturer all in the orientation problem of research domestic environment Xiamen in the world, imaged by employing Head, sonar sensor, laser radar sensor etc. are realizing sensor information or multi-sensor information fusion, and propose one and be The solution of row, such as:
1. in door both sides adhesive label, and the positioning of opposite house is further realized to the positioning of label by monocular vision;
2. using whether having depth saltation zone in sonar sensor or laser radar sensor sniffing robot direction of advance, And the door positioning to open is realized with reference to known cartographic information;
3., using RGB-D sensors, extracted by the feature of opposite house, and the depth information with reference to each object in the visual field Realize the positioning of opposite house;
4. monocular vision is adopted, by extracting image center line feature, further mates the various combined situations of door line feature, Realize the positioning of opposite house.
But said method has certain defect.First, sonar sensor, laser radar sensor price are very high, RGB-D The price of sensor is not relatively low yet, so the robot with the sensor is difficult the family for being generalized to each economic class In;And this scheme there is also deficiency, it is impossible to realize positioning to the door that close.Next, although 4 cost of said method 1 and method Than relatively low, but method 1 needs to modify home environment, and operates relatively complicated, it is difficult to received by user;Method 4 need robot need from door have with a certain distance from just can achieve opposite house positioning, otherwise door with ground boundary can be located at photographic head Dead range in, be subject in actual applications certain to limit to.
Content of the invention
The present invention proposes a kind of domestic environment Xiamen localization method based on binocular vision target detection, and the method is by adopting The positioning to domestic environment Xiamen is realized with binocular vision target detection, is effectively solved using sensing by efficient algorithm The expensive defect of the sensor plans such as device, laser radar sensor, reduces hardware cost;And, this method need not Increase unnecessary mark on door, more simple and convenient in practical operation;Meanwhile, this method only needs to two side frames of door Simultaneously appear in the positioning that opposite house is just can achieve in binocular field of view, actually used more flexible;It is right that this method can also be realized Under domestic environment, the door of different conditions realizes positioning, such as closing, the door of half-open, standard-sized sheet, with more wide application prospect.
Technical scheme provides a kind of domestic environment Xiamen localization method based on binocular vision target detection, Comprise the following steps:
S101, binocular vision video camera (left video camera and right video camera) is placed in the support apart from ground certain altitude On, horizontal positioned receives the image I from two-way binocular vision video cameraL、IR
S102, with the respective image principal point of left video camera and right video cameraCentered on, respectively Intercept image ILMiddle coordinate isRectangular area and image IRMiddle coordinate isRectangular area (yupAnd ydownFor the upside threshold value and downside threshold value of image interception, W is image ILAnd IRThe width of image) can intercept after RGB image IL,C, IR,C
Above-mentioned photographic head parameter is to demarcate to obtain by monocular, such as Zhang Zhengyou standardizitions,
S103, to image IL,C, IR,CGray processing, obtains gray level image I respectivelyL,GAnd IR,G, then respectively to IL,GAnd IR,GEnter Row Canny operator edge detections, obtain binary image IL,BAnd IR,B
S104, using accumulated probability Hough transformation algorithm to binary image IL,BAnd IR,BStraight-line segment detection is carried out, and Extracting wherein slope isLine segment (TdFor angle change threshold value), every line segment is expressed asIn formulaIt is line segment La,iWith straight line yI=yup+1The x of intersection pointIValue, and according to both Set pattern is then screened to the line segment obtained in two width images, can further obtain line segment group L in left imageL={ LL,1, LL,2,…,LL,nLAnd right image in line segment group LR={ LR,1,LR,2,…,LR,nR(quantity of the nL for left image middle conductor, nR Quantity for right image middle conductor);
S105, with line segment group L of left imageLMiddle conductor LL,iOn the basis of, calculate LL,iCorrespond to right image middle conductor group LR? The matching degree of all line segments in the range of matching somebody with somebody, can obtain meeting the spurious matches line segment of screening threshold value to group { LL,i,:}={ (LL,i, LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in)};
S106, judge LLIn all of line segment whether complete spurious matches line segment to organize acquisition, if it is not, then turn to step S105;
S107, obtain line segment group LLIn corresponding line segment group L of each line segmentRIn spurious matches line segment to a group set CMP= {{LL,0,:},{LL,1,:},…,{LL,nL,:}};
S108, the principle that is mated using global optimum select L from CMPLAnd LRMiddle Optimum Matching line segment is to queue(wherein ix and jx represent line segment respectivelyAnd line segmentIn line segment group LLAnd LRIn sequence number), its corresponding actual vertical line group be L={ L1,L2,…,Ln};
S109, formula of being found range using binocular
Calculate coordinate of corresponding actual vertical line groups L of OMP Q under photographic head coordinate systemWherein, f',For binocular vision photographic head parameter, demarcated by monocular and obtained , T is the spacing of two photographic head light between centers,The two lines section for respectively matchingWithCentre coordinate xIValue, xCAnd zCX of the corresponding actual vertical line of two lines section for matching under photographic head coordinate systemC-zCCoordinate;
S110, according to formula(i and j represent line LiWith line LjSequence number in L) meter Calculate vertical line L in LiWith vertical line LjDistance, and think:
Work as di,j∈[WD,min,WD,max](WD,minAnd WD,maxThe respectively minima of domestic environment gate-width and maximum) when, Line LiWith line LjMay be two outer rims of door, be designated as doubtful door
Work as di,j∈[WF,min,WF,max](WF,minAnd WF,maxThe respectively wide minima of domestic environment doorframe and maximum) When, line LiWith line LjMay be the both sides sideline of doorframe, be designated as doubtful doorframe
Calculate in L that institute is the distance between wired, doubtful door group is obtained (ix and jx represent vertical line L respectivelyix,xAnd Ljx,xSequence number in vertical line group L, D are doubtful door label, and x represents doubtful doorIn DsusIn sequence number), and doubtful doorframe group(ix Vertical line L is represented respectively with jxix,xAnd Ljx,xSequence number in vertical line group L, F are doubtful doorframe label, and x represents doubtful doorframeIn FsusIn sequence number)
S111, using characteristic-integration principle from doubtful door group DsusMiddle selection optimal solution, integrates maximum doubtful door for most Excellent solution, that is, realize the identification of opposite house.
Further, in step S104, line segment group L obtained in left imageL={ LL,1,LL,2,…,LL,nLAnd Line segment group L in right imageR={ LR,1,LR,2,…,LR,nR(quantity of the nL for left image middle conductor, nR are right image middle conductor Quantity), further include:
S201, leave out length in pixels less than TlengthLine segment;
S202, when there is center distance less than TdisDuring the two lines section of length in pixels, leave out the less line segment of length;
S203, to the line segment in two images according to xIIt is ranked up from small to large;
S204, final line segment group L obtained in left imageL={ LL,1,LL,2,…,LL,nLAnd right image in line segment group LR ={ LR,1,LR,2,…,LR,nR}.
Further, in step S105, line segment group L with left imageLMiddle conductor LL,iOn the basis of, calculate LL,iRight Should be in right image middle conductor group LRThe matching degree of all line segments in matching range, can obtain the spurious matches line for meeting screening threshold value Section is to group { LL,i,:}={ (LL,i,LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in), further include:
Line segment group L with left imageL={ LL,1,LL,2,…,LL,nLIn line segment LL,iAs a example by for item to be matched, if which is sat It is designated asMatching process is as follows:
S301, formula of being found range according to binocularIn conjunction with the scope that actually fathomsDisparity range [d can be obtainedmin,dmax], i.e. line segment group LRIn with LL,iMatch line segment LR,jXISpan isLRIn all meet require line segments be designated as line segment LL,iSpurious matches line segment group;
S302, the matching area for calculating matched line and line to be matched, it is N to be defaulted as widthp, a height of yup+ydown+ 1 square Shape region, if there are other line segments in the default zone, matching area is changed into the rectangular area between two lines section, if this is silent Recognize region and exceed image boundary, then matching area is changed into the rectangular area between the line segment and image boundary, and ensures left and right figure As two pieces of rectangular zone widths to be matched identical;
S303, further calculating obtain line segment LL,iThe left and right sides and a line segment L in its spurious matches line segment groupR,ixLeft Right matching areaAnd (color space is straight to calculate the feature histogram in 4 Block- matching regions respectively Fang Tu, such as RGB, HSV, YUV etc., such as Texture similarity, LBP etc., and other feature histograms);
S304, by using similarity measurement (such as Euclidean distance, mahalanobis distance, Pasteur distance etc.) respectively calculate line segment LL,iAnd LR,ixLeft side matching areaWithLine segment LL,iAnd LR,ixRight side matching areaWithVarious features straight The similarity of square figure isWith(n is characterized label), and then obtain line segment LL,iAnd LR,ixThe similarity power of the left and right sides Weight is:
In formulaWithRespectively line segment LL,iWith line segment L to be matchedR,ixSimilarity of the left and right sides with regard to feature k, akIt is characterized the weight of k matching degrees;
S305, note wi,ixForWithMiddle the greater, if wi,ix> Tm, then it is assumed that line segment L to be matchedR,ixFor LL,iDoubt Like coupling line segment, spurious matches line segment is constituted to (LL,i,LR,ix);
S306, determine whether other line segments do not complete coupling, if so, then turn to step S302;
S307, the spurious matches line segment pair for further all being met screening threshold value, constitute spurious matches line segment to group {LL,i,:}={ (LL,i,LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in), n be mate line segment to mate in group to number.
Further, in step S108, the principle of the employing global optimum coupling selects L from CMPLAnd LRIn most Excellent coupling line segment is to queue(wherein ix and jx are represented respectively Line segmentAnd line segmentIn line segment group LLAnd LRIn sequence number), its corresponding actual vertical line group be L={ L1,L2,…,Ln, Further include:
S401, L is extracted from CMPLAnd LRIn all of coupling line segment to queue MPQ={ (LL,i1,LR,j1),(LL,i2, LR,j2),…,(LL,in,LR,jn) (wherein ix and jx represent line segment L respectivelyL,ixWith line segment LR,jxIn line segment group LLAnd LRIn sequence Number), each MPQ={ (LL,i1,LR,j1),(LL,i2,LR,j2),…,(LL,in,LR,jn) following rule should be met:
1. to be respectively less than which to the label of each the spurious matches line segment centering two lines section in queue direct for coupling line segment The corresponding label of follow-up spurious matches line segment centering two lines section, i.e., for spurious matches line segment pairWith doubtful Match somebody with somebody line segment pairI need to be metk< ik+1&&jk< jk+1
2. the label of the internal two lines section of first spurious matches line segment during coupling line segment is to queue need to meet current With line segment to the label for not having the internal two lines section of other spurious matches line segments in queue less than its reference numeral, i.e., for doubtful Like coupling line segment pairTo there is no spurious matches line segment pair in queue in current matching line segmentMeet ik < i1||jk< j1
3. coupling line segment need to be met currently to the label of the internal two lines section of last spurious matches line segment in queue Coupling line segment to the label that do not have the internal two lines section of other spurious matches line segments in queue more than its reference numeral, i.e., for Coupling line segment pairTo there is no coupling line segment pair in queue in current matching line segmentMeet ik> in| |jk> jn
S402, calculate each coupling the total weight of line segment to queue:
In formula i be coupling sequence number of the line segment to queue, n be current matching line segment to queue mate to number, rhoLi,Rj It is by LLIn Li-th article of line segment and LRIn the Rj-th article line segment composition spurious matches line segment pair matching degree;
S403, all coupling total weights of the line segment to queue of calculating, the maximum coupling line segment of weighted value is complete to queue Office's optimal solution, is designated as
Further, in step S111, the characteristic-integration principle is further included:
With doubtful door(ix and jx is line Lix,iAnd Ljx,iSequence number in L, D are doubtful door label, and i is doubtful Like doorIn doubtful door group DsusIn sequence number) as a example by, initial integration is 0, and characteristic-integration computational methods include:
If there is doorjamb on the left of the doubtful doors of S501, i.e., doubtful doorLeft side bearing LixThere is line L in right sidemFull Foot (Lix,Lm)∈Fsus, then bonus point SF,L
If there is doorjamb on the right side of the doubtful doors of S502, i.e., doubtful doorRight side bearing LjxThere is line L in left sidenFull Foot (Ln,Ljx)∈Fsus, then bonus point SF,R
For line LxIt is imaged as mating in the photographic head of left and right line segment in binocular to (LL,ix,LR,jx), for line segment LL,ixWith LR,jxThe matching degree of the left and right sidesWithThere are three kinds of situations:
T in formulamFor matching degree threshold value;
If the doubtful doors of S503Sideline LixLeft and right sides matching degreeWithMeet formula (1), then plus Divide SM,1;Bonus point S if formula (2) is metM,2;If meeting formula (3), deduction SM,3
If the doubtful doors of S504Sideline LjxLeft and right sides matching degreeWithMeet formula (1), then plus Divide SM,1;Bonus point S if formula (3) is metM,2;If meeting formula (2), deduction SM,3
If the doubtful doors of S505There is left frame (Lix,Lm) when, if sideline LmLeft and right sides matching degreeWithMeet formula (1) or formula (2), then bonus point SM,2;If meeting formula (3), deduction SM,3
If the doubtful doors of S506There is left frame (Ln,Ljx) when, if sideline LnLeft and right sides matching degreeWithMeet formula (1) or formula (3), then bonus point SM,2;If meeting formula (2), deduction SM,3
If S507 is in doubtful doorThe depth that there is actual line in the middle of two side lines is undergone mutation, that is, there is LkIn LixAnd LjxBetween, and meet(TZIt is distance mutation threshold value), then bonus point Sz,1
If S508 is in doubtful doorThe depth that there is actual point in the middle of two side lines is undergone mutation, that is, there is matching angle Point PmIn LixAnd LjxBetween, and meetThen bonus point Sz,1.
Further, in step S508, the matching angle point is further included:
The coupling angle point refers to by ORB Corner Detection Algorithms, SURF Corner Detections, FAST Corner Detection scheduling algorithms to image IL,CAnd IR,CThe angle point for detecting, and coupling angle point the GM={ (P obtained using BF matching algorithms or FLANN matching algorithmsL,i1, PR,j1),(PL,i2,PR,j2),…,(PL,in,PR,jn), and its coordinate under photographic head coordinate system is obtained by binocular range finding formula
Further, in step S111, the employing characteristic-integration principle is from doubtful door group DsusMiddle selection is optimum Solution, it is optimal solution to integrate maximum doubtful door, further includes:
Calculate doubtful door group DsusIn all doubtful doors integration Ssus={ S1,S2,…,Sn, take integration maximum and meet Smax≥Ts(TsIntegral threshold) doubtful door be optimal solution;If there is the doubtful door of maximum integration identical, doubtful door is selected Central point to photographic head zero distance most short doubtful door be optimal solution.
Technical solution of the present invention effectively realizes the door under domestic environment using binocular vision video camera by efficient algorithm Positioning, and unnecessary mark need not be increased on door, it is only necessary to two side frames of door are simultaneously appeared in binocular field of view Just the positioning of opposite house is can achieve, the door in various states such as closing, half-open, standard-sized sheets effectively can be recognized, with cost The extensive advantage of low, easy to use and flexible, application scenarios.
Other features and advantages of the present invention will be illustrated in the following description, also, partly be become from description Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can pass through in the explanation that is write In book, claims and accompanying drawing, specifically noted structure is realizing and obtain.
Below by drawings and Examples, technical scheme is described in further detail.
Description of the drawings
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for description, the reality with the present invention Applying example is used for explaining the present invention together, is not construed as limiting the invention.In the accompanying drawings:
Fig. 1 is the flow process of the domestic environment Xiamen localization method in the embodiment of the present invention one based on binocular vision target detection Figure;
Fig. 2 is illustrated by carrying out the pixel coordinate system that image interception is used in the embodiment of the present invention one to left and right video camera Figure;
Fig. 3 is the flow process of the domestic environment Xiamen localization method in the embodiment of the present invention one based on binocular vision target detection Schematic diagram;
Fig. 4 is photographic head coordinate system schematic diagram in step S109 in the embodiment of the present invention one;
Fig. 5 is the width information integration schematic diagram of door in step S501, S502 in the embodiment of the present invention one;
Fig. 6 is to judging to be the method flow of the line segment of doorjamb in two road images of left and right in the embodiment of the present invention one Figure;
Fig. 7 is the method flow diagram for finding left and right coupling line segment in the embodiment of the present invention one;
Fig. 8 is to obtain method flow diagram of the coupling line segment to group according to global registration principle in the embodiment of the present invention one;
Fig. 9 is the method for carrying out bonus point according to characteristic-integration principle to doubtful doorjamb line segment in the embodiment of the present invention one Flow chart.
Specific embodiment
The preferred embodiments of the present invention are illustrated below in conjunction with accompanying drawing, it will be appreciated that preferred reality described herein Apply example to be merely to illustrate and explain the present invention, be not intended to limit the present invention.
As shown in Figures 1 to 5, the flow process is comprised the following steps:
S101, binocular vision video camera (left video camera and right video camera) is placed in the support apart from ground certain altitude On, horizontal positioned receives the image I from two-way binocular vision video cameraL、IR
S102, with the respective image principal point of left video camera and right video cameraCentered on, respectively Intercept image ILMiddle coordinate isRectangular area and image IRMiddle coordinate isRectangular area (yupAnd ydownFor the upside threshold value and downside threshold value of image interception, W is image ILAnd IRThe width of image) can intercept after RGB image IL,C, IR,C
Above-mentioned photographic head parameter is to demarcate to obtain by monocular, such as Zhang Zhengyou standardizitions.
S103, to image IL,C, IR,CGray processing, obtains gray level image I respectivelyL,GAnd IR,G.Again respectively to IL,GAnd IR,GEnter Row Canny operator edge detections, obtain binary image IL,BAnd IR,B
S104, using accumulated probability Hough transformation algorithm to binary image IL,BAnd IR,BStraight-line segment detection is carried out, and Extracting wherein slope isLine segment (TdFor angle change threshold value).Every line segment is expressed asIn formulaIt is line segment La,iWith straight line yI=yupThe x of+1 intersection pointIValue.And according to Established rule is screened to the line segment obtained in two width images.Line segment group L in left image can further be obtainedL={ LL,1, LL,2,…,LL,nLAnd right image in line segment group LR={ LR,1,LR,2,…,LR,nR(quantity of the nL for left image middle conductor, nR Quantity for right image middle conductor);
S105, with line segment group L of left imageLMiddle conductor LL,iOn the basis of, calculate LL,iCorrespond to right image middle conductor group LR? The matching degree of all line segments in the range of matching somebody with somebody, can obtain meeting the spurious matches line segment of screening threshold value to group { LL,i,:}={ (LL,i, LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in)};
S106, judge LLIn all of line segment whether complete spurious matches line segment to organize acquisition, if it is not, then turn to step S105;
S107, obtain line segment group LLIn corresponding line segment group L of each line segmentRIn spurious matches line segment to a group set CMP= {{LL,0,:},{LL,1,:},…,{LL,nL,:}};
S108, the principle that is mated using global optimum select L from CMPLAnd LRMiddle Optimum Matching line segment is to queue(wherein ix and jx represent line segment respectivelyAnd line segmentIn line segment group LLAnd LRIn sequence number), its corresponding actual vertical line group be L={ L1,L2,…,Ln};
S109, formula of being found range using binocular
Calculate coordinate of corresponding actual vertical line groups L of OMPQ under photographic head coordinate systemWherein, f',For binocular vision photographic head parameter, demarcated by monocular and obtained , T is the spacing of two photographic head light between centers,The two lines section for respectively matchingWithCentre coordinate xIValue, xCAnd zCX of the corresponding actual vertical line of two lines section for matching under photographic head coordinate systemC-zCCoordinate;
S110, according to formula(i and j represent line LiWith line LjSequence number in L) meter Calculate vertical line L in LiWith vertical line LjDistance, and think:
Work as di,j∈[WD,min,WD,max](WD,minAnd WD,maxThe respectively minima of domestic environment gate-width and maximum) when, Line LiWith line LjMay be two outer rims of door, be designated as doubtful door
Work as di,j∈[WF,min,WF,max](WF,minAnd WF,maxThe respectively wide minima of domestic environment doorframe and maximum) When, line LiWith line LjMay be the both sides sideline of doorframe, be designated as doubtful doorframe
Calculate in L that institute is the distance between wired, doubtful door group is obtained (ix and jx represent vertical line L respectivelyix,xAnd Ljx,xSequence number in vertical line group L, D are doubtful door label, and x represents doubtful doorIn DsusIn sequence number), and doubtful doorframe group (ix and jx represent vertical line L respectivelyix,xAnd Ljx,xSequence number in vertical line group L, F are doubtful doorframe label, and x represents doubtful doorframeIn FsusIn sequence number)
S111, using characteristic-integration principle from doubtful door group DsusMiddle selection optimal solution, integrates maximum doubtful door for most Excellent solution, that is, realize the identification of opposite house.
Fig. 6 is to judging to be the method flow of the line segment of doorjamb in two road images of left and right in the embodiment of the present invention one Figure, i.e., in step S104, obtain line segment group L in left and right imageLAnd LRMethod and step.As shown in fig. 6, the flow process includes Following steps:
S201, leave out length in pixels less than TlengthLine segment;
S202, when there is center distance less than TdisDuring the two lines section of length in pixels, leave out the less line segment of length;
S203, to the line segment in two images according to xIIt is ranked up from small to large;
S204, final line segment group L obtained in left imageL={ LL,1,LL,2,…,LL,nLAnd right image in line segment group LR ={ LR,1,LR,2,…,LR,nR}.
Fig. 7 is the method flow diagram for finding left and right coupling line segment in the embodiment of the present invention one, i.e., in step S105, with a left side Line segment group L of imageLMiddle conductor LL,iOn the basis of, calculate LL,iCorrespond to right image middle conductor group LRAll line segments in matching range Matching degree, obtain meeting the spurious matches line segment of screening threshold value to group { LL,i,:}={ (LL,i,LR,i1),(LL,i,LR,i2),…, (LL,i,LR,in) flow process.As shown in fig. 7, the flow process is comprised the following steps:
S301, formula of being found range according to binocularIn conjunction with the scope that actually fathomsDisparity range [d can be obtainedmin,dmax], i.e. line segment group LRIn with LL,iMatch line segment LR,jXI spans beLRIn all meet require line segments be designated as line segment LL,iSpurious matches line segment group;
S302, the matching area for calculating matched line and line to be matched, it is N to be defaulted as widthp, a height of yup+ydown+ 1 square Shape region, if there are other line segments in the default zone, matching area is changed into the rectangular area between two lines section, if this is silent Recognize region and exceed image boundary, then matching area is changed into the rectangular area between the line segment and image boundary, and ensures left and right figure As two pieces of rectangular zone widths to be matched identical;
S303, further calculating obtain line segment LL,iThe left and right sides and a line segment L in its spurious matches line segment groupR,ixLeft Right matching areaAnd (color space is straight to calculate the feature histogram in 4 Block- matching regions respectively Fang Tu, such as RGB, HSV, YUV etc., such as Texture similarity, LBP etc., and other feature histograms);
S304, by using similarity measurement (such as Euclidean distance, mahalanobis distance, Pasteur distance etc.) respectively calculate line segment LL,iAnd LR,ixLeft side matching areaWithLine segment LL,iAnd LR,ixRight side matching areaWithVarious features straight The similarity of square figure isWith(n is characterized label), and then obtain line segment LL,iAnd LR,ixThe similarity power of the left and right sides Weight is:
In formulaWithRespectively line segment LL,iWith line segment L to be matchedR,ixSimilarity of the left and right sides with regard to feature k, akIt is characterized the weight of k matching degrees;
S305, note wi,ixForWithMiddle the greater.If wi,ix> Tm, then it is assumed that line segment L to be matchedR,ixFor LL,iDoubt Like coupling line segment, spurious matches line segment is constituted to (LL,i,LR,ix);
S306, determine whether other line segments do not complete coupling, if so, then turn to step S302;
S307, the spurious matches line segment pair for further all being met screening threshold value, constitute spurious matches line segment to group {LL,i,:}={ (LL,i,LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in), n be mate line segment to mate in group to number.
Fig. 8 is to obtain method flow diagram of the coupling line segment to group according to global registration principle in the embodiment of the present invention one, i.e., In step S108, the principle that is mated using global optimum selects L from CMPLAnd LRMiddle Optimum Matching line segment is to queue(wherein ix and jx represent line segment respectivelyAnd line segmentIn line segment group LLAnd LRIn sequence number, its corresponding actual vertical line group be L={ L1,L2,…,Ln) method.Such as Fig. 8 institutes Show, the flow process is comprised the following steps:
S401, L is extracted from CMPLAnd LRIn all of coupling line segment to queue MPQ={ (LL,i1,LR,j1),(LL,i2, LR,j2),…,(LL,in,LR,jn) (wherein ix and jx represent line segment L respectivelyL,ixAnd line segmentIn line segment group LLAnd LRIn sequence Number), each MPQ={ (LL,i1,LR,j1),(LL,i2,LR,j2),…,(LL,in,LR,jn) following rule should be met:
1. to be respectively less than which to the label of each the spurious matches line segment centering two lines section in queue direct for coupling line segment The corresponding label of follow-up spurious matches line segment centering two lines section, i.e., for spurious matches line segment pairWith doubtful Match somebody with somebody line segment pairI need to be metk< ik+1&&jk< jk+1
2. the label of the internal two lines section of first spurious matches line segment during coupling line segment is to queue need to meet current With line segment to the label for not having the internal two lines section of other spurious matches line segments in queue less than its reference numeral, i.e., for doubtful Like coupling line segment pairTo there is no spurious matches line segment pair in queue in current matching line segmentMeet ik < i1||jk< j1
3. coupling line segment need to be met currently to the label of the internal two lines section of last spurious matches line segment in queue Coupling line segment to the label that do not have the internal two lines section of other spurious matches line segments in queue more than its reference numeral, i.e., for Coupling line segment pairTo there is no coupling line segment pair in queue in current matching line segmentMeet ik> in| |jk> jn
S402, calculate each coupling the total weight of line segment to queue:
In formula i be coupling sequence number of the line segment to queue, n be current matching line segment to queue mate to number, rhoLi,Rj It is by LLIn Li-th article of line segment and LRIn the Rj-th article line segment composition spurious matches line segment pair matching degree;
S403, all coupling total weights of the line segment to queue of calculating, the maximum coupling line segment of weighted value is complete to queue Office's optimal solution, is designated as
Fig. 9 is the method for carrying out bonus point according to characteristic-integration principle to doubtful doorjamb line segment in the embodiment of the present invention one In flow chart, i.e. step S111, characteristic-integration computational methods.As shown in figure 9, the flow process is comprised the following steps:
If there is doorjamb on the left of the doubtful doors of S501, i.e., doubtful doorLeft side bearing LixThere is line L in right sidemFull Foot (Lix,Lm)∈Fsus, then bonus point SF,L
If there is doorjamb on the right side of the doubtful doors of S502, i.e., doubtful doorRight side bearing LjxThere is line L in left sidenFull Foot (Ln,Ljx)∈Fsus, then bonus point SF,R
For line LxIt is imaged as mating in the photographic head of left and right line segment in binocular to (LL,ix,LR,jx), for line segment LL,ixWith LR,jxThe matching degree of the left and right sidesWithThere are three kinds of situations:
T in formulamFor matching degree threshold value;
If the doubtful doors of S503Sideline LixLeft and right sides matching degreeWithMeet formula (1), then plus Divide SM,1;Bonus point S if formula (2) is metM,2;If meeting formula (3), deduction SM,3
If the doubtful doors of S504Sideline LjxLeft and right sides matching degreeWithMeet formula (1), then plus Divide SM,1;Bonus point S if formula (3) is metM,2;If meeting formula (2), deduction SM,3
If the doubtful doors of S505There is left frame (Lix,Lm) when, if sideline LmLeft and right sides matching degree WithMeet formula (1) or formula (2), then bonus point SM,2;If meeting formula (3), deduction SM,3
If the doubtful doors of S506There is left frame (Ln,Ljx) when, if sideline LnLeft and right sides matching degreeWithMeet formula (1) or formula (3), then bonus point SM,2;If meeting formula (2), deduction SM,3
If S507 is in doubtful doorThe depth that there is actual line in the middle of two side lines is undergone mutation, that is, there is LkIn LixAnd LjxBetween, and meet(TZIt is distance mutation threshold value), then bonus point Sz,1
If S508 is in doubtful doorThe depth that there is actual point in the middle of two side lines is undergone mutation, that is, there is coupling Angle point PmIn LixAnd LjxBetween, and meetThen bonus point Sz,1.
Coupling angle point refers to by ORB Corner Detection Algorithms, SURF Corner Detections, FAST Corner Detections scheduling algorithm to image IL,C And IR,CThe angle point for detecting, and coupling angle point the GM={ (P obtained using BF matching algorithms or FLANN matching algorithmsL,i1, PR,j1),(PL,i2,PR,j2),…,(PL,in,PR,jn), and its coordinate under photographic head coordinate system is obtained by binocular range finding formula
Technical scheme in above-described embodiment is due to using binocular vision video camera, effectively realizing house by efficient algorithm Door positioning under habitat environment, and unnecessary mark need not be increased on door, it is only necessary to two side frames of door occur simultaneously Just the positioning of opposite house is can achieve in binocular field of view, and the door in various states such as closing, half-open, standard-sized sheets effectively can be known Not, with low cost, easy to use and flexible, the extensive advantage of application scenarios.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program Product.Therefore, the present invention can adopt complete hardware embodiment, complete software embodiment or with reference to software and hardware in terms of reality Apply the form of example.And, the present invention can be adopted in one or more computers for wherein including computer usable program code The shape of the upper computer program that implements of usable storage medium (including but not limited to disk memory and optical memory etc.) Formula.
The present invention is the flow process with reference to method according to embodiments of the present invention, equipment (system) and computer program Figure and/or block diagram are describing.It should be understood that can be by computer program instructions flowchart and/or each stream in block diagram Journey and/or the combination of square frame and flow chart and/or the flow process in block diagram and/or square frame.These computer programs can be provided Instruct the processor of general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine so that produced for reality by the instruction of computer or the computing device of other programmable data processing devices The device of the function of specifying in present one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in and can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory is produced to be included referring to Make the manufacture of device, the command device realize in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or The function of specifying in multiple square frames.
These computer program instructions can be also loaded in computer or other programmable data processing devices so that in meter Series of operation steps is executed on calculation machine or other programmable devices to produce computer implemented process, so as in computer or The instruction executed on other programmable devices is provided for realization in one flow process of flow chart or multiple flow processs and/or block diagram one The step of function of specifying in individual square frame or multiple square frames.
Obviously, those skilled in the art can carry out the essence of various changes and modification without deviating from the present invention to the present invention God and scope.So, if these modifications of the present invention and modification belong to the scope of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to comprising these changes and modification.

Claims (7)

1. a kind of domestic environment Xiamen localization method based on binocular vision target detection, it is characterised in that comprise the following steps:
S101, binocular vision video camera (left video camera and right video camera) is placed on the support of ground certain altitude, water Placing flat, receives the image I from two-way binocular vision video cameraL、IR
S102, with the respective image principal point of left video camera and right video cameraCentered on, intercept respectively Image ILMiddle coordinate isRectangular area and image IRMiddle coordinate isRectangular area (yupAnd ydownFor the upside threshold value and downside threshold value of image interception, W is image ILAnd IRThe width of image) can intercept after RGB image IL,C, IR,C
Above-mentioned photographic head parameter is to demarcate to obtain by monocular, such as Zhang Zhengyou standardizitions,
S103, to image IL,C, IR,CGray processing, obtains gray level image I respectivelyL,GAnd IR,G, then respectively to IL,GAnd IR,GCarry out Canny operator edge detections, obtain binary image IL,BAnd IR,B
S104, using accumulated probability Hough transformation algorithm to binary image IL,BAnd IR,BStraight-line segment detection is carried out, and is extracted wherein oblique Rate isLine segment (TdFor angle change threshold value), every line segment is expressed as In formulaIt is line segment La,iWith straight line yI=yupThe x of+1 intersection pointIValue, and according to established rule to the line segment that obtains in two width images Screened, can further be obtained line segment group L in left imageL={ LL,1,LL,2,…,LL,nLAnd right image in line segment group LR ={ LR,1,LR,2,…,LR,nR(quantity of the nL for left image middle conductor, quantity of the nR for right image middle conductor);
S105, with line segment group L of left imageLMiddle conductor LL,iOn the basis of, calculate LL,iCorrespond to right image middle conductor group LRCoupling model The matching degree of interior all line segments is enclosed, can obtain meeting the spurious matches line segment of screening threshold value to group { LL,i,:}={ (LL,i, LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in)};
S106, judge LLIn all of line segment whether complete spurious matches line segment to organize acquisition, if it is not, then turn to step S105;
S107, obtain line segment group LLIn corresponding line segment group L of each line segmentRIn spurious matches line segment to a group set CMP= {{LL,0,:},{LL,1,:},…,{LL,nL,:}};
S108, the principle that is mated using global optimum select L from CMPLAnd LRMiddle Optimum Matching line segment is to queue(wherein ix and jx represent line segment respectivelyAnd line segment In line segment group LLAnd LRIn sequence number), its corresponding actual vertical line group be L={ L1,L2,…,Ln};
S109, formula of being found range using binocular
z C = - f ′ · T x l I - x r I - ( C x l - C x r ) x C = z · ( x l I - C x l ) f
Calculate coordinate of corresponding actual vertical line groups L of OMPQ under photographic head coordinate system Wherein, f',For binocular vision photographic head parameter, demarcated by monocular and obtained, T is the spacing of two photographic head light between centers,The two lines section for respectively matchingWithThe x of centre coordinateIValue, xCAnd zCFor the two lines section for matching X of the corresponding actual vertical line under photographic head coordinate systemC-zCCoordinate;
S110, according to formula(i and j represent line LiWith line LjSequence number in L) calculate in L Vertical line LiWith vertical line LjDistance, and think:
Work as di,j∈[WD,min,WD,max](WD,minAnd WD,maxThe respectively minima of domestic environment gate-width and maximum) when, line Li With line LjMay be two outer rims of door, be designated as doubtful door
Work as di,j∈[WF,min,WF,max](WF,minAnd WF,maxThe respectively wide minima of domestic environment doorframe and maximum) when, line LiWith line LjMay be the both sides sideline of doorframe, be designated as doubtful doorframe
Calculate in L that institute is the distance between wired, doubtful door group is obtained (ix and jx represent vertical line L respectivelyix,xAnd Ljx,xSequence number in vertical line group L, D are doubtful door label, and x represents doubtful doorIn DsusIn sequence number), and doubtful doorframe group(ix Vertical line L is represented respectively with jxix,xAnd LJx, xSequence number in vertical line group L, F are doubtful doorframe label, and x represents doubtful doorframeIn FsusIn sequence number)
S111, using characteristic-integration principle from doubtful door group DsusMiddle selection optimal solution, integrates maximum doubtful door for optimum Solution, that is, realize the identification of opposite house.
2. method according to claim 1, it is characterised in that in step S104, the line segment obtained in left image Group LL={ LL,1,LL,2,…,LL,nLAnd right image in line segment group LR={ LR,1,LR,2,…,LR,nR(nL is left image center line The quantity of section, quantity of the nR for right image middle conductor), further include:
S201, leave out length in pixels less than TlengthLine segment;
S202, when there is center distance less than TdisDuring the two lines section of length in pixels, leave out the less line segment of length;
S203, to the line segment in two images according to xIIt is ranked up from small to large;
S204, final line segment group L obtained in left imageL={ LL,1,LL,2,…,LL,nLAnd right image in line segment group LR= {LR,1,LR,2,…,LR,nR}.
3. method according to claim 1, it is characterised in that in step S105, the calculating LL,iCorrespond to right image Middle conductor group LRThe matching degree of all line segments in matching range, can obtain meeting the spurious matches line segment of screening threshold value to group {LL,i,:}={ (LL,i,LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in), further include:
Line segment group L with left imageL={ LL,1,LL,2,…,LL,nLIn line segment LL,iAs a example by for item to be matched, if its coordinate isMatching process is as follows:
S301, formula of being found range according to binocularIn conjunction with the scope that actually fathoms Disparity range [d can be obtainedmin,dmax], i.e. line segment group LRIn with LL,iMatch line segment LR,jXISpan isLRIn all meet require line segments be designated as line segment LL,iSpurious matches line segment group;
S302, the matching area for calculating matched line and line to be matched, it is N to be defaulted as widthp, a height of yup+ydown+ 1 rectangle region Domain, if there are other line segments in the default zone, matching area is changed into the rectangular area between two lines section, if the acquiescence area Domain exceeds image boundary, then matching area is changed into the rectangular area between the line segment and image boundary, and ensures that left images are treated Two pieces of rectangular zone widths of coupling are identical;
S303, further calculating obtain line segment LL,iThe left and right sides and a line segment L in its spurious matches line segment groupR,ixLeft and right coupling RegionAnd calculate respectively 4 Block- matching regions feature histogram (color space histogram, Such as RGB, HSV, YUV etc., such as Texture similarity, LBP etc., and other feature histograms);
S304, by using similarity measurement (such as Euclidean distance, mahalanobis distance, Pasteur distance etc.) respectively calculate line segment LL,iWith LR,ixLeft side matching areaWithLine segment LL,iAnd LR,ixRight side matching areaWithVarious features histogrammic Similarity isWith(n is characterized label), and then obtain line segment LL,iAnd LR,ixThe similarity weight of the left and right sides is:
w i , i x L = Σ k = 0 N a k · w i , i x , k L ( Σ k = 0 N a k = 1 ) w i , i x R = Σ k = 0 N a k · w i , i x , k R ( Σ k = 0 N a k = 1 )
In formulaWithRespectively line segment LL,iWith line segment L to be matchedR,ixSimilarity of the left and right sides with regard to feature k, akFor The weight of feature k matching degree;
S305, note wi,ixForWithMiddle the greater, if wi,ix> Tm, then it is assumed that line segment L to be matchedR,ixFor LL,iDoubtful With line segment, spurious matches line segment is constituted to (LL,i,LR,ix);
S306, determine whether other line segments do not complete coupling, if so, then turn to step S302;
S307, the spurious matches line segment pair for further all being met screening threshold value, constitute spurious matches line segment to group {LL,i,:}={ (LL,i,LR,i1),(LL,i,LR,i2),…,(LL,i,LR,in), n be mate line segment to mate in group to number.
4. method according to claim 1, it is characterised in that in step S108, the principle of the employing global optimum coupling from L is selected in CMPLAnd LRMiddle Optimum Matching line segment is to queue (wherein ix and jx represent line segment respectivelyAnd line segmentIn line segment group LLAnd LRIn sequence number), its corresponding actual vertical line group For L={ L1,L2,…,Ln, further include:
S401, L is extracted from CMPLAnd LRIn all of coupling line segment to queue MPQ={ (LL,i1,LR,j1),(LL,i2, LR,j2),…,(LL,in,LR,jn) (wherein ix and jx represent line segment L respectivelyL,ixAnd line segmentIn line segment group LLAnd LRIn sequence Number), each MPQ={ (LL,i1,LR,j1),(LL,i2,LR,j2),…,(LL,in,LR,jn) following rule should be met:
1. to be respectively less than which to the label of each the spurious matches line segment centering two lines section in queue directly follow-up for coupling line segment The corresponding label of spurious matches line segment centering two lines section, i.e., for spurious matches line segment pairWith spurious matches line Section is rightI need to be metk< ik+1&&jk< jk+1
2. the label of the internal two lines section of first spurious matches line segment during coupling line segment is to queue need to meet current matching line Section is less than its reference numeral to the label for not having the internal two lines section of other spurious matches line segments in queue, i.e., for doubtful Match somebody with somebody line segment pairTo there is no spurious matches line segment pair in queue in current matching line segmentMeet ik< i1 ||jk< j1
3. coupling line segment need to meet current matching to the label of the internal two lines section of last spurious matches line segment in queue Line segment is more than its reference numeral to the label for not having the internal two lines section of other spurious matches line segments in queue, i.e., for coupling Line segment pairTo there is no coupling line segment pair in queue in current matching line segmentMeet ik> in||jk> jn
S402, calculate each coupling the total weight of line segment to queue:
rho i = Σ k = 1 n rho L i , R j
In formula i be coupling sequence number of the line segment to queue, n be current matching line segment to queue mate to number, rhoLi,RjServe as reasons LLIn Li-th article of line segment and LRIn the Rj-th article line segment composition spurious matches line segment pair matching degree;
S403, all coupling total weights of the line segment to queue of calculating, the maximum coupling line segment of weighted value are the overall situation most to queue Excellent solution, is designated as
5. method according to claim 1, it is characterised in that in step S111, the characteristic-integration principle enters Step includes:
With doubtful door(ix and jx is line Lix,iAnd Ljx,iSequence number in L, D are doubtful door label, and i is doubtful doorIn doubtful door group DsusIn sequence number) as a example by, initial integration is 0, and characteristic-integration computational methods include:
If there is doorjamb on the left of the doubtful doors of S501, i.e., doubtful doorLeft side bearing LixThere is line L in right sidemMeet (Lix,Lm)∈Fsus, then bonus point SF,L
If there is doorjamb on the right side of the doubtful doors of S502, i.e., doubtful doorRight side bearing LjxThere is line L in left sidenMeet (Ln,Ljx)∈Fsus, then bonus point SF,R
For line LxIt is imaged as mating in the photographic head of left and right line segment in binocular to (LL,ix, LR,jx), for line segment LL,ixAnd LR,jx The matching degree of the left and right sidesWithThere are three kinds of situations:
T in formulamFor matching degree threshold value;
If the doubtful doors of S503Sideline LixLeft and right sides matching degreeWithMeet formula (1), then bonus point SM,1;Bonus point S if formula (2) is metM,2;If meeting formula (3), deduction SM,3
If the doubtful doors of S504Sideline LjxLeft and right sides matching degreeWithMeet formula (1), then bonus point SM,1;Bonus point S if formula (3) is metM,2;If meeting formula (2), deduction SM,3
If the doubtful doors of S505There is left frame (Lix,Lm) when, if sideline LmLeft and right sides matching degreeWithMeet formula (1) or formula (2), then bonus point SM,2;If meeting formula (3), deduction SM,3
If the doubtful doors of S506There is left frame (Ln,Ljx) when, if sideline LnLeft and right sides matching degreeWith Meet formula (1) or formula (3), then bonus point SM,2;If meeting formula (2), deduction SM,3
If S507 is in doubtful doorThe depth that there is actual line in the middle of two side lines is undergone mutation, that is, there is LkIn LixWith LjxBetween, and meet(TZIt is distance mutation threshold value), then bonus point Sz,1
If S508 is in doubtful doorThe depth that there is actual point in the middle of two side lines is undergone mutation, that is, there is coupling angle point Pm In LixAnd LjxBetween, and meetThen bonus point Sz,1.
6. method according to claim 1 or 5, it is characterised in that in step S508, the matching angle point is further wrapped Include:
The coupling angle point refers to by ORB Corner Detection Algorithms, SURF Corner Detections, FAST Corner Detections scheduling algorithm to image IL,C And IR,CThe angle point for detecting, and coupling angle point the GM={ (P obtained using BF matching algorithms or FLANN matching algorithmsL,i1, PR,j1),(PL,i2,PR,j2),…,(PL,in,PR,jn), and its coordinate under photographic head coordinate system is obtained by binocular range finding formula
7. method according to claim 1, it is characterised in that in step S111, the employing characteristic-integration principle From doubtful door group DsusMiddle selection optimal solution, it is optimal solution to integrate maximum doubtful door, further includes:
Calculate doubtful door group DsusIn all doubtful doors integration Ssus={ S1,S2,…,Sn, take integration maximum and meet Smax≥Ts (TsIntegral threshold) doubtful door be optimal solution;If there is the doubtful door of maximum integration identical, doubtful door central point is selected It is optimal solution to the photographic head zero most short doubtful door of distance.
CN201610924452.8A 2016-10-24 2016-10-24 A kind of domestic environment Xiamen localization method based on binocular vision target detection Active CN106504288B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201610924452.8A CN106504288B (en) 2016-10-24 2016-10-24 A kind of domestic environment Xiamen localization method based on binocular vision target detection
HK17105132.9A HK1231614A1 (en) 2016-10-24 2017-05-22 Door positioning method under a domestic environment based on binocular vision target detection
PCT/CN2017/107499 WO2018077165A1 (en) 2016-10-24 2017-10-24 Door positioning method on the basis of binocular vision target detection for use in home environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610924452.8A CN106504288B (en) 2016-10-24 2016-10-24 A kind of domestic environment Xiamen localization method based on binocular vision target detection

Publications (2)

Publication Number Publication Date
CN106504288A true CN106504288A (en) 2017-03-15
CN106504288B CN106504288B (en) 2019-02-01

Family

ID=58318503

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610924452.8A Active CN106504288B (en) 2016-10-24 2016-10-24 A kind of domestic environment Xiamen localization method based on binocular vision target detection

Country Status (3)

Country Link
CN (1) CN106504288B (en)
HK (1) HK1231614A1 (en)
WO (1) WO2018077165A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107292927A (en) * 2017-06-13 2017-10-24 厦门大学 A kind of symmetric motion platform's position and pose measuring method based on binocular vision
WO2018077165A1 (en) * 2016-10-24 2018-05-03 北京进化者机器人科技有限公司 Door positioning method on the basis of binocular vision target detection for use in home environment
CN108470356A (en) * 2018-03-15 2018-08-31 浙江工业大学 A kind of target object fast ranging method based on binocular vision
CN108549087A (en) * 2018-04-16 2018-09-18 北京瑞途科技有限公司 A kind of online test method based on laser radar
CN108615025A (en) * 2018-05-02 2018-10-02 北京进化者机器人科技有限公司 Domestic environment Xiamen recognition positioning method, system and robot
CN108759823A (en) * 2018-05-28 2018-11-06 浙江大学 The positioning of low speed automatic driving vehicle and method for correcting error in particular link based on images match
CN110631578A (en) * 2019-09-29 2019-12-31 电子科技大学 Indoor pedestrian positioning and tracking method under map-free condition
CN111986169A (en) * 2020-08-12 2020-11-24 深圳华芯信息技术股份有限公司 Door and window detection method, system, terminal and medium
CN112991368A (en) * 2021-03-16 2021-06-18 追创科技(苏州)有限公司 Target object detection method and device, storage medium and electronic device

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111243003B (en) * 2018-11-12 2023-06-20 海信集团有限公司 Vehicle-mounted binocular camera and method and device for detecting road height limiting rod
CN112288780B (en) * 2020-11-09 2024-01-16 西安工业大学 Multi-feature dynamically weighted target tracking algorithm
CN114365974B (en) * 2022-01-26 2023-01-10 微思机器人(深圳)有限公司 Indoor cleaning and partitioning method and device and floor sweeping robot
CN115399699A (en) * 2022-08-31 2022-11-29 深圳银星智能集团股份有限公司 Determination method of doorway area, storage medium, and cleaning robot
CN116823808B (en) * 2023-08-23 2023-11-17 青岛豪迈电缆集团有限公司 Intelligent detection method for cable stranded wire based on machine vision

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103093479A (en) * 2013-03-01 2013-05-08 杭州电子科技大学 Target positioning method based on binocular vision
CN103268604A (en) * 2013-05-10 2013-08-28 清华大学 Binocular video depth map calculating method
CN104700385A (en) * 2013-12-06 2015-06-10 广西大学 Binocular vision positioning device based on FPGA
CN105717928A (en) * 2016-04-26 2016-06-29 北京进化者机器人科技有限公司 Vision-based robot navigation door-passing method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106504288B (en) * 2016-10-24 2019-02-01 北京进化者机器人科技有限公司 A kind of domestic environment Xiamen localization method based on binocular vision target detection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103093479A (en) * 2013-03-01 2013-05-08 杭州电子科技大学 Target positioning method based on binocular vision
CN103268604A (en) * 2013-05-10 2013-08-28 清华大学 Binocular video depth map calculating method
CN104700385A (en) * 2013-12-06 2015-06-10 广西大学 Binocular vision positioning device based on FPGA
CN105717928A (en) * 2016-04-26 2016-06-29 北京进化者机器人科技有限公司 Vision-based robot navigation door-passing method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LUCÍA DÍAZ-VILARINO ET AL.: ""3D Modeling of Building Indoor Spaces and Closed Doors from Imagery and Point Clouds"", 《SENSORS》 *
董学会: ""基于ROS的移动服务机器人进门过程关键技术研究"", 《中国优秀硕士学位论文全文数据库(电子期刊)》 *

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018077165A1 (en) * 2016-10-24 2018-05-03 北京进化者机器人科技有限公司 Door positioning method on the basis of binocular vision target detection for use in home environment
CN107292927A (en) * 2017-06-13 2017-10-24 厦门大学 A kind of symmetric motion platform's position and pose measuring method based on binocular vision
CN108470356B (en) * 2018-03-15 2020-08-11 浙江工业大学 Target object rapid ranging method based on binocular vision
CN108470356A (en) * 2018-03-15 2018-08-31 浙江工业大学 A kind of target object fast ranging method based on binocular vision
CN108549087A (en) * 2018-04-16 2018-09-18 北京瑞途科技有限公司 A kind of online test method based on laser radar
CN108549087B (en) * 2018-04-16 2021-10-08 北京瑞途科技有限公司 Online detection method based on laser radar
CN108615025B (en) * 2018-05-02 2020-11-03 北京进化者机器人科技有限公司 Door identification and positioning method and system in home environment and robot
CN108615025A (en) * 2018-05-02 2018-10-02 北京进化者机器人科技有限公司 Domestic environment Xiamen recognition positioning method, system and robot
CN108759823B (en) * 2018-05-28 2020-06-30 浙江大学 Low-speed automatic driving vehicle positioning and deviation rectifying method on designated road based on image matching
CN108759823A (en) * 2018-05-28 2018-11-06 浙江大学 The positioning of low speed automatic driving vehicle and method for correcting error in particular link based on images match
CN110631578A (en) * 2019-09-29 2019-12-31 电子科技大学 Indoor pedestrian positioning and tracking method under map-free condition
CN110631578B (en) * 2019-09-29 2021-06-08 电子科技大学 Indoor pedestrian positioning and tracking method under map-free condition
CN111986169A (en) * 2020-08-12 2020-11-24 深圳华芯信息技术股份有限公司 Door and window detection method, system, terminal and medium
CN112991368A (en) * 2021-03-16 2021-06-18 追创科技(苏州)有限公司 Target object detection method and device, storage medium and electronic device
CN112991368B (en) * 2021-03-16 2023-08-15 追觅创新科技(苏州)有限公司 Target object detection method and device, storage medium and electronic device

Also Published As

Publication number Publication date
HK1231614A1 (en) 2017-12-22
WO2018077165A1 (en) 2018-05-03
CN106504288B (en) 2019-02-01

Similar Documents

Publication Publication Date Title
CN106504288A (en) A kind of domestic environment Xiamen localization method based on binocular vision target detection
CN105717928B (en) A kind of robot navigation of view-based access control model moves into one's husband's household upon marriage method
US20190133396A1 (en) Mobile robot and mobile robot control method
GB2612029A (en) Lifted semantic graph embedding for omnidirectional place recognition
Castaman et al. RUR53: an unmanned ground vehicle for navigation, recognition, and manipulation
Chebotareva et al. Person-following algorithm based on laser range finder and monocular camera data fusion for a wheeled autonomous mobile robot
CN113516322B (en) Factory obstacle risk assessment method and system based on artificial intelligence
Wong et al. Visual gaze analysis of robotic pedestrians moving in urban space
Chen et al. SVM based people counting method in the corridor scene using a single-layer laser scanner
Unicomb et al. A monocular indoor localiser based on an extended kalman filter and edge images from a convolutional neural network
Schauerte et al. Way to go! Detecting open areas ahead of a walking person
Yi et al. Map representation for robots
Murali et al. Autonomous exploration using rapid perception of low-resolution image information
Mehta et al. Identifying most walkable direction for navigation in an outdoor environment
Zheng et al. Vision-based autonomous navigation in indoor environments
Singh et al. Map making in social indoor environment through robot navigation using active SLAM
Shinzato et al. Path recognition for outdoor navigation using artificial neural networks: Case study
Wang et al. Precision security: integrating video surveillance with surrounding environment changes
Murali et al. Autonomous navigation and mapping using monocular low-resolution grayscale vision
Ziyu et al. Simple road detection based on vanishing point
Sun et al. The study on intelligent vehicle collision-avoidance system with vision perception and fuzzy decision making
Cai et al. LWDNet-A lightweight water-obstacles detection network for unmanned surface vehicles
Landa-Hernández et al. Geometric fuzzy techniques for guidance of visually impaired people
Zhang et al. Autonomous indoor exploration of mobile robots based on door-guidance and improved dynamic window approach
Song et al. A Object-augmented Semantic Mapping System for Indoor Mobile Robots

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1231614

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: Building 65, No. 17, Jiujiang Road, Tongji New Economic Zone, Jimo District, Qingdao City, Shandong Province, 266200

Patentee after: Qingdao Evolver xiaopang Robot Technology Co.,Ltd.

Address before: Room 02-A426, 2nd Floor, Block B, No. 22, Information Road, Haidian District, Beijing, 100029

Patentee before: BEIJING EVOLVER ROBOTICS Co.,Ltd.