CN111680709A - Positioning method based on environmental picture feature matching - Google Patents

Positioning method based on environmental picture feature matching Download PDF

Info

Publication number
CN111680709A
CN111680709A CN201910246792.3A CN201910246792A CN111680709A CN 111680709 A CN111680709 A CN 111680709A CN 201910246792 A CN201910246792 A CN 201910246792A CN 111680709 A CN111680709 A CN 111680709A
Authority
CN
China
Prior art keywords
picture
pictures
positioning
environment
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910246792.3A
Other languages
Chinese (zh)
Inventor
张亮
秦伦
彭俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Xiaoshi Technology Co ltd
Original Assignee
Wuhan Xiaoshi Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Xiaoshi Technology Co ltd filed Critical Wuhan Xiaoshi Technology Co ltd
Priority to CN201910246792.3A priority Critical patent/CN111680709A/en
Publication of CN111680709A publication Critical patent/CN111680709A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Navigation (AREA)

Abstract

The invention discloses a positioning method based on environmental picture feature matching, which is characterized by collecting pictures of an environment and corresponding positions and postures of the pictures in advance to generate a data set, shooting a current picture and comparing the current picture with a final picture of the data set when the environment is entered again, finding the most similar picture and acquiring the corresponding position of the most similar picture. The positioning method can carry out rough positioning under the condition of no GPS, and can retrieve the correct position under the condition of no positioning loss of the unmanned vehicle.

Description

Positioning method based on environmental picture feature matching
Technical Field
The invention relates to a positioning technology of unmanned driving, in particular to a method for roughly positioning an unmanned vehicle under the condition that a GPS (global positioning system) is not available or only weak signals exist in the GPS.
Background
Positioning is very important in unmanned driving, and the unmanned vehicle cannot operate without positioning and knowing the position of the unmanned vehicle. The current unmanned vehicle generally adopts a multi-sensor fusion scheme for positioning. One of the schemes is to combine gps and a laser radar, the laser radar needs to give an initial value for positioning, the position acquired by gps can be provided to the laser radar through coordinate conversion under the condition of gps signals, and the initial value can be acquired only by other modes under the condition of no gps.
Generally, the appearance of a building and the environment at two sides of a road are small in change, and more feature points are provided, so that the method is suitable for matching and positioning by using pictures. The algorithm provides a method for positioning by using an environment picture, an approximate position can be provided under specific scenes (without GPS signals and the like), and then a laser radar is used for finding an accurate position, so that an unmanned vehicle can quickly find the correct position when losing the position.
Disclosure of Invention
The invention discloses a positioning method based on picture feature matching, which can carry out rough positioning under the condition of no GPS and retrieve the correct position for an unmanned vehicle under the condition of losing positioning.
In order to solve the problems, the technical scheme adopted by the invention is as follows:
the method comprises the steps of collecting environmental pictures of a site to be positioned at multiple angles by using a camera, storing position information corresponding to the pictures at positions acquired by other positioning sensors, and making into a data set. During the positioning, pictures of the surrounding environment of the current position are taken and matched with the database to find the picture which is most similar to the current taken picture, so that the current position is found.
As a preferable scheme of the positioning method based on the environmental picture feature matching, the positioning sensor is used for acquiring absolute coordinates and a posture of the device in an environment when the environmental picture is taken, and storing the absolute coordinates and the posture in a coordinate file. The serial numbers of the pictures correspond to the line numbers in the coordinate file one by one.
As a preferable scheme of the positioning method based on the environmental picture feature matching, feature points of all the shot environmental pictures are extracted, feature vectors are generated, the feature vectors are associated with the numbers of the pictures and are stored in a data set.
As a preferred scheme of the positioning method based on the environmental picture feature matching, when the positioning environment is re-entered, a camera shoots current environmental pictures from multiple angles, feature points of each picture are extracted and feature vectors are generated, the feature vectors of the current pictures are matched with the feature vectors in the data set, the picture with the closest features is found, and the approximate position is further found according to the corresponding relation.
As a preferred scheme of the positioning method based on the environmental picture feature matching, the feature vector matching is completed through quick nearest neighbor searching, and the best matching can be found in a short time.
As a preferred scheme of a positioning method based on environmental picture feature matching, the approximate picture found by matching is usually more than one picture, but more than one picture, so that several most aggregated positions are selected by adopting a clustering method corresponding to the possible positions, and the clustering center of the position is taken as the most possible position.
Drawings
FIG. 1 is a flow chart of an embodiment of a positioning method based on environmental picture feature matching according to the present application;
Detailed Description
The multi-view camera and the positioning equipment are fixed on the vehicle and connected with the computer, and the positioning program and the data acquisition program are started.
The method comprises the steps of shooting environment pictures of the left side and the right side of a road respectively along the advancing direction of the road, wherein the shooting time interval is related to the advancing speed, the speed is not too high, the overlapped part of the collected contents between adjacent pictures is required to be ensured to be more than 50%, the pictures are clear, no moving shielding objects such as automobiles and the like exist, the position and posture information corresponding to the pictures is stored while the pictures are shot, and one picture corresponds to one position and posture information. And on the same road, the environment picture and the position information are collected once to the right back and forth respectively, a more complete data set is obtained, and the position information is saved as a file.
And extracting feature points of the shot environment picture and generating a feature vector data set. According to self requirements, feature points are extracted, the number of the feature points of each picture can be determined according to the situation, the matching success rate is higher when the number of the feature points is more, and the calculation time is longer. The number of the feature vectors is set to 1000, and all the feature vectors are stored in a file as a matching database, and the arrangement order of the feature vectors matches the arrangement order of the pictures.
And when entering a road section which is collected with data next time, starting a picture positioning program, shooting a left environmental picture and a right environmental picture, extracting feature points and generating feature vectors, then performing search matching by using a nearest search algorithm, selecting a result with a large number of matched feature points, and finding out a picture number which is close to the picture shot at this time in a database file, wherein possibly a plurality of pictures are similar to the given picture. And taking out all possible positions according to the corresponding relation between the pictures and the positions, finding the position with the most aggregation by using a clustering method, and taking the center of the positions as a final positioning result.
The above-mentioned embodiments are merely preferred technical solutions of the present invention, and should not be construed as limiting the present invention. The protection scope of the present invention is defined by the claims, and includes equivalents of technical features of the claims. I.e., equivalent alterations and modifications within the scope hereof, are also intended to be within the scope of the invention.

Claims (6)

1. A positioning method based on environmental picture feature matching comprises the following steps: the method comprises the steps of collecting environmental pictures of a site to be positioned at multiple angles by using a camera, storing position information corresponding to the pictures at positions acquired by other positioning sensors, and making into a data set. During the positioning, pictures of the surrounding environment of the current position are taken and matched with the database to find the picture which is most similar to the current taken picture, so that the current position is found.
2. The method for positioning based on environmental picture feature matching according to claim 1, wherein: the positioning sensor is used for acquiring absolute coordinates and postures of the equipment in the environment when the environment picture is shot, and storing the absolute coordinates and the postures in the coordinate file. The serial numbers of the pictures correspond to the line numbers in the coordinate file one by one.
3. The method of claim 2, wherein the method comprises: and extracting feature points of all the shot environment pictures and generating a feature vector, wherein the feature vector is associated with the numbers of the pictures and is stored in a data set.
4. The method according to claim 3, wherein the method comprises: when the mobile terminal enters the positioning environment again, the camera shoots the current environment pictures from multiple angles, the feature point of each picture is extracted and a feature vector is generated, the feature vector of the current picture is matched with the feature vector in the data set, the picture with the closest features is found, and the approximate position is further found according to the corresponding relation.
5. The method of claim 4, wherein the method comprises: the feature vector matching is done by a fast nearest neighbor search, and the best match can be found in a short time.
6. The method of claim 4, wherein the method comprises: the approximate picture found by matching is usually more than one picture, but more than one picture, so that several positions which are most gathered are selected by adopting a clustering method corresponding to a plurality of possible positions, and the clustering center of the positions is taken as the most possible position.
CN201910246792.3A 2019-03-11 2019-03-11 Positioning method based on environmental picture feature matching Pending CN111680709A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910246792.3A CN111680709A (en) 2019-03-11 2019-03-11 Positioning method based on environmental picture feature matching

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910246792.3A CN111680709A (en) 2019-03-11 2019-03-11 Positioning method based on environmental picture feature matching

Publications (1)

Publication Number Publication Date
CN111680709A true CN111680709A (en) 2020-09-18

Family

ID=72433286

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910246792.3A Pending CN111680709A (en) 2019-03-11 2019-03-11 Positioning method based on environmental picture feature matching

Country Status (1)

Country Link
CN (1) CN111680709A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114578188A (en) * 2022-05-09 2022-06-03 环球数科集团有限公司 Power grid fault positioning method based on Beidou satellite

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102944224A (en) * 2012-11-09 2013-02-27 大连理工大学 Automatic environmental perception system for remotely piloted vehicle and work method for automatic environmental perception system
EP2751742A1 (en) * 2011-08-31 2014-07-09 metaio GmbH Method of matching image features with reference features
CN104502932A (en) * 2014-12-11 2015-04-08 百度在线网络技术(北京)有限公司 Method and device for positioning terminal equipment
CN108763481A (en) * 2018-05-29 2018-11-06 清华大学深圳研究生院 A kind of picture geographic positioning and system based on extensive streetscape data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2751742A1 (en) * 2011-08-31 2014-07-09 metaio GmbH Method of matching image features with reference features
CN102944224A (en) * 2012-11-09 2013-02-27 大连理工大学 Automatic environmental perception system for remotely piloted vehicle and work method for automatic environmental perception system
CN104502932A (en) * 2014-12-11 2015-04-08 百度在线网络技术(北京)有限公司 Method and device for positioning terminal equipment
CN108763481A (en) * 2018-05-29 2018-11-06 清华大学深圳研究生院 A kind of picture geographic positioning and system based on extensive streetscape data

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114578188A (en) * 2022-05-09 2022-06-03 环球数科集团有限公司 Power grid fault positioning method based on Beidou satellite
CN114578188B (en) * 2022-05-09 2022-07-08 环球数科集团有限公司 Power grid fault positioning method based on Beidou satellite

Similar Documents

Publication Publication Date Title
CN107990899B (en) Positioning method and system based on SLAM
JP7326720B2 (en) Mobile position estimation system and mobile position estimation method
US20200334499A1 (en) Vision-based positioning method and aerial vehicle
US10694103B2 (en) Building system and building method for panorama point cloud
CN111652934A (en) Positioning method, map construction method, device, equipment and storage medium
CN111445526B (en) Method, device and storage medium for estimating pose of image frame
CN102567449A (en) Vision system and method of analyzing an image
CN107167826B (en) Vehicle longitudinal positioning system and method based on variable grid image feature detection in automatic driving
CN110570453B (en) Binocular vision-based visual odometer method based on closed-loop tracking characteristics
CN111986261B (en) Vehicle positioning method and device, electronic equipment and storage medium
CN103955494B (en) Searching method, device and the terminal of destination object
CN111274847A (en) Positioning method
US20080050012A1 (en) Image processing method, image processing apparatus, image processing program and program recording medium
CN110986969A (en) Map fusion method and device, equipment and storage medium
KR20140054710A (en) Apparatus and method for generating 3d map
CN111239763A (en) Object positioning method and device, storage medium and processor
Zhu et al. Ten-fold improvement in visual odometry using landmark matching
EP2828620B1 (en) Generating navigation data
Tsintotas et al. Sequence-based mapping for probabilistic visual loop-closure detection
Martinez-Carranza et al. Enhancing 6D visual relocalisation with depth cameras
CN112689234B (en) Indoor vehicle positioning method, device, computer equipment and storage medium
CN111680709A (en) Positioning method based on environmental picture feature matching
Wong et al. Vision-based vehicle localization using a visual street map with embedded SURF scale
CN113239072A (en) Terminal equipment positioning method and related equipment thereof
CN113190120A (en) Pose acquisition method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200918