CN112733593A - Method and system for realizing image information identification based on image position - Google Patents
Method and system for realizing image information identification based on image position Download PDFInfo
- Publication number
- CN112733593A CN112733593A CN202011371262.0A CN202011371262A CN112733593A CN 112733593 A CN112733593 A CN 112733593A CN 202011371262 A CN202011371262 A CN 202011371262A CN 112733593 A CN112733593 A CN 112733593A
- Authority
- CN
- China
- Prior art keywords
- mark
- building
- picture
- user
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000010801 machine learning Methods 0.000 claims abstract description 7
- 238000000605 extraction Methods 0.000 claims description 6
- 230000004308 accommodation Effects 0.000 claims description 2
- 239000003550 marker Substances 0.000 description 5
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Geometry (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Medical Informatics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Library & Information Science (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Biology (AREA)
- Computer Graphics (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a method and a system for realizing image information identification based on image positions, which are characterized in that a mark building is identified based on a machine learning image training technology, picture information of different angles of the mark building is collected, mark building characteristic points are identified, and a three-dimensional characteristic point model base of the mark building is constructed; establishing a model and a scenic spot relation graph of a basic resource scenic spot; uploading the picture by a user, extracting the mark buildings in the picture, and comparing the mark buildings with the model library to obtain corresponding mark building identification results; and sending corresponding tourist strategy recommendations to the user according to the identified mark building and the mark building and basic resource scenic spot relation graph.
Description
Technical Field
The invention relates to the field of image information identification, in particular to a method and a system for realizing image information identification based on image positions.
Background
The image identification is to identify key feature points in an image based on an AI technology, so as to obtain a corresponding identification result. Currently, in the tourism industry, image recognition is mainly used for video surveillance and character behavior feature analysis in scenic spots. Through long-term research, tourists can know the characteristics of local scenic spots by searching when entering a scene in the tourism process, at present, the operation is generally realized based on character search, but for some scenic spots, the tourists cannot know the names of the scenic spots, and under the condition, effective information can not be provided for searching or consulting obviously.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a method and a system for realizing image information identification based on an image position.
The purpose of the invention is realized by the following technical scheme:
a method for realizing image information identification based on image position comprises the following steps:
1) identifying a sign building based on a machine learning image training technology, collecting picture information of the sign building at different angles, identifying the feature points of the sign building, and constructing a three-dimensional feature point model library of the sign building;
2) establishing a model and a scenic spot relation graph of a basic resource scenic spot;
3) uploading the picture by a user, extracting the mark buildings in the picture, and comparing the mark buildings with the model library to obtain corresponding mark building identification results;
4) and sending corresponding travel strategy recommendations to the user according to the identified mark buildings and the relation graph of the mark buildings and the scenic spots of the basic resource scenic spot.
Further, in the step 1), the identification of the marker buildings is carried out based on a big data base, and the marker buildings are updated in real time.
Further, the model and the basic resource scenic spot and scenic spot relation map comprise scenic spot introductions corresponding to tourist routes, food recommendations, travel strategies, lodging recommendations, schedule arrangement, scenic spot and scenic spot resource lists and sign buildings.
Further, the extracting of the landmark buildings in the picture in 3) includes:
11) identifying and extracting a mark building in the picture;
12) focusing adjustment is carried out on the mark building so as to extract a clear mark building pattern;
13) dynamically correcting the picture angle, dynamically rotating the picture angle in the picture comparison process until a model with a consistent angle is matched, if the corresponding model is not matched all the time, manually identifying the mark building by a background, and adding the corresponding information into a model library after the corresponding information is obtained;
or the mark building information close to the mark building pattern is returned to the user, the user confirms for the second time, and the confirmed mark building information is returned after the user confirms.
Further, in the step 3), the user uploads the picture and obtains the current geographical position information of the user.
Further, in the step 3), a model of an area where the geographical location of the user is located is preferentially matched.
A system for implementing a method for implementing image information recognition based on image location, the system comprising:
the data acquisition module is used for collecting picture information of different angles of the mark building;
the image feature extraction module is used for extracting the mark building feature points in the picture;
the machine learning image training module is used for training based on the mark building feature points to obtain a three-dimensional feature point model base of the corresponding mark building and establishing a model and basic resource scenic spot relation graph;
a database for storing the model;
the data receiving module is used for receiving the pictures uploaded by the user;
the server compares the model with the mark building characteristics in the picture uploaded by the user and extracted by the image characteristic extraction module, and obtains an identification result;
and the signal sending module is used for sending the identification result to the user.
Furthermore, a user uploads the picture through the mobile terminal, and the data receiving module simultaneously acquires the positioning data of the user in the uploading process.
The invention has the beneficial effects that: according to the method, the image shot by the user is utilized, then the features in the image are extracted, so that the corresponding mark building information is obtained, the mark building information is compared with the model in the database, an accurate identification result is obtained, the identification result and the corresponding travel recommendation are returned to the user, and therefore the tourists can play more conveniently.
Drawings
FIG. 1 is a block diagram of the system of the present invention.
Detailed Description
The technical solution of the present invention is further described in detail with reference to the following specific examples, but the scope of the present invention is not limited to the following.
A method for realizing image information identification based on image position comprises the following steps:
1) identifying a sign building based on a machine learning image training technology, collecting picture information of the sign building at different angles, identifying the feature points of the sign building, and constructing a three-dimensional feature point model library of the sign building;
2) establishing a model and a scenic spot relation graph of a basic resource scenic spot;
3) uploading the picture by a user, extracting the mark buildings in the picture, and comparing the mark buildings with the model library to obtain corresponding mark building identification results;
4) and sending corresponding travel strategy recommendations to the user according to the identified mark buildings and the relation graph of the mark buildings and the scenic spots of the basic resource scenic spot.
Optionally, in the identification of the marker buildings, the marker buildings are identified based on a big data base and updated in real time, and specifically, a crawler technology may be used to obtain corresponding big data in the internet as base data to identify the corresponding marker buildings.
Further, the method for realizing image information identification based on the image position comprises the steps that the model and the basic resource scenic spot relation graph comprise tourist routes, food recommendation, travel strategy, accommodation recommendation, schedule arrangement, scenic spot resource list and scenic spot introduction corresponding to the landmark building.
Further, a method for realizing image information identification based on image position, wherein the step of extracting the mark building in the picture comprises the following steps:
11) identifying and extracting a mark building in the picture;
12) focusing adjustment is carried out on the mark building so as to extract a clear mark building pattern;
13) dynamically correcting the picture angle, dynamically rotating the picture angle in the picture comparison process until a model with a consistent angle is matched, if the corresponding model is not matched all the time, manually identifying the mark building by a background, and adding the corresponding information into a model library after the corresponding information is obtained;
or the mark building information close to the mark building pattern is returned to the user, the user confirms for the second time, and the confirmed mark building information is returned after the user confirms.
Further, a method for realizing image information identification based on image position, wherein a user uploads a picture and obtains the current geographical position information of the user, and the method specifically determines the geographical position according to the positioning information when the user sends the picture.
Furthermore, the method for realizing image information identification based on the image position carries out the matching of the mark buildings in the image identification process and preferentially matches the model of the area where the user geographic position is located.
Referring to fig. 1, the present embodiment also provides a system for implementing a method for implementing image information recognition based on image location, the system comprising:
the data acquisition module is used for collecting picture information of different angles of the mark building;
the image feature extraction module is used for extracting the mark building feature points in the picture;
the machine learning image training module is used for training based on the mark building feature points to obtain a three-dimensional feature point model base of the corresponding mark building and establishing a model and basic resource scenic spot relation graph;
a database for storing models;
the data receiving module is used for receiving the pictures uploaded by the user;
the server compares the model with the mark building characteristics in the picture uploaded by the user and extracted by the image characteristic extraction module, and obtains an identification result;
and the signal sending module is used for sending the identification result to the user.
Optionally, the user uploads the picture through the mobile terminal, and the data receiving module simultaneously obtains the positioning data of the user during the uploading process, where the mobile terminal is generally used by the user.
The foregoing is illustrative of the preferred embodiments of this invention, and it is to be understood that the invention is not limited to the precise form disclosed herein and that various other combinations, modifications, and environments may be resorted to, falling within the scope of the concept as disclosed herein, either as described above or as apparent to those skilled in the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (8)
1. A method for realizing image information identification based on image position is characterized by comprising the following steps:
1) identifying a sign building based on a machine learning image training technology, collecting picture information of the sign building at different angles, identifying the feature points of the sign building, and constructing a three-dimensional feature point model library of the sign building;
2) establishing a model and a scenic spot relation graph of a basic resource scenic spot;
3) uploading the picture by a user, extracting the mark buildings in the picture, and comparing the mark buildings with the model library to obtain corresponding mark building identification results;
4) and sending corresponding travel strategy recommendations to the user according to the identified mark buildings and the relation graph of the mark buildings and the scenic spots of the basic resource scenic spot.
2. The method for realizing image information identification based on image position according to claim 1, characterized in that in 1), the identification of the landmark buildings is carried out based on big data base and is updated in real time.
3. The method of claim 2, wherein the model and the map of the scenic spot relationships of the basic resource comprise a tour route, a food recommendation, a travel strategy, an accommodation recommendation, a schedule, a scenic spot resource list, and a scenic spot introduction corresponding to a landmark building.
4. The method of claim 3, wherein the extracting of the landmark buildings in the picture in 3) comprises:
11) identifying and extracting a mark building in the picture;
12) focusing adjustment is carried out on the mark building so as to extract a clear mark building pattern;
13) dynamically correcting the picture angle, dynamically rotating the picture angle in the picture comparison process until a model with a consistent angle is matched, if the corresponding model is not matched all the time, manually identifying the mark building by a background, and adding the corresponding information into a model library after the corresponding information is obtained;
or the mark building information close to the mark building pattern is returned to the user, the user confirms for the second time, and the confirmed mark building information is returned after the user confirms.
5. The method of claim 4, wherein the user uploads the picture and obtains the current geographical location information of the user in 3).
6. The method of claim 5, wherein the model of the area where the geographic location of the user is located in 3) is preferentially matched.
7. A system for implementing the method for realizing image information identification based on image position according to any one of claims 1-6, the system is characterized by comprising:
the data acquisition module is used for collecting picture information of different angles of the mark building;
the image feature extraction module is used for extracting the mark building feature points in the picture;
the machine learning image training module is used for training based on the mark building feature points to obtain a three-dimensional feature point model base of the corresponding mark building and establishing a model and basic resource scenic spot relation graph;
a database for storing the model;
the data receiving module is used for receiving the pictures uploaded by the user;
the server compares the model with the mark building characteristics in the picture uploaded by the user and extracted by the image characteristic extraction module, and obtains an identification result;
and the signal sending module is used for sending the identification result to the user.
8. The system according to claim 7, wherein the user uploads the picture through the mobile terminal, and the data receiving module simultaneously obtains the positioning data of the user during the uploading process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011371262.0A CN112733593A (en) | 2021-03-18 | 2021-03-18 | Method and system for realizing image information identification based on image position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011371262.0A CN112733593A (en) | 2021-03-18 | 2021-03-18 | Method and system for realizing image information identification based on image position |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112733593A true CN112733593A (en) | 2021-04-30 |
Family
ID=75597918
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011371262.0A Pending CN112733593A (en) | 2021-03-18 | 2021-03-18 | Method and system for realizing image information identification based on image position |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112733593A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102915326A (en) * | 2012-08-30 | 2013-02-06 | 杭州藕根科技有限公司 | Mobile terminal scenery identifying system based on GPS (Global Positioning System) and image search technique |
| CN104754413A (en) * | 2013-12-30 | 2015-07-01 | 北京三星通信技术研究有限公司 | Image search based television signal identification and information recommendation method and device |
| CN104765795A (en) * | 2015-03-25 | 2015-07-08 | 天脉聚源(北京)传媒科技有限公司 | Information prompting method and device |
| CN106529452A (en) * | 2016-11-04 | 2017-03-22 | 重庆市勘测院 | Mobile intelligent terminal building rapid identification method based on building three-dimensional model |
| CN107995375A (en) * | 2018-01-18 | 2018-05-04 | 广东欧珀移动通信有限公司 | A kind of information-pushing method, mobile terminal and storage medium |
| CN108882145A (en) * | 2018-06-05 | 2018-11-23 | 杭州创匠信息科技有限公司 | Sight spot recognition methods and device |
| CN110019599A (en) * | 2017-10-13 | 2019-07-16 | 阿里巴巴集团控股有限公司 | Obtain method, system, device and the electronic equipment of point of interest POI information |
| CN112308977A (en) * | 2020-10-29 | 2021-02-02 | 字节跳动有限公司 | Video processing method, video processing apparatus, and storage medium |
-
2021
- 2021-03-18 CN CN202011371262.0A patent/CN112733593A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102915326A (en) * | 2012-08-30 | 2013-02-06 | 杭州藕根科技有限公司 | Mobile terminal scenery identifying system based on GPS (Global Positioning System) and image search technique |
| CN104754413A (en) * | 2013-12-30 | 2015-07-01 | 北京三星通信技术研究有限公司 | Image search based television signal identification and information recommendation method and device |
| CN104765795A (en) * | 2015-03-25 | 2015-07-08 | 天脉聚源(北京)传媒科技有限公司 | Information prompting method and device |
| CN106529452A (en) * | 2016-11-04 | 2017-03-22 | 重庆市勘测院 | Mobile intelligent terminal building rapid identification method based on building three-dimensional model |
| CN110019599A (en) * | 2017-10-13 | 2019-07-16 | 阿里巴巴集团控股有限公司 | Obtain method, system, device and the electronic equipment of point of interest POI information |
| CN107995375A (en) * | 2018-01-18 | 2018-05-04 | 广东欧珀移动通信有限公司 | A kind of information-pushing method, mobile terminal and storage medium |
| CN108882145A (en) * | 2018-06-05 | 2018-11-23 | 杭州创匠信息科技有限公司 | Sight spot recognition methods and device |
| CN112308977A (en) * | 2020-10-29 | 2021-02-02 | 字节跳动有限公司 | Video processing method, video processing apparatus, and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 余林林: "基于迁移学习的建筑物识别技术研究", 《中国优秀硕士学位论文全文数据库_工程科技Ⅱ辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110645986B (en) | Positioning method and device, terminal and storage medium | |
| CN103632626B (en) | A kind of intelligent guide implementation method based on mobile Internet, device and mobile client | |
| KR102035030B1 (en) | Automatic drawing method using lane information | |
| CN104850563B (en) | Destination image compare retrieval device, destination image compares searching system and destination image compares search method | |
| CN111323024B (en) | Positioning method and device, equipment and storage medium | |
| CN111288996A (en) | Indoor navigation method and system based on video live-action navigation technology | |
| CN108563702B (en) | Voice explanation data processing method and device based on exhibit image recognition | |
| KR101561628B1 (en) | Search apparatus for providing realtime display information of smart glass and method thereof | |
| CN103067856A (en) | Geographic position locating method and system based on image recognition | |
| CN103761539B (en) | Indoor locating method based on environment characteristic objects | |
| CN102915326A (en) | Mobile terminal scenery identifying system based on GPS (Global Positioning System) and image search technique | |
| CN107358639A (en) | A kind of photo display method and photo display system based on intelligent terminal | |
| CN111221997A (en) | Scenic spot person searching method based on portrait recognition and positioning | |
| CN101754363A (en) | System, method and device for identifying position | |
| CN111896003A (en) | Method and system for live-action path navigation | |
| JP2007150681A (en) | Location specifying system and location specifying method | |
| CN111383286B (en) | Positioning method, positioning device, electronic equipment and readable storage medium | |
| KR102033075B1 (en) | A providing location information systme using deep-learning and method it | |
| CN112733593A (en) | Method and system for realizing image information identification based on image position | |
| CN111368112A (en) | Method and device for positioning and identifying building based on intelligent terminal | |
| CN114332435A (en) | Image labeling method and device based on three-dimensional reconstruction | |
| JP2002197103A (en) | Method and system for providing data | |
| CN106776777B (en) | Geographic position information identification method and device and terminal | |
| CN111383271B (en) | Picture-based direction marking method and device | |
| KR20060067033A (en) | Apparatus and method for updating navigation information using scene analisys |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210430 |
|
| RJ01 | Rejection of invention patent application after publication |