CN108507541A - Building recognition method and system and mobile terminal - Google Patents

Building recognition method and system and mobile terminal Download PDF

Info

Publication number
CN108507541A
CN108507541A CN201810171971.0A CN201810171971A CN108507541A CN 108507541 A CN108507541 A CN 108507541A CN 201810171971 A CN201810171971 A CN 201810171971A CN 108507541 A CN108507541 A CN 108507541A
Authority
CN
China
Prior art keywords
building
candidate architecture
target construction
architecture object
candidate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810171971.0A
Other languages
Chinese (zh)
Inventor
曾鸿坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810171971.0A priority Critical patent/CN108507541A/en
Publication of CN108507541A publication Critical patent/CN108507541A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • G01C11/025—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures by scanning the object
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/04—Interpretation of pictures

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

This application involves a kind of mobile terminal and its building recognition method and system with building recognition function.The building recognition method is applied to building recognition system and the mobile terminal configured with the building recognition system.The building recognition method includes：Acquisition includes the image of target construction, obtains the azimuth information of the collecting location of image；At least one candidate architecture object is obtained according to azimuth information；The candidate architecture object to match with target construction is determined from least one candidate architecture object；The information for the candidate architecture object that inquiry matches with target construction, the related information as target construction；And related information is pushed into mobile terminal.Above-mentioned building recognition method can easily identify building and inquire the related information of building.

Description

Building recognition method and system and mobile terminal
Technical field
This application involves mobile communications device field more particularly to a kind of mobile terminal with building recognition function and Its building recognition method and system.
Background technology
When user is in a relatively strange environment, user, which has, understands the related information of surrounding building Demand.For example, understanding the related informations such as building title, type, history or the position of surrounding building.
Currently, if desired user understands the related information of a relatively strange target construction, it usually needs by means of The map and search engine of the mobile terminal of such as mobile phone etc combine, and understand the related information of target construction.It is specific and Speech, user inquire the map on current geographic position periphery by acquisition for mobile terminal current geographic position, are shown in the map There is each building on current geographic position periphery.User combines itself actually located environment, is searched in map needed for determining The target construction of understanding, and then searched in a search engine to obtain the building title of the target construction, position, history etc. Related information.
However, the mode of the strange target construction of above-mentioned understanding is complicated for operation, less efficient.
Invention content
The embodiment of the present application is designed to provide one kind and can easily identify target construction and inquire target structures The mobile terminal and its building recognition method and system of the related information of object, for solving above-mentioned technical problem.
The embodiment of the present application provides a kind of building recognition method, is built applied to building recognition system and configured with this Build the mobile terminal of object identifying system.The building recognition method includes：Acquisition includes the image of target construction, and obtains The azimuth information of the collecting location of image；At least one candidate architecture object is obtained according to azimuth information；It is built from least one candidate Build the candidate architecture object for determining in object and matching with target construction；The candidate architecture object that inquiry matches with target construction Information, the related information as target construction；And the related information of target construction is pushed into mobile terminal.
In wherein some embodiments, azimuth information includes the geographical location of the collecting location of image, according to the side When at least one candidate architecture object of acquisition of information of position, the building in the presumptive area using centered on geographical location is obtained as time Select building.
In wherein some embodiments, the time to match with target construction is determined from least one candidate architecture object Building is selected, including：From the characteristic information of extracting target from images building, and according to characteristic information, from least one candidate The candidate architecture object to match with target construction is determined in building.
In wherein some embodiments, from the characteristic information of extracting target from images building, and according to characteristic information, The candidate architecture object to match with target construction is determined from least one candidate architecture object, including：Extract target construction Appearance profile as characteristic information, by the appearance profile phase of the appearance profile of at least one candidate architecture object and target construction It compares, the similarity between the appearance profile and the appearance profile of target construction of candidate architecture object is calculated, by least one time The highest candidate architecture object of similarity in building is selected to be determined as the candidate architecture object to match with target construction.
In wherein some embodiments, from the characteristic information of extracting target from images building, and according to characteristic information, The candidate architecture object to match with target construction is determined from least one candidate architecture object, including：Extract target construction Appearance and size as characteristic information, by the appearance and size phase of the appearance and size of at least one candidate architecture object and target construction It compares, the similarity between the appearance and size and the appearance and size of target construction of candidate architecture object is calculated, by least one time The highest candidate architecture object of similarity in building is selected to be determined as the candidate architecture object to match with target construction.
In wherein some embodiments, from the characteristic information of extracting target from images building, and according to characteristic information, The candidate architecture object to match with target construction is determined from least one candidate architecture object, including：Extract target construction Building mark as characteristic information, by the building mark phase of the building mark and target construction of at least one candidate architecture object It compares, chooses the candidate architecture that building mark matches with the building mark of target construction at least one candidate architecture object Object, as the candidate architecture object to match with target construction.
In wherein some embodiments, after obtaining at least one candidate architecture object according to azimuth information, including：To increase The three-dimensional image of the candidate architecture object is presented in the form of strong reality；From at least one candidate architecture object determine with The candidate architecture object that the target construction matches, including：In at least one candidate architecture object, by user's selection Candidate architecture object makees the candidate architecture object for being determined as matching with the target construction.
In wherein some embodiments, when the three-dimensional image of candidate architecture object is presented, according to the position of mobile terminal Posture is set, and/or according to the control instruction of user, adjusts the angle presentation of the three-dimensional image of candidate architecture object.
In wherein some embodiments, related information includes any one or more combinations of following information category：It builds Build name claim, the relative position between geographical location, building history, related news and collecting location and between collecting location Path, building type and building functions.
In wherein some embodiments, after related information is pushed to mobile terminal, further include：In working as mobile terminal The information category of related information is shown in preceding display content, and in the triggering instruction for detecting information category, display is triggered Information category details, and detect details triggering instruction when, pack up the details being triggered.
The embodiment of the present application also provides a kind of building recognition system, runs on mobile terminal, any of the above-described for executing The building recognition method of item.Building recognition system includes：Acquisition module, for acquire include target construction figure Picture；Locating module, the azimuth information of the collecting location for obtaining image；Candidate block, for according to azimuth information obtain to A few candidate architecture object；Determining module matches for determining from least one candidate architecture object with target construction Candidate architecture object；Enquiry module, the information for inquiring the candidate architecture object to match with target construction, as target structures The related information of object；And pushing module, for the related information of target construction to be pushed to mobile terminal.
The embodiment of the present application also provides a kind of mobile terminal, including electronic body portion, one or more processors, storage Device and above-mentioned building recognition system.The building recognition system is stored in the memory and is configured as by this One or more processors execute.
Compared with the existing technology, building recognition method provided by the embodiments of the present application includes that target is built by acquisition The image for building object identifies target construction from the image, can directly and automatically inquire the related information of target structures, And related information is pushed into mobile terminal, the related information for conveniently and efficiently obtaining building is allowed users to, without Complicated operation is carried out, recognition efficiency is higher.As user it should be understood that the related information of a certain building in ambient enviroment When, it is only necessary to use mobile scanning terminal target construction, mobile terminal that the association of target structures building just can be presented automatically Information fully simplifies user's operation, improves operating efficiency, and the usage experience of user is improved.
Description of the drawings
In order to illustrate more clearly of the technical solution of the application, attached drawing needed in embodiment will be made below Simply introduce, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the application, general for this field For logical technical staff, without creative efforts, other drawings may also be obtained based on these drawings.
Fig. 1 is the flow diagram of building recognition method provided by the embodiments of the present application；
Fig. 2 is the high-level schematic functional block diagram of building recognition system provided by the embodiments of the present application；
Fig. 3 is the schematic diagram of mobile terminal provided by the embodiments of the present application；
Fig. 4 is the schematic diagram of the hardware environment of mobile terminal shown in Fig. 3.
Specific implementation mode
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation describes, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on Embodiment in the application, those of ordinary skill in the art are obtained every other without creative efforts Embodiment shall fall in the protection scope of this application.
Include, but are not limited to be set as " communication terminal " (or being referred to as " terminal ") used in the embodiment of the present application Be set to via Wireline connection (such as via Public Switched Telephone Network (PSTN), digital subscriber line (DSL), digital cable, Direct cable connection and/or another data connection/network) and/or via (for example, for cellular network, WLAN (WLAN), such as the digital TV network of DVB-H networks, satellite network, AM-FM broadcasting transmitter and/or another communication are whole End) wireless interface receives/sends the device of signal of communication.Being configured to can be by by the communication terminal of radio interface communication Referred to as " wireless communication terminal ", " wireless terminal " and/or " mobile terminal ".The example of mobile terminal includes, but are not limited to defend Star or cellular phone；It can be with combination cellular radio telephone and data processing, the personal communication of fax and communication ability System (PCS) terminal；It may include radio telephone, pager, the Internet/intranet access, Web browser, memo pad, day It goes through and/or the PDA of global positioning system (GPS) receiver；And conventional laptop and/or palmtop receiver or including nothing Other electronic devices of line electricity telephone transceiver.Below in conjunction with the attached drawing in the embodiment of the present application, in the embodiment of the present application Technical solution be clearly and completely described.
Referring to Fig. 1, the embodiment of the present application provides a kind of building recognition method.The building recognition method passes through acquisition The image of target construction, and the azimuth information of target construction is obtained, according to the image and azimuth information of target construction It inquires the related information of target construction and is pushed to user, allow users to the information for conveniently and efficiently obtaining building.
In the particular embodiment, above-mentioned building recognition method is applied to building recognition system as shown in Figure 2 200 and the mobile terminal 100 (Fig. 3) configured with building recognition system 200.Wherein, mobile terminal 100 is configured with radio frequency (Radio Frequency, RF) scanning module and camera, and have Image Acquisition and communication function, mobile terminal 100 Example includes but not limited to：The mobile terminal devices such as mobile phone, tablet computer, smart camera or portable computer.Above-mentioned Building recognition method may comprise steps of：
Step S101：Acquisition includes the image of target construction, obtains the azimuth information of the collecting location of image.
In some embodiments, when acquisition includes the image of target construction, the camera shooting of mobile terminal can be passed through Head acquisition, can also be acquired by the radio frequency reading module of mobile terminal.Wherein, the image of mobile terminal acquisition can be one Image can also be that multiple images or one section of short-sighted frequency, the present embodiment are not construed as limiting this.
During above-mentioned acquisition image, user can be not necessarily to take pictures or record by the operation of such as button etc Picture, just can obtain the image of adjacent buildings, the information of building mark and appearance profile, user only need camera and/or Radio frequency reading module is found a view against adjacent buildings.During finding a view, the radio frequency reading module of mobile terminal or/ And camera obtains the image for including adjacent buildings automatically, can largely simplify the operating procedure of user.
Further, which includes at least the geographical location information of mobile terminal, that is, including Image Acquisition The geographical location information of point.Wherein, the geographical location of collecting location can by GPS (GlobalPositioningSystem, Global positioning system) technical limit spacing.GPS technology can obtain the geographical location of degree of precision.For example, the positioning of conventional GPS technology Precision is built usually between 3 meters to 10 meters based on network RTK (Real-timeKinematic, real-time dynamic control) technology Vertical CORS (ContinuouslyOperatingReferenceStations, continuous operation satellite positioning service integrated system) Positioning accuracy can reach sub-meter grade or more.Certainly, in other possible embodiments, the geographical location of collecting location Base station location technology can be used or Wi-Fi (WirelessFidelity, Wireless Fidelity) location technology obtains.
Step S103：At least one candidate architecture object is obtained according to azimuth information.
In some embodiments, it when azimuth information includes the geographical location in Image Acquisition place, obtains with image The building in presumptive area centered on the geographical location of collecting location is as candidate architecture object.For example, presumptive area is：With The geographical location of the collecting location of image is the center of circle, the border circular areas that radius is 100 meters；When obtaining candidate architecture object, obtaining should Owned building in presumptive area is candidate architecture object.Certainly, the example above is merely exemplary, in practical applications, in advance The size and shape for determining region can independently be set by technical staff according to actual demand, and the present embodiment is not construed as limiting this.
Further, in some embodiments, pass through the shape of augmented reality (Augmented Reality, abbreviation AR) Above-mentioned at least one candidate architecture object is presented in formula.Further, the camera of mobile terminal is kept to find a view state, and in movement The image of above-mentioned at least one candidate architecture object is presented in the interface of finding a view of terminal, user is allowed to observe candidate architecture object with true The candidate architecture object that fixed and target construction matches.Further, when candidate architecture object being presented in the form of AR, candidate is presented and builds The three-dimensional image for building object, according to the position and attitude of mobile terminal, and/or, according to the control instruction of user, adjustment candidate builds The angle presentation for building the three-dimensional image of object allows users to the position and attitude by changing mobile terminal, and/or passes through rotation Turn the three-dimensional image, the angle presentation of adjustment candidate architecture object is realized, so that user observes candidate architecture with multi-angle Object.
For example, when user makes the camera of mobile terminal towards target construction to acquire image, change mobile terminal Position and attitude, to obtain the image of the target construction of different angle, at this point, the candidate of the AR forms presented on mobile terminal The angle of building also changes correspondingly, and allows users to compare candidate architecture object and the similarity degree of target construction in real time； For another example, when user makes the camera of mobile terminal towards target construction to acquire image, user, which clicks on mobile terminal, is in The image (for example, sliding finger on the image) of the candidate architecture object of existing AR forms, can change the presentation of candidate architecture object Angle, to observe candidate architecture object with multi-angle conducive to user.
Step S105：The candidate architecture to match with target construction is determined from above-mentioned at least one candidate architecture object Object.
Further, from the characteristic information of the extracting target from images building comprising target construction, and according to feature Information determines the candidate architecture object to match with target construction from above-mentioned at least one candidate architecture object.
In some embodiments, the characteristic information of above-mentioned target construction, can include but is not limited to include：Target The dimension information etc. of the appearance profile feature of building, the building mark of target construction, target construction.Above-mentioned building mark It should be understood as can show that the flag information of the building identity, for example, the conspicuousness text that outside vertical surface of building shows Word mark (specifically for example, the mansions XX), pattern mark (the port iron mark in such as buildings Gang Tie).
In some embodiments, when extracting the characteristic information of target construction, the appearance profile of target construction is extracted As characteristic information, and according to the appearance profile of target construction, automatically chosen from above-mentioned at least one candidate architecture object The candidate architecture object to match with target construction.At this point, when choosing the candidate architecture object to match with target construction, pass through By the appearance profile of target construction compared with the appearance profile of candidate architecture object pair, the time to match with target construction is determined Select building.Further, the phase between the appearance profile and the appearance profile of target construction by calculating candidate architecture object Like degree, the highest candidate architecture object of similarity is chosen from least one candidate architecture object, is matched as with target construction Candidate architecture object.
Further, when extracting the appearance profile of target construction, start the camera of mobile terminal, acquisition includes target The image of building, while starting the radio frequency reading module of mobile terminal, the appearance profile of target construction is scanned, and according to mesh The appearance profile for the target construction that the image of mark building is obtained in conjunction with scanning, reduces carrying for the appearance profile of target construction Take error.
In some embodiments, when extracting the characteristic information of target construction, the appearance and size of target construction is extracted (such as height of target construction) is used as characteristic information, and according to the appearance and size of target construction, from above-mentioned at least one The candidate architecture object to match with target construction is determined in candidate architecture object.At this point, what selection matched with target construction When candidate architecture object, by the appearance and size of target construction compared with the appearance and size of candidate architecture object pair, being determined and mesh The candidate architecture object that mark building matches.Further, pass through the appearance and size and target construction of calculating candidate architecture object Appearance and size between similarity, from least one candidate architecture object choose the highest candidate architecture object of similarity, as The candidate architecture object to match with target construction.
Further, from the image comprising target construction, and/or, from the outer of aforementioned extracted target construction In shape profile, the actual size (such as height of target construction) of target construction is estimated.Estimate the reality of target construction It, can be according to the profile of the size of the focal length of camera, target construction in the picture and target construction when size Shape calculates the actual size of target construction, e.g., width, height, depth equidimension.It is appreciated that in some embodiments In, when estimating the appearance and size of building, it is convenient to omit scan the appearance profile of target construction using radio frequency reading module Step, and the camera of mobile terminal is directly initiated, acquisition includes the image of target construction, according to the focal length of camera, mesh The contour shape for marking building size in the picture and target construction, calculates the actual size of target construction, Such as, width, height, depth equidimension.
In some embodiments, when extracting the characteristic information of target construction, the first building of target construction is extracted Mark is used as characteristic information, and is indicated according to the first of target construction the building, from above-mentioned at least one candidate architecture object really The candidate architecture object that fixed and target construction matches.At this point, when determining the candidate architecture object to match with target construction, choosing Take at least one candidate architecture object building mark to build the candidate architecture object that mark matches with first, as with target structures The candidate architecture object that object matches.
Further, when extracting the first building mark of target construction, start the camera of mobile terminal, acquisition includes The image of target construction, while starting the radio frequency reading module of mobile terminal, the first building mark of target construction is scanned, And the first building according to the image of target construction in conjunction with the target construction that scanning obtains indicates, reduces target construction The extraction error of first building mark, and confirm the first building mark of target construction, by the first building after reduction error Indicate the first building mark as extraction.
Further, in some embodiments, it is the accuracy of the identification of raising target structures, extraction target structures week When the first building mark of the adjacent buildings enclosed, while acquiring the figure of at least two adjacent buildings around target construction Picture, and the second building mark for extracting at least two adjacent buildings carries that is, when the characteristic information of extraction target construction It takes the first of target construction to build mark and is used as characteristic information, and extract second of adjacent buildings around target structures and build It builds mark and is used as supplemental characteristic information, and mark and the second construction characteristic information are built according to the first of target construction, into It determines to one step the first building mark, the candidate to match with target construction is chosen from above-mentioned at least one candidate architecture object Building.For example, after the first building mark of extraction target construction, scanning respectively is built positioned at the adjacent of target construction both sides It builds object and extracts the second building mark, so as to uniquely determine the building mark of target structures, be conducive to raising target and build The accuracy for the identification built.
It should be understood that above-mentioned the first building mark and the second building mark, it should be understood that can show that this The flag information of building identity, for example, the conspicuousness symbol word marking that outside vertical surface of building shows is (specifically for example, XX Mansion), pattern mark (the port iron mark in such as buildings Gang Tie)；Even, in some embodiments, above-mentioned building mark can be The appearance profile that whole building shows, for example, Eiffel Tower.
It should be understood that in some embodiments, it, can when determining the candidate architecture object to match with target construction To be determined according to any one or more combinations in the characteristic information of above-mentioned offer.For example, determining and target structures It, can be according to the appearance profile and dimension information of target construction, from least one candidate when the candidate architecture object that object matches The candidate architecture object to match with target construction is determined in building；Alternatively, can according to first building mark directly to The candidate architecture object to match with target construction is determined in a few candidate architecture object；Alternatively, can be marked according to the first building Will and the second building mark, the candidate architecture object to match with target construction is determined from least one candidate architecture object, is led to The querying condition as auxiliary by the second building mark is crossed, the accuracy rate of inquiry can be improved；Alternatively, can be according to the first building The dimension information of mark and target construction determines the candidate to match with target construction from least one candidate architecture object Building can improve the accuracy rate of inquiry by the way that the dimension information of target construction to be used as to the condition of auxiliary.
It further, in some embodiments, can when above-mentioned at least one candidate architecture object is presented by AR forms With the candidate architecture object that is selected using user as the candidate architecture object to match with target construction.
Step S107：The information for the candidate architecture object that inquiry matches with target construction, the pass as target construction Join information.
Further, according to the characteristic information of target construction, the related information of target structures is inquired.Further, it looks into When asking the related information of target structures, mobile terminal is controlled from Internet resources, server, database any one or more of way Diameter is inquired.
Further, the related information of target construction includes but not limited at least one in following message：Building The road between relative position and collecting location between title, geographical location, building history, related news and collecting location Diameter, building type and building functions etc..Wherein, the relative position between collecting location and between collecting location Path can be calculated according to the geographical location of collecting location and the geographical location of target construction.
Further, related information includes any one or more combinations of following information category：Building name, geography The path between relative position and collecting location between position, building history, related news and collecting location, building Type and building functions.For example, building name：The mansions XX；Geographical location：The cities X of the X provinces roads X XX；Construction history：It is built in XXX lasts X, and it is world's X high building at that time to build up；Related news：The XX times, it is big that state leader XX arrives XX Tall building ...；Etc. related information.
Step S109：The related information of target construction is pushed into mobile terminal.
Further, when related information being pushed to mobile terminal, working as mobile terminal is superimposed upon in the form of suspended window In preceding display content.For example, currently including the image of target construction, the display screen display of mobile terminal by mobile terminal acquisition When showing the image, the related information of target construction is pushed into mobile terminal, related information is made to be superimposed in the form of suspended window On the image, it allows users to easily obtain the related information.
Further, in some embodiments, after related information being pushed to mobile terminal, further include：Mobile whole The information category of related information is shown in the present displayed content at end, and in the triggering instruction for detecting information category, display The details for the information category being triggered.In wherein some embodiments, pass is shown in the present displayed content of mobile terminal When joining information, the information category of related information is shown, such as only display " building title ", " related news " printed words, when detecting When wherein any one information category is triggered, such as detect " related news " printed words by user's triggering (as touched or clicking) When, the details for the information category being triggered are presented, such as expansion shows " related news：XX times, state leader XX are arrived The content of the mansions ... XX ".Certainly, in some embodiments, after details are triggered, the work(for packing up details is provided Can, when detecting that details are packed up in user's triggering, recovery shows related information in the form of information category.For example, when exhibition When opening the details of display related news, if detecting the content part of details by user's triggering (as touched or clicking) When, then details content is packed up, and restore to show " related news " printed words.The display mode of above-mentioned related information is led to It crosses suspended window to be shown, and expansion and closing function is provided, can avoid occupying multi-mobile-terminal when push relevant information Display area, user experience can be improved.
Compared with the existing technology, building recognition method provided in this embodiment includes target construction by acquisition Image, identify target construction from the image, can directly and automatically inquire the related information of target structures, and will Related information pushes to mobile terminal, allows users to the related information for conveniently and efficiently obtaining building, without carrying out Complicated operation, recognition efficiency are higher.As user it should be understood that when the related information of a certain building in ambient enviroment, only It need to use mobile scanning terminal target construction, mobile terminal that the related information of target structures building just can be presented automatically, User's operation is fully simplified, operating efficiency is improved, the usage experience of user is improved.
Referring to Fig. 2, based on above-mentioned building recognition method, the application embodiment provides a kind of building recognition system System 200, runs on mobile terminal 100 as shown in Figure 3.Building recognition system 200 is used to execute above-mentioned building and knows Other method to acquire the image of target construction, and obtains the azimuth information of target construction, and inquiry obtains target construction Related information is simultaneously pushed to user, allows users to the information for conveniently and efficiently obtaining building.In the application embodiment, Building recognition system 200 is stored in the memory of mobile terminal 100, and is configured as by one of mobile terminal 100 Or multiple processors execute.
Specifically in the embodiment shown in Figure 2, building recognition system 200 include acquisition module 201, locating module 203, Candidate block 205, determining module 206, enquiry module 207 and pushing module 209.Acquisition module 201 includes mesh for acquiring The image of building is marked, locating module 203 is used to obtain the azimuth information of the collecting location of image, and candidate block 205 is used for root At least one candidate architecture object is obtained according to azimuth information, determining module 206 is used for from above-mentioned at least one candidate architecture object really The candidate architecture object that fixed and target construction matches, enquiry module 207 are used to inquire the related information of target construction, push Module 209 is used to push the related information of target construction.It is understood that above-mentioned each module can be to run on computer Program module in readable storage medium storing program for executing, the purposes of above-mentioned modules and work are specific as follows：
Acquisition module 201 be used for acquire include target construction image.Further, acquisition module 201 is for opening The radio frequency reading module of dynamic mobile terminal, and/or, the camera for starting mobile terminal, acquisition includes target construction Image.
Locating module 211 is used to obtain the azimuth information of mobile terminal, that is, the azimuth information of collecting location.Further Ground, locating module 211 are used to, when the acquisition of acquisition module 201 includes the image of target construction, acquire the side of mobile terminal Position information.
Candidate block 205 is used to obtain at least one candidate architecture object according to the azimuth information of mobile terminal.In some realities It applies in mode, when azimuth information includes the geographical location in Image Acquisition place, candidate block 205 is for obtaining adopting with image The building in presumptive area centered on the geographical location in collection place is as candidate architecture object.
In some embodiments, candidate block 205 is additionally operable to through augmented reality (Augmented Reality, abbreviation AR above-mentioned at least one candidate architecture object is presented in form).Further, candidate block 205 is used to keep mobile terminal Camera find a view in the case of state, above-mentioned at least one candidate architecture object is presented in the interface of finding a view of mobile terminal, User is allowed to observe candidate architecture object to determine the candidate architecture object to match with target construction.Further, candidate block 205 in the form of AR when being presented candidate architecture object, the three-dimensional image of candidate architecture object for rendering, and for according to it is mobile eventually The position and attitude at end, and/or, according to the control instruction of user, the angle presentation of the three-dimensional image of candidate architecture object is adjusted, The position and attitude by changing mobile terminal is allowed users to, and/or by rotating the three-dimensional image, realizes that adjustment is candidate The angle presentation of building, so that user observes candidate architecture object with multi-angle.
Determining module 206 from above-mentioned at least one candidate architecture object for determining the candidate to match with target construction Building.Further, it is determined that module 206 is used for the characteristic information from extracting target from images building, and believed according to feature Breath determines the candidate architecture object to match with target construction from above-mentioned at least one candidate architecture object.In some embodiment party In formula, the characteristic information of above-mentioned target construction, can include but is not limited to include：The appearance profile of target construction is special The dimension information etc. of sign, the building mark of target construction, target construction.
In some embodiments, determining module 206 is used to extract the appearance profile of target construction as characteristic information, And for according to the appearance profile of target construction, automatically choose from above-mentioned at least one candidate architecture object and target structures The candidate architecture object that object matches.At this point, when choosing the candidate architecture object to match with target construction, determining module 206 is used In by the appearance profile of target construction compared with the appearance profile of candidate architecture object pair, being determined and target construction phase The candidate architecture object matched.Further, it is determined that module 206 is used for appearance profile and target structures by calculating candidate architecture object Similarity between the appearance profile of object chooses the highest candidate architecture object of similarity from least one candidate architecture object, makees For the candidate architecture object to match with target construction.
Further, it is determined that module 206 is used to start the camera of mobile terminal, acquisition includes the figure of target construction Picture, while the radio frequency reading module for starting mobile terminal, scan the appearance profile of target construction, and according to target structures The appearance profile for the target construction that the image of object is obtained in conjunction with scanning, the extraction for reducing the appearance profile of target construction miss Difference.
In some embodiments, determining module 206 is used to extract appearance and size (such as the target structures of target construction The height of object) it is used as characteristic information, and for the appearance and size according to target construction, from above-mentioned at least one candidate architecture object The candidate architecture object that middle determination matches with target construction.At this point, determining module 206 be used for by will target construction it is outer Shape size determines the candidate architecture object to match with target construction compared with the appearance and size of candidate architecture object pair.Further Ground, determining module 206 are used for the phase between the appearance and size and the appearance and size of target construction by calculating candidate architecture object Like degree, the highest candidate architecture object of similarity is chosen from least one candidate architecture object, is matched as with target construction Candidate architecture object.
Further, it is determined that module 206 is used for from the image comprising target construction, and/or, from aforementioned extracted In the appearance profile of target construction, the actual size (such as height of target construction) of target construction is estimated.Determine mould It, can be according to the focal length of camera, target construction in the picture when block 206 is used to estimate the actual size of target construction The contour shape of size and target construction calculates the actual size of target construction, e.g., width, height, depth etc. Size.
In some embodiments, determining module 206 is used to extract the first building mark of target construction as feature Information, and for being indicated according to the first of target construction the building, the determining and target from above-mentioned at least one candidate architecture object The candidate architecture object that building matches.At this point, determining module 206 builds mark for choosing at least one candidate architecture object The candidate architecture object to match with the first building mark, as the candidate architecture object to match with target construction.
Further, it is determined that when module 206 is used to extract the first building mark of target construction, it is mobile whole for starting The camera at end, acquisition include the image of target construction, while the radio frequency reading module for starting mobile terminal, scan mesh The first building mark of building is marked, and is built in conjunction with the first of the target construction that scanning obtains according to the image of target construction Mark is built, the extraction error of the first building mark of target construction is reduced, and confirms the first building mark of target construction, The first building mark after reduction error is indicated as the first building of extraction.
Further, in some embodiments, it is the accuracy of the identification of raising target structures, extraction target structures week When the first building mark of the adjacent buildings enclosed, determining module 206 is additionally operable at least two around scanning target construction Adjacent buildings, and the second building mark of at least two adjacent buildings is extracted, that is, the feature letter of extraction target construction When breath, the first building mark for extracting target construction is used as characteristic information, and extracts the adjacent buildings around target structures Second building mark be used as supplemental characteristic information, and according to the first of target construction building mark and the second construction characteristic Information further determines the first building mark, is chosen and target construction phase from above-mentioned at least one candidate architecture object The candidate architecture object matched.
It should be understood that in some embodiments, determining module 206 matches for determining and target construction When candidate architecture object, it can be determined according to any one or more combinations in the characteristic information of above-mentioned offer.For example, When determining the candidate architecture object to match with target construction, determining module 206 can be according to the appearance profile of target construction And dimension information, the candidate architecture object to match with target construction is determined from least one candidate architecture object；Alternatively, determining What module 206 can match according to first building mark determining and target construction directly from least one candidate architecture object Candidate architecture object；Alternatively, determining module 206 can indicate according to the first building mark and the second building, from least one candidate The candidate architecture object to match with target construction is determined in building, by the inquiry item that the second building mark is used as to auxiliary Part can improve the accuracy rate of inquiry；Alternatively, determining module 206 can be according to the first building mark and the ruler of target construction Very little information determines the candidate architecture object to match with target construction, by building target from least one candidate architecture object Condition of the dimension information of object as auxiliary is built, the accuracy rate of inquiry can be improved.
Further, in some embodiments, it when candidate architecture object is presented in the form of AR in candidate block 205, determines Module 206 is additionally operable to the candidate architecture object that user selects being determined as the candidate architecture object to match with target construction.
Enquiry module 207 is used to inquire the related information of target construction, that is, for inquiring and target construction phase The information for the candidate architecture object matched, the related information as target construction.Further, enquiry module 207 is in inquiry target When the related information of building, for controlling mobile terminal from Internet resources, server, database any one or more of approach Inquiry.
Related information includes any one or more combinations of following information category：Building name, geographical location, building It the path between relative position and collecting location, building type between object history, related news and collecting location and builds Build object function.For example, building name：The mansions XX；Geographical location：The cities X of the X provinces roads X XX；Construction history：It is built in XXX, is gone through When X, it is world's X high building at that time to build up；Related news：XX times, state leader XX arrive the mansions ... XX；Etc. close Join information.
Related information of the pushing module 209 for target construction pushes to mobile terminal.Further, pushing module 209 push for related information to be superimposed upon in the form of suspended window in the present displayed content of mobile terminal.For example, working as The preceding image for including target construction by mobile terminal acquisition, when the display screen of mobile terminal shows the image, pushing module 209, for the related information of target construction to be pushed to mobile terminal, make related information be superimposed upon figure in the form of suspended window As upper, allow users to easily obtain the related information.
In some embodiments, pushing module 209 is additionally operable to related information is whole in movement in the form of information category It is shown in the present displayed content at end, and in the triggering instruction for detecting information category, showing the info class being triggered Other details.In wherein some embodiments, pushing module 209 in present displayed content for showing related information When, the information category of related information, such as only display " building title ", " related news " printed words are shown, when pushing module 209 is examined When measuring that wherein any one information category is triggered, such as detect " related news " printed words by user's triggering (as touched or point Hit) when, the details for the information category being triggered are presented, such as expansion shows " related news：XX times, state leader XX The content of the present mansions ... XX ".Certainly, in some embodiments, after details are triggered, pushing module 209 is also used The function of details is packed up in offer, when pushing module 209 detects that details are packed up in user's triggering, pushing module 209 show related information for restoring in the form of information category.For example, when expansion shows the details of related news, If pushing module 209 detects the content part of details by user's triggering (as touched or clicking), pushing module 209 For packing up details content, and restore to show " related news " printed words.Above-mentioned pushing module 209 controls related information Display mode, shown by suspended window, and expansion and closing function are provided, can avoid push relevant information when occupy The display area of multi-mobile-terminal is crossed, user experience can be improved.
Compared with the existing technology, building recognition device provided in this embodiment includes target construction by acquisition Image, identify target construction from the image, can directly and automatically inquire the related information of target structures, and will Related information pushes to mobile terminal, allows users to the related information for conveniently and efficiently obtaining building, without carrying out Complicated operation, recognition efficiency are higher.As user it should be understood that when the related information of a certain building in ambient enviroment, only It need to use mobile scanning terminal target construction, mobile terminal that the related information of target structures building just can be presented automatically, User's operation is fully simplified, operating efficiency is improved, the usage experience of user is improved.
Please refer to Fig. 3 and Fig. 4, based on above-mentioned building recognition system 200 and building recognition method, the application Embodiment also provides a kind of mobile terminal 100 comprising electronic body portion 10, electronic body portion 10 include that shell 12 and setting exist Main display 14 on shell 12.Metal can be used in shell 12, such as steel, aluminium alloy are made.In the present embodiment, main display 14 Display panel 111 is generally included, may also comprise for responding the circuit etc. for carrying out touch control operation to display panel 111.Display surface Plate 111 can be a liquid crystal display panel (LiquidCrystalDisplay, LCD), in some embodiments, display panel 111 be a touch screen 109 simultaneously.
Referring to Fig. 4, in actual application scenarios, mobile terminal 100 can be used as intelligent mobile phone terminal and be used, In this case electronic body portion 10 also typically includes one or more (one is only shown in Fig. 4) processors 102, memory 104, radio frequency (RadioFrequency, RF) module 106, voicefrequency circuit 110, sensor 114, input module 118, power module 122, radio frequency reading module 124.It will appreciated by the skilled person that structure shown in Fig. 4 is only to illustrate, it is not right The structure in electronic body portion 10 causes to limit.For example, electronic body portion 10 may also include it is more or less than shown in Fig. 4 Component, or with the configuration different from shown in Fig. 4.
It will appreciated by the skilled person that for processor 102, every other component belongs to outer If being coupled by multiple Peripheral Interfaces 124 between processor 102 and these peripheral hardwares.Peripheral Interface 124 can be based on following standard It realizes：Universal Asynchronous Receive/sending device (UniversalAsynchronousReceiver/Transmitter, UART) leads to With input/output (GeneralPurposeInputOutput, GPIO), Serial Peripheral Interface (SPI) (SerialPeripheralInterface, SPI), internal integrated circuit (Inter-IntegratedCircuit, I2C), but It is not limited to above-mentioned standard.In some instances, Peripheral Interface 124 can only include bus；In other examples, Peripheral Interface 124 may also include other elements, such as one or more controller, such as the display controller for connecting display panel 111 Or the storage control for connecting memory.In addition, these controllers can also be detached from Peripheral Interface 124, And be integrated in processor 102 or corresponding peripheral hardware in.
Memory 104 can be used for storing software program and module, and processor 102 is stored in memory 104 by operation Interior software program and module, to perform various functions application and data processing.Memory 104 may include that high speed is random Memory may also include nonvolatile memory, such as one or more magnetic storage device, flash memory or other are non-volatile Property solid-state memory.In some instances, memory 104 can further comprise the storage remotely located relative to processor 102 Device, these remote memories can pass through network connection to electronic body portion 10 or main display 14.The example packet of above-mentioned network Include but be not limited to internet, intranet, LAN, mobile radio communication and combinations thereof.
Radio-frequency module 106 is used to receive and transmit electromagnetic wave, realizes the mutual conversion of electromagnetic wave and electric signal, thus with Communication network or other equipment are communicated.Radio-frequency module 106 may include the various existing electricity for executing these functions Circuit component, for example, antenna, RF transceiver, digital signal processor, encryption/deciphering chip, subscriber identity module (SIM) card, Memory etc..Radio-frequency module 106 can be communicated or be led to various networks such as internet, intranet, wireless network Wireless network is crossed to be communicated with other equipment.Above-mentioned wireless network may include cellular telephone networks, WLAN or Metropolitan Area Network (MAN).Above-mentioned wireless network can use various communication standards, agreement and technology, the including but not limited to whole world mobile logical Letter system (GlobalSystemforMobileCommunication, GSM), enhanced mobile communication technology (EnhancedDataGSMEnvironment, EDGE), Wideband CDMA Technology (widebandcodedivisionmultipleaccess, W-CDMA), Code Division Multiple Access (Codedivisionaccess, CDMA), time division multiple access technology (timedivisionmultipleaccess, TDMA), adopting wireless fidelity technology (Wireless, Fidelity, WiFi) (such as American Institute of Electrical and Electronics Engineers's standard IEEE 802.10A, IEEE802.11b, IEEE802.11g and/or IEEE802.11n), the networking telephone (Voiceoverinternetprotocal, VoIP), the whole world it is micro- Wave interconnection access (WorldwideInteroperabilityforMicrowaveAccess, Wi-MaX), other for mail, The agreement and any other suitable communications protocol of instant messaging and short message, or even may include that those are not opened currently yet The agreement issued.
Voicefrequency circuit 110, loud speaker 101, sound jack 103, microphone 105 provide user and electronic body portion 10 jointly Or the audio interface between main display 14.Specifically, voicefrequency circuit 110 receives voice data from processor 102, by sound Data are converted to electric signal, by electric signal transmission to loud speaker 101.Loud speaker 101 converts electrical signals to what human ear can be heard Sound wave.Voicefrequency circuit 110 receives electric signal also from microphone 105, converts electrical signals to voice data, and by voice data Processor 102 is transferred to be further processed.Audio data from memory 104 or can pass through radio-frequency module 106 obtain.In addition, audio data can also be stored into memory 104 or be sent by radio-frequency module 106.
In the electronic body portion 10 or in main display 14, the example of sensor 114 includes but not the setting of sensor 114 It is limited to：Optical sensor, operation sensor, pressure sensor, gravity accelerometer and other sensors.
Specifically, optical sensor may include ambient light sensor 114F and proximity sensor, wherein ambient light level Device 114F can allow for some modules that processor 102 executes to utilize ambient light sensor with the light and shade of sense ambient light The output data of 114F automatically adjusts the output of display.Further, light sensor 114F detects ring by light-sensitive element The intensity of visible light in border, is allowed for processor 102 and is executed above-mentioned building using the data of light sensor 114F Recognition methods.Specifically in the present embodiment, light sensor 114F is arranged adjacent to display panel 111.Proximity sensor can be When having object close to main display 14, such as when electronic body portion 10 is moved in one's ear, processor 102 closes display output.
As a kind of motion sensor, gravity accelerometer can detect in all directions (generally three axis) and accelerate The size of degree can detect that size and the direction of gravity when static, can be used to identify 100 posture of mobile terminal application (such as Horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc..In addition, Electronic body portion 10 can also configure the other sensors such as gyroscope, barometer, hygrometer, thermometer, and details are not described herein,
In the present embodiment, input module 118 may include the touch screen being arranged on main display 14 109, and touch screen 109 can Collect user on it or neighbouring touch operation (for example user is existed using any suitable object or attachment such as finger, stylus Operation on touch screen 109 or near touch screen 109), and corresponding attachment device is driven according to a pre-set procedure.It can Choosing, touch screen 109 may include touch detecting apparatus and touch controller.Wherein, the touch of touch detecting apparatus detection user Orientation, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch detecting apparatus Upper reception touch information, and the touch information is converted into contact coordinate, then processor 102 is given, and processor 102 can be received The order sent simultaneously is executed.Furthermore, it is possible to using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves Realize the touch detection function of touch screen 109.In addition to touch screen 109, in other change embodiments, input module 118 is also May include other input equipments, such as button 107.Button 107 for example may include the character keys for inputting character, Yi Jiyong In the control button of triggering control function.The example of control button includes " returning to main screen " button, on/off button etc..
Main display 14 is used to show information input by user, is supplied to user information and electronic body portion 10 Various graphical user interface, these graphical user interface can by figure, text, icon, number, video and its arbitrary combination Lai It constitutes, in an example, touch screen 109 may be disposed on display panel 111 to whole with the composition of display panel 111 one Body.
Power module 122 is used to provide supply of electric power to processor 102 and other each components.Specifically, power module 122 may include power-supply management system, one or more power supplys (such as battery or alternating current), charging circuit, power-fail detection Circuit, inverter, indicator of the power supply status and any other generation of electric power with electronic body portion 10 or in main display 14, Manage and be distributed relevant component.
Radio frequency reading module 120 is set to electronic body portion 10, and external find a view accordingly is equipped in electronic body portion 10 Window.Appearance profile for scanning solid object obtains the image of solid object, and obtains the dimension information of solid object.It penetrates Before frequency scanning module 120 can be integrated in the camera of mobile terminal 100, it can also be separately provided.
Mobile terminal 100 further includes locator 119, and locator 119 is used to determine the actual bit residing for mobile terminal 100 It sets.In the present embodiment, locator 119 realizes the positioning of mobile terminal 100, positioning service using positioning service, it should be understood that To obtain the location information (such as latitude and longitude coordinates) of mobile terminal 100 by specific location technology, mark on the electronic map Go out by the technology of the position of positioning object or service.
It should be understood that above-mentioned mobile terminal 100 is not limited to intelligent mobile phone terminal, should refer to can move The computer equipment used in dynamic.Specifically, mobile terminal 100, refers to the mobile computer for being equipped with intelligent operating system Equipment, mobile terminal 100 include but not limited to that smart mobile phone, smartwatch, notebook, tablet computer, POS machine even include vehicle Carry computer, etc..
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office It can be combined in any suitable manner in one or more embodiments or example.In addition, without conflicting with each other, the skill of this field Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples It closes and combines.
In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply relative importance Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discuss suitable Sequence, include according to involved function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be by the application Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (system of such as computer based system including processor or other can be held from instruction The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicating, propagating or passing Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment It sets.The more specific example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring Interconnecting piece (mobile terminal), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits Reservoir (CDROM).In addition, computer-readable medium can even is that can on it the paper of print routine or other suitable be situated between Matter, because can be for example by carrying out optical scanner to paper or other media, then into edlin, interpretation or when necessary with other Suitable method is handled electronically to obtain program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or combination thereof.Above-mentioned In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be executed with storage Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal Discrete logic, with suitable combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), scene Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step that above-described embodiment method carries Suddenly be that relevant hardware can be instructed to complete by program, program can be stored in a kind of computer readable storage medium In, which includes the steps that one or a combination set of embodiment of the method when being executed.In addition, in each embodiment of the application Each functional unit can be integrated in a processing module, can also be that each unit physically exists alone, can also be two Or more than two units are integrated in a module.The form realization of hardware had both may be used in above-mentioned integrated module, can also It is realized in the form of software function module.If integrated module is realized in the form of software function module and as independent Product is sold or in use, can also be stored in a computer read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application System, those skilled in the art can be changed above-described embodiment, change, replace and become within the scope of application Type.
Finally it should be noted that：Above example is only to illustrate the technical solution of the application, rather than its limitations；Although The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding：It still can be with Technical scheme described in the above embodiments is modified or equivalent replacement of some of the technical features；And These modifications or replacements, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and Range.

Claims (10)

1. a kind of building recognition method, which is characterized in that be applied to building recognition system and know configured with the building The mobile terminal of other system, the building recognition method include：
Acquisition includes the image of target construction, obtains the azimuth information of the collecting location of described image；
At least one candidate architecture object is obtained according to the azimuth information；
The candidate architecture object to match with the target construction is determined from least one candidate architecture object；
The information for the candidate architecture object that inquiry matches with the target construction, the association as the target construction are believed Breath；And
The related information is pushed into the mobile terminal.
2. building recognition method as described in claim 1, which is characterized in that the azimuth information includes adopting for described image The geographical location for collecting place when obtaining at least one candidate architecture object according to the azimuth information, is obtained with the geographical location Centered on presumptive area in building as the candidate architecture object.
3. building recognition method as described in claim 1, which is characterized in that from least one candidate architecture object really The fixed candidate architecture object to match with the target construction, including：The spy of the target construction is extracted from described image Reference ceases, and according to the characteristic information, is determined and the target construction phase from least one candidate architecture object The candidate architecture object matched.
4. building recognition method as claimed in claim 3, which is characterized in that extract the target structures from described image The characteristic information of object, and according to the characteristic information, determined and the target structures from least one candidate architecture object The candidate architecture object that object matches, including：
The appearance profile of the target construction is extracted as the characteristic information, by the outer of at least one candidate architecture object Shape profile calculates the appearance profile of the candidate architecture object and the target compared with the appearance profile of the target construction pair Similarity between the appearance profile of building builds the highest candidate of similarity at least one candidate architecture object Build the candidate architecture object that object is determined as matching with the target construction.
5. building recognition method as claimed in claim 3, which is characterized in that extract the target structures from described image The characteristic information of object, and according to the characteristic information, determined and the target structures from least one candidate architecture object The candidate architecture object that object matches, including：The appearance and size of the target construction is extracted as the characteristic information, it will at least The appearance and size of one candidate architecture object calculates the candidate architecture compared with the appearance and size of the target construction pair Similarity between the appearance and size of object and the appearance and size of the target construction, will be at least one candidate architecture object The highest candidate architecture object of similarity is determined as the candidate architecture object to match with the target construction；
And/or the characteristic information of the target construction is extracted from described image, and according to the characteristic information, from least The candidate architecture object to match with the target construction is determined in one candidate architecture object, including：Extract the target The building mark of building is as the characteristic information, by the building mark of at least one candidate architecture object and the target The building mark of building chooses building mark and the target construction at least one candidate architecture object compared to The candidate architecture object that building mark matches, as the candidate architecture object to match with the target construction.
6. building recognition method as described in claim 1, which is characterized in that obtained according to the azimuth information at least one After the candidate architecture object, including：The three-dimensional image of the candidate architecture object is presented in the form of augmented reality；From to The candidate architecture object to match with the target construction is determined in a few candidate architecture object, including：At least one In the candidate architecture object, the candidate architecture object work of user's selection is determined as building with the candidate that the target construction matches Build object.
7. building recognition method as claimed in claim 6, which is characterized in that the 3 D stereo of the candidate architecture object is presented When image, according to the position and attitude of the mobile terminal, and/or according to the control instruction of user, the candidate architecture object is adjusted Three-dimensional image angle presentation.
8. building recognition method as described in claim 1, which is characterized in that the related information includes following information category Any one or more combinations：Between building name, geographical location, building history, related news and collecting location Path, building type between relative position and collecting location and building functions；
After the related information is pushed to the mobile terminal, further include：In the present displayed content of the mobile terminal It shows the information category of the related information, and in the triggering instruction for detecting information category, shows the info class being triggered Other details, and in the triggering instruction for detecting details, pack up the details being triggered.
9. a kind of building recognition system, mobile terminal is run on, the building recognition system requires 1 for perform claim~ Any one of 8 building recognition method, the building recognition system include：
Acquisition module, for acquire include target construction image；
Locating module, the azimuth information of the collecting location for obtaining described image；
Candidate block, for obtaining at least one candidate architecture object according to the azimuth information；
Determining module, for determining that the candidate to match with the target construction builds from least one candidate architecture object Build object；
Enquiry module, the information for inquiring the candidate architecture object to match with the target construction, builds as the target Build the related information of object；And
Pushing module, for the related information of the target construction to be pushed to the mobile terminal.
10. a kind of mobile terminal, including electronic body portion, which is characterized in that further include：
One or more processors；
Memory；And
The building recognition system of claim 9, the building recognition system be stored in the memory and be configured as by The one or more processors execute.
CN201810171971.0A 2018-03-01 2018-03-01 Building recognition method and system and mobile terminal Pending CN108507541A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810171971.0A CN108507541A (en) 2018-03-01 2018-03-01 Building recognition method and system and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810171971.0A CN108507541A (en) 2018-03-01 2018-03-01 Building recognition method and system and mobile terminal

Publications (1)

Publication Number Publication Date
CN108507541A true CN108507541A (en) 2018-09-07

Family

ID=63376988

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810171971.0A Pending CN108507541A (en) 2018-03-01 2018-03-01 Building recognition method and system and mobile terminal

Country Status (1)

Country Link
CN (1) CN108507541A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109492607A (en) * 2018-11-27 2019-03-19 Oppo广东移动通信有限公司 A kind of information-pushing method, information push-delivery apparatus and terminal device
CN109711248A (en) * 2018-11-08 2019-05-03 平安科技（深圳）有限公司 A kind of Identify Environment and terminal device based on video
CN110596739A (en) * 2019-09-03 2019-12-20 山东科技大学 Building identification system and method based on satellite positioning and WiFi module
CN111046234A (en) * 2019-11-13 2020-04-21 广东小天才科技有限公司 Information display method, corresponding device, terminal, server and storage medium
CN111194015A (en) * 2019-12-24 2020-05-22 华为技术有限公司 Outdoor positioning method and device based on building and mobile equipment
CN111339365A (en) * 2018-12-19 2020-06-26 北京奇虎科技有限公司 Video display method and device
CN111640186A (en) * 2020-06-08 2020-09-08 上海商汤智能科技有限公司 AR special effect generation method and device for building, electronic device and storage medium
CN111753609A (en) * 2019-08-02 2020-10-09 杭州海康威视数字技术股份有限公司 Target identification method and device and camera
CN111860094A (en) * 2020-03-16 2020-10-30 北京嘀嘀无限科技发展有限公司 Method, system and computer readable storage medium for verifying image information
CN112990023A (en) * 2021-03-18 2021-06-18 上海万科投资管理有限公司 Building identification method, device, medium and equipment
CN114254417A (en) * 2020-09-22 2022-03-29 Zillow公司 Automatic identification and use of building floor plan information

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130034930A (en) * 2011-09-29 2013-04-08 구대근 Apparatus, system and method using portable serveying terminals based on augmented reality approach
CN103164518A (en) * 2013-03-06 2013-06-19 杭州九树网络科技有限公司 Mobile terminal (MT) augmented reality application system and method
CN103389978A (en) * 2012-05-07 2013-11-13 联想(北京)有限公司 Method and system for acquiring information through augmented reality technologies
CN103533449A (en) * 2012-12-20 2014-01-22 Tcl集团股份有限公司 Method and system for realizing three-dimensional fitting based on intelligent three-dimensional television
CN103557859A (en) * 2013-10-10 2014-02-05 北京智谷睿拓技术服务有限公司 Image acquisition and positioning method and image acquisition and positioning system
CN103913174A (en) * 2012-12-31 2014-07-09 深圳先进技术研究院 Navigation information generation method and system, mobile client and server
CN104899855A (en) * 2014-03-06 2015-09-09 株式会社日立制作所 Three-dimensional obstacle detection method and apparatus
CN105160327A (en) * 2015-09-16 2015-12-16 小米科技有限责任公司 Building identification method and device
CN105446626A (en) * 2015-12-04 2016-03-30 上海斐讯数据通信技术有限公司 Augmented reality technology based commodity information acquisition method and system and mobile terminal
CN106101574A (en) * 2016-06-28 2016-11-09 广东欧珀移动通信有限公司 Control method, device and the mobile terminal of a kind of image enhaucament reality

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130034930A (en) * 2011-09-29 2013-04-08 구대근 Apparatus, system and method using portable serveying terminals based on augmented reality approach
CN103389978A (en) * 2012-05-07 2013-11-13 联想(北京)有限公司 Method and system for acquiring information through augmented reality technologies
CN103533449A (en) * 2012-12-20 2014-01-22 Tcl集团股份有限公司 Method and system for realizing three-dimensional fitting based on intelligent three-dimensional television
CN103913174A (en) * 2012-12-31 2014-07-09 深圳先进技术研究院 Navigation information generation method and system, mobile client and server
CN103164518A (en) * 2013-03-06 2013-06-19 杭州九树网络科技有限公司 Mobile terminal (MT) augmented reality application system and method
CN103557859A (en) * 2013-10-10 2014-02-05 北京智谷睿拓技术服务有限公司 Image acquisition and positioning method and image acquisition and positioning system
CN104899855A (en) * 2014-03-06 2015-09-09 株式会社日立制作所 Three-dimensional obstacle detection method and apparatus
CN105160327A (en) * 2015-09-16 2015-12-16 小米科技有限责任公司 Building identification method and device
CN105446626A (en) * 2015-12-04 2016-03-30 上海斐讯数据通信技术有限公司 Augmented reality technology based commodity information acquisition method and system and mobile terminal
CN106101574A (en) * 2016-06-28 2016-11-09 广东欧珀移动通信有限公司 Control method, device and the mobile terminal of a kind of image enhaucament reality

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李松霖: "基于特征线匹配的城市建筑物识别方法研究", 《遥感技术与应用》 *
谢宇: "《高科技与现代战争》", 30 September 2012 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109711248A (en) * 2018-11-08 2019-05-03 平安科技（深圳）有限公司 A kind of Identify Environment and terminal device based on video
CN109711248B (en) * 2018-11-08 2024-07-16 平安科技（深圳）有限公司 Environment recognition method based on video and terminal equipment
CN109492607A (en) * 2018-11-27 2019-03-19 Oppo广东移动通信有限公司 A kind of information-pushing method, information push-delivery apparatus and terminal device
CN109492607B (en) * 2018-11-27 2021-07-09 Oppo广东移动通信有限公司 Information pushing method, information pushing device and terminal equipment
CN111339365A (en) * 2018-12-19 2020-06-26 北京奇虎科技有限公司 Video display method and device
CN111753609A (en) * 2019-08-02 2020-10-09 杭州海康威视数字技术股份有限公司 Target identification method and device and camera
CN111753609B (en) * 2019-08-02 2023-12-26 杭州海康威视数字技术股份有限公司 Target identification method and device and camera
CN110596739A (en) * 2019-09-03 2019-12-20 山东科技大学 Building identification system and method based on satellite positioning and WiFi module
CN110596739B (en) * 2019-09-03 2021-12-31 山东科技大学 Building identification system and method based on satellite positioning and WiFi module
CN111046234B (en) * 2019-11-13 2023-09-19 广东小天才科技有限公司 Information display method, corresponding device, terminal, server and storage medium
CN111046234A (en) * 2019-11-13 2020-04-21 广东小天才科技有限公司 Information display method, corresponding device, terminal, server and storage medium
CN111194015A (en) * 2019-12-24 2020-05-22 华为技术有限公司 Outdoor positioning method and device based on building and mobile equipment
CN111860094A (en) * 2020-03-16 2020-10-30 北京嘀嘀无限科技发展有限公司 Method, system and computer readable storage medium for verifying image information
CN111640186A (en) * 2020-06-08 2020-09-08 上海商汤智能科技有限公司 AR special effect generation method and device for building, electronic device and storage medium
CN114254417A (en) * 2020-09-22 2022-03-29 Zillow公司 Automatic identification and use of building floor plan information
CN112990023A (en) * 2021-03-18 2021-06-18 上海万科投资管理有限公司 Building identification method, device, medium and equipment

Similar Documents

Publication Publication Date Title
CN108507541A (en) Building recognition method and system and mobile terminal
KR101421164B1 (en) Mobile terminal and its method for displaying radio device
KR102479495B1 (en) Mobile terminal and method for operating thereof
KR101658562B1 (en) Mobile terminal and control method thereof
KR20160150533A (en) Deformable display device and operating method thereof
CN104956236A (en) Survey techniques for generating location fingerprint data
CN109165606B (en) Vehicle information acquisition method and device and storage medium
CN107872875A (en) The method and device of network positions
CN109218982A (en) Sight spot information acquisition methods, device, mobile terminal and storage medium
KR20180056182A (en) Mobile terminal and method for controlling the same
CN108958634A (en) Express delivery information acquisition method, device, mobile terminal and storage medium
KR20160041435A (en) Mobile terminal and control method for the mobile terminal
CN108366163A (en) Control method, device, mobile terminal and the computer-readable medium of camera applications
US11647370B2 (en) Mobile information terminal, information presentation system and information presentation method
CN110536236B (en) Communication method, terminal equipment and network equipment
CN107205219A (en) Method and apparatus for positioning
CN109813300B (en) Positioning method and terminal equipment
KR101657203B1 (en) Mobile terminal and control method therof
CN110532474B (en) Information recommendation method, server, system, and computer-readable storage medium
CN110095792B (en) Method and device for positioning terminal
KR20130127730A (en) Method and system for providing shop information service having real time listing
KR20010037055A (en) Position conviction service method using position and geographic information
KR20160061154A (en) Mobile terminal and method for controlling the same
KR20160005416A (en) Mobile terminal
KR20150058607A (en) Method for oupputing synthesized image, a terminal and a server thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong

Applicant after: OPPO Guangdong Mobile Communications Co., Ltd.

Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong

Applicant before: Guangdong OPPO Mobile Communications Co., Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20180907

RJ01 Rejection of invention patent application after publication