CN101901233A - Method for searching data and image searching engine - Google Patents

Method for searching data and image searching engine Download PDF

Info

Publication number
CN101901233A
CN101901233A CN2009101455658A CN200910145565A CN101901233A CN 101901233 A CN101901233 A CN 101901233A CN 2009101455658 A CN2009101455658 A CN 2009101455658A CN 200910145565 A CN200910145565 A CN 200910145565A CN 101901233 A CN101901233 A CN 101901233A
Authority
CN
China
Prior art keywords
image
candidate
data
search
inquiry
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2009101455658A
Other languages
Chinese (zh)
Inventor
李沿儒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yuan Ze University
Original Assignee
Yuan Ze University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yuan Ze University filed Critical Yuan Ze University
Priority to CN2009101455658A priority Critical patent/CN101901233A/en
Publication of CN101901233A publication Critical patent/CN101901233A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses a method for searching data. The method comprises the following steps: receiving an image searching message, wherein the image searching message at least comprises an image to be searched and a geographic location message related to the image to be searched; searching the Internet for a plurality of candidate data to constitute a candidate database according to the received geographic location message, wherein each candidate datum comprises at least one candidate image; and then, comparing the image to be searched with the candidate image in the candidate database to determine a search result, wherein the search result at least comprises one of the candidate data.

Description

Data search method and Image Search Device
Technical field
The invention relates to a kind of data search method and search engine, and particularly relevant for a kind of with the input image serve as the inquiry target, carry out the image search method and with the input image serve as the inquiry target Image Search Device.
Background technology
The information height expand now, the rapid data search services that people more and more are dependent on world-wide web and are provided.In the past, when the user wants to carry out data retrieval among world-wide web, must be to specific entry network site, for example: very rub, Google (Google), Yam, see through I/O devices such as keyboard, mouse or touch control screen, key in keyword and search related web page.That just knows at present seeks the literal or the frequently-used data seek mode of pattern data with crucial literal.
Though Google (Google) Search engine is developed the similar image function of searching at present, but its using method also is must be by the input inquiry crucial literal, browse the picture concerned photograph that is searched via the user again, click " similar image " function of particular picture photograph, just can link all relevant images via particular picture.Just so-called similar pattern search also must begin via the input crucial literal, obtains to be expanded into similar pattern search result again after the pattern relevant with crucial literal.In other words, the user can't reach the purpose that image is searched image or image search literal via the image of directly importing institute's desire inquiry.
In addition, because female group is too huge for the data of data search, for compare the search image mutually with image for, needs huge and accurate algorithm support, just obtained accurate image comparison result, and the set of the image of search result can the more accurate user of meeting be wanted.Therefore directly search image with image or search with image on the search engine of literal in exploitation, having the high complexity that software program writes and the difficulty utmost point of hardware high-speed computation support need overcome.
Summary of the invention
The invention provides a kind of material method for searching, the relevant geo-localisation information by the inquiry image dwindles the data search scope, simplifies the step of looking for image with image.
The invention provides a kind of Image Search Device,, dwindle the data search scope, and via the image feature that contrasts inquiry image and candidate data, rapid screening goes out the image search result according to the geo-localisation information of inquiry image.
The present invention proposes a kind of data search method, and the method comprises: receive an image query information, this image query information comprise at least an inquiry image and with a geo-localisation information of this inquiry correction of image.According to the geo-localisation information that is received, in a world-wide web, collect many candidate datas and become a candidate data storehouse, wherein each candidate data comprises at least one candidate's image.Afterwards, contrast inquiry image and candidate's image in the candidate data storehouse, to determine a search result, wherein search result comprise at least candidate data one of them.
In one embodiment of this invention, above-mentioned data search method, wherein this geo-localisation information comprises a latitude and longitude coordinates, a position two-dimensional bar, a global positioning information and an assisted global locating information.In addition, this two-dimensional bar comprises rapid reaction coding (quick response code, QR code).
In one embodiment of this invention, above-mentioned data search method, wherein contrast the method for this inquiry image and those candidate's images, at least one image feature that comprises contrast this inquiry image and those candidate's images is with by filtering out those candidate's images of the part the most similar to this inquiry image in those candidate's images.And image feature comprises image color, image composition, image contrast signal and image contour.
In one embodiment of this invention, above-mentioned data search method also comprises showing the lteral data in each those candidate data in this search result.
In one embodiment of this invention, above-mentioned data search method also comprises the lteral data and at least one candidate's image that show each those candidate data in this search result.
In one embodiment of this invention, above-mentioned data search method, wherein those candidate datas of the pen of each in this candidate data storehouse comprise a position coordinates, and those position coordinateses of those candidate datas all are positioned at a coordinate range.
In one embodiment of this invention, above-mentioned data search method, wherein this coordinate range comprise with this geo-localisation information pairing one the location coordinate be the center, apart from this elements of a fix one hectometer with interior scope.
The present invention proposes a kind of Image Search Device in addition, comprising: an enquiry module, a search module and an image contrast module.Wherein, enquiry module is in order to receiving an image query information, and image query information comprise at least an inquiry image and with a geo-localisation information of this inquiry correction of image.Search module then in order to according to geo-localisation information, is collected many candidate datas and is become a candidate data storehouse in a world-wide web, wherein each those candidate data of pen comprises at least one candidate's image.The image contrast module is to be used to contrast this inquiry image and those candidate's images, to determine a search result, wherein this search result comprise at least those candidate datas one of them.
In one embodiment of this invention, above-mentioned Image Search Device, wherein this geo-localisation information comprises a latitude and longitude coordinates, a position two-dimensional bar, a global positioning information and an assisted global locating information.Wherein, this two-dimensional bar comprises rapid reaction coding (quick response code, QR code).
In one embodiment of this invention, above-mentioned Image Search Device, wherein this image contrast module contrasts this inquiry image and those candidate's images and also comprises the image feature that contrasts this inquiry image and an image feature of those candidate's images, with by filtering out those candidate's images of the part the most similar to this inquiry image in those candidate's images.Again, image feature comprises image color, image composition, image contrast signal and image contour.
In one embodiment of this invention, above-mentioned Image Search Device also comprises a display module, is used for showing the lteral data in each those candidate data of this search result.
In one embodiment of this invention, above-mentioned Image Search Device also comprises a display module, is used for showing a lteral data and at least one candidate's image of these each those candidate datas of search result.
In one embodiment of this invention, above-mentioned Image Search Device, wherein this search module is according to a coordinate range and this geo-localisation information, and a position coordinates of each those candidate data in this candidate data storehouse of being collected all is positioned at this coordinate range.And coordinate range comprise with this geo-localisation information pairing one the location coordinate be the center, apart from this elements of a fix one hectometer with interior scope.
In the present invention, relevant geo-localisation information by the inquiry image dwindles search area, raising is searched image or is searched the simple and easy degree of literal and the correctness of search result with image with image, and the user can view and admire actual scenery or historical relic instantly or afterwards, obtain relevant reference object information, be convenient to the user and plan stroke immediately, promote user's the tourism degree of depth or enrich its tourism travel notes family or the shooting postscript.
For above-mentioned feature and advantage of the present invention can be become apparent, embodiment cited below particularly, and cooperate appended graphic being described in detail below.
Description of drawings
Fig. 1 is a kind of data search method general flow chart of one embodiment of the invention.
Fig. 2 is a kind of Image Search Device sketch of one embodiment of the invention.
Fig. 3 A is a kind of image input method synoptic diagram according to one embodiment of the invention.
Fig. 3 B is a kind of image input method synoptic diagram according to another embodiment of the present invention.
Fig. 4 is the position two-dimensional bar figure according to the Taj Mahal Mausoleum of one embodiment of the invention.
Fig. 5 is the candidate data storehouse synoptic diagram of being made up of candidate data of one embodiment of the invention.
Fig. 6 is the contrast inquiry image of one embodiment of the invention and the simplified schematic diagram of candidate's image.
Fig. 7 is the demonstration search result simplified schematic diagram of one embodiment of the invention.
Embodiment
Fig. 1 is a kind of data search method general flow chart of one of the present invention embodiment.Fig. 2 is a kind of Image Search Device sketch of one embodiment of the invention.Please refer to Fig. 1 and Fig. 2, in step S101, at first, receive an image query information via an enquiry module 202 of Image Search Device 200.Above-mentioned image query information comprise at least an inquiry image and with a geo-localisation information of this inquiry correction of image.And above-mentioned Image Search Device 200 for example is an image search engine.
Fig. 3 A is a kind of image input method synoptic diagram according to one embodiment of the invention.Please refer to Fig. 3 A, above-mentioned enquiry module 202 for example is user's interface 300 shown among Fig. 3 A, it comprises the picture that can upload the inquiry of institute desire or the image input field 302 of image, and supply the user to insert and inquire about the picture or the locating information input field 304 of the geo-localisation information of the correction of image, even also comprise an inquiry button 306, be available for users to after uploading inquiry picture or image and input geo-localisation information, activate querying flow.In present embodiment, be with world's cultural heritage, the image 308 of the Taj Mahal Mausoleum of India (The mausoleum of the Taj Mahal) is as the inquiry image of uploading, and Taj Mahal Mausoleum image 308 relevant geo-localisation informations comprise that the on-site latitude of Taj Mahal Mausoleum is 27.174604 therewith, and longitude is 78.041814.The user can pass through active upload image 308, and input simultaneously and the upload geo-localisation information 310 of inquiring about the correction of image, finishes image query information input step (that is being that image query device 200 is finished reception image query information step S101).In this embodiment, the user is after obtaining image, and the Da quota is imported the step S101 that correction of image geo-localisation information is finished the image data method for searching outward.Yet the present invention is not limited to this.
Fig. 3 B is a kind of image input method synoptic diagram according to another embodiment of the present invention.Please refer to Fig. 3 B, when the user obtains image in photographed, can obtain the relevant geo-localisation information of captured image simultaneously, and be combined into one of summary info of image with image.In this embodiment, be that Taj Mahal Mausoleum is an example still to take actual scenery 312, when the user uses the portable apparatus 314 with geographic locating device to take Taj Mahal Mausoleum 312, the geographic locating device of portable apparatus 314 provides the user to take at that time geo-location data simultaneously, and the image query information input that the image 308 and the geo-location data of synchronization gain are formed is installed on the step S101 that Image Search Device 200 in the portable apparatus 314 is finished above-mentioned data search method.
In this embodiment, portable apparatus 314 for example is camera or the communication device with digitized video function.And the geographic locating device in the portable apparatus 314 for example is and satellite equipments 316 communications, GPS (the Global Positioning System of global positioning information can be provided, GPS) or can provide the assisted global locating information agps system (Assisted Global Positioning System, AGPS).
In addition, in this embodiment, when portable apparatus 314 was taken Taj Mahal Mausoleums 312, portable apparatus 314 obtained and filmed image 308 portable apparatus 314 on-site geo-localisation informations 318 at that time synchronously by its geographic locating device and satellite equipments 316 communications.In this embodiment, this 318 of geographical locating information is logined among the video summarization 320 of image 308.That is, in this embodiment, image 308 has possessed geo-localisation information 318 has been arranged in imaging simultaneously, and image 308 itself can become an image query information 322, directly uploads via the picture among user's interface 300a (shown in Fig. 3 B)/image input field 302a.In other words, the user is when obtaining image, the geo-localisation information of image and synchronization gain can be formed an image query information 322, be uploaded to Image Search Device 200 immediately and finish the step S101 of image data method for searching, with in taking photograph simultaneously, carry out the synchrodata search of captured scenery.
In above-mentioned two embodiment, geo-localisation information for example is a latitude and longitude coordinates or the global positioning information or the assisted global locating information that are obtained via geographic locating device on the portable apparatus and satellite communication.Yet the present invention is not limited to this.Obtaining of geo-localisation information also can comprise the place of the captured scenery of identification or the position two-dimensional bar that historical relic provided.Via identification and decipher this position two-dimensional bar, can obtain the relevant geographical locator data of captured scenery.As shown in Figure 4, above-mentioned two-dimensional bar comprises rapid reaction coding (quick response code, QR code).
Fig. 5 is the candidate data storehouse synoptic diagram of being made up of candidate data of one embodiment of the invention.Then, please refer to Fig. 1, Fig. 2 and Fig. 5, according to the geo-localisation information 310/318 that is comprised in the image query information that is received (respectively with reference to Fig. 3 A and Fig. 3 B), the search module 204 of Image Search Device 200 is collected several candidate datas 502 (as shown in Figure 5) and is become a candidate data storehouse 500 in a world-wide web 206.(step S103) wherein each candidate data 502 comprises at least one candidate's image 504.Each candidate data 502 also comprises a lteral data 506 except comprising at least one candidate's image 504.In addition, each candidate data 502 in the above-mentioned candidate data storehouse 500 also comprises a position coordinates of corresponding candidate's image 504, and the position coordinates of each candidate data 502 all be positioned at received geo-localisation information correspondence one the location coordinate be the center, apart from the elements of a fix one specific range with in the interior coordinate range.Wherein above-mentioned specific range is about a hectometer.
Fig. 6 is the contrast inquiry image of one embodiment of the invention and the simplified schematic diagram of candidate's image.Please refer to Fig. 1, Fig. 2 and Fig. 6, afterwards, in step S105, all candidate's images 504 and inquiry image 308 in the image comparison module 208 comparison candidate data storehouses 500 of Image Search Device 200, to determine a search result, wherein search result comprise at least candidate data 502 one of them.In the present embodiment, the method of comparison inquiry image 308 and candidate's image 504 (comprising candidate's image 504a to 504l shown in Figure 6 at least), at least one image feature that comprises respectively comparison inquiry image 308 and candidate's image 504a to 504l is with by filtering out the candidate image 504 the most similar to inquiring about image 308 in candidate's image 504 (comprising candidate's image 504a to 504l shown in Figure 6 at least).And above-mentioned image feature comprises image color, image composition, image contrast signal and image contour.Wherein, image contour for example is the object outline in image or the picture.
Please refer to Fig. 6, is example with inquiry image 308, candidate's image 504g and 504k, and the profile 308a and the object outline 508 among candidate's image 504k of the Taj Mahal Mausoleum in the inquiry image 308 are almost overlapping.Otherwise the profile 308a of the Taj Mahal Mausoleum in the inquiry image 308 does not conform to fully with the object outline 510 among candidate's image 504g.Therefore, compare after the step S105, have that 502 of the candidate datas of candidate's image 504k are screened goes into search result via image comparison module 208.Opposite, through after the image contrast, candidate's image 504g is because of differing greatly with inquiry image 308, and 502 quilts of candidate data that therefore have candidate's image 504g are played except that search result.
Fig. 7 is the demonstration search result simplified schematic diagram of one embodiment of the invention.Please refer to Fig. 1, Fig. 2 and Fig. 7, in step S107, show a lteral data 506 (comprising lteral data 506h, 506k, 506c and 506m as shown in Figure 7 at least) and at least one candidate's image 504 (comprising candidate's image 504h, 504k, 504c and 504m as shown in Figure 7 at least) of each candidate data in the search result by a display module 210 of Image Search Device 200.Yet the display mode of search result is not limited to the display mode of above-mentioned candidate's image collocation lteral data among the present invention.In another embodiment, display module 210 shows that the mode of search results comprises and only shows the lteral data in each candidate data in the search result.
In the present invention, the user can be after filmed image, input to Image Search Device with image and with the geo-localisation information of the correction of image, further inquire about with coherent video picture and Word message for image, with after user's tourism or taking, be convenient to the user and enrich its tourism travel notes or take record.In addition, the user can also be in the time of filmed image, utilize the built-in geo-positioning system of portable apparatus of filmed image, image is combined with geo-localisation information, utilization is installed on the Image Search Device on the portable apparatus, carry out captured correction of image data search immediately, real-time image of user and Word message can be provided, the tourism guide to visitors and the historical record of for example captured scenery or historical relic.Relevant geo-localisation information by the inquiry image dwindles search area, raising is searched image or is searched the simple and easy degree of literal and the correctness of search result with image with image, and the user can view and admire actual scenery or historical relic instantly, obtain relevant travel information immediately, be convenient to the user and plan the stroke and the tourism degree of depth that promotes the user immediately.
Though the present invention discloses as above with embodiment; right its is not in order to limit the present invention; have in the technical field under any and know the knowledgeable usually; without departing from the spirit and scope of the present invention; when doing a little change and retouching, so protection scope of the present invention is worked as with being as the criterion that claim was defined.

Claims (18)

1. data search method comprises:
Receive an image query information, this image query information comprise at least an inquiry image and with a geo-localisation information of this inquiry correction of image;
According to this geo-localisation information, in a world-wide web, collect many candidate datas and become a candidate data storehouse, wherein each those candidate data of pen comprises at least one candidate's image; And
This inquiry image and those candidate's images of contrast in this candidate data storehouse, to determine a search result, wherein this search result comprise at least those candidate datas one of them.
2. data search method as claimed in claim 1 is characterized in that, this geo-localisation information comprises a latitude and longitude coordinates, a position two-dimensional bar, a global positioning information and an assisted global locating information.
3. data search method as claimed in claim 2 is characterized in that, this two-dimensional bar comprises the rapid reaction coding.
4. material method for searching as claimed in claim 1, it is characterized in that, contrast the method for this inquiry image and those candidate's images, at least one image feature that comprises contrast this inquiry image and those candidate's images is with by filtering out those candidate's images of the part the most similar to this inquiry image in those candidate's images.
5. material method for searching as claimed in claim 4 is characterized in that, this image feature comprises image color, image composition, image contrast signal and image contour.
6. data search method as claimed in claim 1 is characterized in that, also comprises showing the lteral data in each those candidate data in this search result.
7. data search method as claimed in claim 1 is characterized in that, also comprises the lteral data and at least one candidate's image that show each those candidate data in this search result.
8. data search method as claimed in claim 1 is characterized in that, each those candidate data of pen in this candidate data storehouse comprise a position coordinates, and those position coordinateses of those candidate datas all are positioned at a coordinate range.
9. data search method as claimed in claim 8 is characterized in that, this coordinate range comprise with this geo-localisation information pairing one the location coordinate be the center, apart from this elements of a fix one hectometer with interior scope.
10. Image Search Device comprises:
One enquiry module, in order to receiving an image query information, this image query information comprise at least an inquiry image and with a geo-localisation information of this inquiry correction of image;
One search module in order to according to this geo-localisation information, is collected many candidate datas and is become a candidate data storehouse in a world-wide web, wherein each those candidate data of pen comprises at least one candidate's image; And
One image contrast module is used to contrast this inquiry image and those candidate's images, to determine a search result, wherein this search result comprise at least those candidate datas one of them.
11. Image Search Device as claimed in claim 10 is characterized in that, this geo-localisation information comprises a latitude and longitude coordinates, a position two-dimensional bar, a global positioning information and an assisted global locating information.
12. Image Search Device as claimed in claim 11 is characterized in that, this two-dimensional bar comprises the rapid reaction coding.
13. Image Search Device as claimed in claim 10, it is characterized in that, this image contrast module contrasts this inquiry image and those candidate's images and also comprises the image feature that contrasts this inquiry image and an image feature of those candidate's images, with by filtering out those candidate's images of the part the most similar to this inquiry image in those candidate's images.
14. Image Search Device as claimed in claim 13 is characterized in that, this image feature comprises image color, image composition, image contrast signal and image contour.
15. Image Search Device as claimed in claim 10 is characterized in that, also comprises a display module, is used for showing the lteral data in each those candidate data of this search result.
16. Image Search Device as claimed in claim 10 is characterized in that, also comprises a display module, is used for showing a lteral data and at least one candidate's image of these each those candidate datas of search result.
17. Image Search Device as claimed in claim 10, it is characterized in that, this search module is according to a coordinate range and this geo-localisation information, and a position coordinates of each those candidate data in this candidate data storehouse of being collected all is positioned at this coordinate range.
18. Image Search Device as claimed in claim 17 is characterized in that, this coordinate range comprise with this geo-localisation information pairing one the location coordinate be the center, apart from this elements of a fix one hectometer with interior scope.
CN2009101455658A 2009-05-25 2009-05-25 Method for searching data and image searching engine Pending CN101901233A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009101455658A CN101901233A (en) 2009-05-25 2009-05-25 Method for searching data and image searching engine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009101455658A CN101901233A (en) 2009-05-25 2009-05-25 Method for searching data and image searching engine

Publications (1)

Publication Number Publication Date
CN101901233A true CN101901233A (en) 2010-12-01

Family

ID=43226774

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009101455658A Pending CN101901233A (en) 2009-05-25 2009-05-25 Method for searching data and image searching engine

Country Status (1)

Country Link
CN (1) CN101901233A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102081672A (en) * 2010-11-30 2011-06-01 中华电信股份有限公司 System and method for displaying interest point information in lens image of intelligent mobile device
CN102982155A (en) * 2012-11-29 2013-03-20 上海华力微电子有限公司 System and method for searching defects based on pattern identification
CN111159455A (en) * 2018-11-08 2020-05-15 宏碁股份有限公司 Method for judging position and positioning system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102081672A (en) * 2010-11-30 2011-06-01 中华电信股份有限公司 System and method for displaying interest point information in lens image of intelligent mobile device
CN102982155A (en) * 2012-11-29 2013-03-20 上海华力微电子有限公司 System and method for searching defects based on pattern identification
CN111159455A (en) * 2018-11-08 2020-05-15 宏碁股份有限公司 Method for judging position and positioning system

Similar Documents

Publication Publication Date Title
US11455798B2 (en) Imaging device and information acquisition system in which an acquired image and associated information are held on a display
CN104936283B (en) Indoor orientation method, server and system
US8483715B2 (en) Computer based location identification using images
US9600584B2 (en) Scalable visual search system simplifying access to network and device functionality
US8891832B2 (en) Computer-vision-assisted location check-in
US9918048B2 (en) System and method for providing automatic location-based imaging
US20120310968A1 (en) Computer-Vision-Assisted Location Accuracy Augmentation
US9104694B2 (en) Method of searching in a collection of data items
CN105008858A (en) User-in-the-loop architecture for indoor positioning
CN102461217A (en) Providing search results to a computing device
CN102754097A (en) Method and apparatus for presenting a first-person world view of content
WO2007005032B1 (en) Systems, methods and devices for trip management functions
JP2005346440A (en) Metadata application support system, controller, and metadata application support method
WO2011136341A1 (en) Information providing device, method of providing information, information providing processing program, and recording medium on which an information providing processing program is recorded
JP5854714B2 (en) Display control apparatus, display control apparatus control method, and program
CN102023988A (en) Method of establishing interest point information, system and used computer program product
CN101901233A (en) Method for searching data and image searching engine
KR102107208B1 (en) Method for Providing Off-line Shop Information in Network, and Managing Server Used Therein
CN105409251B (en) Method and apparatus for carrying out optimized object search
JP5272107B2 (en) Information providing apparatus, information providing processing program, recording medium on which information providing processing program is recorded, and information providing method
CN101945159B (en) Portable electronic device and operation method thereof
TWI451791B (en) Method for searching contacts, electronic apparatus, and computer program product using the method thereof
Yan et al. Design and implementation of a mobile gis for field data collection
TW201042473A (en) Data searching method and image searching device
JP2019049966A (en) Generation of travel destination and recommendation from scanned content, kiosk system, method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20101201