WO2011017558A1 - User interface for presenting search results for multiple regions of a visual query - Google Patents

User interface for presenting search results for multiple regions of a visual query Download PDF

Info

Publication number
WO2011017558A1
WO2011017558A1 PCT/US2010/044604 US2010044604W WO2011017558A1 WO 2011017558 A1 WO2011017558 A1 WO 2011017558A1 US 2010044604 W US2010044604 W US 2010044604W WO 2011017558 A1 WO2011017558 A1 WO 2011017558A1
Authority
WO
WIPO (PCT)
Prior art keywords
visual
search
visual query
results
query
Prior art date
Application number
PCT/US2010/044604
Other languages
English (en)
French (fr)
Inventor
David Petrou
Theodore Power
Original Assignee
Google Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/850,513 external-priority patent/US9087059B2/en
Application filed by Google Inc. filed Critical Google Inc.
Priority to CN2010800451970A priority Critical patent/CN102667764A/zh
Priority to EP10742686A priority patent/EP2462518A1/en
Priority to AU2010279334A priority patent/AU2010279334A1/en
Priority to JP2012523961A priority patent/JP2013501976A/ja
Priority to CA2770186A priority patent/CA2770186C/en
Priority to KR1020127006115A priority patent/KR101670956B1/ko
Priority to BR112012002803A priority patent/BR112012002803A2/pt
Publication of WO2011017558A1 publication Critical patent/WO2011017558A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43Querying
    • G06F16/438Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/532Query formulation, e.g. graphical querying
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
PCT/US2010/044604 2009-08-07 2010-08-05 User interface for presenting search results for multiple regions of a visual query WO2011017558A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
CN2010800451970A CN102667764A (zh) 2009-08-07 2010-08-05 用于为视觉查询的多个区域展示搜索结果的用户接口
EP10742686A EP2462518A1 (en) 2009-08-07 2010-08-05 User interface for presenting search results for multiple regions of a visual query
AU2010279334A AU2010279334A1 (en) 2009-08-07 2010-08-05 User interface for presenting search results for multiple regions of a visual query
JP2012523961A JP2013501976A (ja) 2009-08-07 2010-08-05 視覚クエリの複数の領域についての検索結果を提示するためのユーザインターフェイス
CA2770186A CA2770186C (en) 2009-08-07 2010-08-05 User interface for presenting search results for multiple regions of a visual query
KR1020127006115A KR101670956B1 (ko) 2009-08-07 2010-08-05 시각 질의의 다수 영역들에 대한 검색 결과들을 제시하기 위한 사용자 인터페이스
BR112012002803A BR112012002803A2 (pt) 2009-08-07 2010-08-05 método implementado por computador para processamento de uma consulta visual, sistema servidor,e, mídia de armazenamento não temporário legível por computador

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US23239709P 2009-08-07 2009-08-07
US61/232,397 2009-08-07
US26612209P 2009-12-02 2009-12-02
US61/266,122 2009-12-02
US12/850,513 2010-08-04
US12/850,513 US9087059B2 (en) 2009-08-07 2010-08-04 User interface for presenting search results for multiple regions of a visual query

Publications (1)

Publication Number Publication Date
WO2011017558A1 true WO2011017558A1 (en) 2011-02-10

Family

ID=43544672

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/044604 WO2011017558A1 (en) 2009-08-07 2010-08-05 User interface for presenting search results for multiple regions of a visual query

Country Status (8)

Country Link
EP (1) EP2462518A1 (pt)
JP (2) JP2013501976A (pt)
KR (1) KR101670956B1 (pt)
CN (1) CN102667764A (pt)
AU (1) AU2010279334A1 (pt)
BR (1) BR112012002803A2 (pt)
CA (1) CA2770186C (pt)
WO (1) WO2011017558A1 (pt)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102594896A (zh) * 2012-02-23 2012-07-18 广州商景网络科技有限公司 电子相片共享方法及系统
JP2014006680A (ja) * 2012-06-25 2014-01-16 Sony Corp ビデオ記録装置、情報処理システム、情報処理方法および記録媒体
WO2014035430A1 (en) 2012-08-31 2014-03-06 Hewlett-Packard Development Company, L.P. Active regions of an image with accessible links
CN104462423A (zh) * 2014-12-15 2015-03-25 百度在线网络技术(北京)有限公司 搜索方法、装置和移动终端
US9355317B2 (en) 2011-12-14 2016-05-31 Nec Corporation Video processing system, video processing method, video processing device for mobile terminal or server and control method and control program thereof
EP3188034A4 (en) * 2014-08-25 2017-07-05 ZTE Corporation Display terminal-based data processing method
US10089412B2 (en) 2015-03-30 2018-10-02 Yandex Europe Ag Method of and system for processing a search query
US10255240B2 (en) 2014-03-27 2019-04-09 Yandex Europe Ag Method and system for processing a voice-based user-input

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488769B (zh) * 2013-09-27 2017-06-06 中国科学院自动化研究所 一种基于多媒体数据挖掘的地标信息检索方法
KR101588950B1 (ko) * 2014-03-28 2016-01-26 주식회사 에스원 시장 점유율 판별 시스템, 시장 점유율 판별 방법 및 그 판별 시스템을 실행할 수 있는 프로그램을 기록한 컴퓨터로 읽을 수 있는 매체
WO2016049799A1 (en) * 2014-09-29 2016-04-07 Microsoft Technology Licensing, Llc Customizable data services
US20160132567A1 (en) * 2014-11-12 2016-05-12 Microsoft Corporation Multi-search and multi-task in search
US10102565B2 (en) * 2014-11-21 2018-10-16 Paypal, Inc. System and method for content integrated product purchasing
CN105868385B (zh) * 2014-12-12 2020-02-07 北京奇虎科技有限公司 基于终端界面触控操作进行搜索的方法及系统
KR102339461B1 (ko) * 2014-12-18 2021-12-15 삼성전자 주식회사 전자 장치의 텍스트 기반 컨텐츠 운용 방법 및 장치
WO2016101768A1 (zh) * 2014-12-26 2016-06-30 北京奇虎科技有限公司 终端以及基于触摸操作的搜索方法和装置
WO2016126665A1 (en) * 2015-02-04 2016-08-11 Vatbox, Ltd. A system and methods for extracting document images from images featuring multiple documents
US10579330B2 (en) * 2015-05-13 2020-03-03 Microsoft Technology Licensing, Llc Automatic visual display of audibly presented options to increase user efficiency and interaction performance
CN108431829A (zh) * 2015-08-03 2018-08-21 奥兰德股份公司 用于在目录中搜索产品的系统和方法
BR112018008266A2 (pt) * 2015-10-25 2018-10-23 Alva Alta Lda embalagem reconhecível por diferentes tipos de meios, sistema e processo para preparação de produtos edíveis com base nas referidas embalagens reconhecíveis
US10528613B2 (en) * 2015-11-23 2020-01-07 Advanced Micro Devices, Inc. Method and apparatus for performing a parallel search operation
US9779293B2 (en) * 2016-01-27 2017-10-03 Honeywell International Inc. Method and tool for post-mortem analysis of tripped field devices in process industry using optical character recognition and intelligent character recognition
DE102016201373A1 (de) * 2016-01-29 2017-08-03 Robert Bosch Gmbh Verfahren zu einer Erkennung von Objekten, insbesondere von dreidimensionalen Objekten
US20190072407A1 (en) * 2016-07-26 2019-03-07 Google Llc Interactive Geo-Contextual Navigation Tool
CN106484817B (zh) * 2016-09-26 2020-06-26 广州致远电子有限公司 一种数据搜索方法及系统
US10346727B2 (en) * 2016-10-28 2019-07-09 Adobe Inc. Utilizing a digital canvas to conduct a spatial-semantic search for digital visual media
US10558857B2 (en) * 2018-03-05 2020-02-11 A9.Com, Inc. Visual feedback of process state
CN109168069A (zh) * 2018-09-03 2019-01-08 聚好看科技股份有限公司 一种识别结果分区域显示方法、装置及智能电视
CN109189289B (zh) * 2018-09-03 2021-12-24 聚好看科技股份有限公司 一种基于截屏图像生成图标的方法及装置
TWI768232B (zh) * 2019-08-07 2022-06-21 上銀科技股份有限公司 線性傳動裝置的影像判定系統及其影像判定方法
CN112417192A (zh) * 2019-08-21 2021-02-26 上银科技股份有限公司 线性传动装置的影像判定系统及其影像判定方法
JP7379059B2 (ja) * 2019-10-02 2023-11-14 キヤノン株式会社 中間サーバ装置、情報処理装置、通信方法
CN114581360B (zh) * 2021-04-01 2024-03-12 正泰集团研发中心(上海)有限公司 光伏组件标签检测方法、装置、设备和计算机存储介质
CN113901257B (zh) 2021-10-28 2023-10-27 北京百度网讯科技有限公司 地图信息的处理方法、装置、设备和存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060253491A1 (en) * 2005-05-09 2006-11-09 Gokturk Salih B System and method for enabling search and retrieval from image files based on recognized information

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09330336A (ja) * 1996-06-11 1997-12-22 Sony Corp 情報処理装置
US7016532B2 (en) * 2000-11-06 2006-03-21 Evryx Technologies Image capture and identification system and process
JP2003150617A (ja) * 2001-11-12 2003-05-23 Olympus Optical Co Ltd 画像処理装置およびプログラム
JP2005165461A (ja) * 2003-11-28 2005-06-23 Nifty Corp 情報提供装置及び情報提供プログラム
JP4413633B2 (ja) * 2004-01-29 2010-02-10 株式会社ゼータ・ブリッジ 情報検索システム、情報検索方法、情報検索装置、情報検索プログラム、画像認識装置、画像認識方法および画像認識プログラム、ならびに、販売システム
US7751805B2 (en) * 2004-02-20 2010-07-06 Google Inc. Mobile image-based information retrieval system
WO2006043319A1 (ja) * 2004-10-20 2006-04-27 Fujitsu Limited 端末及びサーバ
US7809192B2 (en) * 2005-05-09 2010-10-05 Like.Com System and method for recognizing objects from images and identifying relevancy amongst images and information
JP2007018166A (ja) * 2005-07-06 2007-01-25 Nec Corp 情報検索装置、情報検索システム、情報検索方法及び情報検索プログラム
JP2007018456A (ja) * 2005-07-11 2007-01-25 Nikon Corp 情報表示装置及び情報表示方法
JP2007026316A (ja) * 2005-07-20 2007-02-01 Yamaha Motor Co Ltd 画像管理装置、ならびに画像管理用コンピュータプログラムおよびそれを記録した記録媒体
US8849821B2 (en) * 2005-11-04 2014-09-30 Nokia Corporation Scalable visual search system simplifying access to network and device functionality
US20080267504A1 (en) * 2007-04-24 2008-10-30 Nokia Corporation Method, device and computer program product for integrating code-based and optical character recognition technologies into a mobile visual search

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060253491A1 (en) * 2005-05-09 2006-11-09 Gokturk Salih B System and method for enabling search and retrieval from image files based on recognized information

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANAGNOSTOPOULOS I ET AL: "Information fusion meta-search interface for precise photo acquisition on the web", INFORMATION TECHNOLOGY INTERFACES, 2003. ITI 2003. PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON JUNE 16-19, 2003, PISCATAWAY, NJ, USA,IEEE, 16 June 2003 (2003-06-16), pages 375 - 381, XP010654750, ISBN: 978-953-96769-6-2 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9355317B2 (en) 2011-12-14 2016-05-31 Nec Corporation Video processing system, video processing method, video processing device for mobile terminal or server and control method and control program thereof
CN102594896A (zh) * 2012-02-23 2012-07-18 广州商景网络科技有限公司 电子相片共享方法及系统
JP2014006680A (ja) * 2012-06-25 2014-01-16 Sony Corp ビデオ記録装置、情報処理システム、情報処理方法および記録媒体
WO2014035430A1 (en) 2012-08-31 2014-03-06 Hewlett-Packard Development Company, L.P. Active regions of an image with accessible links
CN104583983A (zh) * 2012-08-31 2015-04-29 惠普发展公司,有限责任合伙企业 具有可访问的链接的图像的活动区域
US20150242522A1 (en) * 2012-08-31 2015-08-27 Qian Lin Active regions of an image with accessible links
EP2891068A4 (en) * 2012-08-31 2016-01-20 Hewlett Packard Development Co ACTIVE REGIONS OF AN IMAGE COMPRISING ACCESSIBLE LINKS
US10210273B2 (en) 2012-08-31 2019-02-19 Hewlett-Packard Development Company, L.P. Active regions of an image with accessible links
US10255240B2 (en) 2014-03-27 2019-04-09 Yandex Europe Ag Method and system for processing a voice-based user-input
EP3188034A4 (en) * 2014-08-25 2017-07-05 ZTE Corporation Display terminal-based data processing method
CN104462423A (zh) * 2014-12-15 2015-03-25 百度在线网络技术(北京)有限公司 搜索方法、装置和移动终端
US10089412B2 (en) 2015-03-30 2018-10-02 Yandex Europe Ag Method of and system for processing a search query

Also Published As

Publication number Publication date
AU2010279334A1 (en) 2012-03-15
JP6025812B2 (ja) 2016-11-16
KR20120055627A (ko) 2012-05-31
CN102667764A (zh) 2012-09-12
CA2770186A1 (en) 2011-02-10
JP2015062141A (ja) 2015-04-02
KR101670956B1 (ko) 2016-10-31
BR112012002803A2 (pt) 2019-09-24
CA2770186C (en) 2018-05-22
EP2462518A1 (en) 2012-06-13
JP2013501976A (ja) 2013-01-17

Similar Documents

Publication Publication Date Title
US20190012334A1 (en) Architecture for Responding to Visual Query
CA2770186C (en) User interface for presenting search results for multiple regions of a visual query
US9087059B2 (en) User interface for presenting search results for multiple regions of a visual query
CA2781845C (en) Actionable search results for visual queries
CA2770239C (en) Facial recognition with social network aiding
US9183224B2 (en) Identifying matching canonical documents in response to a visual query
US20110128288A1 (en) Region of Interest Selector for Visual Queries
AU2016200659B2 (en) Architecture for responding to a visual query
AU2017200336A1 (en) Facial recognition with social network aiding
AU2013245488A1 (en) Facial recognition with social network aiding

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080045197.0

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10742686

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2770186

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2012523961

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2010279334

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2010742686

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20127006115

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2010279334

Country of ref document: AU

Date of ref document: 20100805

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112012002803

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112012002803

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20120207