EP3356955A1 - Procédé et système de recherche d'images similaires quasi-indépendant de l'échelle de la collection d'images - Google Patents
Procédé et système de recherche d'images similaires quasi-indépendant de l'échelle de la collection d'imagesInfo
- Publication number
- EP3356955A1 EP3356955A1 EP16775629.5A EP16775629A EP3356955A1 EP 3356955 A1 EP3356955 A1 EP 3356955A1 EP 16775629 A EP16775629 A EP 16775629A EP 3356955 A1 EP3356955 A1 EP 3356955A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- images
- list
- collection
- characteristic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/56—Information retrieval; Database structures therefor; File system structures therefor of still image data having vectorial format
Definitions
- the field of the invention is that of data mining, and more particularly that of the image search by the content for which it is desired to find images similar to a purely visual request in the form of an image called a request image. .
- This visual similarity search process consists of two main phases, indexing the image collection, which is performed offline, and querying, which must be done online.
- indexing is to transform the "pixel" content of images into feature-based (feature extraction) representations, usually of fixed size.
- the purpose of the querying step is to extract a vector representation of the content of the query image and to compare it to the representations of the images in the collection in order to find the most similar elements.
- search trees kd-trees, k-means trees
- kd-trees k-means trees
- the interrogation step of the inverted index starts with an operation of integration with the list having as a first feature the highest weight characteristic in the vector representing the request image, and continues as long as the number of embedded images in the list did not reach the target number by repeating the list integration operation with another feature being the immediately lower weight characteristic in the vector representing the query image;
- the invention relates to a method of searching documents among the documents of a collection by means of a representation of a request and of the documents of the collection by a characteristic vector associating a weight with each of the characteristics.
- a characteristic vector associating a weight with each of the characteristics.
- the extraction of EX-CR characteristics is followed by a scheduling operation, for each of the characteristics, of the images of the collection. according to their weight associated with the feature to create a list of ordered images by descending weights. Then a creation operation "CREA-II" of the inverted index II is performed that matches each of the characteristics with a predefined number of images of the collection corresponding to the first images in the ordered image list associated with the feature.
- CREA-II creation operation “CREA-II" of the inverted index II is performed that matches each of the characteristics with a predefined number of images of the collection corresponding to the first images in the ordered image list associated with the feature.
- This pre-defined number x t may especially, but not necessarily, correspond to the maximum number of images that can be integrated in the list of similar images determined according to the target number x of images in the list of similar images.
- the characteristic C2 with the images 13, 14 and 15 of the reference collection whose weights associated with this characteristic are respectively 0.8, 0.7 and 0.6
- the characteristic C3 with the images 16, 17 and 18 of the reference collection whose weights associated with this characteristic are respectively 0.9, 0.8 and 0.6.
- the online search phase comprises a "CONF" reformulation step of the vector representing the request image consisting of modifying, for example increasing, the weight associated with one or more characteristics to be confused with one or several characteristics selected according to the weight associated with them in the vector representing the request image (the characteristics of the highest weight are typically selected).
- the search phase continues with an LTU interrogation step of the inverted index II to create a list L of images from the collection 16-18, 11, 12 similar to the request image Ir.
- the LTU interrogation step of the inverted index more particularly comprises an operation of integrating into the list of one or more images 16-18 of the collection mapped in the inverted index II with a first characteristic C3 selected according to the weight associated with it in the vector representing the request image, the list integration operation being repeated for another selected characteristic C1 according to the weight associated with it in the vector representing the request image as long as the number of images in the list has not reached the target number x.
- the interrogation step of the inverted index starts with an operation of integration with the list having as a first characteristic the characteristic C3 of highest weight in the vector representing the request image, and continues as long as the number of images included in the list did not reach the target number by repeating the list integration operation with another feature of the immediately lower weight characteristic in the vector representing the request image.
- a processor configured to query the inverted index to create a list of images of the collection similar to the query image by performing an integration operation to the list of one or more images from the collection mapped into the inverted index with a first characteristic C1 selected according to the weight associated with it in the vector representing the request image, and repeating the integration operation with the list for another characteristic C2 selected according to the weight associated with it in the vector representing the query image until the number of images in the list has reached a target number.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1559289A FR3041794B1 (fr) | 2015-09-30 | 2015-09-30 | Procede et systeme de recherche d'images similaires quasi-independant de l'echelle de la collection d'images |
PCT/EP2016/072922 WO2017055250A1 (fr) | 2015-09-30 | 2016-09-27 | Procédé et système de recherche d'images similaires quasi-indépendant de l'échelle de la collection d'images |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3356955A1 true EP3356955A1 (fr) | 2018-08-08 |
Family
ID=55542743
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16775629.5A Withdrawn EP3356955A1 (fr) | 2015-09-30 | 2016-09-27 | Procédé et système de recherche d'images similaires quasi-indépendant de l'échelle de la collection d'images |
Country Status (4)
Country | Link |
---|---|
US (1) | US20180276244A1 (fr) |
EP (1) | EP3356955A1 (fr) |
FR (1) | FR3041794B1 (fr) |
WO (1) | WO2017055250A1 (fr) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180101540A1 (en) * | 2016-10-10 | 2018-04-12 | Facebook, Inc. | Diversifying Media Search Results on Online Social Networks |
US10515289B2 (en) * | 2017-01-09 | 2019-12-24 | Qualcomm Incorporated | System and method of generating a semantic representation of a target image for an image processing operation |
CN107480282A (zh) * | 2017-08-23 | 2017-12-15 | 深圳天珑无线科技有限公司 | 一种图片搜索的方法及装置 |
US11120334B1 (en) * | 2017-09-08 | 2021-09-14 | Snap Inc. | Multimodal named entity recognition |
CN110275970B (zh) * | 2019-06-21 | 2022-05-06 | 北京达佳互联信息技术有限公司 | 图像检索的方法、装置、服务器及存储介质 |
CN113407751B (zh) * | 2021-05-21 | 2022-07-15 | 深圳市广电信义科技有限公司 | 一种图像检索结果重排序方法、装置、设备及介质 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8065293B2 (en) * | 2007-10-24 | 2011-11-22 | Microsoft Corporation | Self-compacting pattern indexer: storing, indexing and accessing information in a graph-like data structure |
WO2009081620A1 (fr) * | 2007-12-26 | 2009-07-02 | T-Terminology, Ltd. | Système de dictionnaire |
US8429216B2 (en) * | 2008-09-23 | 2013-04-23 | Hewlett-Packard Development Company, L.P. | Generating a hash value from a vector representing a data object |
US9710491B2 (en) * | 2009-11-02 | 2017-07-18 | Microsoft Technology Licensing, Llc | Content-based image search |
US9405773B2 (en) * | 2010-03-29 | 2016-08-02 | Ebay Inc. | Searching for more products like a specified product |
GB2487377B (en) * | 2011-01-18 | 2018-02-14 | Aptina Imaging Corp | Matching interest points |
-
2015
- 2015-09-30 FR FR1559289A patent/FR3041794B1/fr not_active Expired - Fee Related
-
2016
- 2016-09-27 EP EP16775629.5A patent/EP3356955A1/fr not_active Withdrawn
- 2016-09-27 US US15/763,347 patent/US20180276244A1/en not_active Abandoned
- 2016-09-27 WO PCT/EP2016/072922 patent/WO2017055250A1/fr active Application Filing
Also Published As
Publication number | Publication date |
---|---|
FR3041794A1 (fr) | 2017-03-31 |
WO2017055250A1 (fr) | 2017-04-06 |
US20180276244A1 (en) | 2018-09-27 |
FR3041794B1 (fr) | 2017-10-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017055250A1 (fr) | Procédé et système de recherche d'images similaires quasi-indépendant de l'échelle de la collection d'images | |
US20200012674A1 (en) | System and methods thereof for generation of taxonomies based on an analysis of multimedia content elements | |
US10163227B1 (en) | Image file compression using dummy data for non-salient portions of images | |
US20100042646A1 (en) | System and Methods Thereof for Generation of Searchable Structures Respective of Multimedia Data Content | |
US20100262609A1 (en) | System and method for linking multimedia data elements to web pages | |
FR2969339A1 (fr) | Systeme et procede d'extraction d'informations multimedia | |
WO2012141655A1 (fr) | Annotation de produit vidéo avec exploration d'informations web | |
WO2016102153A1 (fr) | Representation semantique du contenu d'une image | |
WO2014056819A1 (fr) | Procede de classification d'un objet multimodal | |
EP3008635A1 (fr) | Procede de classification thematique automatique d'un fichier de texte numerique | |
EP2374075A1 (fr) | Procede et systeme pour classifier des donnees issues de base de donnees | |
Rabbath et al. | Analysing facebook features to support event detection for photo-based facebook applications | |
EP2289009B1 (fr) | Dispositif d'aide a la reconnaissance d'images ameliore | |
EP3574462A1 (fr) | Detection automatique de fraudes dans un flux de transactions de paiement par reseaux de neurones integrant des informations contextuelles | |
FR2801991A1 (fr) | Procede et dispositif de recherche d'images basee sur le contenu prenant en compte le contenu de regions d'interet | |
WO2013156374A1 (fr) | Procede de reconnaissance d'un contexte visuel d'une image et dispositif correspondant | |
Yousaf et al. | Patch-CNN: deep learning for logo detection and brand recognition | |
EP4099228A1 (fr) | Apprentissage automatique sans annotation ameliore par regroupements adaptatifs en ensemble ouvert de classes | |
Han et al. | Grass leaf identification using dbN wavelet and CILBP | |
US10180942B2 (en) | System and method for generation of concept structures based on sub-concepts | |
FR3099600A1 (fr) | Méthode de jugement du degré de similarité entre deux systèmes techniques quelconques | |
Nilsson et al. | A comparison of image and object level annotation performance of image recognition cloud services and custom Convolutional Neural Network models | |
FR2830958A1 (fr) | Procede d'indexation, de stockage et de comparaison de documents multimedia | |
Bhatnagar et al. | Choice of Efficient Image Classification Technique using Limited Device | |
Singh et al. | Large Scale Image Retrieval with Locality Sensitive Hashing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20180403 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: GADESKI, ETIENNE Inventor name: POPESCU, ADRIAN Inventor name: GINSCA, ALEXANDRU LUCIAN Inventor name: LE BORGNE, HERVE |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20200122 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20200603 |