MX2016014986A - Natural language image search. - Google Patents

Natural language image search.

Info

Publication number
MX2016014986A
MX2016014986A MX2016014986A MX2016014986A MX2016014986A MX 2016014986 A MX2016014986 A MX 2016014986A MX 2016014986 A MX2016014986 A MX 2016014986A MX 2016014986 A MX2016014986 A MX 2016014986A MX 2016014986 A MX2016014986 A MX 2016014986A
Authority
MX
Mexico
Prior art keywords
natural language
query
images
image
mapped
Prior art date
Application number
MX2016014986A
Other languages
Spanish (es)
Other versions
MX370916B (en
Inventor
Ahmad EL-SABAN Motaz
Yassin TAWFIK Ahmed
Hassan Sayed Sayed
Adbel Moneim Twafik Chalabi Achraf
Original Assignee
Microsoft Technology Licensing Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing Llc filed Critical Microsoft Technology Licensing Llc
Publication of MX2016014986A publication Critical patent/MX2016014986A/en
Publication of MX370916B publication Critical patent/MX370916B/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/332—Query formulation
    • G06F16/3329—Natural language query formulation or dialogue systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/285—Clustering or classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Library & Information Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Natural language image search is described, for example, whereby natural language queries may be used to retrieve images from a store of images automatically tagged with image tags being concepts of an ontology (which may comprise a hierarchy of concepts). In various examples, a natural language query is mapped to one or more of a plurality of image tags, and the mapped query is used for retrieval. In various examples, the query is mapped by computing one or more distance measures between the query and the image tags, the distance measures being computed with respect to the ontology and/or with respect to a semantic space of words computed from a natural language corpus. In examples, the image tags may be associated with bounding boxes of objects depicted in the images, and a user may navigate the store of images by selecting a bounding box and/or an image.
MX2016014986A 2014-05-16 2015-05-14 Natural language image search. MX370916B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/279,346 US11222044B2 (en) 2014-05-16 2014-05-16 Natural language image search
PCT/US2015/030687 WO2015175736A1 (en) 2014-05-16 2015-05-14 Natural language image search

Publications (2)

Publication Number Publication Date
MX2016014986A true MX2016014986A (en) 2017-02-28
MX370916B MX370916B (en) 2020-01-09

Family

ID=53277069

Family Applications (1)

Application Number Title Priority Date Filing Date
MX2016014986A MX370916B (en) 2014-05-16 2015-05-14 Natural language image search.

Country Status (10)

Country Link
US (2) US11222044B2 (en)
EP (1) EP3143521A1 (en)
JP (1) JP6487944B2 (en)
KR (1) KR102422977B1 (en)
CN (1) CN106255968B (en)
AU (1) AU2015259118B2 (en)
CA (1) CA2947036A1 (en)
MX (1) MX370916B (en)
RU (1) RU2688271C2 (en)
WO (1) WO2015175736A1 (en)

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9710437B2 (en) * 2014-07-10 2017-07-18 International Business Machines Corporation Group tagging of documents
US9842390B2 (en) * 2015-02-06 2017-12-12 International Business Machines Corporation Automatic ground truth generation for medical image collections
US10185894B2 (en) * 2015-03-26 2019-01-22 Beijing Kuangshi Technology Co., Ltd. Picture management method and device, picture synchronization method and device
US9984068B2 (en) * 2015-09-18 2018-05-29 Mcafee, Llc Systems and methods for multilingual document filtering
US9984100B2 (en) * 2015-09-29 2018-05-29 International Business Machines Corporation Modification of images and associated text
US9881236B2 (en) 2015-12-28 2018-01-30 Google Llc Organizing images associated with a user
US10732809B2 (en) * 2015-12-30 2020-08-04 Google Llc Systems and methods for selective retention and editing of images captured by mobile image capture device
KR20180111979A (en) 2016-02-11 2018-10-11 이베이 인크. Semantic category classification
US10664719B2 (en) 2016-02-12 2020-05-26 Adobe Inc. Accurate tag relevance prediction for image search
US10235623B2 (en) * 2016-02-12 2019-03-19 Adobe Inc. Accurate tag relevance prediction for image search
US10713588B2 (en) * 2016-02-23 2020-07-14 Salesforce.Com, Inc. Data analytics systems and methods with personalized sentiment models
US20170300531A1 (en) * 2016-04-14 2017-10-19 Sap Se Tag based searching in data analytics
US10635727B2 (en) * 2016-08-16 2020-04-28 Ebay Inc. Semantic forward search indexing of publication corpus
CN106407976B (en) * 2016-08-30 2019-11-05 百度在线网络技术（北京）有限公司 The generation of image character identification model and perpendicular column character picture recognition methods and device
KR101911604B1 (en) * 2016-10-21 2018-10-25 한국과학기술원 Apparatus and method for training a learning system to detect event
US10579902B2 (en) 2016-12-21 2020-03-03 Samsung Electronics Co., Ltd. Method and electronic device for providing text-related image
KR102430567B1 (en) * 2016-12-21 2022-08-09 삼성전자주식회사 Electronic device and method for providing image associated with text
US10515289B2 (en) * 2017-01-09 2019-12-24 Qualcomm Incorporated System and method of generating a semantic representation of a target image for an image processing operation
US10405003B2 (en) * 2017-01-20 2019-09-03 Google Llc Image compression based on semantic relevance
EP3552114A4 (en) * 2017-02-08 2020-05-20 Semantic Machines, Inc. Natural language content generator
WO2018156978A1 (en) 2017-02-23 2018-08-30 Semantic Machines, Inc. Expandable dialogue system
TWI753034B (en) 2017-03-31 2022-01-21 香港商阿里巴巴集團服務有限公司 Method, device and electronic device for generating and searching feature vector
US10642875B2 (en) * 2017-04-28 2020-05-05 International Business Machines Corporation Accurate relationship extraction with word embeddings using minimal training data
US11074250B2 (en) * 2017-06-27 2021-07-27 OWOX Limted Technologies for implementing ontological models for natural language queries
EP3684463A4 (en) 2017-09-19 2021-06-23 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
JP6857586B2 (en) * 2017-10-02 2021-04-14 富士フイルム株式会社 An image extraction device, an image extraction method, an image extraction program, and a recording medium in which the program is stored.
JP6767342B2 (en) * 2017-11-15 2020-10-14 ヤフー株式会社 Search device, search method and search program
US10878473B1 (en) * 2017-11-16 2020-12-29 Amazon Technologies, Inc. Content modification
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
US11273283B2 (en) 2017-12-31 2022-03-15 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
CN108681541B (en) * 2018-01-17 2021-08-31 百度在线网络技术（北京）有限公司 Picture searching method and device and computer equipment
CN109885842B (en) * 2018-02-22 2023-06-20 谷歌有限责任公司 Processing text neural networks
KR101932264B1 (en) * 2018-03-02 2018-12-26 주식회사 머니브레인 Method, interactive ai agent system and computer readable recoding medium for providing intent determination based on analysis of a plurality of same type entity information
JP6947085B2 (en) * 2018-03-09 2021-10-13 オムロン株式会社 Electronic devices and their control methods
US11474836B2 (en) * 2018-03-13 2022-10-18 Microsoft Technology Licensing, Llc Natural language to API conversion
US10977303B2 (en) * 2018-03-21 2021-04-13 International Business Machines Corporation Image retrieval using interactive natural language dialog
US10963491B2 (en) * 2018-03-29 2021-03-30 The Boeing Company Structures maintenance mapper
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
US10699141B2 (en) * 2018-06-26 2020-06-30 Waymo Llc Phrase recognition model for autonomous vehicles
US20200019628A1 (en) * 2018-07-16 2020-01-16 Microsoft Technology Licensing, Llc Visual intent triggering for visual search
DE102018212961A1 (en) 2018-08-02 2020-02-06 Robert Bosch Gmbh Method and device for analyzing an image
US11452839B2 (en) 2018-09-14 2022-09-27 Neuroenhancement Lab, LLC System and method of improving sleep
US11698921B2 (en) 2018-09-17 2023-07-11 Ebay Inc. Search system for providing search results using query understanding and semantic binary signatures
WO2020076362A1 (en) * 2018-10-08 2020-04-16 Google Llc Digital image classification and annotation
WO2020086051A1 (en) * 2018-10-22 2020-04-30 Google Llc Finding locally prominent semantic features for navigation and geocoding
US20200159765A1 (en) * 2018-11-21 2020-05-21 Google Llc Performing image search using content labels
US11436825B2 (en) 2018-12-14 2022-09-06 Samsung Electronics Co., Ltd. Method and apparatus for determining target object in image based on interactive input
CN113330431A (en) 2019-01-25 2021-08-31 株式会社东芝 Event management device, event management program, and event management method
CN109885161A (en) * 2019-01-28 2019-06-14 温州大学 A kind of long haul travel experiencing system based on AR technology
US11494377B2 (en) * 2019-04-01 2022-11-08 Nec Corporation Multi-detector probabilistic reasoning for natural language queries
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
US11100145B2 (en) * 2019-09-11 2021-08-24 International Business Machines Corporation Dialog-based image retrieval with contextual information
RU2742602C1 (en) * 2020-04-06 2021-02-09 Самсунг Электроникс Ко., Лтд. Recognition of events on photographs with automatic selection of albums
CN111046203A (en) * 2019-12-10 2020-04-21 Oppo广东移动通信有限公司 Image retrieval method, image retrieval device, storage medium and electronic equipment
CN113282779A (en) 2020-02-19 2021-08-20 阿里巴巴集团控股有限公司 Image searching method, device and equipment
RU2737600C1 (en) * 2020-03-19 2020-12-01 Общество с ограниченной ответственностью «ИНСПЕКТОР КЛАУД» Method of collecting marked data set
KR102411301B1 (en) * 2020-04-23 2022-06-22 한국과학기술원 Apparatus and method for automatically generating domain specific image caption using semantic ontology
EP4154174A4 (en) * 2020-05-30 2024-02-21 Huawei Tech Co Ltd Systems and methods for retreiving images using natural language description
CN111741236B (en) * 2020-08-24 2021-01-01 浙江大学 Method and device for generating positioning natural image subtitles based on consensus diagram characteristic reasoning
US20230359617A1 (en) * 2020-10-01 2023-11-09 Vishal Misra Systems, methods, and media for formulating database queries from natural language text
KR20220090103A (en) * 2020-12-22 2022-06-29 주식회사 피제이팩토리 Method and apparatus for image labeling and image annotation using meuti-depth image
KR102435849B1 (en) * 2021-01-04 2022-08-25 호서대학교 산학협력단 Method for providing search result for non-text based object in documents
US20220382980A1 (en) * 2021-06-01 2022-12-01 Sap Se Similarity scoring leveraging constrained greedy matching
JP2023028921A (en) * 2021-08-20 2023-03-03 ｚｒｏ株式会社 Method and computing device for constructing semantic definition as semantic metaset
US11972525B2 (en) 2022-02-21 2024-04-30 International Business Machines Corporation Generating training data through image augmentation
KR102590632B1 (en) * 2023-03-20 2023-10-19 노경수 System for providing display service with smart condolatory money

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0594478A (en) 1991-10-02 1993-04-16 Matsushita Electric Ind Co Ltd Image data base system
JP3067966B2 (en) 1993-12-06 2000-07-24 松下電器産業株式会社 Apparatus and method for retrieving image parts
GB9904662D0 (en) 1999-03-01 1999-04-21 Canon Kk Natural language search method and apparatus
WO2004072925A2 (en) 2003-02-07 2004-08-26 The Johns Hopkins University Language learning/teaching methods, systems and software/applications programs embodying such language learning/teaching methods and systems
US7383260B2 (en) 2004-08-03 2008-06-03 International Business Machines Corporation Method and apparatus for ontology-based classification of media content
US20070269775A1 (en) 2004-09-14 2007-11-22 Dreams Of Babylon, Inc. Personalized system and method for teaching a foreign language
US20060224569A1 (en) 2005-03-31 2006-10-05 Desanto John A Natural language based search engine and methods of use therefor
WO2007007201A2 (en) 2005-04-05 2007-01-18 Ai Limited Systems and methods for semantic knowledge assessment, instruction, and acquisition
US8140559B2 (en) * 2005-06-27 2012-03-20 Make Sence, Inc. Knowledge correlation search engine
RU2345414C1 (en) 2007-08-10 2009-01-27 Общество с ограниченной ответственностью "Рекогмишн" Method of creation of system of indexing for search of objects on digital images
JP2009064213A (en) 2007-09-06 2009-03-26 Nagoya Institute Of Technology Object-oriented system for book recommendation
US8463053B1 (en) * 2008-08-08 2013-06-11 The Research Foundation Of State University Of New York Enhanced max margin learning on multimodal data mining in a multimedia database
JP4636141B2 (en) 2008-08-28 2011-02-23 ソニー株式会社 Information processing apparatus and method, and program
JP2010122931A (en) 2008-11-20 2010-06-03 Nippon Telegr & Teleph Corp <Ntt> Similar area retrieval method, similar area retrieval device, and similar area retrieval program
CN101499090A (en) 2009-02-12 2009-08-05 清华大学 Image data storage apparatus and image data storage method
US8612206B2 (en) 2009-12-08 2013-12-17 Microsoft Corporation Transliterating semitic languages including diacritics
US8478699B1 (en) * 2010-04-30 2013-07-02 Google Inc. Multiple correlation measures for measuring query similarity
US9710760B2 (en) * 2010-06-29 2017-07-18 International Business Machines Corporation Multi-facet classification scheme for cataloging of information artifacts
EP2402867B1 (en) 2010-07-02 2018-08-22 Accenture Global Services Limited A computer-implemented method, a computer program product and a computer system for image processing
US20120035905A1 (en) 2010-08-09 2012-02-09 Xerox Corporation System and method for handling multiple languages in text
US9098488B2 (en) 2011-04-03 2015-08-04 Microsoft Technology Licensing, Llc Translation of multilingual embedded phrases
RU2510935C2 (en) 2011-09-23 2014-04-10 Артем Константинович Игнатов Method of indexing and searching digital images
US9916538B2 (en) * 2012-09-15 2018-03-13 Z Advanced Computing, Inc. Method and system for feature detection
US8311973B1 (en) 2011-09-24 2012-11-13 Zadeh Lotfi A Methods and systems for applications for Z-numbers
US8873813B2 (en) 2012-09-17 2014-10-28 Z Advanced Computing, Inc. Application of Z-webs and Z-factors to analytics, search engine, learning, recognition, natural language, and other utilities
EP2608196B1 (en) 2011-12-21 2014-07-16 Institut Telecom - Telecom Paristech Combinatorial method for generating filler words
US9785639B2 (en) 2012-04-27 2017-10-10 Mobitv, Inc. Search-based navigation of media content
US9412366B2 (en) * 2012-09-18 2016-08-09 Adobe Systems Incorporated Natural language image spatial and tonal localization
US9547647B2 (en) * 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
CN103646032B (en) 2013-11-11 2017-01-04 漆桂林 A kind of based on body with the data base query method of limited natural language processing
US9858292B1 (en) * 2013-11-11 2018-01-02 Tableau Software, Inc. Systems and methods for semantic icon encoding in data visualizations

Also Published As

Publication number Publication date
MX370916B (en) 2020-01-09
EP3143521A1 (en) 2017-03-22
RU2688271C2 (en) 2019-05-21
WO2015175736A1 (en) 2015-11-19
JP6487944B2 (en) 2019-03-20
CA2947036A1 (en) 2015-11-19
RU2016144699A (en) 2018-05-15
KR20170007747A (en) 2017-01-20
US20220075806A1 (en) 2022-03-10
CN106255968B (en) 2020-03-31
AU2015259118A1 (en) 2016-10-27
US11222044B2 (en) 2022-01-11
RU2016144699A3 (en) 2018-11-26
CN106255968A (en) 2016-12-21
KR102422977B1 (en) 2022-07-19
US20150331929A1 (en) 2015-11-19
AU2015259118B2 (en) 2020-02-27
JP2017519285A (en) 2017-07-13

Similar Documents

Publication Publication Date Title
MX2016014986A (en) Natural language image search.
MX2019001576A (en) Systems and methods for contextual retrieval of electronic records.
WO2016011361A8 (en) M2m ontology management and semantics interoperability
GB2541581A (en) Retrieving multi-generational stored data in a dispersed storage network
CO2017007032A2 (en) Updating language understanding classifier models for a personal digital assistant based on mass outsourcing
GB2545548A (en) Improved method, system and software for searching, identifying, retrieving and presenting electronic documents
WO2018014109A8 (en) System and method for analyzing and searching for features associated with objects
MX370232B (en) Learning and using contextual content retrieval rules for query disambiguation.
MX2017001178A (en) Ranking external content on online social networks.
JP2017519285A5 (en)
WO2016111710A8 (en) Suggested keywords for searching news-related content on online social networks
GB2542053A (en) Automatically generating a semantic mapping for a relational database
IN2013CH06086A (en)
CL2015002728A1 (en) A method to provide a language learning environment
EA201692294A1 (en) METHOD AND DEVICE FOR DEVELOPING THE PROPOSED ONTOLOGY
CL2013000577A1 (en) Method and system for searching the contents of a user device comprising receiving multiple data objects from a user device, analyzing the search data, storing data, searching the data, generating results, and displaying the search results
RU2014125500A (en) EDITING CONTENT ELECTRONIC DOCUMENT
WO2016106242A8 (en) Identifying join relationships based on transactional access patterns
MX2019011597A (en) Systems and methods for query and index optimization for retrieving data in instances of a formulation data structure from a database.
WO2014120851A3 (en) Method and system for visualizing documents
MX2015014919A (en) Variable search query vertical access.
JP2014149848A5 (en)
MX2015016834A (en) Multimodal search response.
GB2545108A (en) Saving and retrieving locations of objects
MX2017003758A (en) Unified search on a personal computing device.

Legal Events

Date Code Title Description
FG Grant or registration