EP4154174A4 - Systems and methods for retreiving images using natural language description - Google Patents

Systems and methods for retreiving images using natural language description

Info

Publication number
EP4154174A4
EP4154174A4 EP20856170.4A EP20856170A EP4154174A4 EP 4154174 A4 EP4154174 A4 EP 4154174A4 EP 20856170 A EP20856170 A EP 20856170A EP 4154174 A4 EP4154174 A4 EP 4154174A4
Authority
EP
European Patent Office
Prior art keywords
retreiving
images
systems
methods
natural language
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20856170.4A
Other languages
German (de)
French (fr)
Other versions
EP4154174A1 (en
Inventor
Ning Yan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of EP4154174A1 publication Critical patent/EP4154174A1/en
Publication of EP4154174A4 publication Critical patent/EP4154174A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using shape and object relationship
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9032—Query formulation
    • G06F16/90332—Natural language query formulation or dialogue systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2323—Non-hierarchical techniques based on graph theory, e.g. minimum spanning trees [MST] or graph cuts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/768—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using context analysis, e.g. recognition aided by known co-occurring patterns
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/19—Recognition using electronic means
    • G06V30/196—Recognition using electronic means using sequential comparisons of the image signals with a plurality of references
    • G06V30/1983—Syntactic or structural pattern recognition, e.g. symbolic string recognition
    • G06V30/1988—Graph matching
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/36—Creation of semantic tools, e.g. ontology or thesauri
    • G06F16/367—Ontology
EP20856170.4A 2020-05-30 2020-10-01 Systems and methods for retreiving images using natural language description Pending EP4154174A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202063032569P 2020-05-30 2020-05-30
PCT/US2020/053795 WO2021042084A1 (en) 2020-05-30 2020-10-01 Systems and methods for retreiving images using natural language description

Publications (2)

Publication Number Publication Date
EP4154174A1 EP4154174A1 (en) 2023-03-29
EP4154174A4 true EP4154174A4 (en) 2024-02-21

Family

ID=74685268

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20856170.4A Pending EP4154174A4 (en) 2020-05-30 2020-10-01 Systems and methods for retreiving images using natural language description

Country Status (3)

Country Link
EP (1) EP4154174A4 (en)
CN (1) CN115885275A (en)
WO (1) WO2021042084A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230089148A1 (en) * 2021-09-17 2023-03-23 Robert Bosch Gmbh Systems and methods for interactive image scene graph pattern search and analysis

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7974978B2 (en) * 2004-04-30 2011-07-05 International Business Machines Corporation System and method for graph indexing
US11222044B2 (en) * 2014-05-16 2022-01-11 Microsoft Technology Licensing, Llc Natural language image search
US10262062B2 (en) * 2015-12-21 2019-04-16 Adobe Inc. Natural language system question classifier, semantic representations, and logical form templates
US10909401B2 (en) * 2018-05-29 2021-02-02 Sri International Attention-based explanations for artificial intelligence behavior

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LIU CHUNXIAO ET AL: "Graph Structured Network for Image-Text Matching", ARXIV.ORG, 1 April 2020 (2020-04-01), pages 1 - 10, XP093115152, Retrieved from the Internet <URL:https://arxiv.org/pdf/2004.00277.pdf> [retrieved on 20231222] *
See also references of WO2021042084A1 *
WANG SIJIN ET AL: "Cross-modal Scene Graph Matching for Relationship-aware Image-Text Retrieval", 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), IEEE, 1 March 2020 (2020-03-01), pages 1497 - 1506, XP033771269, DOI: 10.1109/WACV45572.2020.9093614 *

Also Published As

Publication number Publication date
WO2021042084A1 (en) 2021-03-04
EP4154174A1 (en) 2023-03-29
CN115885275A (en) 2023-03-31

Similar Documents

Publication Publication Date Title
EP3888005A4 (en) System and method for converting image data into a natural language description
GB202012332D0 (en) System and method for language translation
GB2582315B (en) Method and system for generating an image
EP4150523A4 (en) Systems and methods for retreiving videos using natural language description
GB201808056D0 (en) Device and method for natural language processing
EP3885966A4 (en) Method and device for generating natural language description information
GB202018284D0 (en) Methods and systems for video translation
EP3984022A4 (en) System and method for natural language understanding
EP4233305A4 (en) Systems and methods for image acquisition
SG11202008813PA (en) Image recognition system and method
SG10201906401VA (en) Object recognition system and method using simulated object images
GB202015427D0 (en) Magnetoencephalography method and system
GB202014825D0 (en) Blockchain-based system and method
EP4154174A4 (en) Systems and methods for retreiving images using natural language description
GB2610953B (en) System and method for dimensioning objects
EP3924841A4 (en) Electronic device for generating natural language response and method thereof
GB202205437D0 (en) Image projection method and system
GB2593189B (en) Image generation system and method
GB2592604B (en) Image generation system and method
IL279531A (en) Method and system for teaching language via multimedia content
EP4154172A4 (en) Systems and methods for image capture
GB202017704D0 (en) Latency mitigation system and method
GB202000063D0 (en) Method and system for geotracking objects
IL274559A (en) System and method for few-shot learning
EP4218261A4 (en) System and method for aiding hearing

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20221222

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06K0009620000

Ipc: G06F0016583000

A4 Supplementary search report drawn up and despatched

Effective date: 20240122

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 18/2323 20230101ALI20240116BHEP

Ipc: G06F 18/2413 20230101ALI20240116BHEP

Ipc: G06V 10/70 20220101ALI20240116BHEP

Ipc: G06V 20/00 20220101ALI20240116BHEP

Ipc: G06V 30/196 20220101ALI20240116BHEP

Ipc: G06F 16/9032 20190101ALI20240116BHEP

Ipc: G06F 16/583 20190101AFI20240116BHEP