GB201615373D0 - Structured knowledge modeling, extraction and localization from images - Google Patents

Structured knowledge modeling, extraction and localization from images

Info

Publication number
GB201615373D0
GB201615373D0 GBGB1615373.6A GB201615373A GB201615373D0 GB 201615373 D0 GB201615373 D0 GB 201615373D0 GB 201615373 A GB201615373 A GB 201615373A GB 201615373 D0 GB201615373 D0 GB 201615373D0
Authority
GB
United Kingdom
Prior art keywords
localization
extraction
images
structured knowledge
knowledge modeling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GBGB1615373.6A
Other versions
GB2544379A (en
GB2544379B (en
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Adobe Inc
Original Assignee
Adobe Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/978,421 external-priority patent/US10460033B2/en
Application filed by Adobe Systems Inc filed Critical Adobe Systems Inc
Publication of GB201615373D0 publication Critical patent/GB201615373D0/en
Publication of GB2544379A publication Critical patent/GB2544379A/en
Application granted granted Critical
Publication of GB2544379B publication Critical patent/GB2544379B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G06F18/24137—Distances to cluster centroïds
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/29—Graphical models, e.g. Bayesian networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/042—Knowledge-based neural networks; Logical representations of neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/02—Knowledge representation; Symbolic representation
    • G06N5/022—Knowledge engineering; Knowledge acquisition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G06V10/422—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation for representing the structure of the pattern or shape of an object therefor
    • G06V10/424—Syntactic representation, e.g. by using alphabets or grammars
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/7715—Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/70—Labelling scene content, e.g. deriving syntactic or semantic representations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Library & Information Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
GB1615373.6A 2015-11-11 2016-09-09 Structured knowledge modeling, extraction and localization from images Active GB2544379B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562254147P 2015-11-11 2015-11-11
US14/978,421 US10460033B2 (en) 2015-11-11 2015-12-22 Structured knowledge modeling, extraction and localization from images

Publications (3)

Publication Number Publication Date
GB201615373D0 true GB201615373D0 (en) 2016-10-26
GB2544379A GB2544379A (en) 2017-05-17
GB2544379B GB2544379B (en) 2019-09-11

Family

ID=57234418

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1615373.6A Active GB2544379B (en) 2015-11-11 2016-09-09 Structured knowledge modeling, extraction and localization from images

Country Status (3)

Country Link
CN (1) CN106682060B (en)
DE (1) DE102016010909A1 (en)
GB (1) GB2544379B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111950293A (en) * 2020-06-24 2020-11-17 北京百度网讯科技有限公司 Semantic representation model generation method and device, electronic equipment and storage medium
CN113128231A (en) * 2021-04-25 2021-07-16 深圳市慧择时代科技有限公司 Data quality inspection method and device, storage medium and electronic equipment
CN113407708A (en) * 2020-03-17 2021-09-17 阿里巴巴集团控股有限公司 Feed generation method, information recommendation method, device and equipment
CN116188618A (en) * 2023-04-24 2023-05-30 清华大学 Image generation method and device based on structured semantic graph

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11094058B2 (en) 2015-08-14 2021-08-17 Elucid Bioimaging Inc. Systems and method for computer-aided phenotyping (CAP) using radiologic images
US10535138B2 (en) * 2017-11-21 2020-01-14 Zoox, Inc. Sensor data segmentation
CN108363879A (en) * 2018-02-27 2018-08-03 杭州深绘智能科技有限公司 Data processing method suitable for image of clothing
US10915577B2 (en) * 2018-03-22 2021-02-09 Adobe Inc. Constructing enterprise-specific knowledge graphs
JP7095377B2 (en) * 2018-04-17 2022-07-05 富士フイルムビジネスイノベーション株式会社 Information processing equipment and information processing programs
JP7113916B2 (en) * 2018-05-27 2022-08-05 エルシド バイオイメージング インコーポレイテッド Methods and systems for utilizing quantitative imaging
CN109102024B (en) * 2018-08-14 2021-08-31 中山大学 Hierarchical semantic embedded model for fine object recognition and implementation method thereof
US20200074301A1 (en) * 2018-09-04 2020-03-05 Beijing Jingdong Shangke Information Technology Co., Ltd. End-to-end structure-aware convolutional networks for knowledge base completion
WO2021042763A1 (en) * 2019-09-03 2021-03-11 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image searches based on word vectors and image vectors
CN111104973B (en) * 2019-12-06 2022-02-15 天津大学 Knowledge attention-based fine-grained image classification method
CN112417287B (en) * 2020-11-24 2024-07-16 乐聚(深圳)机器人技术有限公司 Building block searching method, model training method, device, equipment and storage medium
CN112507706B (en) * 2020-12-21 2023-01-31 北京百度网讯科技有限公司 Training method and device for knowledge pre-training model and electronic equipment
CN113609335B (en) * 2021-08-12 2023-02-03 北京滴普科技有限公司 Target object searching method, system, electronic equipment and storage medium
CN114022735B (en) * 2021-11-09 2023-06-23 北京有竹居网络技术有限公司 Training method, device, equipment and medium for visual language pre-training model

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050062624A (en) * 2002-10-18 2005-06-23 도꾸리쯔교세이호징 가가꾸 기쥬쯔 신꼬 기꼬 Learning/thinking machine and learning/thinking method based on structured knowledge, computer system, and information generation method
JP2004152063A (en) * 2002-10-31 2004-05-27 Nec Corp Structuring method, structuring device and structuring program of multimedia contents, and providing method thereof
CN100437582C (en) * 2006-10-17 2008-11-26 浙江大学 Image content semanteme marking method
CN102542067A (en) * 2012-01-06 2012-07-04 上海交通大学 Automatic image semantic annotation method based on scale learning and correlated label dissemination
US20140328570A1 (en) * 2013-01-09 2014-11-06 Sri International Identifying, describing, and sharing salient events in images and videos
US9105068B2 (en) * 2012-11-12 2015-08-11 Facebook, Inc. Grammar model for structured search queries
US20150178786A1 (en) * 2012-12-25 2015-06-25 Catharina A.J. Claessens Pictollage: Image-Based Contextual Advertising Through Programmatically Composed Collages
US9330296B2 (en) * 2013-03-15 2016-05-03 Sri International Recognizing entity interactions in visual media
CN103632147A (en) * 2013-12-10 2014-03-12 公安部第三研究所 System and method for implementing standardized semantic description of facial features
CN103699663B (en) * 2013-12-27 2017-02-08 中国科学院自动化研究所 Hot event mining method based on large-scale knowledge base
CN104933029A (en) * 2015-06-23 2015-09-23 天津大学 Text image joint semantics analysis method based on probability theme model

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113407708A (en) * 2020-03-17 2021-09-17 阿里巴巴集团控股有限公司 Feed generation method, information recommendation method, device and equipment
CN111950293A (en) * 2020-06-24 2020-11-17 北京百度网讯科技有限公司 Semantic representation model generation method and device, electronic equipment and storage medium
CN111950293B (en) * 2020-06-24 2023-06-23 北京百度网讯科技有限公司 Semantic representation model generation method and device, electronic equipment and storage medium
CN113128231A (en) * 2021-04-25 2021-07-16 深圳市慧择时代科技有限公司 Data quality inspection method and device, storage medium and electronic equipment
CN116188618A (en) * 2023-04-24 2023-05-30 清华大学 Image generation method and device based on structured semantic graph
CN116188618B (en) * 2023-04-24 2023-08-15 清华大学 Image generation method and device based on structured semantic graph

Also Published As

Publication number Publication date
GB2544379A (en) 2017-05-17
DE102016010909A1 (en) 2017-05-11
GB2544379B (en) 2019-09-11
CN106682060A (en) 2017-05-17
CN106682060B (en) 2022-03-15

Similar Documents

Publication Publication Date Title
GB201615373D0 (en) Structured knowledge modeling, extraction and localization from images
HK1219692A1 (en) Game system
SG11201609892RA (en) Transport-container system and method
HK1219917A1 (en) Game system
SG11201607508TA (en) Evaluation system and method
SG10201405182WA (en) Method and system
PT3260813T (en) Ranging system and ranging method
SG11201607924TA (en) Figure, platform, and figure system
GB201407711D0 (en) Communnication system and related method
SG10201510702RA (en) Photogrammetry system and photogrammetry method
GB2544853B (en) Structured knowledge modeling and extraction from images
GB201421814D0 (en) System and method
SG11201605105UA (en) Disease detection system and disease detection method
GB201415586D0 (en) Game system
EP3211561C0 (en) Liver boundary identification method, and system
IL248733B (en) Imaging system, method, and applications
GB2587113B (en) System and method
GB201510480D0 (en) System and method
HK1210840A1 (en) Multi-person gaming system
GB201515115D0 (en) System and method
GB201803529D0 (en) Radio-station-recommendation system and method
GB201417330D0 (en) Simulation system
GB201523060D0 (en) Speed-limit-compliance system and method
GB201404184D0 (en) Method and system
PL3251063T3 (en) Carpooling system