SG11202001737SA - Image question answering method, apparatus and system, and storage medium - Google Patents

Image question answering method, apparatus and system, and storage medium

Info

Publication number
SG11202001737SA
SG11202001737SA SG11202001737SA SG11202001737SA SG11202001737SA SG 11202001737S A SG11202001737S A SG 11202001737SA SG 11202001737S A SG11202001737S A SG 11202001737SA SG 11202001737S A SG11202001737S A SG 11202001737SA SG 11202001737S A SG11202001737S A SG 11202001737SA
Authority
SG
Singapore
Prior art keywords
storage medium
question answering
answering method
image question
image
Prior art date
Application number
SG11202001737SA
Inventor
Pan Lu
Hongsheng Li
Xiaogang Wang
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202001737SA publication Critical patent/SG11202001737SA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/279Recognition of textual entities
    • G06F40/284Lexical analysis, e.g. tokenisation or collocates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
SG11202001737SA 2017-10-31 2018-10-30 Image question answering method, apparatus and system, and storage medium SG11202001737SA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711049294.7A CN108228703B (en) 2017-10-31 2017-10-31 Image question-answering method, device, system and storage medium
PCT/CN2018/112735 WO2019085905A1 (en) 2017-10-31 2018-10-30 Image question answering method, device and system, and storage medium

Publications (1)

Publication Number Publication Date
SG11202001737SA true SG11202001737SA (en) 2020-03-30

Family

ID=62654947

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202001737SA SG11202001737SA (en) 2017-10-31 2018-10-30 Image question answering method, apparatus and system, and storage medium

Country Status (5)

Country Link
US (1) US11222236B2 (en)
JP (1) JP6916383B2 (en)
CN (1) CN108228703B (en)
SG (1) SG11202001737SA (en)
WO (1) WO2019085905A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860847A (en) * 2021-01-19 2021-05-28 中国科学院自动化研究所 Video question-answer interaction method and system

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108228703B (en) * 2017-10-31 2020-05-08 北京市商汤科技开发有限公司 Image question-answering method, device, system and storage medium
CN108984730A (en) * 2018-07-12 2018-12-11 三星电子(中国)研发中心 A kind of searching method and search equipment
CN109086779B (en) * 2018-07-28 2021-11-09 天津大学 Attention target identification method based on convolutional neural network
CN109146786A (en) * 2018-08-07 2019-01-04 北京市商汤科技开发有限公司 Scene chart generation method and device, electronic equipment and storage medium
CN109447943B (en) * 2018-09-21 2020-08-14 中国科学院深圳先进技术研究院 Target detection method, system and terminal equipment
CN109408627B (en) * 2018-11-15 2021-03-02 众安信息技术服务有限公司 Question-answering method and system fusing convolutional neural network and cyclic neural network
CN109544524B (en) * 2018-11-15 2023-05-23 中共中央办公厅电子科技学院 Attention mechanism-based multi-attribute image aesthetic evaluation system
EP3896647A4 (en) * 2018-12-14 2022-01-26 FUJIFILM Corporation Mini-batch learning device, operating program for mini-batch learning device, operating method for mini-batch learning device, and image processing device
CN109871457A (en) * 2019-01-30 2019-06-11 北京百度网讯科技有限公司 Data processing method, device, electronic equipment and storage medium based on image
CN109858555B (en) 2019-02-12 2022-05-17 北京百度网讯科技有限公司 Image-based data processing method, device, equipment and readable storage medium
CN110134774B (en) * 2019-04-29 2021-02-09 华中科技大学 Image visual question-answering model, method and system based on attention decision
CN110263912B (en) * 2019-05-14 2021-02-26 杭州电子科技大学 Image question-answering method based on multi-target association depth reasoning
CN110175231B (en) * 2019-05-31 2022-03-15 北京市商汤科技开发有限公司 Visual question answering method, device and equipment
CN110287814A (en) * 2019-06-04 2019-09-27 北方工业大学 Visual question-answering method based on image target characteristics and multilayer attention mechanism
CN110348535B (en) * 2019-07-17 2022-05-31 北京金山数字娱乐科技有限公司 Visual question-answering model training method and device
CN113032535A (en) * 2019-12-24 2021-06-25 中国移动通信集团浙江有限公司 Visual question and answer method and device for assisting visually impaired people, computing equipment and storage medium
CN111666882B (en) * 2020-06-08 2023-04-25 武汉唯理科技有限公司 Method for extracting answers of handwriting test questions
KR20220018467A (en) * 2020-08-01 2022-02-15 센스타임 인터내셔널 피티이. 리미티드. Target object recognition method, device and system
CN112084901B (en) * 2020-08-26 2024-03-01 长沙理工大学 GCAM-based high-resolution SAR image airport runway area automatic detection method and system
JP2022082238A (en) * 2020-11-20 2022-06-01 富士通株式会社 Machine learning program, machine learning method, and output device
CN113010656B (en) * 2021-03-18 2022-12-20 广东工业大学 Visual question-answering method based on multi-mode fusion and structural control
CN113066065B (en) * 2021-03-29 2023-08-04 中国科学院上海高等研究院 No-reference image quality detection method, system, terminal and medium
CN113239784B (en) * 2021-05-11 2022-09-30 广西科学院 Pedestrian re-identification system and method based on space sequence feature learning
CN113222026B (en) * 2021-05-18 2022-11-11 合肥工业大学 Method, system and server for visual question answering of locomotive depot scene
CN113033721B (en) * 2021-05-31 2021-09-28 北京世纪好未来教育科技有限公司 Title correction method and computer storage medium
CN113536952B (en) * 2021-06-22 2023-04-21 电子科技大学 Video question-answering method based on attention network of motion capture
CN113793187A (en) * 2021-09-24 2021-12-14 福州大学 Click rate prediction method and system based on example weight balance and double attention
CN114417044B (en) * 2022-01-19 2023-05-26 中国科学院空天信息创新研究院 Image question and answer method and device
CN114972944B (en) * 2022-06-16 2023-10-27 中国电信股份有限公司 Training method and device for visual question-answering model, question-answering method, medium and equipment
CN115129848B (en) * 2022-09-02 2023-02-28 苏州浪潮智能科技有限公司 Method, device, equipment and medium for processing visual question-answering task

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9082040B2 (en) * 2011-05-13 2015-07-14 Microsoft Technology Licensing, Llc Identifying visual contextual synonyms
US20160350653A1 (en) * 2015-06-01 2016-12-01 Salesforce.Com, Inc. Dynamic Memory Network
US9965705B2 (en) * 2015-11-03 2018-05-08 Baidu Usa Llc Systems and methods for attention-based configurable convolutional neural networks (ABC-CNN) for visual question answering
CN105574133A (en) * 2015-12-15 2016-05-11 苏州贝多环保技术有限公司 Multi-mode intelligent question answering system and method
US10997233B2 (en) * 2016-04-12 2021-05-04 Microsoft Technology Licensing, Llc Multi-stage image querying
US10198671B1 (en) * 2016-11-10 2019-02-05 Snap Inc. Dense captioning with joint interference and visual context
CN107256228A (en) * 2017-05-02 2017-10-17 清华大学 Answer selection system and method based on structuring notice mechanism
CN108228703B (en) * 2017-10-31 2020-05-08 北京市商汤科技开发有限公司 Image question-answering method, device, system and storage medium
US10754851B2 (en) * 2017-12-22 2020-08-25 Adobe Inc. Question answering for data visualizations

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860847A (en) * 2021-01-19 2021-05-28 中国科学院自动化研究所 Video question-answer interaction method and system

Also Published As

Publication number Publication date
US11222236B2 (en) 2022-01-11
JP6916383B2 (en) 2021-08-11
CN108228703B (en) 2020-05-08
US20200193228A1 (en) 2020-06-18
JP2020532017A (en) 2020-11-05
CN108228703A (en) 2018-06-29
WO2019085905A1 (en) 2019-05-09

Similar Documents

Publication Publication Date Title
SG11202001737SA (en) Image question answering method, apparatus and system, and storage medium
ZA201904888B (en) Blockchain system and data storage method and apparatus
SG11202011600QA (en) Image processing method and apparatus, image device, and storage medium
EP3822918A4 (en) Image rendering method and apparatus, and storage medium
EP3819822A4 (en) Image identification method and apparatus, system, and storage medium
EP3435677A4 (en) Video coding method and apparatus, device, and storage medium
EP3713212A4 (en) Image capture method, apparatus, terminal, and storage medium
EP3335412A4 (en) Method, storage medium and electronic apparatus for providing service associated with image
GB2582197B (en) Image capturing apparatus, method of controlling the same, and storage medium
SG11202112379VA (en) Image processing method, device thereof, equipment, and storage medium
GB2591704B (en) Print system, print apparatus, control method, and storage medium
SG11202006333VA (en) Image processing method and apparatus, image device, and storage medium
GB2570792B (en) Image capturing apparatus, method of controlling the same, and storage medium
GB202100237D0 (en) Video publishing method and apparatus, device, and storage medium
SG11202102637YA (en) Video processing method and apparatus, device, and storage medium
EP3684062A4 (en) Video processing method and apparatus, and storage medium
SG10201906334VA (en) Printing apparatus, printing method, and storage medium
EP3839878A4 (en) Image denoising method and apparatus, and device and storage medium
EP3641310A4 (en) Video encoding method, apparatus, device, and storage medium
SG11202104071TA (en) Method and device for processing image, and storage medium
EP3734974A4 (en) Method and apparatus for processing video bitstream, network device, and readable storage medium
SG11202107121VA (en) Method and apparatus for processing images, device and storage medium
SG11202104182YA (en) Method and device for processing image, and storage medium
GB201609331D0 (en) Information processing apparatus, method for controlling information processing apparatus, image processing system and storage medium
PL3376439T3 (en) Method, apparatus for image analyzation, and non-transitory computer-readable storage medium