JP2021524623A5 - - Google Patents
Info
- Publication number
- JP2021524623A5 JP2021524623A5 JP2020564520A JP2020564520A JP2021524623A5 JP 2021524623 A5 JP2021524623 A5 JP 2021524623A5 JP 2020564520 A JP2020564520 A JP 2020564520A JP 2020564520 A JP2020564520 A JP 2020564520A JP 2021524623 A5 JP2021524623 A5 JP 2021524623A5
- Authority
- JP
- Japan
- Prior art keywords
- word
- context
- question
- distribution
- encoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862673606P | 2018-05-18 | 2018-05-18 | |
| US62/673,606 | 2018-05-18 | ||
| US16/006,691 US11600194B2 (en) | 2018-05-18 | 2018-06-12 | Multitask learning as question answering |
| US16/006,691 | 2018-06-12 | ||
| PCT/US2019/032207 WO2019222206A1 (en) | 2018-05-18 | 2019-05-14 | Multitask learning as question answering |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2021524623A JP2021524623A (ja) | 2021-09-13 |
| JP2021524623A5 true JP2021524623A5 (https=) | 2022-05-19 |
| JP7408574B2 JP7408574B2 (ja) | 2024-01-05 |
Family
ID=68532658
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2020564520A Active JP7408574B2 (ja) | 2018-05-18 | 2019-05-14 | 質問応答としてのマルチタスク学習 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US11600194B2 (https=) |
| EP (1) | EP3794469A1 (https=) |
| JP (1) | JP7408574B2 (https=) |
| CA (1) | CA3097224C (https=) |
| WO (1) | WO2019222206A1 (https=) |
Families Citing this family (64)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10817650B2 (en) | 2017-05-19 | 2020-10-27 | Salesforce.Com, Inc. | Natural language processing using context specific word vectors |
| EP3824606A1 (en) * | 2018-07-20 | 2021-05-26 | Nokia Technologies Oy | Learning in communication systems by updating of parameters in a receiving algorithm |
| US10929392B1 (en) * | 2018-11-16 | 2021-02-23 | Amazon Technologies, Inc. | Artificial intelligence system for automated generation of realistic question and answer pairs |
| US11423068B2 (en) * | 2018-11-27 | 2022-08-23 | Google Llc | Canonicalizing search queries to natural language questions |
| WO2020118422A1 (en) * | 2018-12-11 | 2020-06-18 | Sinitic Inc. | System and method for structuring chat history using machine-learning-based natural language processing |
| US11822897B2 (en) | 2018-12-11 | 2023-11-21 | Salesforce.Com, Inc. | Systems and methods for structured text translation with tag alignment |
| US10963652B2 (en) | 2018-12-11 | 2021-03-30 | Salesforce.Com, Inc. | Structured text translation |
| US12182188B2 (en) * | 2018-12-31 | 2024-12-31 | Entigenlogic Llc | Generating a subjective query response utilizing a knowledge database |
| US11423221B2 (en) * | 2018-12-31 | 2022-08-23 | Entigenlogic Llc | Generating a query response utilizing a knowledge database |
| US10909180B2 (en) * | 2019-01-11 | 2021-02-02 | International Business Machines Corporation | Dynamic query processing and document retrieval |
| EP4327214A1 (en) * | 2019-02-18 | 2024-02-28 | David Nahamoo | Intelligent document system |
| JP7358748B2 (ja) * | 2019-03-01 | 2023-10-11 | 富士通株式会社 | 学習方法、抽出方法、学習プログラムおよび情報処理装置 |
| US11003867B2 (en) | 2019-03-04 | 2021-05-11 | Salesforce.Com, Inc. | Cross-lingual regularization for multilingual generalization |
| CN114041145A (zh) * | 2019-08-02 | 2022-02-11 | 谷歌有限责任公司 | 用于生成和提供建议动作的系统和方法 |
| KR20210043995A (ko) * | 2019-10-14 | 2021-04-22 | 삼성전자주식회사 | 모델 학습 방법 및 장치, 및 시퀀스 인식 방법 |
| US11347708B2 (en) | 2019-11-11 | 2022-05-31 | Salesforce.Com, Inc. | System and method for unsupervised density based table structure identification |
| US11481636B2 (en) | 2019-11-18 | 2022-10-25 | Salesforce.Com, Inc. | Systems and methods for out-of-distribution classification |
| US11922303B2 (en) | 2019-11-18 | 2024-03-05 | Salesforce, Inc. | Systems and methods for distilled BERT-based training model for text classification |
| US11640505B2 (en) | 2019-12-09 | 2023-05-02 | Salesforce.Com, Inc. | Systems and methods for explicit memory tracker with coarse-to-fine reasoning in conversational machine reading |
| US12086539B2 (en) | 2019-12-09 | 2024-09-10 | Salesforce, Inc. | System and method for natural language processing using neural network with cross-task training |
| US11416688B2 (en) | 2019-12-09 | 2022-08-16 | Salesforce.Com, Inc. | Learning dialogue state tracking with limited labeled data |
| US11487999B2 (en) | 2019-12-09 | 2022-11-01 | Salesforce.Com, Inc. | Spatial-temporal reasoning through pretrained language models for video-grounded dialogues |
| US11256754B2 (en) | 2019-12-09 | 2022-02-22 | Salesforce.Com, Inc. | Systems and methods for generating natural language processing training samples with inflectional perturbations |
| US11573957B2 (en) | 2019-12-09 | 2023-02-07 | Salesforce.Com, Inc. | Natural language processing engine for translating questions into executable database queries |
| US11669745B2 (en) | 2020-01-13 | 2023-06-06 | Salesforce.Com, Inc. | Proposal learning for semi-supervised object detection |
| CN111291550B (zh) * | 2020-01-17 | 2021-09-03 | 北方工业大学 | 一种中文实体提取方法及装置 |
| US11562147B2 (en) | 2020-01-23 | 2023-01-24 | Salesforce.Com, Inc. | Unified vision and dialogue transformer with BERT |
| CN111310449B (zh) | 2020-01-23 | 2021-01-26 | 北京百度网讯科技有限公司 | 基于语义表示的文本生成方法和装置 |
| US20210249105A1 (en) | 2020-02-06 | 2021-08-12 | Salesforce.Com, Inc. | Systems and methods for language modeling of protein engineering |
| CN111324717B (zh) * | 2020-02-24 | 2023-06-27 | 武汉大学 | 一种面向开放域问答的基于机器阅读理解的答案获取方法及系统 |
| US11921711B2 (en) * | 2020-03-06 | 2024-03-05 | Alibaba Group Holding Limited | Trained sequence-to-sequence conversion of database queries |
| US11263476B2 (en) | 2020-03-19 | 2022-03-01 | Salesforce.Com, Inc. | Unsupervised representation learning with contrastive prototypes |
| US11328731B2 (en) | 2020-04-08 | 2022-05-10 | Salesforce.Com, Inc. | Phone-based sub-word units for end-to-end speech recognition |
| CN111651992B (zh) * | 2020-04-24 | 2024-11-29 | 平安科技（深圳）有限公司 | 命名实体标注方法、装置、计算机设备和存储介质 |
| US12299982B2 (en) | 2020-05-12 | 2025-05-13 | Salesforce, Inc. | Systems and methods for partially supervised online action detection in untrimmed videos |
| US11669699B2 (en) | 2020-05-31 | 2023-06-06 | Saleforce.com, inc. | Systems and methods for composed variational natural language generation |
| US12265909B2 (en) | 2020-06-01 | 2025-04-01 | Salesforce, Inc. | Systems and methods for a k-nearest neighbor based mechanism of natural language processing models |
| US12182509B2 (en) * | 2020-06-01 | 2024-12-31 | Google Llc | Processing large-scale textual inputs using neural networks |
| US11720559B2 (en) | 2020-06-02 | 2023-08-08 | Salesforce.Com, Inc. | Bridging textual and tabular data for cross domain text-to-query language semantic parsing with a pre-trained transformer language encoder and anchor text |
| US12530560B2 (en) | 2020-06-03 | 2026-01-20 | Salesforce, Inc. | System and method for differential architecture search for neural networks |
| US11875233B2 (en) * | 2020-07-10 | 2024-01-16 | Microsoft Technology Licensing, Llc | Automatic recognition of entities related to cloud incidents |
| US20220050877A1 (en) | 2020-08-14 | 2022-02-17 | Salesforce.Com, Inc. | Systems and methods for query autocompletion |
| US11934952B2 (en) | 2020-08-21 | 2024-03-19 | Salesforce, Inc. | Systems and methods for natural language processing using joint energy-based models |
| US11934781B2 (en) | 2020-08-28 | 2024-03-19 | Salesforce, Inc. | Systems and methods for controllable text summarization |
| US11995111B2 (en) * | 2020-11-13 | 2024-05-28 | Tencent America LLC | Efficient and compact text matching system for sentence pairs |
| US11829442B2 (en) | 2020-11-16 | 2023-11-28 | Salesforce.Com, Inc. | Methods and systems for efficient batch active learning of a deep neural network |
| CN112271001B (zh) * | 2020-11-17 | 2022-08-16 | 中山大学 | 一种应用异构图神经网络的医疗咨询对话系统及方法 |
| CN114610741B (zh) * | 2020-12-09 | 2026-03-27 | 阿里巴巴集团控股有限公司 | 对话方法及系统 |
| CN115129829B (zh) * | 2021-03-26 | 2026-04-24 | 阿里巴巴创新公司 | 问答计算方法、服务器及存储介质 |
| CN113033189B (zh) * | 2021-04-08 | 2022-07-12 | 北京理工大学 | 一种基于注意力分散的长短期记忆网络的语义编码方法 |
| CA3213522A1 (en) | 2021-05-21 | 2022-11-24 | Noam Shazeer | Machine-learned language models which generate intermediate textual analysis in service of contextual text generation |
| CN113901210B (zh) * | 2021-09-15 | 2022-12-13 | 昆明理工大学 | 利用局部多头注意力机制融合词-音节对的泰文和缅甸文词性标注方法 |
| CN115967504B (zh) * | 2021-10-08 | 2026-02-03 | 中兴通讯股份有限公司 | 加密恶意流量检测方法、装置、存储介质及电子装置 |
| CN114139532B (zh) * | 2022-01-30 | 2022-04-19 | 北京语言大学 | 一种基于多任务框架进行简单释义生成的方法与系统 |
| US12164550B2 (en) * | 2022-02-16 | 2024-12-10 | Adobe Inc. | Training a model for performing abstractive text summarization |
| US20230289836A1 (en) * | 2022-03-11 | 2023-09-14 | Tredence Inc. | Multi-channel feedback analytics for presentation generation |
| CN114925708B (zh) * | 2022-05-24 | 2024-08-09 | 昆明理工大学 | 融合无监督依存句法的泰汉神经机器翻译方法 |
| CN114861730B (zh) * | 2022-05-25 | 2023-04-07 | 电子科技大学 | 基于多任务学习的干扰认知方法 |
| US12499990B2 (en) * | 2022-05-26 | 2025-12-16 | Verily Life Sciences Llc | Combined vision and language learning models for automated medical reports generation |
| CN115017286B (zh) * | 2022-06-09 | 2023-04-07 | 北京邮电大学 | 基于检索的多轮对话系统和方法 |
| CN115408603B (zh) * | 2022-07-27 | 2026-04-21 | 闽江学院 | 一种基于多头自注意力机制的在线问答社区专家推荐方法 |
| CN115392260B (zh) * | 2022-10-31 | 2023-04-07 | 暨南大学 | 一种面向特定目标的社交媒体推文情感分析方法 |
| CN119719277B (zh) * | 2024-11-27 | 2025-12-12 | 中国地质调查局油气资源调查中心 | 一种用于油气地质调查的专业智能问答系统及方法 |
| CN119692472B (zh) * | 2024-12-03 | 2026-02-06 | 北京中科闻歌科技股份有限公司 | 多模态图表问答大模型构建方法、电子设备和存储介质 |
Family Cites Families (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011033460A1 (en) * | 2009-09-17 | 2011-03-24 | Time To Know Establishment | Device, system, and method of educational content generation |
| US8977041B2 (en) * | 2012-08-22 | 2015-03-10 | Canon Kabushiki Kaisha | Systems and methods for creating a visual vocabulary |
| US20160350653A1 (en) | 2015-06-01 | 2016-12-01 | Salesforce.Com, Inc. | Dynamic Memory Network |
| US11113598B2 (en) | 2015-06-01 | 2021-09-07 | Salesforce.Com, Inc. | Dynamic memory network |
| US20170140240A1 (en) | 2015-07-27 | 2017-05-18 | Salesforce.Com, Inc. | Neural network combined image and text evaluator and classifier |
| US20170032280A1 (en) | 2015-07-27 | 2017-02-02 | Salesforce.Com, Inc. | Engagement estimator |
| US10282663B2 (en) | 2015-08-15 | 2019-05-07 | Salesforce.Com, Inc. | Three-dimensional (3D) convolution with 3D batch normalization |
| US10431205B2 (en) * | 2016-04-27 | 2019-10-01 | Conduent Business Services, Llc | Dialog device with dialog support generated using a mixture of language models combined using a recurrent neural network |
| US10281885B1 (en) * | 2016-05-20 | 2019-05-07 | Google Llc | Recurrent neural networks for online sequence generation |
| US20180082184A1 (en) * | 2016-09-19 | 2018-03-22 | TCL Research America Inc. | Context-aware chatbot system and method |
| US10565493B2 (en) | 2016-09-22 | 2020-02-18 | Salesforce.Com, Inc. | Pointer sentinel mixture architecture |
| US11093813B2 (en) * | 2016-10-20 | 2021-08-17 | Google Llc | Answer to question neural networks |
| US11222253B2 (en) | 2016-11-03 | 2022-01-11 | Salesforce.Com, Inc. | Deep neural network model for processing data through multiple linguistic task hierarchies |
| US11087199B2 (en) * | 2016-11-03 | 2021-08-10 | Nec Corporation | Context-aware attention-based neural network for interactive question answering |
| US10963782B2 (en) | 2016-11-04 | 2021-03-30 | Salesforce.Com, Inc. | Dynamic coattention network for question answering |
| US11080595B2 (en) | 2016-11-04 | 2021-08-03 | Salesforce.Com, Inc. | Quasi-recurrent neural network based encoder-decoder model |
| US10540967B2 (en) * | 2016-11-14 | 2020-01-21 | Xerox Corporation | Machine reading method for dialog state tracking |
| US10565305B2 (en) | 2016-11-18 | 2020-02-18 | Salesforce.Com, Inc. | Adaptive attention model for image captioning |
| US10654380B2 (en) * | 2016-11-18 | 2020-05-19 | Microsoft Technology Licensing, Llc | Query rewriting and interactive inquiry framework |
| US10936947B1 (en) * | 2017-01-26 | 2021-03-02 | Amazon Technologies, Inc. | Recurrent neural network-based artificial intelligence system for time series predictions |
| US20180247549A1 (en) * | 2017-02-21 | 2018-08-30 | Scriyb LLC | Deep academic learning intelligence and deep neural language network system and interfaces |
| US20180329884A1 (en) * | 2017-05-12 | 2018-11-15 | Rsvp Technologies Inc. | Neural contextual conversation learning |
| US10380259B2 (en) * | 2017-05-22 | 2019-08-13 | International Business Machines Corporation | Deep embedding for natural language content based on semantic dependencies |
| US11200269B2 (en) * | 2017-06-15 | 2021-12-14 | Microsoft Technology Licensing, Llc | Method and system for highlighting answer phrases |
| US11243944B2 (en) * | 2017-06-29 | 2022-02-08 | Futurewei Technologies, Inc. | Dynamic semantic networks for language understanding and question answering |
| US10585991B2 (en) * | 2017-06-29 | 2020-03-10 | Microsoft Technology Licensing, Llc | Virtual assistant for generating personalized responses within a communication session |
| US10902738B2 (en) * | 2017-08-03 | 2021-01-26 | Microsoft Technology Licensing, Llc | Neural models for key phrase detection and question generation |
| US11106975B2 (en) * | 2017-10-20 | 2021-08-31 | Asapp, Inc. | Fast neural network implementations by increasing parallelism of cell computations |
| WO2019079922A1 (zh) * | 2017-10-23 | 2019-05-02 | 腾讯科技（深圳）有限公司 | 会话信息处理方法及其装置、存储介质 |
| US10754851B2 (en) * | 2017-12-22 | 2020-08-25 | Adobe Inc. | Question answering for data visualizations |
| US11250038B2 (en) * | 2018-01-21 | 2022-02-15 | Microsoft Technology Licensing, Llc. | Question and answer pair generation using machine learning |
| US10776581B2 (en) * | 2018-02-09 | 2020-09-15 | Salesforce.Com, Inc. | Multitask learning as question answering |
| US20190287012A1 (en) * | 2018-03-16 | 2019-09-19 | Microsoft Technology Licensing, Llc | Encoder-decoder network with intercommunicating encoder agents |
| EP3788632A1 (en) * | 2018-04-30 | 2021-03-10 | Koninklijke Philips N.V. | Visual question answering using on-image annotations |
-
2018
- 2018-06-12 US US16/006,691 patent/US11600194B2/en active Active
-
2019
- 2019-05-14 JP JP2020564520A patent/JP7408574B2/ja active Active
- 2019-05-14 CA CA3097224A patent/CA3097224C/en active Active
- 2019-05-14 EP EP19726296.7A patent/EP3794469A1/en active Pending
- 2019-05-14 WO PCT/US2019/032207 patent/WO2019222206A1/en not_active Ceased
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2021524623A5 (https=) | ||
| CN114118065B (zh) | 一种电力领域中文文本纠错方法、装置、存储介质及计算设备 | |
| Song et al. | Ella-v: Stable neural codec language modeling with alignment-guided sequence reordering | |
| CN113609285A (zh) | 一种基于依赖门控融合机制的多模态文本摘要系统 | |
| CN109992669B (zh) | 一种基于语言模型和强化学习的关键词问答方法 | |
| CN109979429A (zh) | 一种tts的方法及系统 | |
| Wang et al. | Viola: Conditional language models for speech recognition, synthesis, and translation | |
| CN115081459B (zh) | 口语文本生成方法、装置、设备及存储介质 | |
| CN111666756A (zh) | 一种基于主题融合的序列模型文本摘要生成方法 | |
| KR20210044056A (ko) | 중복 토큰 임베딩을 이용한 자연어 처리 방법 및 장치 | |
| CN115719072B (zh) | 一种基于掩码机制的篇章级神经机器翻译方法及系统 | |
| CN116312463B (zh) | 语音合成方法、语音合成装置、电子设备及存储介质 | |
| WO2021143206A1 (zh) | 单语句自然语言处理方法、装置、计算机设备及可读存储介质 | |
| CN116738985B (zh) | 医学文本的标准化处理方法及装置 | |
| CN117577120A (zh) | 结合大语言模型的深度合成音频检测方法、系统和产品 | |
| CN115268868B (zh) | 一种基于有监督学习的智能源码转换方法 | |
| CO2026002985A2 (es) | Tecnologías para aprovechar bots conversacionales mejorados en un sistema de centro de contacto | |
| CN117291171A (zh) | 一种基于RetNet的建筑市政信息自然语言问题生成方法 | |
| CN114780696A (zh) | 适用于对话系统的以会话内容驱动的问题生成方法 | |
| Lima et al. | A large dataset of spontaneous speech with the accent spoken in são paulo for automatic speech recognition evaluation | |
| Zhao et al. | Advancing speech language models by scaling supervised fine-tuning with over 60,000 hours of synthetic speech dialogue data | |
| CN120452459A (zh) | 音频修复方法、装置及电子设备 | |
| CN116416968A (zh) | 一种由双编码器组成的transformer的重庆方言语音识别方法 | |
| Zare et al. | Deepnorm-a deep learning approach to text normalization | |
| CN115080723B (zh) | 一种阅读理解问题的自动生成方法 |