CN109313719B - 使用神经网络生成文本段的依存性解析 - Google Patents

使用神经网络生成文本段的依存性解析 Download PDF

Info

Publication number
CN109313719B
CN109313719B CN201780008760.9A CN201780008760A CN109313719B CN 109313719 B CN109313719 B CN 109313719B CN 201780008760 A CN201780008760 A CN 201780008760A CN 109313719 B CN109313719 B CN 109313719B
Authority
CN
China
Prior art keywords
neural network
input
dependency
text sequence
token
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780008760.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN109313719A (zh
Inventor
张远
戴维·约瑟夫·魏斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of CN109313719A publication Critical patent/CN109313719A/zh
Application granted granted Critical
Publication of CN109313719B publication Critical patent/CN109313719B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Machine Translation (AREA)
CN201780008760.9A 2016-03-18 2017-03-17 使用神经网络生成文本段的依存性解析 Active CN109313719B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662310513P 2016-03-18 2016-03-18
US62/310,513 2016-03-18
PCT/US2017/023047 WO2017161320A1 (en) 2016-03-18 2017-03-17 Generating dependency parses of text segments using neural networks

Publications (2)

Publication Number Publication Date
CN109313719A CN109313719A (zh) 2019-02-05
CN109313719B true CN109313719B (zh) 2022-03-22

Family

ID=58547795

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780008760.9A Active CN109313719B (zh) 2016-03-18 2017-03-17 使用神经网络生成文本段的依存性解析

Country Status (6)

Country Link
US (1) US10878188B2 (enExample)
EP (1) EP3394798A1 (enExample)
JP (1) JP6789303B2 (enExample)
KR (1) KR102201936B1 (enExample)
CN (1) CN109313719B (enExample)
WO (1) WO2017161320A1 (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109558583A (zh) * 2017-09-27 2019-04-02 株式会社理光 一种自动生成文摘的方法、装置及设备
US10482162B2 (en) * 2017-11-30 2019-11-19 International Business Machines Corporation Automatic equation transformation from text
US10721190B2 (en) * 2018-07-31 2020-07-21 Microsoft Technology Licensing, Llc Sequence to sequence to classification model for generating recommended messages
CN110033091B (zh) * 2018-12-13 2020-09-01 阿里巴巴集团控股有限公司 一种基于模型进行预测的方法和装置
RU2721190C1 (ru) * 2018-12-25 2020-05-18 Общество с ограниченной ответственностью "Аби Продакшн" Обучение нейронных сетей с использованием функций потерь, отражающих зависимости между соседними токенами
US10956474B2 (en) 2019-03-14 2021-03-23 Microsoft Technology Licensing, Llc Determination of best set of suggested responses
US11501137B2 (en) * 2019-06-28 2022-11-15 International Business Machines Corporation Feature engineering in neural networks optimization
US11436486B2 (en) * 2019-08-19 2022-09-06 Advanced Micro Devices, Inc. Neural network internal data fast access memory buffer
CN110765243A (zh) * 2019-09-17 2020-02-07 平安科技（深圳）有限公司 自然语言处理系统的构建方法、电子装置及计算机设备
CN112800737B (zh) * 2019-10-29 2024-06-18 京东科技控股股份有限公司 自然语言文本生成方法和装置以及对话系统
CN111178039B (zh) * 2019-12-18 2023-05-09 北京明略软件系统有限公司 一种模型训练方法、装置、实现文本处理的方法及装置
JP2023510791A (ja) * 2020-01-17 2023-03-15 エヌフェレンス，インコーポレイテッド 意味空間内のベクトル表示にタームをマッピングするためのシステム及び方法
US12271694B1 (en) * 2020-04-24 2025-04-08 Educational Testing Service Machine learning-based automated narrative text scoring including emotion arc characterization
CN111832316B (zh) * 2020-06-30 2024-05-24 北京小米松果电子有限公司 语义识别的方法、装置、电子设备和存储介质
CN111832315B (zh) * 2020-06-30 2024-04-30 北京小米松果电子有限公司 语义识别的方法、装置、电子设备和存储介质
CN112528671A (zh) * 2020-12-02 2021-03-19 北京小米松果电子有限公司 语义分析方法、装置以及存储介质
CN112699665B (zh) * 2021-03-25 2021-08-27 北京智源人工智能研究院 一种安全报告文本的三元组抽取方法、装置及电子设备
CN113762445B (zh) * 2021-04-26 2023-11-07 重庆大学 一种基于装配式建筑的标识解析系统
CN113468878B (zh) * 2021-07-13 2024-09-06 腾讯科技（深圳）有限公司 词性标注方法、装置、电子设备及存储介质
US12387725B2 (en) 2021-12-16 2025-08-12 Samsung Electronics Co., Ltd. Electronic device and method for recommending voice command thereof
CN119296528B (zh) * 2024-09-25 2025-09-16 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 一种基于语音端到端的依存结构分析方法及装置
CN119379426B (zh) * 2024-12-31 2025-04-08 杭银消费金融股份有限公司 一种风控拒绝用户数据处理系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998039714A1 (en) * 1997-03-07 1998-09-11 Microsoft Corporation Information retrieval utilizing semantic representation of text
WO2007090033A2 (en) * 2006-02-01 2007-08-09 Honda Motor Co., Ltd. Meta learning for question classification
US7962329B1 (en) * 2000-10-23 2011-06-14 At&T Intellectual Property Ii, L.P. Text-to-scene conversion
CN102662931A (zh) * 2012-04-13 2012-09-12 厦门大学 一种基于协同神经网络的语义角色标注方法
CN102866989A (zh) * 2012-08-30 2013-01-09 北京航空航天大学 基于词语依存关系的观点抽取方法
CN104049755A (zh) * 2014-06-18 2014-09-17 中国科学院自动化研究所 信息处理方法及装置
US8935151B1 (en) * 2011-12-07 2015-01-13 Google Inc. Multi-source transfer of delexicalized dependency parsers
CN104575501A (zh) * 2015-01-19 2015-04-29 北京云知声信息技术有限公司 一种收音机语音操控指令解析方法及系统

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03263266A (ja) 1990-03-14 1991-11-22 Fujitsu Ltd 未知語の品詞選択装置
EP1116134A1 (en) * 1998-08-24 2001-07-18 BCL Computers, Inc. Adaptive natural language interface
JP2007502459A (ja) * 2003-08-12 2007-02-08 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ 対話システム用音声入力インタフェース
GB2428508B (en) * 2005-07-15 2009-10-21 Toshiba Res Europ Ltd Parsing method
US8700403B2 (en) * 2005-11-03 2014-04-15 Robert Bosch Gmbh Unified treatment of data-sparseness and data-overfitting in maximum entropy modeling
US8874434B2 (en) 2010-06-02 2014-10-28 Nec Laboratories America, Inc. Method and apparatus for full natural language parsing
US9454962B2 (en) * 2011-05-12 2016-09-27 Microsoft Technology Licensing, Llc Sentence simplification for spoken language understanding
US9507852B2 (en) * 2013-12-10 2016-11-29 Google Inc. Techniques for discriminative dependency parsing
JP6588449B2 (ja) * 2014-01-31 2019-10-09 グーグル エルエルシー 文書のベクトル表現の生成

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998039714A1 (en) * 1997-03-07 1998-09-11 Microsoft Corporation Information retrieval utilizing semantic representation of text
US7962329B1 (en) * 2000-10-23 2011-06-14 At&T Intellectual Property Ii, L.P. Text-to-scene conversion
WO2007090033A2 (en) * 2006-02-01 2007-08-09 Honda Motor Co., Ltd. Meta learning for question classification
US8935151B1 (en) * 2011-12-07 2015-01-13 Google Inc. Multi-source transfer of delexicalized dependency parsers
CN102662931A (zh) * 2012-04-13 2012-09-12 厦门大学 一种基于协同神经网络的语义角色标注方法
CN102866989A (zh) * 2012-08-30 2013-01-09 北京航空航天大学 基于词语依存关系的观点抽取方法
CN104049755A (zh) * 2014-06-18 2014-09-17 中国科学院自动化研究所 信息处理方法及装置
CN104575501A (zh) * 2015-01-19 2015-04-29 北京云知声信息技术有限公司 一种收音机语音操控指令解析方法及系统

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
A Fast and Accurate Dependency Parser using Neural Networks;Danqi Chen et al.;《Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)》;20140101;1-11 *
Dependency Parsing and Semantic Role Labeling as a Single Task;Morante R et al.;《the 7th International Conference on Recent Advances in Natural Language Processing (RANLP-2009)》;20090101;1-6 *
Natural Language Processing (almost) from Scratch;Ronan Collobert et al.;《Journal of Machine Learning Research》;20110801;第12卷;1-45 *

Also Published As

Publication number Publication date
JP6789303B2 (ja) 2020-11-25
US10878188B2 (en) 2020-12-29
KR102201936B1 (ko) 2021-01-12
CN109313719A (zh) 2019-02-05
US20190073351A1 (en) 2019-03-07
JP2019511033A (ja) 2019-04-18
EP3394798A1 (en) 2018-10-31
WO2017161320A1 (en) 2017-09-21
KR20180099822A (ko) 2018-09-05

Similar Documents

Publication Publication Date Title
CN109313719B (zh) 使用神经网络生成文本段的依存性解析
US10409908B2 (en) Generating parse trees of text segments using neural networks
US10268671B2 (en) Generating parse trees of text segments using neural networks
US11222252B2 (en) Generating representations of input sequences using neural networks
US10559300B2 (en) Generating target sequences from input sequences using partial conditioning
JP6671515B2 (ja) 比較セットを使用する入力例の分類
US10083169B1 (en) Topic-based sequence modeling neural networks
CN109074517B (zh) 全局归一化神经网络
EP3218854B1 (en) Generating natural language descriptions of images
US9818409B2 (en) Context-dependent modeling of phonemes
US11954594B1 (en) Training recurrent neural networks to generate sequences
BR112019004524B1 (pt) Sistema de redes neurais, um ou mais meios de armazenamento legíveis por computador não transitório e método para gerar autorregressivamente uma sequência de saída de dados de áudio
CN118974739A (zh) 具有并行注意力层和前馈层的注意力神经网络
WO2022251720A1 (en) Character-level attention neural networks
US12086715B2 (en) Generating neural network outputs using insertion commands
US12423518B2 (en) Attention neural networks with N-grammer layers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant