KR102201936B1 - 신경망을 사용한 텍스트 세그먼트의 의존성 파스 생성 - Google Patents

신경망을 사용한 텍스트 세그먼트의 의존성 파스 생성 Download PDF

Info

Publication number
KR102201936B1
KR102201936B1 KR1020187021920A KR20187021920A KR102201936B1 KR 102201936 B1 KR102201936 B1 KR 102201936B1 KR 1020187021920 A KR1020187021920 A KR 1020187021920A KR 20187021920 A KR20187021920 A KR 20187021920A KR 102201936 B1 KR102201936 B1 KR 102201936B1
Authority
KR
South Korea
Prior art keywords
neural network
training
token
dependency
text sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020187021920A
Other languages
English (en)
Korean (ko)
Other versions
KR20180099822A (ko
Inventor
위안 장
데이비드 조셉 바이스
Original Assignee
구글 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 구글 엘엘씨 filed Critical 구글 엘엘씨
Publication of KR20180099822A publication Critical patent/KR20180099822A/ko
Application granted granted Critical
Publication of KR102201936B1 publication Critical patent/KR102201936B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G06N3/0454—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Machine Translation (AREA)
KR1020187021920A 2016-03-18 2017-03-17 신경망을 사용한 텍스트 세그먼트의 의존성 파스 생성 Active KR102201936B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662310513P 2016-03-18 2016-03-18
US62/310,513 2016-03-18
PCT/US2017/023047 WO2017161320A1 (en) 2016-03-18 2017-03-17 Generating dependency parses of text segments using neural networks

Publications (2)

Publication Number Publication Date
KR20180099822A KR20180099822A (ko) 2018-09-05
KR102201936B1 true KR102201936B1 (ko) 2021-01-12

Family

ID=58547795

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187021920A Active KR102201936B1 (ko) 2016-03-18 2017-03-17 신경망을 사용한 텍스트 세그먼트의 의존성 파스 생성

Country Status (6)

Country Link
US (1) US10878188B2 (enExample)
EP (1) EP3394798A1 (enExample)
JP (1) JP6789303B2 (enExample)
KR (1) KR102201936B1 (enExample)
CN (1) CN109313719B (enExample)
WO (1) WO2017161320A1 (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109558583A (zh) * 2017-09-27 2019-04-02 株式会社理光 一种自动生成文摘的方法、装置及设备
US10482162B2 (en) * 2017-11-30 2019-11-19 International Business Machines Corporation Automatic equation transformation from text
US10721190B2 (en) * 2018-07-31 2020-07-21 Microsoft Technology Licensing, Llc Sequence to sequence to classification model for generating recommended messages
CN110033091B (zh) * 2018-12-13 2020-09-01 阿里巴巴集团控股有限公司 一种基于模型进行预测的方法和装置
RU2721190C1 (ru) * 2018-12-25 2020-05-18 Общество с ограниченной ответственностью "Аби Продакшн" Обучение нейронных сетей с использованием функций потерь, отражающих зависимости между соседними токенами
US10956474B2 (en) 2019-03-14 2021-03-23 Microsoft Technology Licensing, Llc Determination of best set of suggested responses
US11501137B2 (en) * 2019-06-28 2022-11-15 International Business Machines Corporation Feature engineering in neural networks optimization
US11436486B2 (en) * 2019-08-19 2022-09-06 Advanced Micro Devices, Inc. Neural network internal data fast access memory buffer
CN110765243A (zh) * 2019-09-17 2020-02-07 平安科技（深圳）有限公司 自然语言处理系统的构建方法、电子装置及计算机设备
CN112800737B (zh) * 2019-10-29 2024-06-18 京东科技控股股份有限公司 自然语言文本生成方法和装置以及对话系统
CN111178039B (zh) * 2019-12-18 2023-05-09 北京明略软件系统有限公司 一种模型训练方法、装置、实现文本处理的方法及装置
JP2023510791A (ja) * 2020-01-17 2023-03-15 エヌフェレンス，インコーポレイテッド 意味空間内のベクトル表示にタームをマッピングするためのシステム及び方法
US12271694B1 (en) * 2020-04-24 2025-04-08 Educational Testing Service Machine learning-based automated narrative text scoring including emotion arc characterization
CN111832316B (zh) * 2020-06-30 2024-05-24 北京小米松果电子有限公司 语义识别的方法、装置、电子设备和存储介质
CN111832315B (zh) * 2020-06-30 2024-04-30 北京小米松果电子有限公司 语义识别的方法、装置、电子设备和存储介质
CN112528671A (zh) * 2020-12-02 2021-03-19 北京小米松果电子有限公司 语义分析方法、装置以及存储介质
CN112699665B (zh) * 2021-03-25 2021-08-27 北京智源人工智能研究院 一种安全报告文本的三元组抽取方法、装置及电子设备
CN113762445B (zh) * 2021-04-26 2023-11-07 重庆大学 一种基于装配式建筑的标识解析系统
CN113468878B (zh) * 2021-07-13 2024-09-06 腾讯科技（深圳）有限公司 词性标注方法、装置、电子设备及存储介质
US12387725B2 (en) 2021-12-16 2025-08-12 Samsung Electronics Co., Ltd. Electronic device and method for recommending voice command thereof
CN119296528B (zh) * 2024-09-25 2025-09-16 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 一种基于语音端到端的依存结构分析方法及装置
CN119379426B (zh) * 2024-12-31 2025-04-08 杭银消费金融股份有限公司 一种风控拒绝用户数据处理系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060241946A1 (en) 2003-08-12 2006-10-26 Martin Oerder Speech input interface for dialog systems
US20120290290A1 (en) 2011-05-12 2012-11-15 Microsoft Corporation Sentence Simplification for Spoken Language Understanding

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03263266A (ja) 1990-03-14 1991-11-22 Fujitsu Ltd 未知語の品詞選択装置
US6076051A (en) * 1997-03-07 2000-06-13 Microsoft Corporation Information retrieval utilizing semantic representation of text
EP1116134A1 (en) * 1998-08-24 2001-07-18 BCL Computers, Inc. Adaptive natural language interface
US7016828B1 (en) * 2000-10-23 2006-03-21 At&T Corp. Text-to-scene conversion
GB2428508B (en) * 2005-07-15 2009-10-21 Toshiba Res Europ Ltd Parsing method
US8700403B2 (en) * 2005-11-03 2014-04-15 Robert Bosch Gmbh Unified treatment of data-sparseness and data-overfitting in maximum entropy modeling
US7603330B2 (en) * 2006-02-01 2009-10-13 Honda Motor Co., Ltd. Meta learning for question classification
US8874434B2 (en) 2010-06-02 2014-10-28 Nec Laboratories America, Inc. Method and apparatus for full natural language parsing
US8935151B1 (en) * 2011-12-07 2015-01-13 Google Inc. Multi-source transfer of delexicalized dependency parsers
CN102662931B (zh) * 2012-04-13 2015-03-25 厦门大学 一种基于协同神经网络的语义角色标注方法
CN102866989B (zh) * 2012-08-30 2016-09-07 北京航空航天大学 基于词语依存关系的观点抽取方法
US9507852B2 (en) * 2013-12-10 2016-11-29 Google Inc. Techniques for discriminative dependency parsing
JP6588449B2 (ja) * 2014-01-31 2019-10-09 グーグル エルエルシー 文書のベクトル表現の生成
CN104049755B (zh) * 2014-06-18 2017-01-18 中国科学院自动化研究所 信息处理方法及装置
CN104575501B (zh) * 2015-01-19 2017-11-03 北京云知声信息技术有限公司 一种收音机语音操控指令解析方法及系统

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060241946A1 (en) 2003-08-12 2006-10-26 Martin Oerder Speech input interface for dialog systems
US20120290290A1 (en) 2011-05-12 2012-11-15 Microsoft Corporation Sentence Simplification for Spoken Language Understanding

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Ronan Collobert 외 5명. Natural Language Processing (Almost) from Scratch. 2011년

Also Published As

Publication number Publication date
JP6789303B2 (ja) 2020-11-25
US10878188B2 (en) 2020-12-29
CN109313719A (zh) 2019-02-05
US20190073351A1 (en) 2019-03-07
JP2019511033A (ja) 2019-04-18
CN109313719B (zh) 2022-03-22
EP3394798A1 (en) 2018-10-31
WO2017161320A1 (en) 2017-09-21
KR20180099822A (ko) 2018-09-05

Similar Documents

Publication Publication Date Title
KR102201936B1 (ko) 신경망을 사용한 텍스트 세그먼트의 의존성 파스 생성
JP7210531B2 (ja) ニューラルアーキテクチャ検索
US20220319533A1 (en) Generating audio using neural networks
EP4113354A2 (en) Method and apparatus for generating pre-trained language model, electronic device and storage medium
US11195521B2 (en) Generating target sequences from input sequences using partial conditioning
US20250245507A1 (en) High fidelity speech synthesis with adversarial networks
US10409908B2 (en) Generating parse trees of text segments using neural networks
KR102195223B1 (ko) 전역적으로 노멀화된 신경 네트워크들
EP3792835B1 (en) Generating representations of input sequences using neural networks
KR20190113928A (ko) 강화 학습을 통한 디바이스 배치 최적화
JP2019517075A (ja) 比較セットを使用する入力例の分類
CN109791631A (zh) 奖励增强模型训练
CN110402445B (zh) 使用递归神经网络浏览序列数据的方法和系统
EP4064110A1 (en) Apparatus and method for training dialogue summary model
CN114154518A (zh) 数据增强模型训练方法、装置、电子设备及存储介质
CN118747542B (zh) 语言模型调整方法、装置、电子设备和计算机可读介质
CN112464654B (zh) 关键词生成方法、装置、电子设备和计算机可读介质

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

Patent event date: 20180727

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20200228

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20201030

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20210106

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20210107

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20231221

Start annual number: 4

End annual number: 4