CN107342078B - 对话策略优化的冷启动系统和方法 - Google Patents
对话策略优化的冷启动系统和方法 Download PDFInfo
- Publication number
- CN107342078B CN107342078B CN201710483731.XA CN201710483731A CN107342078B CN 107342078 B CN107342078 B CN 107342078B CN 201710483731 A CN201710483731 A CN 201710483731A CN 107342078 B CN107342078 B CN 107342078B
- Authority
- CN
- China
- Prior art keywords
- action
- module
- decision
- conversation
- tea
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 230000009471 action Effects 0.000 claims abstract description 76
- 238000012549 training Methods 0.000 claims abstract description 23
- 238000005070 sampling Methods 0.000 claims abstract description 21
- 230000014509 gene expression Effects 0.000 claims abstract description 10
- 238000005457 optimization Methods 0.000 claims description 4
- 238000011084 recovery Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 abstract description 8
- 230000002787 reinforcement Effects 0.000 abstract description 8
- 230000007704 transition Effects 0.000 abstract description 5
- 238000013528 artificial neural network Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G10L15/183—Speech classification or search using natural language modelling using context dependencies, e.g. language models
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
- G10L15/063—Training
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
Landscapes
- Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Evolutionary Computation (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710483731.XA CN107342078B (zh) | 2017-06-23 | 2017-06-23 | 对话策略优化的冷启动系统和方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710483731.XA CN107342078B (zh) | 2017-06-23 | 2017-06-23 | 对话策略优化的冷启动系统和方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107342078A CN107342078A (zh) | 2017-11-10 |
CN107342078B true CN107342078B (zh) | 2020-05-05 |
Family
ID=60220002
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710483731.XA Active CN107342078B (zh) | 2017-06-23 | 2017-06-23 | 对话策略优化的冷启动系统和方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107342078B (zh) |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108304489B (zh) * | 2018-01-05 | 2021-12-28 | 广东工业大学 | 一种基于强化学习网络的目标引导型个性化对话方法与系统 |
CN110390398B (zh) * | 2018-04-13 | 2021-09-10 | 北京智行者科技有限公司 | 在线学习方法 |
CN108829797A (zh) * | 2018-04-25 | 2018-11-16 | 苏州思必驰信息科技有限公司 | 多智能体对话策略系统构建方法及自适应方法 |
CN108647789B (zh) * | 2018-05-15 | 2022-04-19 | 浙江大学 | 一种基于状态分布感知采样的智能体深度价值函数学习方法 |
CN108847220B (zh) * | 2018-05-30 | 2020-04-28 | 苏州思必驰信息科技有限公司 | 对话状态跟踪器的训练方法及系统 |
CN109325155A (zh) * | 2018-07-25 | 2019-02-12 | 南京瓦尔基里网络科技有限公司 | 一种新型对话状态存储方法及系统 |
CN109388698A (zh) * | 2018-10-22 | 2019-02-26 | 北京工业大学 | 一种基于深度强化学习的指导性自动聊天方法 |
CN109829044A (zh) * | 2018-12-28 | 2019-05-31 | 北京百度网讯科技有限公司 | 对话方法、装置及设备 |
CN111914069A (zh) * | 2019-05-10 | 2020-11-10 | 京东方科技集团股份有限公司 | 训练方法和装置、对话处理方法和系统及介质 |
CN110245221B (zh) * | 2019-05-13 | 2023-05-23 | 华为技术有限公司 | 训练对话状态跟踪分类器的方法和计算机设备 |
CN110211572B (zh) * | 2019-05-14 | 2021-12-10 | 北京来也网络科技有限公司 | 基于强化学习的对话控制方法及装置 |
CN110569344B (zh) * | 2019-08-22 | 2023-06-02 | 创新先进技术有限公司 | 确定对话文本对应的标准问句的方法和装置 |
CN110971683B (zh) * | 2019-11-28 | 2021-06-15 | 海南大学 | 基于强化学习的服务组合方法 |
CN112989016B (zh) * | 2021-05-17 | 2021-08-10 | 南湖实验室 | 用于检测对话策略学习中模拟用户经验质量的方法和系统 |
CN113392971B (zh) * | 2021-06-11 | 2022-09-02 | 武汉大学 | 策略网络训练方法、装置、设备及可读存储介质 |
CN113704425A (zh) * | 2021-08-27 | 2021-11-26 | 广东电力信息科技有限公司 | 一种结合知识增强和深度强化学习的对话策略优化方法 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104679910A (zh) * | 2015-03-25 | 2015-06-03 | 北京智齿博创科技有限公司 | 智能应答方法及系统 |
CN106126636A (zh) * | 2016-06-23 | 2016-11-16 | 北京光年无限科技有限公司 | 一种面向智能机器人的人机交互方法及装置 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105094315B (zh) * | 2015-06-25 | 2018-03-06 | 百度在线网络技术(北京)有限公司 | 基于人工智能的人机智能聊天的方法和装置 |
EP3341933A1 (en) * | 2015-10-21 | 2018-07-04 | Google LLC | Parameter collection and automatic dialog generation in dialog systems |
-
2017
- 2017-06-23 CN CN201710483731.XA patent/CN107342078B/zh active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104679910A (zh) * | 2015-03-25 | 2015-06-03 | 北京智齿博创科技有限公司 | 智能应答方法及系统 |
CN106126636A (zh) * | 2016-06-23 | 2016-11-16 | 北京光年无限科技有限公司 | 一种面向智能机器人的人机交互方法及装置 |
Non-Patent Citations (2)
Title |
---|
《On-line Dialogue Policy Learning with Companion Teaching》;Lu Chen et al.;《Proceedings of the 15th Conference of the European Chapter of the Association for Compuational Linguistics》;20170407;第2卷;全文 * |
《面向自然交互的多通道人机对话系统》;杨明浩等;《计算机科学》;20141031;第41卷(第10期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN107342078A (zh) | 2017-11-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107342078B (zh) | 对话策略优化的冷启动系统和方法 | |
CN113962315B (zh) | 模型预训练方法、装置、设备、存储介质以及程序产品 | |
CN108734276B (zh) | 一种基于对抗生成网络的模仿学习对话生成方法 | |
US11227581B2 (en) | Systems and methods for generating a response based on task-independent conversational responses or task-specific responses | |
CN112541063B (zh) | 一种基于自学习对话模型的人机对话方法及系统 | |
CN111191450B (zh) | 语料清洗方法、语料录入设备及计算机可读存储介质 | |
CN105704013A (zh) | 基于上下文的话题更新数据处理方法及装置 | |
US9361589B2 (en) | System and a method for providing a dialog with a user | |
CN116521850B (zh) | 一种基于强化学习的交互方法及装置 | |
CN108962221B (zh) | 在线对话状态跟踪模型的优化方法及系统 | |
CN113053388B (zh) | 语音交互方法、装置、设备和存储介质 | |
CN115293132B (zh) | 虚拟场景的对话处理方法、装置、电子设备及存储介质 | |
EP2879062A2 (en) | A system and a method for providing a dialog with a user | |
CN110532555A (zh) | 一种基于强化学习的语言评价生成方法 | |
CN111046178A (zh) | 一种文本序列生成方法及其系统 | |
CN114912020A (zh) | 一种基于用户偏好图的多子目标对话推荐方法 | |
CN111027292A (zh) | 一种限定采样文本序列生成方法及其系统 | |
CN117252957A (zh) | 根据文字描述生成带精确文字图片的方法、装置及存储介质 | |
CN110297894B (zh) | 一种基于辅助网络的智能对话生成方法 | |
JP2024532679A (ja) | 自己回帰言語モデルニューラルネットワークを使用して出力系列を評価すること | |
CN115757749B (zh) | 一种对话处理方法、装置、电子设备及存储介质 | |
CN111091011B (zh) | 领域预测方法、领域预测装置及电子设备 | |
CN113159168A (zh) | 基于冗余词删除的预训练模型加速推理方法和系统 | |
JP2015155932A (ja) | ユーザとの対話システム及び方法 | |
CN113515604B (zh) | 一种闲聊机器人实体跟踪方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20200623 Address after: Room 105G, 199 GuoShoujing Road, Pudong New Area, Shanghai, 200120 Co-patentee after: AI SPEECH Co.,Ltd. Patentee after: Shanghai Jiaotong University Intellectual Property Management Co.,Ltd. Address before: 200240 Dongchuan Road, Shanghai, No. 800, No. Co-patentee before: AI SPEECH Co.,Ltd. Patentee before: SHANGHAI JIAO TONG University |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20201104 Address after: 215123 14 Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Suzhou, Jiangsu. Patentee after: AI SPEECH Co.,Ltd. Address before: Room 105G, 199 GuoShoujing Road, Pudong New Area, Shanghai, 200120 Patentee before: Shanghai Jiaotong University Intellectual Property Management Co.,Ltd. Patentee before: AI SPEECH Co.,Ltd. |
|
CP01 | Change in the name or title of a patent holder | ||
CP01 | Change in the name or title of a patent holder |
Address after: 215123 building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Patentee after: Sipic Technology Co.,Ltd. Address before: 215123 building 14, Tengfei Innovation Park, 388 Xinping street, Suzhou Industrial Park, Suzhou City, Jiangsu Province Patentee before: AI SPEECH Co.,Ltd. |
|
PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Cold Start System and Method for Dialogue Strategy Optimization Effective date of registration: 20230726 Granted publication date: 20200505 Pledgee: CITIC Bank Limited by Share Ltd. Suzhou branch Pledgor: Sipic Technology Co.,Ltd. Registration number: Y2023980049433 |