ATE531034T1 - Einheitliche behandlung von datenknappheit und datenüberanpassung beim maximum entropy modeling - Google Patents

Einheitliche behandlung von datenknappheit und datenüberanpassung beim maximum entropy modeling

Info

Publication number
ATE531034T1
ATE531034T1 AT06022887T AT06022887T ATE531034T1 AT E531034 T1 ATE531034 T1 AT E531034T1 AT 06022887 T AT06022887 T AT 06022887T AT 06022887 T AT06022887 T AT 06022887T AT E531034 T1 ATE531034 T1 AT E531034T1
Authority
AT
Austria
Prior art keywords
data
adaptation
maximum entropy
uniform treatment
scarcity
Prior art date
Application number
AT06022887T
Other languages
English (en)
Inventor
Fuliang Weng
Lin Zhao
Original Assignee
Bosch Robert Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bosch Robert Corp filed Critical Bosch Robert Corp
Application granted granted Critical
Publication of ATE531034T1 publication Critical patent/ATE531034T1/de

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/183—Speech classification or search using natural language modelling using context dependencies, e.g. language models
    • G10L15/19—Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
    • G10L15/197—Probabilistic grammars, e.g. word n-grams
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/205—Parsing
    • G06F40/216—Parsing using statistical methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G06F40/295—Named entity recognition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/183—Speech classification or search using natural language modelling using context dependencies, e.g. language models

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Machine Translation (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Exposure Of Semiconductors, Excluding Electron Or Ion Beam Exposure (AREA)
  • Separation Using Semi-Permeable Membranes (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
AT06022887T 2005-11-03 2006-11-03 Einheitliche behandlung von datenknappheit und datenüberanpassung beim maximum entropy modeling ATE531034T1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11/266,867 US8700403B2 (en) 2005-11-03 2005-11-03 Unified treatment of data-sparseness and data-overfitting in maximum entropy modeling

Publications (1)

Publication Number Publication Date
ATE531034T1 true ATE531034T1 (de) 2011-11-15

Family

ID=37591512

Family Applications (1)

Application Number Title Priority Date Filing Date
AT06022887T ATE531034T1 (de) 2005-11-03 2006-11-03 Einheitliche behandlung von datenknappheit und datenüberanpassung beim maximum entropy modeling

Country Status (4)

Country Link
US (1) US8700403B2 (de)
EP (1) EP1783744B8 (de)
CN (1) CN101004912B (de)
AT (1) ATE531034T1 (de)

Families Citing this family (92)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US20080091423A1 (en) * 2006-10-13 2008-04-17 Shourya Roy Generation of domain models from noisy transcriptions
US7856351B2 (en) * 2007-01-19 2010-12-21 Microsoft Corporation Integrated speech recognition and semantic classification
US10056077B2 (en) * 2007-03-07 2018-08-21 Nuance Communications, Inc. Using speech recognition results based on an unstructured language model with a music system
US8639509B2 (en) * 2007-07-27 2014-01-28 Robert Bosch Gmbh Method and system for computing or determining confidence scores for parse trees at all levels
US7925602B2 (en) * 2007-12-07 2011-04-12 Microsoft Corporation Maximum entropy model classfier that uses gaussian mean values
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US8874443B2 (en) * 2008-08-27 2014-10-28 Robert Bosch Gmbh System and method for generating natural language phrases from user utterances in dialog systems
CN102301395B (zh) * 2009-01-29 2014-08-06 日本电气株式会社 特征选择设备
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US9244984B2 (en) 2011-03-31 2016-01-26 Microsoft Technology Licensing, Llc Location based conversational understanding
US9842168B2 (en) 2011-03-31 2017-12-12 Microsoft Technology Licensing, Llc Task driven user intents
US9858343B2 (en) 2011-03-31 2018-01-02 Microsoft Technology Licensing Llc Personalization of queries, conversations, and searches
US10642934B2 (en) 2011-03-31 2020-05-05 Microsoft Technology Licensing, Llc Augmented conversational understanding architecture
US9760566B2 (en) 2011-03-31 2017-09-12 Microsoft Technology Licensing, Llc Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof
US9064006B2 (en) 2012-08-23 2015-06-23 Microsoft Technology Licensing, Llc Translating natural language utterances to keyword search queries
US9454962B2 (en) * 2011-05-12 2016-09-27 Microsoft Technology Licensing, Llc Sentence simplification for spoken language understanding
WO2013106594A1 (en) * 2012-01-10 2013-07-18 Telcordia Technologies, Inc. Adaptive-diversity for compressible return oriented programs
WO2013155619A1 (en) 2012-04-20 2013-10-24 Sam Pasupalak Conversational agent
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US10282419B2 (en) * 2012-12-12 2019-05-07 Nuance Communications, Inc. Multi-domain natural language processing architecture
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9507852B2 (en) * 2013-12-10 2016-11-29 Google Inc. Techniques for discriminative dependency parsing
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9734193B2 (en) * 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9589563B2 (en) 2014-06-02 2017-03-07 Robert Bosch Gmbh Speech recognition of partial proper names by natural language processing
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9764477B2 (en) 2014-12-01 2017-09-19 At&T Intellectual Property I, L.P. System and method for semantic processing of natural language commands
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US10515150B2 (en) * 2015-07-14 2019-12-24 Genesys Telecommunications Laboratories, Inc. Data driven speech enabled self-help systems and methods of operating thereof
US20170018268A1 (en) * 2015-07-14 2017-01-19 Nuance Communications, Inc. Systems and methods for updating a language model based on user input
CN106354716B (zh) * 2015-07-17 2020-06-02 华为技术有限公司 转换文本的方法和设备
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
CN109313719B (zh) 2016-03-18 2022-03-22 谷歌有限责任公司 使用神经网络生成文本段的依存性解析
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179588B1 (en) 2016-06-09 2019-02-22 Apple Inc. INTELLIGENT AUTOMATED ASSISTANT IN A HOME ENVIRONMENT
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
CN106096413B (zh) * 2016-06-21 2019-01-29 康佳集团股份有限公司 一种基于多特征融合的恶意代码检测方法及系统
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US10732965B2 (en) * 2016-10-13 2020-08-04 Tata Consultancy Services Limited Systems and methods for dynamic generation of questionnaires on programming concepts
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
CN108399914B (zh) * 2017-02-06 2021-06-22 北京搜狗科技发展有限公司 一种语音识别的方法和装置
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. USER INTERFACE FOR CORRECTING RECOGNITION ERRORS
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
DK201770429A1 (en) 2017-05-12 2018-12-14 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US10448074B2 (en) 2017-10-31 2019-10-15 The Nielsen Company (Us), Llc Assigning synthetic respondents to geographic locations for audience measurement
CN107943786B (zh) * 2017-11-16 2021-12-07 广州市万隆证券咨询顾问有限公司 一种中文命名实体识别方法及系统
US10885082B2 (en) 2018-03-22 2021-01-05 International Business Machines Corporation Implicit relation induction via purposeful overfitting of a word embedding model on a subset of a document corpus
US10431210B1 (en) 2018-04-16 2019-10-01 International Business Machines Corporation Implementing a whole sentence recurrent neural network language model for natural language processing
EP3707703A1 (de) * 2018-11-28 2020-09-16 Google LLC. Training und / oder verwendung eines sprachauswahlmodells zur automatischen bestimmung der sprache zur spracherkennung von gesprochener äusserung
US11075862B2 (en) 2019-01-22 2021-07-27 International Business Machines Corporation Evaluating retraining recommendations for an automated conversational service
CN110011742A (zh) * 2019-04-16 2019-07-12 西安交通大学 基于最大互相关熵准则鲁棒稀疏的宽带频谱感知算法
US11604961B2 (en) 2019-04-30 2023-03-14 International Business Machines Corporation Scalable model serving
CN112151024B (zh) * 2019-06-28 2023-09-22 声音猎手公司 用于生成语音音频的经编辑的转录的方法和装置
AU2020394396B2 (en) * 2019-11-26 2024-05-30 Chevron U.S.A. Inc. Requirements decomposition for engineering applications
US11436514B2 (en) 2020-04-01 2022-09-06 Chevron U.S.A. Inc. Designing plans using requirements knowledge graph

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6304841B1 (en) * 1993-10-28 2001-10-16 International Business Machines Corporation Automatic construction of conditional exponential models from elementary features
US5748841A (en) * 1994-02-25 1998-05-05 Morin; Philippe Supervised contextual language acquisition system
US6292767B1 (en) 1995-07-18 2001-09-18 Nuance Communications Method and system for building and running natural language understanding systems
JP2871561B2 (ja) * 1995-11-30 1999-03-17 株式会社エイ・ティ・アール音声翻訳通信研究所 不特定話者モデル生成装置及び音声認識装置
US6049767A (en) * 1998-04-30 2000-04-11 International Business Machines Corporation Method for estimation of feature gain and training starting point for maximum entropy/minimum divergence probability models
US6553345B1 (en) * 1999-08-26 2003-04-22 Matsushita Electric Industrial Co., Ltd. Universal remote control allowing natural language modality for television and multimedia searches and requests
WO2001022285A2 (en) * 1999-09-21 2001-03-29 Borthwick Andrew E A probabilistic record linkage model derived from training data
US6697769B1 (en) * 2000-01-21 2004-02-24 Microsoft Corporation Method and apparatus for fast machine training
US6961685B2 (en) * 2000-09-19 2005-11-01 Sy Bon K Probability model selection using information-theoretic optimization criterion
US7308400B2 (en) * 2000-12-14 2007-12-11 International Business Machines Corporation Adaptation of statistical parsers based on mathematical transform
US7257537B2 (en) * 2001-01-12 2007-08-14 International Business Machines Corporation Method and apparatus for performing dialog management in a computer conversational interface
JP2002373163A (ja) * 2001-04-13 2002-12-26 Mitsubishi Electric Corp 最大エントロピーモデル生成方法および装置ならびにそれを用いた自然言語処理方法および装置
US20020198714A1 (en) * 2001-06-26 2002-12-26 Guojun Zhou Statistical spoken dialog system
US7324927B2 (en) * 2003-07-03 2008-01-29 Robert Bosch Gmbh Fast feature selection method and system for maximum entropy modeling
US7184929B2 (en) * 2004-01-28 2007-02-27 Microsoft Corporation Exponential priors for maximum entropy models
US7716056B2 (en) * 2004-09-27 2010-05-11 Robert Bosch Corporation Method and system for interactive conversational dialogue for cognitively overloaded device users

Also Published As

Publication number Publication date
EP1783744B1 (de) 2011-10-26
US8700403B2 (en) 2014-04-15
EP1783744A1 (de) 2007-05-09
CN101004912B (zh) 2012-10-10
CN101004912A (zh) 2007-07-25
US20070100624A1 (en) 2007-05-03
EP1783744B8 (de) 2012-03-14

Similar Documents

Publication Publication Date Title
ATE531034T1 (de) Einheitliche behandlung von datenknappheit und datenüberanpassung beim maximum entropy modeling
WO2002056249A3 (en) Software tool for heuristic search methods
DK1600796T3 (da) Fremgangsmåde til rekonstruktion af en stokastisk model for at forbedre indstillingen deraf til produktionsdataene
HUP0202171A3 (en) Method for creating a workflow model, programmable device for generating a workflow, computer program and computer readable medium
HK1100181A1 (en) Expression in filamentous fungi of protease inhibitors and variants thereof
WO2006111401A3 (en) A technique for platform-independent service modeling
WO2006096583A3 (en) Methods and apparatus for providing decision support
DE50205215D1 (de) Verfahren zum berechnen von mehrschichthologrammen, verfahren zum herstellen von mehrschichthologrammen und speichermedium mit einem mehrschichthologramm
SG130985A1 (en) Photomask blank, phtomask and fabrication method thereof
GB0625832D0 (en) Real-time in cycle engine model
BR0308893B1 (pt) mÉtodo para controlar o programa de uma mÁquina de lavar roupa, e, mÁquina de lavar roupa.
WO2007041014A3 (en) Wizard and template for treatment planning
WO2007041690A3 (en) Device for generating three dimensional surface models of moving objects
DE60322123D1 (de) Informationseingabe-/-ausgabeverfahren mit einem punktmuster
ATE386996T1 (de) Roulette-automat und spielsteuerungs-verfahren
ATE485911T1 (de) Verfahren und vorrichtung zum tieflochbohren und zur herstellung von nichtzylindrischen innenkonturen
DE602005025057D1 (de) Verfahren zur Parametrierung eines Maschengitters e
DE602005009246D1 (de) Lithografische Vorrichtung und Herstellungsverfahren dafür
WO2005008936A3 (en) Method and apparatus for plan generation
DE60320164D1 (de) Eine numerische gesteuerte Werkzeugmaschine und Verfahren zur Programumwandlung dafür
BR0315856A (pt) Trilho de brinquedo e método de montagem e desmontagem do mesmo
WO2002101581A3 (de) Statistische modelle zur performanzsteigerung von datenbankoperationen
DE112005000923A5 (de) Mikrofluidische Hochdruckkapillarventilvorrichtung sowie ein Verfahren zum Herstellen dieser Vorrichtung
DE602004030413D1 (de) Verfahren zum Zeichnen eines Objekts, das ein grobes Modell und ein detailliertes Modell hat
GB2419204A (en) Conditional rate modelling

Legal Events

Date Code Title Description
RER Ceased as to paragraph 5 lit. 3 law introducing patent treaties