KR20050027931A - 중국어 단어 분절 - Google Patents

중국어 단어 분절 Download PDF

Info

Publication number
KR20050027931A
KR20050027931A KR1020040073392A KR20040073392A KR20050027931A KR 20050027931 A KR20050027931 A KR 20050027931A KR 1020040073392 A KR1020040073392 A KR 1020040073392A KR 20040073392 A KR20040073392 A KR 20040073392A KR 20050027931 A KR20050027931 A KR 20050027931A
Authority
KR
South Korea
Prior art keywords
word
morphological
tagged
text
combination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
KR1020040073392A
Other languages
English (en)
Korean (ko)
Inventor
창-닝 후앙
지앙펭 가오
무 리
아셀리엑스. 창
Original Assignee
마이크로소프트 코포레이션
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 코포레이션 filed Critical 마이크로소프트 코포레이션
Publication of KR20050027931A publication Critical patent/KR20050027931A/ko
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/268—Morphological analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/53—Processing of non-Latin text

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Machine Translation (AREA)
  • Document Processing Apparatus (AREA)
KR1020040073392A 2003-09-15 2004-09-14 중국어 단어 분절 Withdrawn KR20050027931A (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/662,602 2003-09-15
US10/662,602 US20050071148A1 (en) 2003-09-15 2003-09-15 Chinese word segmentation

Publications (1)

Publication Number Publication Date
KR20050027931A true KR20050027931A (ko) 2005-03-21

Family

ID=34136808

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020040073392A Withdrawn KR20050027931A (ko) 2003-09-15 2004-09-14 중국어 단어 분절

Country Status (5)

Country Link
US (1) US20050071148A1 (enExample)
EP (1) EP1515240A3 (enExample)
JP (1) JP2005092883A (enExample)
KR (1) KR20050027931A (enExample)
CN (1) CN1661592A (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190080833A (ko) * 2019-06-18 2019-07-08 엘지전자 주식회사 음성 정보 기반 언어 모델링 시스템 및 방법

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4652737B2 (ja) * 2004-07-14 2011-03-16 インターナショナル・ビジネス・マシーンズ・コーポレーション 単語境界確率推定装置及び方法、確率的言語モデル構築装置及び方法、仮名漢字変換装置及び方法、並びに、未知語モデルの構築方法、
US20070005345A1 (en) * 2005-07-01 2007-01-04 Microsoft Corporation Generating Chinese language couplets
JP2007024960A (ja) * 2005-07-12 2007-02-01 Internatl Business Mach Corp <Ibm> システム、プログラムおよび制御方法
JP3986531B2 (ja) * 2005-09-21 2007-10-03 沖電気工業株式会社 形態素解析装置及び形態素解析プログラム
US20070078644A1 (en) * 2005-09-30 2007-04-05 Microsoft Corporation Detecting segmentation errors in an annotated corpus
US8539349B1 (en) 2006-10-31 2013-09-17 Hewlett-Packard Development Company, L.P. Methods and systems for splitting a chinese character sequence into word segments
US8000955B2 (en) * 2006-12-20 2011-08-16 Microsoft Corporation Generating Chinese language banners
US20080294982A1 (en) * 2007-05-21 2008-11-27 Microsoft Corporation Providing relevant text auto-completions
JP5241828B2 (ja) * 2007-06-14 2013-07-17 グーグル・インコーポレーテッド 辞書の単語及び熟語の判定
WO2008151466A1 (en) 2007-06-14 2008-12-18 Google Inc. Dictionary word and phrase determination
JP5256654B2 (ja) * 2007-06-29 2013-08-07 富士通株式会社 文章分割プログラム、文章分割装置および文章分割方法
US7962507B2 (en) 2007-11-19 2011-06-14 Microsoft Corporation Web content mining of pair-based data
US9411800B2 (en) * 2008-06-27 2016-08-09 Microsoft Technology Licensing, Llc Adaptive generation of out-of-dictionary personalized long words
US8229965B2 (en) * 2009-06-30 2012-07-24 Mitsubishi Electric Research Laboratories, Inc. System and method for maximizing edit distances between particles
CN102043791B (zh) * 2009-10-10 2014-04-30 深圳市世纪光速信息技术有限公司 分词评价方法及装置
EP2488963A1 (en) * 2009-10-15 2012-08-22 Rogers Communications Inc. System and method for phrase identification
CN103631802B (zh) * 2012-08-24 2015-05-20 腾讯科技（深圳）有限公司 歌曲信息检索方法、装置及相应的服务器
WO2014071330A2 (en) * 2012-11-02 2014-05-08 Fido Labs Inc. Natural language processing system and method
JP5770753B2 (ja) * 2013-01-15 2015-08-26 グーグル・インコーポレーテッド Ｃｊｋ名前検出
CN104424177B (zh) * 2013-08-26 2017-09-15 高德软件有限公司 一种抽取核心词的方法及装置
US10607604B2 (en) * 2017-10-27 2020-03-31 International Business Machines Corporation Method for re-aligning corpus and improving the consistency
US10515148B2 (en) * 2017-12-15 2019-12-24 King Fahd University Of Petroleum And Minerals Arabic spell checking error model
CN109190034B (zh) * 2018-08-23 2019-12-13 北京百度网讯科技有限公司 用于获取信息的方法及装置
CN110444210B (zh) * 2018-10-25 2022-02-08 腾讯科技（深圳）有限公司 一种语音识别的方法、唤醒词检测的方法及装置
CN117422061B (zh) * 2023-12-19 2024-03-08 中南大学 一种文本词项多重分割结果合并标注方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5806021A (en) * 1995-10-30 1998-09-08 International Business Machines Corporation Automatic segmentation of continuous text using statistical approaches
US5963893A (en) * 1996-06-28 1999-10-05 Microsoft Corporation Identification of words in Japanese text by a computer system
US6968308B1 (en) * 1999-11-17 2005-11-22 Microsoft Corporation Method for segmenting non-segmented text using syntactic parse
US7017114B2 (en) * 2000-09-20 2006-03-21 International Business Machines Corporation Automatic correlation method for generating summaries for text documents
TWI256562B (en) * 2002-05-03 2006-06-11 Ind Tech Res Inst Method for named-entity recognition and verification

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190080833A (ko) * 2019-06-18 2019-07-08 엘지전자 주식회사 음성 정보 기반 언어 모델링 시스템 및 방법

Also Published As

Publication number Publication date
US20050071148A1 (en) 2005-03-31
EP1515240A3 (en) 2007-02-21
JP2005092883A (ja) 2005-04-07
CN1661592A (zh) 2005-08-31
EP1515240A2 (en) 2005-03-16

Similar Documents

Publication Publication Date Title
KR20050027931A (ko) 중국어 단어 분절
McCarthy et al. The Johns Hopkins University Bible corpus: 1600+ tongues for typological exploration
Shaalan et al. NERA: Named entity recognition for Arabic
Handel What is Sino‐Tibetan? Snapshot of a field and a language family in flux
Bowern Chirila: Contemporary and historical resources for the indigenous languages of Australia
Manov et al. Experiments with geographic knowledge for information extraction
Salah et al. Arabic rule-based named entity recognition systems progress and challenges
Xu Digital approaches to understanding Dongba pictographs
Han Improving the utility of social media with Natural Language Processing
Leveling Tagging of temporal expressions and geological features in scientific articles
Van Crevel unofficial Poetry Journals from the People’s Republic of China: A Research note and an Annotated bibliography
Chen et al. Translating–transliterating named entities for multilingual information access
Mubarak et al. UL2C: Mapping user locations to countries on Arabic Twitter
Álvarez-Mellado A corpus of Spanish political speeches from 1937 to 2019
Kim et al. A Study on the Method and System for Organization's Name Authorization of Korean Science and Technology Contents
Murugathas et al. Domain specific named entity recognition in tamil
Amien et al. Location-based Twitter Filtering for the Creation of Low-Resource Language Datasets in Indonesian Local Languages
Ringland Structured named entities
Park Cross-lingual Name and Subject Access
Prosser Digital Philology in the Ras Shamra Tablet Inventory Project: Text Curation through Computational Intelligence
Stosic Serbian nominal groups: System and structure
Traboulsi A local grammar for proper names
Nguyen et al. A Template-Based Approach for Generating Vietnamese References from Flat MR Dataset in Restaurant Domain
Bingenheimer Digitization of Buddhism:(digital Humanities and Buddhist Studies)
Nand et al. A multi-strategy approach for location mining in tweets: AUT NLP group entry for ALTA-2014 shared task

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20040914

PG1501 Laying open of application
PC1203 Withdrawal of no request for examination
WITN Application deemed withdrawn, e.g. because no request for examination was filed or no examination fee was paid