TWI313418B - Multimodal speech-to-speech language translation and display - Google Patents

Multimodal speech-to-speech language translation and display Download PDF

Info

Publication number
TWI313418B
TWI313418B TW092130319A TW92130319A TWI313418B TW I313418 B TWI313418 B TW I313418B TW 092130319 A TW092130319 A TW 092130319A TW 92130319 A TW92130319 A TW 92130319A TW I313418 B TWI313418 B TW I313418B
Authority
TW
Taiwan
Prior art keywords
language
sentence
natural language
representation
natural
Prior art date
Application number
TW092130319A
Other languages
English (en)
Chinese (zh)
Other versions
TW200416567A (en
Inventor
Gao Yuqing
Gu Liang
Fu-Hua Liu
Sorensen Jeffrey
Original Assignee
Ibm
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ibm filed Critical Ibm
Publication of TW200416567A publication Critical patent/TW200416567A/zh
Application granted granted Critical
Publication of TWI313418B publication Critical patent/TWI313418B/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/55—Rule-based translation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Machine Translation (AREA)
TW092130319A 2002-12-10 2003-10-30 Multimodal speech-to-speech language translation and display TWI313418B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US10/315,732 US20040111272A1 (en) 2002-12-10 2002-12-10 Multimodal speech-to-speech language translation and display

Publications (2)

Publication Number Publication Date
TW200416567A TW200416567A (en) 2004-09-01
TWI313418B true TWI313418B (en) 2009-08-11

Family

ID=32468784

Family Applications (1)

Application Number Title Priority Date Filing Date
TW092130319A TWI313418B (en) 2002-12-10 2003-10-30 Multimodal speech-to-speech language translation and display

Country Status (8)

Country Link
US (1) US20040111272A1 (cg-RX-API-DMAC7.html)
EP (1) EP1604300A1 (cg-RX-API-DMAC7.html)
JP (1) JP4448450B2 (cg-RX-API-DMAC7.html)
KR (1) KR20050086478A (cg-RX-API-DMAC7.html)
CN (1) CN1742273A (cg-RX-API-DMAC7.html)
AU (1) AU2003223701A1 (cg-RX-API-DMAC7.html)
TW (1) TWI313418B (cg-RX-API-DMAC7.html)
WO (1) WO2004053725A1 (cg-RX-API-DMAC7.html)

Families Citing this family (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7536294B1 (en) * 2002-01-08 2009-05-19 Oracle International Corporation Method and apparatus for translating computer programs
JP2004280352A (ja) * 2003-03-14 2004-10-07 Ricoh Co Ltd 文書データ翻訳方法及び文書データ翻訳プログラム
US7607097B2 (en) * 2003-09-25 2009-10-20 International Business Machines Corporation Translating emotion to braille, emoticons and other special symbols
US7272562B2 (en) * 2004-03-30 2007-09-18 Sony Corporation System and method for utilizing speech recognition to efficiently perform data indexing procedures
US7502632B2 (en) * 2004-06-25 2009-03-10 Nokia Corporation Text messaging device
JP2006155035A (ja) * 2004-11-26 2006-06-15 Canon Inc ユーザインタフェースの構築方法
US20060136870A1 (en) * 2004-12-22 2006-06-22 International Business Machines Corporation Visual user interface for creating multimodal applications
EP1856628A2 (en) * 2005-03-07 2007-11-21 Linguatec Sprachtechnologien GmbH Methods and arrangements for enhancing machine processable text information
US20060229882A1 (en) * 2005-03-29 2006-10-12 Pitney Bowes Incorporated Method and system for modifying printed text to indicate the author's state of mind
JP4050755B2 (ja) * 2005-03-30 2008-02-20 株式会社東芝 コミュニケーション支援装置、コミュニケーション支援方法およびコミュニケーション支援プログラム
JP4087400B2 (ja) * 2005-09-15 2008-05-21 株式会社東芝 音声対話翻訳装置、音声対話翻訳方法および音声対話翻訳プログラム
US7983910B2 (en) * 2006-03-03 2011-07-19 International Business Machines Corporation Communicating across voice and text channels with emotion preservation
US7860705B2 (en) * 2006-09-01 2010-12-28 International Business Machines Corporation Methods and apparatus for context adaptation of speech-to-speech translation systems
US8335988B2 (en) * 2007-10-02 2012-12-18 Honeywell International Inc. Method of producing graphically enhanced data communications
GB0800578D0 (en) * 2008-01-14 2008-02-20 Real World Holdings Ltd Enhanced message display system
US20100121630A1 (en) * 2008-11-07 2010-05-13 Lingupedia Investments S. A R. L. Language processing systems and methods
US8856682B2 (en) 2010-05-11 2014-10-07 AI Squared Displaying a user interface in a dedicated display area
US9401099B2 (en) * 2010-05-11 2016-07-26 AI Squared Dedicated on-screen closed caption display
US8798985B2 (en) * 2010-06-03 2014-08-05 Electronics And Telecommunications Research Institute Interpretation terminals and method for interpretation through communication between interpretation terminals
EP2587388A4 (en) * 2010-06-25 2018-01-03 Rakuten, Inc. Machine translation system and method of machine translation
JP5066242B2 (ja) * 2010-09-29 2012-11-07 株式会社東芝 音声翻訳装置、方法、及びプログラム
US11062615B1 (en) 2011-03-01 2021-07-13 Intelligibility Training LLC Methods and systems for remote language learning in a pandemic-aware world
US10019995B1 (en) 2011-03-01 2018-07-10 Alice J. Stiebel Methods and systems for language learning based on a series of pitch patterns
US8862462B2 (en) * 2011-12-09 2014-10-14 Chrysler Group Llc Dynamic method for emoticon translation
WO2013086666A1 (en) * 2011-12-12 2013-06-20 Google Inc. Techniques for assisting a human translator in translating a document including at least one tag
US9740691B2 (en) * 2012-03-19 2017-08-22 John Archibald McCann Interspecies language with enabling technology and training protocols
US8452603B1 (en) 2012-09-14 2013-05-28 Google Inc. Methods and systems for enhancement of device accessibility by language-translated voice output of user-interface items
KR20140119841A (ko) * 2013-03-27 2014-10-13 한국전자통신연구원 애니메이션을 이용한 번역 검증 방법 및 그 장치
KR102130796B1 (ko) * 2013-05-20 2020-07-03 엘지전자 주식회사 이동 단말기 및 이의 제어방법
JP2015060332A (ja) * 2013-09-18 2015-03-30 株式会社東芝 音声翻訳装置、音声翻訳方法およびプログラム
US9754591B1 (en) * 2013-11-18 2017-09-05 Amazon Technologies, Inc. Dialog management context sharing
US9195656B2 (en) 2013-12-30 2015-11-24 Google Inc. Multilingual prosody generation
US9614969B2 (en) * 2014-05-27 2017-04-04 Microsoft Technology Licensing, Llc In-call translation
US9740689B1 (en) * 2014-06-03 2017-08-22 Hrl Laboratories, Llc System and method for Farsi language temporal tagger
JP6503879B2 (ja) * 2015-05-18 2019-04-24 沖電気工業株式会社 取引装置
KR101635144B1 (ko) * 2015-10-05 2016-06-30 주식회사 이르테크 텍스트 시각화와 학습자 말뭉치를 이용한 언어학습 시스템
US10691898B2 (en) * 2015-10-29 2020-06-23 Hitachi, Ltd. Synchronization method for visual information and auditory information and information processing device
KR101780809B1 (ko) * 2016-05-09 2017-09-22 네이버 주식회사 이모티콘이 함께 제공되는 번역문 제공 방법, 사용자 단말, 서버 및 컴퓨터 프로그램
US20180018973A1 (en) 2016-07-15 2018-01-18 Google Inc. Speaker verification
US9747282B1 (en) 2016-09-27 2017-08-29 Doppler Labs, Inc. Translation with conversational overlap
CN108447348A (zh) * 2017-01-25 2018-08-24 劉可泰 语言学习的方法
US11144810B2 (en) * 2017-06-27 2021-10-12 International Business Machines Corporation Enhanced visual dialog system for intelligent tutors
US10841755B2 (en) 2017-07-01 2020-11-17 Phoneic, Inc. Call routing using call forwarding options in telephony networks
CN108090053A (zh) * 2018-01-09 2018-05-29 亢世勇 一种语言转换输出装置及方法
CN108563641A (zh) * 2018-01-09 2018-09-21 姜岚 一种方言转换方法及装置
US10423727B1 (en) 2018-01-11 2019-09-24 Wells Fargo Bank, N.A. Systems and methods for processing nuances in natural language
US12602554B2 (en) 2018-05-02 2026-04-14 Language Scientific, Inc. Systems and methods for producing reliable translation in near real-time
US11836454B2 (en) 2018-05-02 2023-12-05 Language Scientific, Inc. Systems and methods for producing reliable translation in near real-time
US11763821B1 (en) * 2018-06-27 2023-09-19 Cerner Innovation, Inc. Tool for assisting people with speech disorder
US10740545B2 (en) * 2018-09-28 2020-08-11 International Business Machines Corporation Information extraction from open-ended schema-less tables
US10902219B2 (en) * 2018-11-21 2021-01-26 Accenture Global Solutions Limited Natural language processing based sign language generation
US11250842B2 (en) * 2019-01-27 2022-02-15 Min Ku Kim Multi-dimensional parsing method and system for natural language processing
KR101986345B1 (ko) * 2019-02-08 2019-06-10 주식회사 스위트케이 기계독해 성능향상을 위해 표·이미지에 메타 문장을 생성하는 장치
CN111931523A (zh) * 2020-04-26 2020-11-13 永康龙飘传感科技有限公司 在新闻播报实时翻译文字和手语的方法和系统
US11620328B2 (en) 2020-06-22 2023-04-04 International Business Machines Corporation Speech to media translation
CN111738023A (zh) * 2020-06-24 2020-10-02 宋万利 一种图文音频自动翻译方法及其系统
CN112184858B (zh) * 2020-09-01 2021-12-07 魔珐(上海)信息科技有限公司 基于文本的虚拟对象动画生成方法及装置、存储介质、终端
US20220237660A1 (en) * 2021-01-27 2022-07-28 Baüne Ecosystem Inc. Systems and methods for targeted advertising using a customer mobile computer device or a kiosk
US20260122108A1 (en) * 2024-10-28 2026-04-30 Micro Focus Llc Systems and methods for automatic security rule generation

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02121055A (ja) * 1988-10-31 1990-05-08 Nec Corp 点字ワードプロセッサ装置
US5510981A (en) * 1993-10-28 1996-04-23 International Business Machines Corporation Language translation apparatus and method using context-based translation models
US6022222A (en) * 1994-01-03 2000-02-08 Mary Beth Guinan Icon language teaching system
AUPP960499A0 (en) * 1999-04-05 1999-04-29 O'Connor, Mark Kevin Text processing and displaying methods and systems
JP2001142621A (ja) * 1999-11-16 2001-05-25 Jun Sato エジプト象形文字を用いた文字通信
AU2001250975A1 (en) * 2000-03-24 2001-10-08 Eliza Corporation Phonetic data processing system and method

Also Published As

Publication number Publication date
TW200416567A (en) 2004-09-01
JP2006510095A (ja) 2006-03-23
AU2003223701A1 (en) 2004-06-30
JP4448450B2 (ja) 2010-04-07
CN1742273A (zh) 2006-03-01
WO2004053725A1 (en) 2004-06-24
KR20050086478A (ko) 2005-08-30
EP1604300A1 (en) 2005-12-14
US20040111272A1 (en) 2004-06-10

Similar Documents

Publication Publication Date Title
Graham et al. Evaluating OpenAI's Whisper ASR: Performance analysis across diverse accents and speaker traits
JP4448450B2 (ja) 多モードの音声言語翻訳及び表示
Morrissey Data-driven machine translation for sign languages
Porta et al. A rule-based translation from written Spanish to Spanish Sign Language glosses
Al-Barahamtoshy et al. Arabic text-to-sign (ArTTS) model from automatic SR system
US20050119899A1 (en) Phrase constructor for translator
Dhanjal et al. An optimized machine translation technique for multi-lingual speech to sign language notation
Kar Ingit: Limited domain formulaic translation from hindi strings to indian sign language
Tuveri A Comprehensive Review of Sign Language Production
Evangeline A survey on Artificial Intelligent based solutions using Augmentative and Alternative Communication for Speech Disabled
Othman et al. An XML-gloss annotation system for sign language processing
Aljasser et al. A web-based interface to calculate phonological neighborhood density for words and nonwords in Modern Standard Arabic
Pae Written languages, East-Asian scripts, and cross-linguistic influences
Cook Lexical coinages in Mandarin Chinese and the problem of classification
JP6298806B2 (ja) 音声翻訳システム及びその制御方法、並びに音声翻訳プログラム
TW480430B (en) Communication assistance system collocating with sign language keyboard, sentence generation and audio-visual feedback output
Gayana et al. Enhancing communication through speech to sign language converter
Carbonell et al. Language technologies for humanitarian aid
Oak et al. RETRACTED CHAPTER: Literature Review on Sign Language Generation
Sudeshna¹ et al. Framework for Indian Sign Language
Grosso Methodological Issues in Constructing a Typology of Pointing in Signed Languages
Shukla et al. Speech to Sign Language Translator Interface.
Phokaow et al. Enhancing Deaf Comprehension Through Thai Subtitles Aligned with Sign Language Syntax
Almohimeed Arabic text to Arabic sign language example-based translation system
Dasgupta et al. A Framework for the Automatic Generation of Indian Sign Language.

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees