TW201222403A - Multilingual voice control system and method thereof - Google Patents

Multilingual voice control system and method thereof Download PDF

Info

Publication number
TW201222403A
TW201222403A TW99140141A TW99140141A TW201222403A TW 201222403 A TW201222403 A TW 201222403A TW 99140141 A TW99140141 A TW 99140141A TW 99140141 A TW99140141 A TW 99140141A TW 201222403 A TW201222403 A TW 201222403A
Authority
TW
Taiwan
Prior art keywords
text message
language
text
message
mode
Prior art date
Application number
TW99140141A
Other languages
Chinese (zh)
Inventor
Chau-Cer Chiu
Zhe Feng
Original Assignee
Inventec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Corp filed Critical Inventec Corp
Priority to TW99140141A priority Critical patent/TW201222403A/en
Publication of TW201222403A publication Critical patent/TW201222403A/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Machine Translation (AREA)

Abstract

A multilingual voice control system and a method thereof are provided. The system and the method thereof are applicable for integrated communication platform with multiple language versions. The system and the method pre-establish control commands of multiple language versions, read a source language and a target language selected from supported languages of an operating interface, and identify a received voice message into a source lingual text message. When the operation mode is set to be command mode, the system and the method activate the function component with such source lingual text message. When the operation mode is set to be edit mode, the system and the method translate the source lingual text message into a target lingual text message, and then output the target lingual text message. By completing the procedure, the system and the method thereof can achieve the effect of simplifying the input operation of multilingual communication.

Description

201222403 六、發明說明: 【發明所屬之技術領域】 -種語音控制純及其方法’制係指—種適祕具有至少 -語言版本操作界面的軌整合平台的語音控概統及其方法。 【先前技術】 ~ ' 隨著網路與通訊科技的發展,電子郵件、即時軌及網路電 話等電腦可執行的通訊系統除了大幅縮短了空間上的限制,也使 得人與人之_溝通互動更加即時,在講求國際化的今日, 無論是迎合跨國商業合作或是個人尋求特殊語言經驗的訴求,這 些通訊系統仍然是-時之選。由於各種通訊系統之間有時基於多 語通訊的雙方所制的通訊界面不同無法彼此互通,因此坊間便 出現-種通訊整合平台,藉由整合電子郵件、即時通訊及網路電 話等通訊系統於同-執行平台上來實現不同通訊界面之間的通訊 機制,如此一來便降低了多語通訊的雙方通訊的限制。 然而’雖紐過通·合平台進行多語軌的雙方可以在任 何收得到網路訊號的地方進行溝通,但在某些情況下使用者可能 無法使用如.H、鍵盤及觸控I置等的輸人裝置來控制操作界 面或輸入訊息。例如:行車駕駛中不熟悉外語的使用者無法專二 的利用手機按鍵來輸人外語訊息,或是與外語人士視訊會議時, 因聽不懂外語人找義又孙如何拼料語字詞,因而無法與 外語人士對答如流等’此時雖然使用者可以透過通訊整合平二進 行多語通訊,但多語溝通的互動中仍畴在障礙,因此有必:提 出改進的技術手段,來解決此一問題。 【發明内容】 201222403 2於先術存在的_,本發簡揭露—㈣語語 刺,其中: 本發明所揭露之多縣音控_統,翻士201222403 VI. Description of the invention: [Technical field of invention] - Voice control pure and its method system refers to a voice control system and method for a track integration platform having at least a language version operation interface. [Prior Art] ~ 'With the development of Internet and communication technologies, computer-executable communication systems such as e-mail, live track and Internet telephony have greatly shortened the space constraints and made people interact with each other. Even more so, today, when it comes to internationalization, whether it is to cater to multinational business cooperation or individuals seeking special language experience, these communication systems are still the best choice. Since communication interfaces between different communication systems sometimes based on multi-lingual communication cannot communicate with each other, there is a communication integration platform, which integrates communication systems such as e-mail, instant messaging and VoIP. The same-execution platform is used to implement the communication mechanism between different communication interfaces, which reduces the limitation of communication between the two parties of multi-lingual communication. However, although both sides of the multi-language track can communicate with any network that receives the network signal, in some cases the user may not be able to use such as .H, keyboard and touch I. The input device controls the operation interface or inputs a message. For example, users who are unfamiliar with foreign languages in driving can't use the mobile phone buttons to input foreign language messages, or when they are in a video conference with a foreign language person, because they can't understand foreign languages, they can find meanings and words. Therefore, it is impossible to answer questions with foreign language people. At this time, although users can integrate Ping Er into multilingual communication through communication, the interaction of multilingual communication still faces obstacles. Therefore, it is necessary to propose improved technical means to solve this problem. problem. [Description of the Invention] 201222403 2 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

的通訊整合平台,所述之通訊整合平台係用以;; 電子郵件、即時通訊及網路電話之間的雙向通訊,所述 及1:讀取模組’用以讀取操作界面目前使用的操作模式 立辨触本中選取設定的來源語言及目標語言,·語 二L、t’用以接收語音訊息’並將語音訊息辨識為來源語言 表齡ΐ伟息;㈣额,預鍵立有㈣命令表,控制命令 麟界面巾至少—魏顯示元件的至少—語言版本的顯 以根據第—文字訊息查詢控制命令表以觸發顯示文 ” 一文子訊息綱的魏顯示元件;崎 =息_目_㈣…訊息;咖組,二C 韋刼作核式並傳送第一文字訊息’其中當操作模式為命令模式 日主’將第-文字訊息傳送至控制模組中,當操作模式為編輯‘ 二將,-文字訊息傳送至翻譯模組中;及輸出模植,用以輸二 第二文字訊息。 1 本發明所揭露ο語語音控财法,義於具有至少—心 2操作界面騎訊整合平台,·之通訊整合平台_以= 者進仃電子郵件、即時通訊及網路電話之間的雙向通訊 包含下列步驟:預先建立控制命令表,控制命令表錯存^ =乍界面的至少-魏顯示元件的至少—語言版本_示文字; 二取自至少—語言版本中選取設定的來源語言及目標語言 吾音訊息並將語音訊息辨識絲源語言的第—文字訊息;及讀取 201222403 目雌_操作模式,^中:當操作模式為命令 二B«第-文子訊息細控制命令表_發顯示文字與 :字訊灿_功能顯示树;及當操作模式為編輯模式時, 將第一文子訊息翻譯為目標語言的第二文字訊息並輸出。 本發明所揭露之系統與方法如上,與先前技術之㈣差 於本么明具有預先建立多語言版本的㈣命令,並讀取自操作界 面支援的多種語言中所選取設定的來源語言及目標語言,當接收 到語音訊树將語音訊息韻縣源語言的文字訊息,當二作模 式為命令模式時_發操作界面中顯 與辨識出的文字¥ 相同的功能顯示元件,當操作模式為^模式時則翻譯辨識^ 文子sfl息為目標語言再輸出的技術手段。 透過上述的技術手段,本發明可以達成簡化多語溝通互 輸入操作的技術功效。 【實施方式】 以下將配合圖式及實細來詳細說明本發明之實施方式,藉 此對本發明如何應職術手段轉決麟問職達成技術功效的 實現過程能充分理解並據以實施。 , 首先,請先參考I「第1圖」,為本發,之多語語音控制系統的 方塊圖’其包含:讀取模組101、語音辨識&組102、選擇模組1〇3、 控制模組104、翻譯模組105及輸出模組1〇6。本發明之多語語音 控制系統’適用於具有至少-語錄本的操作界面的通訊整合平 台,在此所指的通訊整合平台係用以供使用者進行電子郵件、即 B夺通訊及網路電話之間的雙向通訊。至少—語言版本的操作界 面’指的是同-通訊整合平台的操作界面,不同語言版本的操作 201222403 界面差別僅在於功能顯示元件的顯示文字不同。 頃取模組ιοί,用以讀取操作界面目前使用的操作模式及讀 取自至少-語言帽取設定的來源語言及目標語言。需要特別說 明的是’來·言與目標語言都是自操作界面支援的至少一語言 甲選取4的,可以是系統預先設定的,也可以是使用者透過預 先提供的設定界面自行設定的’而預先提供的設定界面中可以提 供操作界面支_至少—語言作為翻供朗者觀設定。 識模址102 ’用以接收語音訊息,並將語音訊息辨識 立二原二的第一文字訊息。語音辨識模組102當中可以預先建 支援的至少—個語言分別對應的語謂料庫,每個 含彻本及物文谢,當語音辨識 再盘來、^ 訊息後’將會針對語音訊息進行取樣,然後 _====:㈣庫_音腳本比對,最後將語音訊 模式=:::rr出讀取模組101讀取的操作 有兩種模式,一為命令模;,另先提:的’僅具 行使用者自兩種操作模式中選擇其中一種執 仃相對應的插作,因此判斷操 w 讀取模組⑼所讀取的操作模式即^擇模組103僅需判斷 或編輯模式。當操傾#命1^=前制的是命令模式 音辨識模組1〇2辨識產生的第_^時,選擇模組103將會把語 行後續處理,當操作模式為編輯模=息,送給控制模組⑽進 音辨識模組1。2 _產生 三擇模組1G3將會把語 、 文予訊息傳送給翻譯模組105進 201222403 行後續處理。_⑽相#於貞責分派 組為何則視操作模式而定。 收作的松 控制模組1G4 ’縣建立有控制命令表。控制命令表 :有::界面中至少一功能顯示元件的至少一語言版本的: 二=示,的是如下拉式選單的選項、視窗頁鐵選項、 功^按鍵以例來說’假設現有—功能顯示元件為操作界面的 匕鍵’其中文顯示文字為“插入,,,則控制命令表中 =示文字,同日請賴魏_ 也 存:作界面支援的語言版本的顯示文字,例如:英::: 作槿日文版本的“掉入”…等。當選擇模組103判斷出操 2模式為命令模鱗,额阳料㈣—文物 組r此時控制模組104將會根據第-文字訊二 日文字與第—文字訊息相同的功能顯示元件 而纽m ^⑽件。舉例來說,假設來源語言為中文, 觸㈣,蝴“翁,,則當控制 控制命令表中找到中文顯示文字為“編輯,,的功能 :件時,控制模組104將會觸發“編輯,,功能顯示元件。 士進別綱的疋’由於第—文字訊息係根據設定的來源語 =1二_所產生的,因此當㈣者使用的μ文操作界 產Μ二胃言’則此時語音辨識模組102辨識 、-文字訊息將會為英文’而控制模组104查詢控制命令 時加以文的顯示文字,並於找到符合的功能顯示元件 二=^城’操作界面所使料語言與命令模式下觸 “顯料件的顯示文字可以是相同語言,也可以是不同語 201222403 言,因此對於使用中文操作界面的中文使用者來說,可以使用中 文語音觸發巾文的魏顯示元件,而使时文操作界面的英文使 用者來說,也仍然可以使用英文語音觸發功能顯示元件。由於不 同語言版本的操作界面僅是顯示文字的語言有所差異,但功能顯 示元件所對應的功能相同,因此即使是英文使用者,只要曾經操 作過英文操作界Φ ’也可賤過英文語音操作巾域作界面中與 英文操作界面相同功能的功能顯示元件。如此一來,對於不同語 5的使用者來說,更可以提升簡化乡語溝通互織人操作的功效。 翻譯模組105,用以將第一文字訊息翻譯為目標語言的第二 文字訊息。鱗模組1G5料也可以預先建立至少—個雙語資料 ^各個雙語資料庫當中可崎存第_語言_為第二語言的文 子貪料項’此外翻譯模組1〇5也預先建立有翻譯規則設定,當選 擇柄組1〇3觸出操作模式為編輯模式並將第一文字訊息傳送到 翻賴組105當中時,翻職組1〇5可以依據讀取模組!⑴讀取 出的來源^與目標語言選取對應的雙語資料庫及翻譯規則設定 來將第-文字訊息翻譯為第二文字訊息。 翻澤模組1〇5除了負責將第一文字訊息翻譯為第二文字訊息 更用來針對已經輸出的文字訊息進行校正^舉例來說,前— ^翻澤出來的文字訊息和新輸出的文字訊息賴都是經過翻譯 生,但段落與段落之間可能語句並不通順或是文法錯誤,因此 =譯模組奶可崎__已輸㈣文字訊息進行語序或是文 任正調整,提升文字的流驗。由於翻譯校正的方式眾多’ p、、悉語言翻譯演算法者均可在本㈣的揭露前提下提出 、父正演減’在此騎對本發日嫌關校正方式加崎述並限 201222403 定之。 ι 輸4翻譯模組1G5翻譯出的第二文字訊 :4=二,輸出模組106除了將第二文字訊息輸出 ,,面外’咖軸嶋的—贿音· 1〇7將第二 这為語音輪出,如此—來,更可以實現不同的語言的 —之間的崎轉換,提升使用者多語溝猶的互動效果。 參考第2圖」’為本發明之多語語音控制方法的 =圖’將_制本發_實施流程。本發明之多語語音控制 / k用於具有至少—語言版本操作界面的軌整合平台。在此 f指的通訊整合平台_以供使用者進行f子郵件、即時通訊及 =路電話之_雙向通訊。至少—語言版本的操作界面,指的是 ^通訊整合平台賴作界面,不同語言版本輯作界面差別僅 在於功能顯示元件的顯示文字不同。 2,預鍵立控齡令表(㈣2G1)。㈣命令表當中儲存 ΐ作界面中至少—功能顯示元件的至少—語言版本的顯示文 子。功能顯示元件指的是如下拉式選單的選項、視窗頁籤選項、 1能鍵···等。舉例來說,假設現有一功能顯示元件為操作界面的 功此按鍵,其中文顯示文字為“插人,,,則控制命令表中除了中 ^顯示文字“插ν’ ’同時對應該功能顯示元件的資料項也會儲 ,操作界面支援的語言版本賴示文字,例如:英文版本的 “insert”、日文版本的“挿入,,…等。 、 1接著,讀取自至少一語言版本中選取設定的來源語言及目標 語言(步驟2G2)。需要制說明的是,來源語言與目標語言都是^ 操作界面支制至少m雜設定的,可m細先設定 的也可以疋使用者透過預先提供的設定界面自行設定的,而預 201222403 輪犧㈣-語言作為選 字音訊息麵語音訊息_縣言的第一文 子成息^驟203)。系統當中可以預先建立與操作界 音二語言資料庫,每個語言資料庫當中均包含i 語音讀本’當接收到語音訊息後,祕將會針對 聊二ϊ,ϊ後將^後f與來源語言對應的語言資料庫的語音 于最後將語音訊息辨識產生第一文字訊息。 操作息產线,純接賴取操作編前使用的 驟2〇5)'〜4) ’並判斷操作模式為命令模式或編輯模式(步 表以模式為命令模柄,根據第—文字訊息麵控制命令 表以觸發料文字鮮—文字訊息相 =),=,假設來源語言為中文的第-文字訊二: 旬控制命令表找到中文顯示文字為“ 顯=件時,系統將會觸發“編輯”功能顯示元件。 H概_是,由於第—文字訊息係根據設定的來源語 辨識所產生的’因此當使用者使用的是中文操作界 白了英文作為來源語言,則此時辨識產生㈣—文字訊 為英文’而細控制命令树,將會搜尋英文_示文字, 所伯找到符合的功能顯示树時加以觸發。換㈣說,操作界面 =吏用的語言與命令模式下觸發的功能顯示耕的顯示文字可以 言’也可以是不同語言,因此對於使时文操作界面的 用麵說’可贿財文語音紐巾文的魏顯示元件, =中文操作界面的英文使用者來說,也可以使用英文語音觸 d痛7F元件。由於不同語言版本的·界面僅是顯示文字的 201222403 二異’但功能顯示元件所對應的功能相同,因此即使是 H 對於^語謂錢者麵,更可以提升簡化多 §吾溝通互動輸入操作的功效。 的第當模ί為編輯模式時,將第—文字訊息翻譯為目標語言 輸出(步驟2G6b)。系統當中可以預歧立至少 ;』二=資=雙=庫當中可以儲存第-語言翻譯為 /备、, 枓員,此外也可以預先建立翻譯規則設定,當 杈式為編輯模式時’系統便依據讀取出的來源語 G料庫及鱗麵奴來翻譯第- 二=制說明的疋,第二文字訊息可以是輸出到操作界面 的文字訊息再轉為語音訊息再輸出。而已輸 蝴選取並進行語序或文法等的校正調 接下來’將以U有本發明的通訊整合平台的電子郵件系 統操作過_為實_來制本發明卿細實施方式。 月多考第3圖」,假设電子郵件系統的操作界面綱具有中 二法,、曰文、西班牙文...等至少一種語言版本,、系統 可預先自敍少-語言中選取來源語言及目標語言,也可以產生 設定界面301供使用者設定來源語言及目標語言。 應用有本發_通訊整合平台必翻先建立如「第4所 示的控制命令表4G1,控制命令表中儲存有魏顯示元件及至 少1吾言版本_示文字。絲控制命令表·當巾轉中文及 英文語言版本的顯示文字為例,實際上控制命令表姻的語言版 12 201222403 本係根據該通訊整合平台的操作界面所支援的語言為準,而不以 所舉例的為限。 接著,假設目前設定的來源語言為中文,目標語言為英文, 通訊整合平台首先將會讀取選取的來源語言及目標語言。請參考 「第5圖」,當通訊整合平台接收到語音訊息5〇ι “槽案,,時,首 先將會根據來源語言的設定將語音訊息5〇1 “檔案,,辨識為中文 文子訊息。接著通訊整合平台將會讀取操作界面3〇〇目前所使用 的操作模式,假設目前所使用的操作模式為命令模式,則當通訊 正合平台判斷出操作模式為命令模式後,將會把中文文字訊息與 控制中令表中各個功能顯示元件的顯示文字進行比對,假設比對 出中文文字訊息與功能顯示元件5〇2的顯示文字相同,此時通訊 整合平台將會觸發功能顯示元件5G2。於本實施财,功能顯示元 件502為下拉式選單的選項,因此觸發功能顯示元件後,下 拉式,單503將會被觸發並顯示出來。雖然在本實施例中以下拉 式選單的翻為例說明魏顯*元件賴發方式,但實際上功能 顯示元件更可叹視窗賤或是其他視針具有締^且可^ 發執行的顯示元件。 自請參考「第6圖」。假設通訊整合平台所接㈣語音訊 則通訊整合平崎會先將語魏“⑴ 訊息,錄作模式為編輯模式時,通訊整合平台 主會把中文文字訊息先翻譯為英文“ Howare卿Communication integration platform, the communication integration platform is used;; two-way communication between e-mail, instant messaging and internet telephony, and 1: reading module 'used to read the current interface used by the operation interface The operation mode distinguishes the source language and the target language selected in the book, and the second language L, t' is used to receive the voice message 'and the voice message is identified as the source language age and the great message; (4) the amount, the pre-key has (4) The command table, the control command Lin interface towel at least - the display of at least the language version of the Wei display unit according to the first text message query control command table to trigger the display of the text "a text message of the Wei display element; _ (four)... message; café group, two C Wei Wei nucleus and send the first text message 'When the operation mode is command mode day master', the first text message is transmitted to the control module, when the operation mode is edit 'two The text message is transmitted to the translation module; and the output module is used to input the second text message. 1 The invention discloses a voice control method, which has at least a heart-to-heart interface. level Taiwan, the communication integration platform _ to = enter the two-way communication between e-mail, instant messaging and VoIP: the following steps: pre-establish control command table, control command table error ^ = 乍 interface at least - Wei At least - language version of the display component - display text; secondly from at least - the language version selects the set source language and the target language, the voice message and the voice message identifies the first text message of the silk source language; and reads 201222403 _ operation mode, ^: when the operation mode is command two B « the first - text message fine control command table _ send display text and: word message _ function display tree; and when the operation mode is edit mode, the first text The message is translated into a second text message of the target language and output. The system and method disclosed in the present invention are as described above, and the prior art (4) is different from the prior art (4) command having a pre-established multi-language version, and the self-operation interface support is read. The source language and target language selected in the multi-language language, when receiving the voice message tree, the voice message is the text message of the source language of the county, and the second mode In the command mode, the same function display component is displayed in the operation interface, and when the operation mode is the ^ mode, the technical means of translating and identifying the text sfl is the target language re-output. The present invention can achieve the technical effect of simplifying the multi-lingual communication and mutual input operation. [Embodiment] Hereinafter, the embodiments of the present invention will be described in detail in conjunction with the drawings and the actual details. The implementation process of achieving technical efficiency can be fully understood and implemented. First, please refer to I "1st picture", which is a block diagram of the multilingual voice control system of the present invention, which includes: a reading module 101, The voice recognition & group 102, the selection module 1〇3, the control module 104, the translation module 105, and the output module 1〇6. The multi-lingual voice control system of the present invention is applicable to a communication integration platform having at least a quotation-based operation interface, and the communication integration platform referred to herein is used for users to perform email, that is, B-capable communication and VoIP. Two-way communication between. At least the language interface's operation interface refers to the operation interface of the same-communication integration platform. The operation of different language versions 201222403 The interface difference is only that the display characters of the function display components are different. The module ιοί is used to read the operation mode currently used by the operation interface and the source language and target language read from the at least-language cap setting. It should be specially stated that 'the words and the target language are selected from at least one language supported by the operation interface, which can be set by the system in advance, or can be set by the user through the preset setting interface. The pre-provided setting interface can provide an operation interface support _ at least - the language is set as a confession. The fingerprint address 102' is used to receive the voice message and to identify the first text message of the second voice. The voice recognition module 102 can pre-build at least one language corresponding to the language and the corresponding material library, each of which contains the text and the text, and when the voice recognition is repeated, the message will be followed by the voice message. Sampling, then _====: (4) library _ sound script comparison, and finally the voice message mode =::: rr out of the reading module 101 read operations have two modes, one for the command mode; It is mentioned that only the user has selected one of the two operation modes to select one of the two operation modes. Therefore, it is judged that the operation mode read by the operation reading module (9) is only required to be judged. Or edit mode. When the operation of the command #命1^= is the _^ generated by the command mode tone recognition module 1〇2, the selection module 103 will process the line subsequently, when the operation mode is edit mode=content, It is sent to the control module (10) to the sound recognition module 1. 2 _ The generation of the three-selection module 1G3 will transmit the message and the message to the translation module 105 for subsequent processing in 201222403. _(10)相# depends on the assignment mode. The control module 1G4 ’ County has a control command table. Control command table: There are at least one language version of at least one function display component in the interface: 2 = display, the following pull menu option, window page iron option, function ^ button to say 'assume existing' The function display component is the 匕 key of the operation interface. The Chinese display text is “insert,,, then the control command table=display text. On the same day, please ask Wei _ also: display text of the language version supported by the interface, for example: English ::: For the Japanese version of "Drop"...etc. When the selection module 103 determines that the 2 mode is the command mode scale, the amount of material (4) - the cultural relic group r at this time the control module 104 will be based on the first text message The second-day text and the first-text message display the same function and the element is m^(10). For example, if the source language is Chinese, touch (4), and the butterfly "Weng,", when the control control command table finds the Chinese display text, "Edit," function: When the piece is selected, the control module 104 will trigger "Edit," the function display element. Since the first text message is generated according to the set source language = 1 _, the voice recognition module 102 is now used when the (4) user uses the syllabus. The identification, the text message will be in English', and the control module 104 queries the control command to display the text of the text, and finds the corresponding function display component 2 = ^ city's operation interface in the language and command mode touches " The display text of the display material can be the same language or the different language 201222403. Therefore, for Chinese users who use the Chinese operation interface, the Chinese voice can be used to trigger the Wei display component of the towel, and the time operation interface can be used. For English users, the English voice trigger function display component can still be used. Since the language of the different language versions differs only in the language in which the text is displayed, the functions of the function display elements are the same, so even in English. As long as you have ever operated the English operation field Φ 'You can also use the English voice operation field to make the same function as the English operation interface in the interface. The function display component. In this way, for the user of the different language 5, the function of simplifying the operation of the inter-language communication inter-weaving operation can be improved. The translation module 105 is used to translate the first text message into the second language of the target language. Text message. Scale module 1G5 material can also be pre-established at least - bilingual data ^ each bilingual database can be stored in the first _ language _ for the second language of the text greedy item 'In addition to the translation module 1 〇 5 is also pre-established There is a translation rule setting. When the selection handle group 1〇3 touches out the operation mode to the edit mode and transmits the first text message to the rumbling group 105, the turn-over group 1〇5 can read out according to the reading module! (1) The source^ and the target language select the corresponding bilingual database and translation rule settings to translate the first-text message into the second text message. The lithography module 1〇5 is responsible for translating the first text message into the second text message. To correct the text message that has been output. ^ For example, the text message and the newly output text message are translated by the translator, but the paragraph and the paragraph may be The statement is not fluent or the grammar is wrong, so = translation module milk can be __ has been lost (four) text message for word order or text Renzheng adjustment, improve the text of the test. Because of the many ways of translation correction 'p, Anyone who understands the language translation algorithm can propose it under the premise of this (4) disclosure, and the father is performing the reduction. This is the translation of the correction method of this issue. It is limited to 201222403. ι Translate 4 translation module 1G5 translated The second text message: 4 = two, the output module 106 in addition to the second text message output, the outside of the 'coffee axis' - bribe sound · 1〇7 will be the second this is the voice round, so - come, more It is possible to realize the conversion between different languages, and to enhance the interaction effect of the user's multi-lingual channel. Referring to Figure 2, "the multi-language voice control method of the present invention = map" will be implemented Process. The multilingual voice control /k of the present invention is for a track integration platform having at least a language version of the operational interface. Here, f refers to the communication integration platform _ for users to perform f-mail, instant messaging and _ two-way communication. At least the language version of the operation interface refers to the communication integration platform. The difference between the different language versions is that the display characters of the function display components are different. 2, pre-key control age order ((4) 2G1). (4) The display list stores at least the display text of at least the language version of the function display component. The function display element refers to the following options of the pull menu, the window tab option, the 1 key button, etc. For example, suppose the existing function display element is the operation button of the operation interface, and the Chinese display text is “insert,”, in addition to the middle display text “plug ν′′ in the control command table, and corresponding to the function display element The data item will also be stored, and the language version supported by the operation interface will be displayed, for example, the English version of "insert", the Japanese version of "insert, ..., etc., 1 then, read from at least one language version to select settings The source language and the target language (step 2G2). It is necessary to explain that the source language and the target language are ^ the operation interface supports at least m miscellaneous settings, and the m-first setting can also be provided by the user through the pre-provided The setting interface is set by itself, and the pre-201222403 round sacrifice (four)-language is used as the selected voice message surface voice message _ county language first interest rate ^ step 203). The system can pre-establish and operate the boundary sound two language database, each The language database contains i voice readers. 'When the voice message is received, the secret will be for the chat, and then the language data corresponding to the source language. At the end of the voice, the voice message is recognized to generate the first text message. The operation of the interest line is purely connected to the operation before the use of the program 2) 5) '~4) 'and determine the operation mode is command mode or edit mode (step table The mode is the command module, according to the first text message surface control command table to trigger the material text fresh-text message phase =), =, assuming the source language is Chinese - text 2: the Chinese control command table to find the Chinese display text In the case of “display”, the system will trigger the “Edit” function display component. H _ Yes, because the first text message is generated according to the set source language identification. Therefore, when the user uses the Chinese operation field to white English as the source language, then the identification is generated (4) - the text message is English' The fine control command tree will search for the English text, and the trigger will be triggered when the function display tree is found. Change (4) said, the operation interface = the language used and the function triggered in the command mode to display the display text of the plough can be said 'can also be a different language, so for the use of the interface of the time interface to say 'can bribe money voice For the English display component of the towel, the English user of the Chinese operation interface can also use the English voice to touch the D pain 7F component. Since the interface of the different language versions is only the 201222403 two-different display text, but the function corresponding to the function display component is the same, even if the H is for the Chinese language, it can improve the simplified multi-dimensional interaction input operation. efficacy. When the third mode is the edit mode, the first text message is translated into the target language output (step 2G6b). The system can be pre-discriminate at least; "two = capital = double = library can store the first-language translation into / /, 枓, in addition, you can also pre-establish translation rules settings, when the 杈 is the editing mode, the system will According to the read source language G library and the scales slave to translate the first-two system description, the second text message may be a text message output to the operation interface and then converted into a voice message and then output. The correction has been selected and the word order or grammar is adjusted. Next, the embodiment of the present invention will be implemented by the operation of the e-mail system of the communication integration platform of the present invention. In the third month of the multi-test, it is assumed that the operation interface of the e-mail system has at least one language version, such as the second method, the essay, the Spanish language, etc., and the system can select the source language and the target in advance. The language may also generate a setting interface 301 for the user to set the source language and the target language. The application has this _ communication integration platform must first establish the control command table 4G1 as shown in the fourth, the control command table stores the Wei display component and at least 1 version of the _ display text. Wire control command table For example, the display text of the Chinese and English language versions is used. In fact, the language version 12 201222403 of the control command is based on the language supported by the operation interface of the communication integration platform, and is not limited by the examples. Assume that the current source language is Chinese and the target language is English. The communication integration platform will first read the selected source language and target language. Please refer to Figure 5, when the communication integration platform receives the voice message 5〇ι In the case of "slot case," the voice message 5〇1 "file" will be recognized as a Chinese text message according to the setting of the source language. Then, the communication integration platform will read the operation mode currently used by the operation interface 3, assuming that the current operation mode is the command mode, then when the communication normal platform determines that the operation mode is the command mode, the Chinese will be Chinese. The text message is compared with the display text of each function display component in the control table. It is assumed that the Chinese text message is the same as the display text of the function display component 5〇2, and the communication integration platform will trigger the function display component 5G2. . In this implementation, the function display element 502 is an option of a pull-down menu. Therefore, after the function display component is triggered, the pull-down type, the single 503 will be triggered and displayed. Although in the present embodiment, the following pull-type menus are used as an example to illustrate the Wei Xian* component-releasing method, in reality, the functional display elements are more sinful, or other viewing pins have a display element that can be executed and executed. . Please refer to "Figure 6". Assume that the communication integration platform is connected (4) Voice communication communication integration Pingqi will first speak the language "(1) message, when the mode is edited, the communication integration platform will translate the Chinese text message into English first" Howare Qing

輸出時’除了將翻譯為英文的文字訊息輸出S 的文〜再透過通訊整合平台的—個發音模組來將英文 子。心再轉為語音訊息並透過音訊輸出裝置輸出,如并二办 當使用者餘鱗_界®時,健關錄輸A 息。此外’輸出到操作界面的英文文字訊息 201222403 語序或文法的翻譯校正來提高文字的流暢度。 雖然於本實施例中是以通訊整合平台的電子郵件系統舉例說 明’然無論是即時通訊或是網路電話㈣統也同樣可以透過本發 明之多語語音控财統及方法以語音操作騎鱗雜,故於此 不再加以贅述。 雖然本發騎揭露之實施方式如上,惟所述之内容並非用以 直接限林㈣之專娜護範目。任何本發賴屬技術領域中具 有通常知識者,在獨離本發明職紅精神和細的前提下, :以在實施_式上及細紅魅許之更I本發明之專利保護 $巳圍,仍須以所附之申請專利範圍所界定者為準。 【圖式簡單說明】 第1圖為本發明多語語音控⑽、賴方塊圖。 第2圖為本發明多語語音控制方法的流程圖。 第3圖為本發明實施_作界面及語言設定的示意圖。 第4圖為本發明實施例控制命令表示意圖。 第5圖為本發明實施例命令模式的操作示意圖。 第6圖為本發明實關編輯模式的猶示意圖。 【主要元件符號說明】 101 讀取模組 103 選擇模組 105 翻譯模組 107 發音模組 301 设定界面 501 語音訊息 503 下拉式選單 102 語音辨識模組 1〇4 控制模組 106 輸出模組 300 操作界面 401 控制命令表 502 功能_示元件 601 語音訊息 201222403 預先建立控制命令表 頊取自至少一語言版本中選取設定的來源語 接收語音tK息並縣音訊!觸為來源語 讀取操作界面目前使用的操作模式 判斷操作模式為命令模式或編輯模式When outputting, the text will be output as S in addition to the text message translated into English~ and then the English module will be transmitted through the pronunciation module of the communication integration platform. The heart is then converted to a voice message and output through the audio output device. For example, when the user is in the squadron, the user enters the A message. In addition, the English text message output to the operation interface 201222403 The translation correction of the word order or grammar to improve the fluency of the text. Although in the embodiment, the e-mail system of the communication integration platform is exemplified, 'whether it is instant messaging or Internet telephony (4), the multi-lingual voice control system and method of the present invention can also be used to operate the scales by voice operation. Miscellaneous, so I will not repeat them here. Although the implementation of the present disclosure is as above, the content described above is not intended to directly limit the forest (4). Anyone who has the usual knowledge in the field of technology of the present invention, under the premise of the spirit and fineness of the invention, is based on the invention and the patent protection of the invention. , still subject to the definition of the scope of the attached patent application. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a multi-lingual voice control (10) and a block diagram of the present invention. 2 is a flow chart of a multilingual voice control method of the present invention. Figure 3 is a schematic diagram of the implementation of the invention and the language setting. FIG. 4 is a schematic diagram of a control command table according to an embodiment of the present invention. FIG. 5 is a schematic diagram of operation of a command mode according to an embodiment of the present invention. Figure 6 is a schematic diagram of the actual editing mode of the present invention. [Main component symbol description] 101 Reading module 103 Selection module 105 Translation module 107 Pronunciation module 301 Setting interface 501 Voice message 503 Pull-down menu 102 Voice recognition module 1〇4 Control module 106 Output module 300 Operation interface 401 Control command table 502 Function_Display element 601 Voice message 201222403 Pre-establish control command table to retrieve the source t language from the at least one language version to receive the voice tK interest and county audio! Touch as source language Read the operation mode currently used by the operation interface. Determine the operation mode as command mode or edit mode.

步驟201 步驟202 言及目標語言 步驟203 的第一文字訊」 步驟204 步驟205 步驟206a 示文字㈣――轉第—文字H查詢控制命令表以觸發顯 -、第文子訊息相同的功能 步驟2%b將“〜貝不兀件 訊息並輪出 昂文子δί1息翻譯為目標語言的第二文字Step 201 Step 202: Talk to the first text message of the target language step 203. Step 204 Step 205 Step 206a Display text (4) - Turn the first text H query control command table to trigger the same function step of the display and text message 2%b "~Bai does not send a message and rotates the Ang Wenzi δί1 translation into the second language of the target language.

Claims (1)

201222403 七 1. 、申請專利範圍: 音控制系統’適用於一通訊整合平台,其中該通 y σ具有至〃 言版本的—操作界面,該通訊整合 供烟者進行f子郵件、即時通訊及網路電話之 間的雙向通訊,該系統包含: Μ ^取模且肖以讀取該操作界面目前使用的—操作模式 ^取自該至少―語言版本中選取設定的-來源語言及-目 標語言; 日職触’㈣接收—語音喊,並觸語音訊息 辨識為該來源語言的一第一文字訊息; 控繼組’預鍵立有—控制命令表,該控制命令表儲 子該操作界面中至少一功能顯示元件的該至少一語言版本 的顯示文字,·及㈣根_第—文字訊息查觸㈣命令表以 觸發簡f文字無第-文字訊息__功能顯示元件; 翻澤模組,用以將該第一文字訊息翻譯為該目標語言的 一第二文字訊息; ^選擇模組’肋比對躺轉作模式並傳賴第-文字 其中當§亥操作模式為一命令模式時,將該第一文字訊息 料f該控麵組中,當該操作模式為-編輯模式時,將該第 文予息傳送至該翻譯模組中;及 —輸出模組,用以輸出該第二文字訊息。 2.如^專利範圍第1項所述之多語語音控^統,其中該來 源5吾έ係為系統預先設定的或使用者透過預先提供的一設定 界面自行設定的。 201222403 3. 如申請專利翻第1項所述之多語語音控制系統,其中該目 標語言係為系統預先設定的或使用者透過預先提供的一設定 界面自行設定的。 4. 如申請專利範圍第1項所述之多語語音控·統,該翻譯模 組更用以於輸出該第二文字訊級校正已輸出的文字气自。 如申請專利範圍第i項所述之多語語音控制系統,其;^系 統更包含-發音模組1轉輸出的文字訊息再轉為語音訊 息輪出。 6· —種多語語音控制方法,翻於—通訊整合平台,其中該通 $合平台具有至少-語言版本的―操作界面,該通訊整合 吏,電子郵件、即時通訊及網路電話之 螬的雙向通sfL,§亥方法包含下列步驟. 目標語言版本帽取設定的—來源語言及一 第-並物音物㈣物語言的一 讀取並判_操作界面目前制的 當該操作模式為—命令模式時,根據 查詢該控制命令表簡發 勒第—文子訊息 相同的該功能顯示元件;及 九、該第一文字訊息 ¥ 5亥操作模式為一編錄握 譯為該目標語言的一—二"’將該第一文字訊息翻 第一文子訊息並輪出。 17 201222403 7. 如申請專利範圍第6項所述之多語語音控制方法,其中該來 源5吾s係為系統預先設定的或使用者透過預先提供的一設定 界面自行設定的。 8. 如申請專利範圍第6項所述之多語語音控制方法,其中該目 標語言係為系統預先設定的或使用者透過預先提供的一設定 界面自行設定的。 9. 如申請專利範圍第6項所述之多語語音控制方法,其中將該 第-文字訊息翻譯為該目標語言的該第二文字訊息並輪出的 步驟之後更包含校正已輸出的文字訊息的步驟。 、 10·如申請專利範圍第6項所述之多語語音控制方法,其中將該 第-文字訊息翻譯為該目標語言的該第二文字訊息並輪 步驟之後更包含將輸出的文字訊息再轉為語音訊息輪出的+ 驟。 ^201222403 VII. 1. Patent application scope: The sound control system is applicable to a communication integration platform, where the communication y σ has a spoof version-operation interface, which integrates the smoker to perform sub-mail, instant messaging and network. Two-way communication between road phones, the system comprises: Μ ^ modulo and read to read the operation interface currently used - the operation mode ^ is selected from the at least "language version selected - source language and - target language; The Japanese occupation touches (4) receiving-voice shouting, and the voice message is recognized as a first text message of the source language; the control group 'pre-key standing--control command table, the control command table store at least one of the operation interfaces The display text of the at least one language version of the function display element, and (4) the root_first-text message touch (four) command table to trigger the simple f text without the first-text message __ function display component; Translating the first text message into a second text message of the target language; ^Selecting a module' rib ratio to lie to mode and passing the first word to the text In a command mode, the first text message is f in the control group, and when the operation mode is the -edit mode, the message is transmitted to the translation module; and the output module is used for The second text message is output. 2. The multi-lingual voice control system of claim 1, wherein the source 5 is preset by the system or set by the user through a preset setting interface. 201222403 3. The multilingual voice control system as described in claim 1, wherein the target language is preset by the system or set by the user through a preset setting interface. 4. The multi-lingual voice control system according to claim 1, wherein the translation module is further configured to output the second text level correction to output the text gas. For example, in the multi-lingual voice control system described in the scope of claim i, the system further includes a text message outputted by the pronunciation module 1 and then converted into a voice message. 6. A multilingual voice control method, which is turned into a communication integration platform, wherein the communication platform has an operation interface of at least a language version, and the communication is integrated, e-mail, instant messaging, and VoIP. The two-way sfL, § hai method includes the following steps. The target language version is set to the source language and a grammatical object (four) language language read and judge _ operation interface current system when the operation mode is - command In the mode, according to the query, the control command table is the same as the function display element of the text message; and the first text message is a mode of the translation of the first language to the target language. 'Turn the first text message to the first text message and turn it out. The method of claim 6, wherein the source 5 is pre-set by the system or set by the user through a preset setting interface. 8. The multilingual voice control method according to claim 6, wherein the target language is preset by the system or set by the user through a preset setting interface. 9. The multilingual voice control method according to claim 6, wherein the step of translating the first text message into the second text message of the target language and rotating the step further comprises correcting the outputted text message. A step of. 10. The multi-lingual voice control method according to claim 6, wherein the first text message is translated into the second text message of the target language, and the step of the step further comprises rotating the output text message. + for the voice message. ^ 1818
TW99140141A 2010-11-22 2010-11-22 Multilingual voice control system and method thereof TW201222403A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW99140141A TW201222403A (en) 2010-11-22 2010-11-22 Multilingual voice control system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99140141A TW201222403A (en) 2010-11-22 2010-11-22 Multilingual voice control system and method thereof

Publications (1)

Publication Number Publication Date
TW201222403A true TW201222403A (en) 2012-06-01

Family

ID=46725227

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99140141A TW201222403A (en) 2010-11-22 2010-11-22 Multilingual voice control system and method thereof

Country Status (1)

Country Link
TW (1) TW201222403A (en)

Similar Documents

Publication Publication Date Title
US10917369B2 (en) Information processing apparatus, information processing system, and information processing method
CN108028042B (en) Transcription of verbal communications
WO2019214359A1 (en) Data processing method based on simultaneous interpretation, computer device, and storage medium
KR102045585B1 (en) Adaptive input language switching
CA2779117C (en) Automated systems and methods for integrated multi-platform communication including real-time language translation
KR102039553B1 (en) Method and apparatus for providing intelligent service using inputted character in a user device
KR20080094068A (en) Machine translation in instant messaging applications
JP2011182125A (en) Conference system, information processor, conference supporting method, information processing method, and computer program
TW200836077A (en) Internet-based computer for mobile and thin client users
US20160255024A1 (en) Systems and methods for managing presentation of message content at user communication terminals
KR102351408B1 (en) service method of automatically generating translated subtitles of video contents
KR102351400B1 (en) service method of automatically generating subtitles of video contents
KR102390187B1 (en) Method and system for providing translation for conference assistance
JP7142961B2 (en) multilingual keyboard system
KR101815957B1 (en) Method and server for providing user emoticon of online chat service
WO2023202721A1 (en) File transmission method and apparatus, and electronic device and storage medium
JP2017010311A (en) Translation support system, information processing device, and program
WO2020070959A1 (en) Interpretation system, server device, distribution method, and recording medium
TWI795081B (en) On-device real-time translation of media content on a mobile electronic device
JP7145988B2 (en) Translation service providing method using input application and terminal device using the same
TW201104461A (en) Translation system, method and interface thereof based on inputting phonetic symbols
US9569543B2 (en) Sharing of documents with semantic adaptation across mobile devices
KR20230076509A (en) service method of automatically generating subtitles of video contents
TW201222403A (en) Multilingual voice control system and method thereof
KR20200081163A (en) User emoticon offering method for social media services