GB2507797A - Translation application allowing bi-directional speech to speech translation and text translation in real time - Google Patents

Abstract

Speech input in a first language to a first device (device 1) such as a web platform or mobile platform is machine translated in real time and forwarded to a second device (device 2) via instant messenger or voice over IP (VoIP) protocols for output in a second language. The speech from the first device is preferably converted to text, is translated to the required language using a third-party translator and is then converted back to audio to be output as speech in the required language at the second device.

Description

jo uowuonai aqi.Joj MOift UrD p Os pai(ojdap 4X04 01 4X04 put qnaadg 0; 4YOj put;xai 04 qnaadg srq osjt anrpaiuj Jas am woij uoiwi2a;ui -sarnuti am jo uoqrjsutij i(nssaaau 041 JO jt 101 SMOJJt 4DJ4M rn.ioj;tid u011tJ5Ut.JJ 0UUjDtJA t 04111 paw.Ja;u1 T ODrIJOTUT fl5fl aq *urnssnN rads UtD O4M auoaujos 04 31rads uro UtIIIJOD qrads asoq auoauios put UtULJOD UT auoawos 04 31rads UrD qauai uujcads auoamos ajdumxa JOT.TOAO sson ost uro sarnuri aq D40 UflSSflN 4011014 utmJa qsTuuds qsuj 2a asn JOJ maisAs OIfl 04W Pa4tJa1UT aq TI!M inn sa2tn2uri jo.Jaqmnu r srq aq iurnpaiu aan; itat qaaads o; qaaads [tuoqDanp-q P thSfl asautqj 04 qst[u3 at uisooqa ataq; jo arnuti Jaqlour 04th PO4tISUEJT atflSUr[ aAtJtu SOUOOLUOS axuq pan iaqjo qata 44LM 04PDUflLitiUO3 aDD pa[r4sUt uoutnt1ddr aqj srq qniqM arnAap ploiput Auy (Moaq v tutj&ip put paqorjr um1rTp) OqtjTtAt 1(TIUO.L111D OAt4 3M 4r44 ariiflutri ALIt UT PIJOM 3144 UT1CLTt aJoqM1cur Josfi XOASUI&TL,cuP UIOTJ St3 aManaT put O3jtUI m sosn SMOITTT 1P1) XOASIII3JI çoaq j t11tJfl put O4Dt44t urJrnp) 4PM Ot5S0t11 JuTflsuT 01 4STM nbA aorjuoa 044 04O00S OAflj noA aouo AHrouruoJnr auop Si 341 jJbM 344 U! aJo4MAur spuauj TrPuOlOd put spunuj sonflr.ajjon 411M amp jr.oi Ui wqa urn.asn t Os Jauassw iumsui x0,Su13aj DpTAOJd M Q UJrJr!p) suopaonp ouoouios 31St Jo IUtJL1t4SOJ Jo uq 13 U! JOflEM r paoq o ajodnr Ut it JsTuoT4d030J u 4flM airD!utuuuIon uto LTOSfl 13 Os 0DL\0 13 U0 ajiisumij urn noX.4ITLJ) XOASULIJI. 4PM Ouasaid it pTo.Jpuv) smajsAs uptiado aoJAap ajiqom Joj uoi toijddr aiqom r Sr paproiuop aq urn aJrMlTos W dIOA uisn aun; ital U! uoiirIsuni i onoalip-iq qoaads 0 qaaads DTA0 04 aOJAap U13 aOJAap ajUJ5 IrfluTIPTflm J0J 4uasaJd it PTOJPUt SOD!Aap aITqoW JoJ uoptaqddt aqi padolaAap 05W aArq afik ft air.reip) (qsiurds pui qsii8uj put adA31s u!sn pado[aAap uaaq sEq adAio;ojd r -dodr o ad t usn) uJprqa qaM roj sjoo uOTjCoTunmuJoD asaq asn oi put NSW pu adA3j 10410 40E0 01 Jcads 01 5J0U0SS0W iurisu p ioaoioJd dIOA aqi asn 01 ajdoad A&OF TT!M 4!4 (fl) aOtJJOIUJ JOSfi padO1aAap Aurnoads r asn uto anMijos 041 rsJaA am put qstuudg 04 qSLU at arnuti 41344 JO 0P0IM0U joud ULAE4J0 paau Aim 4fl044LM itLS0O4D.1104110.taqiout 01 pairisuui 41 aAuq put aunuri aAt4Eu.11041 uL JEads 01 a1doad MOlit ano a.mA&4Jos aq sJawrq arn2uri J0 anssi aq4 4fl044iM pj.tOM 044.LaAo itt aioi a1doad 10410 04 rads 01 Apunjioddo 041 saasn apiAo.td ano xO\surJJ uoijdiiasau

I

(Mojaq v oas) uOTuSJaAuo3 qoods 01 4DQdS UJT1 tJ JOJ SMOIW I4OfflM O.JlljCJ AJJCA0UUT UC OS[B ST SUOTWJSUtTI SI[CD aDT0A 0141 JO.J ipnq 0Jfl1301T143LJ1 0141 uouEJsurJl aluti [car OpLAO.rd 01 SE OS JOUUELU SSOjLUEOS E Ut auop J[E St 5141 (Moaq)y urcarnp astajd) arnicaj 1E43 41 aoJ pur uitssaj lucIsul.ro put sjrj arno 4104.ro ijflcap Xq AlitoutwoiflE auop 51 511 sc uumd arniucj jo Apssaoau awosiaqiuno 041 1fl04)1M put aDuaLradxa aasn uaiora arou t utptAOJd snqi athrnucj lincJap sauoqd fl01 01 1JflE Aq as am SOcI1Uq SJOSrI ftc s a.raLI 1324 It3U4D01 041 L1011CI51LD.L1 IXOI 01 IXO1 0At4 sn1io oiouqoaj auiua qooads o xo; &usn 4ooads 0; 0P0AUO0 SF auop 00uO 40L4M p0NSutq oq 0 04 0)111 p pOAUOO put OOLOA OAL4cU S0UO0LUOS (j wtinip) tuitii3ip nuassatu ucisu XOASU13JI uqIrMr.i0J)JOOIjO UC) DTAj) JO 01 S11AJOjUT 13 LTaA.TOS * * 3j)O) itnuri i3UT1jOd)DTAOfl S rjos:oT ST I p * lxaT ST WJ U1OJt UOPUULTOJtJI sindw Js ounui pu ixj A Ufl0J 5! 1SS1IU _______________________ Z 331AE10 j)TprL\ t uaq XOASNIVIIJ T331A2111 rvtjcutii 4wtI pmp ____________________________ thitcu puunjzx1 ci.Iq1ourJ o f IU11LI1TQ aim j UOU33UflL ________________________________ (y mnanip) tunaflrnp iiua aaioA XOASUDJI rssatL' iuTprMr.ioJ)1aip 01 SItLkLT2IU! W JAJ2S auo tiap jo uiiiod. apo inui -pur)x ________ j. *q U0J0JS wdlno pocrjd 5! DflJ OTj)tW OtJJ.-;" OPOD spuos OOLAOU anduT qOOOd qooo s fU13 11011 Z 3DIAIU punoj ST orssom -. _________________. -__________ ______ r "°IM XOASNVIII T 3TA3U ojujsuvi iid pimp amT3UO OTpnt £pd piqj rnn paucpd s ntpoui oi IxaJ. o Aiwd pj &ITSTI oipnr 1 1XOJI J1OAUO) ttSU 1tIO tUOJ IJONflU1I 2uisn UOTSIOAUOO HSY y' iLIKJ6CI(j ( auap aq osie ue qoiqM uosiad pailedwi AIIens!A C.104 painbai AlleJiliJads ssaiun pas!I!;n aq o; (yDaad5 Oj;xajj SU.10410 (uo'T'u8oJaH ipaad paEwoTnv) HSV 104 s;uawaj'nbaj 011 SflL]T pue paAIOAu! tpaads ou! aiaj; TCL]4! a;ou 04 aDuaJaJJip Aa aLJj aJnTeaJ auassaw uesui aq4 2uisn uOflCD!unwwOD ario!p pa;elsuei1 e swiojiad iasn e uaqM uale;.Japun si ssaoid awes aqj (aAoqe we.18e!o) 4fld4fl0 tpaads C SC)E 4! sAcld pue lu!I aq; su!e;qo zaD!Aap aqi 6 z aJiAaq 04 paqsnd pue jajas XOASUCJ! aq; Aq pau'e;qo 51014 5t]4 04 NUil aLj 8 auiu tpaad CT;xaj kj.ied P'!t]T at]; Aq pa;eaua OSIC S apj 0!pfle u'' aDiAap 4aJe4 aq; jo a8enuei a;eiidojdde aqi 044! s;JaAUoJ YJ!qM iaias uoi;eisuei; A;jed piiq; B 04 UOITEISUEJ4 104 4X4 aij; spuas uaq; .laAJas XOASUEJI at]! 9 1 aap 40 a2en8uei aq; .104 5)1JL]D JOAJ5 XOASUEJI aqi ç JaAJaS X0SUCJj aL]4 04 4X4 L]4 spuas t aD!AarJ *i aap at]; Aq paft!aDai! qD!qM.laAJas A;jed piq; e Aq;xa; 04 4JAU0J Si ipaads aqj t aoiAa(] o;ui sNeads t J05fl saJ!Aap aq; 40 auoqdoi!w aq4 O4IJi ThJI)leads 4JE45 ue sjasn aq; jo.IaqT!a papauuoo 5! lIED 01j4 auo E as Aqz aDiAaa U0 paAiaDai aq UED t]DiI]M 4D24U03 JaLIIsiL] 04 lIED C saew aD!Aafl 110 Jasfl 1 liflejap Aq! aen&JeI paiiajad sit] JaAJas aq; q4!M sja;siaj.iasn aq; uaq 1 (oAoq y uiur!q)

Claims (9)

1. Claims 1) IransYox is a translation application that allows users to speak with each other in their native language to another in a 1aiguage they cannot speak or have little Imowledge of (i.e. English to Spanish and vice versa). The III (user interface) is new in that we have not seen an organisation develop a coinniercial application for use on a Web platform or mobile platform which uses speech o speech technology br ftanslalion purposes in a slandalone manner incorporating an Instant Messaging protocol for translation and a voice call feature (device to device) protocol for translation using a variety of languages.
2. 2) Based on claim (1) above the TransVox translation application can be inteated with a variety of instant messengers protocols (Skype, MSN live, QQ dc) to allow users a more eflicieni way o communicate with their contacts both domestically or internaflonally using a translation application to address the communication barrier in a time effective and cost effective manner in both a text and a voice medium.
3. 3) the application can he used on a single device for translation (a mobile phone operating system or on a tab currently using Android 23 and above) using a variety of different languages where people can speak into the device and have the application translate the sentence in text and voice format in the chosen language.
4. 4) As stared in claim I IransYox using an instani messenger protocol can isanslate languages from one to another using the User Interface for language selection purposes (e.g. English to Spanish or vice versa). The application has the user's native language as default and thus is unnecessary to select or pair a language for translation when choosing a contact to communicate with. thus increasing the efficiency, eliectiveness and user friendliness ci the application.
5. 5) the applicaflion can as described in claim 1, he used io make a voice call (using assisted voice recognilion technology) o another device (mobile phone or ahlet) which has IransYox installed using speech to speech hi-directional translation and text translation technology in real time using a mobile device (The prototype has already been developed and can be viewed ii required).
6. 6) the claim in 4 above is done by using assisted speech recognition technology to capture the users spoken words and then is processed into text format, it is then translated using machine translation technology (into the chosen language or contacts language).
7. 7) I roni claim 5 above the translation when processed from the firsi users voice it is then sent using V(i)Il' (voice over internet protocol) to the contact and which in turn is then processed into text format so you can read the translated message sent. It is also processed using Text to Speech so that the end user (contact) can hear the translation in their own native language on their mobile device anywhere in the world as long as they have an internet connection and the application installed on their device. Please also see descnption for detailed explanation.
8. 8) Hased on the functionality of claims 4, 5 and 6 above, lransVox thus allows br the elficient and timely 1ranslaion ol languages across devices and covering long distances, thus limiling the need for translators and thus breaking down language as a barrier to communication.
9. 9) From the leatures derived from the above claims we can provide for an effecUve communication tool for the visually impaired who require a communication tool for speaking a different language (the applications design will need to he altered to provide larger fonts and darker colour schemes for ease of reading).