EP1493137A1 - Mobile terminal and method for remote control of a home gateway using same - Google Patents

Mobile terminal and method for remote control of a home gateway using same

Info

Publication number
EP1493137A1
EP1493137A1 EP03745822A EP03745822A EP1493137A1 EP 1493137 A1 EP1493137 A1 EP 1493137A1 EP 03745822 A EP03745822 A EP 03745822A EP 03745822 A EP03745822 A EP 03745822A EP 1493137 A1 EP1493137 A1 EP 1493137A1
Authority
EP
European Patent Office
Prior art keywords
terminal
gateway
order
voice
domestic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03745822A
Other languages
German (de)
French (fr)
Inventor
Thierry Caldini
Gilbert Billon
Jean-Yves Lancien
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
France Telecom SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by France Telecom SA filed Critical France Telecom SA
Publication of EP1493137A1 publication Critical patent/EP1493137A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/64—Hybrid switching systems
    • H04L12/6418—Hybrid transport
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/271—Devices whereby a plurality of signals may be stored simultaneously controlled by voice recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/02—Details of telephonic subscriber devices including a Bluetooth interface

Definitions

  • the present invention relates to a multimedia mobile terminal and a method of remote control of a domestic gateway by means of such a terminal.
  • the objective of the invention is to propose a terminal making it possible to solve such a problem by reducing the risks of acoustic or electrical distortion of the audio stream and by allowing the user to validate a voice command considered ambiguous by the voice recognition module.
  • the invention relates to a multimedia mobile terminal comprising a processor, a program memory and a data memory, characterized in that it further comprises a voice remote control device comprising a microphone, a voice recognition module, a lexical analyzer , and a communication module, capable of controlling at least one domestic item of equipment via a domestic gateway, via a wireless link.
  • a voice remote control device comprising a microphone, a voice recognition module, a lexical analyzer , and a communication module, capable of controlling at least one domestic item of equipment via a domestic gateway, via a wireless link.
  • the screen can be a screen with touch input properties.
  • the wireless link can for example be an IEEE 802.11 type link or a "bluetooth" type link or any other type of radio transmission supporting the IP protocol.
  • the invention also relates to a method of remote control of a home gateway connected to at least one home equipment through a home network, by means of a mobile multimedia terminal, characterized in that it comprises the following steps :
  • a step of receiving this voice command by the terminal a step of transforming the acoustic signal received into electrical information, a step of analysis of this electrical information and of association of words described in a grammar,
  • This method may further comprise a step of displaying a message requesting the reiteration of the command in the event of ambiguity of interpretation.
  • the method of the invention comprises a step of controlling functionalities relating to at least one domestic item of equipment or functionalities intrinsic to the domestic gateway. It can thus include a step of actuating hardware or software processes hosted on at least one domestic device.
  • the method of the invention comprises a step of reiterating a command, carried out in voice mode or by manual action.
  • the information transmitted between the terminal and the home gateway can be in IP format.
  • the invention is thus capable of processing acoustic signals, of including the result of this processing in IP packets, or any other protocol, of transmitting this information in real time to a home gateway where it can be interpreted, and of triggering one of the following:
  • this gateway can transmit information to the multimedia mobile terminal in the form of data, sound, image or video, indicating:
  • Figure 1 illustrates the architecture of the multimedia mobile terminal of the invention.
  • FIG. 2 illustrates the steps of the method of the invention.
  • the multimedia mobile terminal of the invention 10 controllable by a local user 1, is a portable computer platform integrating in particular the following functional components: a processor 11 to which . are connected a random access memory 12, a mass memory 13, a voice recognition module 14, a lexical analyzer 15, and a communication module 16, as well as input and output peripherals.
  • a processor 11 to which . are connected a random access memory 12, a mass memory 13, a voice recognition module 14, a lexical analyzer 15, and a communication module 16, as well as input and output peripherals.
  • the input devices can be a microphone 17, a manual input device which can consist of one or more push buttons.
  • This member may also include a screen 18 having tactile input properties.
  • the output devices can be such a screen 18 and a speaker 19.
  • this terminal is connected by a wireless link, of IEEE 802.11 type, "bluetooth” or any other link using a wireless communication standard (network 20), to a home gateway 21, which comprises: an interface 22 with an external network 23,
  • An interface 25 with a local local area network 26 comprising sensors or actuators 27 making it possible to control domestic equipment, and multimedia equipment such as a hi-fi system, a video assembly.
  • This terminal 10 is capable of transmitting digital information, for example in IP format, in real time to the domestic gateway 21 via its communication module 16.
  • digital information for example in IP format
  • this terminal 10 following the transmission of 'a voice command from the user, there is reception thereof in the terminal using the microphone 17 (step 31).
  • This microphone 31 transforms the acoustic signal into electrical information (step 32).
  • the voice recognition module 14 analyzes this electrical information and associates with it, where appropriate, words described in a grammar (step 33).
  • the lexical analyzer 15 receives the words interpreted by the voice recognition module, searches for a correspondence between these words and a list of orders accepted by the home gateway (step 34). If the order belongs to the list of orders admitted by the gateway, the words recognized by this voice recognition module 14 are sent to the terminal screen (step 35). In the event of ambiguity of interpretation, validation of the displayed words is requested from the user (step 36). Following step 35, the lexical analyzer 15 codes the order according to the protocol of the gateway 21, before transmitting this information to the communication module (step 37).
  • the communication module 16 integrates the coded order in a request, for example an "HTTP" request, of the transmission protocol, for example IP (step 38), then transmits the request to the home gateway 21 by means of the link without wire 20 (step 39).
  • a request for example an "HTTP" request
  • IP for example IP
  • the multimedia mobile terminal of the invention thus makes it possible to remotely activate hardware or software processes hosted on one or more pieces of equipment 27 of a local home network 26 connected to a home gateway 21.
  • This terminal 10 allows the user to control by voice all of the remote control functionalities offered by the domestic gateway 21. These functionalities may relate to the equipment 27 connected to the domestic gateway 21 via the data network 26 or intrinsic to this gateway 21.
  • a user order to an element to order contains at least two useful information: an action and the name of this element.
  • the user can activate one of the input devices of the multimedia mobile terminal 10, for example a push button on the terminal or an icon on the touch screen, before issuing an order. This facility reduces the risk of error to only orders issued by the user to the domestic gateway 21.
  • the terminal of the invention 10 authorizes the repetition of the orders received and interpreted by the terminal 10 either visually on the screen 18, or by voice synthesis by the loudspeaker 19.
  • This feedback allows the user to validate or record orders. This option facilitates the use of the remote control by blind or visually impaired users.
  • the multimedia mobile terminal 10 can warn the user when an order received could not be interpreted.
  • This warning can be an audible or visual signal, or an audio message.
  • the confirmation, repetition or reiteration of such an order can be carried out by the user in voice mode or by manual action, for example by pressing a button or on the touch screen of the multimedia mobile terminal 10.
  • the multimedia mobile terminal 10 makes it possible to correct the errors which may result from the radio transmission.
  • Methods well known to those skilled in the art ensure the quality of service that can be implemented on low layers
  • the lower layers are layers 1 and 2 of the OSI model: the Physical and Link layers.
  • the upper layers are layers 3 to 6 of the OSI model, usually designated by Network, Transport, Session and Presentation layers.
  • the multimedia mobile terminal 10 may include an algorithm for encrypting the digital information contained in each IP packet so as to certify, make confidential and secure the message transmitted between it and the gateway 21.
  • This terminal 10 can, for example, be a personal digital assistant or a larger format graphic tablet allowing access to household or family applications.
  • Example of a mode of use of the terminal of the invention In a mode of use of the terminal 10, the oven and the shutters of a house are connected to the domestic gateway 21 and receive from it via the network domestic room 26 the following parameters: start, stop, stages and cooking ramps.
  • the user can thus, while sitting in his living room, use the voice command of the terminal 10 to know the progress of the cooking cycle and transmit to the oven a stop order, or a decrease in temperature so as to delay the moment of removing a dish from the oven.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Small-Scale Networks (AREA)
  • Selective Calling Equipment (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention concerns a multimedia mobile terminal comprising a processor (11), a programme storage (12), a data storage (13), and a voice-activated remote-control device including a microphone (17), a voice recognition module (14), a lexical analyzer (15) and a communication module (16) adapted to control at least one household equipment (27) via a home gateway (21), through a wireless link (20), a manual input member, a display screen (18) and a loudspeaker (19). The invention also concerns a method for remote control of a home gateway using a multimedia mobile terminal.

Description

TERMINAL MOBILE MULTIMEDIA ET PROCEDE DE TELECOMMANDE D'UNE PASSERELLE DOMESTIQUE AU MOYEN D'UN TEL TERMINAL MULTIMEDIA MOBILE TERMINAL AND METHOD FOR REMOTE CONTROL OF A HOME GATEWAY USING SUCH A TERMINAL
DESCRIPTIONDESCRIPTION
DOMAINE TECHNIQUETECHNICAL AREA
La présente invention concerne un terminal mobile multimédia et un procédé de télécommande d'une passerelle domestique au moyen d'un tel terminal.The present invention relates to a multimedia mobile terminal and a method of remote control of a domestic gateway by means of such a terminal.
ETAT DE LA TECHNIQUE ANTERIEURE II est connu d'utiliser un module de reconnaissance vocale pour réaliser la commande d'équipements domestiques. Mais ce module est éloigné de l'utilisateur. Lors de la transmission d'un ordre entre l'utilisateur et ce module de reconnaissance vocale, l'utilisateur doit répéter sa commande lorsque le flux audio, acoustique ou électrique subit une distorsion. De plus, les échanges entre le dispositif de commande, qui inclut ce module de reconnaissance vocale, et l'utilisateur s'effectuent uniquement en mode vocal. Il en découle un dialogue fastidieux pour 1 'utilisateur.STATE OF THE PRIOR ART It is known practice to use a voice recognition module to control household equipment. But this module is far from the user. When transmitting an order between the user and this voice recognition module, the user must repeat his command when the audio, acoustic or electrical flow is distorted. In addition, the exchanges between the control device, which includes this voice recognition module, and the user take place only in voice mode. This results in a tedious dialogue for the user.
L'objectif de l'invention est de proposer un terminal permettant de résoudre un tel problème en diminuant les risques de distorsion acoustique ou électrique du flux audio et en permettant à l'utilisateur de valider une commande vocale considérée ambiguë par le module de reconnaissance vocale. EXPOSE DE L'INVENTIONThe objective of the invention is to propose a terminal making it possible to solve such a problem by reducing the risks of acoustic or electrical distortion of the audio stream and by allowing the user to validate a voice command considered ambiguous by the voice recognition module. . STATEMENT OF THE INVENTION
L'invention concerne un terminal mobile multimédia comprenant un processeur, une mémoire programme et une mémoire de données, caractérisé en ce qu'il comprend, en outre, un dispositif de télécommande vocal comportant un microphone, un module de reconnaissance vocale, un analyseur lexical, et un module de communication, apte à commander au moins un équipement domestique par l'intermédiaire d'une passerelle domestique, via une liaison sans fil.The invention relates to a multimedia mobile terminal comprising a processor, a program memory and a data memory, characterized in that it further comprises a voice remote control device comprising a microphone, a voice recognition module, a lexical analyzer , and a communication module, capable of controlling at least one domestic item of equipment via a domestic gateway, via a wireless link.
Il peut comprendre, en outre, un organe de saisie manuelle, un écran et un haut-parleur. L'écran peut être un écran disposant de propriétés de saisie tactile. La liaison sans fil peut être par exemple une liaison de type IEEE 802.11 ou une liaison de type "bluetooth" ou tout autre type de transmission radio supportant le protocole IP.It may further comprise a manual input device, a screen and a loudspeaker. The screen can be a screen with touch input properties. The wireless link can for example be an IEEE 802.11 type link or a "bluetooth" type link or any other type of radio transmission supporting the IP protocol.
L'invention concerne, également, un procédé de télécommande d'une passerelle domestique reliée à au moins un équipement domestique au travers d'un réseau domestique, au moyen d'un terminal mobile multimédia, caractérisé en ce qu'il comprend les étapes suivantes :The invention also relates to a method of remote control of a home gateway connected to at least one home equipment through a home network, by means of a mobile multimedia terminal, characterized in that it comprises the following steps :
- une étape d' actionnement d'un périphérique d'entrée du terminal par l'utilisateur, une étape d'émission d'une commande vocale par cet utilisateur,a step of actuating a device for inputting the terminal by the user, a step of issuing a voice command by this user,
- une étape de réception de cette commande vocale par le terminal, - une étape de transformation du signal acoustique reçu en informations électriques, - une étape d'analyse de ces informations électriques et d'association de mots décrits dans une grammaire,a step of receiving this voice command by the terminal, a step of transforming the acoustic signal received into electrical information, a step of analysis of this electrical information and of association of words described in a grammar,
- une étape de recherche d'une correspondance entre ces mots et une liste d'ordres admis par la passerelle domestique,a step of searching for a correspondence between these words and a list of orders accepted by the domestic gateway,
- une étape d'émission par le terminal d'un avertissement lorsqu'un ordre n'a pu être interprété,- a step of issuing by the terminal a warning when an order could not be interpreted,
- une étape d'affichage d'un ordre s'il existe, une étape de retour d' information lorsqu'un ordre a pu être interprété par le terminal,a step for displaying an order if there is one, a step for returning information when an order has been interpreted by the terminal,
- une étape de codage de cet ordre selon le protocole de la passerelle, - une étape d'intégration de cet ordre codé dans une requête du protocole de transmission,a step of coding this order according to the gateway protocol, a step of integrating this coded order into a request of the transmission protocol,
- une étape de transmission de la requête vers la passerelle domestique.- a step of transmitting the request to the domestic gateway.
Ce procédé peut comprendre, en outre, une étape d'affichage d'un message de demande de réitération de la commande en cas d'ambiguïté d' interprétation.This method may further comprise a step of displaying a message requesting the reiteration of the command in the event of ambiguity of interpretation.
Avantageusement, le procédé de l'invention comprend une étape de commande de fonctionnalités relatives à au moins un équipement domestique ou de fonctionnalités intrinsèques à la passerelle domestique. Il peut ainsi comprendre une étape d'actionnement de processus matériels ou logiciels hébergés sur au moins un équipement domestique. Avantageusement, le procédé de l'invention comporte une étape de réitération d'une commande, réalisée en mode vocal ou par une action manuelle.Advantageously, the method of the invention comprises a step of controlling functionalities relating to at least one domestic item of equipment or functionalities intrinsic to the domestic gateway. It can thus include a step of actuating hardware or software processes hosted on at least one domestic device. Advantageously, the method of the invention comprises a step of reiterating a command, carried out in voice mode or by manual action.
On peut, également, utiliser un algorithme de chiffrement de l'information transmise entre le terminal et la passerelle domestique.It is also possible to use an encryption algorithm for the information transmitted between the terminal and the home gateway.
L'information transmise entre le terminal et la passerelle domestique peut être au format IP.The information transmitted between the terminal and the home gateway can be in IP format.
Le terminal mobile multimédia deThe multimedia mobile terminal of
1 ' invention est ainsi capable de traiter des signaux acoustiques, d'inclure le résultat de ce traitement dans des paquets IP, ou tout autre protocole, de transmettre ces informations en temps réel vers une passerelle domestique où elles peuvent être interprétées, et de déclencher l'une des actions suivantes :The invention is thus capable of processing acoustic signals, of including the result of this processing in IP packets, or any other protocol, of transmitting this information in real time to a home gateway where it can be interpreted, and of triggering one of the following:
- commande d'équipements reliés à cette passerelle domestique via un réseau local de transmission de données,- control of equipment connected to this domestic gateway via a local data transmission network,
- exécution de scénarios prédéfinis d'action à réaliser par cette passerelle,- execution of predefined action scenarios to be carried out by this gateway,
- notifications internes à cette passerelle,- internal notifications to this gateway,
- demande d'état des équipements. En retour, cette passerelle peut transmettre au terminal mobile multimédia une information sous forme de donnée, de son, d'image ou de vidéo, indiquant :- equipment status request. In return, this gateway can transmit information to the multimedia mobile terminal in the form of data, sound, image or video, indicating:
- l'état de traitement de la commande, - la notification d'alarmes et de tous événements relatifs au réseau local domestique ou aux équipements connectés à celui-ci.- the order processing status, - notification of alarms and all events relating to the local home network or to the equipment connected to it.
BRÈVE DESCRIPTION DES DESSINS La figure 1 illustre l'architecture du terminal mobile multimédia de l'invention.BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 illustrates the architecture of the multimedia mobile terminal of the invention.
La figure 2 illustre les étapes du procédé de l'invention.FIG. 2 illustrates the steps of the method of the invention.
EXPOSÉ DÉTAILLÉ DE MODES DE RÉALISATION PARTICULIERSDETAILED PRESENTATION OF PARTICULAR EMBODIMENTS
Comme représenté sur la figure 1, le terminal mobile multimédia de l'invention 10, commandable par un utilisateur local 1, est une plate-forme informatique portable intégrant notamment les composants fonctionnels suivants : un processeur 11 auquel . sont reliés une mémoire vive 12, une mémoire de masse 13, un module de reconnaissance vocale 14, un analyseur lexical 15, et un module de communication 16, ainsi que des périphériques d'entrée et de sortie.As shown in FIG. 1, the multimedia mobile terminal of the invention 10, controllable by a local user 1, is a portable computer platform integrating in particular the following functional components: a processor 11 to which . are connected a random access memory 12, a mass memory 13, a voice recognition module 14, a lexical analyzer 15, and a communication module 16, as well as input and output peripherals.
Les périphériques d'entrée peuvent être un microphone 17, un organe de saisie manuelle qui peut être constitué d'un ou de plusieurs boutons poussoir. Cet organe peut également comprendre un écran 18 disposant de propriétés de saisie tactile.The input devices can be a microphone 17, a manual input device which can consist of one or more push buttons. This member may also include a screen 18 having tactile input properties.
Les périphériques de sortie peuvent être un tel écran 18 et un haut-parleur 19.The output devices can be such a screen 18 and a speaker 19.
Comme illustré sur la figure 1, ce terminal est relié par une liaison sans fil, de type IEEE 802.11, "bluetooth" ou tout autre liaison utilisant un standard de communication sans fil (réseau 20) , à une passerelle domestique 21, qui comprend : - un interface 22 avec un réseau extérieur 23,As illustrated in FIG. 1, this terminal is connected by a wireless link, of IEEE 802.11 type, "bluetooth" or any other link using a wireless communication standard (network 20), to a home gateway 21, which comprises: an interface 22 with an external network 23,
- un interface 24 avec le réseau interne 20, par exemple hertzien,an interface 24 with the internal network 20, for example radio,
- un interface 25 avec un réseau local domestique 26 comprenant des capteurs ou actionneurs 27 permettant de contrôler des équipements domestiques, et des équipements multimédias tels qu'une chaîne Hi-fi, un ensemble vidéo.- An interface 25 with a local local area network 26 comprising sensors or actuators 27 making it possible to control domestic equipment, and multimedia equipment such as a hi-fi system, a video assembly.
- un interface 28 vers le réseau Internet.- an interface 28 to the Internet.
Ce terminal 10 est capable de transmettre des informations numériques, par exemple au format IP, en temps réel à la passerelle domestique 21 via son module de communication 16. Dans l'exemple de traitement illustré sur la figure 2, suite à l'émission d'une commande vocale en provenance de l'utilisateur, il y a réception de celle-ci dans le terminal à l'aide du microphone 17 (étape 31) . Ce microphone 31 transforme le signal acoustique en informations électriques (étape 32) .This terminal 10 is capable of transmitting digital information, for example in IP format, in real time to the domestic gateway 21 via its communication module 16. In the processing example illustrated in FIG. 2, following the transmission of 'a voice command from the user, there is reception thereof in the terminal using the microphone 17 (step 31). This microphone 31 transforms the acoustic signal into electrical information (step 32).
Le module de reconnaissance vocale 14 analyse ces informations électriques et leur associe, le cas échéant, des mots décrits dans une grammaire (étape 33) . L'analyseur lexical 15 reçoit les mots interprétés par le module de reconnaissance vocale, recherche une correspondance entre ces mots et une liste d'ordres admis par la passerelle domestique (étape 34) . Si l'ordre appartient à la liste des ordres admis par la passerelle, les mots reconnus par ce module de reconnaissance vocale 14 sont envoyés sur l'écran du terminal (étape 35). En cas d'ambiguïté d'interprétation une validation des mots affichés est demandée à l'utilisateur (étape 36). Suite à l'étape 35, l'analyseur lexical 15 code l'ordre selon le protocole de la passerelle 21, avant de transmettre cette information au module de communication (étape 37) .The voice recognition module 14 analyzes this electrical information and associates with it, where appropriate, words described in a grammar (step 33). The lexical analyzer 15 receives the words interpreted by the voice recognition module, searches for a correspondence between these words and a list of orders accepted by the home gateway (step 34). If the order belongs to the list of orders admitted by the gateway, the words recognized by this voice recognition module 14 are sent to the terminal screen (step 35). In the event of ambiguity of interpretation, validation of the displayed words is requested from the user (step 36). Following step 35, the lexical analyzer 15 codes the order according to the protocol of the gateway 21, before transmitting this information to the communication module (step 37).
Le module de communication 16 intègre l'ordre codé dans une requête, par exemple une requête "HTTP", du protocole de transmission, par exemple IP (étape 38) , puis transmet la requête vers la passerelle domestique 21 au moyen de la liaison sans fil 20 (étape 39) .The communication module 16 integrates the coded order in a request, for example an "HTTP" request, of the transmission protocol, for example IP (step 38), then transmits the request to the home gateway 21 by means of the link without wire 20 (step 39).
Le terminal mobile multimédia de l'invention permet ainsi d'actionner à distance des processus matériels ou logiciels hébergés sur un ou plusieurs équipements 27 d'un réseau local domestique 26 relié à une passerelle domestique 21.The multimedia mobile terminal of the invention thus makes it possible to remotely activate hardware or software processes hosted on one or more pieces of equipment 27 of a local home network 26 connected to a home gateway 21.
Ce terminal 10 permet à l'utilisateur de commander par la voix l'ensemble des fonctionnalités de télécommandes proposées par la passerelle domestique 21. Ces fonctionnalités peuvent être relatives aux équipements 27 reliés à la passerelle domestique 21 via le réseau de donnée 26 ou intrinsèques à cette passerelle 21. Un ordre de l'utilisateur vers un élément à commander contient au moins deux informations utiles : une action et le nom de cet élément. L'utilisateur peut actionner l'un des périphériques d'entrée du terminal mobile multimédia 10, par exemple un bouton poussoir du terminal ou une icône sur l'écran tactile, avant de prononcer un ordre. Cette facilité réduit les risques d'erreur aux seuls ordres prononcés par l'utilisateur à destination de la passerelle domestique 21.This terminal 10 allows the user to control by voice all of the remote control functionalities offered by the domestic gateway 21. These functionalities may relate to the equipment 27 connected to the domestic gateway 21 via the data network 26 or intrinsic to this gateway 21. A user order to an element to order contains at least two useful information: an action and the name of this element. The user can activate one of the input devices of the multimedia mobile terminal 10, for example a push button on the terminal or an icon on the touch screen, before issuing an order. This facility reduces the risk of error to only orders issued by the user to the domestic gateway 21.
Avantageusement, le terminal de l'invention 10 autorise la répétition des ordres reçus et interprétés par le terminal 10 soit visuellement sur l'écran 18, soit par synthèse vocale par le haut- parleur 19. Ce retour d'information permet à l'utilisateur de valider ou d'historier les ordres. Cette faculté facilite l'utilisation de la télécommande par des utilisateurs non-voyants ou mal-voyants.Advantageously, the terminal of the invention 10 authorizes the repetition of the orders received and interpreted by the terminal 10 either visually on the screen 18, or by voice synthesis by the loudspeaker 19. This feedback allows the user to validate or record orders. This option facilitates the use of the remote control by blind or visually impaired users.
Le terminal mobile multimédia 10 peut avertir l'utilisateur lorsqu'un ordre reçu n'a pas pu être interprété. Cet avertissement peut être un signal sonore ou visuel, ou un message audio. Par ailleurs la confirmation, la répétition ou la réitération d'un tel ordre peut être réalisée par l'utilisateur en mode vocal ou par une action manuelle, par exemple par appui sur un bouton ou sur l'écran tactile du terminal mobile multimédia 10.The multimedia mobile terminal 10 can warn the user when an order received could not be interpreted. This warning can be an audible or visual signal, or an audio message. Furthermore, the confirmation, repetition or reiteration of such an order can be carried out by the user in voice mode or by manual action, for example by pressing a button or on the touch screen of the multimedia mobile terminal 10.
Le terminal mobile multimédia 10 permet de corriger les erreurs pouvant résulter de la transmission hertzienne. Des méthodes bien connues de l'homme de métier assurent la qualité de service pouvant être mises en œuvre sur des couches bassesThe multimedia mobile terminal 10 makes it possible to correct the errors which may result from the radio transmission. Methods well known to those skilled in the art ensure the quality of service that can be implemented on low layers
("bluetooth", IEEE 802.11, etc.) et hautes (TCP/IP,("bluetooth", IEEE 802.11, etc.) and high (TCP / IP,
UDP/IP, etc) du protocole de transmission. Les couches basses sont les couches 1 et 2 du modèle OSI : les couches Physiques et Liaisons. Les couches hautes sont les couches 3 à 6 du modèle OSI, usuellement désignée par couches Réseau, Transport, Session et Présentation.UDP / IP, etc.) of the transmission protocol. The lower layers are layers 1 and 2 of the OSI model: the Physical and Link layers. The upper layers are layers 3 to 6 of the OSI model, usually designated by Network, Transport, Session and Presentation layers.
Le terminal mobile multimédia 10 peut, enfin, comporter un algorithme de chiffrement de l'information numérique contenue dans chaque paquet IP de manière à certifier, rendre confidentiel et sécuriser le message transmis entre celui-ci et la passerelle 21.Finally, the multimedia mobile terminal 10 may include an algorithm for encrypting the digital information contained in each IP packet so as to certify, make confidential and secure the message transmitted between it and the gateway 21.
Ce terminal 10 peut, par exemple, être un assistant numérique personnel ou une tablette graphique de format plus important permettant d'accéder à des applications domestiques ou familiales.This terminal 10 can, for example, be a personal digital assistant or a larger format graphic tablet allowing access to household or family applications.
Exemple d'un mode d'utilisation du terminal de l'invention Dans un mode d'utilisation du terminal 10, le four et les volets roulants d'une maison sont connectés à la passerelle domestique 21 et reçoivent de celle-ci via le réseau local domestique 26 les paramètres suivants : démarrage, arrêt, paliers et rampes de cuisson.Example of a mode of use of the terminal of the invention In a mode of use of the terminal 10, the oven and the shutters of a house are connected to the domestic gateway 21 and receive from it via the network domestic room 26 the following parameters: start, stop, stages and cooking ramps.
L'utilisateur peut ainsi, en étant assis dans son salon, utiliser la commande vocale du terminal 10 pour connaître l'avancement du cycle de cuisson et transmettre au four un ordre d'arrêt, ou de diminution de la température de manière à retarder l'instant de la sortie d'un plat du four.The user can thus, while sitting in his living room, use the voice command of the terminal 10 to know the progress of the cooking cycle and transmit to the oven a stop order, or a decrease in temperature so as to delay the moment of removing a dish from the oven.
Depuis le même endroit, il peut commander la fermeture des volets sans quitter des yeux son émission de télévision préférée. From the same place, he can order the shutters to close without taking his eyes off his favorite television program.

Claims

REVENDICATIONS
1. Terminal mobile multimédia comprenant un processeur (11) , une mémoire programme (12) , et une mémoire de données (13), caractérisé en ce qu'il comprend, en outre, un dispositif de télécommande vocal comportant un microphone (17) , un module de reconnaissance vocale (14) , un analyseur lexical (15) , un module de communication (16) apte à commander au moins un équipement (27) par l'intermédiaire d'une passerelle domestique (21) , via une liaison sans fil1. multimedia mobile terminal comprising a processor (11), a program memory (12), and a data memory (13), characterized in that it further comprises a voice remote control device comprising a microphone (17) , a voice recognition module (14), a lexical analyzer (15), a communication module (16) capable of controlling at least one piece of equipment (27) via a domestic gateway (21), via a link wireless
(20) , un organe de saisie manuelle, un écran (18) et un haut-parleur (19) .(20), a manual input device, a screen (18) and a loudspeaker (19).
2. Terminal selon la revendication 1, dans lequel l'écran (18) est un écran disposant de propriétés de saisie tactile.2. Terminal according to claim 1, in which the screen (18) is a screen having tactile input properties.
3. Terminal selon la revendication 1, dans lequel la liaison sans fil est une liaison de type IEEE3. Terminal according to claim 1, in which the wireless link is an IEEE type link.
802.11, ou "bluetooth" ou tout autre type de transmission radio supportant le protocole IP.802.11, or "bluetooth" or any other type of radio transmission supporting the IP protocol.
4. Procédé de télécommande d'une passerelle domestique (21) reliée à au moins un équipement (27) au travers un réseau domestique (26), au moyen d'un terminal mobile multimédia (10) , caractérisé en ce qu'il comprend les étapes suivantes : une étape d'actionnement d'un périphérique d'entrée du terminal par l'utilisateur, une étape d'émission d'une commande vocale par cet utilisateur,4. Method for remote control of a domestic gateway (21) connected to at least one piece of equipment (27) through a home network (26), by means of a mobile multimedia terminal (10), characterized in that it comprises the following steps: a step of actuating a device for inputting the terminal by the user, a step of issuing a voice command by this user,
- une étape de réception de cette commande vocale par le terminal (étape 31) , - une étape de transformation du signal acoustique reçu en informations électriques (étape 32) ,a step of receiving this voice command by the terminal (step 31), a step of transforming the acoustic signal received into electrical information (step 32),
- une étape d'analyse de ces informations électriques et d'association de mots décrits dans une grammaire (étape 33) , - une étape de recherche d'une correspondance entre ces mots et une liste d'ordres admis par la passerelle domestique (étape 34) ,a step of analysis of this electrical information and of association of words described in a grammar (step 33), a step of searching for a correspondence between these words and a list of orders accepted by the domestic gateway (step 34),
- une étape d'émission par le terminal d'un avertissement lorsqu'un ordre n'a pu être interprété, - une étape d'affichage d'un ordre s'il existe (étape 35) , une étape de retour d' information lorsqu'un ordre a pu être interprété par le terminal,- a step of issuing by the terminal a warning when an order could not be interpreted, - a step of displaying an order if it exists (step 35), a step of feedback when an order could be interpreted by the terminal,
- une étape de codage de cet ordre selon le protocole de la passerelle (étape 37) ,a step of coding this order according to the gateway protocol (step 37),
- une étape d'intégration de cet ordre codé dans une requête du protocole de transmission (étape 38),a step of integrating this coded order into a request of the transmission protocol (step 38),
- une étape de transmission de la requête vers la passerelle domestique (21) (étape 39) .a step of transmitting the request to the domestic gateway (21) (step 39).
5. Procédé selon la revendication 4 comprenant une étape d'affichage d'un message de demande de réitération de la commande en cas d'ambiguïté d'interprétation (étape 36). 5. Method according to claim 4 comprising a step of displaying a message requesting the reiteration of the command in the event of ambiguity of interpretation (step 36).
6. Procédé selon la revendication 4, comprenant une étape de commande de fonctionnalités relatives à au moins un équipement domestique (27) ou de fonctionnalités intrinsèques à la passerelle domestique (21) .6. Method according to claim 4, comprising a step of controlling functionalities relating to at least one domestic item of equipment (27) or functionalities intrinsic to the domestic gateway (21).
7. Procédé selon la revendication 6 comprenant une étape d'actionnement de processus matériels ou logiciels hébergés sur au moins un équipement domestique (27) .7. The method of claim 6 comprising a step of actuating hardware or software processes hosted on at least one household equipment (27).
8. Procédé selon la revendication 5 comportant une étape de réitération d'une commande, réalisée en mode vocal ou par une action manuelle.8. The method of claim 5 comprising a step of reiterating a command, performed in voice mode or by manual action.
9. Procédé selon la revendication 4, dans lequel on utilise un algorithme de chiffrement de l'information transmise entre le terminal (10) et la passerelle domestique (21) .9. The method of claim 4, wherein an encryption algorithm is used for the information transmitted between the terminal (10) and the home gateway (21).
10. Procédé selon la revendication 4, dans lequel l'information transmise entre le terminal (10) et la passerelle domestique (21) est au format IP. 10. The method of claim 4, wherein the information transmitted between the terminal (10) and the home gateway (21) is in IP format.
EP03745822A 2002-04-08 2003-04-04 Mobile terminal and method for remote control of a home gateway using same Withdrawn EP1493137A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR0204319 2002-04-08
FR0204319A FR2838278B1 (en) 2002-04-08 2002-04-08 MULTIMEDIA MOBILE TERMINAL AND METHOD FOR REMOTE CONTROL OF A HOME GATEWAY USING SUCH A TERMINAL
PCT/FR2003/001070 WO2003085616A1 (en) 2002-04-08 2003-04-04 Mobile terminal and method for remote control of a home gateway using same

Publications (1)

Publication Number Publication Date
EP1493137A1 true EP1493137A1 (en) 2005-01-05

Family

ID=28052174

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03745822A Withdrawn EP1493137A1 (en) 2002-04-08 2003-04-04 Mobile terminal and method for remote control of a home gateway using same

Country Status (6)

Country Link
US (1) US20050210064A1 (en)
EP (1) EP1493137A1 (en)
JP (1) JP2005528018A (en)
AU (1) AU2003246779A1 (en)
FR (1) FR2838278B1 (en)
WO (1) WO2003085616A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640217A (en) * 2018-12-19 2019-04-16 维沃移动通信有限公司 A kind of speaker control method and terminal device

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6826407B1 (en) 1999-03-29 2004-11-30 Richard J. Helferich System and method for integrating audio and visual messaging
US7003304B1 (en) 1997-09-19 2006-02-21 Thompson Investment Group, Llc Paging transceivers and methods for selectively retrieving messages
US6253061B1 (en) 1997-09-19 2001-06-26 Richard J. Helferich Systems and methods for delivering information to a transmitting and receiving device
US6636733B1 (en) 1997-09-19 2003-10-21 Thompson Trust Wireless messaging method
US6983138B1 (en) 1997-12-12 2006-01-03 Richard J. Helferich User interface for message access
CN1858817B (en) * 2005-07-06 2010-12-15 华为技术有限公司 System for constructing remote control gateway device and realizing method
BRMU8601339U (en) * 2006-06-26 2008-02-12 Leonardo Senna Da Silva strap with attached control device
US9602880B2 (en) 2006-12-29 2017-03-21 Kip Prod P1 Lp Display inserts, overlays, and graphical user interfaces for multimedia systems
US11316688B2 (en) 2006-12-29 2022-04-26 Kip Prod P1 Lp Multi-services application gateway and system employing the same
US20170344703A1 (en) 2006-12-29 2017-11-30 Kip Prod P1 Lp Multi-services application gateway and system employing the same
US9569587B2 (en) 2006-12-29 2017-02-14 Kip Prod Pi Lp Multi-services application gateway and system employing the same
US11783925B2 (en) 2006-12-29 2023-10-10 Kip Prod P1 Lp Multi-services application gateway and system employing the same
WO2008085205A2 (en) 2006-12-29 2008-07-17 Prodea Systems, Inc. System and method for providing network support services and premises gateway support infrastructure
EP2148275A1 (en) 2008-07-25 2010-01-27 France Telecom Residential gateway management
KR20100056921A (en) * 2008-11-20 2010-05-28 삼성전자주식회사 Electronic apparatus and remote control method of the same
US20110020771A1 (en) * 2009-07-23 2011-01-27 Rea Ryan M Electronic braille typing interface
TWI501110B (en) * 2013-02-25 2015-09-21 Pixart Imaging Inc Protocol system and related method of automatically updating a datum
JP6309382B2 (en) * 2013-10-17 2018-04-11 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Cordless telephone device control method, cordless telephone device cordless handset and cordless telephone device
USRE49284E1 (en) 2013-10-17 2022-11-08 Panasonic Intellectual Property Corporation Of America Method for controlling cordless telephone device, handset of cordless telephone device, and cordless telephone device
KR102277259B1 (en) * 2014-11-26 2021-07-14 엘지전자 주식회사 Device control system, digital device and method of controlling the same
CA3010340C (en) 2015-12-31 2021-06-15 Delta Faucet Company Water sensor

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU4773193A (en) * 1992-07-17 1994-02-14 Voice Powered Technology International, Inc. Voice operated remote control device
WO1995025326A1 (en) * 1994-03-17 1995-09-21 Voice Powered Technology International, Inc. Voice/pointer operated system
JPH08314493A (en) * 1995-05-22 1996-11-29 Sanyo Electric Co Ltd Voice recognition method, numeral line voice recognition device and video recorder system
JPH09292895A (en) * 1996-04-25 1997-11-11 Matsushita Electric Ind Co Ltd Human and machine interface device
EP0911808B1 (en) * 1997-10-23 2002-05-08 Sony International (Europe) GmbH Speech interface in a home network environment
FR2783625B1 (en) * 1998-09-21 2000-10-13 Thomson Multimedia Sa SYSTEM INCLUDING A REMOTE CONTROL DEVICE AND A VOICE REMOTE CONTROL DEVICE OF THE DEVICE
JP2000236585A (en) * 1999-02-15 2000-08-29 Nippon Telegr & Teleph Corp <Ntt> Apparatus control method and device and control server
JP2000277268A (en) * 1999-03-24 2000-10-06 Matsushita Electric Works Ltd Network dimming system
EP1079352B1 (en) * 1999-08-27 2012-10-10 Thomson Licensing Remote voice control system
JP2001275176A (en) * 2000-03-24 2001-10-05 Matsushita Electric Ind Co Ltd Remote controller
GB0007242D0 (en) * 2000-03-24 2000-05-17 Tvcompass Com Ltd Remote control devices
JP2001318689A (en) * 2000-05-08 2001-11-16 Matsushita Electric Ind Co Ltd Remote controller by means of speech recognition
JP2002044760A (en) * 2000-07-28 2002-02-08 Matsushita Electric Ind Co Ltd Operating apparatus and billing method
JP2002044765A (en) * 2000-07-28 2002-02-08 Matsushita Electric Ind Co Ltd Remote control system and gateway apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO03085616A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109640217A (en) * 2018-12-19 2019-04-16 维沃移动通信有限公司 A kind of speaker control method and terminal device

Also Published As

Publication number Publication date
FR2838278A1 (en) 2003-10-10
FR2838278B1 (en) 2004-08-13
AU2003246779A1 (en) 2003-10-20
US20050210064A1 (en) 2005-09-22
JP2005528018A (en) 2005-09-15
WO2003085616A1 (en) 2003-10-16

Similar Documents

Publication Publication Date Title
EP1493137A1 (en) Mobile terminal and method for remote control of a home gateway using same
US20220068110A1 (en) Systems and methods for provisioning appliance devices in response to a panic signal
US7933945B2 (en) Method, system, and computer program product for managing controlled residential or non-residential environments
EP1854262B1 (en) Intelligent remote multi-communicating surveillance system and method
US20050179531A1 (en) Vehicle interactive electronic wireless air pressure system&#39;s information: &#34;VIEW A PSI&#34;
US20130055322A1 (en) Personal video network
US20020056114A1 (en) Transmitter for a personal wireless network
EP2586175B1 (en) Method and device for verifying physical recognition between a caller and a called party
US20070256105A1 (en) Entertainment device configured for interactive detection and security vigilant monitoring in communication with a control server
CN111819560A (en) Information security/privacy through security accessory decoupled from always-on auxiliary device
WO2008003070A2 (en) Portable communication device
EP1399799B1 (en) Modular computer
US20010053134A1 (en) Router for a personal wireless network
US20110161839A1 (en) Intercom and chat for home media network
EP1494192A2 (en) Remote control system for controlling household devices
KR20060102601A (en) Service system and method for providing robot contents
EP2015552B1 (en) Modular alarm system and method
EP3661161B1 (en) Method and system for remote voice access to voice assistant services
WO2020015187A1 (en) Biometric information-based method and device for transmitting voice notification
EP1605639A2 (en) Message based programming device
US10887552B1 (en) Door-knocking for teleconferencing
FR2794325A1 (en) Household communications domestic alert/alarm system having pre recorded messages set off for specific events and householder audio and television signal alerting.
JP2004185621A (en) Audio confirmation system and method
EP2820821A1 (en) Method and device for making available at least one communication datum
WO2003054855A1 (en) Voice recognition method and multimedia terminal therefor

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20040930

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20080304