EP2483881B1 - REMOTE CONTROL METHODS AND DEVICES USING A UPnP SERVICE - Google Patents

Description

The present invention is directed to remote control methods and devices by a UPnP service (acronym for "Universal Plug and Play" for universal connection and use). It applies in particular to the substitution of commands transmitted by infrared radiation by a UPnP service.

The technical field of the present invention relates to audiovisual services and, in particular, remote control of a remotely controllable device using UPnP commands.

Digital home electronics has seen the advent of consumer electronics devices that allow the use of DLNA (Digital Living Network Alliance for Digital Living Network Alliance) and UPnP, such as digital television set-top boxes, audio devices and video and game devices.

• le « Media Server » (pour serveur de médias), ou « MS » : entité « esclave » qui partage ses médias (comme l'audio, la vidéo ou des images) avec les clients UPnP du réseau ;
• le « Control Point » (pour Point de Contrôle), ou « CP » : le client UPNP, l'entité « maître » du réseau, qui peut détecter les dispositifs ou entités UPnP (appelés « devices » dans le standard UPnP) et leurs services, recevoir des événements de ces entités UPnP et les commander en leur envoyant des actions UPnP et
• le « Media Renderer » (pour restituteur de média), ou « MR » : entité « esclave » en charge de la restitution ou de l'affichage du contenu (par exemple, écran de télévision, chaîne Hifi, ...).

The "UPnP AV" architecture (for UPnP Audio & Video), involves three entities in the home network for managing audio, video and photo content:

• the "Media Server", or "MS": "slave" entity that shares its media (such as audio, video, or images) with the UPnP clients on the network;
• the "Control Point", or "CP": the UPNP client, the "master" entity of the network, which can detect UPnP devices or entities (called "devices" in the UPnP standard) and their services, receive events from these UPnP entities and order them by sending them UPnP actions and
• the "Media Renderer", or "MR": "slave" entity responsible for the reproduction or display of the content (for example, television screen, hi-fi system, etc.).

Generally, the so-called "Media Renderers" equipment, are also "Media Players", or "MP" and integrate a "Media Controller", or "MC", capable of rendering, on the device itself, content from a Media Server.

It is noted that the terms "DMS", "DMR" and "DMC" are also used instead of the terms "MS", "MR" and "MC", respectively, the "D" added meaning digital , or digital.

Each of these entities implements services specified by UPnP. In particular, a "digital media renderer" must include the "ConnectionManager" (for connection manager) and "RenderingControl" (for rendering control) services and, in general, include the "AVTransport" service (for audio-video transport) .

The Control Point software, coupled with a human-machine interface (or "HMI"), allows a user to select a content (eg video, audio or image) made available by a "media server" and to broadcast on the "media renderer" of his choice. For example, the mobile Nokia N95 (registered trademarks) includes a "digital media controller" that allows you to view the contents of UPnP media servers and push them to a UPnP "media renderer" (for example as a UPnP HiFi system or a frame UPnP photo).

Within UPnP, it is planned to enrich the standard with specific evolutions. Indeed, an industrialist can define his own UPnP entities, and associated services, for example by extending existing services or by adding "actions" following UPnP standardized formalism, these extensions are called "vendor-specific" (for specific to the salesman).

Once the Control Point or digital media controller has discovered a UPnP entity in the network, it obtains a description of that entity (called a device description) using a URL included in the discovery message. Then, from the URL contained in this description of this entity, it obtains for each service implemented by this entity, a service description comprising a list of UPnP commands or invokable actions, as well as the possible parameters for each of its actions. The The service description also includes a list of state variables that describe the current state of the service when it is run.

However, there is no UPnP service that allows full control of a device.

US2002 / 130834 describes an electronic control device on which a graphic simulation is displayed for the control of other electronic devices to be controlled.

WO 2006/082498 describes the use of a manual remote control emitting infrared light signals or radio signals to devices to be controlled, according to the prior art described below.

US 2004/0249925 describes a wireless terminal that can be used instead of a remote device remote control. The remote device converts the command data to the appropriate key code for processing by the IP input adaptation layer before being sent to the main program of the device to be controlled.

For the remote control of a decoder, the prior art is to send infrared codes to this decoder. This technique remains a "directional" solution, or "line of sight", that is to say that it is necessary that there is no screen between the user who points the remote control and the receiver of the decoder in question.

In addition, the conventional remote control is often powered by batteries that must be replaced, unlike mobile type terminals that have, as standard, rechargeable batteries and chargers associated.

In the case of the conventional remote control, the communications are unidirectional, from the remote control to the decoder.

The remote control also has no display capability or presentation of information from the decoder.

The remote control is only provided in one copy with a decoder. When it is damaged or lost, the remote control becomes impossible and a new remote compatible with the old one must be obtained. Similarly, when two people want successively remote control the same device, they must pass the remote control by hand.

In addition, apart from so-called "universal" remote controls, conventional remote controls are used to control only one device and its associated contents. It is therefore necessary to have as many remote controls as there are devices to remotely, which causes a loss of space, a significant consumption of batteries and a risk of misplacing a remote control or sending involuntary orders to one device rather than another, when one confuses remote controls of different devices.

Finally, there are, for example for the Nokia N95, applications that make it possible to control UPnP devices of the DMS or DMR type, but these applications only allow control of the functions defined in UPnP / DLNA, while basic functions (such as change of reception channel) are accessible only by means of an infrared remote control.

The present invention aims to remedy these disadvantages.

For this purpose, the present invention aims, according to a first aspect, a method of remote control of a device to be controlled using a command processing module, characterized in that it comprises a step of implementation, on said control device, a remote control application, which, following detection of at least one interaction of a user with a user interface associated with said application, invokes via a network at least one action of a command reception service, implemented in the device to be controlled and transmitting to said command processing module at least one control code representing said interaction.

It is noted that the term "service" is understood here in the sense of the UPnP standard or an equivalent or derived standard. More generally, it is a set of functions of an entity whose execution is likely to be triggered by another entity of the network and that the entity declares. In UPnP, UPnP entities declare the functions associated with the services they implement in accordance with a feature discovery mechanism and discovery feature discovery.

Thanks to the implementation of the present invention, the device to be controlled has a new remote control channel passing, from the user, by the user interface associated with the application and by the command reception service to arrive. to the command processing module of the device.

According to an embodiment in which a control input hardware interface is operable for controlling the device to be controlled, the command processing module is adapted to receive the same said control code from said hardware interface. control input. The order acceptance service thus offers a new control mode, complementary to a control mode by means of a hardware interface. The order receiving service makes it possible to receive and transmit to the command processing module command codes from the control device, these command codes being identical to those from the hardware interface.

This therefore amounts to coupling a command reception service to a command processing module, so that this same command processing module can be used both for the processing of control codes coming from the hardware interface and for both to the processing of these same control codes when they come from the remote control device and are generated following the invocation of an action of this control service.

According to one embodiment, the command codes transmitted to the processing module represent actions that can be performed on a hardware input control interface of said device to be controlled.

The implementation of the present invention makes it possible to set up new remote control mechanisms by replacing infrared codes with a UPnP command syntax.

In general, the invention makes it possible to substitute a control input hardware interface (infrared remote control, keyboard, buttons, knobs or other actuators on the equipment housings, etc.) that can be used to control the device. to control, a software interface for generating control codes representative of actions that can be operated on such a hardware interface control input.

This means that not only does the user have control of the UPnP DMR (acronym for Digital Media Renderer for Digital Media Restorer) in the equipment connected to the UPnP network, (decoder type, or "STB", acronym set-top box, TV, stereo, etc ...), but it also has the equivalent of buttons on the equipment box or remote control buttons, via a new service for the remote control, in particular UPnP, from any command application able to invoke this new command reception service.

To fully control the decoder at a UPnP level, this new UPnP service has been defined and implemented both on the UPnP Control Point side, for the Invoke Actions part, and on the Device side to be controlled, for the implementation. implementation of the Order Receipt Service.

The invention thus provides means for replacing a local control (keypad of the device to be controlled) or remotely, in particular a conventional remote control (with radii and infrared codes), with a device implementing the new command reception service.

According to particular features, during the implementation step, the control application obtains a file defining the action (s) to be invoked and / or possible action parameters according to the user's interactions with the user. user interface.

Note that the present invention is not limited to infrared remote control key codes but extends to any control code representative of actions that may be performed on a control input hardware interface, provided that order receipt is identified by the remote control application.

According to particular features, the method which is the subject of the present invention, as briefly described above, comprises a step of configuring the user interface in accordance with a configuration file obtained by said application and defining graphic elements representing elements control input of a control input hardware interface of said device to be controlled.

According to particular characteristics, the configuration file is specific to the device to be controlled.

According to particular characteristics, the configuration file specifies a type of user interaction with each element of the user interface with which the user can interact, the actions invoked and / or parameters of these actions depending on the type interaction detected.

According to a second aspect, the present invention aims at a remote control method of a device to be controlled using a command processing module, characterized in that it comprises a step of implementation, on the device to be controlled. of a command-receiving service which executes actions invoked via a network by a remote control application and which transmits to said command processing module command codes representing user interactions with a user interface associated with it. said remote control application.

According to particular characteristics, said application is integrated in a UPnP entity and the command reception service is a UPnP service.

According to particular features, the method that is the subject of the present invention, as briefly described above, comprises a step of discovery, by the application of remote control, of a device of a network implementing the service of receiving remote control and, at least in the case where more than one such device is discovered, a step of presenting the discovered devices and a step of selecting, by the user, one of the discovered devices, said invocations being addressed to the selected device.

The remote control object of the present invention can be used to control all infrared remote control equipment, and more generally those having a hardware input control interface. The invention aims in particular at providing entities of the network to which the equipment is connected, a command reception service designed to transmit command codes to a command processing module, this module being capable / designed to receive these same command codes of a hardware input command interface.

According to particular characteristics, the command codes represent actions that can be performed on a hardware input control interface of said device to be controlled.

According to particular features, the control codes represent simple, double or long user interactions with a touch of a hardware input control interface of said device to be controlled.

According to particular characteristics, at least one invoked action represents a string of characters entered with said user interface.

The present invention thus allows new features, such as, for example, the remote search of files or artwork by their title, author, interpreter or any other reference using a string of characters.

According to particular features, the command codes represent a key press or release of a hardware input control interface of said device to be controlled.

Thus, typically, one touch-key type of management includes the support and release of elements of the user interface and another type of management does not include them. These releases and releases allow the remote control reception service to take into account the duration of the interaction and to differentiate a long support from a short support.

According to a third aspect, the present invention is directed to a control device and a device to be controlled.

The device for remote control of a device to be controlled using a command processing module, characterized in that it comprises means for implementing a remote control application, adapted, following a detection of at least one interaction of a user with a user interface associated with said application, to invoke, via a network, at least one action of a command reception service, implemented in the device to be controlled and transmitting to said command processing module at least one command code representing said interaction.

The device to be controlled using a command processing module, characterized in that it comprises means for implementing a command reception service adapted to perform actions invoked via a network by a remote control application and transmitting to said command processing module command codes representing user interactions with a user interface associated with said remote control application.

Since the advantages, aims and characteristics of these devices are similar to those of the process that is the subject of the present invention, as briefly described above, they are not repeated here.

• la figure 1 représente, schématiquement, un mode de réalisation particulier du système objet de la présente invention se substituant à une télécommande infrarouge
• la figure 2 représente des requêtes émises par un mode de réalisation simplifié du procédé et du système objet de la présente invention et
• la figure 3 représente, sous forme d'un logigramme, des étapes mises en oeuvre dans un mode de réalisation particulier du procédé objet de la présente invention.

Other advantages, aims and features of the present invention will emerge from the description which follows, for an explanatory and non-limiting purpose, with reference to the appended drawings, in which:

• the figure 1 represents, schematically, a particular embodiment of the system object of the present invention substituting for an infrared remote control
• the figure 2 represents queries emitted by a simplified embodiment of the method and system of the present invention and
• the figure 3 represents, in the form of a logic diagram, steps implemented in a particular embodiment of the method that is the subject of the present invention.

Throughout the description that follows, the terms "key", "key" or "icon" are used interchangeably to designate elements, hardware or software, of actuation with which a user can interact, these elements being, for example, present on a keyboard or on a hardware interface of control input of the device to be controlled.

The figure 1 represents only one control device and only one device to be controlled. However, the present invention also applies to the remote control of a plurality of devices to be controlled by a single control device.

We observe figure 1 , a remote control device 105, a conventional infrared remote control 110 and a remote control device 150.

The device to be controlled 105 is any device integrating a UPnP entity, implementing a UPnP service defined in the UPnP standard (for example a UPnP media server, a UPnP media renderer or a Digital Media Printer, or "DMPr" printer). , etc.) and further implementing a command-receiving service as defined in the present invention.

The device to be controlled 105 is for example a decoder, a hi-fi system, a general-purpose computer, a radio, a television, or a set-top box that can be controlled by a local keyboard, by optical signals. or electric, powerline, WiFi or Bluetooth (registered trademarks). In the example shown in figure 1 the device to be controlled can be controlled by a control input hardware interface, for example by an infrared remote control 110. For this purpose, the remote control 110 has keyboard keys 115, an encoder 117 which provides a key code for each pressing on one of the keys of the keyboard 115 and an infrared signal transmitter 120 which modulates infrared signals representative of the key codes generated by the encoder 117. On the device to be controlled 105, an infrared signal receiver 125 receives these signals and demodulates them before transmitting them to a control processing module 130. The control processing module 130, after interpretation of received key codes, activates one or more of the functions 135 of the device 105.

According to the present invention, remote control means implemented in both a control device 150 and at least one control device 105 are added. Here, the control device 150 is a portable device, for example a mobile telephone. , a PDA, or PDA, or a handheld or portable computer.

• un écran graphique 155,
• une application 160 implémentant une interface utilisateur sur l'écran graphique et un contrôleur d'interface utilisateur qui détecte des interactions de l'utilisateur avec l'interface utilisateur et invoque des actions d'un service de réception et d'interprétation de commande 170 du dispositif à commander 105 et
• un module de communication à distance 165.

In the embodiment illustrated in figure 1 the control device 150 comprises:

• a graphic screen 155,
• an application 160 implementing a user interface on the graphics screen and a user interface controller that detects user interactions with the user interface and invokes actions of a reception and control interpretation service 170 of the device to be controlled 105 and
• a remote communication module 165.

The remote communication module 165 communicates through a local area network (not shown) with a remote communication module 167 of the device to be controlled 105. The reception and control interpretation service 170 receives, via the module 167, UPnP action invocation requests, interprets these commands and their possible parameters, and transmits to the command processing module 130 command codes resulting from this interpretation.

The service 170, hereinafter referred to as "RemoteControl" service, thus serves as an interface making it possible to make available to the UPnP entities of the local network, the control mode implemented by the command processing module 130 and the functions 135.

The command processing module 130 is able to receive and process both key codes, emitted by means of an infrared signal from the remote control 120, and control codes, derived from UPnP commands conveyed through the local network by invoking UPnP actions proposed by the "RemoteControl" service 170.

The device to be controlled 105 also implements a UPnP entity of the "digital media renderer" or DMR 175 type, which, in accordance with the UPnP standard, implements the "ConnectionManager" (for connection manager) and "RenderingControl" services (for rendering control) and, in general, includes the "AVTransport" service (for audio-video transport). This set of standard services is represented on the figure 1 171. The requests for invoking actions of these services are also transmitted through the remote communication module 165, the local network and the remote communication module 167.

The "RemoteControl" service 170 is preferably performed as a UPnP service of a UPnP entity / device. In the embodiment described here by way of example, the "RemoteControl" service 170 is implemented by the UPnP entity 175 (or device DMR, according to the UPnP terminology). In this way, by means of the command application 160 and a user interface associated with this application, a user is able to completely control the functions of the device to be controlled: on the one hand, the elementary functions usually triggered by infrared commands, and on the other hand, the functions of rendering a DMR proposed via the services "ConnectionManager", "RenderingControl" and "AVTransport".

The device to be controlled 105 can also be an equipment integrating a UPnP entity implementing, as sole service, the UPnP control receiving service as defined in the present invention.

The figure 2 represents an exchange of messages to change the channel on a decoder 105. It is assumed that the application 160 allowing the remote control operates on a mobile phone 150 and, through its user interface, displays the user a list channels each identified by a channel number and graphic elements representing keys on a numeric keypad, bearing the numbers "0" to "9".

According to the interactions detected on this user interface, the command application invokes actions of the "RemoteControl" service 170.

• l'action « SendKeyPressEvent() » avec les paramètres suivants : KeyCode=«D1» et PressType=« SINGLEPRESS » et
• l'action « SendKeyPressEvent() » avec les paramètres suivants : KeyCode=«D2» et PressType=« SINGLEPRESS »,

où le paramètre « KeyCode» » identifie la touche appuyée et le paramètre « PressType » identifie le type d'interaction, en l'occurrence le type d'appui de touche.For example, if the user chooses the channel number "12", by successively selecting the "1" and "2" keys on the part of the user interface of the DMC representing a numeric keypad, the DMC invokes the following actions:

• the "SendKeyPressEvent ()" action with the following parameters: KeyCode = "D1" and PressType = "SINGLEPRESS" and
• the action "SendKeyPressEvent ()" with the following parameters: KeyCode = "D2" and PressType = "SINGLEPRESS",

where the "KeyCode" parameter identifies the pressed key and the "PressType" parameter identifies the type of interaction, in this case the type of key press.

The application DMC is aware, for all the user interface elements allowing a user interaction, of each action to be invoked (for example an action or sequence of actions, possibly triggered by "macros"), key codes to be used as parameters and the type of interactions to be detected.

According to the same principle of invoking actions, an action can be invoked for a plurality of detected interactions. The application DMC 160 may for example be used to send an alphanumeric character string that a user would have entered by multiple interactions with a portion of the user interface representing an alphanumeric keyboard. In this case, the character string is for example transmitted as a parameter of a "SendKeyCodeSequence" action designed for this purpose.

The action invocation requests, including the key codes and any information on the type of key press, are transmitted by the application 160 and addressed to the "RemoteControl" service 170 and detected in accordance with the intended discovery protocol. in UPnP. Upon receipt of an action invocation request by the "RemoteControl" service 170 and its possible parameters, the latter translates this request into command codes and then transmits these command codes to the processing module 130.

• d'une part, les actions UPnP définies dans le standard UPnP pour le service de restitution d'un DMR UPnP et,
• d'autre part, les actions UPnP définies selon la présente invention pour le service « RemoteControl » 170,

soit mis en oeuvre au sein d'une seule et même application 160. Dans cette optique, l'application 160 est également nommée « application DMC ».An implementation of the present invention is presented below for an application 160 enabling the remote control of several devices to be controlled 105, which application is generic and configurable whatever the device to be controlled 105. The application 160 is for example integrated in a UPnP DMC so that the set of UPnP actions including,

• on the one hand, the UPnP actions defined in the UPnP standard for the UPnP DMR rendering service and,
• on the other hand, the UPnP actions defined according to the present invention for the "RemoteControl" service 170,

it is implemented within a single application 160. In this respect, the application 160 is also called "DMC application".

The application DMC 160 thus designates the application that allows a user to control UPnP devices of a home network that implement the "RemoteControl" service 170. The application DMC 160 is composed of a user interface ("UI"). for "User Interface") and a UPnP DMC module enhanced by the ability to detect and invoke actions of the "RemoteControl" service 170.

Because of its compatibility with the "RemoteControl" service 170, the application 160 is able to present to the user, on the screen 155, in a specific manner, the UPnP devices that implement the "RemoteControl" service. For example, when the application 160 displays the list of UPnP devices of the home network, each device implementing the "RemoteControl" service 170 is identified by a remote control icon. By selecting this icon, the user enters a "remote control" mode of the device 105 in question and screens specific to this remote control are displayed on the screen 155, through the user interface.

In order to favor a generic DMC 160 application, preferentially, user interface screens are defined whose buttons and other interactive graphic elements are configurable. Indeed, the list of buttons and other interactive graphic elements, their layout and the associated key codes are described in an XML configuration file that the DMC controller application 160 obtains during its initialization. This file is either pre-recorded by the DMC application in a predefined file directory, or transmitted by the "RemoteControl" service 170 to the DMC application on receipt of a request defined for this purpose or obtained by means of a URL provided by the RemoteControl service 170.

We assume that each interaction at one of the buttons or other interactive graphic element of the user interface causes one or more key codes to be sent by means of an UPnP action invocation request. . For this purpose, the configuration file defines the action (s) to be invoked and / or possible action parameters according to the interactions of the user with the user interface associated with the command application.

The "SendKeyStrokeEvent" action reports a keystroke to the "RemoteControl" 170 service. It includes the following parameters: Argument Direction Linked state variable KeyCode IN A_ARGTYPE_KeyCode strokeType IN A_ARGTYPE_StrokeType Error code Error description Description 801 Invalid Key Code the code is not valid 802 Invalid Stroke Type typing type is invalid

The "SendKeyPressEvent" action reports a key press to the "RemoteControl" 170 service. It includes the following parameters: Argument Direction Linked state variable KeyCode IN A_ARGTYPE_KeyCode presstype IN A_ARGTYPE_PressType Error code Error description Description 801 Invalid Key Code The code is not valid 802 Invalid Press Type The typing type is invalid

• des appuis ou relâchés de touche, simulés par clic de souris sur un élément graphique représentant la touche considérée ou
• des durées d'appui de touche, simulés par clic de souris sur un élément graphique représentant la touche considérée.

Depending on the equipment to be controlled, it may be necessary to detect different types of user interaction on the user interface of the application 160:

• presses or keystrokes, simulated by mouse click on a graphic element representing the key considered or
• key press durations, simulated by mouse click on a graphic element representing the key in question.

The "RemoteControl" 170 service makes it possible to manage different key press durations ("SINGLE" for a short press, "DOUBLE" for two short presses and "LONG" for a long press) and more events. low level (of type pressing or releasing keys). The configuration file therefore specifies the type of interaction to be detected for each graphical element representing a button, especially if the user interface, the UI module, is to perform PUSH / RELEASE (or press / release) management for the button. and, in this case, send the events down level "PUSH" (press) and "RELEASE" (released) via the action "SendKeyStrokeEvent ()".

With regard to "SendKeyCodeSequence ()", this action sends a sequence of key codes to the "RemoteControl" service 170. Argument Direction Linked state variable keySequence IN A_ARGTYP E_KeyCodeList

As regards the sending of characters, with the new remote control service, it is possible to provide advanced uses, for example by enabling the user to search for a video file in a VOD catalog by entering his title, his author, one of his interpreters or any other reference using a string of characters. This functionality can be easily provided by implementing a rich application ("rich media application") based on a DMC compatible with the "RemoteControl" service 170.

• utiliser l'action « SendKeySequence() » pour transmettre des caractères. Pour éviter des conflits avec des codes de touches de commande à distance, on peut mettre à part les caractères (par exemple avec un antislash ou barre oblique inversée, en anglais « backslash », suivi du caractère à transmettre), ou spécifier les codes ASCII ou UTF8 (par example « ASC48 » pour le caractère « a »),
• créer une action spécifique pour transmettre des caractères « UTF-8 » (par exemple, « SendCharacters() » comportant la chaîne à transmettre comme un argument « IN »).

For this purpose, two implementation options are envisaged:

• use the "SendKeySequence ()" action to transmit characters. To avoid conflicts with remote control key codes, you can set the characters aside (for example with a backslash, followed by the character to be transmitted), or specify the ASCII codes. or UTF8 (for example "ASC48" for the character "a"),
• create a specific action to transmit "UTF-8" characters (for example, "SendCharacters ()" with the string to be passed as an "IN" argument).

The name of the screen configuration file can be chosen based on properties specified in the UPnP entity description. For example, the "modelName" property of a UPnP entity is used to retrieve the name of the screen configuration file. For example, if the modelName of an STB decoder is "TV Decoder", the configuration file is "decoder_tvRemoteConfig.xml".

  <?xml version=«1.0» encoding=«UTF-8»>
  <remoteConfig>
  <button position=«1» text=«Menu» icon=«menu.png»>
  <key code=«MENU» type=«SINGLEPRESS»>
  </button>
  <button position=«2» text=«UP» icon=«up.png» keystroke=«UP»>
  </remoteConfig>

An example of a configuration XML file is given below:

 <? xml version = "1.0" encoding = "UTF-8"> 
  <RemoteConfig><button position = "1" text = "Menu" icon = "menu.png"><key code = "MENU" type = "SINGLEPRESS"></Button><button position = "2" text = "UP" icon = "up.png" keystroke = "UP"></RemoteConfig> 

• le bouton « MENU » qui correspond à la touche « MENU » de la télécommande. Sa sélection dans l'interface doit générer l'envoi du code de touche (« KeyCode ») « MENU » avec une variable de type d'appui (« pressType ») valant « SINGLEPRESS » (appui simple) et
• le bouton « UP » qui correspond à la flèche « haut ». L'attribut « keyStroke » permet de spécifier au module UI qu'il doit gérer les appuis/relâchés de bas niveau pour ce bouton.

The example above defines two buttons:

• the "MENU" button corresponding to the "MENU" button on the remote control. Its selection in the interface must generate the sending of the keycode ("KeyCode") "MENU" with a variable of type of support ("pressType") worth "SINGLEPRESS" (simple support) and
• the "UP" button corresponding to the "up" arrow. The "keyStroke" attribute allows the UI module to specify that it should handle low-level press / release for that button.

The attribute "position" makes it possible to specify a position of the button in the screen. For example, the screen presents the buttons in the form of a grid and each box of the grid is numbered and associated with a button.

In parallel with the description of the steps illustrated in figure 3 , we recall, below, the fundamentals of the UPnP standard.

UPnP allows the definition, discovery and control of UPnP entities present on the network ("network devices").

During a step 305, an application 160 implementing a user interface, implemented on the control device or on a remote device communicating with the control device, which detects interactions with the control device, is initialized on the control device 150. user with the user interface and invokes actions of the "RemoteControl" service 170, corresponding to said interactions.

During a step 310, a "RemoteControl" service 170 is initialized on at least one command device 105, which receives, from the application 160, action invocation requests, translates them into action. control codes then transmits these command codes to the command processing module 130.

In a addressing phase 315, each of the devices 105 and 150 joins the UPnP network, automatically obtaining a unique address that the network entities can use to communicate with this device.

During a description phase 320, each of the devices 105 and 150 summarizes its services and capabilities in a standard format. In particular, the device to be controlled 105 indicates that it has the "RemoteControl" service 170. During the description phase, a UPnP entity gives a list of the services it provides, in documents based on XML. The description of UPnP includes a URL to access a description of each service provided by that entity. A service description provides detailed information about this service, the actions this service provides, the service settings, and its return value.

During a discovery phase 325, the device 105 is detected by UPnP Control Points, in particular by the device 150, which learn the capabilities of the device 105 to obtain its description.

The discovery phase defines how an UPnP entity announces its presence and how UPnP Control Points discover it by implementing the Simple Service Discovery Protocol (SSDP). This SSDP protocol extends HTTP protocol headers to provide a simple discovery protocol based on a multicast broadcast.

Once a UPnP entity has acquired an IP address, this UPnP entity is periodically signaling itself on the network. This periodic communication as well as the responses during discovery phases include a URL of the XML description document. This URL provides UPnP Control Points with the information they will need to retrieve descriptions of this UPnP entity and its services. The description documents are found by the UPnP Control Points and scanned, or "parsed", to know the UPnP entity well. A vendor can add extensions beyond the basic functions and include them in the description documents. This extension mechanism allows a Point to UPnP control to prefer an optional or vendor-specific interface to a standard interface.

During a control phase 330, the device 105 processes the requests that come to it from the UPnP Control Points, in particular from the device 150. During the control phase, the UPnP Control Points invoke the actions of a service of a UPnP entity. When a service receives a control message, this service acts according to this message. UPnP relies on the Simple Object Access Protocol (SOAP) for controlling a UPnP entity. This protocol unites XML and http to provide web-based messages and remote call procedure mechanisms: XML expresses the contents of the message while HTTP sends the messages to their destinations. The SOAP protocol is specified as a set of conventions that govern the format and rules for processing SOAP messages.

During an event processing phase 335, the device 105 notifies the control points that have subscribed to this notification, each modification of its internal state.

During a presentation phase 340, the device 105 provides an administration interface based on HTML code to allow the direct manipulation and monitoring of the device 105. Each of the UPnP phases is related to protocols. Note that the device 105 can provide the URL of a presentation page in the description of the device.

During a step 345, the user interacts with the user interface. During a step 350, the user interface detects each interaction of the user with the user interface. During a step 355, the application 160 invokes actions, including any parameters, representing said interactions. During a step 360, the invocation request is transmitted to the device 105.

During a step 365, the "RemoteControl" service 170 receives the action invocation request, that is to say receives a UPnP command.

During a step 370, the "RemoteControl" service 170 interprets this command to generate one or more command codes that it transmits to the command processing module 130.

During a step 375, the command processing module interprets the command code (s) received, in order to activate the function (s) 135 corresponding to these command codes.

It is noted that each UPnP entity can offer a large number of services, each service having its own unique type of service. This is how departments define the real features of this entity.

A Control Point is a network entity that invokes a feature of a UPnP entity. In terms of client / server, the Control Point is the client and the UPnP entity is the server. Control Points invoke actions on services, providing any required input parameters and receiving any output parameters and possibly a return value. A Control Point discovers UPnP entities, invokes actions on the services of these UPnP entities and subscribes to event notifications. For its part, a UPnP entity responds to action invocations, sends events when state variables change, and supports a web page for an administrative control, called page ("page layout"). ).

• elle permet une interaction plus facile avec plus de possibilités au niveau de l'affichage (tactile, affichage des métadonnées...),
• elle permet une interaction optimisée en termes de programmation des tâches, etc. Par exemple, je veux programmer l'enregistrement d'une émission sur le canal 2 mais je regarde le canal 5 et ne veux pas le perturber sur la télévision, ce qui n'est pas possible avec l'EPG et l'enregistrement actuel par télécommande classique. Donc je programme l'enregistrement du canal 2 avec mon application sur mon mobile,
• elle permet une écriture alphabétique plus simple avec le clavier d'un mobile ou un clavier tactile sur un terminal mobile, par exemple dans le cadre d'une recherche d'une vidéo dans un catalogue de vidéo à la demande.

Several advantages of the present invention are given below:

• it allows easier interaction with more possibilities in the display (touch, metadata display ...),
• it allows optimized interaction in terms of task scheduling, etc. For example, I want to schedule the recording of a program on channel 2 but I watch channel 5 and do not want to disturb it on television, which is not possible with the EPG and the current recording by classic remote control. So I program the recording of channel 2 with my application on my mobile,
• it allows a simpler alphabetic writing with the keyboard of a mobile or a tactile keyboard on a mobile terminal, for example in the context of a search for a video in a catalog of video on demand.

The UPnP remote gives the potential to design and develop new infrared-based control mechanisms that enrich the UPnP interfaces that these devices already have. The UPnP standard has been retained in this description because it is one of the best candidates for compatibility, interoperability and simplicity of development. However, the principles of the invention are also applicable to other standards for remote control of equipment.

Thanks to the invention, not only the users can control the DMR services of their decoder, but also have a user interface also offering the equivalent of the buttons of the remote control and access to the more advanced functions of the decoder which can thus be fully piloted from any DMC control point that implements the remote control application.

This remote control application can be implemented in any type of terminal capable of communicating through the network to which the device to be controlled is connected.

The end user can therefore use his mobile phone or any other communicating device to control all services available on the device to be controlled, which allows to evolve beyond the conventional infrared remote control.

To benefit from the advantages of the invention, it is necessary for the device to be controlled to implement this new UPnP service "RemoteControl" 170.

The present invention allows the complete remote control of a decoder via UPnP, including basic functions such as changing channels, accessing a menu, information, to start a play ("play"), stop playback, change playback range, change colors, move up, down, right or left, etc.

Thanks to the invention, an application implementing a UPnP "Control Point" which has been configured to also include the UPnP remote control application 160 is able to control the decoder via its associated graphical interface. this application.

The present invention also brings new functionalities, in particular because of the possibility offered to the user to drive, from one and the same user interface, several devices each incorporating a "RemoteControl" service 170: for example, the simultaneous control of a recording device (or "DVR" for "Digital Video Recorder") and a television for a programming of a recording of content or the simultaneous control of two separate TVs, for example, likely to broadcast the same audiovisual program. Thus the invention lends itself to complex multimedia flow management applications requiring the control of several independent equipment. The remote control application 160 can be used to control all infrared-controllable equipment incorporating a UPnP entity, for example of the "Digital Media Renderer" type.

It should be noted that, with the present invention, the user's experience goes beyond the functionalities allowed at the decoder by the UPnP (Digital Media Renderer) entity integrated therein. By default, according to the UPnP standard, the UPnP entity of the decoder allows it to be remotely controlled. The present invention aims at defining a new service in terms of UPnP in order to allow the total control of the decoder by means of a single remote control application, that is to say the activation of both the functions of the pre-existing UPnP entity and basic functions, the latter being activable until now only by means of a remote control or buttons of the decoder. The user will be able to take his mobile phone integrating this application of control, with some consequent modifications to this new service and to be able to control completely all the services audio and video on their television which arrive by the decoder or services musical on a device Hifi.

Claims (16)

1. Method of remote control implemented by a control device, the control device comprising:

   - a remote communication module designed to exchange, across a local area network, with a remote communication module of a device to be controlled (105),

   - a first entity able to trigger at least one function implemented by a second entity and which are declared by said second entity,

   the device to be controlled comprising:

   - a module for processing commands (130) controlling, on receipt of command codes, one of the at least one elementary function of the device to be controlled

   - the second entity declaring the at least one function, and able to implement one of the at least one function on triggering of the first entity of the control device

   - characterized in that the method of control comprises a step of implementation, on said control device, of a remote control application (160), said application being integrated on the first entity,

   - said application comprising, subsequent to a detection of at least one interaction of a user with a user interface associated with said application, a dispatching by said control device of at least one UPnP, DLNA command code to a command reception service (170), implemented by the device (105) to be controlled, the commands reception service transmitting said at least one UPnP, DLNA command code to said module (103) for processing commands which activates, from among the declared functions of the second entity, the corresponding elementary function of the second entity.
2. Method according to Claim 1, in which the control device is complementary to a command input hardware interface of the device to be controlled.
3. Method according to either one of Claims 1 or 2, in which the implementation of the application of the method of control comprises an invocation of an action of the command reception service of the device to be controlled, said invocation of an action comprising the dispatching of the at least one command code.
4. Method according to one of Claims 1 to 3, in which the step of implementation of the control application comprises an obtaining of a file defining the action or actions to be invoked and/or possible action parameters as a function of the interactions of the user with the user interface.
5. Method according to any one of Claims 1 to 4, which comprises a step of configuring the user interface in accordance with a configuration file, obtained by said application and defining graphical elements representing command input elements of a command input hardware interface of said device to be controlled.
6. Method according to Claim 5, in which the configuration file is specific to the device to be controlled.
7. Method according to either one of Claims 5 or 6, in which the configuration file specifies a type of interactions of the user with each of the user interface's elements with which the user can interact, the actions invoked and/or possible parameters of these actions being dependent on the interaction type detected.
8. Method of remote control implemented by a device (105) to be controlled, the device to be controlled comprising:

   - a remote communication module designed to exchange, across a local area network, with a remote communication module of a control device, and

   - a module (130) for processing commands controlling, on receipt of command codes, at least one elementary function of the device to be controlled, characterized in that:

   the method comprises a step of implementation, on the device (105) to be controlled, of a command reception service (107) which comprise a transmission by said command reception service of at least one UPnP or DLNA command code, to said module (103) for processing commands which activates the corresponding elementary function, said UPnP or DLNA command code, having been received by the command reception service of the control device originating from an application implemented by the control device, subsequent to a detection of at least one interaction of a user with a user interface associated with said application.
9. Method according to any one of Claims 1 to 8, in which the first entity is a UPnP, DLNA entity and the command reception service is a UPnP, DLNA service.
10. Method according to any one of Claims 1 to 9, which comprises a step of discovery, by the remote control application, of a device of a network implementing the remote command reception service and, at least in the case where more than such a device is discovered, a step of presenting the discovered devices and a step of selection, by the user, of one of the discovered devices, said invocations being addressed to the selected device.
11. Method according to any one of Claims 1 to 10, in which the command codes represent actions liable to be operated on a command input hardware interface of said device to be controlled.
12. Method according to any one of Claims 1 to 11, in which the command codes represent simple, double or long interactions of the user with a key of a command input hardware interface of said device to be controlled.
13. Method according to any one of Claims 1 to 12, in which at least one invoked action represents a character string entered with said user interface.
14. Method according to any one of Claims 1 to 13, in which the command codes represent a press or a release of a key of a command input hardware interface of said device to be controlled.
15. Device (150) for remote control of a device (105) to be controlled comprising:

    - a module (130) for processing commands, controlling, on receipt of command codes, at least one elementary function of the device to be controlled,

    - a second entity declaring at least one function, and able to implement one of the at least one function on triggering of a first entity of the control device the control device comprising:

    - a remote communication module designed to exchange, across a local area network, with a remote communication module of the device to be controlled

    - the first entity able to trigger at least one function implemented by the second entity,

    characterized in that:

    the device (150) for remote control comprises a means for implementing a remote control application (160) integrated on the first entity, the means for implementing the application being adapted to dispatch, subsequent to a detection of at least one interaction of a user with a user interface associated with said application, at least one UPnP or DLNA command code, via the local area network to a command reception service (170), implemented in the device (105) to be controlled, the command reception service transmitting the at least one UPnP or DLNA command code, to said module (103) for processing commands which activates, from among the declared functions of the second entity, the corresponding elementary function of the second entity.
16. Device (105) to be controlled comprising:

    - a remote communication module designed to exchange, across a local area network, with a remote communication module of a control device,

    - a second entity declaring at least one function, and able to implement one of the at least one function on triggering of a first entity of the control device, and

    - a module (130) for processing commands controlling, on receipt of command codes, at least one elementary function of the device to be controlled, said device (105) to be controlled being characterized in that it comprises a means for implementing a command reception service (170) transmitting at least one UPnP or DLNA command code, to said module (103) for processing commands which activates, from among the declared functions of the second entity, the corresponding elementary function of the second entity, said UPnP or DLNA command code, having been received by the command reception service of the control device originating from an application integrated on the first entity and implemented by the control device, subsequent to a detection of at least one interaction of a user with a user interface associated with said application.

Images