Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/75—Media network packet handling
  • H04L65/762—Media network packet handling at the source 
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/1066—Session management
  • H04L65/1101—Session protocols
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/1066—Session management
  • H04L65/1101—Session protocols
  • H04L65/1104—Session initiation protocol [SIP]

Definitions

• a method of managing the execution by a server of an application providing at least one interactive multimedia service to at least one terminal, corresponding computer program product and server.
• the field of the invention is that of audio and / or video communications, which take place on a switched telephone network type communication network, integrated services digital network, packet-switched network, or wireless telephone network, or any network that allows audio and / or video communication.
• the invention relates to a technique allowing terminals capable of receiving multimedia streams (containing information of the audio and / or video type) to access interactive multimedia services offered by applications.
• Each server can be a single machine or distributed on multiple machines.
• the invention applies in particular, but not exclusively, to the case of a server providing at least one interactive multimedia service to videophones.
• a WEB browser is an example of a thin client integrated by a terminal. It allows the particular terminal to connect to an http server, using the http protocol (hypertext transfer protocol), to transfer and display web pages in HTML ("HyperText Markup Language" or hypertext markup language) . It is important to note that, with regard to the outputs of the application executed by the server, the server does not transmit to the terminal a multimedia stream (Web pages) that the terminal can present directly, without prior processing. The server transmits information (HTML tags) that the device's web browser must process in order to generate a multimedia stream.
• HTML HyperText Markup Language
• the terminal does not transmit directly to the server the user's inputs (made for example via a keyboard or a joystick), without pre-treatment.
• the device's web browser must process these entries to convert them to http requests that are then sent to the server.
• PCs personal computers
• GotoMyPC registered trademark
• PcAnyWhere registered trademark
• Symantec software for remote control of a PC
• one of the objectives of the present invention is to provide a management technique for execution by a server of an application offering at least one interactive multimedia service to at least one terminal, this technique being able to be implemented with terminals with limited capacity, without the need for these terminals to run a thin client.
• the invention also aims, in at least one embodiment, to provide such a technique allowing the terminal to access an application (application) by controlling it.
• the invention also aims, in at least one embodiment, to provide such a technique allowing the terminal to access an application
• Another object of the invention in at least one embodiment, is to provide such a technique that is simple to implement and inexpensive.
• a complementary objective of the invention in at least one embodiment, is to provide such a technique that does not require any modification of the existing low capacity terminals, such as videophone for example. 4. Presentation of the invention
• the method comprises the following steps performed by the server: conversion of the outputs of the application in the form of at least a first multimedia stream that can be presented by said at least one terminal; and - transmitting said at least one first multimedia stream to said at least one terminal, via a communication established between the server and said at least one terminal.
• the general principle of the invention is therefore to perform, in the server, a conversion on the outputs of the application, so that after conversion they are compatible with the terminals, without them run a particular thin client (browser Web or other).
• it is the server that adapts the service, and more specifically the outputs of the application, to the most basic terminals, which are only required to be able to receive multimedia streams (for example a stream audio video, for a videophone).
• the invention allows one or more basic terminals to individually or multiple access to a multitude of services running on a remote server (which itself is executed by a single machine or several machines).
• the method further comprises the following steps performed by the server: reception of the inputs of the application that said at least one terminal transmits to the server, via said communication; and converting application entries into commands to control the application.
• the terminal or terminals can control the application, despite that they do not run any particular thin client (web browser or other). Again, it is the server that adapts the service to the most basic terminals, which are only required to be able to send the inputs of the application (for example DTMF signals generated by user support on a keyboard, for a videophone).
• the server receives the application inputs from said at least one terminal in at least one second multimedia stream and / or in at least one signaling channel associated with said communication.
• the step of converting the outputs of the application in the form of at least one first multimedia stream is based on a technique belonging to the group comprising (non-exhaustive list): capture at determined times of an image of screen resulting from the execution of the application, and conversion of the captured image sequence thus achieved into at least one video stream, in real time; implementation by the application of a direct display in memory, and conversion of the direct display in memory in at least one video stream.
• the server comprises a signaling server and a processing server, and the processing server performs the step of converting the outputs of the application and the step of transmitting said at least one first multimedia stream.
• the invention can be applied both in the case where the server is run on one or more machines dedicated to the provision of said at least one interactive multimedia service that in the case where the server is run on one or more machines not dedicated to providing said at least one interactive multimedia service.
• said at least one terminal is a basic terminal not integrating any particular processing capability.
• the terminal is for example a videophone. It is clear that, more generally, the invention applies to any type of terminal capable of receiving and presenting a multimedia stream coming from the server and, if the terminal must pilot the application, to send in a raw manner (c ' that is, without processing) the application's entries to the server.
• the server is seen by said at least one terminal as a call termination point.
• the server is intercalated in a transparent manner, at the end of a communication between said at least one terminal and another terminal.
• the invention also relates to a computer program product downloadable from a communication network and / or recorded on a computer readable medium and / or executable by a processor, this computer program product including program code instructions for the computer program. execution of the steps of the aforementioned method, when said program is executed on a computer.
• the invention also relates to a server of the type enabling the execution of an application offering at least one interactive multimedia service to at least one terminal connected to the server via a communication network.
• the server comprises: means for converting the outputs of the application in the form of at least one first multimedia stream that can be presented by the at least one terminal
• FIG. 1 shows an exemplary system in which the method according to the invention can be implemented, comprising a server according to the invention
• FIG. 2 presents a flowchart of a particular embodiment of the method according to the invention
• FIG. 3 is a simplified representation of the service rendered to a terminal by a server according to the invention
• FIG. 4 shows a functional block diagram of a particular embodiment of the server according to the invention, comprising a signaling server and a processing server
• FIGS. 5, 6 and 7 each show a distinct example of exchange kinematics between a terminal and the signaling and processing servers appearing in FIG. 4
• Figure 8 shows the structure of a machine running a server according to the invention. 6.
• the invention therefore relates to a method for managing the execution by a server of an application offering at least one interactive multimedia service to at least one terminal connected to the server via a communication network.
• the server 1 provides an interactive multimedia service to one or both of the terminals 2, 3, which are, for example, videophones.
• the terminals 2, 3, which are, for example, videophones.
• a communication is established, via a communication network 4, between the server 1 and the terminals 2, 3.
• server 1 is running on a single machine.
• the invention also applies in the case where the server is run on several machines.
• FIG. 2 a particular embodiment of the method according to the invention is presented. For example, it is assumed that a terminal (for example the one referenced 2 in FIG. 1) wishes to benefit from a multimedia service offered by the server (referenced 1 in FIG. 1).
• the server executes an application aimed at providing an interactive multimedia service to the terminal.
• the server checks whether the application has generated an output. In the case of a positive verification in step 22, the server performs a step 23 of converting this output of the application into at least one first multimedia stream that can be presented directly, without prior processing, by the terminal. Then, in a step 24, the server transmits this or these first streams to the terminal, via a communication established between the server and the terminal. Finally, the server returns to step 22. In case of negative verification in step 22, the server server returns directly to step 22.
• the server checks in a step 25 if the terminal has transmitted to him, directly and without prior treatment, an entry of the application.
• the server receives the input transmitted by the terminal in a step 26.
• the server converts this input (for example a DTMF signal) into one or more commands to control the application.
• the server returns to step 22.
• the server returns directly to step 25.
• a session gives rise to the execution of an application on an interactive service server (this can be a dedicated server or an advanced terminal at an individual); the outputs of the application (video display, audio output, ...) are sent in the form of media streams to one or more connected terminals according to their capabilities; and the entries entered on the terminal or terminals can be sent to the application and allow to control it from the terminal that generated the entries.
• the inputs can be of various types: DTMF ("Dual Tone MultiFrequency", or “multifrequency two-tone"), voice, video with pattern recognition or gestures in a video stream (the recognition can then be done on the machine receiving the flow), or others.
• DTMF Dual Tone MultiFrequency
• voice voice
• video with pattern recognition or gestures in a video stream the recognition can then be done on the machine receiving the flow
• the invention makes it possible to produce interactive applications that can be used and controlled from any terminal with limited capabilities (compatible with the type of application that is to be made accessible).
• This application may be a game, a configuration interface of its services, or any other type of application with potential user interactions.
• Several terminals can be in communication with the application (multiplayer games, document sharing, presentations, ).
• the invention offers the possibility of accessing an application without controlling it from a terminal. In this case, no entry of the application is entered on the terminal, and the method is limited to steps 21 to 24 of Figure 2.
• the client terminal here plays the role of the service server and the client software is the application executed by this server.
• the client software (or a module installed on its machine) can capture the output of the client software and convert it to a media stream accepted by the terminal with limited capabilities of the "hot line".
• the client software or a module installed on its machine
• the service delivered to a terminal 2 by a server 1 according to the invention can be represented by the diagram of FIG.
• the interactive services server can be seen as a terminal (as in the case of a service portal which is called directly, simply by dialing a number (or an alias) as for the establishment of a conventional telephone call).
• the server can be inserted transparently in cutoff during the establishment of a call to a correspondent (active services during communication).
• the application server switches off the communication, it does not actually switch off unless necessary (for example, if the caller or called party is not subscribed to the service specific, the communication normally takes place) or at the request of one of the users.
• the exchanges between the terminal 2 and the server 1 we can distinguish those
• the inputs (commands) 33 transmitted to the server by the terminal can be either messages in the signaling of the communication (case of DTMFs in ESFFO messages in SIP), or media streams which are interpreted by the server as commands (like for example speech recognition).
• the service may, for example, be rendered by means of two pieces of equipment: a signaling server (41) (traditionally called AS for "Application Server” in the SIP world) and a processing server (or PS for " Processing Server ”) 42.
• a signaling server (41) traditionally called AS for "Application Server” in the SIP world
• a processing server or PS for " Processing Server ”
• the server 1 discussed above itself comprises the signaling server 41 and the processing server 42.
• the processing database 43, data or content servers, .
• a communication (here the example is given with only one participant, the terminal 2) takes place in two stages: the caller 2 dials the service number, the signaling server 41 determines the processing server 42 available corresponding to the requested service and makes the media streams 44 of the caller 2 sent to the processing server 42 and that the media streams 45 of the processing server 42 are sent to the caller 2; the caller 2 can interact with the processing server 42 by means of the input device of his terminal, the commands being sent in the form of a media stream or in the signaling (and in this case relayed by the SIP-serviet 46) and interpreted by the processing server 42.
• the role of the signaling server 41 is now presented, in connection with the examples of exchange kinematics of FIGS. 5, 6 and 7.
• the call establishment proceeds normally, except that the signaling server
• SIP-serviet 46 written in Java. It requires passing some SIP protocol request messages ("Session
• the servlet 46 consults the payload of the message, which is a description in SDP format ("Session Description Protocol") of the different flows that will be involved in the communication (that is, the streams that the caller 2 wishes to receive in the communication session).
• the servlet 46 indicates to the processing server 42 the addresses 52 associated with each stream of the caller intended to interact with the processing server 42.
• the processing server 42 supplies the servlet 46 with the addresses 53 corresponding to the streams of the server. processing server 42 associated with the caller. This is done by means of a programming interface (or API for "Application Programming
• the servlet 46 simulates a called terminal by accepting the call by returning to the caller 2 a SIP message "200OK" 54 containing the addresses and flow types associated with the processing server 42. The servlet 46 also intercepts the acknowledgment SIP message.
• DTMF in-band or out-of-band (DTMF) DTMF, etc. It is possible that the servlet 46 is responsible for receiving these inputs (triggers), in which case it transmits them to the processing server 42.
• the triggers are conveyed in the form of DTMF out-of-band.
• the processing server 42 transmits media streams 61 transmitted to the caller 2.
• the caller 2 controls the application by pressing, for example, a key on the keyboard of his terminal. In the example, this produces a message "ESfFO (DTMF)" 62 of the SIP protocol which carries the DTMF digit associated with this key.
• the signaling server 41 intercepts this "INFO (DTMF)" message 62, and transmits a trigger request 63 to the processing server 42. The latter acts on this trigger as a function of the current application.
• the trigger causes an update of the media stream 64 sent to the caller 2.
• the kinematics illustrated in Figure 7 relates to the termination of the call (call) by the caller. It is assumed that the processing server 42 and the caller 2 are sending flows 71.
• the signaling server 41 intercepts the end-of-call SIP message "BYE" 72 sent by the caller and transmits a stop request 73 from the service to the processing server 42. The latter responds with an acknowledgment message 74 and the signaling server 41 sends a SIP message "200OK" 75 to the caller in order to terminate the call in turn.
• the caller and the processing server 42 stop all transmissions of media streams between them (which is symbolized by the dots referenced 76).
• the role of the processing server 42 is now presented. It acts as an end of communication terminal with regard to the media streams. It exposes the aforementioned API 48, allowing the servlet 46 included in the signaling server 41 to initialize the input / output addresses, and possibly to drive the application of the processing server 42 if the caller inputs are received by the servlet.
• RTCP Real-Time Transport Protocol
• the processing server 42 may or may not have outputs on the machine running the application.
• the service delivered by the processing server 42 may be more or less complex and may be a menu to other services that will then be executed by the processing server 42 or simply relayed by it or provided directly by a new server after transfer .
• the processing server 42 may be in several forms, for example
• This module also functions as a robot application that makes it possible, for example, to take control of the cursor (displacements and generation of clicks) as a function of the incoming information (inputs of the application) coming from the control terminals; a module integrated in the application, which retrieves a display buffer (for example, but this is valid for all other types of output of the application) to convert it to RTP media stream.
• This module then retrieves the inputs from the terminals and can act directly on the elements of the application.
• the interactive services server is itself a communication termination element for both the flows and the signaling. It can also be an element in the communication network, or a correspondent in the same way as the requesting terminal of the service (case of a "peer-to-peer" network for example).
• FIG. 8 shows the structure of a machine running a server according to the invention, the server itself executing an application offering at least one interactive multimedia service.
• the machine includes a memory 81, and a processing unit
• the processing unit 80 receives outputs from the application 83, which the microprocessor processes, according to the instructions of the program 82, to convert them into one or more multimedia streams 84 transmitted to one or more terminals so that they present them directly. , without prior treatment.
• the processing unit 80 also receives inputs from the application 85, transmitted by one or more terminals, which the microprocessor processes, according to the instructions of the program 82, to convert them into one or more commands 86 making it possible to control the application.

Applications Claiming Priority (2)

Publications (1)

Family

ID=35448202

Family Applications (1)

Country Status (3)

Families Citing this family (32)

Family Cites Families (6)

• 2006
  • 2006-06-07 WO PCT/EP2006/062982 patent/WO2006134055A1/fr active Application Filing
  • 2006-06-07 US US11/917,695 patent/US20090119408A1/en not_active Abandoned
  • 2006-06-07 EP EP06763567A patent/EP1891790A1/de not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events