EP2368167A1

EP2368167A1 - Method and device for processing text data

Info

Publication number: EP2368167A1
Application number: EP09802187A
Authority: EP
Inventors: Stephane Allegro
Original assignee: France Telecom SA
Current assignee: Orange SA
Priority date: 2008-12-22
Filing date: 2009-12-16
Publication date: 2011-09-28
Also published as: US20110249083A1; JP2012513693A; WO2010072945A1; US8848015B2

Abstract

The invention relates to a method for processing text data in a telecommunication context between at least one first terminal (T1) and one second terminal (T2), comprising, after a first processing device (MCU) receives text data (d1) from the first terminal (T1), generating image data (Im) integrating said received text data (d1) in order to transmit the image data (Im) to at least the second terminal (T2). The invention also relates to a corresponding device and to a call system including such a device.

Description

Method and device for processing textual data

The invention relates to the field of textual data processing, in particular in the context of videoconferencing between a plurality of users.

Conversational videophone services have recently undergone a strong development. Such services consist of the joint use of video, audio and text means to organize a conference between a plurality of participants.

In addition to traditional video / audio conferencing means, a chat feature is required to exchange messages as textual data. In a point-to-point context, between two participants, there are methods of exchanging texts, regardless of the exchange of video, with for example a text input made on the client side and exchanged by entire sentence.

An example of such a point-to-point system is shown in FIG. IA. In this conventional system, the terminals A and B exchange video data by a first exchange channel 1, audio data by a second exchange channel 2 and text data by a third exchange channel 3. The transfer of Text data is governed by a text communication protocol, such as the T. 140, SIP Message or SIP Info protocols. A first problem arises if one wishes to carry out textual conversations between two terminals not using the same text communication protocol, or incompatible protocols between them. This problem is illustrated in Figure IB. In this figure, in addition to the usual channels of video exchange 1 and audio 2, the terminal A uses a channel 4 for exchanging text data managed by a T.140 type protocol, while the terminal B uses a channel 5 d exchange of text data managed by a SIP Message type protocol, as an example. In such a case, the terminal B can not receive the textual data provided by the channel 4, and conversely the terminal A can not receive the data provided by the channel 5.

This problem is particularly acute in the context of multipoint videoconferencing systems, where a central control unit will manage videoconferencing between a plurality of participants, typically more than three.

This is illustrated in FIG. IC. In this figure, in addition to the usual channels of video exchange 1 and audio 2, the terminal A uses a channel 6 for exchanging text data managed by a T.140 protocol. It receives textual data from a terminal B according to a textual data exchange channel 7 managed by the same protocol T.140, as well as textual data from a terminal C according to a textual data exchange channel 8 managed. by the SIP protocol Message. In such a case, the terminal A can communicate verbatim with the terminal B, but is unable to communicate verbatim with the C terminal.

It is clear from Figure IC that the more participants in a multipoint videoconferencing, the greater the chance of having a textual data exchange problem, since only one of the participants does not use the same text communication protocol as the others, or a protocol that is incompatible with them, for the textual conversation to fail.

In addition, the presentation of the text conversation in such a context will be very heterogeneous and depend on the capabilities of each terminal.

A solution to this text conversation problem, during a videoconference between several participants, is of course to require that each participant use the same textual communication protocol, as is the case for the terminals A and B on the figure IC. However, this constraint is cumbersome to implement, or even simply unfeasible, when the participants' terminals already have their own textual communication protocol and can not change it. In addition, participants' terminals do not know how to receive textual data from multiple text sources, even if they use the same protocol. Thus, in fact, most terminals do not support the multi-point text dialogue function. One of the aims of the invention is to overcome disadvantages of the state of the art cited above.

It proposes for this purpose a textual data processing method, in telecommunication context between at least a first terminal and a second terminal, having, after receiving from a textual data processing device of the first terminal, the generation of data. image integrating the textual data received, for transmission of these image data at least to the second terminal.

The present invention improves the situation, making it possible for multiple text conversations, homogeneously and dynamically, with any terminal supporting at least the sending of textual data.

The second terminal does not need to use the same textual communication protocol as the first terminal to receive the text data thereof.

In addition, the second terminal can now receive multiple text streams from different sources and transferred using the same protocol.

In a preferred embodiment, the processing device embeds at least a portion of a text corresponding to said text data in at least one source image. The text data of the first terminal will thus be readily available for the second terminal, simply by viewing the image data received from the processing device.

According to an advantageous characteristic of the invention, the processing device also receives text data from the second terminal and embeds at least part of a text corresponding to said textual data received from the second terminal in said source image.

It thus becomes possible to make conversation without the need to use the same textual communication protocol, simultaneously displaying text data from different terminals.

Advantageously, at least part of the source image is communicated from the first terminal to the processing device.

Information of a textual nature from the first terminal will thus be supplemented by information of a visual nature.

Preferably, the source image is a composite image of which at least part is communicated from the second terminal to the processing device. Textual information from the terminals will thus be supplemented by visual information from them.

In a first variant, the overlay of the text data is performed in a display area defined in said source image.

Such an arrangement of the text makes it possible to follow the conversation between participants in an immediate manner.

In another variant, the source image comprises at least a first display area in which at least a portion of a first image communicated from the first terminal to the processing device is displayed, as well as a second display area. wherein at least a portion of a second communicated image of the second terminal is displayed to the processing device. Such a processing device embeds at least part of a text corresponding to said text data from the first terminal in the first display area and at least a portion of a text corresponding to said text data from the second terminal in the second area. display.

Such an arrangement of the text makes it possible to immediately associate the text entered during the conversation with its author.

The present invention also proposes a device for processing textual data, in the context of telecommunication between at least a first terminal and a second terminal, comprising processing means adapted to implement the method as described above.

Advantageously, the processing device comprises pretreatment means for generating the source image according to the method described above.

Preferably, the pretreatment means comprises mixing means for generating said source image in the form of a composite image according to the method described above.

The present invention also provides a video-text conversation system comprising a textual data processing device as described above, connected to at least two terminals able to send textual and / or image data to the processing device.

The present invention proposes, finally, a computer program for the implementation of the method as described above. Such a program may be downloadable via a telecommunication network and / or stored in a memory of a processing device and / or stored on a storage medium intended to cooperate with a processing device.

Other characteristics and advantages of the invention will appear on examining the detailed description below, and the attached drawings in which: FIGS. 1A, 1B, 1C illustrate various conventional videoconferencing systems with textual communication;

FIG. 2 diagrammatically represents a textual data processing device according to a preferred embodiment of the invention; Figures 3A, 3B illustrate different modes of presentation of textual data and images according to the present invention; FIG. 4 illustrates a videoconferencing system with textual communication according to a preferred embodiment of the invention; Figure 5 illustrates the steps of a textual data processing method according to a preferred embodiment of the invention.

Referring first to Figure 2 which shows schematically a conversation system comprising a textual data processing device MCU according to a preferred embodiment of the invention.

In this conversation system, three users Bob, Jen and Sam converse together through their respective terminals Ti, T ₂ and T ₃ . These terminals are connected to the MCU processing device which, in the example shown, is an MCU control unit (for "Multipoint Control Unit"). The system illustrated in Figure 2 is used by three users as an example, but it is obvious that the present invention can be applied to any system used by two or more users, each equipped with a terminal connected to the MCU control unit.

The three users Bob, Jen and Sam can enter text data di, d ₂ , d ₃ on their respective terminals Ti, T ₂ and T ₃ and send them to the control unit MCU. Here, "textual data" is understood to mean one or more data corresponding to one or more successive characters forming a part of text, for example characters represented by data coded in the ASCII format. Such data can be entered on the keyboard of a usual terminal.

Any textual data communication protocol, such as the T. 140 protocol, SIP message or

SIP info, can be used to transmit the textual data between the terminals and the control unit, from the moment when the protocols used by the different terminals Ti, T ₂ , T ₃ are recognized by the control unit MCU. Thus, the different users do not need to use the same textual communication protocol in the present invention.

The control unit MCU thus receives the textual data of at least one terminal, for example Ti, and then generates from these, within a processing means PROC, image data Im which are intended to be transmitted to at least one other terminal, for example T ₂ .

Thus, if Bob sends data d1 through the terminal Ti, the control unit MCU generates data image Im intended to be sent to Jen, through the terminal T ₂ , or even to Sam through the terminal T ₃ . Preferably, this image data is also sent to the terminal Ti, so that Bob can verify that his di se data have been integrated into the image data Im.

The generation of the image data Im can be performed, for example, by embedding a portion of text corresponding to the textual data di in a portion of a source image Im ₃ . This source image Im ₃ may be a simple still image, such as a completely black image, on which a portion of text corresponding to the textual data di in white characters is embedded. The source image Im ₈ may also consist of a succession of images {Im _s } i, _{..ι / k} of a video stream, received for example from a medium external to the control unit MCU and generating such video stream, like a TV program for example.

Advantageously, the source image data Im ₃ come from the users themselves. For example, Bob, Jen and / or Sam can transmit respective image data Im ₁ , Im ₂ , Im ₃ , which will be used to embed a portion of text corresponding to the text data di, d ₂ and / or d ₃ transmitted.

In a first example, the terminal T ₁ transmits textual data di, corresponding to a text entered by the user Bob, as well as image data Imi, corresponding for example to a picture of this user. Bob. The processing means PROC then uses the image data Iirii as source image data Im ₅ , in order to embed a part of the text corresponding to the textual data di input by this user Bob. It then generates image data Im corresponding to this picture of the user Bob on which appears the text he has entered. This image data is then transmitted to the user Jen, or even for example to other users like Sam, and possibly also to the user Bob as described above.

In another example, the terminal Ti transmits textual data di, corresponding to a text entered by the user Bob, as well as a video stream consisting of a series of image data {Imi} i, ..., k / corresponding for example to the video acquisition of a webcam belonging to BOB. The processing means PROC will then use the image data {Imχ} ik successively as source image data {Im _s } i, ..., k # to embed on each of these images a part of the corresponding text to the text data dl entered by the user Bob. The means PROC then generates a video stream consisting of successive image data {Im} i, ... _{/ k} corresponding to the video acquisition of the webcam of the user Bob on which the text he has displayed is displayed. grasped. This video stream is then transmitted to the user Jen, as well as to other users like Sam for example, and possibly to the user Bob, again.

In an exemplary embodiment, the text corresponding to the transmitted textual data is inlaid character by character, as the textual data arrive at the MCU control unit. This is called a "real-time" text inlay mode, as text data is entered. Such a mode of inlay offers a great interactivity between the participants.

However, it is possible to imagine another mode of textual embedding, in which the processing means PROC expects to have a complete sentence before displaying it in an image. To achieve such a keying mode "sentence by sentence", the processing means PROC may comprise a memory, of buffer type for example, for storing the received textual data until a data indicative of the end of a sentence (such as the ASCII data corresponding to the "input" key of a keyboard) is received. It is only then that the processing means PROC processes all the stored text data and inserts the entire sentence on the source image Im ₃ .

The control unit MCU can also very well simultaneously receive text data dχ, d ₂ , d ₃ respectively from the users Bob, Jen and Sam. In this case, the processing means PROC can be made to incrust simultaneously, in real time, the text parts corresponding to these different data within the same image to be broadcast to different terminals. One can also imagine, as has been described previously, that the processing means PROC stores separately the textual data coming from the users Bob, Jen and / or Sam, in order to display the corresponding texts only when an entire sentence has been received from one of them. This storage can be done within a single buffer, common to all these users, or buffers dedicated respectively to each user.

It is advantageous to display the different parts of text, corresponding to the different textual data di, d _{2 /} d ₃ received, within the same area located in the center of the source image Im _s . The texts belonging to the different users can then be differentiated by mentioning a specific datum, such as the user's name or first name, near the text entered by the user. Such an example is illustrated in Figure 3A.

In this example of FIG. 3A where three participants converse, the source image Im ₅ is a composite image consisting of three images Im ₁ , Im ₂ , Im ₃ each representing one of the participants, Bob, Jen and Sam. A central zone Z of Text is superimposed on this composite image and is used to embed the text parts corresponding to each participant. Such a presentation, in addition to being homogeneous, provides a quick overview of the conversation at a glance at this unique central area.

In order to obtain such a composite image, the control unit MCU comprises a preparation means PREP of the source image receiving image data Im _× , Im ₂ and Im ₃ of each of the terminals T ₁ , T ₂ , T ₃ . This image data can be first decoded by decoders respective DECODi, DECOD ₂ , DECOD ₃ , in order to overcome the different types of image coding used during transmission from the terminals to the MCU control unit.

These image data ImI ₁ Im ₂ and Im ₃ are then sent to a mixing means (MIX) which processes them, in order, for example, to produce a composite Im ₈ source image, presenting three images coming respectively from the three terminals Ti, T ₂ , T ₃ , for example three images of different users as shown in Figure 3A. Other effects can be envisaged, and realized by means MIX and PROC, as for example the animation on the most recently received characters for more dynamism.

It is also advantageous to display the texts entered by the users in an area corresponding to their respective image, and no longer only in a central area. Such an example of implementation is illustrated in FIG. 3B.

In the example of this FIG. 3B, each participant has his particular zone Z _x , Z ₂ or Z ₃ , in which an image or a video stream that he has transmitted from his terminal for example, as well as the characters, will be displayed. he will have seized. This type of presentation has, in addition to the advantage of homogeneity, that of differentiating, visually and immediately, which user has entered a particular text. Figure 4 will now illustrate a videoconferencing system with text communication using an MCU control unit according to a preferred embodiment of the invention.

In the videoconferencing system with text communication of this FIG. 4, the three users Bob, Jen and Sam use the respective terminals A, B, C to communicate with each other via an MCU control unit similar to that described. above.

The terminals A, B, C use the video channels 21, 31, 41 and the audio channels 22, 32, 42 to organize the videoconference, followed by established protocols. Regarding the text data, the terminal A uses the protocol T. 140, the terminal B the SIP protocol Message and the terminal C the SIP Info protocol.

With a conventional multipoint control unit, a text conversation between these different terminals would be impossible, because of the different textual communication protocols, as illustrated previously in Figure IC. But here, the textual channels 23, 33, 43 are only used in the uplink direction, ie terminals to the control unit MCU. The control unit MCU then increments, in the manner described above, the different textual data received by the textual channels in a video stream to retransmit to the terminals, in the downstream direction, by the video channels 21, 31, 41 The problem of compatibility between Textual protocols are thus solved, as is the problem of receiving a plurality of text streams from different sources, and the textual conversation can take place.

Finally, FIG. 5 illustrates the steps of a method 100 of textual data processing according to a preferred embodiment of the invention.

During a first input step 110, textual data di are entered on at least one terminal Ti, by means of a keyboard for example.

Preferably, but optionally, source image data Iirii are captured on the same terminal T _x during a second capture step 120. This data can consist of a single image, or even a video stream, and be captured. by means of a webcam for example.

The capture step 120 is indicated as following the input step 110 in FIG. 5, but these two steps can also be performed simultaneously, or in the reverse order where the image data capturing step precedes the step of entering textual data.

The entered text data di, and possibly the captured image data Im _x , are then transmitted by the terminal T _x and received by the control unit MCU, during a reception step 130. A source image preparation step 140 follows, in which the image data Im _x is processed, formatted to a specific format, or combined with other image data received from other terminals to form an image. composite source image. This step is performed within the PREP preparation means of the MCU control unit. We then obtain a source image Im ₅ , or even a source image stream {Im _s } i _k , composed of a succession of source images.

During a keying step 150, the textual data di are then embedded in the source image Im ₅ or the stream {Im _s } _{X /} ..., _k , prepared previously, in one of the presentation modes ci. before, for example. An image Im, or the corresponding image stream (Im) _xk, is then obtained.

Once these text data are embedded in a source image or a source image stream, the image Im or the image stream (Im) _1k is broadcast to the participants' terminals during a broadcast step 160 , if necessary by being previously encoded by a coding means COD adapted to these terminals.

Of course, the invention is not limited to the embodiments described above and shown, from which we can provide other modes and other embodiments, without departing from the scope of the invention .

Claims

claims

1. A method for processing textual data, in a telecommunication context between at least a first terminal (Ti) and a second terminal (T ₂ ), characterized in that it comprises, after reception (130) at a device of processing (MCU) of text data (di) of the first terminal (T _x ), generating (150) image data (Im) integrating said received text data (di), for transmission (160) of said image data (Im) at least at the second terminal (T ₂ ).

2. Method according to claim 1, characterized in that said processing device (MCU) embeds at least a portion of a text corresponding to said textual data (di) in at least one source image (Im " _s s;

3. Method according to claim 2, characterized in that said processing device (MCU) furthermore receives textual data (d ₂ ) from the second terminal (T ₂ ) and embeds at least part of a text corresponding to said textual data. (d ₂ ) received from the second terminal (T ₂ ) in said source image (Im ₈ ).

4. Method according to one of claims 2 or 3, characterized in that at least a portion of the source image (Im ₃ ) is communicated from the first terminal (T _x ) to the processing device (MCU).

5. Method according to claim 4, characterized in that the source image (Im ₅ ) is a composite image of which at least a part is communicated from the second terminal (T ₂ ) to the processing device (MCU).

6. Method according to one of claims 2 to 5, characterized in that the incrustation of the textual data (di, d ₂ ) is performed in a display area (Z) defined in said source image (Im ₃ ) .

The method according to claim 6, wherein the source image (Im ₅ ) comprises at least a first display area (Zi) in which at least a portion of a first image (Imi) communicated from the first image is displayed. terminal (T ₁ ) to the processing device (MCU), as well as a second display area (Z ₂ ) in which at least a portion of a second, communicated image (Im ₂ ) of the second terminal (T ₂ ) to the processing device (MCU), characterized in that said processing device (MCU) embeds at least a part of a text corresponding to said textual data (di) coming from the first terminal (Ti) in the first zone of displaying (Z ₁ ) and at least a part of a text corresponding to said textual data (d ₂ ) coming from the second terminal (T ₂ ) in the second display area (Z ₂ ).

8. Apparatus for processing textual data (MCU), in a telecommunication context between at least a first terminal (T ₁ ) and a second terminal (T ₂ ), characterized in that it comprises a processing means (PROC) for , sure receiving text data (di) from a first terminal (T _x ), generating image data (Im) integrating said received text data (d _x ), for transmission of said image data at least to a second terminal (T ₂ ).

9. Apparatus for processing textual data (MCU) according to the preceding claim, characterized in that said processing means (PROC) is able to embed at least a portion of a text corresponding to said textual data (d _x ) in at least a source image (Im ₅ ) for generating said image data (Im).

10. Apparatus for processing textual data (MCU) according to the preceding claim, characterized in that said processing means (PROC) is further able to embed at least a portion of a text corresponding to textual data (d ₂ ) received from the second terminal (T ₂ ) in said source image (Im _s ) to generate said image data (Im).

11. Apparatus for processing textual data (MCU) according to one of claims 9 or 10, characterized in that it comprises a preprocessing means (PREP) for generating said source image (Im ₅ ) from data of image (Im _x ) received from the first terminal (T _x ).

12. Textual data processing device (MCU) according to the preceding claim, characterized in that the preprocessing means (PREP) comprises a mixing means (MIX) for generating said source image (Im ₅ ) under the shape of a composite image of which at least a first part is generated as a function of image data (Imi) received from the first terminal (Ti) and at least a second part is generated as a function of image data (Im ₂ ) received from the second terminal (T ₂ ).

13. Video-text conversation system comprising a textual data processing device (MCU) according to one of claims 8 to 10, connected to at least two terminals (Ti, T ₂ ) able to send text data (di, d ₂ ) to said processing device (MCU).

14. Video-text conversation system comprising a textual data processing device (MCU) according to one of claims 11 to 12, connected to at least two terminals (Ti, T ₂ ) able to send textual data.

(di, d ₂ ) and image data (Im ₁ , Im ₂ ) to said processing device (MCU).

15. Computer program for implementing the method according to one of claims 1 to 7, downloadable via a telecommunications network and / or stored in a memory of a processing device and / or stored on a memory medium for to cooperate with a treatment device.