Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L12/00—Data switching networks
  • H04L12/02—Details
  • H04L12/16—Arrangements for providing special services to substations
  • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
  • H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
  • H04L12/1827—Network arrangements for conference optimisation or adaptation
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F15/00—Digital computers in general; Data processing equipment in general
  • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
  • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
  • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
  • H04L51/10—Multimedia information
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/14—Systems for two-way working
  • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/14—Systems for two-way working
  • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
  • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/14—Systems for two-way working
  • H04N7/15—Conference systems
  • H04N7/152—Multipoint control units therefor

Definitions

• the invention relates to the field of textual data processing, in particular in the context of videoconferencing between a plurality of users.
• Conversational videophone services have recently undergone a strong development. Such services consist of the joint use of video, audio and text means to organize a conference between a plurality of participants.
• chat feature is required to exchange messages as textual data.
• a chat feature is required to exchange messages as textual data.
• a point-to-point context between two participants, there are methods of exchanging texts, regardless of the exchange of video, with for example a text input made on the client side and exchanged by entire sentence.
• FIG. IA An example of such a point-to-point system is shown in FIG. IA.
• the terminals A and B exchange video data by a first exchange channel 1, audio data by a second exchange channel 2 and text data by a third exchange channel 3.
• the transfer of Text data is governed by a text communication protocol, such as the T. 140, SIP Message or SIP Info protocols.
• a text communication protocol such as the T. 140, SIP Message or SIP Info protocols.
• the terminal A uses a channel 4 for exchanging text data managed by a T.140 type protocol, while the terminal B uses a channel 5 d exchange of text data managed by a SIP Message type protocol, as an example.
• the terminal B can not receive the textual data provided by the channel 4, and conversely the terminal A can not receive the data provided by the channel 5.
• This problem is particularly acute in the context of multipoint videoconferencing systems, where a central control unit will manage videoconferencing between a plurality of participants, typically more than three.
• the terminal A uses a channel 6 for exchanging text data managed by a T.140 protocol. It receives textual data from a terminal B according to a textual data exchange channel 7 managed by the same protocol T.140, as well as textual data from a terminal C according to a textual data exchange channel 8 managed. by the SIP protocol Message. In such a case, the terminal A can communicate verbatim with the terminal B, but is unable to communicate verbatim with the C terminal.
• a solution to this text conversation problem, during a videoconference between several participants, is of course to require that each participant use the same textual communication protocol, as is the case for the terminals A and B on the figure IC.
• this constraint is cumbersome to implement, or even simply unfeasible, when the participants' terminals already have their own textual communication protocol and can not change it.
• participants' terminals do not know how to receive textual data from multiple text sources, even if they use the same protocol.
• most terminals do not support the multi-point text dialogue function.
• One of the aims of the invention is to overcome disadvantages of the state of the art cited above.
• a textual data processing method in telecommunication context between at least a first terminal and a second terminal, having, after receiving from a textual data processing device of the first terminal, the generation of data. image integrating the textual data received, for transmission of these image data at least to the second terminal.
• the present invention improves the situation, making it possible for multiple text conversations, homogeneously and dynamically, with any terminal supporting at least the sending of textual data.
• the second terminal does not need to use the same textual communication protocol as the first terminal to receive the text data thereof.
• the second terminal can now receive multiple text streams from different sources and transferred using the same protocol.
• the processing device embeds at least a portion of a text corresponding to said text data in at least one source image.
• the text data of the first terminal will thus be readily available for the second terminal, simply by viewing the image data received from the processing device.
• the processing device also receives text data from the second terminal and embeds at least part of a text corresponding to said textual data received from the second terminal in said source image.
• At least part of the source image is communicated from the first terminal to the processing device.
• Information of a textual nature from the first terminal will thus be supplemented by information of a visual nature.
• the source image is a composite image of which at least part is communicated from the second terminal to the processing device. Textual information from the terminals will thus be supplemented by visual information from them.
• the overlay of the text data is performed in a display area defined in said source image.
• the source image comprises at least a first display area in which at least a portion of a first image communicated from the first terminal to the processing device is displayed, as well as a second display area. wherein at least a portion of a second communicated image of the second terminal is displayed to the processing device.
• a processing device embeds at least part of a text corresponding to said text data from the first terminal in the first display area and at least a portion of a text corresponding to said text data from the second terminal in the second area. display.
• the present invention also proposes a device for processing textual data, in the context of telecommunication between at least a first terminal and a second terminal, comprising processing means adapted to implement the method as described above.
• the processing device comprises pretreatment means for generating the source image according to the method described above.
• the pretreatment means comprises mixing means for generating said source image in the form of a composite image according to the method described above.
• the present invention also provides a video-text conversation system comprising a textual data processing device as described above, connected to at least two terminals able to send textual and / or image data to the processing device.
• the present invention proposes, finally, a computer program for the implementation of the method as described above.
• a program may be downloadable via a telecommunication network and / or stored in a memory of a processing device and / or stored on a storage medium intended to cooperate with a processing device.
• FIGS. 1A, 1B, 1C illustrate various conventional videoconferencing systems with textual communication
• FIG. 2 diagrammatically represents a textual data processing device according to a preferred embodiment of the invention
• Figures 3A, 3B illustrate different modes of presentation of textual data and images according to the present invention
• FIG. 4 illustrates a videoconferencing system with textual communication according to a preferred embodiment of the invention
• Figure 5 illustrates the steps of a textual data processing method according to a preferred embodiment of the invention.
• FIG. 2 shows schematically a conversation system comprising a textual data processing device MCU according to a preferred embodiment of the invention.
• text data is understood to mean one or more data corresponding to one or more successive characters forming a part of text, for example characters represented by data coded in the ASCII format. Such data can be entered on the keyboard of a usual terminal.
• Any textual data communication protocol such as the T. 140 protocol, SIP message or
• SIP info can be used to transmit the textual data between the terminals and the control unit, from the moment when the protocols used by the different terminals Ti, T 2 , T 3 are recognized by the control unit MCU.
• the different users do not need to use the same textual communication protocol in the present invention.
• the control unit MCU thus receives the textual data of at least one terminal, for example Ti, and then generates from these, within a processing means PROC, image data Im which are intended to be transmitted to at least one other terminal, for example T 2 .
• the control unit MCU generates data image Im intended to be sent to Jen, through the terminal T 2 , or even to Sam through the terminal T 3 .
• this image data is also sent to the terminal Ti, so that Bob can verify that his di se data have been integrated into the image data Im.
• the generation of the image data Im can be performed, for example, by embedding a portion of text corresponding to the textual data di in a portion of a source image Im 3 .
• This source image Im 3 may be a simple still image, such as a completely black image, on which a portion of text corresponding to the textual data di in white characters is embedded.
• the source image Im 8 may also consist of a succession of images ⁇ Im s ⁇ i, .. ⁇ / k of a video stream, received for example from a medium external to the control unit MCU and generating such video stream, like a TV program for example.
• the source image data Im 3 come from the users themselves.
• Bob, Jen and / or Sam can transmit respective image data Im 1 , Im 2 , Im 3 , which will be used to embed a portion of text corresponding to the text data di, d 2 and / or d 3 transmitted.
• the terminal T 1 transmits textual data di, corresponding to a text entered by the user Bob, as well as image data Imi, corresponding for example to a picture of this user.
• the processing means PROC uses the image data Iudi as source image data Im 5 , in order to embed a part of the text corresponding to the textual data di input by this user Bob. It then generates image data Im corresponding to this picture of the user Bob on which appears the text he has entered. This image data is then transmitted to the user Jen, or even for example to other users like Sam, and possibly also to the user Bob as described above.
• the terminal Ti transmits textual data di, corresponding to a text entered by the user Bob, as well as a video stream consisting of a series of image data ⁇ Imi ⁇ i, ..., k / corresponding for example to the video acquisition of a webcam belonging to BOB.
• the processing means PROC will then use the image data ⁇ Im ⁇ ik successively as source image data ⁇ Im s ⁇ i, ..., k # to embed on each of these images a part of the corresponding text to the text data dl entered by the user Bob.
• the means PROC then generates a video stream consisting of successive image data ⁇ Im ⁇ i, ...
• the text corresponding to the transmitted textual data is inlaid character by character, as the textual data arrive at the MCU control unit. This is called a "real-time" text inlay mode, as text data is entered. Such a mode of inlay offers a great interactivity between the participants.
• the processing means PROC may comprise a memory, of buffer type for example, for storing the received textual data until a data indicative of the end of a sentence (such as the ASCII data corresponding to the "input" key of a keyboard) is received. It is only then that the processing means PROC processes all the stored text data and inserts the entire sentence on the source image Im 3 .
• the control unit MCU can also very well simultaneously receive text data d ⁇ , d 2 , d 3 respectively from the users Bob, Jen and Sam.
• the processing means PROC can be made to incrust simultaneously, in real time, the text parts corresponding to these different data within the same image to be broadcast to different terminals.
• the processing means PROC stores separately the textual data coming from the users Bob, Jen and / or Sam, in order to display the corresponding texts only when an entire sentence has been received from one of them. This storage can be done within a single buffer, common to all these users, or buffers dedicated respectively to each user.
• the source image Im 5 is a composite image consisting of three images Im 1 , Im 2 , Im 3 each representing one of the participants, Bob, Jen and Sam.
• a central zone Z of Text is superimposed on this composite image and is used to embed the text parts corresponding to each participant.
• the control unit MCU comprises a preparation means PREP of the source image receiving image data Im ⁇ , Im 2 and Im 3 of each of the terminals T 1 , T 2 , T 3 .
• This image data can be first decoded by decoders respective DECODi, DECOD 2 , DECOD 3 , in order to overcome the different types of image coding used during transmission from the terminals to the MCU control unit.
• each participant has his particular zone Z x , Z 2 or Z 3 , in which an image or a video stream that he has transmitted from his terminal for example, as well as the characters, will be displayed. he will have seized.
• This type of presentation has, in addition to the advantage of homogeneity, that of differentiating, visually and immediately, which user has entered a particular text.
• Figure 4 will now illustrate a videoconferencing system with text communication using an MCU control unit according to a preferred embodiment of the invention.
• the three users Bob, Jen and Sam use the respective terminals A, B, C to communicate with each other via an MCU control unit similar to that described. above.
• the terminals A, B, C use the video channels 21, 31, 41 and the audio channels 22, 32, 42 to organize the videoconference, followed by established protocols.
• the terminal A uses the protocol T. 140, the terminal B the SIP protocol Message and the terminal C the SIP Info protocol.
• FIG. 5 illustrates the steps of a method 100 of textual data processing according to a preferred embodiment of the invention.
• a first input step 110 textual data di are entered on at least one terminal Ti, by means of a keyboard for example.
• source image data I sculpture are captured on the same terminal T x during a second capture step 120.
• This data can consist of a single image, or even a video stream, and be captured. by means of a webcam for example.
• the capture step 120 is indicated as following the input step 110 in FIG. 5, but these two steps can also be performed simultaneously, or in the reverse order where the image data capturing step precedes the step of entering textual data.
• a source image preparation step 140 follows, in which the image data Im x is processed, formatted to a specific format, or combined with other image data received from other terminals to form an image. composite source image. This step is performed within the PREP preparation means of the MCU control unit. We then obtain a source image Im 5 , or even a source image stream ⁇ Im s ⁇ i k , composed of a succession of source images.
• the textual data di are then embedded in the source image Im 5 or the stream ⁇ Im s ⁇ X / ..., k , prepared previously, in one of the presentation modes ci. before, for example.
• An image Im, or the corresponding image stream (Im) xk, is then obtained.
• the image Im or the image stream (Im) 1k is broadcast to the participants' terminals during a broadcast step 160 , if necessary by being previously encoded by a coding means COD adapted to these terminals.

Landscapes

• Engineering & Computer Science (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Computer Networks & Wireless Communication (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• Human Computer Interaction (AREA)
• Software Systems (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Telephonic Communication Services (AREA)
• Data Exchanges In Wide-Area Networks (AREA)
• Information Transfer Between Computers (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=40897699

Family Applications (1)

Country Status (4)

Families Citing this family (8)

Citations (3)

Family Cites Families (15)

• 2009
  • 2009-12-16 US US13/139,417 patent/US8848015B2/en not_active Expired - Fee Related
  • 2009-12-16 EP EP09802187A patent/EP2368167A1/de not_active Withdrawn
  • 2009-12-16 JP JP2011541556A patent/JP2012513693A/ja active Pending
  • 2009-12-16 WO PCT/FR2009/052559 patent/WO2010072945A1/fr active Application Filing

Patent Citations (3)

Non-Patent Citations (2)

Also Published As

Similar Documents

Legal Events