JP2002537734A - Apparatus, system and method for video communication - Google Patents

Abstract

  (57) [Summary] The present invention relates to a user image data input device for inputting real-time user image data, an image data editing device for generating user image data edited from the user real-time image data, and at least one additional user And a video communication device provided with an image data output device that outputs the image data to a video communication device. An identification device for identifying at least one communication user and an edit selection control connected to the identification device are provided. The edit selection controller outputs unedited real-time or edited user image data based on the identification result of the identification device by an image data output device or by additionally connecting an image data editing device.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD OF THE INVENTION

The present invention relates to a video communication device according to the preamble of claim 1, and more particularly to a video communication system including such a video communication device and a video communication method using such a video device.

[0002]

[Prior art]

Video communication devices, video communication systems and methods for providing channels for the transmission of sound and images in each of the visual media as well as the auditory domain are known, but still large to a wide audience. No spread has been found.
It is clear that an inherent disadvantage of the prior art is that the transmission of image information to at least one further communicating user often causes them to combine to create an unwanted intrusion into the privacy of the user. Depending on who wishes to initiate a communication contact, the user and / or his communication partner may or may not wish to transmit certain visual information. Most preferably, the communication user wishes to transmit the optimal “desired appearance image” to be adopted by the opposite communication partner. This image not only includes a suitable background, but also includes suitable clothing and additional advantageous appearance.

So far, the image editing algorithms used in video conferencing systems, for example as disclosed in WO 96/09722, have been used. DE-4102895 C1 discloses a method and a device for correcting gaze angles together with a workplace video system. Here, the user's visual area is edited to give the impression that a person looks directly at the camera rather than on the screen. This editing function works without notification by the sender and recipient on the transmission.

Furthermore, it is known in the TV field that there is a way to change this information in real time or almost in real time before it is transmitted to the sender unit. this is,
It has the advantage that the information to be edited corresponds or approximates the desired appearance of the author. These methods include, for example, "blue box", "masking", and "automatic masking".

As is well known, the aforementioned audiovisual communication services and systems transmit more than telephone calls. Among other things, the appearance of the sending participant, his body language,
The surroundings captured by the video camera as well as facial expressions and actions belong to this information. However, there arises a problem that the transmission of the visual information results in a psychological suppression threshold when the aforementioned audiovisual communication service and system are used. These psychological suppression thresholds may be evident, for example, due largely to the fact that video telephony is not yet on the market.

[0006]

[Object of the invention]

Accordingly, it is an object of the present invention to provide a video communication apparatus, a video communication system and a video communication method that can be used without problems on both personal and business sides without undesirably affecting a communication partner being transmitted. It is to be.

[0007]

Summary of the Invention

According to the invention, this object is achieved by a video communication device according to claim 1, a video communication system having such a video communication device according to claim U, as well as such a video communication device according to claim X This is achieved by a video communication method using a device. By means of the present invention, psychological suppression thresholds when using video communication devices and services are reduced or avoided, and the corresponding video communication technology can advantageously bring widespread use.

According to the present invention, therefore, at least user image data input means for inputting current user image data, and image data editing means for generating user image data edited from the current user image data, An image data output means for outputting user image data to one further communication participant is provided. According to the present invention, there is further provided identification means for identifying at least one participant, and an edit selection controller connected to the identification means. The edit selection controller outputs the output of the unedited current or edited user image data by the image data output means based on the identification result of the identification means. Start by connecting to the data editing means in advance.

[0009] If the video communication device is acceptable for only one person as a user, the identity of the caller is sufficient. On the other hand, if the same edited user image data has been assigned to each of several users of the video communication device, the identity of the corresponding user is sufficient. By means of the present invention, the transmission of unedited image data or image data specifically edited by the user in a pre-settable manner can mechanically create the intended visual impression for the communication partner. Guaranteed. This allows the video communication device to be used without any practical disadvantages, and in particular, to use the current information, such as the current user's appearance and the user's atmosphere, without transmitting the current surrounding information. And does not send it to the communication partner if it is not desired. Thus, the user need not be afraid that the communication partner will receive any information, such as, for example, his flat part, his physical appearance, or his communication clothing. The video communication device according to the invention ensures that: That is, if required, the corresponding edited or unedited image data is automatically transmitted and time-intensive, depending on who the particular communication partner is, for example, a boss, friend or relative. There is no need to make any manual settings or choices.

[0010] Thus, the video communication device allows for control of the exchange of self-referencing information in a simple and reliable manner for the user of the corresponding audiovisual communication service and system. According to the present invention, a user as a participant in transmitting or receiving an audiovisual communication signal has the opportunity to influence the content in a way that the transmitted content approaches or matches the idea that the user wants to publish. Is given.
This overcomes the disadvantages of current audiovisual communications. Users of the audiovisual message can communicate independently and are not disturbed. For example, it is possible to communicate irrespective of his appearance after getting up in the morning, illness, regardless of his facial flaws, or any other appearance that is contrary to his preference.

For example, using the present invention in conjunction with video telephony, video conferencing, workplace conferencing, internet conferencing, etc., each participant in audiovisual communication will see each participant's appearance and surroundings recorded by a camera That at the receiving participant's location correspond to his understanding of his inner self-dignity. Thereby, use of the present invention protects personal sphere and privacy.

Preferably, in the video communication device according to the invention, identification means are arranged to identify the user and at least one further communicating or already communicated communication participant. In addition, such a video communication device may be used individually by several users for communication with opposing partners, each user appearing in each of his communication partners in a separate desired presentation. .

Furthermore, within the scope of the present invention, participant selection data storage means for storing participant selection data, and communication participants respectively identifying the user and / or at least one further communicating or contacted participant. Preferably, the participant identification input means for inputting the participant identification is assigned to the identification means, and the identification means compares the stored participant selection data with the current communication participant identification to provide the user with the information. And / or is preferably configured to achieve an identification result for at least one further communicating or contacted participant.

[0014] The above embodiments are characterized in that the participant selection data storage means stores user selection data of at least one possible user; and / or
Participant selection data storage means for storing communication participant selection data of at least one possible communication participant. As a variant, ie an addition to the embodiment, in particular, the participant identification input means for inputting the current communication participant identification of the user selection data and / or the communication partner selection data comprises manual selection means, electrical signal input means, , An optical signal input means and / or an acoustic signal input means in a given case are preferably included.

The manual selection means includes a keyboard, a menu control key, a menu control lever or menu control pointing, and / or a touch-sensitive input means for inputting a communication participant identification by the user; and / or -Electrical signal input means for receiving an electrical signal for inputting a communication participant identification by said user or communication participant; and / or-a communication participant identification by said user or communication participant. Optical signal input means for receiving an optical signal for input and / or sound for receiving an audio signal for inputting a communication participant identification by the user or the communication participant; Signal input means is configured.

In another preferred enhancement of the invention, a pre-given or pre-set mode or one of a plurality of pre-given or pre-set modes.
According to another aspect, it is provided that the edit selection controller is configured to stop or cause the editing of the current user image data by the image data editing means based on the identification result of the identification means.

Furthermore, in the video communication apparatus according to the present invention, a given image data storage means for storing given image data is provided, and by means of given image data.
Alternatively, it is provided with an advantage that image data editing means for editing the current user image data based on the image data and creating the edited user image data is configured.

In this embodiment, in such a video communication device, the given image data storage means includes:
Including the given background image data storage means and / or the given human image data storage means, the image data editing means separates the current user image data into at least background image data and human image data, and outputs the background image data and / or the human image data. Being configured to replace the human image data in whole or in part with the corresponding given background image data or the given human image data, or to correspond to the edited background image data and / or human image data. A further development can be made in that it is provided to be configured to create from a corresponding storage means on the basis of given background image data or given human image data. Accordingly, the given image data storage means or the given human image data storage means can further include a torso image data storage means and a head image data storage means, and the image data editing means stores the human image data. It is configured to separate the torso image data and the head image data, and to replace all or part of the torso image data and / or the head image data with the corresponding given torso image data or given head image data. Or may be configured to create edited torso image data and / or head image data from corresponding storage means based on corresponding given torso image data or given head image data. .

Preferably, in the above embodiment, a given image data storage means, a given background image data storage means and / or a given human image data storage means and, in a given case, torso image data storage Means and / or head image data storage means with a plurality of given background image data and / or given human image data, or in given cases given body image data and / or Or, given head image data, or a plurality of corresponding sets or subsets or elements consisting thereof, may or may be stored. These can be assigned to different editing modes of the image data editing means.

According to another preferred further development of the invention, the image data editing means separates and edits the current image data separately from each other and at least essentially simultaneously, for generating edited user image data. It is configured to bring these together again later. Another preferred further development of the invention is that, in the image data editing means, the cosmetic and / or technical optimization of the user image data is dependent on and / or independent of the identification result. The replacement of background image data and / or human image data in a given case, and before and / or after replacement of torso image data and / or head image data in a given case. The given image data can be completely or partially executed on the basis of an editing algorithm from each given image data storage means.

Further, in the video communication device according to the present invention, the user image data input means includes:
It is advantageous if a plurality of or current user images, each individually edited by the image data editing means and / or based on preset rules, are generated in chronological order in succession. Preferably, the image data editing means in the video communication apparatus according to the present invention is arranged to separate not only background image data and / or human image data but also, in a given case, torso image data and head image data. In the case of giving, the replacement of each given image data storage means by means of the corresponding given image data means is successively and dynamically performed for a single user image. .

Further, it is preferable that the user image data input means includes at least one camera, and the image data output means includes at least one interface with a telephone network. In a video communication device as provided by the present invention, a user voice input means for inputting current user sound data, a sound data editing means for creating edited user sound data from the current user sound data, Sound data output means for outputting data to at least one further communication partner.

In this embodiment, the edit selection controller is configured to generate the output of the unedited current or edited user sound data by the sound data output means based on the identification result by the identification means. It can be further developed. As a variant, or additional example thereto, a given sound data storage means for storing given sound data may be provided, and
Sound data editing means may be configured to edit the current user sound data by and / or on the basis of the given sound data to create edited user sound data. As an additional or alternative enhancement of the variants of the embodiment of the invention described here, the aesthetic and / or technical audio optimization of the user audio data by the audio data editing means depends on the identification result. And / or independently of the identification result, in a given case before and / or after the editing of the current user sound data by the given sound data means from the given sound data storage means, based on the editing algorithm Can be performed.

In the field of sound data, it may also be provided in a preferred manner that the editing mode of the editing means of a given sound data is assigned individually or in groups by the user to the identification result of the identification means. Further, the user sound data input means includes at least one microphone;
The audio data output means has at least one interface with a telecommunications network.
Preferably, and / or the identification means comprises at least one interface with a telecommunications network.

Preferably, in the video communication device according to the present invention, representationally optimized transmission of video and / or audio data is possible, which is preferable for the performance of the video communication method described later. Therefore, corresponding video communication devices include: -Video input and output means-audio input and output means-transmission and reception means-interface to at least one transmission channel-input devices for input of control and command signals-given image data and given sound data As well as storage means for storage of user and system programs, wherein the means, equipment and components described above are configured to interact with the described means and components to perform such method steps Functionally connected to

A further development of the above-described embodiment of the video communication device according to the invention is that it comprises a higher management unit and / or a higher memory medium, for example a “personal computer”
And an interface connected to the processor unit for connecting to the processor. By means of the present invention, there is further provided a video communication system which also achieves the above objects. Such a video communication system comprises at least two video communication devices according to the invention and according to claims 1 to 22, which devices are or can be connected via a telephone network.

The object of the present invention is also achieved by a video communication method. Here, the communication participant is identified by the identification means, the current user image data is input to the user image data input means, and the edit selection control sends the current user image data to the image data editing means based on the identification result of the identification means. If the image data editing means generates from or becomes these edited image data based on the reception of the current user image data, and finally unedited current or existing Is output by the image data output means.

For a discussion of achieving the objects and advantages, reference will be made, in all instances, to the expression in the context of a video communication device according to the present invention, in order to avoid repetition of achieving such objects and advantages. Preferred further developments of the video communication method according to the invention result from a similar and suitable implementation of the above-described aspects of the video communication device according to the invention and combinations of these aspects.

Furthermore, the video communication method according to the invention can be further developed in that the image data, or in particular the image and sound data in the case of a visual telephone, are transmitted in a commendation-optimized manner. Here, each of the image data derived from the video source, the sound data derived in a given case from the acoustic source, is transmitted to a given image data or a given image data before transmission to its communication partner. In some cases, on the basis of the given sound data, it is changed by the following steps, corresponding to at least one predetermined or predeterminable criterion.

Before commencing communication: a) Given image data is created and stored. b) Parameters referring to the image data are defined and stored and assigned to the given image data stored in step a). And during the communication c) the user image data derived from the user image data input means, in particular the video source and relating to one or several selected or selectable image data parameters are defined in step b) And extracted by means of the stored parameters (plural).

D) The user image data of step c) based on the selected image data parameters is edited based on the assigned given image data. e) The user image data edited in step d) is transmitted to one or several communication partners. A further development variant of the method consists in that steps d) and e) are performed at a central location remote from the user, wherein the user image data, the assigned given image data and the image data The parameter (s) are transmitted from the user's location to the central location. Alternatively or additionally, steps a) to e) are performed at the location of the user.

Further, variations on the embodiments described herein can be further developed. That is, an additional step f) is provided in which the pre-stored authorized user's speech sample is compared with the current user's spoken code phrase, and in the positive result of the comparison, Release of the edited communication to is performed. This ensures that only authorized users can perform user-specific optimizations and can start transmissions with edited images and / or modified degrees, preferably in a simple manner Is done. At that point, in step f), the stored audio samples are additionally assigned to the given image data belonging to the user or selected as belonging to him, and the user saves the stored audio samples and It is further provided that the identification is based on associated given image data. Alternatively or additionally, an analysis of the uttered code phrases and speech and an image analysis of the user image data input means, in particular of the user image data derived from the video source, can be performed in step f). In the last-mentioned embodiment, the facial morphology on the Yugo's image analysis features is compared with relevant or given image data.

Another further development of the basic variant of the invention of the video communication method just described is that, prior to the execution of step c), the user is provided with an audiovisual view of the given stored image data. Identified as authorized to use for communication. Further, in the video communication method according to the present invention, the user image data to be processed or edited and analyzed, and the edited user image data as well as the given image data are used as motion image, two-dimensional and three-dimensional image information. It is preferable to include

Another preferred embodiment of the video communication according to the invention comprises that the transmitted user image data is shown to the user before the transmission. Preferably, this means that the display displays not only the selectable and / or selected given image data, but also the selectable or selected image data parameters.
surface) can be further developed.

The video communication device, the video communication system and the video communication method according to the invention are preferably used for optimized transmission of video and / or audio data in the case of video telephony, video conferencing or computer networks. Can be adapted. Further preferred and advantageous embodiments of the invention are obtained not only from the dependent claims and from their combinations, but also from a similar and compatible transformation of each form with the combination of the apparatus, system and method claims. can get.

The invention will now be described in more detail by way of example on the basis of an embodiment shown in the drawings. The same reference numbers in individual figures and examples in the drawings refer to elements having the same or similar or equal or similar effect. On the basis of the illustrations in the drawings, even without the reference signs, such forms will become apparent irrespective of the fact that they are subsequently described or not. On the other hand, embodiments of the present description will be apparent to those skilled in the art even if not visible in the drawings, ie, not shown.

【Example】

The present invention is based on the existence of an audiovisual communication medium. Common forms of audiovisual communication media are microphones and loudspeakers, video cameras and monitors,
A control unit, a transmission processing unit for processing audio and video signals, a reception processing unit for processing audio and video signals, and a given line bandwidth, e.g. analog or digital telephone network, communication for package control via the Internet, A compression unit for internal computer networks and other optimal uses.

The present invention extends, among other things, an audiovisual communication medium with a function called “optimized image processing (OIP)” in the description that follows. The OIP function according to the present invention can be used, for example, in video image telephony, video conferencing systems or systems based on Internet protocols. For the sake of simplicity, this description will not primarily describe speech optimization in more detail with reference to user controlled OIPs.

The OIP according to the invention saves a participant from one to n optimized images of his desired appearance as image information in one or several memory media, ie given image data. Give the opportunity to. Here, storage media of different physical types can also be used.

Referring now to FIG. 1, FIG. 1 shows a block diagram of an apparatus adapted to carry out the method according to the invention, ie to transmit / receive audiovisual information with optimized user control. I have. According to FIG. 1, a central processor unit 10 has image data input means in the form of an image input unit 11, for example a video camera, a display device 12, for example a PC monitor or a liquid crystal display, and image and sound data output. Sound output / input means 13 including means, transmitting unit 14, receiving unit 15 and telephone network, wireless network, mobile network or data network 16,
An audiovisual communication unit, generally including an interface with a telecommunications network, an interface 17 with a host storage medium or computer such as a personal computer, and identification of a participant such as a telephone keyboard or a separate keyboard. The input device 18 as a means and at least the user's own program 21 and the reference image or given image data 22, in which case the acoustic reference data or given sound data are stored and the given image The data and a memory 20 represented as storage means for given sound data are operatively connected.

FIG. 2 illustrates that the memory 20 can also include several physically different memory media. The optimized or edited reference information, i.e., the reference image information or edited user image data and the reference sound information or edited sound data is used for the image input unit 11 and the audio input unit 13 which can be a video camera, a recorder, and the like. Via the interface 17, that is, from the upper unit to the memory 20 in one direction. This makes it irrelevant whether the application and the image material are provided, for example, in a ROM memory, a RAM memory or, for example, a hard disk, a flash card or similar media (FIG. 2). As mentioned,
The memory 20 also contains reference sound information or given sound data that can be used for the user-controlled optimization of his sound. The user controls the optimized image processing or image data editing, for example by means of the input device 18, and optimizes the images and / or audio to be sent by him to the communication partner according to his choice. Input device 18
Can be, for example, a telephone keyboard, a separately connected keyboard, a computer mouse, a light pen, a graphic tray, and the like.

FIG. 2 shows the details of the memory 20 as well as the user-specific information content 21 and the reference image or given image data 22 stored therein.
As shown, the memory 20 that can be used in the present invention can include or include ROM memory, RAM memory, hard disk, removable disk, floppy disk, flash card, and other suitable memory media. You. Memory 20 may also include a combination of such storage media. In the content block 21, a user-specific program and information or data are stored here, and a block 210 for user recognition or identification and a different algorithm 1, 2,. . . N, a block 211 for technical image optimization or editing by means of N. . . A block 212 for aesthetic appearance optimization or image optimization by means of N, a block 213 for background processing, a block 214 for head processing, and a block 215 for torso processing. Be placed. Here, the user specific block 21 and the individual blocks 211 to 215 included above are not limited to the given enumeration, and the memory content for speech recognition and the additional content are described in order to avoid repetition. It must be mentioned that, although not, it may exist in similar and similar situations between image and audio optimization.

As shown in FIG. 2, the block 22 for referring to the image material of the given image data includes the given background image data or the reference background image data 1,. . . N blocks 221 and reference images 1, 2,... Of the user's head (given head image data). . . N blocks 222 and reference images 1, 2,... Of the user's torso (given torso image data). . . N blocks 223. This terminology is based on the fact that the term "torso" includes body parts excluding the head.

According to the present invention, in the case of a video communication device in the form of the audiovisual communication device shown in the figure, this is approved for a large number of participants, and blocks 221 to 223 correspond. There are several times more, which are realized in individual physical memory devices, possibly according to software, i.e. by means of their suitable division, possible in the form of separate storage means for each user. obtain.

FIG. 3 shows, in the form of a functional block diagram, a method of a function without image editing optimization on the sender side, that is, a function without OIP according to the present invention. Function block 4
The above-mentioned OIP shown at 0 is deactivated and the video signal of the video signal source goes directly to the coding block 41. The method of this function is automatically selected by the video communication device by means of the identification means on the basis of the identification result, for example the identification of the user and the communication partner. This will be referred to later, but if the user previously determines that it is to be transmitted to a specific communication partner, the communication partner can view the current user image data.

FIG. 4 shows, in the form of a functional block diagram, that the optimized image processing or editing of the current user image data is performed before the user image data is output to the communication partner via the telecommunications network. Is shown. The method of this function is automatically selected by the video communication device by means of the identification means on the basis of the identification result, for example the identification of the user and the communication partner. If the user first determines that it will not be transmitted to the specific communication partner, the communication partner will not be able to see the current user image data, but the user will be wearing clothing and clothing in front of the special background. And / or wants to be seen by this particular communication partner with the rest of the appearance properly prepared, such as hairstyle, beard, complexion and sophisticated face. For example, if the specific communication partner is, for example, a business partner, boss, subordinate, friend of sports or leisure or an unknown person, the latter approach would be desirable in each of the appropriate approaches.

Before the start of the telecommunication, for example before transmission, the current user image data, for example in the form of a video signal, obtained by the image input unit 11, for example a video signal source, can be edited or optimized according to the invention. For the purpose of segmentation, the content is separated and decoded by the content recognition block 30 in individual regions, that is, layers 31 to 33 (English layer). For better understanding only, layers 31-33 are here named Layer 1 (background), Layer 2 (body) and Layer 3 (head). These layers are the layers "background" stored in the memory area 22.
That is, a given background image 221, a “head” or given head image 222, and a “body”
That is, it corresponds to the given torso image 223. These terms, background, head and torso are
It merely provides an indication of aspects of the invention. Depending on the size of the memory provided, further areas or layers may be defined for further refinement. Also, for the purpose of displaying the method, a further special layer 34 drawn in dashed lines may be defined, for example for text insertion, and added if desired.

The above-mentioned layers 31 to 34 correspond to the image input means 1 in the form of a video signal source.
1, for example, from a video signal flowing from a video camera, a content recognition block 3
Separated by means of an image processing algorithm within 0 and identified separately in the logical memory area. If an audiovisual communication occurs, all or individual layers or portions thereof are replaced by image information from the memory 22, ie given image data, depending on the adjustment of the user. In the example of FIG. 4, the layers 31 and 32 referring to the background and the reference head are replaced by the reference background image 2 and the head image 3 from the memory areas 221 and 222. The control of the given image data or image information used is guaranteed by the fiducial markers.

The face provides an example for further explanation. The recognized fiducial markers are used for controlling the image information of the layer “head” to be inserted. If the user moves his head, for example, nods affirmatively, the optimized or edited image will perform the same movement. If the layer "torso" is activated, the current layer "torso" is replaced by one of the torso reference images stored in the area 223 in the form of the given torso image data. All layers are put together in edited user image data as optimized video images to be transmitted.

It should be taken into account that the term “layer” does not mean that the image information, ie the user image data processed or edited by the method according to the invention, can only be two-dimensional. Alternatively, three-dimensional image information, ie, user image data, can also be processed. The newly assembled video image is now chrominance (chro) according to pre-selected or selectable parameters (see block 42 in FIG. 4).
minance), technically optimized for contrast and brightness.

In a further functional unit 43, called aesthetic image optimization, an aesthetic improvement is preferably performed in the facial region. This may include, for example, brightening the eyes, modifying the gaze angle, brightening the tooth areas, brightening the shadows (eg, wide color changes in the chin and skin), eg, unwanted warts And making slight coloring corrections to diseases such as

The video signal optimized in this way is passed to the coding unit 41 and finally sent to the communication partner, ie the communication partner as the receiver (s). With reference to FIGS. 5 and 6, the communication steps using the method according to the invention will now be described.

First, an externally set up communication connection is described. That is, the user enters a communication state. The audiovisual communication device (FIG. 1) receives signals from the other side for connection setup. Communication systems corresponding to the prior art probably transmit so-called caller identities served as communication partners, ie normal communication participant identities. In the case of an incoming call (step 51), the caller identification is checked by the identification means (step 53). This is performed by comparing the transmitted caller identification or communication participant identification with participant selection data in the participant directory 52 (the telephone directory containing the participant's address), which is identified by the participant. It is stored in the memory of the selection storage means. Certain OIP configurations, or edit modes, may or may be assigned to the participant directory 52.

In the example presented, it is assumed that there is no entry for the caller in the participant directory 52 or that the OIP configuration “office” is assigned to the entry. In these cases, the signal of the image input unit 11 in the form of a video camera is forwarded to the content recognition function block 30. Step 57 computes layers 31-34 (see FIG. 4), which are assembled in real time with the reference information, ie, the given image data of the OIP configuration "job" in step 58. Thereafter, the aesthetic image optimization 43 and the technical image optimization 42 described above are performed. After technical image optimization 42, the optimized image provides a block 40 corresponding to a pre-selected parameter value or an edit mode in the assignment of participant entries in directory 52.
The signals, i.e. the optimized image and audio signals, are then encoded and transmitted in a function block 41 based on a communication protocol.

Referring now to FIG. 5, the case includes: a) that the desired participant is known in the participant directory 52 (the exit “
YES)) and b) the OIP configuration "Private" is assigned to the participant (step 55), ie there is no editing of the user image data and therefore no editing mode is executed. Then, the unedited video signal, that is, the signal without OIP, is transmitted to the encoding unit 41.

Referring now to FIG. 6, this illustrates a connection setup originating from a present user. If the current user wants to set up a communication, he selects one participant from the participant directory (step 62).
) Or manually entering the corresponding participant code (step 61). In the case of selecting the desired participant from the participant directory 62, a check in step 64 as to whether the ID code is known leads to an exit "YES". Then, according to the OIP parameters in the participant directory 62, the OIP configuration “
"Leisure" is activated (step 66). Only the aesthetic optimization in function block 43 and the technical optimization in block 42 are assigned to this editing mode, for example by the user. The modified video signal is then encoded according to the required specifications of the communication protocol in the function block 41.

An example will now be described. Here, the user manually inputs the connection code required in step 61 by means of an input device or unit 18 (FIG. 1). The manually entered participant number or address performed in query step 64 gives a negative response in query 64 in this example. Following this, the edit selection control activates the configuration "work" and all image processing for the OIP. That is, optimization or editing of the image information, ie, the user image data, and in the given case, the acoustic information, ie, the user sound data, is performed. The optimization of acoustic information
Although not shown in FIGS. 5 and 6 for simplicity and clarity, it may be performed in a manner similar to image data editing. The edit signal is then passed to the encoding unit 41
Proceed to

For example, the “rudi” of the current user image data, ie, the image information only by the full OIP function, that is, the full editing and the aesthetic image optimization 43 and the technical image optimization 42.
Apart from the automatic selection between "mental editing", the user is allowed to activate or deactivate the OIP configuration, i.e. the editing mode, at any time via the input means 18, for example also during communication. Is done.

The method according to the invention described above can also be used, for example, to transmit the face of another person or a character that has been designed completely artificially. Here, the user acts as an "animator". The implementation of such "animations" enabled by the means of the present invention has inherent advantages in commercial use, where the identity of a commercially known person, for example as an image carrier, is important. is there. For example, it is imagined that establishing a character as a brand is a requirement of a company. For illustration reasons, the insurance company character "Mr. Kaiser" or Walt
It mentions Disney's "Mickey Mouse". Commercial use is here the preparation of the OIP, ie the corresponding editing mode according to the invention, for the telephone agent. In that regard, each user who intends to use the edit mode must identify himself for the usage of the corresponding edit mode. This assures that an uncertified person presents himself with a different appearance, possibly cannot cause any damage.

For example, a company instructs a telephone agent provided with a corresponding video communication means to always reply to and acquire a customer's inquiry, and requests to use a desired character. In this manner, the insurer described above as an example communicates acousto-visually in this manner with the familiarity of the established enterprise via OIP. Children and young people may be informed of special events and tips for their leisure time activities by the company by means of familiar comic characters, such as Mickey Mouse. As a communication participant identification for a person who gives a desired character life, for example, an algorithm for face recognition can be used to prevent misuse of the above method. The face recognition can play a role of controlling the above-mentioned layer “head”. If the user does not have the same character face shape as the stored head image, the video signal is forwarded to the encoding unit for transmission in an unedited manner and the use of the video communication device is prevented. Can come off.

Furthermore, the above-described method for the selection of authorized participants can include a voice identification algorithm that is mainly utilized in the field of commercial applications. The current participant utters the code phrase, which is compared to the stored speech sample. This should be attributed to the additional adaptation process, and furthermore, the above-mentioned correlation with the image identification can be based on the stored head image. Therefore, misuse of the present invention through the mistake of a person or impersonation of another person is prevented. Customer communication participant identification is not required in video communication device applications according to the present invention. However, if, for example, a communication participant identification with respect to a communication partner, e.g.
If it is desired to occur, it is found that an edited communication connection with the customer or an unedited communication connection with a colleague or boss is initiated. Furthermore, if the above application allows a given image data to be provided centrally on compatible hardware,
Clearly, it is guaranteed to use valid data at all times with all authorized users. Even in the case of a corresponding system, the implementation of the processing can be provided centrally.

As well as adjustable call diversion, participant identification and / or image data editing is already possible in the system or hardware with the telecommunications network provider today. It can be implemented within the provider's system or hardware, ie externally to the video communication device. This allows the technical requirements of the video communication device on the user side to be kept small and nevertheless provides sufficient processing and memory resources.

Further applications of the invention are in the field of door intercom with picture transmission, interactive video surveillance or similar. The invention is not limited to the features of the embodiments described above and illustrated in the drawings, and to combinations of such features. In individual situations, the features of the invention and combinations of such features may be realized and have value to be protected both individually and in combination. Regardless of the general and specific descriptions contained herein for an understanding of the present invention, alterations, modifications, substitutions, and combinations readily apparent to one of ordinary skill in the art and / or using its expertise may also be made from this document. It is part of the scope of this book.

[Brief description of the drawings]

FIG. 1 is a block diagram of an apparatus for transmitting / receiving audiovisual information in user-optimized content according to the present invention.

FIG. 2 is a block diagram relating to details of a function group “memory” according to FIG. 1;

FIG. 3 is a block diagram of functions when the apparatus of FIGS. 1 and 2 is used and there is no user control optimization.

FIG. 4 is a block diagram of a function using user control optimization.

FIG. 5 is a functional flow diagram of method steps when no user control optimization is performed.

FIG. 6 is a functional flow diagram of method steps when user control optimization is performed.

[Brief description of reference numerals]

 Reference Signs List 10 central processor unit 11 image input unit 12 display 13 sound input unit 14 transmission unit 15 reception unit 16 data network 17 interface 18 input device 20 memory 21 content block 22 predetermined image data 30 content recognition block 210 user identification block 211 technical image optimization Block 212 Aesthetic optimization block 213 Background processing block 214 Head processing block 215 Body processing block 221 Given background image data 222 Given head image data 223 Given body image data 31 Layer 1 (background) 32 Layer 2 (body) 33 Layer 3 (head) 34 Special layer 40 Function block 41 Encoding processing block 42 Optimization block 43 Optimization block

──────────────────────────────────────────────────続 き Continuation of front page (81) Designated country EP (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, IT, LU, MC, NL, PT, SE ), OA (BF, BJ, CF, CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG), AP (GH, GM, KE, LS, MW, SD, SL, SZ, TZ, UG, ZW), EA (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), AE, AL, AM, AT, AU, AZ, BA, BB, BG, BR, BY, CA, CH, CN, CR, CU, CZ, DK, DM, EE, ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL , IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, ZW

Claims (39)

[Claims] 1. A user image data input means for inputting current user image data, an image data editing means for generating user image data edited from the current user image data, and at least one further communication participation Video data output means for outputting user image data to a user, comprising: identification means for identifying at least one communication participant; and an edit selection controller connected to the identification means. Wherein the edit selection controller activates output of unedited current image data or edited user image data using image data output means depending on the identification result of the identification means, In the case of (1), the video communication apparatus is connected to the image data editing means in advance. 2. The video communication as claimed in claim 1, wherein the identification means is arranged to identify the user and at least one further connection or connected communication participant. apparatus. 3. A participant selection data storage means for storing participant selection data, and a participant for input for identifying a user and / or at least one further connected participant or connected communication participant, respectively. Identification input means is assigned to the identification means, the identification means comparing the stored participant selection data with the proof of the current communication participant to further connect the user and / or at least one further participant. 3. The video communication device according to claim 1, wherein the video communication device is configured to provide an identification result to a person or a connected communication participant. 4. A participant selection data storage means for storing user selection data of at least one communicable user, and / or
4. The video communication apparatus according to claim 3, further comprising partner selection data storage means for storing communication partner selection data of at least one communicable partner. 5. The participant identification input means for inputting the current communication participant identification, in particular the user identification data and / or the communication partner selection data, comprises manual selection means, electrical signal input means, optical signal input means, And / or an audio signal input method, wherein the manual selection means includes a keyboard, a menu control key, a menu control lever or a menu control pointing and / or touch-sensitive input for a communication participant identification input by a user. And / or wherein said electrical signal input means is configured to receive an electrical signal for a communication participant identification input by said user or communication participant, and / or said optical signal input means comprises: Configured to receive an optical signal for a communication participant identification input by a user or a communication participant; 5. The video communication device according to claim 3, wherein the audio signal input unit is configured to receive an audio signal corresponding to a communication participant identification input by the user or the communication participant. 6. 6. The image data editing means according to claim 1, wherein said edit selection controller is provided with a predetermined or preset edit mode, or one of a plurality of predetermined or preset edit modes. Editing of the current user image data by
2. The video communication device according to claim 1, wherein the video communication device is configured to stop or start according to the identification result of the identification unit. 7. A given image data storage means is provided for storage of given image data, said image data editing means using the given image data to produce edited user image data, The video communication device according to claim 1, wherein the video communication device is configured to edit current user image data based on and / or. 8. The given image data storage means includes a given background image data storage means and / or a given person image data storage means, and the image data editing means comprises at least current user image data. Is separated into background image data and person image data, and the background image data and / or person image data are completely or partially replaced or corresponded to given background image data or given person image data. The edited background image data and / or person image data based on the corresponding given background image data or given person image data from the storage means. Item 8. The video communication device according to Item 7. 9. The given image data storage means or the given person image data storage means includes a torso image data storage means and / or a head image data storage means, and the image data editing means comprises a person Separating the image data into torso image data and head image data, and depending on the given torso image data and / or the given head image data, the torso image data and / or the head image data can be completely or And configured to generate edited torso image data or head image data based on the corresponding given torso image data or given head image data from the respective storage means. The video communication device according to claim 8, wherein the video communication is performed. 10. The given image data storage means, the given background image data storage means and / or the given person image data storage means, in certain cases the torso image data storage means and / or In the head image data storage means, a plurality of given background image data and / or given person image data are given in a given case, given torso image data and / or given head image data. 10. A method according to claim 7, wherein a plurality of corresponding sets or subsets or constituent elements thereof can be saved, or assigned to different editing modes of the image data editing means and saved. A video communication device according to claim 1. 11. The image data editing means edits the separated current image data independently of each other and at least essentially simultaneously, and combines them to create edited user image data. 11. The video communication device according to claim 7, wherein the video communication device is configured. 12. An aesthetic and / or technical image optimization of user image data depending on or independent of an identification result using image data editing means.
Before and / or after the replacement of the background image data and / or the person image data in the given case, and before and / or after the replacement of the torso image data and / or the head image data in the given case. 2. The method as claimed in claim 1, wherein, based on an editing algorithm, it can be performed completely or partially by corresponding given image data from each given image data storage means. Video communication device. 13. The user image data input means creates a plurality of current user images continuously in chronological order, and each of the images is individually and / or sequentially prepared in advance using image data editing means. 2. The video communication device according to claim 1, wherein the video communication device is edited according to settable rules. 14. The image data editing means separates background image data and / or person image data, in a given case, torso image data and head image data, and outputs a given user image. Wherein the replacement of the torso image and the head image by the corresponding given image data from each of the image data input means is dynamically performed continuously. 2. The video communication device according to 1. 15. The apparatus according to claim 1, wherein said user image data input means includes at least one camera, and said image data output means includes at least one interface to a data communication network. A video communication device as described. 16. A user sound data input unit for inputting current user sound data, a sound data editing unit for generating edited user sound data from the current user sound data, and at least one further device. 2. A video communication apparatus according to claim 1, wherein sound data output means for outputting user sound data to a communication partner is provided. 17. The editing selection control uses sound data output means to generate an output of unedited current sound data or edited user sound data depending on the identification result of the identification means. 17. The video communication device according to claim 16, wherein: 18. Given sound data storage means for storing given sound data, the sound data editing means uses the given sound data to create edited user sound data. 18. The video communication device according to claim 16 or 17, wherein the video communication device is configured to edit the current user sound data based on and / or. 19. An aesthetic and / or technical sound optimization of the user sound data, depending on the identification result or independently of the identification result, using sound data editing means in a given case. 19. The method according to claim 16, further comprising the step of: executing an editing algorithm before and / or after editing the current user sound data with the given sound data from the given sound data storage means. A video communication device according to claim 1. 20. A video as claimed in claim 16, wherein the editing mode of the sound data editing means given individually or in advance by the user in the group is assigned the identification result of the identification means. Communication device. 21. The method according to claim 16, wherein the user sound data input means includes at least one microphone, and the sound data output means includes at least one interface to a data communication network. Video communication device. 22. The video communication device according to claim 1, wherein said identification means includes an interface to at least one data communication network. 23. A video communication system comprising at least one video communication device according to one of claims 1 to 22 and connected or connectable to a data communication network. 24. A video communication method, wherein at least one communication participant is identified by identification means, current user image data is input to user image data input means, and edit selection control is performed by said identification means. Guiding or not guiding the current user image data to the image data editing means depending on the identification result of, the image data editing means edits this or for this immediately after receiving the current user image data Generating edited user image data, and finally outputting unedited current data or edited user image data, if any, by the image data output means. 25. A video communication method according to claim 24, wherein the video communication device according to claim 2 is used and / or operated. 26. Image data or image and sound data is transmitted in a manner optimized for image presentation, especially when the image is communicated over a telephone, wherein image data obtained from a video source, In some cases, the sound data from the sound source is based on a given image data or a given sound data, each corresponding to at least one predetermined or predeterminable criterion, before each transmission to the communication partner. Before the commencement of the communication, wherein: a) the given image data is generated and stored; and b) the parameters for querying the image data are defined and stored and stored in step a). C) user image data obtained from the user image data input means, in particular one or several Extracting a video source for the selected or selectable image data parameters by the parameters defined and stored in step b); and d) in step c) based on the selected image data parameters. The user image data is edited based on the assigned given image data; and e) the user image data edited in step d) is transmitted to one or several communication partners. 26. The video communication method according to claim 24, further comprising the step of: 27. The steps d) and e) are performed at a central location remote from the user, wherein the user image data, the assigned given image data and image data parameters are 27. The method of video communication according to claim 26, wherein the method is transmitted from a user location to the central part. 28. The video communication method according to claim 26, wherein the steps a) to e) are performed at a user location. 29. A pre-stored speech sample of an authorized user is compared with a code phrase uttered by the current user, and if the comparison is positive, the An additional step f in which the edited communication is released
29. The video communication method according to one of claims 26 to 28, wherein 30. In step f), the stored audio sample is additionally assigned to given image data belonging to the user or selected to belong to the user, and the user is stored 30. The method of video communication of claim 29, wherein the method is identified based on the audio sample and associated image data. 31. The speech analysis of the said uttered code phrase and the image analysis of the user image data obtained from the user image data input means, in particular the video source is performed in step f). Claim 29 or 3
0. The video communication method according to item 0. 32. The method of video communication according to claim 31, wherein in the image analysis, user-specific features are compared with relevant or selected given image data. 33. Before performing step c), it is confirmed that the user is authorized to use the given image data stored for audiovisual communication. 33. The video communication method according to any one of 30 to 32. 34. The user image data to be processed or edited and to be analyzed, the given image data as well as the edited image data comprise two-dimensional and three-dimensional motion images. 3. The image processing apparatus according to claim 2, further comprising image information.
34. The video communication method according to any one of items 4 to 33. 35. The video communication method according to claim 24, wherein the user image data to be transmitted is indicated to the user before transmission. 36. The display comprising an interactive user appearance,
36. The video communication method according to claim 35, further comprising displaying selectable and / or selected given image data as well as selectable or selected image data parameters. 37. The presentation of video and / or audio data according to claims 1 to 22 is optimized, not only for the implementation of the video communication method according to claims 24 to 26 in particular. A video communication device for transmitting, comprising: video input and output means (11, 12); audio input and output means (13); transmission and reception means (14, 15). An interface (16) to at least one transmission channel; an input device (18) for input of control and command signals; storage of user and system programs as well as given image data and given sound data. Means, devices and components as described above, having a functional connection with the processor unit (10), and a method according to the described means and components. Video communication apparatus characterized by being configured to perform the step. 38. An interface (17) with a higher-level management device and / or a processing device (10) for connection to a higher-level storage medium, for example a "personal computer"
The video communication device according to claim 37, further comprising: 39. The video communication device according to claim 1, wherein the video communication device is a video communication device.
37. Use of a video communication system according to claim 24 and a method of video communication according to one of claims 24 to 36, wherein the transmission of images by telephone, video conferencing or image optimized transmission of video and / or audio data in a computer network. The use method characterized in that it is particularly intended for.