EP1192807A1

EP1192807A1 - Video communications device, system and method

Info

Publication number: EP1192807A1
Application number: EP00915108A
Authority: EP
Inventors: Tobias Dorfner
Original assignee: Voxar AG
Current assignee: Voxar AG
Priority date: 1999-02-16
Filing date: 2000-02-16
Publication date: 2002-04-03
Also published as: AU3654700A; IL144878A0; WO2000049806A1; JP2002537734A

Abstract

The invention relates to a video communications device with input devices for user image data for inputting real-time user image data and with editing devices for image data for generating edited user image data from the real-time user image data and with output devices for image data for outputting user image data to at least one additional communications user. Identification devices for identifying at least one communications user and an editing selector control that is coupled to the identification devices are provided. Said editing selector control outputs unedited real-time or edited user image data by means of the output devices for image data according to the identification result of the identification devices, optionally by connecting the editing device for image data.

Description

Video communication device, system and - experienced

description

The invention relates to a video communication device according to the preamble of claim 1, a video communication system with such video communication devices and a video communication method in which such video communication devices are used.

Video communication devices, video communication systems and video communication methods, which in addition to the auditory area also offer visual media or channels for the transmission of sound and image information, are known, but have not yet been widely used by the general public. A major disadvantage of the prior art is that the associated transmission of image information to at least one other communication participant often interferes with the privacy of the user. Depending on who triggers the communication contact, the user and / or his communication partner would like to transmit certain visual information or not. The communication participants would prefer to transmit an optimal "desired appearance" tailored to the respective communication partner. This includes not only a suitable background, but also suitable clothing and an advantageous other appearance.

For example, in video conferencing systems, image processing algorithms are used, as are disclosed, for example, in WO96 / 09722.

DE-4102895 C1 describes a method and a device for correcting the corner of the eye in workplace video systems. Here, the eye area of a user is edited to give the impression that you are looking directly into the camera instead of the monitor. This editing function works unnoticed by the sender and recipient of the transmission.

It is also known that there are methods in the television field which change information in real time or almost in real time before being passed on to the transmitting unit. The advantage here is that the changed information corresponds to or comes close to the representation desired by the creator. These methods include, for example, "blue box", "masking" and "auto-masking". As is known, the above-mentioned audiovisual communication services and systems transmit more information than the telephone. This information includes, among other things, the appearance of the sending participant, his body language, facial expressions and gestures, as well as the environment that can be captured by the video camera. The problem arises, however, that the transmission of this visual information leads to psychological inhibitions when using the above-mentioned audiovisual communication services and systems. It is certain that these psychological inhibitions have largely contributed to the fact that, for example, the videophone has still not established itself on the market.

It is therefore an object of the present invention to provide a video communication device, a video communication system and a video communication method, which enable problem-free use in the private as well as in the business area without transmitting undesirable visual impressions to a communication partner.

This aim is achieved according to the invention with a video communication device according to claim 1, a video communication system with such video communication devices according to claim U and a video communication method in which such video communication devices are used according to claim X. The invention reduces or avoids psychological inhibitions when using video communication devices and services, so that the corresponding video communication technology can advantageously be used widely.

According to the invention, a video communication device is thus created, with user image data input devices for inputting current user image data, image data editing devices for generating edited user image data from the current user image data, and image data output devices for outputting user image data to at least one further communication subscriber. According to the invention it is further provided that identification devices for identifying at least one

Communication subscriber and an edit selection control coupled to the identification devices are provided, which, depending on the identification result of the identification devices, causes output of unedited or edited user image data by means of the image data output devices, possibly with the image data editing devices connected upstream. If the video communication device is only accessible to one person as a user, the identification of a caller can suffice. If, on the other hand, the same edited user image data are always assigned to each of several users of the video communication device, the identification of the respective user is sufficient.

The invention can thus automatically ensure that exactly an intended visual impression is created at the communication partner by the transmission of unedited image data or of image data edited by the user in particular in a predefinable manner. Video communication devices can thus be used in practice without disadvantages, in particular without current environmental information, information about the current appearance and even current mood information of the user being transmitted to communication partners if this is not desired. A user does not have to fear that the communication partner will receive information about e.g. receives his home, physical appearance or clothing at the time of communication. The video communication devices according to the invention ensure that, depending on a particular communication partner, such as a superior, friends or relatives, correspondingly edited or unedited image data are automatically transmitted without time-consuming manual settings or selections being necessary.

The video communication device thus enables users of corresponding audiovisual communication services and systems to control the exchange of self-related information in a simple and reliable manner.

The user e.g. As a sending or receiving subscriber of audiovisual communication signals, the invention gives the possibility to influence the content in such a way that the sent content comes close to the presentation of the user or corresponds to his presentation. This overcomes the following disadvantage of the previous audiovisual communication: The user of an audiovisual message can, for example, regardless of its current appearance, e.g. Communicate unhindered in the morning after getting up, in the event of illness, deformities of the face or despite an appearance that is disadvantageous for other reasons.

By using the present invention, for example in video telephony, in video conferences, workplace conferences, internet conferences, etc., a respective participant in audiovisual communication ensures that its appearance and the surroundings also captured by the camera are at the receiving participant's inner Self-esteem corresponds. Thus, the use of the present invention protects privacy and privacy.

In the video communication device according to the invention, it is also preferably provided that the identification devices are designed to identify the user and at least one other contacting or contacted communication subscriber. Such a video communication device can thus be used individually by several users for communication with corresponding partners, and each user appears in each of his communication partners in the individually desired representation.

Furthermore, it is preferred within the scope of the invention if the identification devices are assigned subscriber selection data storage devices for storing subscriber selection data and subscriber identification input devices for entering communication subscriber identifications of the user and / or at least one other contacting or contacted communication subscriber, and that the identification devices are designed are to obtain an identification result for the user and / or at least one other contacting or contacted communication participant by comparing stored participant selection data with current communication participant identifications.

The above embodiment can be further developed in that the subscriber selection data storage devices contain user selection data storage devices for storing user selection data of at least one possible user and / or partner selection data storage devices for storing communication partner selection data for at least one possible communication partner. As an alternative or in addition to this, the subscriber identification input devices for entering current communication subscriber identifications, in particular user selection data and / or communication partner selection data, manual dialing devices, electrical signal input devices, optical signal input devices and / or acoustic signal input devices, preferably include a keyboard, menu control buttons, levers or contain pointing devices, and / or touch-sensitive input devices for the input of communication subscriber identifications by the user, and / or the electrical signal input devices are designed for receiving electrical signals for the input of communication subscriber identifications by the user or by a communication subscriber, and / or the optical signal input devices are designed for receiving optical signals for the input of communication subscriber identifications by the user or from a communication subscriber, and / or the acoustic signal input devices are designed for receiving acoustic signals for the input of communication partner identifications by the user or from a communication subscriber.

In another preferred development of the invention, it is provided that the edit selection control is designed, depending on the identification result of the identification devices, to prevent editing of the current user image data by the image data editing devices or according to a predefined or predefinable editing mode or one of a plurality of predefined ones or predefinable editing modes.

Furthermore, it can advantageously be provided in a video communication device according to the present invention that default image data storage devices are provided for storing default image data, and that the image data editing devices are designed for editing the current user image data by means of and / or on the basis of the default image data in order to be edited To create user image data.

This embodiment can be further developed in that it is provided in such a video communication device that the default image data storage devices contain background default image data storage devices and / or personal default image data storage devices, and that the image data editing devices for separating the current user image data at least into background image data and person image data and Replace the background image data and / or person image data in whole or in part with corresponding background default image data or person default image data or for the generation of edited background image data and / or person image data on the basis of corresponding background default image data or person default image data from the corresponding storage devices. Furthermore, the default image data storage devices or the personal default image data storage devices can contain body image data storage devices and / or header image data storage devices, and the image data editing devices for separating the personal image data into body image data and header image data and replacing the body image data and / or header image data in whole or in part with corresponding body default image data or header image data or for generating edited body image data and / or header image data on the basis of corresponding body input image data or header input image data from the respective storage devices.

In the above explanations, a plurality of background default image data and / or personal default image data and / or personal default image data or, if applicable, are preferably provided in the default image data storage devices, background default image data storage devices and / or personal default image data storage devices or possibly body image data storage devices and / or header image data storage devices. Body default image data and / or head default image data or a plurality of corresponding sentences or subsets or components thereof can be stored or stored, which can be assigned to different editing modes of the image data editing devices.

According to another advantageous development of the invention, the image data editing devices are designed to edit the separated current image data separately from one another and at least essentially at the same time and then to reassemble them to produce edited user image data.

Another advantageous further development of the invention consists in the fact that by means of the image data editing devices a cosmetic and / or technical image optimization of user image data depending on an identification result or independently of one

The identification result and / or if necessary before and / or after replacing the background image data and / or person image data or possibly body image data and / or header image data can be carried out in whole or in part by corresponding default image data from the respective default image data storage devices on the basis of editing algorithms.

Furthermore, in a video communication device according to the invention it is advantageous if the user image data input devices successively generate a plurality of current user images, which are each individually edited in succession and / or according to predefinable rules by means of the image data editing devices.

In a video communication device according to the invention, the image data editing devices are preferably designed to dynamically and sequentially perform the separation of background image data and / or person image data as well as possibly body image data and header image data and, if necessary, their replacement by corresponding default image data from the respective default image data storage devices for individual user images . It is further preferred that the user image data input devices contain at least one camera and that the image data output devices contain at least one interface to a telecommunications network.

In a video communication device as created by the invention, it can further be provided that user sound data input devices for entering current user sound data, sound data editing devices for creating edited user sound data from the current user sound data, and sound data output devices for outputting user sound data to at least another communication participant is provided.

This embodiment can be further developed in that the edit selection control is designed to initiate output of unedited current or edited user sound data by means of the sound data output devices, depending on the identification result of the identification devices. As an alternative or in addition to this, preset sound data storage devices can be provided for storing preset sound data and the sound data editing devices can be designed for editing the current user sound data by means of and / or on the basis of the preset sound data in order to create edited user sound data.

Another additional or alternative embodiment of the embodiment variant of the invention now dealt with consists in the fact that the sound data editing devices enable cosmetic and / or technical sound optimization of user sound data as a function of an identification result or independently of an identification result and / or possibly before and / or after editing the current user audio data by means of the default audio data from the default audio data storage devices on the basis of editing algorithms.

In the area of the sound data, too, it can advantageously be provided that identification results of the identification devices are assigned to edit modes of the sound data editing devices that can be specified individually or in groups by the user.

It is further preferred if the user sound data input devices contain at least one microphone and the sound data output devices contain at least one interface to a telecommunication network, and / or if the identification devices contain at least one interface to a telecommunication network. In a video communication device according to the present invention, display-optimized transmission of video and / or audio data is preferably possible, preferably for carrying out the video communication method described later. For this purpose, a corresponding video communication device contains: video input and output means,

- audio input and output means,

- means of transmission and reception,

an interface to at least one transmission channel,

- An input device for inputting control and command signals, - Storage devices for storing user and system programs as well as preset image data and preset sound data, the aforementioned means, devices and components being functionally connected to a processor unit which is set up to do this Execute procedural steps in interaction with the means and components mentioned.

A further development of the previously explained embodiment of the video communication device according to the invention consists in that it also has an interface connected to the processor unit for connection to a higher-level management unit and / or a higher-level storage medium, e.g. with a "personal computer".

The invention also provides a video communication system with which the above-mentioned goal is also achieved. Such a video communication system contains at least two video communication devices according to the invention according to one of Claims 1 to 22, which are connected or can be connected via a telecommunication network.

The aim underlying the invention is also achieved by a video communication method, in which a communication subscriber is identified by means of identification devices, current user image data are entered in user image data input devices, an edit selection control guides the current user image data depending on the identification result of the identification devices to image data editing devices or not , the image data editing devices, if they have received the current user image data, generated from them or user image data edited therefor, and finally unedited current or, if present, edited user image data are output by means of image data output devices. With regard to the arguments for achieving the objective and the advantages, in order to avoid repetitions, reference is made overall to the representations in connection with the video communication device according to the invention.

Advantageous developments of the video communication method according to the invention result from analog or adequate implementation of the features and combinations of features of the video communication device according to the invention specified above.

The video communication method according to the invention can also be further developed in that image data or image and sound data, in particular in the case of video telephony, are transmitted in an optimized manner by adding image or possibly audio data coming from a video source and possibly an audio source prior to their transmission a communication partner can be changed on the basis of default image data or, if applicable, default audio data according to at least one predetermined or predeterminable criterion, with the following steps: before communication, a) default image data are created and stored, and b) parameters relating to image data are defined, stored, and the Assigned default image data stored in step a), and during communication c) user image data coming from user image data input devices, in particular a video source, with respect to one or more selected or selectable image data parameters are defined by those in step b) extracted and stored parameters, d) the user image data from step c) is edited based on the selected image data parameter (s) based on the assigned default image data, and e) the user image data edited in step d) is transmitted to one or more communication partners.

A further development of this variant of the method is that steps d) and e) are carried out at a central location which is distant from the user, the user image data, the assigned default image data and the image data parameter or parameters being transmitted from the location of the user to the central location become. Alternatively or additionally, it can be provided that steps a) to e) are carried out at the location of a user.

The embodiment variant dealt with here can be further developed by providing an additional step f) with which previously stored speech samples of authorized users are compared with a spoken passphrase of a current user and, if the result of the comparison is positive, a release for edited communication for this application. turns. This ensures in an advantageously simple manner that only an authorized user can carry out the user-specific optimization and can go on the air with edited images and / or a changed voice position. It can further be provided that in step f) the stored speech sample is also assigned default image data that belongs to a user or has been selected as belonging to the user, and the user is identified on the basis of the stored speech sample and the associated default image data. Alternatively or additionally, a speech analysis of the spoken characteristic phrase and an image analysis of the user image data coming from the user image data input devices, in particular the video source, can be carried out in step f). The latter embodiment can be further developed by comparing the facial features of a user with associated or selected default image data in the image analysis.

Another further development of the basic inventive variant of a video communication method discussed last consists in the user being identified as authorized to use stored default image data for audiovisual communication before performing step c).

It is further preferred in the video communication method according to the invention that the user image data to be processed or edited and analyzed, the default image data and the edited user image data contain moving images, two-dimensional and three-dimensional image information.

Another preferred embodiment of the video communication method according to the invention is that the user image data to be transmitted are displayed to the user before the transmission. This can preferably be further developed in that the display has an interactive user interface which also displays the selectable and / or selected default image data and the selectable or selected image data parameters.

The video communication device, the video communication system and the video communication method according to the invention are advantageously suitable for the particularly display-optimized transmission of video and / or audio data in telephony, in video conferences or via computer networks.

Further preferred and advantageous configurations of the invention result from the respective dependent claims and their combinations as well as from the analog and suitable Ned transfers of respective features and combinations of features between device, system and process claims.

The invention is explained in more detail below using exemplary embodiments shown in the drawing, in which the further features and combinations of features are disclosed. The drawing shows:

FIG. 1 shows a block diagram of a device according to the invention for transmitting / receiving audio-visual information with user-optimized content,

FIG. 2 shows a block diagram about details of the “storage” function group according to FIG. 1,

3 shows a block diagram of functions when using the device of FIGS. 1 and 2 without user-controlled optimization, FIG.

FIG. 4 shows a block diagram of functions using a user-controlled optimization,

FIG. 5 shows a functional flow diagram of method steps if no user-controlled optimization is carried out, and

FIG. 6 shows a functional flow diagram of method steps when a user-controlled optimization is carried out.

Identical reference symbols in the individual figures and illustrations of the drawings denote identical or similar or identically or similarly acting components. On the basis of the representations in the drawing, such ^* features that are not provided with reference symbols become clear, regardless of whether such features are described below or not. On the other hand, features which are contained in the present description but which are not visible or shown in the drawing are also readily understandable for a person skilled in the art.

The invention is based on the presence of audiovisual communication media. General features of audio-visual communication media are microphone and loudspeaker, video camera and screen, a control unit, a processing unit outgoing for processing audio and video signals, a processing unit for processing audio and video signals and a compression unit for optimal Use of the available line bandwidth, e.g. via analog and digital telephone networks, packet-controlled communication via the Internet, internal computer networks, etc.

The present invention extends the audiovisual communication media, among others. a function that is called "optimizing image processing" (OBV) in the following. The OBV function according to the invention can e.g. in video picture telephones, video conference systems or systems based on internet protocol. For the purpose of simplification, the present description is mainly concerned with the user-controlled OBV and the language optimization is not dealt with in such detail.

The OBV according to the invention gives the subscriber the possibility of storing 1 to n optimized images of his desired appearance as reference image information or default image data in one or more storage media. Storage media of different physical types can also be used.

Reference is now made to FIG. 1, which shows a block diagram of an apparatus which is used to carry out the method according to the invention, i.e. is set up to send / receive audiovisual information with user-controlled optimization.

According to FIG. 1, a central processor unit 10 is functionally connected to user image data input devices in the form of an image input unit 11, e.g. a video camera with a display device 12, e.g. a PC monitor or a liquid crystal display, with an audio output / input device 13 which contains image data and sound data output devices, with an audiovisual communication unit which has a transmitter unit 14, a receiver unit 15 and an interface to a telephone network, radio network, Contains mobile network or data network 16 or telecommunications network in general, with an interface 17 to a higher-level storage medium or a computer, such as a personal computer with an input device 18, e.g. a telephone keypad or a separate keypad as an example for subscriber identification input devices, and with a memory 20 in which at least user-specific programs 21 and reference pictures or default picture data 22 and possibly audio reference data or default sound data are stored, and which thus represents default picture data and default data storage devices.

FIG. 2 shows that the memory 20 can have several, also physically different, storage media. The optimized or edited reference information, ie the reference Renzbildinformation or edited user image data and the reference audio information or edited user sound data, on the one hand via the image input unit 11, which may be a video camera, a recorder, etc., the audio input unit 13, or from a higher-level unit via the interface 17 in the memory 20 . It is immaterial whether the applications and the image material are made available, for example, in a ROM memory, a RAM memory or a mass storage device, such as in a hard disk, in flash cards or similar media (FIG. 2). As mentioned, the memory 20 can also contain reference audio information or default audio data which can be used for the user-controlled optimization of its language. For example, the user controls the optimizing image processing or image data editing through the input device 18 in order to optimize the image to be sent by him to a communication partner and / or his language of his choice. The input device 18 can be, for example, a telephone keyboard, a separately connected keyboard field, a computer mouse, a light pen, a graphic tablet, etc.

FIG. 2 shows details of the memory 20 and the user-specific information content 21 stored therein and the reference images or default image data 22. As illustrated, the memory 20 that can be used in the invention may include or include ROM, RAM, hard disk, removable disk, floppy disk, flash card, and other suitable storage media. The memory 20 can also contain a combination of such storage media. In the content block 21, in which user-specific programs and information or data are stored, there is a block 210 for user identification or identification, a block 211 for technical image optimization or editing with various algorithms 1, 2,... N Block 212 for cosmetic appearance optimization or image optimization, again with various image processing algorithms 1, 2, ... N, a block 213 for background processing, a block 214 for head processing and a block 215 for body processing. It must be noted here that the individual blocks 211 to 215 contained in the user-specific block 21 and listed above are not limited to the list given, and that memory contents for speech recognition and other contents which are here to avoid

Repetitions under similar or analog aspects between the image and the speech optimization were omitted.

The block 22 shown in FIG. 2, which relates to the image material of the default image data, ie the reference image information, contains a block 221 with background default image data or reference background images 1,... N, a block 222 with reference images 1, 2,... N of the head (Header image data) and a block 223 with reference images 1, 2, ... N of the body pers (body image data) of the user. This terminology is based on the fact that the term "body" includes the parts of the body other than the head.

For a video communication device according to the invention in the form of the audiovisual communication device shown in the figures, which is authorized for a plurality of participants, the blocks 221 to 223 are correspondingly present multiple times, which is within individual physical storage devices by their suitable, possibly software-based division or in the form of separate storage devices can be implemented for every user.

FIG. 3 shows a function in the form of a functional block diagram without optimizing image processing on the transmitter side, i.e. without the OBV according to the invention. The above-mentioned OBV, which is shown in a function block 40, is deactivated, and the video signal from the video signal source goes directly to an encoding block 41. This function is based on an identification result, for example of user and communication partner identification by means of identification devices, which will be discussed later automatically selected in the video communication device if the user had previously determined that the specific communication partner should receive the current user image data and should therefore be able to see it.

In contrast, FIG. 4 shows in the form of a functional block diagram the case in which an optimizing image processing or editing of the current user image data is carried out before a output of the user image data in a telecommunication network to a communication partner. This function is automatically selected on the basis of an identification result, for example user and communication partner identification, by means of identification devices from the video communication device if the user had previously determined that the specific communication partner should not receive the current user image data and should therefore be able to see it, but rather the user of this concrete communication partner against a special background, with certain clothing and / or a suitably prepared other exterior, such as hairstyle,

Shave, complexion and firmness, etc. The latter may be desired in a suitable manner, for example, if the specific communication partner is, for example, a business partner, a supervisor, a subordinate, a sports or leisure acquaintance or an unknown person.

Before a telecommunications connection, for example a broadcast, is established, the current applications received from an image input unit 11, for example a video signal source, are derbilddaten in the form of, for example, a video signal to prepare for editing or optimization in the sense of the invention by a content recognition block 30 into individual areas or levels 31 to 33 (English: "layers") or broken down. Levels 31 to 33 are only referred to as level 1 (background), level 2 (body) and level 3 (head) for the purpose of better understanding. These levels correspond to the layers "background" or background default image data 221, "head or header default image data 222 and" body "or body default image data 223 (see FIG. 2) stored in the memory area 22. These terms background, body, head are only used to illustrate this aspect of the invention. Depending on the size of the memory provided, further areas or levels can be defined for further detailing, also to illustrate the method, a further special level 34, shown in broken lines, is defined, for example for text overlays, which can optionally be activated.

The described levels 31 to 34 are derived from the video signal stream from the image input unit 11 in the form of the video signal source, e.g. from the video camera, with image processing algorithms in the content recognition block 30 and separately managed in logical storage levels. If audio-visual communication takes place, depending on the setting of the user, all or individual levels or parts thereof are replaced by image information or default image data from the memory 22. In the example of FIG. 4, the levels 31 and 32, relating to the background and reference header, are replaced by a reference background image 2 and a header image 3 from the memory areas 221 and 222. The control of the default image data or image information used is ensured by reference marks.

The face should serve as an example for the further explanation. The recognized reference marks are used to control the image information to be used on the "Head" level. If the user moves the head, for example if he nods in agreement, the optimized or edited image executes the same movement. If the "Body" level is activated, the current level becomes active "Body" is replaced by one of the stored body reference images in the form of the body default image data in the area 223. Put together at all levels, the edited user image data to be sent form an optimized video image.

It should be noted that the term "plane" does not mean that image information or user image data processed or edited with the method according to the invention can only be two-dimensional. Instead, three-dimensional image information or user image data can also be processed. The newly composed video image is now technically optimized in terms of color values, contrasts, brightness according to preset or presettable parameters (see block 42 in FIG. 4).

In a further functional unit 43, which is called cosmetic image optimization, cosmetic improvements are preferably made in the facial area. These include e.g. brightening the eyes and correcting the corner of the eye, brightening the tooth area, brightening the shadow (e.g. with beard growth and with large-scale pigment changes of the skin) and retouching of unwanted small pigment disorders or e.g. Warts.

The video signal optimized in this way is passed on to the coding unit 41 and finally sent to the communication partner or partners as the receiver.

Communication steps using the method according to the invention are described below with reference to FIGS. 5 and 6.

First, a communication connection is described that is established from outside, i.e. the user is contacted. The audiovisual communication device (FIG. 1) receives a signal from the opposite side to set up a connection. The state of the

Communication systems corresponding to technology may transmit a so-called caller ID, which serves as communication partner or general communication subscriber identification. In the case of an incoming call (step 51), the caller ID is checked using identification devices (step 53). This is done by comparing the transmitted caller ID or communication subscriber identification with subscriber selection data in a subscriber directory 52 (telephone book with subscriber addresses), which is stored in a memory of subscriber selection data storage devices. Certain OBV configurations or editing modes can be assigned to the entries in the subscriber directory 52.

In the example presented, it is assumed that the caller either has no entry in the directory 52 or that the OBV configuration "office" has been assigned to the entry in the directory 52. In these cases, the signal of the image input unit 11 in the form of the video camera is forwarded to the content recognition function block 30, the step 57 calculates the levels 31 to 34 (see FIG. 4), which in step 58 with the

Reference information or default image data of the OBV configuration "office" can be compiled in real time. Thereafter, the cosmetic image optimization 43 already mentioned and the technical image optimization 42 is carried out. After the technical image optimization 42, the optimized video image is created in block 40 according to the preset parameter values or in accordance with the editing mode in association with the subscriber entry in directory 52. The signals, ie the optimized images and audio signals, are then coded and transmitted in function block 41 depending on the communication protocol.

5, the case is considered that a) the desired subscriber is known to subscriber directory 52 (output "YES" of comparison step 53) and that b) the OBV configuration "private" is assigned to the subscriber (step 55) , ie no editing of the user image data and therefore no editing mode is carried out. Then the raw video signal, i.e. without OBV, the coding unit 41 transmitted.

Reference is now made to FIG. 6, which represents a connection setup by the present user. If the present user wants to establish communication, he has the option of selecting a participant from the participant directory

(Step 62) or manually enter the corresponding subscriber code (step 61). In the case in which the desired subscriber is selected from the subscriber directory 62, the check in step 64 leads whether the code LD is known to the output "YES". Then, in accordance with the OBV parameter in the subscriber directory 62 in accordance with the selection preset by the user, e.g. the OBV configuration "Leisure" activated

(Step 66). This editing mode is assigned, for example, only cosmetic image optimization in function block 43 and technical image optimization in function block 42 by the user. The video signal thereby changed is then encoded in function block 41 according to the requirements of the communication protocol.

An example will now be described in which the user manually enters the required connection code in step 61 via the input device or unit 18 (FIG. 1). The check carried out in query step 64 of the manually entered subscriber number or address in the example results in a negative answer to query 64. An edit selection control for the OBV then activates the "office" configuration and the entire image processing, ie optimization or editing of the image information or User image data and possibly the audio information or user sound data executed. The execution of the optimization of the audio information is not shown in FIGS. 5 and 6 for simplicity and clarity, but can be carried out in the same way as the image data editing. The edited signal is then passed on to the coding unit 41. Apart from this automatic selection between, for example, a complete OBV function, ie complete editing and "rudimentary editing" of the image information or the current user image data only by means of cosmetic image optimization 43 and technical image optimization 42, the user can, for example, at any time to activate or deactivate the OBV configuration or the editing mode during a communication via the input unit 18.

The prescribed method according to the invention can also be used to e.g. To transfer faces of other people or entirely artificially created characters. The user can act as an "animator". The implementation of such "animations" made possible by the invention is particularly advantageous in commercial applications in which a certain identity, for example a personality known from advertising, is important as an image carrier from companies to establish a certain character as a brand. The character "Mr. Kaiser" of an insurance company and also the character "Mickey Mouse" of the Walt Disney Corporation are cited for illustration. A commercial application here is the provision of an OBV according to the invention or a corresponding editing mode for telephone agencies, it is desirable that every user who wants to use the editing mode must identify himself in order to use the corresponding editing mode, so that it can be ensured that unauthorized persons are not under a different name can appear and possibly cause damage.

For example, companies can commission telephone agencies equipped with appropriate video communication equipment to always respond to customer inquiries and requests with the desired character. In this way, customers of the insurance company cited above as an example communicate audiovisually with the company’s popular figure established by OBV. Children and adolescents can find out about special campaigns and tips on how to spend their free time from the company through likable cartoon characters, such as Mickey Mouse. Algorithms for facial recognition can be used, for example, as communication subscriber identification for the people who give life to the desired character, so that misuse of the above-described method is prevented. Face recognition can be part of the control of the "head" level described above. If the user does not have the same characteristic facial features as the stored header picture, the video signal is passed on unedited to the coding unit for transmission or the use of the video communication device is prevented. Furthermore, the above-described method for selecting authorized subscribers can contain speech recognition algorithms, which are advantageously activated especially in commercial applications. A current participant speaks a passphrase that is compared to stored speech samples. If there is a match, a correlation with the image recognition mentioned can also be established using a stored header image. Misuse of the invention by confusing people or pretending by other people is thus excluded. Communication subscriber identification by customers is not necessary in this application of the video communication device according to the invention. If, however, it is desired that, for example, company-internal communication should also take place via the corresponding devices, identification of the communication partner with regard to the communication partner can be used to determine, for example, whether an edited communication connection with a customer or an unedited communication connection with a colleague or manager should be established. In the case of the application described above, it is also advisable for the default image data to be provided centrally on suitable hardware, so that it is ensured that all authorized users always use the applicable data, and processing power can also be provided centrally in corresponding systems.

Similar to the call forwarding that can already be set by a telecommunications network operator in its system or hardware, subscriber identification and / or image data editing can be carried out in the system or in the hardware of a telecommunications network operator, that is to say externally with respect to the video communication device. As a result, the technical outlay in the user-side video communication device can be kept low and there are nevertheless sufficient processing and storage resources available.

Further applications of the invention are, for example, in the field of door intercoms with image transmission, interactive video surveillance systems and others.

The invention is not restricted to the features and combinations of features of the exemplary embodiment described above and shown in the drawing. The individual aspects, features and combinations of features of the present invention can be implemented individually and in combination and are worthy of protection. In addition to the general and concrete information contained in the present documents on the implementation of the invention, the scope of the invention also includes all variations, modifications, substitutions and combinations which the person skilled in the art can readily recognize from the documents himself and / or with the help of his specialist knowledge.

Claims

Video communication device, system and method claims

1. Video communication device with user image data input devices for

Entering current user image data, image data editing devices for generating edited user image data from the current user image data, and image data output devices for outputting user image data to at least one further communication participant, characterized in that identification means for identifying at least one communication participant and one coupled to the identification means Editing selection controls are provided which, depending on the identification result of the identification devices, cause an output of unedited current or edited user image data by means of the image data output devices, possibly with the image data editing devices connected upstream.

2. Video communication device according to claim 1, characterized in that the identification devices are designed to identify the user and at least one other contacting or contacted communication participants.

3. Video communication device according to claim 1 or 2, characterized in that the identification devices subscriber selection data storage devices for storing subscriber selection data and subscriber identification input devices for entering communication subscriber identifications each of the user and / or at least one other contacting or contacted

Are assigned to the communication subscriber, and that the identification devices are designed to obtain an identification result for the user and / or at least one other contacting or contacted communication subscriber by comparing stored subscriber selection data with current communication subscriber identifications.

4. Video communication device according to claim 3, characterized in that the subscriber selection data storage devices user selection data storage devices for storing user selection data of at least one possible user and / or partner selection data storage devices for storing

Contain communication partner selection data of at least one possible communication partner.

5. Video communication device according to claim 3 or 4, characterized in that the subscriber identification input devices for entering current communication subscriber identifications, in particular user selection data and / or communication partner selection data, manual dialing devices, electrical signal input devices, optical signal input devices and / or acoustic signal input devices, preferably including the manual dialing devices if necessary , Menu control buttons, levers or pointing devices, and / or touch-sensitive input devices for the input of communication subscriber identifications by the user, and / or the electrical signal input devices are designed for receiving electrical signals for the input of communication subscriber identifications by the user or by a communication subscriber , and / or the optical signal input devices for receiving optical signals are designed for the input of communication subscriber identifications by the user or by a communication subscriber, and / or the acoustic signal input devices are designed to receive acoustic signals for the input of communication partner identifications by the user or from a communication subscriber.

6. Videokommunikationsvomchtung according to any one of the preceding claims, characterized in that the edit selection control is designed, depending on the identification result of the identification devices to prevent editing of the current user image data by the image data editing devices or according to a predetermined or predeterminable editing mode or from one

To initiate a plurality of predefined or predefinable editing modes.

7. Video communication device according to one of the preceding claims, characterized in that default image data storage means are provided for storing default image data, and that the image data editing means for

Editing of the current user image data by means of and / or on the basis of the default image data are designed to create edited user image data.

8. Video communication device according to claim 7, characterized in that the default image data storage means include background default image data storage means and / or personal default image data storage means, and that the image data editing means for separating the current user image data at least in the background image data and person image data and replacing the background image data and / or person image data in whole or in part with corresponding background specification image data or person specification image data or for generating edited background image data and / or person image data on the basis of corresponding background specification image data or person specification image data from the corresponding storage devices.

9. Video communication device according to claim 8, characterized in that the default image data storage means or the personal default image data storage means contain image data storage means and / or header image data storage means, and that the image data editing means for separating the personal image data into body image data and header image data and replacing the body image data and / or header image data in whole or in part with corresponding body default image data or header default image data or for generating edited body image data and / or header image data on the basis of corresponding body default image data or header default image data from the respective storage devices.

10. Video communication device according to one of claims 7 to 9, characterized in that in the default image data storage devices, background default image data storage devices and / or personal default image data storage devices or, if applicable, body image data storage devices and / or header image data storage devices, a plurality of background default image data and / or person default image data or, if applicable, body default image data and / or header default image data or a plurality of corresponding sentences or subsets or components thereof, which can be assigned to different editing modes of the image data editing devices.

11. Videokommunikationsvomchtung according to any one of claims 7 to 10, characterized in that the image data editing devices are designed to edit the separated current image data separately from one another and at least substantially simultaneously and then reassemble them to produce edited user image data.

12. Videokommunikationsvomchtung according to any one of the preceding claims, characterized in that by means of the image data editing devices, a cosmetic and / or technical image optimization of user image data depending on an identification result or independently of an identification result and / or possibly before and / or after replacing the background image data and / or person image data or possibly body image data and / or header image data in whole or in part by means of corresponding default image data from the respective default image data storage devices on the Basis of editing algorithms is feasible.

13. Videokommunikationsvomchtung according to any one of the preceding claims, characterized in that the user image data input devices successively in time generate a plurality of current user images, which are each individually one after the other and / or edited according to predetermined rules by means of the image data editing devices.

14. Video communication device according to one of the preceding claims, characterized in that the image data editing devices are designed to separate background image data and / or person image data and, if appropriate, body image data and header image data and, if appropriate, replace them with corresponding default image data from the respective default image data storage devices to execute dynamically in succession for individual user images.

15. Video communication device according to one of the preceding claims, characterized in that the user image data input devices contain at least one camera, and that the image data output devices contain at least one interface to a telecommunications network.

16. Video communication device according to one of the preceding claims, characterized in that user sound data input devices are provided for entering current user sound data, sound data editing devices for creating edited user sound data from the current user sound data, and sound data output devices for outputting user sound data to at least one further communication subscriber .

17. Videokommunikationsvomchtung according to claim 16, characterized in that the edit selection control is designed to cause an output of unedited current or edited user audio data by means of the audio data output devices depending on the identification result of the identification devices.

18. Video communication device according to claim 16 or 17, characterized in that default audio data storage devices are provided for storing default audio data, and that the audio data editing devices are designed for editing the current user audio data by means of and / or on the basis of the default audio data in order to edit edited user audio data create.

19. Video communication device according to one of claims 16 to 18, characterized in that by means of the sound data editing devices a cosmetic and / or technical sound optimization of user sound data as a function of an identification result or independently of an identification result and / or possibly before and / or after editing the current user audio data by means of the default audio data from the default audio data storage devices on the basis of editing algorithms.

20. Videokommunikationsvomchtung according to one of claims 16 to 19, characterized in that identification results of the identification devices are assigned individually or in groups by the user definable editing modes of the sound data editing devices.

21. Videokommunikationsvomchtung according to any one of claims 16 to 20, characterized in that the user sound data input devices contain at least one microphone, and that the sound data output devices contain at least one interface to a telecommunications network.

22. Video communication device according to one of the preceding claims, characterized in that the identification devices contain at least one interface to a telecommunications network.

23. Video communication system, characterized in that contain at least one video communication device according to one of claims 1 to 22 and to one

Telecommunications network is connected or connectable.

24. Video communication method, in which at least one communication subscriber is identified by means of identification devices, current user image data are entered in user image data input devices. an edit selection control passes the current user image data depending on the identification result of the identification devices to image data editing devices or not, the image data editing devices, if they have received the current user image data, generates them or user image data edited therefor, and finally unedited current or, if present, edited user image data are output by means of image data output devices.

25. Video communication method according to claim 24, characterized in that a video communication device according to one of claims 2 to 22 is used and / or operated.

26. Video communication method according to claim 24 or 25, characterized in that image data or image and sound data, in particular in the case of video telephony, are transmitted in an optimized manner by means of image or possibly audio data coming from a video source and possibly an audio source before being transmitted to a Communication partners can be changed on the basis of default image data or, if applicable, default audio data in accordance with at least one predetermined or predeterminable criterion, with the following steps: before communication, a) default image data are created and stored, and b) parameters relating to image data are defined, stored, and the Assigned default image data stored in step a), and during communication c) user image data coming from user image data input devices, in particular a video source, with regard to one or more selected or selectable image data parameters from those defined in step b) n and stored parameters are extracted, d) the user image data from step c) are edited based on the selected image data parameter (s) on the basis of the assigned default image data, and e) the user image data edited in step d) are transmitted to one or more communication partners .

27. Video communication method according to claim 26, characterized in that steps d) and e) are carried out at a central location which is remote from the user, the user image data, the associated default image data and the or the image data parameters are transmitted from the user's location to the central location.

28. Video communication method according to claim 26 or 27, characterized in that steps a) to e) are carried out at the location of a user.

29. Video communication method according to one of claims 26 to 28, characterized in that an additional step f) is provided with which previously stored speech samples of authorized users are compared with a spoken identification phrase of a current user and, if the result of the comparison is positive, a release for an edited one Communication for this user takes place.

30. Video communication method according to claim 29, characterized in that in step f) the stored speech sample is also assigned default image data which belong to a user or have been selected as belonging to him, and the

User is identified based on the saved speech sample and the associated default image data.

31. Video communication method according to claim 29 or 30, characterized in that in step f) a speech analysis of the spoken passphrase and an image analysis of the user image data input devices, in particular the video source, are carried out.

32. Video communication method according to claim 31, characterized in that characteristic facial features of a user are compared with associated or selected default image data in the image analysis.

33. Video communication method according to one of claims 30 to 32, characterized in that the user is identified before execution of step c) as authorized to use stored default image data for audiovisual communication.

34. Video communication method according to one of claims 24 to 33, characterized in that the user image data to be processed or edited and analyzed, the default image data and the edited user image data contain moving images, two-dimensional and three-dimensional image information.

35. Video communication method according to one of claims 24 to 34, characterized in that the user image data to be transmitted are displayed to the user before the transmission.

36. Video communication method according to claim 35, characterized in that the display has an interactive user interface which also shows the selectable and / or selected default image data and the selectable or selected image data parameters.

37. Video communication device for the display-optimized transmission of video and / or audio data according to one of claims 1 to 22 and in particular for carrying out the video communication method according to one of claims 24 to 26, characterized in that the device contains:

- video input and output means (11, 12), - audio input and output means (13),

- Sending and receiving means (14, 15),

- an interface (16) to at least one transmission channel,

an input device (18) for inputting control and command signals,

- Storage devices (20) for storing user and system programs as well as default image data and default sound data, the aforementioned means, devices and components being functionally connected to a processor unit (10) which is set up to interact with the method steps in said means and components.

38. Videokommunikationsvomchtung according to claim 37, characterized in that it further has a with the processor unit (10) in connection interface (17) for connection to a higher-level management unit and / or a higher-level storage medium, in particular with a "personal computer".

39. Use of the video communication device according to one of claims 1 to 22, the video communication system according to claim 23 and the video communication method according to one of claims 24 to 36 for in particular display-optimized transmission of video and / or audio data in telephony, in video conferences or via computer networks.