CZ2009361A3 - Video-conference setting system for communication of remote groups and method of using thereof for communication of remote groups - Google Patents

Abstract

The videoconferencing environment system for remote groups includes a group camera (1), a group microphone, a speaker (6), a visualization attendance display (5), and a focusing participant camera (3). On the visualization display (5), a window (7) for displaying the stream from the group cameras (1) from the other rooms and a window (9) for displaying the subscriber stream (4) is located in a higher resolution. The system further includes a side attendant camera (2). Furthermore, a window (8) for displaying the stream from the focusing cameras (3) or side cameras (2) of the other participants (4) is located on the visualization display (5). The higher resolution stream display window (9) is arranged at the top of the visualization display (5), and the focusing view camera (3), which is mounted on the visualization display (5), is located directly above the center of this view windows (9). The invention further provides a method for displaying a video conference participant on a subscriber display (5).

Description

VIDEO CONFERENCE SYSTEM FOR COMMUNICATION

REMOTE GROUPS AND METHOD OF ITS USE FOR COMMUNICATION

REMOTE GROUPS

Technical field

The invention relates to a videoconferencing environment system for communicating remote groups, comprising a group camera, a group microphone and a loudspeaker, a visualization subscriber display and a sighting subscriber, wherein a visualization subscriber display is provided with a window for displaying streams from group cameras from other rooms and a window to display the participant's stream in higher resolution and how to use it for communication.

BACKGROUND OF THE INVENTION

Currently, technologies related to remote group communication are being used both in academia and for commercial use. If the videoconferencing environment is really focused on collaboration between several remote groups, then they are either embedded videoconferencing systems that require a dedicated room (the disadvantage is the need to use special equipment that is expensive, making it inaccessible to many participants and not allowing flexible responses to changes in the number of communicating participants.) or Lifesize products, that is, a combination of one monitor and camera for each group. The major disadvantage of Lifesize is that it does not allow eye contact and other non-verbal signals to be transmitted when communicating to remote groups. For the subscriber, this impoverished long-term communication is very demanding for attention (and thus very tiring), there are misunderstandings and problems with fluent speech transfer within the conversation. On the other hand, another known method of communication, the so-called Desktop videoconferencing, assumes only communication between individuals where each participant sits in a different room.

* · · ····· · · · · · · · · · · · · · · · ·

2 ♦ · 9 9 9 * * ““

The problem of communication quality and lack of eye contact, which occurs to a greater or lesser extent in the above-mentioned remote group communication systems, is due to the disparity between the viewing of the eyes observed on the display and the location of the observing camera. videoconferencing participants tend to communicate and collaborate more with participants within their group at the expense of remote group participants. Currently, this problem is solved in different ways. In US Patent 6,806,898 to Microsoft Corp. describes a system and method for automatically adapting the view and orientation of a video conference participant's head. A camera and a display device are available to the participant. From the participant's image captured by the camera, a virtual 3D model is created that is computer-modified to give the impression that the participant is looking directly at the communicating partner. This solution does not require additional technical resources, but requires a sophisticated software module that works with the participant's 3D models and is computationally demanding.

Another approach is to use beam splitters (semi-transparent mirrors) to overcome the above drawbacks. A device for use in videoconferencing comprising at least one video camera, an imaging device, and at least one semipermeable curved mirror is described in WO003101101. The semipermeable mirror shows a reflection of the display device to the subscriber, while the camera located behind the mirror captures the subscriber's view. For example, a teleconference terminal equipped with a beam splitter is also based on a similar principle described in US2006181607. This approach requires video conferencing participants to acquire and install said beam splitters, which has a negative effect on flexibility in the variable number of video conference participants.

Another approach is disclosed in WO03069905 describing a device and system for improving the projection of the presence of a remote video conference participant and improving eye contact between the participants during the conference. The remote participant's facial image is displayed on a video monitor that is equipped with a camera positioned at the eye level of the facial image at a distance not exceeding international distance (approximately 1.5 to 3 inches). Furthermore, the device is equipped with a feedback screen, microphone and speaker. Since the camera distance does not exceed the inter-year distance, participants appear to be facing each other's eyes. Said device is intended for communication of individual pairs of participants, but does not meet the needs of a larger number of communicating participants or their groups. In addition, research in the field of eye contact transmission (see M. Chen. Leveraging the asymmetric sensitivity of eye contact for videoconference. In CHI Ό 2, pages 49-56, New York, NY, USA, 2002. ACM) suggests that The eye contact is that in all directions, except for the vertical upward direction, the tolerance of the disparity between the image of the eyes observed on the display and the location of the camera that captures the observer is minimal. Only vertically upward from the visualized eyes can the camera be positioned up to approximately 5 ° (the angle enclosed by the camera lens, head scanned and visualized by the participant observing the presence / absence of eye contact) so that the observer can still perceive eye contact.

A videoconferencing environment designed for communication of remote groups of participants is described in the article "Videoconferencing design for remote groups" (P. Slovák, E. Hladká and P. Troubil. Videoconferencing design for remote groups. In CollaborateCom 2007, pages 437-441, 2007). The video conferencing environment of the present invention includes a group camera, a group speaker, a group (echocance) microphone, a subscriber visualization display, and a subscriber (sighting) camera, where the subscriber visualization display has a window in the upper left corner while at the bottom of the subscriber visualization display there is a window for displaying streams from the subscriber cameras of the other subscribers, and in the upper right corner of the subscriber visualization display is a stream of some of the other subscribers in a higher resolution. While this solution provides flexibility in changing the number of participants, it does not allow the transfer of eye contact between the participants, it only provides the opportunity to view, in addition to the views of the communicating groups and their individual users, the closer selected participant of the videoconference.

US Patent No. 7,515,174 B1 discloses a videoconferencing system between distant parties that provides the right view and eye contact between all participants. It is known from the description that there are cameras and monitors in which one display is located in the room for each remote subscriber; and on each display there are as many cameras as there are distant participants in the center.

• a and a ♦ «· ♦ **

9 · · a a a a a a a a a a a a a a a a a

The disadvantage of this system is, in particular, the improper scaling of the number of cameras as the number of subscribers increases, since n2 cameras are always required, where n is the number of remote subscribers. Thus, when communicating eg two groups of three people, this system requires (32) x2 = 18 cameras; if it is a communication between two groups of five people then 50 cameras are needed. The proposed system requires only 12 resp. 20 cameras for the respective variants.

Another significant disadvantage is the need to use displays that are capable of displaying several different images at the same time, depending on the angle we look at them. These displays are not commonly available and are also very expensive. The proposed system does not have specific requirements for displays, it is possible to use any display device (eg laptop screen).

Another U.S. Patent No. 5,500,671 discloses a videoconferencing system that provides eye contact and sensory presence to many conference participants located in a conference room. Each conference room comprises at least one video phone or communication device that includes a video camera for generating video signals indicating a sequence of images of local conference participants and an image receiver for displaying local conference participants. The video receiver, video camera, and participant eyes define the viewing angle which is then adjusted, before being displayed to other subscribers, by the image captured by the video camera.

The disadvantage of this system is that the principle of eye contact support is based on extensive manipulation of acquired video streams - for each frame it is necessary to first identify the position of the head software and then change the captured image so that the head / eye direction is correct. This is not only problematic in terms of computational complexity, but also necessarily generates at least partial unnatural images of the participants. Our proposed solution does not require manipulation with image data, it uses camera streams as they were captured, thus avoiding both mentioned shortcomings.

U.S. Pat. No. 4,965,819 discloses a conference system facilitating interactive audio and video communication between the accused and the witness and the tribunal during the trial. Preferably, the system comprises a recording device for producing continuous combined video and audio recordings.

Although the above-mentioned system shares an element of displaying images from multiple camcorders on a single display, it still solves a completely different situation than that for which our solution is specified. In particular, it inherently involves a certain hierarchy and inequality between different types of rooms: a local room - for the tribunal, ie more people, control elements; remote room - only for the accused / witness, ie specified for only one person, without checking the display changes). It is not so suitable (nor easily editable) for the needs of team communication, which is our solution.

PCT Application No. WO 2007/140459 discloses a system for interconnecting multiple rooms such that displaying images from individual rooms corresponds to a virtual spacing around one large table. The principal disadvantage of this solution is in particular that it does not support eye contact between individuals from distant groups. Furthermore, this system is not flexible enough, because the number of displays and cameras in each room is clearly dependent on the number of communicating places, thus, compared to the proposed solution, adding a new room to the video conference may need to physically modify the system in all other rooms.

SUMMARY OF THE INVENTION

SUMMARY OF THE INVENTION The object of the invention is an innovative design of a new videoconferencing environment that solves communication between several smaller groups.

In the most general sense, environment is understood to mean the (unique) communication channel created by a videoconferencing system (ie, a plurality of cameras, screens described in this invention, a program determining which streams are displayed where, deploying future users, etc.).

The above-mentioned shortcomings are overcome by a videoconferencing environment system designed for remote group communication, which includes a group camera, a group microphone and a loudspeaker, a visualization subscriber display and a sighting subscriber, where a visualization subscriber display has a group camera stream window. from other rooms and a window for displaying the subscriber's stream in a higher resolution, the principle being that it further comprises a side subscriber camera, and on the visualization subscriber display there is also a display window streams from the sights of the other participants, the window for displaying the subscriber's stream of higher resolution is arranged at the upper edge of the visualization subscriber display and the sighting subscriber camera, which is for visualization it fixed subscriber display is placed directly over the center of the window.

It further relates to a method of using a videoconferencing environment system for remote group communication, the principle being that for all videoconferencing participants from all remote groups, the choice between displaying streams from sights or side cameras on their visualization subscriber displays is that if the first subscriber has video conferencing of the selected second participant displayed in its window for displaying the participant's stream at a higher resolution, then the second participant is shown on the visual participant display from the first participant a stream from the sighting camera, whether in the viewer streaming window of the other participants; a window for displaying the participant's stream in higher resolution if the first participant is followed by the second participant in higher resolution, while all other participants a visual subscriber display from the first subscriber stream from the side subscriber camera, either in the viewer window of the other subscriber sights or side cameras, or in the subscriber stream display window in higher resolution when the first subscriber is viewed by the second subscriber in higher resolution.

If there is communication between more than two remote subscriber groups, then it is preferable that the window for displaying streams from group cameras from other rooms is divided into smaller windows to display all group streams simultaneously.

Advantageously, the videoconferencing environment may also include a projection screen or other visualization device that is shared by the whole group for displaying presentations or other documents or materials.

The present invention is based on a recommendation of how video conferencing participants are to be captured and imaged, so it is predominantly the deployment of cameras depending on the deployment of visualization subscriber displays depicting remote subscribers and, in particular, the content projected on the displays.

For all videoconferencing participants from all remote groups, the same rules apply to the choice between displaying streams from sights or side cameras on their visual displays. If the first participant of the videoconference selected the second participant displayed in its display window to display the participant's stream at a higher resolution, then the second participant displays the sight from the first participant on the visual participant display from the first participant attendees, or in the viewer to view the participant's stream in higher resolution if the first participant is tracked in the higher participant). All other subscribers are displayed on the visual subscriber display from the first subscriber stream from the side subscriber camera (either in the viewer window of the other subscriber sights or side cameras or in the subscriber stream display window in higher resolution).

In a particular embodiment, individual streams from users displayed in the window for displaying streams from the sights or side cameras of other subscribers may be re-orderable, e.g., by mouse, according to the subscriber's individual needs. Depending on specific requirements, the video conferencing environment can also be set so that in the window for displaying streams from other participants' sights or side cameras, the subscriber has the option of displaying a selected stream from one of their subscriber cameras or temporarily bring up a new window displaying these streams from their subscriber cameras on the visualization display, e.g. using a predefined hotkey. In a particular embodiment, the window for displaying streams from the sights or side cameras of the other subscribers may be replaced by separate windows displaying the individual streams of the other subscribers.

As for the subscriber selection mechanism whose stream will be displayed in the subscriber stream display window at a higher resolution, this can advantageously be done, for example, by clicking the respective subscriber stream in the viewer stream window of the other subscribers. The system can also offer a way to not display any stream in the higher-resolution viewer of the attendee's stream if the attendee of the video conference does not want to focus on anyone.

··· · 4 ··· · ··

A · ♦ <<<<<* * * *

8 · · · Α · Α · Α · Α · · · · · · · · · · · ·

Compared to standard environments, the advantage of this solution is a new concept of videoconferencing environment allowing partial transmission of eye contact, other non-verbal signals and information to individual participants about which communicating participants are actively monitored during the discussion, but at the same time remains completely unpretentious. It also enables simple changes in the number of conference participants even during the conference.

This makes it possible to build a new videoconferencing environment with affordable and affordable means, which is based on high flexibility (the possibility of changing the number of participants during the conference) and low technological demands, which makes it suitable for teams that need to communicate with each other financial resources (and thus it is not worth investing in a built-in videoconferencing system), or where the structure of individual remote groups changes frequently and quickly (and therefore require great flexibility from the videoconferencing environment used) while significantly improving communication quality.

The advantage is that, compared to other designs of videoconferencing environments designed for the transmission of eye contact and other non-verbal signals, our solution differs in the technical demands of the resulting implementation - in our case only two webcams per participant, one group camera, echo-office a microphone and loudspeaker for each room (under the fairly reasonable assumption that participants have their own laptops or computers); other designs include complex structures that must be fixed in rooms and support a fixed number of videoconferencing participants.

BRIEF DESCRIPTION OF THE DRAWINGS

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 shows the layout of communication means in a room; FIG. 2 shows a view of a visualization subscriber display.

DETAILED DESCRIPTION OF THE INVENTION

The proposed videoconferencing environment system connects several mutually distant groups that communicate through it. Participants 4 in each of the communicating groups share one room and, to some extent, videoconferencing equipment. This equipment includes a visualization subscriber display 5, with a sighting subscriber camera 3 and a side subscriber camera 2, which is arranged to the left of the visualization subscriber display 5. In the conference room space there is also a group camera 1, a group microphone and a speaker 6.

An exemplary arrangement of subscribers 4 and apparatuses within each of these rooms is shown in FIG. 1. The arrangement of subscribers 4 and equipment in each of the communicating rooms is illustrative. Each subscriber 4 has in front of him one visualization subscriber display 5, for example a laptop monitor, on which is mounted one sight subscriber camera 3, the so-called focus camera. The side subscriber camera 2 is then positioned in such a way as to occupy the subscriber 4 from a side view, e.g. The group camera 1 occupies all participants 4 in the room. An optional projection screen or other visualization device that is shared by the whole group is not shown in FIG.

The proposed image layout on the visualization subscriber displays 5 is shown in Fig. 2, where streams from the aforementioned cameras 1 or 2 or 3 are distributed.

1. In the upper left corner of the visualization subscriber display 5 (indicated by the word group) there is a window 7 for displaying streams from group cameras 1 from other rooms; if communication is between more than two rooms, this window 7 is divided so that all streams are visible at the same time;

2. at the bottom of the visualization subscriber display 5 is a window 8 for displaying streams from the sights 3 or the side cameras 2 of the other participants 4 (one stream for each of them, the method of selecting the streams is described in the next paragraph);

3. in the upper right corner of the visualization subscriber display 5 there is a window 9 for displaying subscriber 4 streams, which allows subscribers 4 to watch the desired subscriber 4 stream at a higher resolution (entirely of their choice and independently of others) the window 9 is as close as possible to the upper edge of the visualization subscriber display 5 and for the sighting subscriber camera 3, which is mounted on the visualization subscriber display 5, to be directly above the center of this window 9.

The system informs the subscriber 4 which of the other subscribers 4 is watching it at a higher resolution by selecting a stream from the subscriber's appropriate camera 3. From those subscribers 4 watching it, the visualization subscriber display 5, whether in the window 8 for displaying streams from the sights 3 or the side cameras 2, or even in the window 9 for displaying the subscriber's stream 4, if the subscriber is being monitored in higher resolution, the stream from the focus camera 3 is shown - in this case it is subscribers A, C and F, while subscriber A is also viewed in higher resolution; from the others, the subscriber 4 receives an image from the side subscriber camera 2

The method of using a videoconferencing environment for remote group communication is based on the following condition. For all videoconferencing participants 4 from all remote groups, the choice between displaying streams from sighting cameras 2 or side cameras 3 on their visualization subscriber displays 5 is that if the first videoconference participant 4 has a selected second participant 4 displayed in its stream display window 9 of the subscriber in higher resolution, then the second subscriber 4 is shown on the visualization subscriber display 5 from the first subscriber 4 a stream from the aiming camera, whether in window 8 to view streams from the sights or side cameras of other participants, or higher resolution when the first subscriber 4 is viewed by the second subscriber 4 in higher resolution, while all other subscribers 4 are shown on the visual subscriber display 5 from the first subscriber 4 a stream from the side subscriber camera, in the window 8 for displaying streams from the sights or side cameras of the other subscribers, or in the window 9 for displaying the subscriber's stream in higher resolution if the first subscriber 4 is monitored by the second subscriber 4 in higher resolution.

Industrial Applicability 4 · 4 4 4 · * * * * * 4 * * 4 * * 4 * 4 4 * * * * * * * * * *

The videoconferencing environment for remote group communication is particularly useful for teams who want a flexible and technologically accessible videoconferencing environment and are not worth investing in videoconferencing systems that require a dedicated room.

Claims (4)

A videoconferencing environment system for remote group communication comprising a group camera (1), a group microphone and a speaker (6), a visualization subscriber display (5) and a sighting subscriber camera (3), wherein the visualization subscriber display (5) includes a window (7) for displaying streams from the group cameras (1) from other rooms and a window (9) for displaying the stream of the subscriber (4) in higher resolution, characterized in that it further comprises a side subscriber camera (2); a display (5) further comprising a window (8) for displaying streams from the sights (3) or side cameras (2) of the other subscribers (4), the window (9) for displaying the higher resolution subscriber (4) stream at the top edge of the visualization subscriber display (5) and the sighting subscriber camera (3) that is on the visualization subscriber display is mounted directly above the center of the window (9). The videoconferencing environment system for remote group communication according to claim 1, characterized in that for communication that takes place between more than two rooms, the window (7) for displaying streams from group cameras (1) from other rooms is divided into smaller windows to view all group streams simultaneously. The videoconferencing environment system for remote group communication, according to claim 1 or 2, further comprising a projection screen or other visualization device shared by the whole group. A method of using a videoconferencing environment system for remote group communication, characterized in that for all videoconferencing participants (4) from all remote groups it is applicable to the choice between displaying streams from sights or side cameras (2 and 3) on their visualization subscriber displays (4). 5) that if the first participant (4) of the videoconferencing has selected the second participant (4) displayed in its window (9) to display the participant's stream in higher resolution, then the second participant (4) is displayed on the visualization participant display (5) from the first subscriber (4) stream from the ranging camera, either in the window (8) to view the streams from the other participants' sights or side cameras, or in the window (9) to display the subscriber's stream in higher resolution if the first subscriber (4) the other participant (4) followed in higher resolution while everyone else In the visualization subscriber display (5) of the first subscriber (4), a stream from the side subscriber camera is displayed, either in the window (8) for displaying streams from the other subscriber sights or side cameras or in the window (9) for displaying a subscriber stream at a higher resolution when the first subscriber (4) is monitored by the second subscriber (4) at a higher resolution.