CZ305294B6 - Video conference environment for communication of remote groups and communication method of remote group in such video conference environment - Google Patents

Abstract

The system of video conference environment for communication of remote groups, according to the present invention, comprises a group camera (1), a group microphone, a loudspeaker (6), a visualization subscriber display (5) and directional subscriber camera (3). A window (7) for displaying stream of group cameras (1) of other rooms and window (9) for displaying a subscriber (4) stream in greater resolution are situated on the visualization subscriber display (5). The system further comprises a side subscriber camera (2). A window (8) for displaying stream of the directional subscriber cameras (3) or the side cameras (2) of other subscribers (4) is also disposed on the visualization subscriber display (5). The window (9) for displaying a subscriber (4) stream in greater resolution is arranged close to the upper edge of the visualization subscriber display (5) and the directional subscriber camera (3), which is fastened on the visualization subscriber display (5), is situated directly above the center of that window (9). The invention also discloses a method of displaying a subscriber of the video conference on the visualization subscriber display (5).

Description

Technical field

The invention relates to a videoconferencing environment which is intended for remote group communication and to a method of communicating remote groups in a videoconferencing environment system.

BACKGROUND OF THE INVENTION

Currently, technologies related to remote group communication are being used both in academia and for commercial use. If the videoconferencing environment is really focused on collaboration between several remote groups, then they are either embedded videoconferencing systems that require a dedicated room (the disadvantage is the need to use special equipment that is expensive, making it inaccessible to many participants and not allowing flexible responses to changes in the number of communicating participants), or Lifesize products, that is, a combination of one monitor and camera for each group. The major disadvantage of Lifesize is that it does not allow eye contact and other non-verbal signals to be transmitted when communicating to remote groups. For the subscriber, this impoverished long-term communication is very demanding for attention (and thus very tiring), there are misunderstandings and problems with fluent speech transfer within the conversation. On the other hand, another known method of communication, the so-called Desktop videoconferencing, assumes only communication between individuals where each participant sits in a different room.

The problem of communication quality and lack of eye contact, which occurs to a greater or lesser extent in the above-mentioned remote group communication systems, is due to the disparity between the viewing of the eyes observed on the display and the location of the observing camera, that videoconference participants tend to communicate and collaborate more with participants within their group at the expense of remote group participants. Currently, this problem is solved in different ways. In US Patent 6,806,898 to Microsoft Corp. describes a system and method for automatically adjusting the view and orientation of a video conference participant's head. A camera and a display device are available to the participant. From the participant's image captured by the camera, a virtual 3D model is created that is computer-modified to give the impression that the participant is looking directly at the communicating partner. This solution does not require additional technical resources, but requires a sophisticated software module that works with the participant's 3D models and is computationally demanding.

Another approach is to use beam splitters (semi-transparent mirrors) to overcome the above drawbacks. A device for use in video conferencing comprising at least one video camera, a display device, and at least one semipermeable curved mirror is disclosed in WO 03101101. A semipermeable mirror illustrates to a subscriber a reflection of a display device, wherein the camera located behind the mirror captures the subscriber's view. For example, a teleconference terminal equipped with a beam splitter described in US 2006181607 is based on a similar principle.

Another approach is disclosed in WO 03069905 describing a device and system for improving the projection of the presence of a remote video conference participant and improving eye contact between the participants during the conference. The remote participant's facial image is displayed on a video monitor that is equipped with a camera positioned at the eye level of the facial image at a distance not exceeding international distance (approximately 1.5 to 3 inches). Furthermore, the device is equipped with a feedback screen, microphone and speaker. Since the camera's distance does not exceed the inter-year distance, the participants seem to look each other in the eye. Said device is intended for communication of individual pairs of participants, but it does not meet the needs of a larger number of communicating participants or their groups. In addition, studies in the field of eye contact transmission (see M. Chen. Leveraging the asymmetric sensitivity of eye contact for videoconference. In CHI '02, pages 49-56, New York, NY, USA, 2002. ACM) show that To transmit eye contact, in all directions, except for the vertical upward direction, the tolerance of the disparity between the image of the eyes observed on the display and the location of the camera that captures the observer is minimal. Only vertically upward from the visualized eyes can the camera be positioned up to approximately 5 ° (angle enclosed by the camera lens, head scanned and visualized by the eye observer) so that the observer still perceives eye contact.

The videoconferencing environment designed for communication of remote groups of participants is described in the article "Videoconferencing design for remote groups" (P. Slovák, E. Hladká and P. Troubil. Videoconferencing design for remote groups. In CollaborateCom 2007, pages 437–441, 2007). The video conferencing environment of this solution includes a group camera, a group speaker, a group (echo-office) microphone, a subscriber visualization display, and a subscriber (sighting) camera where the subscriber visualization display has a window in the upper left corner room, while in the lower part of the subscriber visualization display there is a window for displaying streams from the subscriber cameras of other subscribers and in the upper right corner of the subscriber visualization display is a stream of one of the other subscribers in higher resolution. While this solution provides flexibility in changing the number of participants, it does not allow the transfer of eye contact between the participants, it only provides the opportunity to view, in addition to the views of the communicating groups and their individual users, the closer selected participant of the video conference.

SUMMARY OF THE INVENTION

SUMMARY OF THE INVENTION The object of the invention is an innovative design of a new videoconferencing environment that solves communication between several smaller groups. The design of the videoconferencing environment is based on high flexibility of the environment (the possibility of changing the number of participants also during the conference) and low technological demands. The proposed videoconferencing environment improves the communication quality of remote groups of participants by allowing the transmission of eye contact and other non-verbal signals. Furthermore, the environment gives individual participants an overview of which communicating participants are actively monitored during the discussion, which further enhances the quality of communication within the videoconference.

The above-mentioned shortcomings eliminate the videoconferencing environment for remote group communication and include a group camera, a group microphone and a loudspeaker, a visualization subscriber display and a sighting subscriber, where a visualization subscriber display has a window for viewing group camera streams from other rooms. higher resolution subscriber streams, wherein the videoconferencing environment further includes a side subscriber camera, and a subscriber's visualization display is further provided with a window for displaying streams from other subscriber sights or side cameras, and it is important that the subscriber streams display window in higher resolution was as close as possible to the upper edge of the visualization display of the subscriber and the sighting subscriber camera, which is on the visualization was placed directly above the center of this window, and for all videoconference participants from all remote groups the choice between displaying streams from sights or side cameras on their visualization subscriber displays is that if the first videoconference participant has the selected second participant displayed in their window to display the subscriber's streams in higher resolution, then the second subscriber displays the stream from the first subscriber on the visual subscriber display from the first subscriber, either in the view stream of the other subscriber sights or side cameras or in the view stream of the subscriber in higher resolution if the first participant is viewed by the second participant at a higher resolution, while all other participants are shown on the visual participant display from the first participant subscriber cameras, whether

-2GB 305294 B6 already in the window for displaying streams from other participants' sights or side cameras, or in the window for displaying the subscriber's stream in higher resolution, if the first participant is viewed by the second subscriber in higher resolution.

Furthermore, it relates to a method of communicating remote groups in a videoconferencing system system, the principle being that for all videoconferencing participants from all remote groups, the choice between displaying streams from sights or side cameras on their visualization subscriber displays is that if the first participant has a videoconference of the selected second participant displayed in its window to display the participant's streams at a higher resolution, then displays the second participant's stream from the first viewer on the visualization display from the first participant, whether in the viewer or other viewers' streams higher-resolution subscriber stream if the first subscriber is followed by the higher subscriber in higher resolution, while all other subscribers are shown on the visual subscriber m display from the first participant stream from subscriber side cameras whether the window display targeting streams from cameras or camera side the other participants, or in the window to display the stream participant in a higher resolution, if the first party to the other party pursued higher resolution.

If there is communication between more than two remote groups of participants, then it is preferable that the window for displaying streams from group cameras from other rooms is divided into smaller windows to display all group streams simultaneously.

Advantageously, the videoconferencing environment may also include a projection screen or other visualization device that is shared by the whole group for displaying presentations or other documents or materials.

The essence of the invention is the recommendation of how the videoconference participants should be captured and displayed, so it is mainly the deployment of cameras depending on the layout of visualization subscriber displays depicting remote subscribers and the content being projected on the displays.

For all videoconferencing participants from all remote groups, the same rules apply to the choice between displaying streams from sights or side cameras on their visual displays. If the first participant of the videoconference selected the second participant displayed in its display window to display the participant's stream at a higher resolution, then the second participant displays the sight from the first participant on the visual participant display from the first participant or in the window for displaying the subscriber's streams in higher resolution if the first subscriber is followed by the higher subscriber). All other subscribers are displayed on the visual subscriber display from the first subscriber stream from the side subscriber camera (either in the viewer window of the other subscriber sights or side cameras or in the subscriber stream display window in higher resolution).

In a particular embodiment, individual streams from users displayed in the window for displaying streams from the sights or side cameras of other subscribers may be re-orderable, e.g., using the mouse, according to the subscriber's individual needs. Depending on specific requirements, the video conferencing environment can also be set so that in the window for displaying streams from other participants' sights or side cameras, the subscriber has the option of displaying a selected stream from one of their subscriber cameras or temporarily bring up a new window displaying these streams from their subscriber cameras on the visualization display, e.g. using a predefined hotkey. In a particular embodiment, the window for displaying streams from the sights or side cameras of the other subscribers may be replaced by separate windows displaying the individual streams of the other subscribers.

-3 CZ 305294 B6

As for the subscriber selection mechanism whose stream will be displayed in the subscriber stream display window at a higher resolution, this can advantageously be done, for example, by clicking the respective subscriber stream in the viewer stream window of the other subscribers. The system can also offer a way to not display any stream in the higher-resolution viewer of the attendee's stream if the attendee of the video conference does not want to focus on anyone.

Compared to standard environments, the advantage of this solution is a new concept of videoconferencing environment allowing partial transmission of eye contact, other non-verbal signals and information to individual participants about which communicating participants are actively monitored during the discussion, which at the same time remains completely unpretentious. It also enables simple changes in the number of conference participants even during the conference.

This makes it possible to build a new videoconferencing environment with affordable and affordable means, based on high flexibility (possibility of changing the number of participants during the conference) and low technological demands, which makes it suitable for teams that need to communicate with each other for short financial resources (and thus it is not worth investing in a built-in videoconferencing system), or where the structure of individual remote groups changes frequently and quickly (and therefore requires great flexibility from the videoconferencing environment used) while significantly improving communication quality.

The advantage is that, compared to other designs of videoconferencing environments designed for the transmission of eye contact and other non-verbal signals, our solution differs in the technical demands of the resulting implementation - in our case only two webcams per participant, one group camera, echo-office are required. a microphone and loudspeaker for each room (under the fairly reasonable assumption that participants have their own laptops or computers); other designs include complex structures that must be fixed in rooms and support a fixed number of videoconferencing participants.

Clarification of drawings

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 shows the layout of communication means in a room;

DETAILED DESCRIPTION OF THE INVENTION

The proposed videoconferencing environment connects several mutually distant groups that communicate through it. Participants 4 in each of the communicating groups share one room and, to some extent, videoconferencing equipment. This equipment includes a visualization subscriber display 5, with a sighting subscriber camera 3 and a side subscriber camera 2, which is arranged to the left of the visualization subscriber display 5. In the conference room space there is also a group camera 1, a group microphone and a speaker 6.

An exemplary arrangement of subscribers 4 and apparatuses within each of these rooms is shown in FIG. 1. The arrangement of subscribers 4 and equipment in each of the communicating rooms is illustrative. Each subscriber 4 has in front of him one visualization subscriber display 5, for example a laptop monitor, on which is mounted one sight subscriber camera 3, the so-called focus camera. The side subscriber camera 2 is then positioned such that it occupies the subscriber 4 from a side view, for example, lying on a table next to the monitor. The group camera 1 occupies all participants 4 in the room. An optional projection screen or other visualization device that is shared by the whole group is not shown in FIG.

-4GB 305294 B6

The proposed image layout on the visualization subscriber displays 5 is shown in Fig. 2, where streams from the aforementioned cameras 1 or 2 or 3 are distributed.

1. In the upper left corner of the visualization subscriber display 5 (indicated by the word group) there is a window 7 for displaying streams from group cameras and from other rooms; if communication is between more than two rooms, this window 7 is divided so that all streams are visible at the same time;

2. at the bottom of the visualization subscriber display 5 is a window 8 for displaying streams from the sights 3 or the side cameras 2 of the other participants 4 (one stream for each of them, the method of selecting the streams is described in the next paragraph);

3. in the upper right corner of the visualization subscriber display 5 there is a window 9 for displaying subscriber 4 streams, which allows subscribers 4 to watch the desired subscriber 4 stream at a higher resolution (entirely of their choice and independently of others) the window 9 is as close as possible to the upper edge of the visualization subscriber display 5 and for the sighting subscriber camera 3, which is mounted on the visualization subscriber display 5, to be directly above the center of this window 9.

The system informs subscriber 4 which of the other subscribers 4 is watching it in higher resolution by selecting streams from the subscriber's appropriate camera 3. From those subscribers 4 watching it, the visualization subscriber display 5, whether in window 8 for displaying streams from sighting cameras 3 or side cameras 2, or even in window 9 for displaying streams of subscriber 4, if the subscriber is being monitored in higher resolution, the stream from the focus camera 3 is shown - in this case it is subscribers A, C and F, while subscriber A is also viewed in higher resolution; from the others, the subscriber 4 receives an image from the side subscriber camera 2.

The method of communication of remote groups in a videoconferencing environment system is based on the following condition. For all videoconferencing participants 4 for all remote groups, the choice between displaying streams behind the aiming cameras 3 or side cameras 2 on their visualization subscriber displays 5 is that if the first videoconference participant 4 of the selected second participant 4 displayed in its participant stream display window 9 4 in higher resolution, then the second participant 4 is shown on the visualization subscriber display 5, from the first participant 4 a stream from the sighting camera 3, whether in window 8 for displaying streams from the sighting or side cameras 3 and 2 of other participants, or in window 9 to display the streams of the subscriber 4 at a higher resolution if the first subscriber 4 is viewed by the second subscriber 4 at a higher resolution, while all other subscribers 4 are shown on the visual subscriber display 5 from the first subscriber 4 a side subscriber stream 2, whether in the window 8 for displaying streams from the sights or side cameras 3 and 2 of the other participants 4, or in the window 9 for displaying streams of the subscriber 4 in higher resolution if the first subscriber 4 is monitored by the second subscriber 4 in higher resolution.

Industrial applicability

The videoconferencing environment for remote group communication is particularly useful for teams who want a flexible and technologically accessible videoconferencing environment and are not worth investing in videoconferencing systems that require a dedicated room.

Claims (2)

PATENT CLAIMS A video conferencing environment for remote group communication comprising a group camera (1), a group microphone and a speaker (6), a visualization subscriber display (5) and a sighting subscriber camera (3), wherein the visualization subscriber display (5) is located a window (7) for displaying streams from group cameras (1) from other rooms and a window (9) for displaying the stream of the subscriber (4) in a higher resolution, characterized in that the videoconferencing environment further comprises a side subscriber camera (2) and further, a window (8) for displaying streams from the sights (3) or side cameras (2) of the other subscribers (4) is located in the subscriber display (5), it being important that the window (9) for displaying the subscriber's stream (4) higher resolution was as close as possible to the upper edge of the visualization subscriber display (5) and to the aiming subscriber camera (3), which is and fixed to the visualization subscriber display (5), is located directly above the center of the window (9), and for all videoconferencing participants (4) from all remote groups it is the choice between displaying streams from sights or side cameras on their visualization subscriber displays (5). ) that if the first participant (4) of the videoconferencing has selected the second participant (4) displayed in its window (9) to display the participant's stream in higher resolution, then it is displayed to the second participant (4) on the visualization participant display (5) from the subscriber (4) stream from the ranging camera, either in the window (8) to display the streams from the sights or side cameras of the other subscribers, or in the window (9) to display the subscriber's stream in higher resolution when the first subscriber (4) is the second by the subscriber (4) in higher resolution while all the other subscriber In the visualization subscriber display (5) from the first subscriber (4), a stream from the side subscriber camera is displayed, whether in a window (8) for displaying streams from the sights or side cameras of other subscribers, or displaying the subscriber's stream in higher resolution when the first subscriber (4) is followed by the higher subscriber (4) in higher resolution. Video conferencing environment for remote group communication according to claim 1, characterized in that, for communication between more than two rooms, the window (7) for displaying streams from group cameras (1) from other rooms is divided into smaller windows for displaying all group groups. streams simultaneously. The videoconferencing environment for remote group communication, according to claim 1 or 2, further comprising a projection screen or other visualization device shared by the whole group. Method of communicating remote groups in a videoconferencing system system according to any one of claims 1 to 3, characterized in that for all videoconferencing participants (4) from all remote groups it is valid for the choice between displaying streams from sighting or side cameras (2 and 3). on their visualization subscriber displays (5) that if the first participant (4) of the videoconference has the selected second subscriber (4) displayed in its window (9) to display the subscriber's streams in higher resolution, then the second subscriber (4) is displayed on the visualization a display (5) from the first subscriber (4) a stream from the sighting camera (3), whether in a window (8) to display streams from the sights or side cameras (2 and 3) of other participants, or in a window (9) to display the stream higher resolution subscriber if the first subscriber (4) is followed by the higher subscriber (4) in higher resolution, whereas all other subscribers (4) are shown on the visual subscriber display (5) from the first subscriber (4) a stream from the side-by-side camera (2) whether in the window (8) to display streams from the sights or side cameras (2 and 3) ) of other subscribers, or in a window (9) for displaying the subscriber stream (4) in higher resolution if the first subscriber (4) is followed by the second subscriber (4) in higher resolution. 2 drawings