GB2484944A

GB2484944A - Mimic video conference meeting place

Info

Publication number: GB2484944A
Application number: GB201018093A
Authority: GB
Inventors: David Roger Sherriff; David Alec Robertson
Original assignee: Individual
Current assignee: Individual
Priority date: 2010-10-27
Filing date: 2010-10-27
Publication date: 2012-05-02
Also published as: GB201018093D0

Abstract

A meeting place for video conferencing comprising two locations, where each location has two or more positions, each for occupation by a single person. The arrangement is normally for two pairs of positions, where there is one pair of positions 10, and another pair of positions at a remote location 11, so that each person occupying a position can hold a conversation in the direct presence of one person, and with two other people by sight and by sound using video conferencing technology comprising display screens, microphones, loudspeakers and cameras plus associated equipment for video conferencing. The arrangement is normally set around a table 59 with seated positions for two people 10, with three display screens, two being standard screens 13 and one is a stereo display screen 14 where the stereo display screen provides two distinctly different images on one screen each towards the two positions 10 respectively. In a remote location there is a mimic of the arrangement. For the arrangement at one location and the arrangement at the remote location there is at least one display screen, display screen defined in the widest sense e.g. electronic screen, projection, curved display, mannequin shaped display surface, and the like, that provides two or more, distinct video images that occupy the same area where each image is designed for viewing at the said positions to mimic in time and space a person or object at the remote location.

Description

t V.' INTELLECTUAL ..* PROPERTY OFFICE Application No. GB 1018093.3 RTIVI Date 7 July 2011 The following term is a registered trademark and should be read as such wherever it occurs in this document: Bluetooth Intellectual Properly Office is an operating name of the Patent Office www.ipo.gov.uk

MMIC VDEO CONFERENCE MEETNG PLACE

BACKGROUND

The present invention relates to a general arrangement known as a video conference. A videoconference or video conference (also known as a videoteleconference and a videophone call) is a set of nteractwe telecommunication technologies whch allow persons in two or more locations to interact via two-way video and audio transmissions simultaneously R has also been called visual coliaboraton'. This can he as simpie as a conversation between two people in private places (point-to-point) or involve several places (multi-point) with more than one person in large rooms at different sites.

The general arrangement of a video conference by way of example comprises at least one video camera in each location that acquires images and audio of a person or persons facing a screen at each location. VVhilst persons at remote locations involved do achieve some intimacy in communication, this intimacy is limited by the general arrangement of the technology. One limitation by way of example, accurate eye contact of persons is not possible due to makaiignment of eyes and cameras.

The invention described herein overcomes some problems of intimacy in current arrangements by improvements in the general arrangement.

THE INVENTION

The present invention relates to a general arrangement known as a video conference, For the purposes of the ensuing descriptions the term video conferencing session' is understood to comprise of a person at a first remote location and another person at a second remote location, whereby video comprising of moving pictures and audio of the first person is displayed to the second person and vice-versa in real time, Each person communicatng has a camera directed on them producing moving images normally comprising of the head and shoulders, with a microphone recording their voice, a viewing screen in front of them and loudspeakers or headphones for hearing. People can have several video conferencing sessions' in progress either by showing different people on different screens or by switching between people showng on the same screen. Telecommunications provide two-.way electronic communication for two or more remote sites for a video conferencing session' normally via the Internet, ntranet, area computer network or any other computer based electronic transmissions. Secondary components for a video conferencing session' include controlled lighting, backdrops, sound echo reduction, and speech synthesis for real time language translation and sub-titling.

Forthe purposes of the ensuing descriptions the words display screen will he used forthwith to mean any audo-visuai electronic display, using all type.s of display technologies, including by way of example; computer monitors, televisions, electronic screens, projections, headup displays, visual display unit, half mirrored screens, stereoscopic displays and holographic displays for three dimensionai viewing. Some display screens have a containing box, frame or edge for which the development tendency is to progressively minimise. Display screens showing different images can become integrated on what becomes a single extendmg integrated surface. By way display screen' surfaces can be fiat or curved in two and three dimensions, and by way of example, can be a glass sheetfor images to be integrated into or projected upon showing different images become integrated on what becomes a single extending surface.

Further to the use of the term dispiay screen', is a stereo display screen', which can show two different images at two distinct viewing angles using image splitting technoiogy, such as by Nay of example of these technoiogies include auto stereoscopic monitor technologies adapted for viewng the two images at approximately 90 degrees separation in viewing angles, and lenticular, micro directional louvers and LCD shutters.

In the preferred invention the display screen has a muitiplicity of stepped surfaces small enough to he undetectable at normal viewing angles by the human eye, one surface direction facing towards the first position and the other facing towards the second position in the pairs of positions, whereby the matrix of colour LCD or LED pixels covers each stepped surface to build two distinct display screen surfaces of which only one can be seen relative to the viewing angle associated with each position.

The viewing of images on the centrai display screen require in some situations that programmed distortion be applied to the images as they are viewed from an angle and need compensation to make the image iook undistorted relative to the viewing angie.

For the purposes of the ensuing descriptions the word position'will he used forthwith to mean a place for a person or object not being a person. This position' may not necessarily be occupied, or alternatively two or more peopie may squeeze into one position, there may he a mother and child in the same position', the position' may be occupied by one or more animals normally as pets with or without humans. The postion' n physical extents wouid normally be occupied by a person's head, neck and shoulders but the position' may extend or contain any part or all of a human body an animal body, a mannequin of all sizes and shapes, or a robotic body. In addition the position' may contain objects such as an item for sale or a sculpture to admire, or people with objects like a person playing an instrument and a band of four musicians piaying their instruments.

In the present invention, the preferred posiUon is that there are two positions situated opposite each other in close proximity at distances normally associated with conversation around a table, and there are a further two positions situated opposite each other in similar proximity in a remote location, the two pairs of positions being connected by four video conferencing sessions to make it appear that there are four positions in a virtual square arrangement according to the perception of the occupiers of the positions, thus for each of the positions a person is real communication with one other position being in their presence plus in telecommunication via two video conferendng sessions with another two positions.

In the preferred arrangement of the invention the two pairs of remote postions are geometricaHy arranged into a square, or near square, according to the perception of the occupiers of the positions, where two of the positions are virtual' in that they appear on the display screen.

In the preferred context of the invention the two pairs of remote virtual' positions are set around similar or identical tables, square, round or any geometric shape, of the type normally provided for eating on, whereby the two tabies visually connect in near geometric arrangement with matching characteristics via the display screens making for a visual illusion of a single table. Further to enhance the illusion the display screens have dimensions extending from the table surface and up to head height and positioned side by side with minimal frames around the display screens or to the point where the frames disappear and become a single surface or wall of projected display screens, or an integrated field of images on one large display screen. Many features of the environment of the table is in can be imitated between the two remote positons.

In an alternative context the two pairs of positions are for people standing so that the video conferencing sessions transmit head to foot images. Byway of example such an arrangement may he suitable within night clubs and wine bars or cafes, where projection of images is on an interior or extehor wall or wndow or where the display screen' replaces a window between the interior of the cafe and exterior of a street.

In the preferred positions of the invention the images being captured on the respective cameras and shown on the respective display screens mimic the real dimensions of the subjects which are normally a person's head and shoulders. This is done by adiusting the scale of the images being displayed wlth allowance for viewing distance, then in different modes of working there are other dimensional scales that the images can he projected using camera lens controlled by the users such as zoomedin closeup images which may imply intimacy and zoomedout imagesforlargergroups, complete body and context.

In the preferred arrangement of the invention for the two pairs of positions there are two flat walls alongside the positions as though dividing equally the virtual pair of positions and contained on the flat wail are three display screens in line, where the two outer screens have a single video conference session each and the middle screen as two video conference sessions whereby two distinct video screen images emanate from the middle stereo display screen. In a variation the middle display screen is replaced by two mono image display screens mounted at roughly right angles to each other and face directly to the respective positions.

In a variation in the arrangement of the invention there is a table with two seats representing two :3 posiUons and opposite the two positions there is display screen rising verticahy from the tables edge opposite the two side by side positions, then at a remote location there is a near identical arrangement, so that relative to each posit;on there are two conference sessions with the two remote positions, and to handle the overlap of the video conference session imagery there is a stereo display screen is that can show two different images across two distinct viewing angles.

In an advancement of the patent, trkscopic monitor technologies would make possible for six positions in two remote groups allowing three distinct images to be shown on the same display screen, and likewise in an increasing progression of distinct images and positions.

In a variation o0 the invention the four positions are roughly equally spaced and two positions are occupied by mannequin figures where the convex surface of the heads act as display screens for projection of their counterparts remotely located. The same arrangement is repeated at a remote location. The projections onto the mannequin heads are a representation of real people at the remote location. A feature of the projection is that for a group of four, three camera viewpoints have to be set up around a participants head in order to maintain the projected rotation of their head to look at all three other positions. In addition some head rotation detection, eye tracking detection or voice direction detection is needed to monitor the direction of the video conferencing session between which two participants, and furthermore needs switching every time two participants talk to each other. The equipment thus tracks ail six video conference sessions between four participants at four positions with two being in remote iocation(s). The mannequin heads can also have necks, torsos to act as projection surfaces forthe projection of neck and torso images. The use of projections of people onto remote mannequins for video conferencing sessions is scalable in numbers of participants from two people upwards. An alternative to this arrangement is that projection of images of a persons face is by back projection where the projector is within the mannequin head projecting onto the inner surface of a transparent or translucent material thus enabling the viewer to see the face of a person projected.

In an extension the mannequin itself can reproduce movement of the person it is representing by using robotic technoogies so that movement can be made in coordination wth the subject person in movements such as head rotation, head nodding, torso bending. and the like.

A variation of the mannequin arrangement replaces the dummy mannequin with a projected three dimensional life size mannequin which works by projecting thousands of2D images per second onto a rotating screen, US Patent 2967905, US Patent 6208318, NO Patent 2008039335.

As a way of enhancing the social intimacy the camera should he as close as possible to the alignment of the eyes of two people in a video conference session so as to maintain eye contact across the session. One way of acheving this sto have a minimally sized camera on a stalk in front of the display screen being as acceptably close as possible to the centre of the eyes of the person showing on the display screen and another is to mount the camera just above the top of the display screen. Another way is to use display screens where the camera can receive images through the amalgamated transparent parts around the active components of the dispiay screen or alternativeiy cycle the active dispiay components on and off on the display screen aflowing the camera to receive images during the off phase through the screen.

Yet anotherwayto enhance the social context is the use of semi silvered mirrors individually placed at a precise angie in front of the display screen whereby a camera mounted to the side, top or bottom ofa screen is able to capture the dmect gaze of the reflected mage of a person's face and lineofeye accurately. To increase the visibility of the reflected image the person's face is sufficiently illuminated.

With a certain ievei of illumination the semi silvered mirror can be repiaced with a sheet of glass.

Image processing can enhance images obtained from the reflected light.

To clarify the sound transmission related to a video conferencing session in noisy environments like cafes, bars, waiting rooms and lounges multiple loudspeakers can locus the sound at the occupied position, or noise cancelling technology can be used, or directional ultrasonic column technoiog US patent 3392368, can be used. To clarify the sound recording of the voices of the peopie at the;r respectve positions an array of microphones can be used where the signal from each microphone can be processed by a computer running a program to optimise the sound from the target position.

An alternative arrangement for sound is where headphones are worn by individual persons connected by wireless means such as Bluetooth technology. Afurther arrangements is where sound is focused onto a person so only that person hears it and other persons do no using directed sound as in the way achieved by spot lights with light.

To enhance the sociai context of the invention hapUc interfaces for transmitting touch is addit!onal part of the video conference session. Byway of example only, a deformabie palm sized object can be held and transmt variations in shape to a persons hand, oran aperture resemhlng lps can transmit a kiss, a robotic hand can transmit squeezing for hand shaking.

To enhance the context of the invention, smell senses can he transmitted dunng a video conferencng session between positions by incorporating olfactory detection system along with smell emitbng system to transmit smells such as perfume, coffee, food, and the like.

There is another arrangement of the invention where one or two holographic display screens can show live images of the two remote positions.

In another format of the invention mobile phones/cell phones are used to replace the equipment of video conferericing session using the phones camera, microphone, display screen, and loudspeaker/headphones together with an application which integrates the users phones together in a working group where the phone display screen is spht depending on the number of remote parbcipants awayfrom two or more parUcipants who are together in reality.

Any remote posit.on away from the two positions ri real space is able to be replaced and integrated by a video conference session based on mobUe phone/cell phone or computer social media. This integration can be ata simple level or extend to the fuR inventive arrangements outlined here within.

DESCRIPTION OF THE DRAWINGS

A specific embodiment of the invention will now be described by way of example with reference to the accompanying drawings in which: Figure 1 illustrates in plan view two identical remotely connected set-ups; Figures 2,4 and 5 Rlustrate plan view variations in positions and display screens; Figure 3 illustrates in perspectwe Figure 2; Figure 6 illustrates a plan view detal; Referring to the drawing Fig.1 illustrates two identical video conference set-ups in plan vew, one set-up comprising of two positions 30 & 31 that can each he occupied by a person, and two display screens 43 & 47 containing cameras, microphones and loudspeakers, a computer processing unit 45 processing all the electronic input and output signals using computer programs, and the second set-up comprising of two positions 36 & 37 that can each be occupied by a person, and two screens 44 & 48 containing cameras, microphones and loudspeakers, a computer processing unit 46 processing all the electronic input and output signals using computer programs. Each of the two video conference set-ups is connected by a cable wire 28 camiying electronic telecommunication transmissions. A person beng on camera at position 30 is seen virtually at position 34 by the observer at position 36 via the alignment 54 and by the observer at position 37 via the alignment 56. A person being on camera at position 31 is seen virtually at position 35 by the observer at position 36 via the alignment 55 and by the observer at position 37 via the alignment 57. A person beng on camera at position 36 is seen virtually at position 32 by the observer at position 30 via the alignment 50 and by the observer at position 31 via the alignment 52. A person being on camera at position 37 is seen virtually at positon 33 by the observer at position 30 via the alignment 51 and by the observer at position 31 via the alignment 53.

Another layout is illustrated in Fig.2 with a simplified plan view without cameras, microphones, loudspeakers, processing computer and transmission connections, where two positions for people are on either side of a table 59 are alongside a display screen wali 13 & 14 that show virtual images of the remote positions 11 and table 12. From display screens 13 the eye sight lines 15 to positions 10 are shown as from virtual positions 11 with virtual continuation of the sight lines 17. The eye sight lines 16 from virtual positions 11 cross-overto positions 10 with virtual continuation of the sight lines 18 thus requihng a stereo display screen 14.

The perspective view n Ag. 3 iflustrates chairs 61 around table 62 with rmcrophones 65 on top, mountea alongside display screen housing 63 containing two display screens 66 and one stereo display screen 67 pius integrated stereo loudspeakers 68 and four cameras 64.

The layout illustrated in Fig. 4 is a simplified plan view without cameras, microphones, loudspeakers, processing computer and transmission connections, where two positions for people 10 are on either side of a table 40. Each position 10 has one sight line 21 to the adjacent position 10 and two sight lines to remote positions displayed on display screens 13 & 22.

Fig. 5 illustrates two positions 10 which have six cameras 26 trained on them that are on two sides of square table 41. While on the other sde of the square table, two mannequin heads 25 are projected onto by six switchable projectors 27. The whole arrangement is repeated in a remote location where the camera images of the four positions 10 are projected onto four mannequins 25 with the images being communicated electronically.

Applicable to any position and display screen arrangement between a persons face and the display screen, Fig 6 illustrates a person's head 70 s in front of a display screen 71 that is viewed through a semi silvered mirror or plan glass sheet 72 while a camera 74 records images along an example light track 73 that is reflected off the semi silvered/semi mirrored glass sheet 72 and directly in alignment with a person's eyes.

Claims

CLAIMS1 A video conferencing arrangement comprising of two or more positions situated at distances normally associated with person to person conversation and another arrangement in a remote location, normally identical to the first. All positions in one location are places for occupation by persons, objects and normally by single people in direct person to person conversation, and all these said positions are connected together by a plurality of video conferencing sessions to all the positions in the remote location. For the arrangement at one location and the arrangement at the remote location there is at least one display screen, display screen defined in the widest sense hereby way of example; electronic screen, projection, curved display, mannequin shaped display surface, and the like, that provides two or more, distinct video images that occupy the same area where each image is designed for viewing at the said positions to mimic in time and space a person or object at the remote location.

2 A video conferencing arrangement as claimed in Claim I wherein the normal arrangement is two pairs of remote positions geometrically arranged into a square, or near square where two of the positions are virtual' in that they appear on the display screen.

3 A video conferencing arrangement as claimed in Claim I wherein the two pairs of positions are for people standing so that the video conferencing sessions transmit head to foot images.

4 A video conferencing arrangement as claimed in Claim I wherein the display screen replaces a window between the interior of the café and exterior of a street.

A video conferencing arrangement as claimed in Claim I wherein the images being captured on the respective cameras and shown on the respective display screens mimic the real dimensions of the subjects which are normally a person's head and shoulders.

6 A video conferencing arrangement as claimed in Claim 5 wherein the images can be projected using camera lens controlled by the users such as zoomed-in close-up images which may enable intimacy and zoomed-out images for larger groups, complete body and context.

7 A video conferencing arrangement as claimed in Claim I wherein there are two flat walls alongside the positions and contained on the flat wall are three display screens in line, where the two outer screens have a single video conference session each and the middle screen has two video conference sessions whereby two distinct video images emanate from the middle display screen.

8 A video conferencing arrangement as claimed in Claim I and Claim 7 wherein the middle display screen is replaced by two mono image display screens mounted at roughly right angles to each other and face directly to the respective positions.

9 A video conferencing arrangement as claimed in Claim I and Claim 7 wherein the viewing of images on one or more display screens, and normally the central one, require that distortion effects be applied to make an image look undistorted relative to the viewing angle.

A video conferencing arrangement as claimed in Claim I wherein there is a table with two seats representing two positions and opposite each of the two positions there is stereo display screen rising vertically from the table4s edge, and at a remote location there is an identical c-"-arrangement. Ta

(Y) II A video conferencing arrangement as claimed in Claim I, Claim 7 and Claim 10 wherein 0 the stereo display screen has a multiplicity of stepped surfaces small enough to be undetectable at normal viewing angles by the human eye, one surface direction facing towards the first position and the other facing towards the second position in the pairs of positions, whereby the matrix of colour LCD or LED pixels, or other display elements, covers each stepped surface to build two distinct display screen surfaces of which only one can be seen relative to the viewing angle associated with each position.

12 A video conferencing arrangement as claimed in Claim 1, Claim 7 and Claim 10 wherein the two pairs of remote virtual' positions are set around similar or identical tables, square, round or any geometric shape, of the type normally provided for eating on, whereby the two tables visually connect in near geometric arrangement with matching characteristics via the display screens making for a visual illusion of a single table.

13 A video conferencing arrangement as claimed in Claim I, Claim land Claim 10, wherein display screen surfaces can be flat or curved in two and three dimensions.

14 A video conferencing arrangement as claimed in Claim I, Claim 7, Claim 10 and Claim 13 wherein the display screens are positioned side by side with minimal frames.

A video conferencing arrangement as claimed in Claim 1, Claim 7, Claim 10 and Claim 13, the display screens become a single surface or wall of projected display screens, or an integrated field of images on one large display screen.

16 A video conferencing arrangement as claimed in Claim I wherein many features of the environment within which the table is situated can be imitated between the two pairs of positions.

17 A video conferencing arrangement as claimed in Claim I wherein there are places for sb positions in two remote groups allowing three distinct images to be shown on the same display screen using tri-scopic monitor technologies.

18 A video conferencing arrangement as claimed in Claim I wherein the four posHions are roughly equally spaced and two positions are occupied by mannequin figures where the convex surface of the heads act as display screens for projection of their counterparts remotely located.V.".' The same arrangement is repeated at a remote location. The projections onto the mannequin (?) heads are a representation of real people at the remote location.

19 A video conferencing arrangement as claimed in Claim I and Claim 18, wherein head rotation detection, eye tracking detection or voice direction detection is needed to monitor the direction of the video conferencing session between participants.

A video conferencing arrangement as claimed in Claim I and Claim 18, wherein the equipment tracks six video conference sessions between four participants at four positions with two being in remote location.

21 A video conferencing arrangement as claimed in Claim I wherein the mannequin heads can also have necks, torsos to act as projection surfaces for the projection of neck and torso images.

22 A video conferencing arrangement as claimed in Claim 21 wherein the use of projections of people onto remote mannequins for video conferencing sessions is scalable in numbers of participants from two people upwards.

23 A video conferencing arrangement as claimed in Claim 21 wherein the projection of images of a person's face is by back projection' where the projector is within the mannequin head projecting onto the inner surface of a translucent material.

24 A video conferencing arrangement as claimed in Claim 21 wherein the mannequin can reproduce movement of the person it is representing by using robotic technologies so that movement can be made in coordination with the subject person in movements such as head rotation, head nodding, torso bending, and the like.

A video conferencing arrangement as claimed in Claim 21 wherein the mannequins are replaced with a projected three dimensional life size mannequin which works by projecting thousands of 2D images per second onto a rotating screen.

26 A video conferencing arrangement as claimed in Claim I wherein there are minimally sized cameras on a stalk in front of the display screens being as acceptably dose as possible to the centre of the eyes of the person showing on the display screen. C1)

27 A video conferencing arrangement as claimed in Claim 1 wherein the camera can receive images through the amalgamated transparent parts around the active components of the display screen.

28 A video conferencing arrangement as claimed in Claim I wherein the active display components alternatively switch on and off on the display screen allowing the camera to receive images during the off phase through the screen.

29 A video conferencing arrangement as claimed in Claim I wherein the use of semi-silvered mirrors individually placed at a precise angle in front of the display screen whereby a camera mounted to the side, top or bottom of a screen is able to capture the direct gaze of the reflected image of a person's face and line-of-eye.

A video conferencing arrangement as claimed in Claim 29 wherein the semi silvered mirror is replaced with a sheet of glass.

31 A video conferencing arrangement as claimed in Claim 29 and Claim 30 wherein image processing can enhance images obtained from the reflected light.

32 A video conferencing arrangement as claimed in Claim I wherein multiple loudspeakers can focus the sound at the occupied position.

33 A video conferencing arrangement as claimed in Claim I and Claim 32 wherein noise cancelling technology is used.

34 A video conferencing arrangement as claimed in Claim I wherein directional ultrasonic column technology is used.

A video conferencing arrangement as claimed in Claim I wherein an array of microphones is used where the signal from each microphone can be processed by a computer running a program to optimise the sound from the target position.

36 A video conferencing arrangement as claimed in Claim I wherein sound is where 0) headphones are worn by individual persons connected by wireless means such as Bluetooth cD technology.

37 A video conferencing arrangement as claimed in Claim I wherein interfaces for transmitting touch is additional part of the video conference session, where image capture with pattern recognition technology can determine shapes for haptic transmission of these to a remote location..

38 A video conferencing arrangement as claimed in Claim 37 wherein a deformable palm sized object can be held and transmit variations in shape to a person's hand.

39 A video conferencing arrangement as claimed in Claim 37 wherein an aperture resembling lips can transmit a kiss.

A video conferencing arrangement as claimed in Claim 37 wherein a robotic hand can transmit squeezing for hand shaking.

41 A video conferencing arrangement as claimed in Claim I wherein smell senses can be transmitted during a video conferencing session between positions by incorporating olfactory detection system along with smell emitting system to transmit smells such as perfume, coffee, food, and the like.

42 A video conferencing arrangement as claimed in Claim I wherein one or two holographic display screens can show live images of the two remote positions.

43 A video conferencing arrangement as claimed in Claim I wherein smart mobile phones/cell phones are used for the video conferencing session together within an application that integrates the users together into a virtual group, where the phone display screen may be split between positions, or windows are automatically switched depending on position being addressed.

44 A video conferencing arrangement as claimed in Claim 1 wherein any remote position away from the two positbns in real space is able to be replaced and integrated by a video conference session based on mobile phone/cell phone or computer social media. C1)A video conferencing arrangement as claimed in Claim I wherein each position is a place for occupancy by a person, a group of people, animals, a mannequin, a robot, an object or can remain unoccupied.