CN101427574A - System and method for providing location specific sound in a telepresence system - Google Patents
System and method for providing location specific sound in a telepresence system Download PDFInfo
- Publication number
- CN101427574A CN101427574A CNA2007800141474A CN200780014147A CN101427574A CN 101427574 A CN101427574 A CN 101427574A CN A2007800141474 A CNA2007800141474 A CN A2007800141474A CN 200780014147 A CN200780014147 A CN 200780014147A CN 101427574 A CN101427574 A CN 101427574A
- Authority
- CN
- China
- Prior art keywords
- remote
- remote microphone
- user
- microphone
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A system for providing location-specific sound in a telepresence system includes a plurality of remote microphones. Each remote microphone is associated with a respective area and operable to generate a sound signal from the voice of at least one user within the respective area. The system also includes a plurality of remote cameras. Each remote camera is associated with a respective remote microphone of the plurality of remote microphones and aligned to generate an image of its associated respective area. The system further includes a plurality of local displays. Each local display is operable to reproduce the image of a respective area generated by a respective remote camera. The system also includes a plurality of local loudspeakers. Each local loudspeaker is positioned proximate to a respective local display and operable to reproduce the sound signal from the voice of the at least one user within the respective area reproduced by the respective local display.
Description
Technical field
Relate generally to of the present invention communication especially relates in long-range presenting (telepresence) system and providing specific to the system and method for the sound of position.
Background technology
Along with " global economy " continues expansion, can stride potential long distance also expand thereupon with the demand that other people communicates.A communications field having seen client's reliability of steady-state growth and increase is internet and the topological use of other networking.Along with the constant growth and the development of networked capabilities, become and to have realized more and better product and feature.Especially increase and a field of development is the call field of the Internet-enabled (Internetenabled) of for example using VoIP all having seen aspect the quality and quantity two.By obtaining audio signal (talker's voice) and converting them to Internet Protocol (IP) grouping, IP phone can send audio signal through IP network (for example, internet).
When existing only voice communication also inadequate.In this case, video conference may be attractive and viable option.Current video conference often relates to complicated setting and call establishment (technical support that needs someone usually is to be provided with instrument) before meeting.In addition, exist under a plurality of users' the situation, typical video conferencing system is a different piece with single screen divider.Each part is associated with ad-hoc location usually, and need make great efforts to cooperate the visual field of camera all users of this position.Current video conferencing system also uses single loudspeaker or loudspeaker to be used to reproduce sound usually.Therefore, no matter who is in speech, and sound is all from same position.This often needs to receive the user and carefully examines screen closely, checks that respectively each user is to determine who is in speech.This may be especially difficult in following video conference: screen is allocated to some positions, and each position has a plurality of users in the visual field of camera.
Summary of the invention
According to specific embodiment, the system and method that provides in telepresence system specific to the sound of position is provided, it is eliminated basically or has reduced shortcoming and the problem that is associated with previous system and method.
According to specific embodiment, a kind of providing in telepresence system specific to the system of the sound of position comprises a plurality of remote microphone.Each remote microphone is associated with respective regions, and can operate at least one user's voice that is used for according in the respective regions and generate voice signal.System also comprises a plurality of remote camera.Each remote camera is associated with corresponding remote microphone in a plurality of remote microphone, and is aligned to generate the image of its associated respective area.System also comprises a plurality of local displays.Each local display can be operated the image that is used to reproduce the respective regions that is generated by respective remote camera.System also comprises a plurality of local loudspeaker.Each local loudspeaker are oriented to corresponding local display, and can operate the voice signal that is used to reproduce according at least one user's voice in the respective regions that is reproduced by corresponding local display.
Depend on embodiment, microphone can comprise one or more in the following: a plurality of sensing remote microphone; A plurality of heart-shaped remote microphone of pointing to; A plurality of super heart-shaped sensing remote microphone; A plurality of more high-orders point to remote microphone; A plurality of compact remote microphones; The perhaps remote microphone that couples with desk across each respective regions.
In certain embodiments, a plurality of local loudspeaker can be positioned in the corresponding local display pressed close to below.In a particular embodiment, a plurality of local loudspeaker can be positioned in the corresponding local display pressed close to above.In certain embodiments, a plurality of local loudspeaker can be positioned in the side of the corresponding local display of being pressed close to so that each local display has at least one local loudspeaker in each side.
According to another embodiment, a kind of providing in telepresence system specific to the sound method of position comprises: generate voice signal according at least one user's voice in the respective regions.This voice signal is generated by at least one remote microphone in a plurality of remote microphone.Each remote microphone is associated with respective regions.This method also comprises aims at a plurality of remote camera to generate the image of associated respective area.Each remote camera is associated with corresponding remote microphone in a plurality of remote microphone.This method also is included in the image that the respective regions that is generated by respective remote camera is reproduced at each local display place in a plurality of local displays.This method also comprises the voice signal that reproduces according at least one user's voice in the respective regions that is reproduced by corresponding local display, and each local loudspeaker are oriented to corresponding local display.
The technological merit of specific embodiment comprise by be positioned to demonstration sound from the loudspeaker of display in zone reproduce sound from ad-hoc location.Therefore, the local user fast, accurately and easily sound recognition turn to this display from where and with their attentiveness.Another technological merit of specific embodiment comprises the use of directional microphone.Therefore, directional microphone can detect the sound that sends in the main localized area around directional microphone more possibly.
According to the following drawings, explanation and claim, other technological merit is sufficiently clear to those skilled in the art.In addition, though the above certain benefits of having enumerated, each embodiment can comprise in the cited advantage whole, some or do not comprise.
Description of drawings
For the more complete understanding to specific embodiment of the present invention and feature and advantage thereof is provided, can come in conjunction with the accompanying drawings with reference to following description, in the accompanying drawings:
Fig. 1 shows and illustrates particular embodiments of the inventions herein, uses at least one telepresence system to carry out the block diagram of the system of the visual conference between each position;
Fig. 2 illustrates particular embodiments of the inventions herein, comprises that the local exemplary remote of the various piece of the long-range telepresence system of watching by local display presents the perspective view of system;
Fig. 3 illustrates particular embodiments of the inventions herein, comprises that the local exemplary remote of the various piece of the long-range telepresence system of watching by local display presents another perspective view of system;
Fig. 4 illustrates particular embodiments of the inventions herein, exemplary remote shown in Figure 3 presents the top view of the camera of system, display and desk;
Fig. 5 illustrates the type separator that separates according to a particular embodiment of the present invention;
Fig. 6 illustrates perforated area separator according to a particular embodiment of the present invention and uneven surface type separator;
Fig. 7 illustrates the carinate type separator that is positioned on the floor according to a particular embodiment of the present invention;
Fig. 8 illustrates the recess-type separator that is positioned on the floor according to a particular embodiment of the present invention; And
Fig. 9 illustrates the configuration of local loudspeaker according to a particular embodiment of the present invention and display.
Embodiment
Fig. 1 illustrates the block diagram that uses at least one telepresence system to carry out the system 10 of the visual conference between each position.Illustrated embodiment comprises network 102, the long-range visual conference of instrument 106 between remote site 100 that present of network 102 auxiliary uses.Website 100 comprises the user 104 of any suitable number that participates in visual conference.System 10 provides video conference true to nature to experience to user 104, also is like this even site-local 100 may have the long-range instrument 106 that presents that lacks than remote site 100.
The one or more individuals or the individual's of visual conference group is attended in user's 104 expressions.User 104 uses such as audio the Internet protocol (IP) phone, videophone devices, participates in visual conference based on the visual telephone of personal computer (PC) and any suitable device and/or the assembly the flow transmission client.During visual conference, user 104 participates in session as the talker or participates in as non-talker.
The long-range video conference that presents between instrument 106 auxiliary each user 104.The long-range instrument 106 that presents can comprise in order to set up and any suitable element of accessorial visual meeting.For example, the long-range instrument 106 that presents can comprise loudspeaker, microphone or microphone.In illustrated embodiment, the long-range instrument 106 that presents comprises camera 108, monitor 110, processor 112 and network interface 114.
Camera 108 comprises any suitable hardware and/or the software that also this image is offered other user 104 in order to auxiliary catch user 104 and both images of peripheral region thereof.Camera 108 is caught user 104 image and is sent this image as vision signal (for example, high definition video signal).Monitor 110 comprises in order to the auxiliary reception vision signal and shows any suitable hardware and/or the software of these users' 104 image to other user 104.For example, monitor 110 can comprise notebook type PC, wall display-device, floor mounted formula display or self-supporting display.Monitor 110 uses any appropriate technology (for example, high definition, compression hardware and efficient encoding and decoding standard) that photorealism is provided to come the image of explicit user 104.The long-range instrument 106 of presenting uses such as session initiation protocol (SIP) or any suitable technique and/or agreement are H.323 set up the visual conference session.In addition, long-rangely present that instrument 106 can be supported and (for example H.261, H.263 and/or H.264) other video system is carried out interoperability with other standard of support.
In an operation example embodiment, the user 104 at website 100a and 100b place wishes to participate in visual conference.One of the user 104 at website 100a place may talk.His voice are can be in this locality detected and long-range reproduced, so that can come which user of quick identification 104 in speech by the position of sound the user 104 at website 100b place.
Can make amendment, add or omit system 10.For example, system 10 can comprise the website 100 of any suitable number, and can assist the visual conference between the website 100 of any suitable number.As another example, website 100 can comprise in order to the camera 108 of any suitable number of accessorial visual meeting and monitor 110.As another example, the visual conference between each website 100 can be point-to-point meeting or multipoint conference.In addition, the operation of system 10 can by more, still less or other assembly carry out.In addition, the operation of system 10 can use any suitable logic to carry out.
The local exemplary remote that Fig. 2 illustrates the each several part that comprises the long-range telepresence system of watching by local display presents the perspective view of system.Telepresence system 300 can be similar to any one of website 100 of Fig. 1.Telepresence system 300 provides the high-quality visual meeting of the video conferencing system of surpasses typical to experience.By telepresence system 300, the user can experience lifelike, full scale (perhaps near full scale) image in high definition (HD) virtual desktop environment.The HD virtual desktop environment of being created by telepresence system 300 can help to form the personal experiences to visual conference.Not only by near the image of natural scale ratio, but also by special eye contact, watch observation (hereinafter referred to as " eyes are watched attentively ") attentively and can form these personal experiences specific to the sound of position.Eyes are watched attentively and can and be aimed at user, camera and monitor and realize by the location.Can realize by each microphone that use is positioned at the specific region specific to the sound of position, described specific region separately be positioned at the monitor that shows microphone zone of living near one or more loudspeaker be associated.This can allow for each user or groups of users is carried out discrete voice reproduction.
The design of telepresence system 300 (for example is not restricted to improve those assemblies of using in typical video conferencing system, monitor 304, camera 306, loudspeaker 308 and microphone 310), and it can also comprise many others, feature, assembly and/or equipment in the room, (for example comprise such as desk 302, wall 312, lighting apparatus, 314 and 316) and so on assembly and some other assemblies are below with more detailed argumentation.These assemblies can be designed as and help to cover the related technology of telepresence system 300, thereby reduce the sensation that participates in video conference, increase the sensation of personal communication simultaneously.Telepresence system 300 as shown in Figure 2 can also comprise some users, local user 324a-324c and long-range user 322a-322c.
Eyes are watched attentively and can be made up to be created in the very natural dialogue between the local and remote user specific to the sound characteristic of position.When the speech of long-distance user 322a for example, his voice reproduce by near the loudspeaker 308a that is positioned at the monitor 304a, and monitor 304a shows the monitor of long-distance user 322a on being.Local user 324 can be naturally turns to this sound with their attentiveness, thereby and can be apace their attentiveness be accumulated on the long-distance user 322a.In addition, if long-distance user 322a is just seeing something or someone, then the special eye gaze ability of telepresence system 300 can allow local user 324 to be easy to discern him where just to see.For example, if long-distance user 322a asks " how you think " when seeing local user 324c, then the eye gaze ability of telepresence system 300 can allow all users (local and remote both) apace identification " you " whom is because clearly visible long-distance user 322a is just seeing local user 324c.This natural flow process can help the user is felt at home, and can facilitate the long-range personal experiences that auxiliary visual conference is experienced that present.
Here several width of cloth in the accompanying drawing of being discussed not only show the assembly of local telepresence system, but also show in the visual field of remote camera and be displayed on those assemblies of the long-range telepresence system on the local monitor.For simplicity, the front that is positioned at the assembly at remote site place will be coupled with long-range this speech.For example, the telepresence system at the other end place of visual conference can be called long-range telepresence system.When can see assembly of long-range telepresence system in one of monitor 304 time, it can have the label of himself, but at an assembly when being invisible, it can use the label of the local counterpart that has added long-range this speech in front.For example, the long-range counterpart of microphone 310a can be called remote microphone 338a, and the long-range counterpart of loudspeaker 308b can be called remote speaker 308b.Under the position of the assembly of mentioning is clearly visible situation, can not carry out this address.
A hands-on part can realize by the following fact: telepresence system can comprise the many features and/or the assembly in room.In certain embodiments, because the use of telepresence system 300, the outward appearance in the room at meeting two ends can similar (if not same).Therefore, when local user 324 observed monitors 304, they were presented the image that seems the room that with themselves room be complementary to have in background.For example, the wall 312 of telepresence system 300 can have and similar color, pattern and/or design feature or the feature of the remote wall 312 of long-range telepresence system.
It is the configuration of desk 302, remote table 330, monitor 304 and remote camera 306 that the making of telepresence system 300 himself be fit to be created hands-on another aspect.These assemblies are placed as mutual concord, so that it seems that desk 302 continues up to desk 330 by monitor 304, thereby form single continuous desk, rather than at two discrete desks at two diverse location places.More specifically, desk 302 can comprise the table forward part 302a of full size, and it can be a slight bending or angled.Table forward part 302a can couple mutually with table rear section 302b, and table rear section 302b can continue from table forward part 302a.But table rear section 302b can have the width of shortening.The table rear section 302b that shortens width can be so that when it adjoins with a part that is presented at the remote table 330 in the monitor 304, and these two discrete parts appear to the single part of the desk with complete width similar to table forward part 302a.
Except the layout of remote table 330, the layout of remote camera 306 and aim at can so that the correct part of desk 330 and may just be sitting in the user at that part place of desk 330 or groups of users within the visual field of remote camera 306.More specifically, remote camera 306a can be aligned to catch the outer part in a left side of desk 330 and long-distance user 322a, remote camera 306b can be aligned the China and foreign countries' part with seizure desk 330 and long-distance user 322b, and remote camera 306c can be aligned to catch the right outer part of desk 330 and long-distance user 322c.Each camera 306 and remote camera 306 can be caught the video of high definition, and for example, camera 306 can be caught 720i, 720p, 1080i, 1080p or other more high-resolution video.Should be noted that when a plurality of users are in the visual field of camera, do not need to change the aligning of camera.
In certain embodiments, remote camera 306 can be aligned so that at the horizontal clearance between the adjacent vertical edges of the visual field between two adjacent cameras corresponding to the (gap between the monitor, any gap between the screen of monitor 304, for example gap d 2 and the d3 of Fig. 3 can comprise around any space between any border of monitor screen and two monitors).For example, the horizontal clearance between the adjacent vertical edges of remote camera 306a and 306b can and the screen of monitor 304a and 304b between the gap align.In addition, remote camera 306 and monitor 304 can be aligned so that cross over the object of the visual field of a plurality of cameras (for example can not present disconnection, remote wall engages the line of long-range ceiling can be linearly, rather than be an angle and be another angle in a monitor in adjacent monitor).Therefore, if stretching out one's hand, long-distance user 322a touches for example computer monitor 326b, user 324 can not see long-distance user 322 arm unusual interruption (for example, unusual long and short or disconnect), just look like its to stride across monitor 304a the same with 304b (and visual field of remote camera 306a and 306b).
In certain embodiments, monitor 304 can show the high definition video that remote camera 306 is caught.For example, monitor 304 can show 720i, 720p, 1080i, 1080p or any other high-resolution video.In certain embodiments, monitor 304 can be a flat-panel monitor, for example, and LCD monitor or plasma monitor.In a particular embodiment, monitor 304 can have 60 or 65 inches screen (striding screen to angular measurement).Screen sizes can allow telepresence system 300 to show long-distance user 322 as proportional and full scale (perhaps near proportional and near natural scale) image.The high-definition display capabilities of monitor 304 and screen sizes can also also be kept image clearly simultaneously by the size that increases video image increases the personal effect that telepresence system 300 produces (avoiding the mosaic (pixelation) that may cause by attempting display standard resolution chart picture on big monitor or fuzzy).
In certain embodiments, monitor 304 can be positioned such that they constitute around the angled wall of table rear section 302b.In a particular embodiment, monitor 304 can be aligned so that the outside of the approximate reflection table of their arrangement forward part 302a.More specifically, monitor 304b can be parallel with wall 312b, and monitor 304a and 304c can towards user 324b and to leave wall 312b angled.Though monitor 304a and 304c angled (with respect to monitor 304b), the inside vertical edge of each monitor (Far Left of the rightmost of monitor 304a and monitor 304c) can be respectively in abutting connection with or almost in abutting connection with the left side and the right of monitor 304b.Similarly, the base of monitor 304b can in abutting connection with or almost in abutting connection with the table rear section 302b back of the body limit.In a particular embodiment, monitor 304 can be positioned such that the bottom boundaries of monitor 304 or framework below the end face of table rear section 302b, thereby invisible to user 324.This can provide from local desk 302 to the apparent seamless transitions that is presented at the remote table 330 on the monitor 304.In certain embodiments, monitor 304, remote monitor 304 and remote camera 306 accuracy and the effectiveness that can also be positioned/aim at and watch attentively with the eyes that increase long-distance user 322.Remote camera 306 can be positioned in the following preset distance of the top margin place of remote monitor 304.This preset distance can be based on for example following factor: the distance between the size of remote monitor 304 and/or long-distance user 322 and the remote camera 306.For example, in a particular embodiment, remote camera 306 can be positioned in following 4 to 6 inches places, top of remote monitor 304a.In addition, remote camera 306 can be towards remote table 330, so that can being similar to the outside (long-distance user can be sitting in the limit at this place) of remote table 330 is perpendicular, the axis of each camera (notes, outside under the situation of spring song, the axis of each camera can be similar to outside with remote table and be similar at the tangent line at the some place of the centre of each User Part perpendicular).Therefore, when long-distance user 322 participates in presenting session with local user 324 long-range, may appear to long-distance user 322 and just see local user 324.More specifically, though long-distance user 322 is in the position of separation, long-distance user 322 image may appear to the eye of creating/setting up with local user 324 and contact on monitor 304.May be clearly visible, the accuracy that the increase eyes are watched attentively has increased the personal experiences of the visual conference of presiding over via telepresence system 300.
Depend on embodiment, camera 306 can be freedom movably, non-easily movably (for example, they may need some instrument to adjust them), or fixing.For example, non-easily movably in the specific embodiment at camera 306, still can adjust camera 306 subtly to aim at a left side or the right side, to go up or down or rotation.In certain embodiments, all adjust camera 306 in the time of may wishing to use telepresence system 300 at every turn, may reduce the simplicity of using telepresence system 300 because so do.Therefore, maybe advantageously limited subscriber in the zone that may sit when mutual with telepresence system 300.A kind of like this assembly telepresence system 300, that can be used to help the position controlling the user relatively and sat with camera can be a desk.User 324 can take a seat along the outside of table forward part 302a, can record the note, shelve their ancon or otherwise use desk 302.This can allow to be provided with based on the size of desk 302 field depth and the convergent-divergent of camera 306.For example, in certain embodiments, the field depth of camera 306 can be provided so that then they can be aligned focus (in focus) if user 324 is between four feet at two feet in the place ahead of the outside of forward part 302a and the rear.Similarly, the convergent-divergent of camera 306 can be provided so that the user who is sitting in the desk place will present natural scale on being displayed on remote monitor the time.Should be understood that as seen amount of zoom may not only depend on the distance between camera 306 and the user 324, but also depend on the screen size of remote monitor 304.
Except user 324 is remained in the focusing range of camera 306, also may wish to make them to remain in the visual field of camera 306.In certain embodiments, can use separator 336 to come limited subscriber 324 edges/laterally moving around the outside of forward part 302a.Zone between the separator 336 can be corresponding with the visual field of respective camera 306, and can be called as User Part.In certain embodiments, each User Part can be enough wide to hold two users.Utilizing separator to limit along laterally moving of desk 302 may be even more important in the following cases: have a plurality of users in viewing field of camera.This may be because exist in the visual field of certain camera under a plurality of users' the situation, and a plurality of users will more may need the more horizontal spaces (comparing with unique user) along desk 302.Therefore, separator can help prevent a plurality of users that themselves is placed outside the visual field in whole or in part.
Separator 336 can be formalized and according to size be cut into make the user just by, across, thereafter or otherwise too near separator 336 time, will find uncomfortable.For example, in a particular embodiment, separator 336 can be covered with flexible foam plastic large-scale outstanding, these outstanding outsides that can extend to along the bottom surface of table forward part 302 or surpass table forward part 302a.In a particular embodiment, separator 336 can be used for table support 302, and perhaps they can be added to some assembly of the supporting construction of desk 302.Use separator 336 can be increased in the amount of space of the pin/leg of the user below the desk 302 as the part of the supporting construction of desk 302.Different embodiment can use different separators or other assembly or feature realizing identical purpose, and function extra or that substitute can be provided, below with more detailed argumentation.
In certain embodiments, desk 302 can comprise further feature, the specific region that these features can help the user is directed to desk 302 (for example, the center of the visual field of camera 306), perhaps can help prevent the user to walk and thereby enter the visual field of a plurality of cameras or outside the visual field of certain camera from the specific region.For example, desk 302 can comprise computer monitor 320, and it can be used for showing the information from computer (Local or Remote), for example slideshow or chart or figure.Computer monitor 320 can comprise CRT, LCD or can show monitor from any other type of the image of computer.In certain embodiments, computer monitor 320 (for example can be integrated in the desk 302, can watch the screen of computer monitor 320 by the table top of looking down desk 302), and in other embodiments, they are (for example, the traditional computer monitor can be shelved on the mode on the desk) from the teeth outwards.In a particular embodiment, computer monitor 320 can not be the part of desk 302, but can separate with desk 302.For example, they can be in go-cart movably.In addition, some embodiment can use the combination of integrated, desk-top and separate monitors.
Can be used for user 324 is caused another feature specific region, desk 302 can be microphone 310.In a particular embodiment, microphone 310 can be integrated with desk 302, moves its ability thereby reduce the user.For example, microphone 310 can be positioned at the center of the visual field of respective camera 306.This can provide extra prompting they are caused the center of visual field to the user.In certain embodiments, microphone 310 can move freely, thereby allows to attempt to use under the situation of same microphone to its reorientation a plurality of users.In certain embodiments, microphone 310 can be to have the heart-shaped more directional microphone of high-order directing mode of (cardioid), super heart-shaped sensing (hypercardioid) or other that points to.In a particular embodiment, microphone 310 can be small-sized (low profile) microphone, and it can be installed to be the surface near desk 302, thereby reduces the effect of any sound reflection that leaves desk 302.In certain embodiments, microphone 310 can be linked, so that work as a plurality of microphones (for example, microphone 310a and 310b) when detecting same sound, for example removes detected sound from detected sound for the most weak microphone by filtering.Therefore, can be like this: may be mainly be associated with microphone near spoken user from specific user's sound.
Some embodiment can be by enabling to utilize following ability specific to the sound of position: have the sound from the single source (for example, microphone 310a) in known location (for example, the left side of desk 302).Telepresence system 300 can reproduce by the detected sound of the particular microphone with known location by loudspeaker or a pair of loudspeaker, and described loudspeaker or a pair of loudspeaker are positioned near the monitor that shows this particular microphone peripheral region that detects sound.Therefore, the sound that sends in the left side of long-range telepresence system 300 can be reproduced in the left side of telepresence system 300.This can also strengthen personal effect by the language that this long-distance user is reproduced near the loudspeaker place the monitor that has shown the long-distance user.More specifically, if long-distance user 322a speech, possible remote microphone 338a and 338b both can detect the language that user 322a is said.Because user 322a more approaches microphone 338a, and because microphone 338a towards user 322a, so voice signal that may 32a is stronger at microphone 338a place.Therefore, long-range telepresence system can ignore/filter be complementary from the input of microphone 338a, from the input of microphone 338b.Then, may be that loudspeaker 308a (loudspeaker below the monitor 304a) reproduces by the detected sound of microphone 338a.When user 324 heard sound from loudspeaker 308a, they can turn to that side, and just they can do in same room and when just having said words just as user 322a.
In a particular embodiment, loudspeaker 308 can be installed in the below, top, rear of each monitor 304 or in both sides, perhaps they can otherwise be positioned near the monitor 304, so that for example when loudspeaker 308b reproduces the language that long-distance user 322b said, user 324 can discern this sound apace from the long-distance user 322b that is presented among the monitor 304b.Except loudspeaker 308, some embodiment of telepresence system 300 can comprise one or more extra auxiliary loudspeaker.Auxiliary loudspeaker can be used for patchery possibly can't visit the long-distance user of the video conference hardware of telepresence system or any kind.Auxiliary loudspeaker can be the part of IP phone 318, perhaps can be except as the loudspeaker any loudspeaker of the part of IP phone 318.Though loudspeaker 308 (perhaps its some parts) are visual in Fig. 2, in certain embodiments, loudspeaker 308 can visually be covered by sound-transparent screen or other assembly.This screen can be similar to the sound-transparent screen of using (for example, fabric or wire mesh (grill)) on many consumer loudspeakers on the material.In order to help to reduce the indication that telepresence system 300 is comprised loudspeaker 308, sound-transparent screen can cover the whole zone below the monitor 304.For example, can cover loudspeaker zone 340b (comprising loudspeaker 308b) with acoustic window material.
Can determine that from the foregoing description each long-distance user 322 can be associated with a monitor, a remote camera, a remote microphone and/or loudspeaker.For example, long-distance user 322c can be associated with monitor 304c, remote camera 306c, remote microphone 338c and/or loudspeaker 308c.More specifically, remote camera 306c can be aimed at the User Part that user 322c is taken a seat, so that on monitor 304c, show his image, and when he talks, microphone 338c can detect his language, these language subsequently when user 324 watches and listens attentively to long-distance user 322c via loudspeaker 308c by playback.Therefore, from local user 324 angle, just look like to be that long-distance user 322c is in together with local user 324 and holds telepresence system 300 accessorial visual meetings in the room the samely.
Another feature of some embodiment is to use and can strengthens the shown image of monitor 304 with the illumination that remote camera 306 and monitor 304 echo the ground designed/calibrated mutually, so that be presented at the approximate more long-distance user's 322 of color the actual color of the image of the long-distance user 322 on the monitor 304.Illumination can so that its color/temperature help compensation remote camera 306 is that caught and/or monitor 304 is reproduced color intrinsic any difference.For example, in certain embodiments, illumination can be controlled in about 4100 to 5000 Kelvins (Kelvin).Specific embodiment can not only be controlled the color/temperature of light, but also can stipulate to arrange.For example, the lighting apparatus of the above-head that is arranged in long-distance user 322 can be arranged to help to reduce position any shade thereon.This is even more important in the following cases: remote camera 306 is in long-distance user 322 the higher height in head top.The illumination that the remote camera of being arranged in 306 rears can also be arranged is so that the place ahead of lighting consumer 322 suitably.In a particular embodiment, lamp 314 can be installed in the rear of monitor 304 and below the top margin of monitor 304.In certain embodiments, reflector 316 can be positioned at after monitor 304 and the lamp 314, and can extend to outside the periphery of monitor 304.In certain embodiments, the part that extends to outside the monitor 304 of reflector 316 can have bending or arc, perhaps can be otherwise angled, and leave reverberation 316 and go to user 324 so that light is reflected.In a particular embodiment, can use filter to filter the light that generates from the rear of camera 306.Reverberation and filter both can be so that the long-distance user (for example be washed in the light of q.s, 300-500 lux (lux)), reduced dazzling (intrusiveness) level (for example, having the light bright spot that possibility causes long-distance user's 324 blinks) of light simultaneously.In addition, some embodiment can comprise the low gloss surface of desk 302.Low gloss surface can reduce the dazzling and reflection light quantity that is caused by desk 302.
Though can comprising, telepresence system 300 is designed to use two or more telepresence systems 300 to increase the certain characteristics of the personal experiences of visual conference, but telepresence system 300 can also comprise that the personal experiences that directly do not contribute to meeting still can contribute to the further feature of the general utility functions of telepresence system 300.For example, telepresence system 300 can comprise one or more cabinets 342.Cabinet 342 can provide the support to desk 302, and they can provide the memory location easily within the visual field that is not in camera 306.In certain embodiments, cabinet 342 can comprise door.
Another attribute of some embodiment can be an access door 326.Access door 326 can be the part of desk 302, and the one end comprises hinge 344, and the other end keeps free.Therefore, if the user wants to enter the middle open section (for example, in order to regulate camera 306, clean monitors 304 is perhaps picked up the something of the desk 302 that drops) of desk 302, he can enter by lifting freely bringing in of access door 326 at an easy rate.This has created the clear path that enters the mid portion of desk 302 by desk 302.
Another attribute of some embodiment can be to comprise outlet or network access port or socket.These sockets or port can be positioned at the top of desk 302, within the separator 336 or can be convenient or practical any other place.
The specific embodiment of telepresence system 300 is omissible to be visible a large amount of long-range or complicated control panels in typical high-end video conferencing system.On the contrary, many functions of telepresence system 300 can be from controlling such as the single phone of IP phone 318 (for example, 7970 of Cisco serial IP phone) and so on.By arrange the control to telepresence system 300 in IP phone, user 324b is presented the interface that may be familiar with him.This can minimize 300 related the defeating and chaotic amount of operation telepresence system.
In addition, in a particular embodiment, each assembly of telepresence system 300 can be used to carry out conventional video conference (for example, not having under the situation of available telepresence system at remote site) or standard telephone is called out.For example, user 324b can use the IP phone 318 of telepresence system 300 to send conventional person-to-person call, perhaps carry out typical audio conference call by activating microphone 310 and/or loudspeaker 308 (perhaps under applicable situation, auxiliary loudspeaker).
One of ordinary skill in the art will realize that telepresence system shown in Figure 2, telepresence system 300 only is an exemplary embodiment of telepresence system.Each assembly shown in Figure 2 and described above can be substituted, revises or replace to satisfy individual demand.For example, the size that can reduce telepresence system to be to adapt to less room, perhaps can use one, two, four or more groups of cameras, monitor, microphone and loudspeaker.In addition, though Fig. 2 only shows the unique user in each User Part, in any given User Part, have a plurality of users to take a seat and thereby the visual field at camera in and showing a plurality of users on the monitor also in the scope at specific embodiment.As another example, can replace monitor 304 with the blank screen of using in conjunction with projecting apparatus.
The local exemplary remote that Fig. 3 illustrates the each several part that comprises the long-range telepresence system of watching by local display presents the perspective view of system.Fig. 4 illustrates the top view of camera, display and desk that exemplary remote shown in Figure 3 presents system.
Camera 406 can be echoed the location, ground mutually with monitor 404 and be aimed at optimized eye gaze.This has increased the personal experiences of communicating by letter with long-distance user 422, and makes and can determine where the long-distance user is just seeing simpler, easier, more natural and more accurately.Telepresence system 400 can comprise or control many variablees that the eyes that can be used for the optimization long-distance user are watched attentively.For example, monitor 404 can be towards the desk front center in (place that the user takes a seat) angled.In a particular embodiment, monitor 404a and 404c can be angled towards the User Part that local user 424 is just taking a seat, so that angle a1 is similar between 10 and 20 degree (for example, 15 degree), and angle a2 is similar between 10 and 20 degree (for example, 15 degree).
As mentioned above, the eyes quality of watching attentively can be controlled by the position of camera 406.The camera 406 of telepresence system 400 can be positioned such that they enough watch attentively and can excessively not cover the long-distance user 422b that for example is presented on the monitor 404b and the image of 422c so that can accurately catch local user's eyes near the center (vertical centre and horizontal center) of the monitor 404a of telepresence system 400.In certain embodiments, camera 406 can be positioned at the horizontal mid-point of monitor 404b and below the top margin of monitor 404b apart from the d1 place.Can be apart from d1 enough greatly to allow camera 406 enough low to when local user 424 is just seeing long- distance user 422b and 422c, local user 424 is just seeing that the situation of long- distance user 422b and 422c appears on the remote monitor 404b.Physical length apart from d1 can depend on for example following factor: the distance between the size of monitor 404 and/or user 424 and the camera 406.In addition, in certain embodiments, camera 406 can be located in horizontal mid-point, thereby the eyes that prevent long- distance user 422b and 422c are watched attentively and distortion or misalignment are occurred.
The consistency that the eyes of long- distance user 422b and 422c are watched attentively can part realize by following manner: aim at the axis of remote camera 406b so that it is perpendicular with the front at the desk 430 of the midpoint of the User Part that is associated with remote camera 406b.Similarly, thus remote camera 406a and 406c can be aligned with the front at the desk 430 of the midpoint of their User Parts separately perpendicular.More specifically, the axis of camera 406a and 406c can be respectively to a left side and the right angle (for example, 33 degree) that becomes to be similar between 30 and 36 degree of the axis of camera 406b.This has not only increased effect and accuracy that eyes are watched attentively, but also a plurality of users in the permission viewing field of camera are aligned focus and (for example have approximately equalised ratio, if two user's stature sizes are approximate identical, then they can present identical size on monitor).
The consistency that the eyes of user in the different user part on being presented at different monitors are watched attentively also can realize by the rotary alignment of camera.For example, relative to each other the rotary alignment remote camera 406, so that may can be rendered as consecutive image across any of a plurality of monitors, and can be not twisted.Therefore, straight line (for example, the lines that joint produced of wall and ceiling) in the time of on being displayed on monitor 404a and 404b can be straight, rather than these lines seem to be inclined upwardly in monitor 404a and seem downward-sloping in monitor 404b.
Mention indirectly that as above another aspect that the quality that may watch attentively eyes and accuracy produce the telepresence system 400 of contribution is the shape and the position of desk 402.The shape of local desk 402 and position can with the aligning and the location harmony mutually of this ground camera 406 and remote monitor 404, so that the image that is presented on the remote monitor 404 appears to directly with their communication long-distance user 422, just look like to be that the local user is in the same room with the long-distance user and uses same desk the same.By design size, angle and the position of local desk 402 in conjunction with this ground camera 406, telepresence system 400 can increase the possibility of following situation: the local user of system will present complete ratio, be aligned focus and throw correct eyes to the long-distance user and watch attentively by remote monitor 404.By making desk 402 and camera 406, can adjust the focusing territory of camera 406 at a distance of preset distance.In addition, known dimensions by known distance between combination table 402 and this ground camera 406 and remote monitor 404, can adjust the convergent-divergent of this ground camera 406, so that their image presents complete ratio (remembering that this convergent-divergent can depend on distance between remote camera and the long-distance user and the size of local monitor) in remote monitor 404.
Because long-distance user 422 image was can be both proportional fully but also be aligned focus, so the local user can determine quickly and accurately relatively easily where long-distance user 422 is just seeing.The eyes that telepresence system 400 is created are watched attentively and can be similar to the eyes that may exist in the personal session and watch attentively.More specifically, work as the long-distance user, for example long-distance user 422a is seeing that remote object (for example, be arranged in the something of the website identical or someone with the long-distance user) time, being presented at his eyes on the monitor 404a watches attentively to be orientated and makes local user 424 can be easy to discern the remote object (if perhaps this remote object is then discerned the direction of this remote object not in the visual field of any remote camera 406) that long-distance user 422 is just seeing.Similarly, the image of seeing local target as long-distance user 422a (for example, just be presented on one of remote monitor 404 from the something of site-local or someone) time, be presented at his eyes on the monitor 404a and watch attentively to be orientated and make local user 424 can be easy to discern the local target that long-distance user 422a is just seeing.In addition, in certain embodiments, the accuracy that eyes are watched attentively can not can owing to the discontinuous of the image of each monitor reduces.This can be because the aligning of remote camera 406 and local monitor 404 can be so that the visual field overlap or any unclear gap.More specifically, for example any gap between the visual field of remote camera 406a and 406b can be corresponding to the gap d 2 of the equal sizes between the screen of monitor 404a and 404b.In addition, because the front of the remote table 430 that the axis of remote camera 406 can partly be located with each relative users is perpendicular, and because the rotation of remote camera 406 can be set, so can seldom have or not twisted to the image of next monitor from a monitor.Therefore, touch long-distance user 422b if long-distance user 422a stretches out one's hand, the arm of user 422a can not present unusual long and short or disconnection.
In certain embodiments, desk 402 can comprise separator, these separators are positioned to prevent that the user from shifting out the visual field of camera (for example, half of their health is presented on the monitor, and second half of their health is presented on the adjacent monitor) whole or in part.In a particular embodiment, constraint can comprise the assembly that couples with desk 402, and this assembly can be so that sit in the place ahead of separator or can be uncomfortable during near separator, perhaps can be so that be difficult to work during on separator or near separator.In certain embodiments, constraint can comprise the ground plate features, this ground plate features makes can be very difficult or uncomfortable outside the visual field that chair is placed on or moves to camera.By preventing that the local user from sitting in outside the qualifying part, can reduce and can eliminate each meeting of having nothing for it but in certain embodiments and adjust the needs that the aligning of camera is watched attentively with the optimization eyes.Can also assist in ensuring that the local user can be because of carelessness be sitting in the gap between the visual field of two adjacent cameras, perhaps otherwise remove they self whole or in part from the visual field of camera.
What Fig. 5 illustrated according to a present invention specific embodiment separates (partition) type separator.Partition dividers 40 can be designed as and prevents that one or more users from moving to outside the visual field of their corresponding camera.May be especially suitable when there is a plurality of user in this in the visual field of single camera because of the space of the required increase of a plurality of users.
In certain embodiments, separator 40 can be integrated into supporting structure 43.Supporting structure 43 can support table top 44.Separator 40 can be integrated into the supporting structure 43 of only selecting number, and perhaps they can be integrated in all supporting structures 43.The accurate number of the supporting structure that separator 40 is integrated into can depend on the number of the supporting structure that is used for support table top 44 and type and the required camera or the number of User Part.For example, in Fig. 2, desk 302 can be supported by cabinet 342 and separator 336, and may need to provide three User Parts.In this case, may only need to comprise two partitions on separator 336a and 336b respectively, and make cabinet 342 as the leftmost side of desk 302 and the separator of the rightmost side.In another example, desk can by some supporting structures (for example, may not can excessively occupy the space of the leg below the desk or relatively the space of this leg can not seem heavy supporting structure) support and still only need three User Parts.In this case, may wish to comprise partition 40 on two supporting structures between three User Parts (for example, desk changes the point of its angle).Remember that in certain embodiments, specific user's part can be consistent with the visual field of respective camera.
In a particular embodiment, partition 40 can comprise the rigid member 42 that centers on flexible foam plastic outer cover 41.Depend on embodiment, rigid member 42 can extend to outside the limit of table top 44, and it can be by (stop short) place, limit in table top 44, and perhaps it can just extend on the limit of table top 44.No matter how much length of rigid member 42 is, it can center on flexible foam plastic outer cover 41.Outer cover 41 both can provide benefit attractive in appearance that safety/comfortable benefit can also be provided.Outer cover 41 can increase the large volume of partition 40, and this can increase it and separates effect.
In certain embodiments, rigid member 42 and outer cover 41 boths can extend to the floor from the lower surface of table top 44 always.The specific embodiment of partition 40 can comprise outlet 45 and network outlet 46.Outlet 45 can provide the convenience point that is connected the various electronic equipments such as kneetop computer to the user with network outlet 46.Some embodiment can only comprise one of outlet 45 or network outlet 46 or all not comprise.Similarly, some embodiment can comprise a plurality of outlets 45 and/or network outlet 46.
Fig. 6 illustrates perforated area separator and uneven surface type separator.These be can be table top 54 upper surface a part or be couple to two examples of two class separators of the upper surface of table top 54.Though should be noted that in Fig. 6, separator 51 and 52 and inequality in most of embodiment, though they are not always, also will be similar usually.
Perforated area 51 can comprise some eyelets or perforation, and they can be so that be difficult to write in this zone.May be because attempt in perforated area 51, to write than the difficulty more of on table top 54, writing, so the user may tend to be sitting in the place ahead rather than the perforated area 51 of table top 54.Have a plurality of circular ports though perforated area 51 is shown as, other embodiment can comprise square hole, long otch, mesh surface, perhaps can be difficult to or inconvenient any other perforation so that write in perforated area 51.
Perforated area 51 and uneven surface zone 52 boths can comprise and use assembly or the feature made from table top 54 same materials that perhaps they can be made with the different materials such as contrast material.The use of different contrast section bar material can also be indicated specific user's portion boundary.In a particular embodiment, local separator 51 and 52 can not seen by the long-distance user, because local separator can be positioned in the horizontal clearance between the vertical edges in the visual field of this ground camera.
As mentioned above, perforated area 51 and uneven surface 52 only are two examples of two dissimilar separators that can be integrated into the upper surface of table top 54.Specific embodiment has been imagined the separator in the table top 54 of being integrated into of many other types, for example, uses non-rigid area or gap.In addition, all kinds of separators can comprise many variants, and for example, non-rigid area can comprise soft foam or elastomeric material, and this material can extend the whole width of table top 54, perhaps can cover the some parts of the width of table top 54.In addition, though should be noted that and abovely mentioned once that may not wish to have each separator did not match that (for example, separator is the punching surface, and another separator is the gap) desk, but also can wish the multiclass separator is combined into single separator together.For example, the outstanding either side that can stand on non-rigid area of the projection of uneven surface 52.
Fig. 7 illustrates the rigid type separator that is positioned on the floor, and Fig. 8 illustrates recessed (indentation) type separator that is positioned on the floor.Fig. 7 and 8 is the examples that can be integrated into the separator on floor.Be similar to the purpose of the separator in Fig. 5 and 6, the purpose of floor divider can be by preventing that the user from helping make the user to remain in the visual field of camera along the visual field that desk laterally moved and shifted out respective camera.More specifically, floor divider can prevent laterally moving along desk by making the user be difficult to that their chair is moved through floor divider.
In certain embodiments, ridges 61 can and the visual field of two adjacent cameras between horizontal clearance align.The shape of ridges 61 can be different according to embodiment.For example, ridges 61 can be sphere, angled or smooth.Similarly, the height of ridges 61 and width also can change.In a particular embodiment, ridges 61 can extend under the table top 64, in certain embodiments, ridges 61 can place, the front of table top 64 or before end.Because ridges 61 is given prominence to more than the floor level,, the user moves past ridges 61 so can finding the chair that is difficult to them.When this with stay in common user's propensity within the limited boundary when combined, ridge 61 can be used to prevent that the user from leaving the visual field that is associated with their User Part separately.
Recessed 71 can be similar to the center of the visual field that is positioned at each User Part and/or each camera.Depend on embodiment, recessed 71 limit 72 can be angled, circular or vertical.Recessed 71 the degree of depth and shape can change between different embodiment similarly.For example, limit 72 can be left table top 74 and extends by angle, and it can be similar to the limit of the visual field of respective camera, and perhaps they can be straight (with the fronts of table top 74 perpendicular and be parallel to each other) or therebetween Anywhere.Recessed can extend to table top below 74, perhaps its can the place, front of table top 74 or before end.Because user's chair can be in recessed 71, and the lower surface of recessed 71 limit from recessed 71 extends upward, and moves on to outside recessed 71 so the user may find the chair that is difficult to them.When this with stay in common user's propensity within the limited boundary when combined, recessed 71 can be used to prevent that the user from leaving the visual field that is associated with their User Part separately.
Because ridge 61 and recessed 71 has been created uneven floor, in certain embodiments, recessed 71 limit and ridge 61 can be painted or decorative pattern uniquely.This can help when the user walks about in the room thereby their attentiveness is attracted to separator and can helps prevent to trip.
Ridge 61 and recessed 71 only be can in conjunction with telepresence system use in order to prevent that the user from leaving two class separators of the visual field of camera.The present invention has imagined the separator that is integrated into the floor of many other types.For example, telepresence system can comprise heavy back blanket floor, and wherein, the rigid surface zone is designed to encourage the user to be retained on the rigid surface and thereby is retained in the visual field of camera.
Fig. 9 illustrates the configuration of local loudspeaker and display.Loudspeaker 808a can be associated with monitor 804a and microphone 838a; Loudspeaker 808b can be associated with monitor 804b and microphone 838b; And loudspeaker 808c can be associated with monitor 804c and microphone 838c.As mentioned above, microphone 838 can be the directional microphone that can interconnect so that can by sound the microphone at loud place detect and send sound.This can allow to reproduce the sound of long-range establishment by single loudspeaker 808.Though loudspeaker 808 are shown in monitor below 804, in a particular embodiment, they can be positioned on the monitor 804 or afterwards.In a particular embodiment, loudspeaker can be positioned at the both sides of monitor 804.Being arranged in an embodiment of the both sides of monitor 804 at loudspeaker, can be loudspeaker to be arranged between adjacent monitor, for these two monitors are shared.If for example remote microphone 838a detects sound, then this sound can be by reproducing at first loudspeaker in the left side of monitor 804a and second loudspeaker between monitor 804a and 804b; If for example remote microphone 838b detects sound, then this sound can reproduce by second loudspeaker and the 3rd loudspeaker between monitor 804b and 804c; And if for example remote microphone 838c detects sound, then this sound can reproduce by the 3rd loudspeaker between monitor 804b and 804c and the 4th loudspeaker on the right side of monitor 804c.
In certain embodiments, microphone 838 can attach to desk 830.For example, microphone 838 can be positioned and attached so that they from their arbitrary limit of appropriate section of desk 830 equidistant and from the front of desk 830 backward between 30 and 50 centimetres.Therefore, if in the identical User Part that two users are in microphone 838a is associated, then microphone 838a can detect the sound from two users equivalently.The location of the microphone between two users allows each user to have the personal work zone, shares microphone and do not disturb their working region in this personal work zone.For example, the user can have the laptop computer at the either side of microphone separately.Do not attached among those embodiment of desk 830 restriction of the length that moves the cable that can be attached to it of microphone 838 at microphone 838.This can help prevent microphone 838 to be moved to outside their the relative users part, and can help prevent and obscure microphone.
No matter whether microphone 838 is attached to desk 830, and they can comprise extra feature, and for example in certain embodiments, microphone 838 can comprise mute button.Specific embodiment can also comprise LED, and this LED is luminous to be muted with the indication microphone.In a particular embodiment, microphone 838 can comprise the silk screen screen, and it can help prevent air to upset.Some embodiment can also be included in perforate (open-cell) foam layer below the silk screen screen, flow into microphone in order to prevent air.In addition, in certain embodiments, microphone 838 can be a lapel mike.This can help to reduce the influence that the sound of desk is left in reflection.
By utilizing some (for example, separator prevents from laterally to move the aligning of camera) in position fixing or relatively-stationary microphone 838 and above-mentioned other various features, telepresence system can be created the sound specific to the position.This is preferably by being conceived to the long-range various relevance/reciprocations that present assembly of single group.Because microphone 838a can be in the fixed position, perhaps in limited relatively zone, and this position can be in the visual field of the certain camera that image is provided for monitor 804a, so loudspeaker 808a can reproduce the sound that send in (for example, the zone in the visual field that the camera that is presented at the image on the monitor 804a is provided) from the peripheral region of microphone 838a.More specifically, if user 822a speech, then its voice can be detected by microphone 838a, and are detected by microphone 838b on less degree.Telepresence system can filtering or is otherwise removed more weak sound from the voice of the user 822a of microphone 838b.So, user 822 voice can along be presented on the monitor 804a he the moving of image (for example, moving to point to individually defined thing) along with his face moves to form language or his hand and reproduced by loudspeaker 808a in this locality.By reproducing user 833 voice via loudspeaker 808a, the local user can discern apace loudspeaker where be positioned at (people's ear can accurately be positioned at the sound source on edge-to-edge (side-to-side) direction) thus and discern which user in speech.
Microphone 838 not only can filter by other microphone 838 detected sound, and in a particular embodiment, they can also filter or remove the sound of other type.For example, detect that sound is hit in very big kowtowing but other microphone does not all detect and kowtows under the situation of hitting at microphone 838b, can suppose to kowtow hit on the comfortable microphone or near kowtow the local user 822b that hits its finger.This undesirable noise can be filtered or remove.The another kind of sound that some embodiment may be able to remove is the sound that something (for example, paper) was dragged microphone.
The present invention has imagined element and the configuration of their intraware and the very big flexibility in the design in the telepresence system.Those skilled in the art can determine many other changes, substitute, change, change and revising, and the invention is intended to include all these changes in the spirit and scope that drop on appended claims, substitute, change, change and revising.
Claims (24)
1. one kind provides in telepresence system specific to the system of the sound of position, comprising:
A plurality of remote microphone, each remote microphone is associated with respective regions, and can operate at least one user's voice that is used for according in the described respective regions and generate voice signal;
A plurality of remote camera, each remote camera is associated with corresponding remote microphone in described a plurality of remote microphone, and is aligned to generate the image of its associated respective area;
A plurality of local displays, each local display can be operated the image that is used to reproduce the respective regions that is generated by respective remote camera; And
A plurality of local loudspeaker, each local loudspeaker are oriented to corresponding local display, and can operate the voice signal that is used to reproduce according at least one user's voice in the described respective regions that is reproduced by described corresponding local display.
2. the system as claimed in claim 1, wherein, described a plurality of remote microphone comprise a plurality of sensing remote microphone.
3. the system as claimed in claim 1, wherein, described a plurality of remote microphone comprise a plurality of heart-shaped remote microphone of pointing to.
4. the system as claimed in claim 1, wherein, described a plurality of remote microphone comprise a plurality of super heart-shaped sensing remote microphone.
5. the system as claimed in claim 1, wherein, described a plurality of remote microphone comprise that a plurality of more high-orders point to remote microphone.
6. the system as claimed in claim 1, wherein, described a plurality of remote microphone comprise a plurality of compact remote microphones.
7. the system as claimed in claim 1 also comprises filter, and this filter can be operated and be used for from removing undesired sound by the detected sound of described a plurality of remote microphone.
8. system as claimed in claim 7, wherein, described undesired sound comprises by the detected sound of two remote microphone in described a plurality of remote microphone at least, have different amplitudes at each detected sound in remote microphone place, described undesired sound is the sound that has more by a small margin.
9. the system as claimed in claim 1, wherein, each local loudspeaker be positioned in the corresponding local display pressed close to below.
10. the system as claimed in claim 1, wherein, each local loudspeaker be positioned in the corresponding local display pressed close to above.
11. the system as claimed in claim 1, wherein, each local loudspeaker are positioned in the side of the corresponding local display of being pressed close to so that each local display has at least one local loudspeaker in each side.
12. the system as claimed in claim 1, wherein, each remote microphone that is associated with respective regions comprises the remote microphone that couples with desk, and wherein, described desk is across each respective regions.
13. one kind provides the sound method specific to the position, comprising in telepresence system:
Generate voice signal according at least one user's voice in the respective regions, described voice signal is generated by at least one remote microphone in a plurality of remote microphone, and each remote microphone is associated with respective regions;
Aim at a plurality of remote camera generating the image of associated respective area, each remote camera is associated with corresponding remote microphone in described a plurality of remote microphone;
The image of the respective regions that is generated by respective remote camera is reproduced at each local display place in a plurality of local displays; And
Reproduce the voice signal according at least one user's voice in the described respective regions that is reproduced by described corresponding local display, each local loudspeaker are oriented to corresponding local display.
14. method as claimed in claim 13, wherein, described a plurality of remote microphone comprise a plurality of sensing remote microphone.
15. method as claimed in claim 13, wherein, described a plurality of remote microphone comprise a plurality of heart-shaped remote microphone of pointing to.
16. method as claimed in claim 13, wherein, described a plurality of remote microphone comprise a plurality of super heart-shaped sensing remote microphone.
17. method as claimed in claim 13, wherein, described a plurality of remote microphone comprise that a plurality of more high-orders point to remote microphone.
18. method as claimed in claim 13, wherein, described a plurality of remote microphone comprise a plurality of compact remote microphones.
19. method as claimed in claim 13 also comprises from by filtering undesired sound the detected sound of described a plurality of remote microphone.
20. method as claimed in claim 19, wherein, described undesired sound comprises by the detected sound of two remote microphone in described a plurality of remote microphone at least, have different amplitudes at each detected sound in remote microphone place, described undesired sound is the sound that has more by a small margin.
21. method as claimed in claim 13, wherein, each local loudspeaker be positioned in the corresponding local display pressed close to below.
22. method as claimed in claim 13, wherein, each local loudspeaker be positioned in the corresponding local display pressed close to above.
23. method as claimed in claim 13, wherein, each local loudspeaker are positioned in the side of the corresponding local display of being pressed close to so that each local display has at least one local loudspeaker in each side.
24. method as claimed in claim 13, wherein, each remote microphone that is associated with respective regions comprises the remote microphone that couples with desk, and wherein, described desk is across each respective regions.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US79401606P | 2006-04-20 | 2006-04-20 | |
| US60/794,016 | 2006-04-20 | ||
| US11/483,469 | 2006-07-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101427574A true CN101427574A (en) | 2009-05-06 |
Family
ID=40518510
Family Applications (5)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200780007846.6A Active CN101401109B (en) | 2006-04-20 | 2007-04-17 | System and method for displaying users in a visual conference between locations |
| CN200780013988.3A Expired - Fee Related CN101427232B (en) | 2006-04-20 | 2007-04-17 | System and method for controlling a telepresence system |
| CNA2007800141671A Pending CN101467448A (en) | 2006-04-20 | 2007-04-18 | System and method for enhancing eye gaze in a telepresence system |
| CN200780013978XA Active CN101536511B (en) | 2006-04-20 | 2007-04-18 | System and method for single action initiation of a video conference |
| CNA2007800141474A Pending CN101427574A (en) | 2006-04-20 | 2007-04-19 | System and method for providing location specific sound in a telepresence system |
Family Applications Before (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200780007846.6A Active CN101401109B (en) | 2006-04-20 | 2007-04-17 | System and method for displaying users in a visual conference between locations |
| CN200780013988.3A Expired - Fee Related CN101427232B (en) | 2006-04-20 | 2007-04-17 | System and method for controlling a telepresence system |
| CNA2007800141671A Pending CN101467448A (en) | 2006-04-20 | 2007-04-18 | System and method for enhancing eye gaze in a telepresence system |
| CN200780013978XA Active CN101536511B (en) | 2006-04-20 | 2007-04-18 | System and method for single action initiation of a video conference |
Country Status (1)
| Country | Link |
|---|---|
| CN (5) | CN101401109B (en) |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011120407A1 (en) * | 2010-03-30 | 2011-10-06 | 华为终端有限公司 | Realization method and apparatus for video communication |
| WO2012055291A1 (en) * | 2010-10-26 | 2012-05-03 | 中兴通讯股份有限公司 | Method and system for transmitting audio data |
| CN102655584A (en) * | 2011-03-04 | 2012-09-05 | 中兴通讯股份有限公司 | Media data transmitting and playing method and system in tele-presence technology |
| US8836753B2 (en) | 2010-12-24 | 2014-09-16 | Huawei Device Co., Ltd. | Method, apparatus, and system for processing cascade conference sites in cascade conference |
| CN104584539A (en) * | 2012-08-24 | 2015-04-29 | 高通股份有限公司 | Person identification within video call |
| CN106605196A (en) * | 2014-09-02 | 2017-04-26 | 苹果公司 | Remote camera user interface |
| US10122931B2 (en) | 2015-04-23 | 2018-11-06 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US10136048B2 (en) | 2016-06-12 | 2018-11-20 | Apple Inc. | User interface for camera effects |
| US10135905B2 (en) | 2014-07-21 | 2018-11-20 | Apple Inc. | Remote user interface |
| US10579225B2 (en) | 2014-09-02 | 2020-03-03 | Apple Inc. | Reduced size configuration interface |
| US10645294B1 (en) | 2019-05-06 | 2020-05-05 | Apple Inc. | User interfaces for capturing and managing visual media |
| US10887193B2 (en) | 2018-06-03 | 2021-01-05 | Apple Inc. | User interfaces for updating network connection settings of external devices |
| US11054973B1 (en) | 2020-06-01 | 2021-07-06 | Apple Inc. | User interfaces for managing media |
| US11080004B2 (en) | 2019-05-31 | 2021-08-03 | Apple Inc. | Methods and user interfaces for sharing audio |
| US11079894B2 (en) | 2015-03-08 | 2021-08-03 | Apple Inc. | Device configuration user interface |
| US11112964B2 (en) | 2018-02-09 | 2021-09-07 | Apple Inc. | Media capture lock affordance for graphical user interface |
| US11128792B2 (en) | 2018-09-28 | 2021-09-21 | Apple Inc. | Capturing and displaying images with multiple focal planes |
| US11212449B1 (en) | 2020-09-25 | 2021-12-28 | Apple Inc. | User interfaces for media capture and management |
| US11301130B2 (en) | 2019-05-06 | 2022-04-12 | Apple Inc. | Restricted operation of an electronic device |
| US11321857B2 (en) | 2018-09-28 | 2022-05-03 | Apple Inc. | Displaying and editing images with depth information |
| US11468625B2 (en) | 2018-09-11 | 2022-10-11 | Apple Inc. | User interfaces for simulated depth effects |
| US11539831B2 (en) | 2013-03-15 | 2022-12-27 | Apple Inc. | Providing remote interactions with host device using a wireless device |
| US11706521B2 (en) | 2019-05-06 | 2023-07-18 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11770601B2 (en) | 2019-05-06 | 2023-09-26 | Apple Inc. | User interfaces for capturing and managing visual media |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102404541A (en) * | 2010-09-10 | 2012-04-04 | 中华电信股份有限公司 | Intelligent type video conference starting method |
| CN103096018B (en) | 2011-11-08 | 2016-11-23 | 华为技术有限公司 | The method of transmission information and terminal |
| US9369667B2 (en) * | 2012-04-11 | 2016-06-14 | Jie Diao | Conveying gaze information in virtual conference |
| US9900769B2 (en) * | 2015-05-29 | 2018-02-20 | Nagravision S.A. | Methods and systems for establishing an encrypted-audio session |
| CN110324554B (en) * | 2018-03-28 | 2021-08-13 | 北京富纳特创新科技有限公司 | Video communication apparatus and method |
| CN109547734A (en) * | 2019-01-02 | 2019-03-29 | 姚树财 | A kind of long-range presentation device of involvement Formula V R video conference and system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5491797A (en) * | 1992-11-30 | 1996-02-13 | Qwest Communications | Schedulable automatically configured video conferencing system |
| US5689641A (en) * | 1993-10-01 | 1997-11-18 | Vicor, Inc. | Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal |
| US5483587A (en) * | 1994-06-08 | 1996-01-09 | Linkusa Corporation | System and method for call conferencing |
| AU768509B2 (en) * | 1999-03-04 | 2003-12-18 | Rovi Guides, Inc. | Multiple interactive electronic program guide system and methods |
| CN1278538C (en) * | 2003-02-26 | 2006-10-04 | 北京艾尼通科技有限公司 | Access method of fixed phone/mobile phone/IP phone to IP video conference system |
-
2007
- 2007-04-17 CN CN200780007846.6A patent/CN101401109B/en active Active
- 2007-04-17 CN CN200780013988.3A patent/CN101427232B/en not_active Expired - Fee Related
- 2007-04-18 CN CNA2007800141671A patent/CN101467448A/en active Pending
- 2007-04-18 CN CN200780013978XA patent/CN101536511B/en active Active
- 2007-04-19 CN CNA2007800141474A patent/CN101427574A/en active Pending
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011120407A1 (en) * | 2010-03-30 | 2011-10-06 | 华为终端有限公司 | Realization method and apparatus for video communication |
| WO2012055291A1 (en) * | 2010-10-26 | 2012-05-03 | 中兴通讯股份有限公司 | Method and system for transmitting audio data |
| US8836753B2 (en) | 2010-12-24 | 2014-09-16 | Huawei Device Co., Ltd. | Method, apparatus, and system for processing cascade conference sites in cascade conference |
| CN102655584A (en) * | 2011-03-04 | 2012-09-05 | 中兴通讯股份有限公司 | Media data transmitting and playing method and system in tele-presence technology |
| US9363474B2 (en) | 2011-03-04 | 2016-06-07 | Zte Corporation | Method and system for sending and playing media data in telepresence technology |
| US9532000B2 (en) | 2011-03-04 | 2016-12-27 | Xi'an Zte New Software Company Limited | Method and system for sending and playing media data in telepresence technology |
| CN104584539A (en) * | 2012-08-24 | 2015-04-29 | 高通股份有限公司 | Person identification within video call |
| US11539831B2 (en) | 2013-03-15 | 2022-12-27 | Apple Inc. | Providing remote interactions with host device using a wireless device |
| US10135905B2 (en) | 2014-07-21 | 2018-11-20 | Apple Inc. | Remote user interface |
| US11604571B2 (en) | 2014-07-21 | 2023-03-14 | Apple Inc. | Remote user interface |
| US11609681B2 (en) | 2014-09-02 | 2023-03-21 | Apple Inc. | Reduced size configuration interface |
| US10200587B2 (en) | 2014-09-02 | 2019-02-05 | Apple Inc. | Remote camera user interface |
| US10579225B2 (en) | 2014-09-02 | 2020-03-03 | Apple Inc. | Reduced size configuration interface |
| US10936164B2 (en) | 2014-09-02 | 2021-03-02 | Apple Inc. | Reduced size configuration interface |
| CN106605196A (en) * | 2014-09-02 | 2017-04-26 | 苹果公司 | Remote camera user interface |
| US11079894B2 (en) | 2015-03-08 | 2021-08-03 | Apple Inc. | Device configuration user interface |
| US11102414B2 (en) | 2015-04-23 | 2021-08-24 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US11490017B2 (en) | 2015-04-23 | 2022-11-01 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US10616490B2 (en) | 2015-04-23 | 2020-04-07 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US10122931B2 (en) | 2015-04-23 | 2018-11-06 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US11711614B2 (en) | 2015-04-23 | 2023-07-25 | Apple Inc. | Digital viewfinder user interface for multiple cameras |
| US11641517B2 (en) | 2016-06-12 | 2023-05-02 | Apple Inc. | User interface for camera effects |
| US11245837B2 (en) | 2016-06-12 | 2022-02-08 | Apple Inc. | User interface for camera effects |
| US10136048B2 (en) | 2016-06-12 | 2018-11-20 | Apple Inc. | User interface for camera effects |
| US10602053B2 (en) | 2016-06-12 | 2020-03-24 | Apple Inc. | User interface for camera effects |
| US11962889B2 (en) | 2016-06-12 | 2024-04-16 | Apple Inc. | User interface for camera effects |
| US11165949B2 (en) | 2016-06-12 | 2021-11-02 | Apple Inc. | User interface for capturing photos with different camera magnifications |
| US11112964B2 (en) | 2018-02-09 | 2021-09-07 | Apple Inc. | Media capture lock affordance for graphical user interface |
| US10887193B2 (en) | 2018-06-03 | 2021-01-05 | Apple Inc. | User interfaces for updating network connection settings of external devices |
| US11468625B2 (en) | 2018-09-11 | 2022-10-11 | Apple Inc. | User interfaces for simulated depth effects |
| US11669985B2 (en) | 2018-09-28 | 2023-06-06 | Apple Inc. | Displaying and editing images with depth information |
| US11128792B2 (en) | 2018-09-28 | 2021-09-21 | Apple Inc. | Capturing and displaying images with multiple focal planes |
| US11895391B2 (en) | 2018-09-28 | 2024-02-06 | Apple Inc. | Capturing and displaying images with multiple focal planes |
| US11321857B2 (en) | 2018-09-28 | 2022-05-03 | Apple Inc. | Displaying and editing images with depth information |
| US11301130B2 (en) | 2019-05-06 | 2022-04-12 | Apple Inc. | Restricted operation of an electronic device |
| US10645294B1 (en) | 2019-05-06 | 2020-05-05 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11223771B2 (en) | 2019-05-06 | 2022-01-11 | Apple Inc. | User interfaces for capturing and managing visual media |
| US10681282B1 (en) | 2019-05-06 | 2020-06-09 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11340778B2 (en) | 2019-05-06 | 2022-05-24 | Apple Inc. | Restricted operation of an electronic device |
| US10735642B1 (en) | 2019-05-06 | 2020-08-04 | Apple Inc. | User interfaces for capturing and managing visual media |
| US10735643B1 (en) | 2019-05-06 | 2020-08-04 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11706521B2 (en) | 2019-05-06 | 2023-07-18 | Apple Inc. | User interfaces for capturing and managing visual media |
| US10791273B1 (en) | 2019-05-06 | 2020-09-29 | Apple Inc. | User interfaces for capturing and managing visual media |
| US10674072B1 (en) | 2019-05-06 | 2020-06-02 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11770601B2 (en) | 2019-05-06 | 2023-09-26 | Apple Inc. | User interfaces for capturing and managing visual media |
| US10652470B1 (en) | 2019-05-06 | 2020-05-12 | Apple Inc. | User interfaces for capturing and managing visual media |
| US11080004B2 (en) | 2019-05-31 | 2021-08-03 | Apple Inc. | Methods and user interfaces for sharing audio |
| US11714597B2 (en) | 2019-05-31 | 2023-08-01 | Apple Inc. | Methods and user interfaces for sharing audio |
| US11157234B2 (en) | 2019-05-31 | 2021-10-26 | Apple Inc. | Methods and user interfaces for sharing audio |
| US11054973B1 (en) | 2020-06-01 | 2021-07-06 | Apple Inc. | User interfaces for managing media |
| US11617022B2 (en) | 2020-06-01 | 2023-03-28 | Apple Inc. | User interfaces for managing media |
| US11330184B2 (en) | 2020-06-01 | 2022-05-10 | Apple Inc. | User interfaces for managing media |
| US11212449B1 (en) | 2020-09-25 | 2021-12-28 | Apple Inc. | User interfaces for media capture and management |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101536511A (en) | 2009-09-16 |
| CN101427232A (en) | 2009-05-06 |
| CN101467448A (en) | 2009-06-24 |
| CN101401109A (en) | 2009-04-01 |
| CN101536511B (en) | 2012-11-14 |
| CN101427232B (en) | 2015-05-13 |
| CN101401109B (en) | 2013-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101496401B (en) | System and method for preventing movement in a telepresence system | |
| CN101427574A (en) | System and method for providing location specific sound in a telepresence system | |
| US8427523B2 (en) | System and method for enhancing eye gaze in a telepresence system | |
| US7692680B2 (en) | System and method for providing location specific sound in a telepresence system | |
| US10958871B2 (en) | System and methods for facilitating virtual presence | |
| US8947500B1 (en) | Telepresence camera system | |
| US8253770B2 (en) | Residential video communication system | |
| US8159519B2 (en) | Personal controls for personal video communications | |
| EP2024852A2 (en) | System and method for controlling a telepresence system | |
| US8154578B2 (en) | Multi-camera residential communication system | |
| US20040254982A1 (en) | Receiving system for video conferencing system | |
| US20080297588A1 (en) | Managing scene transitions for video communication | |
| US20080297589A1 (en) | Eye gazing imaging for video communications | |
| JP2006303997A (en) | Video conference system | |
| US20220247971A1 (en) | Virtual Digital Twin Videoconferencing Environments | |
| Roussel | Experiences in the design of the well, a group communication device for teleconviviality | |
| CN204145519U (en) | The interconnected conference system of a kind of small intelligent | |
| JP7306765B2 (en) | Communication device, communication program and storage medium | |
| Abler et al. | High Definition video support for natural interaction through distance learning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090506 |