WO2011124066A1 - 远程呈现系统及其摄像机组 - Google Patents

远程呈现系统及其摄像机组 Download PDF

Info

Publication number
WO2011124066A1
WO2011124066A1 PCT/CN2010/078646 CN2010078646W WO2011124066A1 WO 2011124066 A1 WO2011124066 A1 WO 2011124066A1 CN 2010078646 W CN2010078646 W CN 2010078646W WO 2011124066 A1 WO2011124066 A1 WO 2011124066A1
Authority
WO
WIPO (PCT)
Prior art keywords
adjacent
display
conference
devices
imaging
Prior art date
Application number
PCT/CN2010/078646
Other languages
English (en)
French (fr)
Inventor
吴衍平
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2011124066A1 publication Critical patent/WO2011124066A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • Telepresence technology is a technology for creating an immersive virtual conference environment, which fully reflects the humanization factors of participants, and gives the participants a real experience as much as possible, which can greatly improve the acceptance of the end users.
  • Telepresence systems have many advantages over traditional video conferencing systems, including: the ability to provide life-size images, eye contact, experience of remote participants' physical behavior, and high-definition The video and audio effects make the off-site participants feel at the same meeting site.
  • 1 is a plan view of a conference site of a remote presentation system according to the related art.
  • L1 is a right boundary line of an imaging area of the camera 204
  • L2 and L3 are left and right boundary lines of an imaging area of the camera 205, respectively. It is the left boundary line of the imaging area of the camera 206.
  • the adjustment cameras 204, 205, 206 cause the boundary lines of the imaging areas of the three cameras to intersect near the center line at the conference seats 218 and 219 of the local end.
  • the remote conference system in the related art has such a problem that the scene video in the area C of the local end appears in an overlapping manner in the remote display.
  • Method 1 Set a baffle or a wall surface at the intersection of the two sides of the conference table and the border of the adjacent imaging area to restrict the entry of the participants. Overlapping area activities.
  • the disadvantage of this solution is that the conference room has a small space available, and the participants are not free to move at the conference site.
  • the second method is to use a processing device dedicated to image cropping and splicing to scale the video captured by multiple cameras. , trimming, panning, and splicing, the overlapping display area is sent to the remote communication device after the special processing described above, and displayed on the remote display.
  • a primary object of the present invention is to provide a telepresence system and a device thereof to solve the problem that overlapping regions of adjacent cameras of the telepresence system in the related art may overlap.
  • a remote presentation system including: an audio collection device, a plurality of display devices, an audio output device, a multimedia communication terminal, a control device, and a plurality of imaging devices, wherein The imaging apparatus is configured to capture a local conference live image, and send the captured video image to the multimedia communication terminal, wherein the plurality of imaging devices are arranged such that boundary lines of adjacent imaging regions of the adjacent imaging devices are parallel to each other.
  • a camera set is provided for use in a telepresence system, comprising: a plurality of imaging devices, wherein the plurality of imaging devices are arranged such that boundary lines of adjacent imaging regions of adjacent imaging devices Parallel to each other.
  • the invention arranges a plurality of imaging devices of the telepresence system such that the boundary lines of the adjacent imaging devices of the adjacent imaging devices are parallel to each other, and solves the problem of the adjacent 4N image camera of the existing telepresence system.
  • There is an overlap problem there is no need to limit the actions of remote meeting participants, and there is no need to add expensive image-cutting and splicing equipment, which not only saves cost but also increases user experience.
  • FIG. 1 is a plan view of a site of a remote presentation system according to the related art
  • FIG. 2 is a plan view of a site of an application telepresence system according to an embodiment of the present invention
  • FIG. 3 is a view of a site according to an embodiment of the present invention
  • FIG. 2 is a top view of a conference site of an application remote presentation system according to an embodiment of the present invention, the system includes: an audio collection device, a plurality of display devices, an audio output device, a multimedia communication terminal, a control device, and a plurality of imaging devices, Wherein, the plurality of imaging devices are configured to capture a local conference scene image, and send the captured video image to the multimedia communication terminal, wherein the plurality of imaging devices are arranged such that adjacent 4 image regions of the adjacent 4 image device The boundary lines are parallel to each other.
  • a plurality of imaging devices are arranged such that an imaging area of an adjacent imaging device overlaps in a conference area.
  • the overlapping area is an area C, so that before the local conference scene is displayed at the remote end, It is necessary to cut and splicing the overlapping areas, or to set the baffle or wall surface to limit the range of activities of the participants, to avoid overlapping areas, and the related art all under the premise that the imaging area of the imaging device inevitably overlaps.
  • Use additional processing to shield the overlapping areas from being displayed at the far end.
  • the remote presentation system provided by the embodiment of the present invention, by arranging the shooting angles of the plurality of imaging devices, makes the boundary lines of adjacent imaging regions of the adjacent imaging devices parallel to each other, that is, the boundary lines L1 and L2 shown in FIG. Parallel, L3 and L4 are parallel to each other, there is no intersection, thus avoiding the overlap of 3 ⁇ 4 image areas from the source, so there is no need to limit the range of activities of the participants, and there is no need to add additional image cropping in the telepresence system. Splicing processing equipment.
  • each device in the above system may have the following functions: multiple imaging devices, used to capture a local conference scene image, and send the captured video image to the multimedia communication terminal, where the adjacent camera device
  • the adjacent imaging area boundary lines are parallel to each other.
  • the plurality of imaging devices are three imaging devices.
  • the entire conference site can be covered. As shown in FIG. 2, three cameras 204, 205, and 206 of left, center, and right are placed on the top of one display 202 in the middle of the three displays to meet the shooting requirements of the arc conference site. , thereby adding as many seats as possible within the limited venue space.
  • the right boundary line of the imaging area of the camera 204 is parallel to the left boundary line of the imaging area of the camera 205, and the right boundary line of the imaging area of the camera 205 is parallel to the left boundary line of the imaging area of the camera 206, thereby ensuring that the imaging areas of the three cameras do not overlap. , and thus the remote display does not require additional image cropping and stitching.
  • the audio collection device is configured to collect audio information of a local conference site, and send the collected audio signals to the multimedia communication terminal.
  • a plurality of display devices are configured to display video images of the remote conference site. As shown in FIG. 2, three displays 201, 202, and 203 are disposed on the desktop 207. The three displays are arranged at a certain angle between the two.
  • An audio output device for outputting an audio signal of a remote conference site such as a speaker
  • the position of the speaker is not shown in FIG. 2, but it can be understood that the speaker can be placed at a surrounding wall or other suitable location disposed at the venue.
  • the multimedia communication terminal is connected to the plurality of camera devices and the audio collection device, and is configured to process the received video data and audio data of the local conference site, and send the data to the remote communication terminal, and to the plurality of display devices and audio.
  • the output device is coupled to process video data and audio data of the received remote conference site, and display the video image of the far end through a plurality of display devices, and output the audio signal of the far end through the audio output device.
  • the multimedia communication terminal is not shown in FIG.
  • the control device is connected to the multimedia communication terminal, the plurality of camera devices, the audio collection device, the plurality of display devices, and the audio output device, for setting or adjusting the working state of each device, as shown in FIG. 2, at the dedicated conference table 212.
  • a control device 215 is disposed thereon.
  • the device provides a human-computer interaction interface and can provide the following functions:
  • the control device sets or adjusts the imaging area of the plurality of imaging devices such that the plurality of conference areas correspond to the plurality of imaging devices.
  • the control device sets or adjusts the imaging angles of the plurality of imaging devices such that the boundary lines of the adjacent imaging regions of the adjacent imaging devices are parallel to each other, and the main optical axes of the plurality of imaging devices are approximately vertical
  • the vertical plane of the field of view of the corresponding conference area is equally divided.
  • Control other auxiliary equipment at the conference site to work according to user requirements, such as lifting and lowering the desktop of the conference area, adjusting the angle or height of the carrier of the display device, and adjusting the brightness of the conference site.
  • the foregoing control device may be set at any position of the conference site without affecting the conference or the remote display. For example, it may be set at a conference seat or display device in a conference area, or may be set. In the machine room outside the venue.
  • the remote presentation system provided by the embodiment of the present invention avoids overlapping of the imaging areas of the plurality of imaging devices from the root cause, so that the video images collected by the plurality of imaging devices do not need to be processed, such as clipping, splicing, and translation.
  • the plurality of display devices at the remote end respectively display the conference site pictures of the corresponding camera devices, which do not affect each other, thereby ensuring the display quality of the remote display; there is no need to limit the activities of the participants.
  • the range which increases the user's experience, eliminates the need for additional image cropping and splicing devices, thereby reducing the cost of the telepresence system.
  • the pitch of the boundary lines of adjacent imaging regions parallel to each other corresponds to the inter-largeness of the display regions of the remote adjacent display devices.
  • the area between the boundary lines of adjacent imaging areas parallel to each other is the dead angle area of the filming, and the plurality of 4 image devices in the area cannot be photographed, so the remote display device cannot Displaying these dead zone areas, the dead zone can be handled by a particular cropping and splicing device, but this adds to the cost of the system.
  • the best solution is to block the display of these dead zones by using the interval between the display areas of the remote display devices (such as the border of the display). Therefore, the shooting range and shooting angle of multiple camera devices can be adjusted.
  • the parallel detection of the above-mentioned means solves the display problem of shooting the dead zone, effectively utilizing the physical characteristics of the remote display device to shield the display of the dead zone, thereby increasing the body-risk of the user.
  • the pitch of the boundary lines of adjacent imaging regions parallel to each other may be equal to the pitch of the display regions of the remote adjacent display devices.
  • a display device with a diagonal size of not less than 60 inches is usually used, so that the display device can display the far-end image picture in a ratio of 1:1.
  • the boundary of the imaging area of the adjacent imaging device will be The spacing between the two is adjusted to be equal to the spacing of the display area of the remote adjacent display device, and can be adapted to the size characteristics of the display device of such proportional display.
  • the spacing of the adjacent imaging area boundary lines parallel to each other is approximately zero.
  • the camera device may be adjusted to have a pitch or a camera. Angle, try to reduce the distance between the boundary lines of adjacent imaging areas that are parallel to each other, so that it is approximately 0, so as to adapt to the characteristics of the remote display device without edges.
  • each of the plurality of imaging devices corresponds to one conference area.
  • Each conference area can include multiple rows of conference seats, and each conference table is set up before the conference seats.
  • the conference can be set in the imaging region of each imaging device (ie, in the sector region within the two boundary lines of the imaging region) Area, conference tables and conference seats are arranged in this conference area.
  • This embodiment also makes full use of the characteristics of the infinite depth of field, so that each conference area can be arranged in multiple rows of seats.
  • the conference table and the conference chair can be arranged in a row, and the number of seats can be increased layer by layer, and several rows of seats can be specifically determined according to the depth of field of the camera. As shown in FIG.
  • dedicated conference tables 212 and 225 (two rows in front and rear) and three groups of user seats are placed opposite the desktop 207, which are left (216, 217) and (228, 229), and intermediate (218, respectively). 219), (230, 231, 232) and (220, 221), (233, 234) on the right.
  • the dedicated desktop faces the display in an approximately arcuate manner.
  • the meeting area corresponding to each of the 4 image devices is arranged in the above-mentioned form, which ensures that the seat of the corresponding area does not exceed the imaging area of the corresponding imaging device, and the site picture displayed at the far end is more prominent and important personnel, thereby improving the user's Experience.
  • the conference table of each conference area may also be provided with an auxiliary display and/or an audio collection device for displaying video images related to the conference, as shown in FIG. 2, at the dedicated conference table 212 and 225 desktops.
  • an auxiliary display and/or an audio collection device for displaying video images related to the conference, as shown in FIG. 2, at the dedicated conference table 212 and 225 desktops.
  • three liquid crystal displays 222, 223, 224 are placed on the dedicated conference table 212, and three liquid crystal displays 235, 236, 237 are placed on the dedicated conference table 225. Since the conference space may be very large, if the audio collection equipment is set up only somewhere or somewhere on the conference site, the sound collection effect may not be expected, so it is set up in the vicinity of the participants.
  • the audio collection device can ensure the sound collection effect.
  • audio collection devices can be set on each row of conference tables, and the number of audio collection devices specifically set on each conference table can be determined according to the number of seats in the row. For example, only two seats in the front row are provided. , you can set up an audio collection device (such as a microphone or microphone array), and there are multiple seats in the back row, then set up an audio collection device between each two seats.
  • the participants may need to know the image data related to the conference (such as video clips, slides, etc.), in this case, such as by painting
  • the method of drawing a picture displays the image data related to the meeting on one of the plurality of displays.
  • a preferred solution is to set up an auxiliary display on the conference table of each conference area to display auxiliary image data. More preferably, the auxiliary display can simultaneously display the video of a certain remote conference area. Of course, all auxiliary displays The display is also controlled by the above control device.
  • the remote presentation system provided by the embodiment of the present invention has more functions and a higher user experience.
  • the embodiment shown in FIG. 2 not only makes the local participants feel that the remote site personnel of the existing telepresence system are opposite to themselves, but also has the effect of real human size and listening voice.
  • the participants walked around the venue, they looked at the images on the three remote displays, and the actions were coordinated, for example, naturally disappeared from the right side of the left display 201, and then from the middle display.
  • the left side of 202 appears, the picture of the body part that does not appear on the left display 201 has not disappeared, and the part of the left side of the middle display 202 or the two parts of the body picture respectively located on the displays 201 and 202
  • the human eye feels distorted and the stitching is unnatural. It can be seen from the present embodiment that the number of participants is limited only by the physical space of the conference room and the depth of field of the camera itself, because the boundary line parallel technology of the imaging area is used.
  • a camera group is further provided, which is applied to a remote presentation system, including: a plurality of imaging devices, wherein the plurality of imaging devices are arranged such that adjacent imaging regions of the adjacent imaging devices are arranged The boundary lines are parallel to each other.
  • a camera group is further provided, which is applied to a remote presentation system, including: a plurality of imaging devices, wherein the plurality of imaging devices are arranged such that adjacent imaging regions of the adjacent imaging devices are arranged The boundary lines are parallel to each other.
  • the camera group provided by the embodiment of the present invention avoids overlapping of the image capturing areas of the plurality of image capturing devices from the root cause, so that the plurality of display devices respectively display the meeting scene images collected by the corresponding camera devices, which do not affect each other and are not repeated.
  • An area is displayed to ensure the display quality of the display.
  • the spacing of the boundary lines of adjacent imaging regions corresponds to the inter-largeness of the display regions of the remote adjacent display devices.
  • the area between the boundary lines of adjacent imaging areas parallel to each other is a dead zone of shooting. In this area, a plurality of 4 image devices cannot shoot 4, and the remote display device cannot display these dead zones, but can pass multiple displays.
  • the shooting range and the shooting angle of the plurality of imaging devices can be adjusted such that the pitch of the boundary lines of the adjacent imaging regions parallel to each other corresponds to the pitch of the display regions of the remote adjacent display devices.
  • the plurality of imaging devices are three imaging devices.
  • the camera group can be effectively applied to the telepresence system, ensuring the «_ range.
  • the camera group provided by the embodiment of the present invention is described in detail below through a specific embodiment.
  • 3 is a top plan view of a camera set applied to a telepresence system in accordance with an embodiment of the present invention. As shown in FIG. 3, the camera group includes three cameras, and the three cameras are arranged in the following characteristics:
  • the boundary lines of adjacent shooting areas are parallel to each other.
  • the area between two mutually parallel boundary lines is the area of the shot dead angle.
  • the parallel spacing of the boundary lines of adjacent shooting areas corresponds to the horizontal level between the effective display areas of adjacent display devices.
  • the parallel spacing may be equal to the horizontal spacing of the effective display area of the adjacent display device.
  • the physical distance of the display device is used to effectively block the shooting dead zone. If you use the whole wide-screen display device to display three conference areas shot by three device heads, you can't use the physical spacing of the display device to block the dead angle of the shooting. You can adjust the spatial angle and focal length of the three cameras. Under the premise that the boundary lines of adjacent shooting areas are parallel to each other, the parallel between the parallels is approximately 0.
  • the technical solution provided by the embodiment of the present invention effectively solves the problem that the adjacent camera shooting areas of the existing telepresence system overlap, and there is no need to limit the actions of the remote conference participants.
  • the above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the scope of the present invention are intended to be included within the scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了一种远程呈现系统及其摄像机组,该远程呈现系统包括:音频采集设备、多个显示设备、音频输出设备、多媒体通信终端、控制设备,以及多个摄像设备,用于拍摄本地会议现场图像,并将拍摄到的视频图像发送至所述多媒体通信终端,其中,上述多个摄像设备被布置成使得相邻摄像设备的相邻摄像区域的边界线相互平行。本发明中的远程呈现系统的多个摄像设备被布置成使得相邻摄像设备的相邻摄像区域的边界线相互平行,从而无需限制远程会议与会人员的行动,也无需增加昂贵的图像剪裁拼接设备。

Description

远程呈现系统及其才聂 组
技术领域 本发明涉及多媒体技术领域, 具体而言, 涉及一种远程呈现系统及其摄 像机组。 背景技术 远程呈现技术是一种创建沉浸式虚拟会议环境的技术, 该虚拟会议环境 充分体现了参与者的人性化因素, 尽可能地赋予参与人的真实体验, 能够极 大地提高最终用户的接受度, 从而提高使用率和用户满意度, 远程呈现系统 相比传统视频会议系统具有很多优点, 包括: 能够提供真人大小的图像, 实 现眼神交流, 体验远端与会者的肢体行为等, 并且可以提供高清的视频和音 频效果, 使异地与会者感觉处于同一会议现场。 图 1是根据相关技术的的应用远程呈现系统的会场俯视图,如图 1所示, L1为摄像机 204的摄像区域的右边界线, L2、 L3分别为摄像机 205的摄像 区域的左、 右边界线, L4为摄像机 206的摄像区域的左边界线。 现有的远程 会议系统, 调节摄像机 204、 205、 206使得三个摄像机的摄像区域的边界线 在本端的会议座椅处 218和 219处中心线处附近相交。 显而易见的, 相关技 术中的远程会议系统存在这样一个问题: 本端的区域 C中的场景视频会以重 叠的方式出现在远端的显示器中。 为规避上述区域 C的重叠显示问题, 相关技术通常釆用以下两种解决方 式: 方式一、在会议桌的两侧及相邻摄像区域边界线相交处设置挡板或墙面, 限制与会人员进入重叠区域活动。 这种解决方式的缺点是会议室可利用空间 很小, 并且与会人员不能自由地在会议现场移动; 方式二、 釆用专用于图像剪裁拼接的处理设备, 对多个摄像机釆集的视 频进行缩放、 剪裁、 平移以及拼接处理, 将重叠显示区域经过上述特殊处理 后发送至远端通信设备, 在远端显示器上显示。 这种解决方式的缺点是图像 处理复杂, 处理后容易出现图像失真, 并且专用于图像拼接的处理设备成本 过高 (市场上该类型设备价格超过 10万元;)。 综上所述, 相关技术只是通过额外手段解决相邻摄像机拍摄区域出现重 叠的显示问题, 但是均未提出如何避免相邻摄像机拍摄区域出现重叠的解决 方案。 发明内容 本发明的主要目的在于提供一种远程呈现系统及其 4聂像机组, 以解决相 关技术中远程呈现系统的相邻摄像机拍摄区域会出现重叠的问题。 才艮据本发明的一个方面, 提供了一种远程呈现系统, 包括: 音频釆集设 备、 多个显示设备、 音频输出设备、 多媒体通信终端、 控制设备, 以及多个 摄像设备, 其中, 多个摄像设备用于拍摄本地会议现场图像, 并将拍摄到的 视频图像发送至多媒体通信终端, 其中, 多个摄像设备被布置成使得相邻摄 像设备的相邻摄像区域的边界线相互平行。 根据本发明的另一方面, 提供了一种摄像机组, 应用于远程呈现系统, 包括: 多个摄像设备, 其中, 多个摄像设备被布置成使得相邻摄像设备的相 邻摄像区域的边界线相互平行。 本发明将远程呈现系统的多个摄像设备布置成使得相邻摄像设备的相邻 才聂像区域的边界线相互平行, 解决了现有远程呈现系统的相邻 4聂像机拍 4聂区 域会出现重叠的问题, 无需限制远程会议与会人员的行动, 也无需增加昂贵 的图像剪裁拼接设备, 不仅节省了成本, 而且增加了用户体验度。 附图说明 此处所说明的附图用来提供对本发明的进一步理解, 构成本申请的一部 分, 本发明的示意性实施例及其说明用于解释本发明, 并不构成对本发明的 不当限定。 在附图中: 图 1是才艮据相关技术的应用远程呈现系统的会场俯视图; 图 2是才艮据本发明实施例的应用远程呈现系统的会场俯视图; 图 3是根据本发明实施例的应用于远程呈现系统的摄像机组俯视图。 具体实施方式 下文中将参考附图并结合实施例来详细说明本发明。 需要说明的是, 在 不冲突的情况下, 本申请中的实施例及实施例中的特征可以相互组合。 图 2是才艮据本发明实施例的应用远程呈现系统的会场俯视图, 该系统包 括: 音频釆集设备、 多个显示设备、 音频输出设备、 多媒体通信终端、 控制 设备, 以及多个摄像设备, 其中, 多个摄像设备用于拍摄本地会议现场图像, 并将拍摄到的视频图像发送至多媒体通信终端, 其中, 多个摄像设备被布置 成使得相邻 4聂像设备的相邻 4聂像区域的边界线相互平行。 现有的远程呈现系统, 多个摄像设备布置成相邻的摄像设备的摄像区域 在会议区域出现重叠, 如图 1所示, 重叠区域为区域 C, 使得在远端显示本 地会议现场画面前, 需要对重叠区域进行剪裁及拼接处理, 或者认为地设置 挡板或墙面限制与会人员的活动范围, 避免出现重叠区域, 相关技术均在默 认了摄像设备的摄像区域不可避免的出现重叠的前提下, 釆用额外的处理手 段屏蔽重叠区域在远端显示。 但是都没有从产生摄像区域重叠的根源解决问 题。 本发明实施例提供的远程呈现系统,通过布置多个摄像设备的拍摄角度, 使得相邻摄像设备的相邻摄像区域边界线相互平行, 即, 使如图 1所示的边 界线 L1和 L2相互平行, L3和 L4相互平行, 不存在交叉点, 从而从才艮源上 避免了 ¾像区域出现重叠, 这样, 就无需限制与会人员的活动范围, 也无需 在远程呈现系统中增加额外的图像剪裁拼接处理设备。 在实施过程中, 上述系统中的各个设备的可以具有如下功能: 多个摄像设备, 用于拍摄本地会议现场图像, 并将拍摄到的视频图像发 送至多媒体通信终端, 其中,相邻摄像设备的相邻摄像区域边界线相互平行, 优选地, 多个摄像设备为 3个摄像设备。 即可覆盖整个会议现场, 如图 2所 示, 在三台显示器的中间一台显示器 202的顶部放置左、 中、 右共三台摄像 机 204、 205、 206, 即可满足弧形会场的拍摄需求, 从而在有限的会场空间 内增加尽可能多的座位。 其中, 摄像机 204的摄像区域的右边界线与摄像机 205的摄像区域的左边界线平行, 摄像机 205的摄像区域的右边界线与摄像 机 206的摄像区域的左边界线平行,从而保证三台摄像机的摄像区域不重叠, 进而远端显示无需额外的图像剪裁和拼接处理。 音频釆集设备, 用于釆集本地会议现场的音频信息, 并将釆集到的音频 信号发送至多媒体通信终端。 多个显示设备, 用于显示远端会议现场的视频图像, 如图 2所示, 桌面 207 上布置三台显示器 201、 202、 203。 三台显示器两两之间呈一定夹角 列。 音频输出设备, 用于输出远端会议现场的音频信号, 例如釆用扬声器, 图 2中未示出扬声器的位置, 但是可以理解, 扬声器可以放置在布置在会场 的四周墙壁或其他适当位置。 多媒体通信终端, 与多个摄像设备及音频釆集设备 接, 用于对接收到 的本地会议现场的视频数据和音频数据进行处理, 并发送给远端通信终端, 以及与多个显示设备及音频输出设备耦接, 用于对接收到的远端会议现场的 视频数据和音频数据进行处理, 并通过多个显示设备显示远端的视频图像, 通过音频输出设备输出远端的音频信号。图 2中虽然未示出多媒体通信终端, 但是可以理解, 此设备可以放置在机房或是直接放置在会场内适当位置。 控制设备, 与多媒体通信终端、 多个摄像设备、 音频釆集设备、 多个显 示设备以及音频输出设备 接, 用于设置或调整各个设备的工作状态, 如图 2所示, 在专用会议桌 212上布置有控制设备 215。 该设备提供人机交互界 面, 可以提供如下功能:
( 1 )、 设置或调整音频输出设备的音量大小及音效。
( 2 )、 设置或调整多个显示设备的图像显示效果。
( 3 )、 控制多媒体通信终端处理接收到的会议现场的视频数据及音频数 据, 并发送至远端通信终端。
( 4 )、 控制多媒体通信终端接收和处理远端通信终端发送的远端会议现 场的视频数据及音频数据。
( 5 )、 控制设备设置或调整多个摄像设备的摄像区域, 以使多个会议区 域与多个摄像设备——对应。
( 6 )、 控制设备设置或调整多个摄像设备的摄像角度, 以使相邻摄像设 备的相邻摄像区域边界线相互平行, 并且使多个摄像设备的主光轴近似垂直 平分对应的会议区域的视野垂直平面。
( 7 )、 控制会议现场的其他辅助设备按照用户要求工作, 例如放置会议 区域的桌面的升降, 放置显示设备的载体的角度或高度调整, 会议现场灯光 亮度的调整等。 需要说明的是, 上述控制设备在不影响会议或远端显示的前提下, 可以 设置在会场的任意位置, 例如可以设置在某个会议区域的某个会议坐席或显 示设备的后方, 也可以设置在会场外的机房。 通过本发明实施例提供的远程呈现系统, 从根源上避免了多个摄像设备 的摄像区域出现重叠, 使得多个摄像设备釆集到的视频图像不需要进行而外 的剪裁、 拼接、 平移等处理, 即可显示在远端的多个显示设备上。 相对与现 有的远程呈现系统, 远端的多个显示设备分别显示对应的摄像设备釆集的会 议现场画面, 互不影响, 从而保证了远端显示的显示质量; 不需要限制与会 人员的活动范围, 从而增加了用户的体验度, 不需要釆用额外的图像剪裁拼 接设备, 从而降低了远程呈现系统的成本。 优选地, 相互平行的相邻摄像区域边界线的间距对应于远端相邻显示设 备的显示区域的间 巨。 在具体的实施过程中, 相互平行的相邻摄像区域边界线之间的区域为拍 才聂的死角区域, 该区域多个 4聂像设备无法拍 4聂到, 因此, 远端显示设备也无 法显示这些死角区域, 可以通过特定的剪裁和拼接设备处理该死角区域, 但 是, 这样又增加了系统的成本。 最佳的解决办法, 就是用远端多个显示设备 的显示区域之间的间隔区域 (例如显示器的边框) 来遮挡这些死角区域的显 示, 因此, 可以调整多个摄像设备的拍摄范围及拍摄角度, 使得相互平行的 过上述手段解决拍摄死角区域的显示问题, 有效地利用了远端显示设备的物 理特点屏蔽掉死角区域的显示, 从而增加了用户的体-险度。 优选地, 相互平行的相邻摄像区域边界线的间距可以等于远端相邻显示 设备的显示区域的间距。 在实施过程中, 为使得处于两地的与会人员感觉是面对面交流, 通常釆 用对角线尺寸不小于 60英寸的显示设备, 这样, 显示设备可以以 1 : 1的比 例显示远端图像画面。 在这种情况下, 将相邻摄像设备的摄像区域边界线之 间的间距调整为等于远端相邻显示设备的显示区域的间距, 可以适应这种等 比例显示的显示设备的尺寸特点。 优选地, 如果远端相邻显示设备的显示区域的间距为零或远端釆用一块 显示设备显示本地会议图像, 则相互平行的相邻摄像区域边界线的间距近似 为 0。 在实施过程中, 如果远端釆用的显示设备间距为零或远端釆用一块显示 设备显示本地会议图像, 无法利用显示设备的物理特点屏蔽死角区域, 则可 以调整多个摄像设备间距或摄像角度, 尽量减少相互平行的相邻摄像区域边 界线的间 巨, 使之近似为 0, 从而适应远端显示设备没有边^ I的特点。 优选地, 多个摄像设备的每个摄像设备对应一个会议区域。 每个会议区 域可以包括多排会议坐席, 每排会议坐席前设置会议桌。 在实施过程中, 在多个摄像设备的相邻摄像区域边界线相互平行的前提 下, 可以在每个摄像设备的摄像区域内 (即摄像区域的两个边界线内的扇形 区域内)设置会议区域, 在此会议区域内布置会议桌和会议座椅。 该实施例 还充分利用了无限景深的特点, 使得每个会议区域可以布置多排坐席。 会议 桌和会议座椅可以分排布置, 逐层增加坐席数量, 并且可以根据摄像机的景 深范围, 具体确定布置几排坐席。 如图 2所示, 在桌面 207对面放置专用会 议桌 212和 225 (分前后两排 )以及三组用户坐席,分别是左边的( 216, 217 ) 与 ( 228, 229 ), 中间的 ( 218, 219 )、 ( 230, 231 , 232 ) 以及右边的 ( 220, 221 )、 ( 233 , 234 )。 所述专用桌面以近似弧形方式面对显示器。 将每个 4聂像 设备对应的会议区域布置成上述形式, 保证了所属区域的坐席不会超过相应 摄像设备的摄像区域, 并且显示在远端的会场画面更加突出与会重要人员, 从而提高用户的体验度。 优选地 ,每个会议区域的会议桌上还可以设置辅助显示器和 /或音频釆集 设备, 辅助显示器用于显示与会议相关的视频图像, 如图 2所示, 在专用会 议桌 212以及 225桌面上放置若千音频釆集设备 213 , 214, 226, 227„ 在专 用会议桌 212上放置三台液晶显示器 222、 223、 224, 以及在专用会议桌 225 上放置三台液晶显示器 235、 236、 237。 由于会议现场空间可能会很大, 如果只在会议现场某处或某几处设置音 频釆集设备, 其声音釆集效果可能达不到预期, 因此, 在与会人员的附近设 置音频釆集设备可以保证声音釆集效果。 在实施过程中, 可以在每排会议桌 上设置音频釆集设备, 也可以根据该排的坐席数量具体确定每排会议桌上具 体设置的音频釆集设备数量, 例如, 前排只有两个坐席, 则可以设置一个音 频釆集设备(如麦克风或麦克风阵列), 后排有多个坐席, 则每两个坐席之间 设置一个音频釆集设备。 在具体的实施过程中, 与会人员除了通过上述多个显示器观看远端视频 之外, 可能还需要了解会议相关的影像资料(例如视频片段, 幻灯片等), 这 种情况下, 可以通过诸如画中画的方式将与会议相关的影像资料显示在上述 多个显示器的某一个显示器上, 但是, 这样显示与会议相关的影像资料必然 遮挡一部分远端视频画面, 影响了用户的体验度, 因此, 较佳的解决方法是 在每个会议区域的会议桌上设置辅助显示器, 来显示辅助影像资料, 更优地, 也可以通过辅助显示器同步显示远端某个会议区域的视频, 当然, 所有辅助 显示器的显示也通过上述控制设备控制。 通过辅助显示器显示其他视频, 使 得本发明实施例提供的远程呈现系统功能更加丰富, 用户体验度更高。 综上所述, 上述图 2所示的实施例, 不仅使得本地与会人员感觉到现有 远程呈现系统所具有的远端会场人员就在自己对面, 具有真人大小、 听声辩 位效果外, 还使得会场内无论哪个位置的与会人员在会场走动时, 其在远端 三个显示器上的图像上看起来, 动作是协调一致的, 比如, 很自然地从左边 显示器 201右侧消失, 然后从中间显示器 202的左侧出现, 不会出现在左边 显示器 201上的身体部位的画面还没消失, 而中间显示器上 202的左侧就已 经出现了该部位或者分别位于显示器 201和 202上的两部分身体画面在人眼 感觉上显得扭曲变形, 拼接不自然。 从本实施例可以看到, 由于釆用了摄像区域边界线平行技术, 与会者人 员数量仅受到会议室物理空间和摄像机本身的景深范围限制。根据实际测算, 会议室深度可以达到 7〜9米。 根据本发明实施例, 还提供了一种摄像机组, 应用于远程呈现系统, 包括: 多个摄像设备, 其中, 所述多个摄像设备被布 置成使得相邻所述摄像设备的相邻摄像区域边界线相互平行。 根据本发明实施例, 还提供了一种摄像机组, 应用于远程呈现系统, 包 括: 多个摄像设备, 其中, 所述多个摄像设备被布置成使得相邻所述摄像设 备的相邻摄像区域的边界线相互平行。 通过本发明实施例提供的摄像机组, 从根源上避免了多个摄像设备的摄 像区域出现重叠, 使得多个显示设备分别显示对应的摄像设备釆集的会议现 场画面, 互不影响, 不会重复显示某个区域, 从而保证了显示的显示质量。 优选地, 相邻摄像区域边界线的间距对应于远端相邻显示设备的显示区 域的间 巨。 相互平行的相邻摄像区域边界线之间的区域为拍摄的死角区域, 该区域 多个 4聂像设备无法拍 4聂到, 远端显示设备也无法显示这些死角区域, 但是可 以通过多个显示设备的显示区域之间的间隔区域 (例如显示器的边框) 来遮 挡这些死角区域的显示。 因此, 可以通过调整多个摄像设备的拍摄范围及拍 摄角度, 使得相互平行的相邻摄像区域边界线的间距对应于远端相邻显示设 备的显示区域的间距。 通过上述手段解决拍摄死角区域的显示问题, 有效地 利用了远端显示设备的物理特点屏蔽掉死角区域的显示, 从而增加了用户的 体验度。 优选地, 多个摄像设备为 3个摄像设备。 使得摄像机组可以有效的应用 于远程呈现系统, 保证了拍 «_范围。 下面通过具体的实施例详细介绍本发明实施例提供的摄像机组。 图 3是根据本发明实施例的应用于远程呈现系统的摄像机组俯视图。 如 图 3所示,该摄像机组包括三个摄像头, 并且三个摄像头被布置成以下特点:
1、 相邻拍摄区域的边界线两两平行。 两条相互平行的边界线之间的区 域为拍 死角区域。
2、 相邻拍摄区域的边界线的平行间距对应于相邻显示设备的有效显示 区域的水平间 巨。 在具体的实施过程中, 如果显示器可以达到 1 : 1 的显示 效果, 则上述平行间距可以等于相邻显示设备的有效显示区域的水平间距。 从而利用显示设备的物理间距有效遮挡了拍摄死角区域。 如果釆用整块宽屏显示设备显示三个设备头拍摄的三个会议区域,此时, 无法利用显示设备的物理间距遮挡拍摄的死角, 则可以调整三个摄像头的空 间夹角及焦距, 在保证相邻拍摄区域的边界线两两平行的前提下, 使得上述 平行间 巨近似、为 0。 从以上的描述中, 可以看出, 本发明实施例提供的技术方案, 有效地解 决了现有远程呈现系统的相邻摄像机拍摄区域会出现重叠的问题, 无需限制 远程会议与会人员的行动, 也无需增加昂贵的图像剪裁拼接设备, 不仅节省 了成本, 而且使得会场内无论哪个位置的与会人员在会场走动时, 其在远端 三个显示器上的图像上看起来 , 动作是协调一致的,从而增加了用户体验度。 以上所述仅为本发明的优选实施例而已, 并不用于限制本发明, 对于本 领域的技术人员来说, 本发明可以有各种更改和变化。 凡在本发明的 ^"神和 原则之内, 所作的任何修改、 等同替换、 改进等, 均应包含在本发明的保护 范围之内。

Claims

权 利 要 求 书
1. 一种远程呈现系统, 其特征在于, 包括:
音频釆集设备、 多个显示设备、 音频输出设备、 多媒体通信终端、 控制设备, 以及
多个摄像设备, 用于拍摄本地会议现场图像, 并将拍摄到的视频图 像发送至所述多媒体通信终端, 其中, 所述多个摄像设备被布置成使得 相邻所述 4聂像设备的相邻 4聂像区域的边界线相互平行。
2. 根据权利要求 1所述的系统, 其特征在于, 相互平行的所述相邻摄像区
根据权利要求 2所述的系统, 其特征在于, 相互平行的所述相邻摄像区 平行的所述相邻摄像区域边界线的间距等于所述远端相邻显示设备的显 示区域的间 巨。 才艮据权利要求 2所述的系统, 其特征在于, 如果所述远端相邻显示设备 的显示区域的间距为 0或远端釆用一块显示设备显示本地会议图像, 则 所述相互平行的相邻摄像区域边界线的间距近似为 0。 根据权利要求 1至 4任一项所述的系统, 所述多个摄像设备为 3个摄像 设备。 根据权利要求 1至 4任一项所述的系统, 其特征在于, 所述多个摄像设 备的每个摄像设备对应一个会议区域, 其中, 每个会议区域包括多排会 议坐席, 每排会议坐席前设置会议桌。 根据权利要求 6所述的系统, 其特征在于, 在所述会议桌上设置辅助显 示器和 /或所述音频釆集设备, 其中, 所述辅助显示器用于显示与会议相 关的视频图像。 一种 4聂像机组, 应用于远程呈现系统, 其特征在于, 包括: 多个 4聂像设 备, 其中, 所述多个摄像设备被布置成使得相邻所述摄像设备的相邻摄 像区域的边界线相互平行。 根据权利要求 8所述的摄像机组, 其特征在于, 所述相邻摄像区域的边 界线的间距对应于远端相邻显示设备的显示区域的间距。 根据权利要求 8或 9所述的摄像机组, 其特征在于, 所述多个摄像设备 为 3个摄像设备。
PCT/CN2010/078646 2010-04-06 2010-11-11 远程呈现系统及其摄像机组 WO2011124066A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010145172.X 2010-04-06
CN201010145172XA CN101877775A (zh) 2010-04-06 2010-04-06 远程呈现系统及其摄像机组

Publications (1)

Publication Number Publication Date
WO2011124066A1 true WO2011124066A1 (zh) 2011-10-13

Family

ID=43020225

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/078646 WO2011124066A1 (zh) 2010-04-06 2010-11-11 远程呈现系统及其摄像机组

Country Status (2)

Country Link
CN (1) CN101877775A (zh)
WO (1) WO2011124066A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877775A (zh) * 2010-04-06 2010-11-03 中兴通讯股份有限公司 远程呈现系统及其摄像机组
CN102761731B (zh) * 2011-04-29 2015-09-09 华为终端有限公司 数据内容的显示方法、装置和系统
EP2838257B1 (en) * 2013-08-15 2016-04-06 Alcatel Lucent A method for generating an immersive video of a plurality of persons
CN106161961A (zh) * 2016-08-27 2016-11-23 山东万博科技股份有限公司 一种消除盲区的摄像头视频监控装置及方法
JP7005269B2 (ja) 2017-10-18 2022-01-21 キヤノン株式会社 情報処理装置、システム、情報処理方法及びプログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101534413A (zh) * 2009-04-14 2009-09-16 深圳华为通信技术有限公司 一种远程呈现的系统、装置和方法
CN101668160A (zh) * 2009-09-10 2010-03-10 深圳华为通信技术有限公司 视频图像数据处理方法、装置及视频会议系统及终端
CN101877775A (zh) * 2010-04-06 2010-11-03 中兴通讯股份有限公司 远程呈现系统及其摄像机组

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7619658B2 (en) * 2004-11-15 2009-11-17 Hewlett-Packard Development Company, L.P. Methods and systems for producing seamless composite images without requiring overlap of source images
JP5337170B2 (ja) * 2008-02-08 2013-11-06 グーグル インコーポレイテッド タイミング調節されるシャッターを用いる複数のイメージセンサーを有するパノラマカメラ

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101534413A (zh) * 2009-04-14 2009-09-16 深圳华为通信技术有限公司 一种远程呈现的系统、装置和方法
CN101668160A (zh) * 2009-09-10 2010-03-10 深圳华为通信技术有限公司 视频图像数据处理方法、装置及视频会议系统及终端
CN101877775A (zh) * 2010-04-06 2010-11-03 中兴通讯股份有限公司 远程呈现系统及其摄像机组

Also Published As

Publication number Publication date
CN101877775A (zh) 2010-11-03

Similar Documents

Publication Publication Date Title
US11729351B2 (en) System and methods for facilitating virtual presence
JP4057241B2 (ja) 仮想カメラを有する改善された画像撮影システム
US8508576B2 (en) Remote presenting system, device, and method
US8896655B2 (en) System and method for providing depth adaptive video conferencing
US8860775B2 (en) Remote presenting system, device, and method
WO2010130084A1 (zh) 远程呈现系统、方法及视频采集设备
WO2018214746A1 (zh) 一种视频会议实现方法、装置、系统及计算机存储介质
SE535205C2 (sv) Studio och konferenssystem för videokonferens
GB2440376A (en) Wide angle video conference imaging
WO2011124066A1 (zh) 远程呈现系统及其摄像机组
JPH0522722A (ja) 画像通信用入出力装置
US10645340B2 (en) Video communication device and method for video communication
US20190306459A1 (en) Video communication device and method for video communication
WO2012021365A1 (en) A gaze correcting apparatus, a method and system of videoconferencing
JP2013141231A (ja) ビデオ会議装置およびビデオ会議装置の制御方法
TWI739585B (zh) 全視角會議攝影裝置
US11310465B1 (en) Video conference teminal and system there of
CN213693932U (zh) 一种基于透明显示器的视频会议系统
WO2013060295A1 (zh) 一种视频处理方法和系统
JPH0481088A (ja) 視線一致型の人物映像表示・撮像装置
CN213213667U (zh) 一种基于视觉与声音融合的可交互的会议装置
WO2019104629A1 (zh) 一种导播控制方法及装置
JP2015186177A (ja) 映像配信システム及び映像配信方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10849302

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10849302

Country of ref document: EP

Kind code of ref document: A1