CN1290107A - Method for implementing picture-in-picture mode at remote end - Google Patents

Method for implementing picture-in-picture mode at remote end Download PDF

Info

Publication number
CN1290107A
CN1290107A CN 99124655 CN99124655A CN1290107A CN 1290107 A CN1290107 A CN 1290107A CN 99124655 CN99124655 CN 99124655 CN 99124655 A CN99124655 A CN 99124655A CN 1290107 A CN1290107 A CN 1290107A
Authority
CN
China
Prior art keywords
image
video
small
picture
superimposed
Prior art date
Application number
CN 99124655
Other languages
Chinese (zh)
Other versions
CN1148062C (en
Inventor
郭宏智
邹孟睿
火焰
黄强
Original Assignee
深圳市中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市中兴通讯股份有限公司 filed Critical 深圳市中兴通讯股份有限公司
Priority to CNB991246551A priority Critical patent/CN1148062C/en
Publication of CN1290107A publication Critical patent/CN1290107A/en
Application granted granted Critical
Publication of CN1148062C publication Critical patent/CN1148062C/en

Links

Abstract

A method for implementing the remote picture-in-picture of video meeting is disclosed, which includes such steps as converting the image taken by master comera to data in CIF format, converting the images taken by secondary cemeras to small images to be overlapped, overlapping them in video overlapping module to obtain a frame of image data in CIF format, encoding and transmitting to channel via multiplexer module.

Description

远端画中画的实现方法 Implementation of the distal end of the PIP

本发明属于电通信技术,具体涉及会议电视领域。 The present invention is in electrical communication technology, particularly relates to a television conference.

在会议电视系统中,多点控制单元(MCU)通过网络控制下面的多个会场的终端,各个会场的终端同时具有发送本端信息和接收对方信息的功能。 In the television conference system, a multipoint control unit (MCU) controlling the network terminals of the plurality of venue below, each site also has a function of transmitting the terminal information and the local information receiving counterpart. 一般情况下,每个终端在接收到对方的图像的同时,还要显示一幅本地的图像,即本地画中画,这一图像一般是本地主摄像机的图像。 In general, each terminal while receiving the image of the counterpart, also displaying an image of the local, local PIP i.e., the image is typically the image of the local primary camera.

通常情况下,主会场是一个可容纳几百人的礼堂,因为会场太大,一台摄像机无法把整个会场的场景都拍摄进去,所以可以布置两台或两台以上的摄像机,一台摄像机拍摄主席台上的画面、其余的摄像机拍摄观众席上的画面等。 Under normal circumstances, the main hall is a hall that can accommodate hundreds of people, because the venue is too large, a camera can not take the whole hall scene are taken into account, it is possible to arrange more than two or two cameras, a video camera screen on the podium, the rest of the cameras on the auditorium screen and so on.

如图1所示,各个会场的终端设备可以接多个摄像机,终端设备不仅需要传送主摄像机的图像,还要求可以传送一个或一个以上辅助摄像机(如:图文摄像机)的图像,传送的图像越多,对方获得的信息也就越多。 As shown, each site terminal device can be connected to more than one camera, the terminal device needs to transmit not only the image of the main camera can be transmitted also require one or more auxiliary camera: image (such as a document camera), the transmission of the image the more information they have obtained the more. 目前对这一问题,国内外的会议电视厂商都是采用切换视频源的方法使得对方能看到其他摄像机摄取的图像,但这种方法同一时刻只能传送一个摄像机摄取的图像。 Currently on this issue, videoconferencing domestic and foreign manufacturers are using the method to switch video sources so that the other party can see the other images picked up a camera, but this method can only send the same time a camera taken image. 会议进行时,根据需要切换同一个会场的两个视频源,使得其他会场的与会者能够看到整个会场的场景。 When the meeting is necessary to switch two video sources according to the same conference site, so that other participants can see the whole hall venue scene.

本发明的目的在于提出一种远端画中画的实现方法,能够克服现有的技术的上述缺点,使得开会的双方既免去了要经常切换视频源的麻烦,又可以同时看到对方两个或两个以上场景的图像。 Object of the present invention is to propose a method for implementing a distal end of the PIP, to overcome the above mentioned disadvantages of the prior art, such that both sides meet regularly eliminates the trouble of switching to the video source, and the other two can be seen simultaneously two or more images of the scene.

远端画中画的概念是相对于本地画中画而提出的。 The concept is relative to the distal PIP PIP local proposed. 也就是说,远端画中画会议电视系统的每一个终端上可同时看到三个以上的画面,一幅图像为对方发送过来的主图像,另一幅为叠加在主图像上的本地画中画,还有一幅或一幅以上叠加在主图像上的从对方发送过来的远端画中画。 That is, the distal end of each terminal PIP TV conference system can simultaneously see the main image of three or more pictures, an image is sent from the other party, the other one is superimposed on the main image local Videos in painting, as well as one or more than one superimposed on the main image transmitted from the other over the distal end of the PIP.

本发明的方法是通过以下的技术方案实现的:主摄像机摄取的图像通过格式转换模块先转化为编码器所要求的标准格式数据,如:CIF(公共中间格式)、QCIF(CIF的四分之一);多个辅助摄像机摄取的图像分别通过格式转换模块转化为需叠加的小图像;然后将主图像和需叠加的小图像一起送入视频叠加模块进行叠加,变成一帧编码器所要求的标准格式数据;再交给编码器做编码;编码后的数据经过复用模块送上信道。 The method of the present invention is achieved by the following technical solution: an image picked up through the main camera format converting module standard format converted first data encoder required, such as: the CIF (Common Intermediate Format), QCIF (CIF a quarter of the a); a plurality of images picked up additional cameras were transformed by the image format converting module needs a small superimposed; then superimposed into the video overlay module together with the main image and the required small image superimposed into a required encoder standard format data; re-encoder to make coding; the encoded data sent through the channel multiplexing module.

本发明的方法实现了会议电视终端设备同时传送两个或两个以上摄像机摄取的活动视频图像,举行电视会议时,开会的接收方可以同时看到对方的两个或两个以上的场景的图像,即实现了远端画中画;同时也省去了切换视频源的麻烦。 The method of the present invention is to achieve a video conference terminal devices simultaneously transmit two or more cameras uptake of active video image, when videoconferencing, meetings recipient can see each other two or more scenes simultaneously image , i.e., to achieve a PIP distal end; also eliminates the trouble of switching the video source.

下面结合附图和实施例,进一步说明本发明的技术方案。 DRAWINGS Examples and embodiments, further illustrate the technical solutions of the present invention.

图1是现有技术中会议电视终端摄像机的连接示意图;图2是现有技术中会议电视终端图像编码的流程示意图;图3是以两个视频源为例的本发明应用例;图4(a)是视频叠加过程中亮度信号Y的叠加示意图;图4(b)是视频叠加过程中色度信号U的叠加示意图;图4(c)是视频叠加过程中色度信号V的叠加示意图。 1 is a schematic prior art video conference connection terminal camera; FIG. 2 is a schematic flow diagram of the prior art image coding conference terminal; FIG. 3 is an application example of the present invention is an example of two video sources; FIG. 4 ( a) is a schematic diagram of a luminance signal Y superimposed video overlay process; FIG. 4 (b) is a schematic view of superimposed video overlay during the chrominance signal U; FIG. 4 (c) is a schematic diagram of the chrominance signal V is superimposed video overlay process.

图1是对现有技术中会议电视终端摄像机的连接情况的描述,在前面的背景技术中已做了详细介绍。 FIG 1 is a description of the prior art connection conference terminal of the video camera, in front of the background art has been described in detail.

图2是现有技术的会议电视终端图像编码流程示意图,在现有技术中,会议电视终端图像编码过程如图2所示:首先把模拟视频信号通过格式转化模块转换为标准的格式,如:CIF(公共中间格式)、QCIF(CIF的四分之一)格式,然后交给编码器做编码,编码后的数据经过复用送上信道。 FIG 2 is a schematic flow diagram of an image encoding video conferencing terminal of the related art, in the prior art image coding process conference terminal shown in Figure 2: First, the analog video signal into a standard format by format conversion module, such as: CIF (common intermediate format), QCIF (CIF quarter) format, then the encoder to make coding, the encoded data sent through the multiplex channel. 这种方式显然仅适合于同一时刻传送一幅图像。 This approach is clearly only suitable for transmitting an image at the same time.

图3是以接两个视频源为例,说明了本发明方法的实现过程: FIG 3 is connected to two video sources as an example, it illustrates an implementation procedure of the present invention:

视频源1即主摄像机摄取的图像,通过格式转换模块先转化为编码器所要求的格式数据,如:CIF(公共中间格式)、QCIF(CIF的四分之一)格式数据,视频源2即辅助摄像机摄取的图像,通过格式转换模块转化为需叠加的小图像;然后将主图像和需叠加的小图像送入视频叠加模块进行叠加,合成一帧编码器所要求的格式数据,如:CIF、QCIF格式的图像数据;再交给编码器进行编码,这里,需叠加的小图像即远端画中画的大小和位置可根据客户的需求进行设置。 I.e., a main camera source video images taken by the first format conversion module converting data into a format required by the encoder, such as: CIF (Common Intermediate Format), QCIF (CIF quarter) format data, i.e., video source 2 auxiliary camera captured image, converted by the format converting module needs a small superimposed image; then the main image and the required small image is superimposed into the video overlay module overlay, the encoder synthesis format data required for one, such as: CIF , image data of QCIF format; encoder to re-encode, here, for an image that is superimposed on the distal end of the small size and location of the PIP can be set according to customer demand. 对于编码器来说,叠加后的图像和原来只有一幅图像的图像数据没有任何区别,因此就不会影响编码的速度和效果;编码后的数据经过复用模块送上信道。 For the encoder, the original image and the superimposed image data of an image not only any difference, so it will not affect the speed and effectiveness of coding; the encoded data sent through the channel multiplexing module. 与图2的现有技术中会议电视终端图像编码过程相比,本发明在通常的图像编码之前,增加了一个视频叠加这个步骤。 Compared with the prior art image coding process conference terminal in FIG. 2, the present invention prior to general image coding, a video overlay adds this step.

图4是以两个视频源为例说明了视频叠加的具体实现过程:一幅图像由若干行像素点组成,每个像素点一般包含一个亮度信号Y和两个色度信号U和V,由于人眼对色度信号不是很敏感,而对亮度信号比较敏感,因此,一般抽取较少的色度信号进行编码,这样既减少了图像编码的运算量,又不致于影响图像质量。 FIG 4 is an example of two video sources the video overlay specific implementation process: an image by a number of rows of pixels, each pixel typically comprises a luminance signal Y and two chrominance signals U and V, since the human eye is not very sensitive to the chrominance signal, but sensitive to a luminance signal, therefore, generally fewer extracted chrominance signal is encoded, not only reduces the amount of calculation of image coding which, without affecting the image quality. 例如YUV420格式的CIF图像的像素点为Y:352×288,U:176×144,V:176×144。 E.g. CIF image pixels YUV420 format is Y: 352 × 288, U: 176 × 144, V: 176 × 144.

图4中,进行视频叠加的视频源1的格式为:YUV420,CIF,(即Y:352×288,U:176×144,V:176×144),进行视频叠加的视频源2,即远端画中画的格式为:YUV420,100×80(即Y:100×80,U:50×40,V:50×40)。 In FIG. 4, a video overlay video source format 1 is: YUV420, CIF, (i.e., Y: 352 × 288, U: 176 × 144, V: 176 × 144), video overlay video source 2, i.e., away end PIP format: YUV420,100 × 80 (i.e., Y: 100 × 80, U: 50 × 40, V: 50 × 40). 假设用户希望将远端画中画置于屏幕(200,100)的位置,那么叠加过程如下:(1)如图4(a)所示亮度信号Y的叠加:找出视频源1位于200<x<300,100<y<180的亮度信号Y1,此区域的亮度信号用视频源2的亮度信号Y2代替。 Assume that the user wishes to place the distal end of the PIP screen (200, 100) position, then the superposition process is as follows: (1) (A) superimposing the luminance signal Y 4 shown in FIG: 1 is located to find the video source 200 < x <300,100 <y <Y1 180 of the luminance signal, the luminance signal of the luminance signal Y2 in this region was replaced with a video source 2. 其中,Y1和Y2分别为视频源1和视频源2采集的亮度信号;(2)如图4(b)所示色度信号U的叠加:找出视频源1位于100<x<150,50<y<90的色度信号U1,此区域的色度信号用视频源2的色度信号U2代替。 Wherein, Y1 and Y2 are the luminance signal of the video source 1 and source 2 video acquisition; superimposed (2) in FIG. 4 (b) the chrominance signal U is shown: find the video source 1 is located 100 <x <150,50 <y chrominance signals U1 <90, the chrominance signal in this area chrominance signal U2 instead of the video source 2. 其中U1和U2分别为视频源1和视频源2采集的色度信号;(3)如图4(c)所示色度信号V的叠加:找出视频源1位于100<x<150,50<y<90的色度信号V1,此区域的色度信号用视频源2的色度信号V2代替。 Wherein U1 and U2 are chrominance signal of the video source 1 and source 2 video acquisition; (3) (c) superimposing the chrominance signal V 4 shown in FIG: 1 is located to find the source video 100 <x <150,50 <chrominance signal V1 y <90, the chrominance signal V2 in this region was replaced with the chrominance signal of the video source 2. 其中,V1和V2分别为视频源1和视频源2采集的色度信号; Wherein, V1 and V2 are the video source 1 and source 2 capture video chrominance signal;

至此,视频叠加过程完毕。 So far, video overlay process is completed.

由于本发明使用了视频叠加的方法,使得开会的双方能够同时看到对方的两个或两个以上的场景,即可实现远端画中画的传送,使用简单方便。 Since the present invention is a method of using the video overlay, so that both can be seen simultaneously meeting two or more of the other scenarios, the distal end of the PIP transmission can be achieved, easy to use.

Claims (2)

1.一种远端画中画的实现方法,包括以下步骤:1)将主摄像机摄取的图像转化为符合编码器要求的格式数据;2)多个辅助摄像机摄取的图像分别转化为需叠加的小图像;3)将所述的主图像和需叠加的小图像一起送入进行视频叠加,变成一帧符合编码器要求的格式数据;4)对叠加后的图像数据进行编码;5)编码后的数据经过复用之后送上信道。 An implementation of PIP distal end, comprising the following steps: 1) the main camera taken image format into data conforming to the requirements of the encoder; 2) a plurality of auxiliary camera images are picked into superposed required small images; 3) into the main image according to the needs and the superimposed image with a small video overlay into a format data in line with the requirements of the encoder; 4) the superimposed image data is encoded; 5) encoding after the data is multiplexed send channel.
2.如权利要求1所述的一种远端画中画的实现方法,其特征在于:所述视频叠加过程包括亮度信号Y的叠加、色度信号U的叠加和色度信号V的叠加:首先确定需要叠加的小图像在大图像中的起始位置;然后根据小图像的起始位置和大小,找出小图像在大图像中的区域;最后将位于此区域的大图像的亮度信号Y,色度信号U,V分别用小图像的亮度信号Y,色度信号U,V代替。 2. A method for implementing a distal end of the PIP according to claim 1, wherein: said process comprising superimposing video overlay superimposed luminance signal Y, chrominance signals U and superposed chrominance signal V: determining a starting position of the first small images require a large superimposed image; then, according to the starting position and size of the small picture, a small area of ​​the image to identify a large image; Finally, the luminance signal Y is located in the large image of this area , the chrominance signals U, V with the luminance signal Y respectively, the small picture, the chrominance signals U, V instead.
CNB991246551A 1999-12-18 1999-12-18 Method for implementing picture-in-picture mode at remote end CN1148062C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB991246551A CN1148062C (en) 1999-12-18 1999-12-18 Method for implementing picture-in-picture mode at remote end

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB991246551A CN1148062C (en) 1999-12-18 1999-12-18 Method for implementing picture-in-picture mode at remote end

Publications (2)

Publication Number Publication Date
CN1290107A true CN1290107A (en) 2001-04-04
CN1148062C CN1148062C (en) 2004-04-28

Family

ID=5283530

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB991246551A CN1148062C (en) 1999-12-18 1999-12-18 Method for implementing picture-in-picture mode at remote end

Country Status (1)

Country Link
CN (1) CN1148062C (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100388782C (en) 2003-11-12 2008-05-14 华为技术有限公司 Stationary graphic and text realizing method
CN100515079C (en) 2006-12-13 2009-07-15 北京大学;中国科学院计算技术研究所;中国网通集团宽带业务应用国家工程实验室有限公司 An implementation method for picture-in-picture in IPTV
CN101860715A (en) * 2010-05-14 2010-10-13 中兴通讯股份有限公司 Multi-picture synthesis method and system and media processing device
CN102625129A (en) * 2012-03-31 2012-08-01 福州一点通广告装饰有限公司 Method for realizing remote reality three-dimensional virtual imitated scene interaction
CN103002346A (en) * 2011-09-16 2013-03-27 联想(北京)有限公司 Video processing device, television equipment and video processing method
CN103248863A (en) * 2010-12-28 2013-08-14 华为终端有限公司 Camera device, communication system and corresponding imagine processing method
WO2015043170A1 (en) * 2013-09-29 2015-04-02 中兴通讯股份有限公司 Endpoint information interaction processing method, apparatus and telepresence endpoint

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100388782C (en) 2003-11-12 2008-05-14 华为技术有限公司 Stationary graphic and text realizing method
CN100515079C (en) 2006-12-13 2009-07-15 北京大学;中国科学院计算技术研究所;中国网通集团宽带业务应用国家工程实验室有限公司 An implementation method for picture-in-picture in IPTV
CN101860715A (en) * 2010-05-14 2010-10-13 中兴通讯股份有限公司 Multi-picture synthesis method and system and media processing device
WO2011140812A1 (en) * 2010-05-14 2011-11-17 中兴通讯股份有限公司 Multi-picture synthesis method and system, and media processing device
CN103248863B (en) * 2010-12-28 2016-03-30 华为终端有限公司 An imaging apparatus, a communication system and a corresponding image processing method
CN103248863A (en) * 2010-12-28 2013-08-14 华为终端有限公司 Camera device, communication system and corresponding imagine processing method
CN103002346A (en) * 2011-09-16 2013-03-27 联想(北京)有限公司 Video processing device, television equipment and video processing method
CN103002346B (en) * 2011-09-16 2016-03-30 联想(北京)有限公司 Video processing device, video processing method, and a television device
CN102625129A (en) * 2012-03-31 2012-08-01 福州一点通广告装饰有限公司 Method for realizing remote reality three-dimensional virtual imitated scene interaction
WO2015043170A1 (en) * 2013-09-29 2015-04-02 中兴通讯股份有限公司 Endpoint information interaction processing method, apparatus and telepresence endpoint
CN104519304A (en) * 2013-09-29 2015-04-15 中兴通讯股份有限公司 Endpoint information interaction processing method, device and remote rendering endpoint
US10356141B2 (en) 2013-09-29 2019-07-16 Zte Corporation Method and device for exchanging endpoint information, and telepresence endpoint

Also Published As

Publication number Publication date
CN1148062C (en) 2004-04-28

Similar Documents

Publication Publication Date Title
US7003795B2 (en) Webcam-based interface for initiating two-way video communication
US5611038A (en) Audio/video transceiver provided with a device for reconfiguration of incompatibly received or transmitted video and audio information
US6043837A (en) Method and apparatus for electronically distributing images from a panoptic camera system
CN1103981C (en) Video information adjusting apparatus
US20070263077A1 (en) System and Method for Dynamic Control of Image Capture in a Video Conference System
EP1683356B1 (en) Distributed real-time media composer
JP2008507898A (en) High-speed channel switching in digital media systems
US7787007B2 (en) Method and system for preparing video communication image for wide screen display
EP0622000B1 (en) Method and apparatus for video camera image film simulation
US6704042B2 (en) Video processing apparatus, control method therefor, and storage medium
JP4295441B2 (en) Video communication system, decoder circuit, video display system, encoder circuit, and video data receiving method
JP3931392B2 (en) Stereo image video signal generating device, stereo image video signal transmitting device, and stereo image video signal receiving device
US5453780A (en) Continous presence video signal combiner
US5280540A (en) Video teleconferencing system employing aspect ratio transformation
KR100316639B1 (en) Multi-point video conference system and method for realizing the same
US8368741B2 (en) Apparatus and system for improving image quality
JP3684525B2 (en) Multiple picture composing method and multiple picture composing apparatus
US6243129B1 (en) System and method for videoconferencing and simultaneously viewing a supplemental video source
US8872881B2 (en) Minimal decoding method for spatially multiplexing digital video pictures
US5555443A (en) Satellite communications multi-point video transmit system
CN101309390B (en) Visual communication system, apparatus and subtitle displaying method
KR20100085188A (en) A three dimensional video communication terminal, system and method
JP3125552B2 (en) TV conference system
CN1192619C (en) Multiple-picture display method in video conference system
US6356294B1 (en) Multi-point communication arrangement and method

Legal Events

Date Code Title Description
C06 Publication
C10 Request of examination as to substance
C14 Granted
C56 Change in the name or address of the patentee

Owner name: ZTE CO., LTD.

Free format text: FORMER NAME OR ADDRESS: SHENZHENG CITY ZTE CO., LTD.