WO2015089944A1

WO2015089944A1 - Method and device for processing picture of video conference, and conference terminal

Info

Publication number: WO2015089944A1
Application number: PCT/CN2014/073182
Authority: WO
Inventors: 曹长刚; 梁昕; 刘帅
Original assignee: 中兴通讯股份有限公司
Priority date: 2013-12-20
Filing date: 2014-03-11
Publication date: 2015-06-25
Also published as: CN103997616B; CN103997616A

Abstract

A method and device for processing a picture of a video conference, and a conference terminal. The method comprises: acquiring background picture information about a video conference; when the video conference is held, segmenting instant image information about a video conference system; acquiring picture-centred foreground picture information from the segmented instant image information; and superposing the foreground picture information on the background picture information so as to generate video image information with a centered picture.

Description

Method, device and conference terminal for processing video conference picture

Technical field

The present invention relates to the field of video conferencing, and more particularly to a method and device for processing a video conference screen.

Background technique

Video conferencing is the use of video technology and equipment to realize real-time, two-way, interactive multimedia conferences in remote locations through modern communication networks.

At present, the multi-screen video conferencing system adopts a multi-screen environment layout, and brings high-quality, panoramic, multi-screen and other display features to bring a good user experience to the video conference. The multi-screen environment layout is implemented by means of a plurality of fixed cameras corresponding to a plurality of fixed seats. For a single camera of the system, the shooting range of the camera is generally a seat position, that is, two seats or three seats. Thus, when the system is used, since the position of the camera used by the camera is a fixed seat, when the person attending the meeting is located at the left side or the right side of the seat, the video picture is not processed, and a position always appears. It is an empty scene that affects the experience of the video conference of the magic system. Summary of the invention

The embodiment of the invention discloses a method, a device and a conference terminal for processing a video conference screen, which can realize the image centering of the image display personnel participating in the video conference, and improve the user experience of the video conference system. An embodiment of the present invention provides a method for processing a video conference screen, including:

Obtaining background image information of the video conference;

Splitting the instant image information of the video conference system when performing a video conference;

Obtaining foreground picture information centered on the picture from the divided instant image information; and superimposing the foreground picture information into the background picture information to generate video image information centered on the picture. Optionally, obtaining background image information of the video conference includes: obtaining by using a video conference camera The seatless image information of the actual conference scene, or other static image information that conforms to the actual conference scene is used as the background screen information.

Optionally, the instant image information of the split video conference system includes:

When the video conference system acquires the instant image information of the two positions of the image capturing position, the segmentation is performed along the middle coordinate position of the obtained instant image;

When the video conference system acquires the instant image information of the three-position imaging position, the division is performed along one-third and two-thirds of the coordinate positions of the obtained instant image;

When the image capturing position acquired by the video conferencing system is other types of instant image information, the size and position determined according to the external command are divided along the corresponding coordinate positions of the obtained instant image. Optionally, obtaining foreground image information centered on the screen from the segmented instant image information includes:

Obtaining, by using an external instruction, the image information corresponding to the seat position of the video conference participant participating in the video conference participant from the divided instant image information as the foreground image centered on the screen; or

The image information corresponding to the seat position of the video conference participant is obtained from the divided instant image information by the image matching method as a foreground image centered on the screen.

On the other hand, an embodiment of the present invention provides an apparatus for processing a video conference screen, including: a background unit, a picture division unit, a collection unit, and a superposition unit;

a background unit, configured to collect background image information of the video conference;

a picture division unit configured to split the instant image information of the video conference system;

a collecting unit configured to collect foreground image information centered on the screen from the image information divided by the screen dividing unit;

And a superimposing unit configured to superimpose the foreground picture information collected by the unit to the background picture information of the background unit to generate video image information centered on the picture.

Optionally, the background unit acquires background picture information of the video conference by: collecting the seatless image information of the actual conference scene by using the video conference camera;

Or, set other static image information that matches the actual conference scene as background image information. Optionally, the screen splitting unit is set to: When the video conference system acquires the instant image information of the two positions of the image capturing position, the segmentation is performed along the middle coordinate position of the obtained instant image;

When the image capturing position acquired by the video conferencing system is other types of instant image information, the size and position determined according to the external command are divided along the corresponding coordinate positions of the obtained instant image. Optionally, the unit is set to:

By external command, the image information corresponding to the seat position where the video conference participant is located is collected from the instant image information divided by the screen division unit as a foreground image centered on the screen; or, by the image matching method, the divided instant image is obtained In the information, the image information corresponding to the seat position where the video conference participant is located is collected as the foreground picture centered on the screen.

In another aspect, an embodiment of the present invention provides a conference terminal for processing a video conference screen, including: a collection unit, a screen division unit, and a superposition unit;

a screen dividing unit configured to divide the instant image information of the conference participants of the video conference;

a collecting unit configured to acquire foreground image information centered on the screen from the instantaneous image information divided by the screen dividing unit;

And a superimposing unit configured to superimpose the acquired foreground picture information into the background picture information of the video conference to generate video image information centered on the picture of the video conference participant.

Optionally, the conference terminal further includes an obtaining unit configured to acquire background picture information of the video conference.

Optionally, the background information of the video conference, including: directly obtained by the video conference system, as image information of the background image; or

After obtaining the static image information conforming to the actual conference scene, it is sent to the conference terminal as the image information of the background screen.

Optionally, the screen splitting unit is set to:

When the video image of the conference participant's instant image information is the instant of the two-seat camera position In the image information, the segmentation is performed along the middle coordinate position of the obtained instant image; when the instant image information of the conference participant of the video conference is the instant image information of the imaging position of the three seats, the obtained instant image is obtained along the image Dividing one-third and two-thirds of the coordinate position;

When the instant image information of the conference participant of the video conference is the instant image information of the camera position of other specifications, the size and the position determined according to the external command set by the conference participant are segmented along the corresponding coordinate position of the obtained instant image. .

Optionally, the unit is set to:

By external command, the image information corresponding to the seat position where the video conference participant is located is collected as the foreground picture information centered on the screen from the instant image information divided by the screen dividing unit; or, by the image matching method, from the split instant In the image information, the corresponding image information corresponding to the seat position where the video conference participant is located is collected as the foreground picture information centered on the screen.

The present application provides a technical solution, including: acquiring background image information of a video conference; dividing the instant image information of the video conference system when performing the video conference; acquiring foreground image information centered on the screen from the divided instant image information; The screen information is displayed in the background screen information to generate video image information centered on the screen. The application also includes apparatus and conference terminals corresponding to the method.

The method and the device of the embodiment of the present invention realize that the instant image of the video conference system participating in the video conference personnel is segmented to obtain a foreground image, and the foreground image is superimposed on the background image to generate a video image centered on the screen, so that the video conference is performed. Participants are in the center of the video image to improve the video conferencing system user experience. BRIEF abstract

The drawings described herein are intended to provide an understanding of the invention, and are intended to be a part of the invention. In the drawing:

FIG. 1 is a flowchart of a method for processing a video conference screen according to an embodiment of the present invention;

FIG. 2 is a structural block diagram of an apparatus for processing a video conference screen according to an embodiment of the present invention. Preferred embodiment of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

FIG. 1 is a flowchart of a method for processing a video conference screen according to an embodiment of the present invention. As shown in FIG. 1 , a method for centering a video conference screen includes:

Step 100: Obtain background image information of the video conference. In this step, obtaining the background image information of the video conference includes: obtaining the seatless image information of the actual conference scene through the video conference camera, or acquiring other static image information that conforms to the actual conference scene as the background image information.

Step 101: When performing a video conference, splitting the instant image information of the video conference system; in this step, the instant image information of the split video conference system includes:

When the video conference system acquires the instant image information of the three-position imaging position, the division is performed along the one-third and two-thirds coordinate positions of the obtained instant image;

When the image capturing position acquired by the video conferencing system is other types of instant image information, the size and position determined according to the external command are divided along the corresponding coordinate positions of the obtained instant image. Step 102: Acquire foreground picture information centered on the picture from the divided instant image information. In this step, obtaining foreground image information centered on the screen from the divided instant image information includes:

Obtaining, by using an external instruction, image information corresponding to the location of the video conference participant from the divided instant image information as a foreground image centered on the screen; or

It should be noted that the image seat foreground image of the seat position where the participant is located is determined by an external command or image matching method, and is only for the current system setting, if the limit is used. The size of the image is determined and a certain amount of the set identification information is detected to obtain the foreground image. The implementation principle is similar to the image matching, or is a branch of the image matching, and belongs to the protection scope of the present invention.

Step 103: Superimpose the foreground picture information into the background picture information, and generate video image information centered on the picture.

It should be noted that the superposition method is implemented by using a field programmable gate array (FPGA) hardware; or a hardware or software algorithm of a digital signal processor (DSP), and the specific implementation has applications in image processing and video applications, and belongs to the field. Common sense.

2 is a structural block diagram of an apparatus for processing a video conference screen according to an embodiment of the present invention. As shown in FIG. 2, the method includes: a background unit 21, a picture dividing unit 22, a collecting unit 23, and a superimposing unit 24;

The background unit 21 is configured to collect background picture information of the video conference. Obtaining the background image information of the video conference includes: collecting the seatless image information of the actual conference scene through the video conference camera;

Or, set other static image information that matches the actual conference scene as background image information. A picture division unit 22 is provided to segment the instant image information of the video conference system.

Optionally, the picture segmentation unit 22 is configured to:

When the image capturing position acquired by the video conferencing system is other types of instant image information, the size and position determined according to the external command are divided along the corresponding coordinate positions of the obtained instant image. The collecting unit 23 is configured to collect foreground image information centered on the screen from the image information divided by the screen dividing unit.

Optionally, the collection unit 23 is configured to:

Through external instructions, from the segmented instant image information, the video conference participants are gathered. Image information corresponding to the seat position, as a foreground picture centered on the screen; or,

Through the image matching method, image information corresponding to the seat position where the video conference participant is located is collected from the divided instant image information as a foreground picture centered on the screen.

The superimposing unit 24 is arranged to superimpose the foreground picture information obtained by the obtaining unit into the background picture information of the background unit to generate video image information centered on the picture.

It should be noted that the superposition method is implemented by a field programmable gate array (FPGA) hardware; or a hardware or software algorithm of a digital signal processor DSP, and the specific implementation has applications in image processing and video applications, and is well known in the art. common sense.

A conference terminal for processing a video conference picture, comprising: a collection unit, a picture division unit, and a superposition unit; wherein

A picture division unit configured to segment the instant image information of the video conference participant. It should be noted that the instant image information of the conference participants of the video conference is obtained by the camera device of the related art video conference, which is common knowledge and will not be described here.

The screen splitting unit is set to:

When the instant image information of the conference participant of the video conference is the instant image information of the two seat image capturing positions, segmentation is performed along the middle coordinate position of the obtained instant image;

When the instant image information of the conference participant of the video conference is the instant image information of the two seat imaging positions, dividing along one-third and two-thirds of the coordinate positions of the obtained instant image;

When the instant image information of the conference participant of the video conference is the instant image information of the two seat imaging positions, the size and the position determined according to the external command set by the conference participant are segmented along the corresponding coordinate position of the obtained instant image. .

The collection unit is configured to acquire foreground picture information centered on the picture from the instantaneous image information divided by the picture division unit.

The collection unit is set to:

The image information corresponding to the seat position where the video conference participant is located is collected from the instant image information divided by the screen division unit by an external command, and is used as foreground image information centered on the screen; or Through the image matching method, corresponding image information corresponding to the seat position where the video conference participant is located is collected from the divided instant image information as the foreground picture information centered on the screen.

It should be noted that the segmentation and superposition of the instant image information and the generation of the video image information centered on the image are mainly implemented by the image processing software or the video conference system loading the corresponding software processing program.

The conference terminal further includes an acquisition unit configured to acquire background screen information of the video conference. The background picture information of the video conference includes: image information directly obtained by the video conference system as a background picture; or

It should be noted that the background image information obtained directly through the video conference system refers to being directly acquired by the camera device of the video conference system. In addition, a device that collects still image information in accordance with the actual conference scene is collected. It may be a camera, a camera, a general camera device, a device with a camera function, and a storage device or a network access device that can acquire a still picture, and only has such a function, which is required in accordance with an embodiment of the present invention. Device. In addition, such devices and conference terminals implement data transmission by wired or wireless means. This part is common knowledge and will not be repeated here.

One of ordinary skill in the art will appreciate that all or a portion of the above steps may be accomplished by a program instructing the associated hardware, such as a read-only memory, a magnetic disk, or an optical disk. Alternatively, all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits. Correspondingly, each module/unit in the above embodiment may be implemented in the form of hardware or in the form of a software function module. The invention is not limited to any specific form of combination of hardware and software.

The above description is only a preferred example of the present invention, and is not intended to limit the scope of protection of the present invention. For the image capturing position is another seat image, the implementation method is consistent with the principle of the present invention, and the method for image segmentation superposition or the like, the present invention Just enumerate the common methods, you can achieve the split and superimposed side There are many ways. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

The method and the device of the embodiment of the present invention realize that the instant image of the video conference system participating in the video conference personnel is segmented to obtain a foreground image, and the foreground image is superimposed on the background image to generate a video image centered on the screen, so that the video conference is performed. Participants are in the center of the video image to improve the video conferencing system user experience.

Claims

claims

1. A method for processing video conference images, including:

Get the background screen information of the video conference;

When conducting a video conference, split the real-time image information of the video conference system;

Obtain the foreground picture information as the center of the picture from the segmented real-time image information; and superimpose the foreground picture information to the background picture information to generate the video image information of the center of the picture.

2. The method according to claim 1, wherein the obtaining the background picture information of the video conference includes:

Obtain seatless image information of the actual conference scene through the video conference camera, or obtain other static image information that matches the actual conference scene as background picture information.

3. The method according to claim 1, wherein the segmenting the instant image information of the video conferencing system includes:

When the video conferencing system acquires real-time image information with camera positions of two seats, segmentation is performed along the middle coordinate position of the obtained real-time image;

When the video conferencing system obtains real-time image information with camera positions of three seats, segmentation is performed along one-third and two-thirds of the coordinate positions of the obtained real-time image; and

When the camera position obtained by the video conferencing system is real-time image information of other specifications, segmentation is performed along the corresponding coordinate positions of the obtained real-time image according to the size and position determined by the external instruction.

4. The method according to claim 3, wherein the obtaining the foreground picture information as the center of the picture from the segmented real-time image information includes:

Through external instructions, obtain the image information corresponding to the seat position of the video conference participant from the divided real-time image information as the foreground image in the center of the screen; or,

Through the image matching method, the image information corresponding to the seat position of the video conference participant is obtained from the segmented real-time image information as the foreground image in the center of the screen.

5. A device for processing video conference pictures, including: a background unit, a picture segmentation unit, a collection unit and an overlay unit; wherein, The background unit is configured to collect background screen information of the video conference;

The screen segmentation unit is configured to segment the real-time image information of the video conferencing system; the collection unit is configured to collect foreground image information as the center of the screen from the image information segmented by the screen segmentation unit; and the overlay unit is configured to The foreground picture information collected by the collection unit is superimposed on the background picture information collected by the background unit to generate video image information in the center of the picture.

6. The device according to claim 5, wherein the background unit obtains the background picture information of the video conference in the following manner: collecting the seatless image information of the actual conference scene through the video conference camera;

Or, collect other static image information that conforms to the actual conference scene as background picture information.

7. The device according to claim 5, wherein the picture segmentation unit is configured to: when the video conferencing system obtains real-time image information with camera positions of two seats, along the middle of the obtained real-time image Split the coordinate position;

When the video conferencing system obtains real-time image information of three seats with camera positions, segmentation is performed along one-third and two-thirds of the coordinate positions of the obtained real-time image; and when the video conferencing system obtains the camera information When the position is real-time image information of other specifications, segmentation is performed along the corresponding coordinate positions of the obtained real-time image according to the size and position determined by the external instruction.

8. The device according to claim 5, wherein the collection unit is configured to: collect images corresponding to the seat positions of video conference participants from the real-time image information divided by the picture segmentation unit through external instructions. information, as a foreground image in the center of the screen; or, through the image matching method, from the segmented real-time image information, the image information corresponding to the seat position of the video conference participant is collected, as a foreground image in the center of the screen.

9. A conference terminal that processes video conference pictures, including: a collection unit, a picture segmentation unit and an overlay unit; wherein the picture segmentation unit is configured to segment real-time image information of video conference participants; the collection unit, It is set to obtain the foreground picture information as the center of the picture from the real-time image information divided by the picture dividing unit; and The overlay unit is configured to superimpose the obtained foreground picture information onto the background picture information of the video conference, and generate video image information in which the video conference participant's picture is centered.

10. The conference terminal according to claim 9, wherein the conference terminal further includes an acquisition unit configured to acquire background screen information of the video conference.

11. The conference terminal according to claim 10, wherein the background screen information of the video conference includes:

Obtained directly through the video conferencing system as image information of the background screen; or,

After being obtained by a device that collects static image information that conforms to the actual conference scene, it is sent to the conference terminal as the image information of the background screen.

12. The conference terminal according to claim 9 or 10, wherein the picture dividing unit is set to:

When the real-time image information of the video conference participants is the real-time image information of the camera positions of the two seats, segmentation is performed along the middle coordinate position of the obtained real-time image;

When the real-time image information of the video conference participants is the real-time image information of the camera positions of the three seats, segmentation is performed along the coordinate positions of one-third and two-thirds of the obtained real-time image; and

When the real-time image information of the video conference participant is the real-time image information of the camera position of other specifications, segmentation is performed along the corresponding coordinate position of the obtained real-time image according to the size and position determined by the external instructions set by the conference participant.

13. The conference terminal according to claim 9 or 10, wherein the collection unit is configured to:

Through external instructions, the image information corresponding to the seat position of the video conference participant is collected from the real-time image information divided by the picture segmentation unit as the foreground picture information in the center of the picture; or, through the image matching method, from the divided real-time image information Among the image information, the corresponding image information corresponding to the seat position of the video conference participant is collected as the foreground image information in the center of the image.