WO2017024448A1

WO2017024448A1 - Method and apparatus for encoding screen sharing image

Info

Publication number: WO2017024448A1
Application number: PCT/CN2015/086386
Authority: WO
Inventors: 章万光
Original assignee: 华为技术有限公司
Priority date: 2015-08-07
Filing date: 2015-08-07
Publication date: 2017-02-16

Abstract

Disclosed are a method and apparatus for encoding a screen sharing image. The method comprises: a sharing terminal acquiring screen sharing images at pre-set time intervals, wherein a screen sharing image acquired at a first moment is a first image and a screen sharing image acquired at a second moment is a second image; dividing the second image into a plurality of rectangular image blocks; determining a first image block to be encoded located in a second top layer window region; matching, in a first top layer window region in the first image, a target image block corresponding to the first image block to be encoded; and using the displacement of the first image block to be encoded relative to the target image block as a motion vector of the first image block to be encoded. Therefore, for an image block in a top layer window in an image to be encoded, a target image block is matched only in a top layer window region, and hence, the calculation workload is less, the encoding efficiency is higher, and the real-time performance of screen sharing can thus be improved.

Description

Method and device for encoding screen shared image

Technical field

Embodiments of the present invention relate to the field of image processing and, more particularly, to a method and apparatus for encoding a screen shared image.

Background technique

Web conferencing has been widely used in daily work communication, business meetings, online education and other scenarios. Screen sharing is an important feature of web conferencing. A terminal that performs screen sharing in a network conference (hereinafter referred to as a shared terminal) acquires an image displayed on the screen of the terminal as a screen shared image, and transmits the image shared by the conference server to the terminal of other participants, and the screen shared by the terminal of the other participant. It is displayed on the screen, so other participants feel as if they are watching the same screen as the user sharing the terminal.

In order to save transmission bandwidth, the shared terminal needs to encode the screen shared image before sending the screen shared image to the conference server. In the prior art, screen sharing images may be encoded in a manner commonly used in motion estimation in video coding. The specific implementation manner is: dividing the current image to be encoded into a plurality of rectangular image blocks, and searching for the same target image block as the image block A in the previous image for one image block A in the current image, if matched, The displacement of the image block A with respect to the target image block is calculated, and the calculated displacement is taken as the motion vector of the image block A without encoding the image data of the image block A itself. Correspondingly, the terminal of the other participant can obtain the image data of the image block A by using the image data of the target image block and the motion vector on the premise that the image data of the target image block is decoded.

According to the prior art, the target image block is usually searched in the entire previous image, resulting in a large amount of computation of the search target image block and low coding efficiency. Therefore, the coding of the screen shared image directly by using the prior art is generally not possible. Ensure the real-time nature of screen sharing.

Summary of the invention

Embodiments of the present invention provide a method and apparatus for encoding a screen shared image, which are used to solve The problem of the low efficiency of coding existing in the prior art leads to the inability to guarantee the real-time nature of screen sharing.

In a first aspect, a method of encoding a screen shared image is provided, the method comprising:

The shared terminal acquires an image displayed on the screen of the shared terminal as a screen shared image at a preset time interval, wherein the screen shared image acquired at the first time is the first image, and the screen shared image acquired at the second time is the first a second image, where the first moment and the second moment are adjacent moments;

The sharing terminal divides the second image into a plurality of rectangular image blocks;

The sharing terminal determines, according to the description information of the second top-level window area, that the first top-level window displayed at the first time on the screen of the shared terminal and the second top-level window displayed at the second time are the same top-level window a first to-be-coded image block in the second top-level window region of the plurality of rectangular image blocks, wherein the second top-level window region is the second top-level window in the second screen shared image Area occupied

And the sharing terminal matches the target image block corresponding to the first to-be-coded image block in the first top-level window area in the first image according to the description information of the first top-level window area, where the a top window area is an area occupied by the first top window in the first screen shared image, and image data in the target image block is the same as image data in the first to-be-coded image block;

And the sharing terminal uses a displacement of the first to-be-coded image block relative to the target image block as a motion vector of the first to-be-encoded image block.

In a first possible implementation manner of the first aspect, the sharing terminal matches the first top window area in the first image according to the description information of the first top window area A target image block having the same image block to be encoded specifically includes:

Determining, in the first top-level window area, a first to-be-matched image block having the same width as the first to-be-encoded image block according to the description information of the first top-level window area, the first The displacement of the image block to be encoded relative to the first image block to be matched is the same as the displacement of the second top window region relative to the first top window region;

The sharing terminal determines whether the image data in the first image to be matched is the same as the image data in the target image block, and if the same, the first image to be matched is used as the target image block.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, the sharing terminal is in the first image in the first image according to the description information of the first top window area Matching the same target image block in the top window area to the first image block to be encoded further includes:

If it is different, determining, according to the description information of the first top-level window area, a second to-be-matched image block having the same width and width as the first to-be-encoded image block in the first top-level window area, the second to-be-held The abscissa of the left edge of the matching image block and the abscissa of the left edge of the first image to be matched are the same, and the ordinate of the upper edge of the second image block to be matched and the first image block to be matched The upper edge has a different ordinate;

And determining, when the image data in the second image to be matched is the same as the image data in the target image block, the second image to be matched as the target image block.

In conjunction with the second possible implementation of the first aspect, in a third possible implementation, the shared terminal determines image data in the second image to be matched and an image in the target image block After the data is the same, it also includes:

Determining, by the sharing terminal, the second to-be-coded image block in the second top-level window area, the second to-be-coded image block, according to the description information of the second top-level window area Different from the first image block to be encoded;

Determining, by the sharing terminal, a third to-be-matched image block having the same width as the second to-be-coded image block in the first top-level window region according to the description information of the first top-level window region, the second Determining the displacement of the image block to be encoded relative to the third image to be matched and the displacement of the image block to be encoded with respect to the target image block, determining image data of the image block to be matched in the third When the image data of the second to-be-coded image block is the same, the displacement of the second to-be-coded image block relative to the third to-be-matched image block is used as the motion vector of the second to-be-coded image block. the amount.

In a second aspect, a shared terminal is provided, including: an obtaining module and an encoding module;

The acquiring module acquires an image displayed on a screen of the sharing terminal as a screen sharing image at a preset time interval, where the screen sharing image acquired at the first time is the first image, and the screen sharing acquired at the second time is The image is a second image, and the first moment and the second moment are adjacent moments;

The encoding module is configured to divide the second image into a plurality of rectangular image blocks, a first top-level window displayed at a first moment on a screen of the shared terminal, and a second top-level displayed at a second moment When the window is the same top-level window, determining, according to the description information of the second top-level window region, the first to-be-coded image block in the second top-level window region of the plurality of rectangular image blocks, wherein the second top-level window region Sharing the area occupied by the image in the second screen for the second top window, and matching and matching in the first top window area in the first image according to the description information of the first top window area a target image block corresponding to the first to-be-coded image block, wherein the first top-level window area is an area occupied by the first top-level window in the first screen shared image, in the target image block The image data is the same as the image data in the first image block to be encoded; and is further configured to use the displacement of the first image block to be encoded relative to the target image block as the first to be edited Motion vector of the image block.

In a first possible implementation manner of the second aspect, the encoding module is configured to determine, in the first top-level window region, the first image to be encoded according to the description information of the first top-level window region. a first to-be-matched image block having a block width equal to a height, a displacement of the first to-be-coded image block relative to the first to-be-matched image block, and a second top-level window region relative to the first top-level window region The displacements are the same, and it is determined whether the image data in the first image to be matched is the same as the image data in the target image block. When the determination result is the same, the first image to be matched is used as the Target image block.

With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, the coding module is further configured to: when the determination result is different, according to the first top window area Descriptive information of the domain, in the first top-level window area, determining a second to-be-matched image block having the same width as the first to-be-coded image block, and an abscissa of a left edge of the second to-be-matched image block The abscissa of the left edge of the first to-be-matched image block is the same, and the ordinate of the upper edge of the second image to be matched and the ordinate of the upper edge of the first image block to be matched are different, and When it is determined that the image data in the second image to be matched is the same as the image data in the target image block, the second image to be matched is used as the target image block.

With reference to the second possible implementation of the second aspect, in a third possible implementation, the coding module is further configured to: determine image data in the second image to be matched and the target image After the image data in the block is the same, determining, according to the description information of the second top-level window region, the second to-be-coded image block in the second top-level window region of the plurality of rectangular image blocks, the second The image block to be encoded is different from the first image block to be encoded, and is determined to be equal in width to the second image block to be encoded in the first top window region according to the description information of the first top window region. a third to-be-matched image block, the displacement of the second to-be-coded image block relative to the third to-be-matched image block is the same as the displacement of the first to-be-coded image block relative to the target image block, When the image data of the third to-be-matched image block is the same as the image data of the second to-be-coded image block, the displacement of the second to-be-coded image block relative to the third to-be-matched image block is used as the The motion vector of the second image block to be encoded.

According to the embodiment of the present invention, for the feature of the screen sharing image, for the image block in the top window in the image to be encoded, the target image block is not matched in the image of the previous moment, but only in the top window region. The target image block, therefore, the amount of calculation is small, and the coding efficiency is high, thereby improving the real-time performance of the screen sharing.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only some of the present invention. For the embodiments, those skilled in the art can obtain other drawings according to the drawings without any creative work.

FIG. 1 is a schematic structural diagram of a networking of a conference system according to an embodiment of the present disclosure;

2 is a schematic flowchart of a method according to Embodiment 1 of the present invention;

3A and 3B are schematic diagrams of screen sharing images provided by Embodiment 1 of the present invention;

4 and FIG. 5 are schematic diagrams showing the displacement relationship between an image block to be encoded and an image block to be matched according to Embodiment 1 of the present invention;

FIG. 6 is a schematic structural diagram of a sharing terminal 500 according to Embodiment 2 of the present invention;

FIG. 7 is a schematic structural diagram of a shared terminal 1000 according to Embodiment 3 of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

FIG. 1 is a schematic structural diagram of a networking of a conference system 100 according to Embodiment 1 of the present invention. The conference system 100 includes a conference terminal 110, a conference server 120, and a conference terminal 130. Any one of the

conference terminals

110 and 130 can be used as a shared terminal for screen sharing. When the shared terminal performs screen sharing, the shared terminal obtains the image displayed on the screen of the terminal as the screen shared image code and sends the image to the conference server 120. The conference server 120 transmits the image to the conference server 120. The encoded screen shared image is sent to other conference terminals, and the other conference terminals decode the received screen shared image and display it on the screen of the terminal.

2 is a schematic flowchart of a method according to Embodiment 1 of the present invention. The method in Embodiment 1 of the present invention is applied to any conference terminal in the conference system 100 shown in FIG. 1 as a shared terminal.

As shown in FIG. 2, the method provided in Embodiment 1 of the present invention includes:

Step 201: The shared terminal acquires an image displayed on the screen of the shared terminal as a screen shared image at a preset time interval, and may also obtain description information of a top-level window (ie, a focus window) displayed on the screen.

The subsequent one of the two adjacent moments is referred to as the first moment, and the latter moment is referred to as the second At the moment, for example, with 200ms as the preset time interval, the first time is 6 minutes, 30 seconds, 200 milliseconds, and the second time is 6 minutes, 30 seconds, 400 milliseconds. Correspondingly, the screen sharing image acquired at the first moment is referred to as a first image, the screen sharing image acquired at the second moment is referred to as a second image, and the top-level window displayed at the first moment is referred to as a first top-level window The top-level window displayed at the second moment is referred to as a second top-level window, the region occupied by the first top-level window in the first image is referred to as a first top-level window region, and the second top-level window is referred to in the second image The area occupied is called the second top-level window area.

An example of the first image is shown in FIG. 3A, 311 is a screen sharing image acquired at a first time, and 312 is a top window displayed at a first time. An example of the second image is shown in FIG. 3B, 321 is a screen sharing image acquired at a second time, and 322 is a top window displayed at a second time.

The description information of the top-level window is used to describe an area occupied by the top-level window in an image displayed on a screen of the shared terminal, and specifically includes a reference point on the top-level window (such as the top-level window) The coordinates of the top left corner, the width and height of the top window.

If the screen sharing image is acquired at a certain moment, the description information of the top window displayed at the moment can naturally be used to describe the area occupied by the top window in the screen sharing image acquired at the moment (ie, the top window area), that is, Can be used as a description of the top-level window area. For example, the description information of the first top-level window may be used to describe the first top-level window area, which may be used as description information of the first top-level window area; and the description information of the second top-level window may be used to describe The second top-level window area can be used as the description information of the second top-level window area.

In a specific implementation, the sharing terminal may acquire and record description information of the top-level window displayed on the screen in the following manner.

The sharing terminal starts a window monitoring program, such as a windows hook program, by the window monitoring program to monitor changes in the top window (such as switching of the top window, the position of the top window or The size changes) and the information of the current top-level window obtained by the window monitoring program is recorded when the change occurs.

When it is monitored that the top window is switched from the first window to the second window, for example, switching from one slide window to one browser window, and, for example, switching from one slide window to another Port, record the moment when the switch occurs, the identifier of the current top-level window (ie, the second window) (such as the handle of the current top-level window), and the description information of the current top-level window. If the top-level window is switched, the information of the top-level window recorded before switching is no longer needed, and can be deleted at this time.

When the position of the top-level window is changed, the time at which the change occurred and the description information of the current top-level window are recorded.

When it is detected that the size of the top-level window changes, the time at which the change occurred and the description information of the current top-level window are recorded. If the size of the top-level window changes, the information of the top-level window recorded before the change is no longer needed, and can be deleted at this time.

An example of the information for a top-level window of a record is as follows:

变化时刻Changing moment	描述信息Description
变化时刻Changing moment	描述信息Description	t1T1	(x1,y1,w,h)(x1, y1, w, h)
t2T2	(x2,y2,w,h)(x2, y2, w, h)	t1T1	(x1,y1,w,h)(x1, y1, w, h)
t2T2	(x2,y2,w,h)(x2, y2, w, h)	…...	…...
tiTi	(xi,yi,w,h)(xi,yi,w,h)	…...	…...
tiTi	(xi,yi,w,h)(xi,yi,w,h)	…...	…...

Where ti is the moment of change, (xi, yi) is the coordinates of the top left window at the top left corner of ti, wi is the width of the top window at time ti, and hi is the height of the top window at time ti. Usually, the upper left corner of the image shared by the screen is taken as the coordinate origin, the horizontal axis is horizontally facing right, and the vertical axis is vertically downward.

Step 202: The sharing terminal divides the second image into a plurality of rectangular image blocks.

If h.264 is used to encode the acquired screen sharing images, the image blocks are referred to as macroblocks; if HEVC (High Efficiency Video Coding) is used to encode the acquired screen sharing images, An image block is called a coding unit.

Step 203: When the shared terminal determines that the first top-level window displayed at the first moment on the screen of the shared terminal and the second top-level window displayed at the second moment are the same top-level window, according to the second top-level window The description information of the area determines the to-be-coded picture in the second top-level window area Like a block.

Assume that the description information of the current top-level window is as follows:

变化时刻Changing moment	描述信息Description
变化时刻Changing moment	描述信息Description	t1T1	(x1,y1,w,h)(x1, y1, w, h)
t2T2	(x2,y2,w,h)(x2, y2, w, h)	t1T1	(x1,y1,w,h)(x1, y1, w, h)
t2T2	(x2,y2,w,h)(x2, y2, w, h)	t3T3	(x3,y3,w3,h3)(x3, y3, w3, h3)
t4T4	(x4,y4,w4,h4)(x4, y4, w4, h4)	t3T3	(x3,y3,w3,h3)(x3, y3, w3, h3)

If the first time is greater than or equal to t2 is less than t3, and the second time is greater than or equal to t3 is less than t4, the description information of the first top-level window is (x2, y2, w, h), which may be the first Descriptive information of the top-level window area, where the description information of the second top-level window is (x4, y4, w4, h4), which can be used as description information of the second top-level window area.

If the first top-level window and the second top-level window are not the same top-level window, the subsequent steps are not performed, and the matching in the first image may correspond to each image block in the second image by using the prior art. The target image block.

In addition, the sharing terminal may determine whether the size of the first top window and the second top window are the same if the first top window and the second top window are the same top window. That is, whether the width is equal. If they are the same, the subsequent steps are performed; otherwise, the subsequent steps are not performed, and the target image blocks corresponding to the respective image blocks in the second image may be matched in the first image by the prior art. It is also possible not to judge whether the sizes of the first top-level window and the second top-level window are the same, but to directly perform subsequent steps.

Step 204: The sharing terminal matches the same target image block as the image block to be encoded in the first top window in the first image according to the description information of the first top window area.

Step 205: Use a displacement of the image block to be encoded with respect to the target image block as a motion vector of the image block to be encoded.

Using the motion vector as the encoded data of the image block to be encoded without The image data of the code image block itself is encoded.

If the target image block corresponding to a certain image block to be encoded in the second top window area is not matched in step 204, the image block to be encoded may be encoded by the prior art. For image blocks not included in the second top-level window, the corresponding target image blocks may be matched in the first image using the prior art.

After the shared terminal encodes the second image by using the foregoing steps, the shared image is sent to other conference terminals through the conference server, and the other conference terminals decode and display the received encoded second image by referring to the first image. In the process of decoding the encoded second image, for the image block in which the encoded data is a motion vector, the image data of the image block is obtained according to the image data of the corresponding target image block and the motion vector.

It should be noted that, in Embodiment 1 of the present invention, the second image is encoded by using the first image as a reference frame, and the first image of the reference frame of the second image may be encoded as a key. The frame (ie, I frame) may also be encoded as a non-key frame (eg, a P frame) with the screen shared image of the previous moment of the first image as a reference frame according to the method of Embodiment 1 of the present invention.

According to Embodiment 1 of the present invention, for the feature of the screen sharing image, for the image block in the top window in the image to be encoded, the target image block is not matched in the image of the previous moment, but only in the top window. The target image block, therefore, the amount of calculation is small, and the coding efficiency is high, thereby improving the real-time performance of the screen sharing.

Preferably, the specific implementation of step 204 may include the following steps:

Step 204-1: Determine, according to the description information of the first top-level window area, a first to-be-matched image block having the same width as the image block to be encoded, the image block to be encoded, in the first top-level window. The displacement relative to the first image to be matched is the same as the displacement of the second top window relative to the first top window.

As shown in FIG. 4, A1 is the first top-level window, A2 is the second top-level window, B1 is the first image block to be matched, and B2 is the image block to be encoded. B1 and B2 are equal in width and B2 phase The displacement for B1 is the same as the displacement of A2 with respect to A1.

The specific implementation may be: calculating a displacement of the second top-level window relative to the first top-level window according to the description information of the second top-level window area and the description information of the first top-level window area (hereinafter referred to as a window) Displacement), determining, in the first image, an image block having a displacement in the same direction as the window displacement size with respect to the displacement of the image block to be encoded as the first image block to be matched. Specifically, the coordinates of the reference point in the description information of the second top-level window area (such as the upper left corner of the top-level window area) and the coordinates of the corresponding reference point in the description information of the first top-level window area may be calculated. The window is displaced. For example, the coordinates of the upper left corner of the image block to be encoded are (x0, y0), the width is w, and the height is h, and the displacement of the second top window relative to the first top window is (dx, dy). The determined upper left corner coordinates of the first to-be-matched image block are (x0-dx, y0-dy), width w, and height h.

Step 204-2: determining whether the image data in the first to-be-matched image block is the same as the image data in the image block to be encoded, and if the same, the first image to be matched is to be encoded as Step 205 is performed to the target image block corresponding to the image block, and step 204-3 is performed if it is different.

Step 204-3: determining, within the first top-level window, a new image block to be matched that is equal in width to the image block to be encoded, an abscissa of the left edge of the new image block to be matched, and the The abscissa of the left edge of the first to-be-matched image block is the same, and the ordinate of the upper edge of the new image block to be matched is different from the ordinate of the upper edge of the first image block to be matched.

Step 204-4: determining whether the image data in the new image block to be matched is the same as the image data in the target image block. If they are the same, the new image block to be matched is the target image block. Step 205 is performed. If different, step 204-3 to step 204-4 are performed again. When step 204-3 is executed again, the determined new image block to be matched is not determined by any of the previously determined image blocks to be matched. Completely coincident.

In the process of performing step 204-3 to step 204-4 multiple times, the first to-be-matched image block may be used as a starting point, and the stepwise upward or downward interval may be set at an interval of a set offset (for example, 3 pixels). One by one The image is block-matched until it matches the target image block corresponding to the image block to be encoded, or until it matches the upper or lower boundary of the first top-level window region.

In the process of performing screen sharing, in the case where the position of the top-level window has changed, the content in the top-level window generally does not change, so the first image to be matched and the image block to be encoded are The probability that the image data is the same is higher. Therefore, it is possible to preferentially confirm whether the first image to be matched is the target image block, and the speed of hitting the target image block can be further improved, thereby saving the calculation amount of the target image block and improving the coding efficiency. .

In addition, since the usual operation is to scroll up and down the content in the top window (such as the ppt presentation document, the word document) during the screen sharing process, the first image to be matched is used as a starting point to go up or down. The search can improve the speed of hitting the target image block, thereby saving the calculation amount of the target image block and improving the coding efficiency.

In a specific implementation manner, for each image block to be encoded in the second top-level window region, the corresponding target image block is matched and encoded in the above manner.

In another specific implementation, if the determined target image block (hereinafter referred to as the first target image block) to be encoded (hereinafter referred to as the first image block to be encoded) is determined relative to the first to-be The displacement of the encoded image block is different from the displacement of the first top-level window relative to the second top-level window, and the displacement of the first target image block relative to the first image-to-coded image block may also be recorded (subsequent Referring to the image block displacement), when the target image block of the other image block to be encoded (hereinafter referred to as the second image block to be encoded) is matched, the second image to be encoded in the first image may be preferentially determined. Whether the image data of the image block to be matched is equal to the image data of the image block to be matched (hereinafter referred to as the third image to be matched) is the same as the image data of the second image block to be encoded, that is, whether a target image block corresponding to the two to-be-coded image blocks.

As shown in FIG. 5, X2 is the first image block to be encoded, X1 is the first target image block, Y2 is the second image block to be encoded, and the displacement of Y1 with respect to Y2 and X1 with respect to X2. The displacement is the same. When sharing on the screen, if in the top-level window (such as ppt presentation document, word document) When the content is scrolled up and down, the scrolling width of the image blocks that are scrolled and displayed in the top window is often the same, that is, the displacement of each image block that performs scroll display is the same as the displacement of the corresponding target image block. The probability that Y1 is the target image block corresponding to Y2 is high. Therefore, it is possible to preferentially confirm whether Y1 is the target image block corresponding to Y2, and the speed of hitting the target image block can be further improved, thereby saving the calculation amount of the target image block and improving the coding efficiency. .

According to Embodiment 1 of the present invention, Embodiment 2 of the present invention provides a sharing terminal 500. As shown in FIG. 6, the communication terminal 500 includes: an obtaining module 501 and an encoding module 502;

The acquiring module 501 acquires an image displayed on the screen of the sharing terminal 500 as a screen sharing image at a preset time interval, wherein the screen sharing image acquired at the first time is the first image, and the screen sharing image acquired at the second time is a second image, where the first moment and the second moment are adjacent moments;

The encoding module 502 is configured to divide the second image into a plurality of rectangular image blocks, and the first top-level window displayed at the first moment on the screen of the determining sharing terminal 500 and the second top-level window displayed at the second moment are The first to-be-encoded image block in the second top-level window region of the plurality of rectangular image blocks is determined according to the description information of the second top-level window region, wherein the second top-level window region is And the second top-level window shares an area occupied by the image in the second screen, and matches and matches the first top-level window area in the first image according to the description information of the first top-level window area. a target image block corresponding to the image block to be encoded, wherein the first top-level window area is an area occupied by the first top-level window in the first screen shared image, and image data in the target image block The same as the image data in the first to-be-coded image block; and is further configured to use the displacement of the first to-be-coded image block relative to the target image block as the first to-be-coded image The motion vector of the block.

Preferably, the encoding module 502 is specifically configured to determine, according to the description information of the first top-level window region, a first to-be-matched image having the same width as the first to-be-encoded image block in the first top-level window region. Block, the displacement of the first to-be-coded image block relative to the first to-be-matched image block is the same as the displacement of the second top-level window region relative to the first top-level window region, and And whether the image data in the first to-be-matched image block is the same as the image data in the target image block, and when the determination result is the same, the first to-be-matched image block is used as the target image block.

Further, the method may be further configured to determine, in the first top-level window region, the same width as the first image block to be encoded, according to the description information of the first top-level window region, when the determination result is different. a second to-be-matched image block, an abscissa of a left edge of the second to-be-matched image block and an abscissa of a left edge of the first to-be-matched image block are the same, and the second image to be matched is on the image block The ordinate of the edge is different from the ordinate of the upper edge of the first image to be matched, and when it is determined that the image data in the second image to be matched is the same as the image data in the target image block, The second image to be matched is used as the target image block.

In addition, after determining that the image data in the second to-be-matched image block is the same as the image data in the target image block, the encoding module 502 may be further configured to determine, according to the description information of the second top-level window region, a second image block to be encoded in the second top window region of the plurality of rectangular image blocks, the second image block to be encoded being different from the first image block to be encoded, according to the first top layer Determining information of the window area, in the first top-level window area, determining a third to-be-matched image block having the same width as the second to-be-encoded image block, the second to-be-coded image block being opposite to the third Determining the displacement of the image block to be matched and the displacement of the image block to be encoded with respect to the target image block, determining image data of the image block to be matched and image of the second image block to be encoded When the data is the same, the displacement of the second image to be encoded relative to the third image to be matched is used as the motion vector of the second image block to be encoded.

The functional modules described in Embodiment 2 of the present invention may be used to implement the operations performed by the shared terminal in the method described in Embodiment 1 above.

According to the sharing terminal 500 provided by Embodiment 2 of the present invention, for the image block in the top window in the image to be encoded, the target image block is not matched in the image of the previous moment, but only the target is matched in the top window area. Image blocks, so the amount of computation is small and the coding efficiency is high, which can improve the real-time performance of screen sharing.

According to Embodiment 1 of the present invention, Embodiment 3 of the present invention provides a sharing terminal 1000. As shown in FIG. 7, the sharing terminal 1000 includes a processor 1010 and a memory 1020, wherein the processor 1010 and the memory 1020 are completed by using a bus. Communication with each other.

The memory 1020 is configured to store computer operation instructions. The memory 1020 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.

The processor 1010 is configured to execute computer operation instructions stored in the memory 1020. The processor 1010 may be a central processing unit (CPU) and is a computer core unit.

The processor 1010 executes the computer operation instruction to cause the sharing terminal 1000 to perform the operations performed by the sharing terminal in the method described in Embodiment 1 above.

According to the sharing terminal provided in Embodiment 3 of the present invention, for the image block in the top-level window in the image to be encoded, the target image block is not matched in the image of the previous moment, but only the target image is matched in the top-level window region. Block, therefore, the amount of calculation is small, the coding efficiency is high, so that the real-time of screen sharing can be improved.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative For example, the division of the unit is only a logical function division, and the actual implementation may have another division manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be Ignore, or not execute. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

The functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer terminal (which may be a personal computer, server, or network terminal, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

A method for encoding a screen shared image, the method comprising:

The shared terminal acquires an image displayed on the screen of the shared terminal as a screen shared image at a preset time interval, wherein the screen shared image acquired at the first time is the first image, and the screen shared image acquired at the second time is the first a second image, where the first moment and the second moment are adjacent moments;

The sharing terminal divides the second image into a plurality of rectangular image blocks;

The sharing terminal determines, according to the description information of the second top-level window area, that the first top-level window displayed at the first time on the screen of the shared terminal and the second top-level window displayed at the second time are the same top-level window a first to-be-coded image block in the second top-level window region of the plurality of rectangular image blocks, wherein the second top-level window region is the second top-level window in the second screen shared image Area occupied

And the sharing terminal matches the target image block corresponding to the first to-be-coded image block in the first top-level window area in the first image according to the description information of the first top-level window area, where the a top window area is an area occupied by the first top window in the first screen shared image, and image data in the target image block is the same as image data in the first to-be-coded image block;

And the sharing terminal uses a displacement of the first to-be-coded image block relative to the target image block as a motion vector of the first to-be-encoded image block.
The method of claim 1, wherein the sharing terminal matches the first in the first top-level window area in the first image according to the description information of the first top-level window area The target image block with the same image block to be encoded specifically includes:

The sharing terminal is in the first top window according to the description information of the first top window area Determining, in the area, a first to-be-matched image block having the same width as the first to-be-coded image block, a displacement of the first to-be-coded image block relative to the first to-be-matched image block, and the second top layer The displacement of the window region relative to the first top window region is the same;

The sharing terminal determines whether the image data in the first image to be matched is the same as the image data in the target image block, and if the same, the first image to be matched is used as the target image block.
The method according to claim 2, wherein said sharing terminal matches said first in said first top-level window area in said first image according to said description information of said first top-level window area The target image block having the same image block to be encoded further includes:

If it is different, determining, according to the description information of the first top-level window area, a second to-be-matched image block having the same width and width as the first to-be-encoded image block in the first top-level window area, the second to-be-held Matching the abscissa of the left edge of the matching image block and the abscissa of the left edge of the first image block to be matched

And the ordinate of the upper edge of the second image to be matched and the ordinate of the upper edge of the first image block to be matched are different;

And determining, when the image data in the second image to be matched is the same as the image data in the target image block, the second image to be matched as the target image block.
The method of claim 3, wherein the sharing terminal, after determining that the image data in the second image to be matched is the same as the image data in the target image block, further comprises:

Determining, by the sharing terminal, the second to-be-coded image block in the second top-level window area, the second to-be-coded image block, according to the description information of the second top-level window area Different from the first image block to be encoded;

The sharing terminal is in the first top window according to the description information of the first top window area Determining, in the region, a third to-be-matched image block having the same width as the second to-be-coded image block, a displacement of the second to-be-coded image block relative to the third to-be-matched image block, and the first to-be-matched The displacement of the coded image block is the same with respect to the target image block, and when the image data of the third image to be matched is determined to be the same as the image data of the second image block to be encoded, the second image to be encoded is The displacement of the block relative to the third image to be matched is used as the motion vector of the second image block to be encoded.
A sharing terminal, comprising: an obtaining module and an encoding module;

The acquiring module acquires an image displayed on a screen of the sharing terminal as a screen sharing image at a preset time interval, where the screen sharing image acquired at the first time is the first image, and the screen sharing acquired at the second time is The image is a second image, and the first moment and the second moment are adjacent moments;

The encoding module is configured to divide the second image into a plurality of rectangular image blocks, a first top-level window displayed at a first moment on a screen of the shared terminal, and a second top-level displayed at a second moment When the window is the same top-level window, determining, according to the description information of the second top-level window region, the first to-be-coded image block in the second top-level window region of the plurality of rectangular image blocks, wherein the second top-level window region Sharing the area occupied by the image in the second screen for the second top window, and matching and matching in the first top window area in the first image according to the description information of the first top window area a target image block corresponding to the first to-be-coded image block, wherein the first top-level window area is an area occupied by the first top-level window in the first screen shared image, in the target image block The image data is the same as the image data in the first image block to be encoded; and is further configured to use the displacement of the first image block to be encoded relative to the target image block as the first to be edited Motion vector of the image block.
A sharing terminal according to claim 5, wherein said encoding module is specifically for root Determining, according to the description information of the first top-level window area, a first to-be-matched image block having the same width as the first to-be-encoded image block in the first top-level window area, the first to-be-coded image block Determining the displacement of the first to-be-matched image block with respect to the displacement of the second top-level window region with respect to the first top-level window region, and determining image data in the first image to be matched and the Whether the image data in the target image block is the same, and when the determination result is the same, the first image to be matched is used as the target image block.
The sharing terminal according to claim 6, wherein the encoding module is further configured to: in the first top-level window region, according to description information of the first top-level window region, when the determination result is different Determining a second to-be-matched image block having a width equal to the first to-be-coded image block, an abscissa of a left edge of the second to-be-matched image block, and a horizontal of a left edge of the first to-be-matched image block The coordinates are the same, and the ordinate of the upper edge of the second image to be matched is different from the ordinate of the upper edge of the first image block to be matched, and the image data in the image block to be matched is determined. When the image data in the target image block is the same, the second image to be matched is used as the target image block.
The sharing terminal according to claim 7, wherein the encoding module is further configured to: after determining that the image data in the second image to be matched is the same as the image data in the target image block, according to The description information of the second top-level window area determines a second to-be-encoded image block in the second top-level window area of the plurality of rectangular image blocks, the second to-be-coded image block is different from the first Determining, according to the description information of the first top-level window region, a third to-be-matched image block having the same width and width as the second to-be-coded image block according to the description information of the first top-level window region, Determining the displacement of the second to-be-coded image block relative to the third to-be-matched image block and the displacement of the first to-be-coded image block relative to the target image block, determining a map of the third to-be-matched image block When the image data is the same as the image data of the second image block to be encoded, the displacement of the second image block to be encoded relative to the image block to be matched is used as the motion vector of the image block to be encoded. .