WO2015196718A1

WO2015196718A1 - Video encoding method and device

Info

Publication number: WO2015196718A1
Application number: PCT/CN2014/091932
Authority: WO
Inventors: 张林涛; 毛丹; 苗军
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-06-25
Filing date: 2014-11-21
Publication date: 2015-12-30
Also published as: CN105208381A

Abstract

A video encoding method and device, which are applied to a multi-core video encoding environment. The method comprises: in the case where a current frame image is not a first frame image in a video, detecting a first division manner of a previous frame image in the video; dividing the current frame image in a second division manner, wherein the second division manner is different form the first division manner; and encoding sub-images obtained by dividing the current frame image. By means of the video encoding method and device provided in the embodiments of the present invention, each frame image in a video is dynamically partitioned during the process of encoding a multi-core video, thereby avoiding the problem in the related art that the video encoding quality is affected due to the fact that difference effects are continuously accumulated since the position of an intermediate partition line for static partition is fixed.

Description

Video coding method and device

Technical field

The present invention relates to the field of video coding technologies, and in particular, to a video coding method and apparatus.

Background technique

With the development of the Internet, the demand for multimedia services, especially video services, is accelerating. As the core technology of multimedia applications, video codec technology plays a huge role in applications such as remote monitoring, distance learning, telemedicine diagnosis, remote shopping, remote viewing, video conferencing and video telephony. With the increasing demand for high-definition video compression transmission, high-performance codec and other related technologies have become research hotspots. With the development of mainstream video compression standards, the contradiction between its increasingly high computational complexity and the current single-core computing power limitation of DSP (Digital Signal Processor) is quite prominent. With the wide application of network multimedia services for ultra-high resolution support and high-definition picture quality streaming media, the demand for high-performance parallel computing is also increasing. The existing single-core DSP architecture is difficult to meet the performance requirements and is difficult to meet. Real-time codec requirements, while high-definition real-time image applications such as video conferencing require high-speed encoding on multi-core architectures to enable larger-scale parallel data calculations.

Summary of the invention

In order to realize real-time encoding on a multi-core DSP, the original video data is usually distributed to multiple cores of the processor and simultaneously encoded in parallel, and the encoded data is collected and packaged after the encoding is completed. Since the horizontal motion in the video scene is more common, in the related art, the video frame is usually uniformly and horizontally divided into a plurality of parts, and then encoded by a plurality of cores. However, this will bring a problem. Taking dual-core encoding as an example, if one frame of image is divided into upper and lower half frames and then separately encoded, the coding parameters on both sides of the upper and lower field boundaries will be different, and after merging the images, A visual intermediate divider difference effect is produced during video playback. Since the static segmentation method in the multi-core encoding of the video frame in the related art is relatively fixed, the effect of the intermediate dividing line generated in the video is continuously accumulated, thereby affecting the quality of the video encoding.

The embodiment of the invention provides a video encoding method and device, which avoids the influence of the difference effect caused by the static intermediate dividing line in the prior art and affects the video encoding quality.

According to an aspect of the present invention, an embodiment of the present invention provides a video coding method, which is applied to a multi-core video coding environment, and includes:

In a case where the current frame image is not the first frame image in the video, detecting a first division manner of the previous frame image in the video;

And dividing the current frame image by using a second dividing manner, where the second dividing manner is different from the first dividing manner;

The sub-image obtained by dividing the current frame image is encoded.

Optionally, the second dividing manner is different from the first dividing manner, and includes: dividing positions when the image frames in the video are divided.

Optionally, the second dividing manner is different from the first dividing manner, and further includes: the number of the divided sub-images is different.

Optionally, the first dividing manner and the second dividing manner each include: dividing an image frame in the video into at least two sub-images.

Optionally, the dividing the image frame in the video into at least two sub-images includes:

Dividing the image frame in the video horizontally into at least two sub-images;

Alternatively, the image frames in the video are vertically divided into at least two sub-images.

Optionally, each sub-image obtained by the division is the same size.

According to another aspect of the present invention, an embodiment of the present invention further provides a video encoding apparatus, including:

a detecting module, configured to detect a first dividing manner of a previous frame image in the video if the current frame image is not the first frame image in the video;

a dividing module, configured to divide the current frame image by using a second dividing manner, where the second dividing manner is different from the first dividing manner;

The encoding module is configured to encode the sub-image obtained by dividing the current frame image.

Optionally, each of the divided sub-images has the same size.

According to still another aspect of the present invention, an embodiment of the present invention further provides a video encoding terminal, including:

a processor, configured to detect a first division manner of a previous frame image in the video when the current frame image is not the first frame image in the video; and divide the current frame image by using a second division manner, where The second dividing manner is different from the first dividing manner; the divided sub-images of the current frame image are encoded.

The embodiment of the invention further provides a computer program and a carrier thereof, the program comprising program instructions, when the program instruction is executed by the video encoding device, enabling the device to perform the above video encoding method.

With the above technical solution, the embodiment of the present invention has at least the following advantages:

The video encoding method and device according to the embodiment of the present invention adopts a dynamic segmentation mode for each frame image in the video in the video multi-core encoding process, which can avoid the influence of the difference effect of the static intermediate dividing line in the prior art. The problem of video coding quality.

BRIEF abstract

1 is a flowchart of a video encoding method according to a first embodiment of the present invention;

2 is a schematic diagram of frame image division in the first embodiment of the present invention;

3 is a schematic diagram of horizontal division of a frame image in the first embodiment of the present invention;

4 is a schematic diagram showing vertical division of a frame image in the first embodiment of the present invention;

FIG. 5 is a schematic diagram of a video encoding apparatus according to a second embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram of a video encoding terminal according to a third embodiment of the present invention.

Preferred embodiment of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

A first embodiment of the present invention, a video encoding method, is applied to a multi-core video encoding environment, as shown in FIG. 1, and includes the following specific steps:

Step S101: In a case where the current frame image is not the first frame image in the video, the first division manner of the previous frame image in the video is detected.

Specifically, it is first determined whether the frame image currently required to be encoded in the video is an IDR (Instantaneous Decoding Refresh) frame, because the IDR frame in the video frame is the first frame image in the video, if the current frame image is detected as For an IDR frame, the current frame image is the first frame image in the video. If it is detected that the current frame image is not an IDR frame, the image division mode in the image coding of the previous frame is detected, that is, the first division mode.

Step S102: Perform a second division manner on the current frame image, where the second division manner is different from the first division manner.

Specifically, after detecting the previous frame image division mode of the current frame image in the video, the current frame image in the video is divided, that is, the second division mode is used for division; wherein the second division manner is the first division manner Different, the adjacent frame images in the video are divided in different ways, so that the position of the middle dividing line of each frame of the frame image in the video is dynamically adjusted, so that the middle dividing line of the image of the latter frame is not intersected with the middle dividing line of the image of the previous frame. The coincidence avoids the phenomenon that the intermediate dividing line is superimposed on the same division mode for each frame of the video, which ensures the quality of the video.

In the case that the current frame image is not an IDR frame, if the IDR frame is defined as the 0th frame, the frame distance between the frame image currently required to be encoded and the IDR frame may also be detected. If the frame distance is an even number, the frame image currently required to be encoded may be in the same division manner as the IDR frame; if the frame distance between the currently required frame image and the IDR frame is an odd number, a different division manner from the IDR frame image may be adopted. In this way, The current frame image is adjacent to the IDR frame image, and the current frame image and the IDR frame image are not divided in the same manner. According to the frame-to-parity of the currently-coded frame image and the IDR frame, even if only two frame images are divided, it is possible to avoid the case where the adjacent two frames of the video are equally divided. Of course, the more the division of the frame image, the more the phenomenon that the intermediate dividing line is superimposed on the same division mode for each frame of the video can be avoided. In addition, the present invention may also select a division manner required for each frame image according to the frame number frame_num allocated when the frame image is encoded in the video; wherein the frame_num value of the IDR frame is 0, and the frame_num value of the subsequent frame image and the IDR The frame spacing, so that the frame image of the frame to be encoded in the video can be purposefully selected.

Optionally, in the manner of dividing the frame image in the video, the encoded frame image may be divided into multiple manners, such as a horizontal division manner and a vertical division manner.

Fig. 2 is a diagram showing the division of frame images in the first embodiment of the present invention.

As shown in FIG. 2, the frame image in the video is divided into four parts, and four sub-images are obtained: slice 0, slice 1, slice 2, and slice 3. Chip 0, slice 1, slice 2, and slice 3 are respectively handed over to DSP1, DSP2, DSP3, and DSP4 for simultaneous parallel encoding processing.

FIG. 3 is a schematic diagram of horizontal division of a frame image in the first embodiment of the present invention.

Three consecutive frame images are shown in Figure 3. As shown in FIG. 3, considering the middle 2j frame image as the current frame image, firstly, the division manner of the previous frame image in the video is checked, that is, the division manner of the 2j-1 frame image in FIG. 3 is detected. Since the current frame image and the previous frame image are all divided by the horizontal division method, the specific division of the current frame image can be avoided by adjusting the number or size of the divided sub-images of the current frame image. The method is the same as the specific division of the image of the previous frame, so that the problem that the current frame image is generated at the same position as the intermediate dividing line when the image of the previous frame is divided can be avoided. Similarly, when the next frame image is specifically divided, the same specific division method as the current frame image should be avoided.

As can be seen from FIG. 3, the adjacent frame images in the video image are divided in different ways, and the purpose is to make the positions of the intermediate dividing lines generated by the adjacent frame images different. The positions of the intermediate dividing lines L1, L2, ..., Ln-1 generated in the 2j-1th frame image in Fig. 3 are different from the positions of the intermediate dividing lines L1, L2, ..., Ln-1 generated in the 2jth frame image. Similarly, FIG. 4 is a method for vertically dividing an image in the first embodiment of the present invention, so that the position of the intermediate dividing line generated by the adjacent frame images in FIG. 4 is different, as shown in FIG. 4 . The positions of the intermediate dividing lines L1, L2, ..., Ln-1 generated in the 2j-1th frame image are different from the positions of the intermediate dividing lines L1, L2, ..., Ln-1 generated in the 2jth frame image.

It should be noted that, in the embodiment of the present invention, the manner of dividing the video frame image is not limited to the horizontal division and the vertical division. In other embodiments, other division manners may also be adopted.

Step S103, encoding the sub-image obtained by dividing the current frame image.

Specifically, with reference to FIG. 2, the embodiment of the present invention divides the frame image in the video into four sub-images, and then passes the divided four sub-images to four DSP cores for parallel simultaneous encoding processing, which adopts the embodiment of the present invention. The method of encoding and processing all the frame images in the video frame is re-consolidated into a video image, and the position of the intermediate dividing line generated by dividing the adjacent video frame image into different sub-images is different, and the phase is not in the video playing process. The superposition of the intermediate dividing lines of the adjacent frame images results in a reduction in video encoding quality.

In addition, in a case where the current frame is the first frame image in the video, the division mode of the other frame image is not detected, and the current frame image is directly divided. Since the current frame image is the first frame image in the video, it is also the first frame image that needs to be encoded. Since the subsequent other frame images have not been subjected to encoding processing, the division of the frame images is not performed. Therefore, it is only necessary to directly divide and encode the current frame image according to the frame image division of the above-described one of the current frame images. A second embodiment of the present invention, as shown in FIG. 5, is a video encoding apparatus, including:

The detecting module 10 is configured to detect a first dividing manner of the previous frame image in the video if the current frame image is not the first frame image in the video.

Specifically, it is first determined whether the frame image currently required to be encoded in the video is an IDR frame. Since the IDR frame in the video screen is the first frame image in the video, if the current frame image is detected as an IDR frame, the current frame image is in the video. The first frame of the image. If it is detected that the current frame image is not an IDR frame, the detecting module 10 detects an image division manner in the image encoding of the previous frame, that is, a first division manner.

The dividing module 20 is configured to divide the current frame image by using a second dividing manner, and the second dividing manner is different from the first dividing manner.

Specifically, after the detection module 10 detects the previous frame image division mode of the current frame image in the video, the dividing module 20 divides the current frame image in the video, that is, divides by using the second division manner; wherein, the second division manner To be different from the first division method, so that adjacent frame images in the video The division mode is different, so that the position of the middle dividing line of each frame of the frame image in the video is dynamically adjusted, so that the middle dividing line of the image of the latter frame does not coincide with the middle dividing line of the image of the previous frame, thereby avoiding each frame in the video. The phenomenon that the images are superimposed by the same division mode and the intermediate dividing lines appear ensures the quality of the video.

In the case that the current frame image is not an IDR frame, if the IDR frame is defined as the 0th frame, the frame distance between the frame image currently required to be encoded and the IDR frame may also be detected. If the frame distance is an even number, the frame image currently required to be encoded may be in the same division manner as the IDR frame; if the frame distance between the currently required frame image and the IDR frame is an odd number, a different division manner from the IDR frame image may be adopted. Thus, even if the current frame image is adjacent to the IDR frame image, the current frame image and the IDR frame image are not divided in the same manner. According to the frame-to-parity of the currently-coded frame image and the IDR frame, even if only two frame images are divided, it is possible to avoid the case where the adjacent two frames of the video are equally divided. Of course, the more the division of the frame image, the more the phenomenon that the intermediate dividing line is superimposed on the same division mode for each frame of the video can be avoided. In addition, the present invention may also select a division manner required for each frame image according to the frame number frame_num allocated when the frame image is encoded in the video; wherein the frame_num value of the IDR frame is 0, and the frame_num value of the subsequent frame image and the IDR The frame spacing, so that the frame image of the frame to be encoded in the video can be purposefully selected.

Optionally, in the manner of dividing the frame image in the video, the encoded frame image may be divided into multiple manners, such as a horizontal division manner and a vertical division manner. For details, refer to FIG. 3 and FIG. 4.

The encoding module 30 is configured to encode the divided sub-images in the current frame image.

Specifically, in combination with FIG. 2, the frame image in the video is divided into four parts, and four sub-images are obtained: slice 0, slice 1, slice 2, and slice 3. Chip 0, slice 1, slice 2, and slice 3 are respectively handed over to DSP1, DSP2, DSP3, and DSP4 for simultaneous parallel encoding processing.

A third embodiment of the present invention, as shown in FIG. 6, is a video encoding terminal, including:

The processor 40 is configured to: when the current frame image is not the first frame image in the video, detect a first division manner of the previous frame image in the video; and divide the current frame image by using a second division manner, and the second division manner Different from the first division manner; encoding the sub-image obtained after division in the current frame image.

Specifically, it is first determined whether the frame image currently required to be encoded in the video is an IDR frame. Since the IDR frame in the video screen is the first frame image in the video, if the current frame image is detected as an IDR frame, the current frame image is in the video. The first frame of the image. If it is detected that the current frame image is not an IDR frame, the image division mode in the image coding of the previous frame is detected, that is, the first division mode.

After detecting the previous frame image division mode of the current frame image in the video, the current frame image in the video is divided, that is, divided according to the second division manner. The second division mode is different from the first division manner, so that adjacent frame images in the video are divided in different manners. In this way, by dynamically adjusting the position of the intermediate dividing line of each frame of the frame image in the video, the middle dividing line of the latter frame image does not coincide with the middle dividing line of the previous frame image, thereby avoiding adopting each frame image in the video. The phenomenon of superposition of intermediate dividing lines appearing in the same division mode ensures the quality of the video.

Application examples of the invention:

This application example uses the four cores of the model TCI6678 to complete the video data encoding of 1080 format, the encoding type is IPPPPP, and select the "1080P_example.yuv" sequence with the resolution of 1920×1080 as the test sequence, combined with the above figure 1. ~ Figure 4, the specific implementation steps are as follows:

Step 1. Determine whether the current encoded frame is an IDR frame or an even frame, that is, whether it is a 2j frame. If yes, go to step 2. If not, go to step 3.

Step 2: The 2j frame image of the "1080P_example.yuv" sequence is spatially divided into four slices, which are respectively coded by four cores of DSP0, DSP1, DSP2, and DSP3, and each image has the same size. Then, go to step 4.

Step 3: The 2j+1 frame image of the "1080P_example.yuv" sequence is re-divided into 4 slices based on step 2, and the horizontal dividing lines are all shifted down by one macroblock row, and respectively coded by four DSP cores. See Figure 2.

Step 4. Return to step 1 and continue the next frame encoding.

It should be noted that in all embodiments of the present invention, frame images and image frames in a video refer to the same concept and are well known to those skilled in the art.

In summary, the video encoding method and apparatus provided by the embodiments of the present invention use a dynamic segmentation mode for each frame of video in the video multi-core encoding process, thereby avoiding the difference effect of the static intermediate dividing line in the related art. The problem of constantly accumulating and affecting the quality of video coding can be obtained. Better video image quality.

One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium, such as on a corresponding hardware platform (eg, The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve. Thus, the invention is not limited to any specific combination of hardware and software.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When each device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Variations or substitutions are readily conceivable within the scope of the present invention by those skilled in the art and are within the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Industrial applicability

The video encoding method and device provided by the embodiments of the present invention use a dynamic segmentation mode for each frame of video in the video multi-core encoding process, which can avoid affecting the video due to the continuous accumulation of the difference of the static intermediate dividing line in the related art. Coding quality issues to get better video image quality.

Claims

A video coding method applied to a multi-core video coding environment, comprising:

In a case where the current frame image is not the first frame image in the video, detecting a first division manner of the previous frame image in the video;

And dividing the current frame image by using a second dividing manner, where the second dividing manner is different from the first dividing manner;

Sub-images obtained by dividing the current frame image are encoded.
The video encoding method according to claim 1, wherein

The second division manner is different from the first division manner, and includes: a division position when the image frame in the video is divided.
The video encoding method according to claim 2, wherein the second dividing manner is different from the first dividing manner, and further comprising: the number of divided sub-images is different.
The video encoding method according to claim 1, wherein the first dividing manner and the second dividing manner each comprise: dividing an image frame in the video into at least two sub-images.
The method according to claim 4, wherein the dividing the image frame in the video into at least two sub-images comprises:

Dividing the image frame in the video horizontally into at least two sub-images;

Alternatively, the image frames in the video are vertically divided into at least two sub-images.
The video encoding method according to claim 4 or 5, wherein each of the divided sub-images has the same size.
A video encoding device comprising:

a detecting module, configured to detect a first dividing manner of a previous frame image in the video if the current frame image is not the first frame image in the video;

a dividing module, configured to divide the current frame image by using a second dividing manner, where the second dividing manner is different from the first dividing manner;

The encoding module is configured to encode the sub-image obtained by dividing the current frame image.
The apparatus according to claim 7, wherein

The second division manner is different from the first division manner, and includes: a division position when the image frame in the video is divided.
The apparatus of claim 1, wherein the first division manner and the second division manner each comprise dividing an image frame in the video into at least two sub-images.
The apparatus according to claim 9, wherein dividing the image frame in the video into at least two sub-images comprises:

Dividing the image frame in the video horizontally into at least two sub-images;

Alternatively, the image frames in the video are vertically divided into at least two sub-images.
The apparatus according to claim 9 or 10, wherein each of the divided sub-images has the same size.
A video encoding terminal comprising:

a processor, configured to detect a first division manner of a previous frame image in the video when the current frame image is not the first frame image in the video; and divide the current frame image by using a second division manner, where The second division manner is different from the first division manner; and the sub-image obtained by dividing the current frame image is encoded.
A computer program comprising program instructions which, when executed by a video encoding device, cause the apparatus to perform the method of any of claims 1-6.
A carrier carrying the computer program of claim 13.