CN110572654A

CN110572654A - video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, storage medium, and electronic apparatus

Info

Publication number: CN110572654A
Application number: CN201910927984.0A
Authority: CN
Inventors: 高欣玮; 毛煦楠; 谷沉沉
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-09-27
Filing date: 2019-09-27
Publication date: 2019-12-13
Anticipated expiration: 2039-09-27
Also published as: CN110572654B

Abstract

the invention discloses a video encoding method, a video decoding method, a video encoding device, a video decoding device, a storage medium and an electronic device. Wherein, the method comprises the following steps: acquiring a motion vector MV of a reference block of a block to be coded in a video frame to be coded, wherein the reference block is a coded block referred to by the block to be coded in the video frame to be coded; determining a target resolution for coding the block to be coded according to the motion vector MV; and coding the block to be coded according to the target resolution. The invention solves the technical problem of poor video quality caused by relatively large coding distortion of different blocks in one frame of a video by adopting the same resolution in the existing video coding process.

Description

Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, storage medium, and electronic apparatus

Technical Field

The present invention relates to the field of computers, and in particular, to a video encoding method, a video decoding method, a video encoding device, a video decoding device, a storage medium, and an electronic device.

Background

With the development of digital media technology and computer technology, video is applied to various fields, such as mobile communication, network monitoring, network television, and the like. With the improvement of hardware performance and screen resolution, the demand of users for high-definition video is increasingly strong.

if different blocks in a frame of a video are encoded by adopting high resolution, under the condition that the transmission bandwidth is small, the peak signal-to-noise ratio PSNR1 corresponding to the different blocks in the frame of the video encoded by adopting high resolution is lower than the peak signal-to-noise ratio PSNR2 corresponding to the different blocks in the frame of the video encoded by adopting low resolution, that is, the peak signal-to-noise ratio PSNR1 corresponding to the different blocks in the frame of the video encoded by adopting high resolution is relatively small when the transmission bandwidth is small, and the distortion is relatively large.

Similarly, if the different blocks in one frame of the video are encoded with low resolution, the peak signal-to-noise ratio PSNR3 corresponding to the low resolution encoding of the different blocks in one frame of the video is lower than the peak signal-to-noise ratio PSNR4 corresponding to the high resolution encoding of the different blocks in one frame of the video when the transmission bandwidth is relatively large, that is, the peak signal-to-noise ratio PSNR3 corresponding to the low resolution encoding of the different blocks in one frame of the video is relatively small and the distortion is relatively large when the transmission bandwidth is relatively large.

Under the condition of limited moving bandwidth, the existing method for encoding different blocks in a frame of a video by using the same resolution ratio may have the problem that certain scenes are relatively large in distortion, so that the video quality is poor.

In view of the above problems, no effective solution has been proposed.

disclosure of Invention

embodiments of the present invention provide a video encoding method and apparatus, a video decoding method and apparatus, a storage medium, and an electronic apparatus, so as to at least solve the technical problem of poor video quality caused by relatively large coding distortion when different blocks in a frame of a video are coded with the same resolution in the existing video encoding process.

according to an aspect of the embodiments of the present invention, there is also provided a video decoding method, including:

Acquiring a motion vector MV of a reference block of a block to be decoded in a video frame to be decoded, wherein the reference block is a decoded block referred to by the block to be decoded in the video frame to be decoded;

determining a target resolution for decoding the block to be decoded according to the motion vector MV, wherein the target resolution is a first resolution when the motion vector MV indicates that the intensity of motion of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And decoding the block to be decoded according to the target resolution.

according to another aspect of the embodiments of the present invention, there is also provided a video encoding method, including:

acquiring a motion vector MV of a reference block of a block to be coded in a video frame to be coded, wherein the reference block is a coded block referred to by the block to be coded in the video frame to be coded;

determining a target resolution for encoding the block to be encoded according to the motion vector MV, wherein the target resolution is a first resolution in the case that the motion vector MV indicates that the intensity of motion of a reference block of the block to be encoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

and coding the block to be coded according to the target resolution.

According to another aspect of the embodiments of the present invention, there is also provided a video decoding apparatus, including:

A first obtaining module, configured to obtain a motion vector MV of a reference block of a block to be decoded in a video frame to be decoded, where the reference block is a decoded block referred to by the block to be decoded in the video frame to be decoded;

A first determining module, configured to determine a target resolution for decoding the block to be decoded according to the motion vector MV, where the target resolution is a first resolution in a case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

and the decoding module is used for decoding the block to be decoded according to the target resolution.

according to another aspect of the embodiments of the present invention, there is also provided a video encoding apparatus, including:

a second obtaining module, configured to obtain a motion vector MV of a reference block of a block to be coded in a video frame to be coded, where the reference block is a coded block referred to by the block to be coded in the video frame to be coded;

A second determining module, configured to determine a target resolution for encoding the block to be encoded according to the motion vector MV, where the target resolution is the first resolution in a case that the motion vector MV indicates that the severity of motion of a reference block of the block to be encoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And the coding module is used for coding the block to be coded according to the target resolution.

according to yet another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned video encoding method or the above-mentioned video decoding method when running.

According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the video encoding method or executes the video decoding method through the computer program.

In the embodiment of the invention, the target resolution of the current block to be coded is decided through the motion vector MV of the reference block of the block to be coded in the video frame to be coded, the block to be coded is coded according to the target resolution, and different coding blocks are coded by adopting different resolutions, so that the coding distortion is relatively small, the video quality is improved, and the technical problem of poor video quality caused by relatively large coding distortion of different blocks in one frame of a video by adopting the same resolution in the existing video coding process is solved.

drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

FIG. 1 is a diagram illustrating an exemplary embodiment of a video encoding method and a video decoding method;

FIG. 2 is a diagram illustrating an internal structure of the terminal of FIG. 1 according to one embodiment;

FIG. 3 is a diagram illustrating the internal structure of the server of FIG. 1 in one embodiment;

Fig. 4 is a flowchart of a video encoding method according to an embodiment of the present invention;

FIG. 5 is a first schematic diagram of video encoding according to an embodiment of the present invention;

FIG. 6 is a second diagram of video encoding according to an embodiment of the present invention;

fig. 7 is a flowchart of a video decoding method according to an embodiment of the present invention;

Fig. 8 is a block diagram of a video decoding apparatus according to an embodiment of the present invention;

fig. 9 is a block diagram of a video encoding apparatus according to an embodiment of the present invention;

fig. 10 is a block diagram of a video encoding apparatus according to a preferred embodiment of the present invention;

FIG. 11 is a first schematic structural diagram of an alternative electronic device according to an embodiment of the invention;

Fig. 12 is a schematic structural diagram of an alternative electronic device according to an embodiment of the invention.

Detailed Description

in order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

it should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

fig. 1 is a diagram illustrating an application environment in which a video encoding method and a video decoding method are executed according to an embodiment. As shown in fig. 1, the application environment includes a terminal 110 and a server 120, wherein the terminal 110 and the server 120 communicate via a network.

The terminal 110 may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like. The video encoding method and the video decoding method may be completed in the terminal 110 or the server 120, and the terminal 110 may perform adaptive resolution encoding on a video frame to be encoded by using the video encoding method and then transmit the encoded video frame to the server 120, or may receive encoded data of the adaptive resolution from the server 120 and perform decoding by using the video decoding method to generate a decoded video frame. The server 120 may transcode the bitstream when it is stored, where the video encoding method is performed at the server, and if the server 120 needs to decode the bitstream, where the video decoding method is performed at the server.

in one embodiment, the internal structure of the terminal 110 in fig. 1 is as shown in fig. 2, and the terminal 110 includes a processor, a graphic processing unit, a storage medium, a memory, a network interface, a display screen, and an input device, which are connected through a system bus. The storage medium of the terminal 110 stores an operating system, and further includes a video encoding apparatus and/or a video decoding apparatus, which are used to implement a video encoding method and/or a video decoding method suitable for the terminal. The processor is used to provide computational and control capabilities that support the operation of the entire terminal 110. The graphic processing unit in the terminal 110 is configured to provide at least a rendering capability of a display interface, the memory provides an environment for the operation of the video encoding device and/or the video decoding device in the storage medium, and the network interface is configured to perform network communication with the server 120. The display screen is used for displaying an application interface and the like, such as decoding video, and the input device is used for receiving commands or data input by a user. For a terminal 110 with a touch screen, the display screen and input device may be a touch screen. The structure shown in fig. 2 is a block diagram of only a part of the structure related to the present application, and does not constitute a limitation of the terminal to which the present application is applied, and a specific terminal or server may include more or less components than those shown in the figure, or combine some components, or have a different arrangement of components.

in one embodiment, the internal structure of the server 120 in fig. 1 is shown in fig. 3, and the server 120 includes a processor, a storage medium, a memory, and a network interface connected by a system bus. The storage medium of the server 120 stores an operating system, a database, a video encoding device and/or a video decoding device, wherein the database is used for storing data, and the video encoding device and/or the video decoding device are used for implementing a video encoding method and/or a video decoding method suitable for the server 120. The processor of the server 120 is used to provide computing and control capabilities to support the operation of the entire server 120. The memory of the server 120 provides an environment for the operation of the video encoding device and/or the video decoding device in the storage medium. The network interface of the server 120 is used for communication with the external terminal 110 through a network connection. The configurations shown in fig. 2 and 3 are block diagrams of only a portion of the configurations associated with the present application and do not constitute a limitation on the terminal to which the present application is applied, and a particular terminal or server may include more or fewer components than shown, or combine certain components, or have a different arrangement of components.

an embodiment of the present invention provides a video encoding method, which is exemplified by a terminal or a server applied in the above application environment, and fig. 4 is a flowchart of the video encoding method according to the embodiment of the present invention, as shown in fig. 4, including the following steps:

Step S402, obtaining a motion vector MV of a reference block of a block to be coded in a video frame to be coded, wherein the reference block is a coded block referred to by the block to be coded in the video frame to be coded;

A Motion Vector (MV) indicates that an image scene is a large Motion scene when the Motion Vector is large.

Specifically, the video frame to be encoded may be a video frame collected in real time for instant messaging, or may be a video frame corresponding to a stored video. The MV in the embodiments of the present invention refers to the sum of absolute values (or mean square error) of differences between the encoded reconstructed pixel and the original pixel value.

The reference block in the embodiment of the present invention may be an encoded block adjacent to the block to be encoded, or may be an encoded block that is not adjacent to the block to be encoded, the interval between the block to be encoded and the reference block is not greater than n pixels, the reference block is located in front of the encoding time sequence of the current block to be encoded, or located in front of the decoding time sequence of the current block to be decoded, that is, the encoded block or the decoded block in the preamble.

Step S404, determining a target resolution for coding the block to be coded according to the motion vector MV, wherein the target resolution is a first resolution under the condition that the motion vector MV represents that the intensity of motion of a reference block of the block to be coded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

Specifically, when the length of the motion vector MV of one decoded block is smaller than a first preset threshold, or the variance or the mean of the lengths of the motion vectors MV of a plurality of decoded blocks is smaller than a fifth preset threshold, the degree of motion intensity of the reference block is greater than or equal to a predetermined threshold, that is, the motion is not intense, but the motion is intense on the contrary, where the fifth preset threshold is the same as or different from the first preset threshold.

step S406, encoding the block to be encoded according to the target resolution.

In an optional embodiment, the step S404 may specifically include:

Under the condition that the motion vector MV represents that the motion of a reference block of the block to be coded is not severe (namely, a non-large motion scene), determining the target resolution as a first resolution;

And in the case that the motion vector MV indicates that the reference block of the block to be coded has severe motion (i.e. a large motion scene), determining the target resolution as a second resolution, wherein the first resolution is greater than the second resolution.

in this embodiment of the present invention, the reference block may be one encoded block or may be multiple encoded blocks, and step S404 may specifically include:

S4041, in case that the reference block is a coded block, determining the target resolution according to the length of the motion vector MV of the coded block; the length of the motion vector MV is also called the modulus of the motion vector MV. The block to be coded is the t-th block in the video frame to be coded, the reference block is the coded t-k block, the MV of the t-k block is calculated, and the target resolution can be determined according to the MV of the t-k block.

s4042, in the case that the reference block is a plurality of encoded blocks, determining the target resolution according to the variance or mean of the lengths of the motion vectors MV of the plurality of encoded blocks, specifically, calculating the MV of each encoded block in the reference block, and determining the variance or mean of the MVs of all encoded blocks in the reference block, so as to determine the target resolution.

in an embodiment of the present invention, step S4041 may specifically include:

Determining the target resolution as a first resolution under the condition that the length of the motion vector MV of the one coded block is smaller than a first preset threshold;

In case that the length of the motion vector MV of the one encoded block is greater than or equal to the first preset threshold, the target resolution is determined to be the second resolution, wherein the first resolution is greater than the second resolution, wherein the first preset threshold may be preset according to specific situations, for example, the first preset threshold may be set to any number of 5-7, for example, the first preset threshold may be set to 6.

further, the second resolution may be divided into a plurality of levels of resolution, for example, the second resolution includes: a third resolution, a fourth resolution, a fifth resolution, a sixth resolution, and the like, for example, the third resolution is 3/4 of the width of the first resolution, the fourth resolution is 2/3 of the width of the first resolution, the fifth resolution is 1/2 of the width of the first resolution, and the sixth resolution is 1/3 of the width of the first resolution, and correspondingly, in the case that the length of the motion vector MV of the encoded block is greater than or equal to the first preset threshold, determining that the target resolution is the second resolution includes:

determining the target resolution to be a third resolution in a case that the length of the motion vector MV of the one encoded block is greater than or equal to the first preset threshold and less than a second preset threshold, where the second preset threshold may be set in advance, for example, the second preset threshold may be set to 9, and when the MV of the one encoded block is greater than or equal to 6 and less than 9, the target resolution may be determined to be 3/4 of the width and height of the first resolution;

Determining the target resolution as a fourth resolution when the length of the motion vector MV of the one encoded block is greater than or equal to the second preset threshold and less than a third preset threshold; the third preset threshold may be preset, for example, the second preset threshold may be set to 12, and when the MV of one coded block is greater than or equal to 9 and less than 12, it may be determined that the target resolution is 2/3 of the width and height of the first resolution.

determining the target resolution as a fifth resolution under the condition that the length of the motion vector MV of the coded block is greater than or equal to the third preset threshold and smaller than a fourth preset threshold; the fourth preset threshold may be preset, for example, the second preset threshold may be set to 15, and when the MV of one encoded block is greater than or equal to 12 and less than 15, the target resolution may be determined to be 1/2 of the width and height of the first resolution.

In the case that the length of the motion vector MV of one encoded block is greater than or equal to the fourth preset threshold, the target resolution is determined to be the sixth resolution, and in the case that the length of the MV of one encoded block is greater than or equal to 15, the target resolution may be determined to be 1/3 of the width and height of the first resolution, and it can be seen that the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

For a current block to be coded in a video, if a motion vector MV of a coded block is less than a first preset threshold value, the motion between frames of the current coded block is complex, and the current coded block is coded by adopting high resolution, namely, the coding is carried out by adopting the first resolution. If the second preset threshold > motion vector MV > of one coded block is equal to the first preset threshold, it indicates that the intra texture of the current coded block is complex, and the current coded block is coded by using high-resolution width-height 3/4 samples, that is, the third resolution may be 3/4 of the width of the first resolution; if the third preset threshold > motion vector MV > of one coded block is equal to the second preset threshold, it indicates that the intra texture of the current coded block is complex, and the current coded block is coded by using high-resolution 2/3 samples of width and height, i.e. the fourth resolution may be 2/3 of the width and height of the first resolution; if the fourth preset threshold > motion vector MV > of one coded block is equal to the third preset threshold, it indicates that the intra texture of the current coded block is complex, and the current coded block is coded by using high-resolution width-height 1/2 samples, that is, the fifth resolution may be 1/2 of the first resolution; if the motion vector MV > of one coded block is equal to the fourth preset threshold, it indicates that the intra texture of the current coded block is complex, and the current coded block is coded by using high-resolution 1/3 samples of width and height, that is, the sixth resolution may be 1/3 of the width and height of the first resolution, and so on.

In an embodiment of the present invention, the first preset threshold, the second preset threshold, and the third preset threshold, and the fourth preset threshold is positively correlated with a maximum resolution in a preset resolution set, for example, the first preset threshold may be set to 6, the second preset threshold is set to 9, the third preset threshold is set to 12, and the fourth preset threshold is set to 15, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

In the embodiment of the present invention, the flag bit directly carries the target Resolution, where the first Resolution, the second Resolution, the third Resolution, the fourth Resolution, the fifth Resolution, and the sixth Resolution may be represented by 3 bits, for example, 000 represents the first Resolution, 001 represents the second Resolution, 010 represents the third Resolution, 011 represents the fourth Resolution, 100 represents the fifth Resolution, and 101 represents the sixth Resolution, the flag bit may be an Adaptive Resolution flag bit, and the name may be Adaptive Resolution.

In an embodiment of the present invention, step S4042 may specifically include:

determining the target resolution as a first resolution in case that a variance or a mean of lengths of the motion vectors MV of the plurality of encoded blocks is less than a fifth preset threshold;

in a case that the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the fifth preset threshold, determining the target resolution as the second resolution, where the first resolution is greater than the second resolution, where the fifth preset threshold may be the same as or different from the first preset threshold, and may be preset according to specific situations, for example, the fifth preset threshold may be set to any number from 5 to 7, and for example, the first preset threshold may be set to 7.

wherein, the variance or mean of the lengths of the motion vectors MV of the plurality of encoded blocks is the square of the length of the difference vector between the motion vector MV of each of the plurality of encoded blocks and the average vector (the average vector is the mean of each dimension in the dimension of the respective vector).

further, the second resolution may be divided into a plurality of levels of resolution, for example, the second resolution includes: a third resolution, a fourth resolution, a fifth resolution, a sixth resolution, and the like, for example, the third resolution is 3/4 of the width of the first resolution, the fourth resolution is 2/3 of the width of the first resolution, the fifth resolution is 1/2 of the width of the first resolution, the sixth resolution is 1/3 of the width of the first resolution, and correspondingly, in the case that the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the fifth preset threshold, determining that the target resolution is the second resolution includes:

Determining the target resolution as a third resolution when the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the fifth preset threshold and less than a sixth preset threshold; wherein, the sixth preset threshold may be set in advance, for example, the sixth preset threshold may be set to 10, and when the weighted sum of the MVs of the plurality of encoded blocks is greater than or equal to 7 and less than 10, the target resolution may be determined to be 3/4 of the width and height of the first resolution.

Determining the target resolution as a fourth resolution when the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the sixth preset threshold and less than a seventh preset threshold; wherein, the seventh preset threshold may be set in advance, for example, the seventh preset threshold may be set to 13, and when the weighted sum of the MVs of the plurality of encoded blocks is greater than or equal to 10 and less than 13, the target resolution may be determined to be 2/3 of the width and height of the first resolution.

Determining the target resolution as a fifth resolution when the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the seventh preset threshold and less than an eighth preset threshold; wherein, the eighth preset threshold may be set in advance, for example, the eighth preset threshold may be set to 16, and when the weighted sum of the MVs of the plurality of encoded blocks is greater than or equal to 13 and less than 16, the target resolution may be determined to be 1/2 of the width and height of the first resolution.

in a case where the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the eighth preset threshold, the target resolution is determined to be the sixth resolution, and in a case where the weighted sum of the MVs of the plurality of encoded blocks is greater than or equal to 16, the target resolution may be determined to be 1/3 of the width and height of the sixth resolution, where the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

for a current block to be coded in a video, if the variance of the motion vectors MV of a plurality of coded blocks is smaller than a first preset threshold, it indicates that the inter-frame motion of the current block is complex, and the current block is coded with high resolution, that is, with the first resolution. If the second preset threshold > is the variance > of the motion vectors MV of the multiple encoded blocks, which is equal to the first preset threshold, it indicates that the intra texture of the current encoded block is complex, and the current encoded block is encoded by using high-resolution width-height 3/4 samples, that is, the third resolution may be 3/4 of the width of the first resolution; if the third preset threshold > is the variance > of the motion vectors MV of the multiple encoded blocks, which is the second preset threshold, it indicates that the intra texture of the current encoded block is complex, and the current encoded block is encoded by using high-resolution 2/3 samples of width and height, that is, the fourth resolution may be 2/3 of the width and height of the first resolution; if the fourth preset threshold > is the variance > of the motion vectors MV of the multiple encoded blocks, which is equal to the third preset threshold, it indicates that the intra texture of the current encoded block is complex, and the current encoded block is encoded by using high-resolution width-height 1/2 samples, that is, the fifth resolution may be 1/2 of the first resolution; if the variance > of the motion vectors MV of multiple encoded blocks is equal to the fourth preset threshold, it indicates that the intra texture of the current encoded block is complex, and the current encoded block is encoded by using high-resolution 1/3 samples of width and height, i.e. the sixth resolution may be 1/3 of the width and height of the first resolution, and so on.

in an embodiment of the present invention, the fifth preset threshold, the sixth preset threshold, and the seventh preset threshold, the eighth preset threshold is positively correlated to a maximum resolution in a preset resolution set, for example, the fifth preset threshold is set to 7, the sixth preset threshold is set to 10, the seventh preset threshold is set to 13, and the eighth preset threshold is set to 16, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

in the embodiment of the present invention, in a case where the reference block includes a plurality of encoded blocks, the plurality of encoded blocks are consecutive encoded blocks, or discontinuous encoded blocks.

in the video encoding process of the embodiment of the invention, different blocks in a frame in a video are adaptively encoded by adopting corresponding resolutions, the resolution adopted by the current block is decided to be high resolution or low resolution by utilizing the information (MV) of the encoded block in the neighborhood, and the decoding resolution of the current block can be determined at a decoding end according to the same decision rule, so that the decoding is rapidly completed.

the decision process of the coding resolution used by the coding block of the present invention will be described in detail below.

for a current coding block t to be coded in a video, referring to the relation between the variance of MVs of a plurality of coding blocks (continuous or discontinuous) which are adjacent to the current coding block t and have finished coding and a threshold value, and selecting a corresponding resolution for the t-th coding block to code.

in the first mode, when the t-th coding block in the video is coded, the variance of the MVs of the t-k coding blocks which are coded in the neighborhood is obtained (the variance is large and indicates that the motion directions are inconsistent). If the variance is greater than the preset threshold value, the coding consistency is poor, the coding is complex, and therefore the t-th coding block is coded by selecting low resolution; if the variance is less than the preset threshold value, the coding consistency is better, the coding complexity is lower, and therefore the t-th coding block is selected to be coded with high resolution.

In the second mode, when the t-th coding block in the video is coded, the variance of the MVs of a plurality of coding blocks which are coded in the neighborhood is obtained (the variance is large and indicates that the motion directions are inconsistent). If the variance is greater than the preset threshold value, the coding consistency is poor, the coding is complex, and therefore the t-th coding block is coded by selecting low resolution; if the variance is less than the preset threshold value, the coding consistency is better, the coding complexity is lower, and therefore the t-th coding block is selected to be coded with high resolution.

as an alternative example, the predetermined threshold may be positively correlated with the maximum resolution of the selectable resolutions.

As an alternative example, the plurality of frames may be consecutive ones or non-consecutive ones.

Fig. 5 is a schematic diagram of video encoding according to an embodiment of the present invention, as shown in fig. 5, in the video encoding process according to an embodiment of the present invention, for different blocks in a frame of a video, the coding resolution adopted by the different blocks is self-analyzed by using information of a current coding block, so that the purpose that the corresponding peak signal-to-noise ratio is relatively large and distortion is relatively small in both the case that the bandwidth of transmission is relatively small (e.g., smaller than the bandwidth threshold Th shown in fig. 5) and the case that the bandwidth of transmission is relatively large (e.g., larger than the bandwidth threshold Th shown in fig. 5) can be achieved.

in addition, because the coding resolution adopted by the decision is adaptive to different blocks in one frame of the video, the corresponding resolution does not need to be selected according to the intersections (fig. 6 is a schematic diagram two of video coding according to an embodiment of the present invention, as shown by the intersections in fig. 6) corresponding to different types of videos or different frames of the same video or different blocks in the same frame when the frames in the video are coded, and the coding complexity is reduced.

In the video coding process, the coding resolution adopted by the gradient information self-adaptive decision of the adjacent coded blocks is utilized for different blocks in one frame in the video, so that the relatively high peak signal-to-noise ratio is realized under the whole bandwidth, and the distortion is small. In addition, when different blocks in one frame of the video are coded, the corresponding resolution does not need to be selected according to the intersections corresponding to different types of videos or different frames of the same video or different blocks in the same frame, and the coding complexity is reduced.

An embodiment of the present invention provides a video decoding method, which is exemplified by a terminal or a server applied in the above application environment, and fig. 7 is a flowchart of the video decoding method according to the embodiment of the present invention, as shown in fig. 7, including the following steps:

Step S702, obtaining a motion vector MV of a reference block of a block to be decoded in a video frame to be decoded, wherein the reference block is a decoded block referred to by the block to be decoded in the video frame to be decoded;

In the embodiment of the present invention, in the case where the reference block includes a plurality of decoded blocks, the plurality of decoded blocks are a plurality of decoded blocks that are consecutive, or a plurality of decoded blocks that are discontinuous.

step S704, determining a target resolution for decoding the block to be decoded according to the motion vector MV, wherein the target resolution is a first resolution when the motion vector MV indicates that the intensity of motion of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; in the case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

step S706, decoding the block to be decoded according to the target resolution.

Through the above steps S702 to S706, the decoding side obtains the motion vector MV of the reference block of the block to be decoded in the video frame to be decoded, where the reference block is the decoded block referred to by the block to be decoded in the video frame to be decoded, determines the target resolution for decoding the block to be decoded according to the motion vector MV, and decodes the block to be decoded according to the target resolution, thereby solving the technical problem that in the existing video encoding process, different blocks in one frame of a video are encoded with the same resolution, and the decoding process is performed with the same resolution, so that the distortion in the video transmission process is relatively large, and the video quality is poor.

in the embodiment of the invention, at least one pair of blocks to be decoded to be reconstructed is determined from a current video frame, wherein each pair of blocks to be decoded in the at least one block to be decoded comprises a first block to be decoded with a first resolution and a second block to be decoded with a second resolution, and the first block to be decoded and the second block to be decoded are adjacent blocks to be decoded;

Adjusting the first resolution of the first block to be decoded to a target resolution, and adjusting the second resolution of the second block to be decoded to the target resolution;

determining a first edge pixel point set from the first block to be decoded and determining a second edge pixel point set from the second block to be decoded, wherein the position of the first edge pixel point set is adjacent to the position of the second edge pixel point set;

and filtering the first edge pixel point set to obtain a filtered first edge pixel point set, and filtering the second edge pixel point set to obtain a filtered second edge pixel point set, wherein the filtered first edge pixel point set is matched with the filtered second edge pixel point set.

and a first difference value between the pixel value of the ith pixel point in the first edge pixel point set after filtering and the pixel value of the jth pixel point corresponding to the ith pixel point in the second edge pixel point set after filtering is smaller than a second difference value between the pixel value of the ith pixel point in the first edge pixel point set and the pixel value of the jth pixel point in the second edge pixel point set, i is a positive integer and is less than or equal to the total number of the pixel points in the first edge pixel point set, and j is a positive integer and is less than or equal to the total number of the pixel points in the second edge pixel point set.

Wherein adjusting to the target resolution comprises:

1) Adjusting the second resolution to the first resolution in a case where the target resolution is equal to the first resolution;

2) Adjusting the first resolution to the second resolution in a case where the target resolution is equal to the second resolution;

3) In the case where the target resolution is equal to the third resolution, the first resolution is adjusted to the third resolution, and the second resolution is adjusted to the third resolution, wherein the third resolution is different from the first resolution and different from the second resolution.

By adjusting the resolution of the block to be decoded and performing edge filtering on the edge pixel point set determined in the block to be decoded, obvious seams can be avoided in the video in the reconstruction process, so that the content in the video can be accurately restored, and the technical problem of video distortion caused by inconsistent resolution is solved.

in an optional embodiment, the step S704 may specifically include:

Determining the target resolution as a first resolution under the condition that the motion vector MV represents that the motion of a reference block of the block to be decoded is not severe (namely, a non-large motion scene);

in the case that the motion vector MV indicates that the reference block of the block to be decoded is in severe motion (i.e. a large motion scene), the target resolution is determined to be the second resolution, wherein the first resolution is greater than the second resolution.

in another optional embodiment, the step S704 may specifically include:

S7041, in case the reference block is a decoded block, determining the target resolution according to the motion vector MV of the decoded block; the block to be decoded is the t-th block in the video frame to be decoded, the reference block is the decoded t-k block, the MV of the t-k block is calculated, and the target resolution can be determined according to the MV of the t-k block.

s7042, in case the reference block is a plurality of decoded blocks, determining the target resolution according to the variance of the MV of the motion vectors of the plurality of decoded blocks, specifically, calculating the MV of each decoded block in the reference block, and determining the variance or mean of the MVs of all decoded blocks in the reference block, so as to determine the target resolution.

in an embodiment of the present invention, the step S7041 may specifically include:

determining the target resolution as a first resolution in case the motion vector MV of the one decoded block is smaller than a first preset threshold;

in case that the motion vector MV of the decoded block is greater than or equal to the first preset threshold, the target resolution is determined to be the second resolution, wherein the first resolution is greater than the second resolution, wherein the first preset threshold may be preset according to specific situations, for example, the first preset threshold may be set to any number of 5-7, for example, the first preset threshold may be set to 6.

Further, the second resolution may be divided into a plurality of levels of resolution, for example, the second resolution includes: a third resolution, a fourth resolution, a fifth resolution, a sixth resolution, and the like, for example, the third resolution is 3/4 of the width of the first resolution, the fourth resolution is 2/3 of the width of the first resolution, the fifth resolution is 1/2 of the width of the first resolution, and the sixth resolution is 1/3 of the width of the first resolution, and correspondingly, in the case that the motion vector MV of the decoded block is greater than or equal to the first preset threshold, determining that the target resolution is the second resolution includes:

determining the target resolution as a third resolution when the motion vector MV of the decoded block is greater than or equal to the first preset threshold and less than a second preset threshold;

Determining the target resolution as a fourth resolution when the motion vector MV of the decoded block is greater than or equal to the second preset threshold and less than a third preset threshold;

Determining the target resolution as a fifth resolution when the motion vector MV of the decoded block is greater than or equal to the third preset threshold and less than a fourth preset threshold;

determining the target resolution as a sixth resolution in case the motion vector MV of the decoded block is greater than or equal to the fourth predetermined threshold, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

In an embodiment of the present invention, the first preset threshold, the second preset threshold, the third preset threshold, and the fourth preset threshold are respectively in positive correlation with a maximum resolution in a preset resolution set, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

in an embodiment of the present invention, the step S7042 may specifically include:

Determining the target resolution as a first resolution in case that the variance of the motion vectors MV of the plurality of decoded blocks is less than a fifth preset threshold;

Determining the target resolution as a second resolution if the variance of the motion vectors MV of the decoded blocks is greater than or equal to the fifth predetermined threshold, wherein the first resolution is greater than the second resolution. The fifth preset threshold may be the same as or different from the first preset threshold, and may be preset according to specific situations, for example, the fifth preset threshold may be set to any number of 5 to 7, and for example, the first preset threshold may be set to 7

further, the second resolution may be divided into a plurality of levels of resolution, for example, the second resolution includes: a third resolution, a fourth resolution, a fifth resolution, a sixth resolution, and the like, for example, the third resolution is 3/4 of the width of the first resolution, the fourth resolution is 2/3 of the width of the first resolution, the fifth resolution is 1/2 of the width of the first resolution, the sixth resolution is 1/3 of the width of the first resolution, and the determining that the target resolution is the second resolution in the case that the variance of the motion vectors MV of the decoded blocks is greater than or equal to the fifth preset threshold includes:

Determining the target resolution as a third resolution when the variance of the motion vectors MV of the decoded blocks is greater than or equal to the fifth preset threshold and less than a sixth preset threshold; the sixth preset threshold may be preset, for example, the sixth preset threshold may be set to 10, and when the weighted sum of the MADs of the plurality of decoded blocks is greater than or equal to 7 and less than 10, it may be determined that the target resolution is 3/4 of the width and height of the first resolution.

Determining the target resolution as a fourth resolution when the variance of the motion vectors MV of the decoded blocks is greater than or equal to the sixth preset threshold and less than a seventh preset threshold; wherein, the seventh preset threshold may be preset, for example, the seventh preset threshold may be set to 13, and when the weighted sum of the MADs of the plurality of decoded blocks is greater than or equal to 10 and less than 13, it may be determined that the target resolution is 2/3 of the width and height of the first resolution.

determining the target resolution as a fifth resolution if the variance of the motion vectors MV of the decoded blocks is greater than or equal to the seventh preset threshold and less than an eighth preset threshold; the eighth preset threshold may be preset, for example, the eighth preset threshold may be set to 16, and when the weighted sum of the MADs of the plurality of decoded blocks is greater than or equal to 13 and less than 16, the target resolution may be determined to be 1/2 of the width and height of the first resolution.

The target resolution is determined to be the sixth resolution in a case where the variance of the motion vectors MV of the plurality of decoded blocks is greater than or equal to the eighth preset threshold, and the target resolution may be determined to be 1/3 of the width and height of the sixth resolution in a case where the weighted sum of the MVs of the plurality of decoded blocks is greater than or equal to 16, where the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

In an embodiment of the present invention, the fifth preset threshold, the sixth preset threshold, the seventh preset threshold, and the eighth preset threshold are respectively in positive correlation with a maximum resolution in a preset resolution set, for example, the fifth preset threshold is set to be 7, the sixth preset threshold is set to be 10, the seventh preset threshold is set to be 13, and the eighth preset threshold is set to be 16, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

an embodiment of the present invention further provides a video decoding apparatus, and fig. 8 is a block diagram of a video decoding apparatus according to an embodiment of the present invention, as shown in fig. 8, including:

a first obtaining module 82, configured to obtain a motion vector MV of a reference block of a block to be decoded in a video frame to be decoded, where the reference block is a decoded block referred to by the block to be decoded in the video frame to be decoded;

A first determining module 84, configured to determine a target resolution for decoding the block to be decoded according to the motion vector MV, where the target resolution is a first resolution in a case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

and a decoding module 86, configured to decode the block to be decoded according to the target resolution.

Fig. 9 is a block diagram of a video decoding apparatus according to a preferred embodiment of the present invention, and as shown in fig. 9, the first determining module 84 includes:

a first determining sub-module 92 for determining the target resolution according to the length of the motion vector MV of one decoded block in case the reference block is the one decoded block;

A second determining sub-module 94 for determining the target resolution according to a variance or a mean of lengths of the motion vectors MV of the plurality of decoded blocks in case that the reference block is a plurality of decoded blocks.

optionally, the first determining submodule 92 includes:

a first determining unit, configured to determine the target resolution as a first resolution if the length of the motion vector MV of the one decoded block is smaller than a first preset threshold;

A second determining unit, configured to determine the target resolution as a second resolution if the length of the motion vector MV of the decoded block is greater than or equal to the first preset threshold, wherein the first resolution is greater than the second resolution.

optionally, the second determination unit is further used for

Determining the target resolution as a third resolution when the length of the motion vector MV of the decoded block is greater than or equal to the first preset threshold and less than a second preset threshold;

Determining the target resolution as a fourth resolution when the length of the motion vector MV of the decoded block is greater than or equal to the second preset threshold and less than a third preset threshold;

Determining the target resolution as a fifth resolution when the length of the motion vector MV of the decoded block is greater than or equal to the third preset threshold and less than a fourth preset threshold;

Determining the target resolution as a sixth resolution in case that the length of the motion vector MV of the decoded block is greater than or equal to the fourth preset threshold, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

Optionally, the first preset threshold, the second preset threshold, the third preset threshold, and the fourth preset threshold are positively correlated with a maximum resolution in a predetermined resolution set, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

optionally, the apparatus further comprises:

a second obtaining module, configured to, when t and k corresponding to different values are not completely the same, in a process of decoding the block to be decoded according to the target resolution, obtain, for the t-th block, a t-th flag bit corresponding to the t-th block, where the t-th flag bit is used to indicate k corresponding to t.

Optionally, the second determining submodule 94 includes:

A third determining unit configured to determine the target resolution as the first resolution if a variance or a mean of lengths of the motion vectors MV of the plurality of decoded blocks is less than a fifth preset threshold;

a fourth determining unit, configured to determine the target resolution as a second resolution if a variance or a mean of lengths of the motion vectors MV of the plurality of decoded blocks is greater than or equal to the fifth preset threshold, wherein the first resolution is greater than the second resolution.

optionally, the fourth determination unit is further configured to

Determining the target resolution as a third resolution when the variance or the mean of the lengths of the motion vectors MV of the decoded blocks is greater than or equal to the fifth preset threshold and less than a sixth preset threshold;

determining the target resolution as a fourth resolution when the variance or the mean of the lengths of the motion vectors MV of the decoded blocks is greater than or equal to the sixth preset threshold and less than a seventh preset threshold;

Determining the target resolution as a fifth resolution if the variance or the mean of the lengths of the motion vectors MV of the decoded blocks is greater than or equal to the seventh preset threshold and less than an eighth preset threshold;

Determining the target resolution as a sixth resolution in case that a variance or a mean of lengths of the motion vectors MV of the decoded blocks is greater than or equal to the eighth preset threshold, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

optionally, the fifth preset threshold, the sixth preset threshold, the seventh preset threshold, and the eighth preset threshold are positively correlated with a maximum resolution in a predetermined resolution set, respectively, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

Optionally, in a case where the reference block includes a plurality of decoded blocks, the plurality of decoded blocks are a continuous plurality of decoded blocks, or a discontinuous plurality of decoded blocks.

An embodiment of the present invention further provides a video encoding apparatus, and fig. 10 is a block diagram of a video encoding apparatus according to an embodiment of the present invention, as shown in fig. 10, including:

A second obtaining module 102, configured to obtain a motion vector MV of a reference block of a block to be coded in a video frame to be coded, where the reference block is a coded block referred to by the block to be coded in the video frame to be coded;

a second determining module 104, configured to determine a target resolution for encoding the block to be encoded according to the motion vector MV, where the target resolution is the first resolution in a case that the motion vector MV indicates that the severity of motion of the reference block of the block to be decoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And the encoding module 106 is configured to encode the block to be encoded according to the target resolution.

Optionally, the second determining module 104 includes:

A third determining sub-module, configured to determine the target resolution according to the length of the motion vector MV of one coded block if the reference block is the one coded block;

a fourth determining sub-module, configured to determine the target resolution according to a variance or a mean of lengths of the motion vectors MV of the plurality of encoded blocks, if the reference block is the plurality of encoded blocks.

optionally, the third determining sub-module includes:

A fifth determining unit, configured to determine the target resolution as the first resolution if the length of the motion vector MV of the one encoded block is smaller than a first preset threshold;

a sixth determining unit, configured to determine the target resolution as a second resolution if the length of the motion vector MV of the one encoded block is greater than or equal to the first preset threshold, where the first resolution is greater than the second resolution.

Optionally, the sixth determining unit is further configured to

determining the target resolution as a third resolution when the length of the motion vector MV of the one encoded block is greater than or equal to the first preset threshold and smaller than a second preset threshold;

Determining the target resolution as a fourth resolution when the length of the motion vector MV of the one encoded block is greater than or equal to the second preset threshold and less than a third preset threshold;

Determining the target resolution as a fifth resolution under the condition that the length of the motion vector MV of the coded block is greater than or equal to the third preset threshold and smaller than a fourth preset threshold;

In case the length of the motion vector MV of the one encoded block is greater than or equal to the fourth preset threshold, determining the target resolution as a sixth resolution, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

optionally, the first preset threshold, the second preset threshold, the third preset threshold, and the fourth preset threshold are respectively in positive correlation with a maximum resolution in a predetermined resolution set, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

Optionally, the fourth determining sub-module includes:

A seventh determining unit, configured to determine the target resolution as the first resolution if a variance or a mean of lengths of the motion vectors MV of the plurality of encoded blocks is smaller than a fifth preset threshold;

An eighth determining unit, configured to determine the target resolution as a second resolution if a variance or a mean of lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the fifth preset threshold, wherein the first resolution is greater than the second resolution.

optionally, the eighth determining unit is further configured to

determining the target resolution as a third resolution when the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the fifth preset threshold and less than a sixth preset threshold;

Determining the target resolution as a fourth resolution when the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the sixth preset threshold and less than a seventh preset threshold;

determining the target resolution as a fifth resolution when the variance or the mean of the lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the seventh preset threshold and less than an eighth preset threshold;

Determining the target resolution as a sixth resolution in case that a variance or a mean of lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the eighth preset threshold, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

optionally, the fifth preset threshold, the sixth preset threshold, the seventh preset threshold, and the eighth preset threshold are respectively in positive correlation with a maximum resolution in a predetermined resolution set, where the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

Optionally, in a case that the reference block includes a plurality of encoded blocks, the plurality of encoded blocks are consecutive encoded blocks, or discontinuous encoded blocks.

An electronic device for implementing the video decoding method is further provided in an embodiment of the present invention, and as shown in fig. 11, the electronic device includes a memory 1102 and a processor 1104, where the memory 1102 stores therein a computer program, and the processor 1104 is configured to execute the steps in any one of the method embodiments through the computer program.

Optionally, in this embodiment, the electronic apparatus may be located in at least one network device of a plurality of network devices of a computer network.

Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:

s11, obtaining a motion vector MV of a reference block of a block to be decoded in a video frame to be decoded, wherein the reference block is a decoded block referred to by the block to be decoded in the video frame to be decoded;

s12, determining a target resolution for decoding the block to be decoded according to the motion vector MV, wherein the target resolution is a first resolution in case that the motion vector MV indicates that the intensity of motion of the reference block of the block to be decoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And S13, decoding the block to be decoded according to the target resolution.

alternatively, it can be understood by those skilled in the art that the structure shown in fig. 11 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an android Mobile phone, an iOS Mobile phone, etc.), a tablet computer, a palm computer, a Mobile Internet device (M id), a PAD, and the like. Fig. 11 is a diagram illustrating a structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 11, or have a different configuration than shown in FIG. 11.

The memory 1102 may be used to store software programs and modules, such as program instructions/modules corresponding to the method and apparatus for acquiring a media resource in the embodiments of the present invention, and the processor 1104 executes various functional applications and data processing by running the software programs and modules stored in the memory 1102, that is, implements the above-mentioned method for acquiring a media resource. The memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1102 can further include memory located remotely from the processor 1104 and such remote memory can be coupled to the terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 1102 may be specifically, but not limited to, used for information such as an encryption key (including a first encryption key, a second encryption key, etc.) and a decryption key (including a first decryption key, a second decryption key, etc.). As an example, as shown in fig. 11, the memory 1102 may include, but is not limited to, the first obtaining module 82, the first determining module 84, and the decoding module 86 of the video decoding apparatus. In addition, the video decoding apparatus may further include, but is not limited to, other module units in the first video decoding apparatus, which is not described in this example again.

Optionally, the transmitting device 1106 is used for receiving or transmitting data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transmission device 1106 includes a Network adapter (NIC) that can be connected to a router via a Network cable to communicate with the internet or a local area Network. In one example, the transmission device 1106 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

in addition, the electronic device further includes: a display 1108 for displaying the media assets; and a connection bus 1110 for connecting the respective module parts in the above-described electronic apparatus.

According to yet another aspect of the embodiments of the present invention, there is also provided an electronic device for implementing the video coding method, as shown in fig. 10, the electronic device includes a memory 1102 and a processor 1104, the memory 1102 stores therein a computer program, and the processor 1104 is configured to execute the steps in any one of the method embodiments through the computer program.

s21, obtaining a motion vector MV of a reference block of a block to be coded in a video frame to be coded, wherein the reference block is a coded block referred to by the block to be coded in the video frame to be coded;

s22, determining a target resolution for coding the block to be coded according to the motion vector MV, wherein the target resolution is a first resolution under the condition that the motion vector MV represents that the intensity of motion of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; when the motion vector MV indicates that the motion intensity of the reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And S23, encoding the block to be encoded according to the target resolution.

alternatively, it can be understood by those skilled in the art that the structure shown in fig. 12 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an android Mobile phone, an iOS Mobile phone, etc.), a tablet computer, a palm computer, a Mobile Internet device (M id), a PAD, etc. Fig. 12 is a diagram illustrating a structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 12, or have a different configuration than shown in FIG. 12.

the memory 1102 may be used to store software programs and modules, such as program instructions/modules corresponding to the method and apparatus for acquiring a media resource in the embodiments of the present invention, and the processor 1104 executes various functional applications and data processing by running the software programs and modules stored in the memory 1102, that is, implements the above-mentioned method for acquiring a media resource. The memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1102 can further include memory located remotely from the processor 1104 and such remote memory can be coupled to the terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 1102 may be specifically, but not limited to, used for information such as an encryption key (including a first encryption key, a second encryption key, etc.) and a decryption key (including a first decryption key, a second decryption key, etc.). As an example, as shown in fig. 12, the memory 1102 may include, but is not limited to, the second obtaining module 102, the second determining module 104, and the encoding module 106 of the video encoding apparatus. In addition, the video encoding apparatus may further include, but is not limited to, other module units in the first video encoding apparatus, which is not described in this example again.

According to a further aspect of an embodiment of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the steps in any of the above-mentioned method embodiments when executed.

alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:

And S13, decoding the block to be decoded according to the target resolution.

alternatively, in this embodiment, a person skilled in the art may understand that all or part of the steps in the methods of the foregoing embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

and S23, encoding the block to be encoded according to the target resolution.

the above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in the above computer-readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing one or more computer devices (which may be personal computers, servers, network devices, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention.

in the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

the foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims

1. a video decoding method, comprising:

obtaining a motion vector MV of a reference block of a block to be decoded in a video frame to be decoded, wherein the reference block is a decoded block referred to by the block to be decoded in the video frame to be decoded;

Determining a target resolution for decoding the block to be decoded according to the motion vector MV, wherein the target resolution is a first resolution when the motion vector MV indicates that the intensity of motion of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; in the case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And decoding the block to be decoded according to the target resolution.

2. the method of claim 1, wherein determining a target resolution for decoding the block to be decoded from the motion vector MV comprises:

Determining the target resolution according to a length of a motion vector MV of one decoded block in case that the reference block is the one decoded block;

In the case where the reference block is a plurality of decoded blocks, the target resolution is determined according to a variance or mean of lengths of motion vectors MV of the plurality of decoded blocks.

3. The method of claim 2, wherein determining the target resolution from the motion vector MV of the one decoded block comprises:

determining the target resolution as a first resolution in case the length of the motion vector MV of the one decoded block is smaller than a first preset threshold;

determining the target resolution to be a second resolution if the length of the motion vector MV of the one decoded block is greater than or equal to the first preset threshold, wherein the first resolution is greater than the second resolution.

4. the method of claim 3, wherein determining the target resolution as the second resolution in case the motion vector MV of the decoded block is greater than or equal to the first preset threshold comprises:

determining the target resolution as a third resolution if the length of the motion vector MV of the decoded block is greater than or equal to the first preset threshold and less than a second preset threshold;

Determining the target resolution as a fourth resolution if the length of the motion vector MV of the decoded block is greater than or equal to the second preset threshold and less than a third preset threshold;

determining the target resolution to be a fifth resolution if the length of the motion vector MV of the decoded block is greater than or equal to the third preset threshold and less than a fourth preset threshold;

determining the target resolution to be a sixth resolution if the length of the motion vector MV of the decoded block is greater than or equal to the fourth preset threshold, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

5. The method according to claim 4, wherein the first preset threshold, the second preset threshold, the third preset threshold, and the fourth preset threshold are positively correlated to a maximum resolution in a predetermined resolution set, respectively, wherein the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution, and the sixth resolution.

6. The method of claim 2, wherein determining the target resolution from the variance of the motion vectors MVs for the plurality of decoded blocks comprises:

determining the target resolution to be a first resolution in a case where a variance or a mean of lengths of Motion Vectors (MVs) of the plurality of decoded blocks is less than a fifth preset threshold;

determining the target resolution to be a second resolution if a variance or a mean of lengths of the motion vectors MV of the plurality of decoded blocks is greater than or equal to a fifth preset threshold, wherein the first resolution is greater than the second resolution, and the fifth preset threshold is the same as or different from the first preset threshold.

7. the method of claim 6, wherein the determining the target resolution to be the second resolution in case the variance of the motion vectors MV of the plurality of decoded blocks is greater than or equal to the fifth preset threshold comprises:

Determining the target resolution as a third resolution if a variance or a mean of lengths of motion vectors MV of the plurality of decoded blocks is greater than or equal to the fifth preset threshold and less than a sixth preset threshold;

determining the target resolution as a fourth resolution if a variance or a mean of lengths of motion vectors MV of the plurality of decoded blocks is greater than or equal to the sixth preset threshold and less than a seventh preset threshold;

Determining the target resolution to be a fifth resolution if a variance or a mean of lengths of Motion Vectors (MVs) of the plurality of decoded blocks is greater than or equal to the seventh preset threshold and less than an eighth preset threshold;

Determining the target resolution to be a sixth resolution in case that a variance or a mean of lengths of motion vectors MV of the plurality of decoded blocks is greater than or equal to the eighth preset threshold, wherein the first resolution > the third resolution > the fourth resolution > the fifth resolution > the sixth resolution.

8. The method according to claim 7, wherein the fifth preset threshold, the sixth preset threshold, the seventh preset threshold and the eighth preset threshold are positively correlated to a maximum resolution in a predetermined resolution set, respectively, wherein the resolution set includes the first resolution, the third resolution, the fourth resolution, the fifth resolution and the sixth resolution.

9. The method of claim 2, wherein in the case that the reference block comprises a plurality of decoded blocks, the plurality of decoded blocks are a consecutive plurality of decoded blocks or a non-consecutive plurality of decoded blocks.

10. A video encoding method, comprising:

determining a target resolution for encoding the block to be encoded according to the motion vector MV, wherein the target resolution is a first resolution when the motion vector MV indicates that the motion intensity of a reference block of the block to be encoded is greater than or equal to a predetermined threshold; in the case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

And coding the block to be coded according to the target resolution.

11. The method of claim 10, wherein determining a target resolution for encoding the block to be encoded according to the motion vector MV comprises:

determining the target resolution according to the length of the motion vector MV of the coded block under the condition that the reference block is the coded block;

in the case where the reference block is a plurality of encoded blocks, the target resolution is determined according to a variance or mean of lengths of motion vectors MV of the plurality of encoded blocks.

12. the method of claim 11, wherein determining the target resolution according to the length of the motion vector MV of the one encoded block comprises:

determining the target resolution as a first resolution in case that the length of the motion vector MV of the one encoded block is smaller than a first preset threshold;

determining the target resolution to be a second resolution if the length of the motion vector MV of the one encoded block is greater than or equal to the first preset threshold, wherein the first resolution is greater than the second resolution.

13. The method of claim 11, wherein determining the target resolution according to the variance or mean of the lengths of the motion vectors MV of the plurality of encoded blocks comprises:

Determining the target resolution as a first resolution in case that a variance or a mean of lengths of motion vectors MV of the plurality of encoded blocks is less than a fifth preset threshold;

Determining the target resolution to be a second resolution in case that a variance or a mean of lengths of the motion vectors MV of the plurality of encoded blocks is greater than or equal to the fifth preset threshold, wherein the first resolution is greater than the second resolution.

14. A video decoding apparatus, comprising:

a first determining module, configured to determine a target resolution for decoding the block to be decoded according to the motion vector MV, where the target resolution is a first resolution in a case that the motion vector MV indicates that a motion severity of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; in the case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;

15. a video encoding apparatus, comprising:

the second obtaining module is used for obtaining a motion vector MV of a reference block of a block to be coded in a video frame to be coded, wherein the reference block is a coded block referred to by the block to be coded in the video frame to be coded;

A second determining module, configured to determine a target resolution for encoding the block to be encoded according to the motion vector MV, where the target resolution is the first resolution in a case that the motion vector MV indicates that a motion intensity of a reference block of the block to be decoded is greater than or equal to a predetermined threshold; in the case that the motion vector MV indicates that the severity of motion of a reference block of the block to be decoded is less than the predetermined threshold, the target resolution is a second resolution, wherein the first resolution is greater than the second resolution;