WO2021196994A1

WO2021196994A1 - Encoding method and apparatus, terminal, and storage medium

Info

Publication number: WO2021196994A1
Application number: PCT/CN2021/079799
Authority: WO
Inventors: 黎凌宇; 王悦
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2020-03-31
Filing date: 2021-03-09
Publication date: 2021-10-07
Also published as: CN111526363A

Abstract

The present application provides an encoding method and apparatus, a terminal, and a storage medium. The encoding method comprises: obtaining an N-th video image frame in a video; detecting the type of the N-th video image frame; if the type of the N-th video image frame is a keyframe, starting a screen encoding tool for at least one video image frame after the N-th video image frame, and encoding the at least one video image frame on the basis of the screen encoding tool; counting the number of image blocks, which use a screen encoding mode, in each video image frame in the at least one video image frame to obtain a counting result; and determining, according to the counting result, whether to use the screen coding tool for continuous non-keyframe video images after the at least one video image frame before the arrival of a next keyframe. The encoding method in the present application allows adaptively deciding whether to open a screen encoding tool.

Description

Encoding method and device, terminal and storage medium

Cross-references to related applications

This application is filed based on the Chinese patent application with the application number 202010240984.6, the filing date of March 31, 2020, and the title "Encoding method and device, terminal and storage medium", and claims the priority of the Chinese patent application. The entire content of the patent application is incorporated herein by reference.

Technical field

The embodiments of the present disclosure relate to the field of computer technology, and in particular, to an encoding method and device, a terminal, and a storage medium.

Background technique

The screen video content is the video content captured directly from the image display of the terminal such as computer mobile phone, mainly including computer graphics, text documents, natural video and graphic text mixed images, computer-generated images, etc. Screen video has broad application prospects in desktop sharing, video conferencing, online education, cloud gaming and other fields.

Summary of the invention

In order to solve the existing problems, the present disclosure provides an encoding method and device, terminal and storage medium.

The present disclosure adopts the following technical solutions.

In some embodiments, the present disclosure provides an encoding method, including:

Obtain the Nth frame of video image in the video; where N is a positive integer;

Detecting the type of the Nth frame of video image; wherein, the type includes key frames and non-key frames;

When the type of the Nth frame of video image is the key frame, a screen encoding tool is turned on for at least one frame of video image after the Nth frame of video image, and the screen encoding tool is used for the at least Encode one frame of video image;

Counting the number of image blocks in each frame of video image in the at least one frame of video image that adopt the screen encoding mode to obtain a statistical result; and

According to the statistical result, it is determined whether to use the screen encoding tool for the continuous non-key frame video image after the at least one frame of video image before the arrival of the next key frame.

In some embodiments, the present disclosure provides an encoding device, including:

The acquisition module is used to acquire the Nth frame of video image in the video; where N is a positive integer;

The detection module is used to detect the type of the Nth frame of video image; wherein, the type includes key frames and non-key frames;

An operation module, configured to enable a screen encoding tool for at least one frame of video image after the Nth frame of video image when the type of the Nth frame of video image is the key frame, and based on the screen encoding The tool encodes the at least one frame of video image;

A statistics module, configured to count the number of image blocks in each frame of the video image in the at least one frame of video image that adopt the screen encoding mode, and obtain a statistical result; and

The determining module is configured to determine, according to the statistical result, whether to use the screen encoding tool for the continuous non-key frame video image after the at least one frame of video image before the arrival of the next key frame.

In some embodiments, the present disclosure provides a terminal, including: at least one memory and at least one processor;

Wherein, the memory is used to store program code, and the processor is used to call the program code stored in the memory to execute the above-mentioned method.

In some embodiments, the present disclosure provides a storage medium, the storage medium is used to store program code, and the program code is used to execute the above-mentioned method.

The coding scheme provided by the present disclosure can effectively distinguish screen video content and non-screen video content; for screen video, the coding efficiency of the screen coding tool can be guaranteed; for non-screen video content, the screen coding tool is adaptively turned off to speed up the coding speed and save calculations resource.

Description of the drawings

The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent in conjunction with the accompanying drawings and with reference to the following specific implementations. Throughout the drawings, the same or similar reference signs indicate the same or similar elements. It should be understood that the drawings are schematic and elements and elements are not necessarily drawn to scale.

Fig. 1 is a flowchart of an encoding method according to an embodiment of the present disclosure.

Fig. 2 is a schematic diagram of an encoding method of an embodiment of the present disclosure.

Fig. 3 is a schematic structural diagram of an encoding device according to an embodiment of the present disclosure.

Fig. 4 is a schematic structural diagram of an encoding device according to another embodiment of the present disclosure.

Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided for Have a more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are only used for exemplary purposes, and are not used to limit the protection scope of the present disclosure.

It should be understood that the steps described in the method embodiments of the present disclosure can be executed in parallel and/or in parallel. In addition, method implementations may include additional steps and/or omit to perform the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and its variations as used herein are open-ended includes, that is, "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments." Related definitions of other terms will be given in the following description.

It should be noted that the concepts of “first” and “second” mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modification of "a" mentioned in the present disclosure is illustrative and not restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

The videos that people come into contact with in practical applications are all compressed videos. This is because the data volume of uncompressed original video is amazing and cannot be directly used for actual transmission or storage. Therefore, a key technology for video applications is video coding (Video Coding), also known as video compression, whose purpose is to remove redundant components in video data as much as possible and reduce the amount of data that characterizes the video. High Efficiency Video Coding (HEVC) Screen Content Coding (SCC) proposes an expansion proposal for screen video content on HEVC/H.265. For typical screen video content, HEVC SCC can improve coding efficiency by about 50%, while also increasing coding complexity. SCC only has good coding efficiency for typical desktop videos, but it cannot improve the coding and compression efficiency of natural scene sequences captured by similar cameras, and it will greatly increase the coding complexity. In addition, the screen video content also has many natural sequence scenes, such as playing movies and TV series collected by cameras. The content produced by UGC users includes many natural scene videos captured by cameras, as well as many screen contents such as ppt, document recording, and hard subtitles. If the screen encoding tool is turned on for all videos, it will waste computing power.

In view of the above situation, the inventor filed this application, and the solutions provided by the embodiments of this application will be described in detail below in conjunction with the accompanying drawings.

As shown in Fig. 1, Fig. 1 is a flowchart of an encoding method according to an embodiment of the present disclosure, which includes the following steps.

S100. Acquire an Nth frame of video image in the video, where N is a positive integer. Specifically, N is a positive integer increasing from 1.

Today's video is usually digital video, which is essentially a series of digital images with continuous content arranged in chronological order. Because the human eye has a persistence mechanism of vision, the continuously played images will form a smooth and continuous visual effect. When the playback speed is fast enough, the human eye no longer distinguishes each image, but forms a continuous video in the mind. Therefore, the image is the basic unit of the video signal. To distinguish it from a still image, a complete image in a video is usually called a frame (Frame), and a video composed of many frames in a time sequence is called a video sequence (Video Sequence). And a frame of image can be divided into multiple image blocks.

S200: Detect the type of the Nth frame of video image, where the type includes a key frame and a non-key frame.

Specifically, a video sequence is composed of several small groups of pictures (Group Of Pictures, GOP), and each GOP is independently coded and decoded. Each GOP starts with a key frame (I frame) image, and subsequent images are non-key frames, such as P frames and B frames. Among them, the I frame does not need to refer to other frames, while the P frame and B frame need to refer to the I frame. Starting from the key frame image, the image and the images behind it can be decoded independently, without relying on any images that precede it in the code stream. In the coded stream, the appearance of a key frame image not only marks the end of the previous group of pictures, but also the beginning of a new group of pictures.

S300. When the type of the Nth frame of video image is the key frame, a screen encoding tool is turned on for at least one frame of video image after the Nth frame of video image, and the screen encoding tool is used for at least one frame based on the screen encoding tool. Video images are encoded. Wherein, the at least one frame of video image mentioned here includes M+1 frames of continuous video images composed of the Nth frame of video images and subsequent M frames of non-key frame video images, and M is a positive integer. Of course, the at least one frame of video image may not include the Nth frame of video image, or only include the Nth frame of video image.

Specifically, when a key frame (I frame) video image is detected, the embodiments of the present disclosure may encode the key frame video image and subsequent M consecutive non-key frame video images. As shown in FIG. 2, FIG. 2 is a schematic diagram of an encoding method according to an embodiment of the present disclosure. Figure 2 shows video image frames in a GOP. For example, the sequence number of the first frame is N, and the continuous last M frames of video images starting from the Nth frame are taken, that is, from the Nth frame to the (N+M)th frame. The frame performs, for example, an encoding operation. It can be understood that the value of M is a positive integer smaller than the total number of frames in the GOP, and the specific value can be determined according to actual conditions. More specifically, each frame of video image can be divided into several image blocks; among them, different image blocks can be encoded into different modes, which can include a screen video encoding mode and a regular mode.

S400: Count the number of image blocks in the at least one frame of video image that use the screen encoding mode in each frame of video image to obtain a statistical result.

Optionally, in the embodiment of the present application, the number of the image blocks using the screen encoding mode in each frame of the video image in the at least one frame of video image is greater than or equal to a first preset value and /Or when the proportion is greater than or equal to the second preset value, it is determined to use the screen coding tool for the continuous non-key frame video image; otherwise, it is determined not to use the screen coding tool for the continuous non-key frame video image.

Among them, the proportion mentioned here refers to the ratio of the number of image blocks using the screen encoding mode for a certain frame of image to the number of all image blocks included in the frame of image.

Optionally, for video images of different frames, the first preset value and/or the second preset value may be the same or different.

Specifically, the embodiment of the present disclosure may define that the number of the at least one frame of video image is M+1, and the at least one frame of video image includes the Nth frame of video image; based on the screen encoding tool, the number of the Nth frame of video The first image area in the image is encoded to obtain the number of first image blocks in the first image area using the screen encoding mode; based on the screen encoding tool, the (N+i)th frame of video image The (i+1)th image area in the image area is coded sequentially, and the number of the (i+1)th image block in the (i+1)th image area using the screen coding mode is obtained respectively; where i is from 1 is an integer incremented to M; and sequentially obtain the first proportions of the first image blocks that adopt the screen encoding mode in the first image area until the (M+1)th image area The (M+1)th proportion of the (M+1)th image block in which the screen encoding mode is adopted in the screen encoding mode; wherein the statistical result includes the proportion from the first proportion to the (M+1)th proportion (M+1) ratio of the ratio. Among them, the image area mentioned here can be a whole frame of image, or can be obtained by dividing a frame of image. In other words, one frame of image may also include at least one image area.

More specifically, still taking FIG. 2 as an example, it is assumed that video images from the Nth frame to the (N+M)th frame are respectively encoded. For each frame of video image, different image blocks may be encoded into different modes. For example, three image blocks can be included in the Nth frame of video image. If two of the image blocks are encoded in the screen encoding mode, then the number of image blocks in the sampling screen encoding mode can be known to be 2, and the ratio is 2/3 . In the same way, in other frames of video images, the number of respective image blocks using the screen encoding mode can also be obtained. Among them, the screen encoding modes include Intra block copy (IBC) mode, Hash me mode, Palette mode, and Adaptive color transform (Adaptive color transform). , ACT) at least one of the modes. The embodiments of the present disclosure may include statistical results in two forms of numerical value and ratio. If the statistical result is a numerical value, the number of image blocks in each frame of video image obtained as described above that adopts the screen encoding mode is the statistical result; if the statistical result is a ratio, the number obtained above can be divided by the frame The total number of image blocks in the video image can be used to obtain the proportion of image blocks in the frame of video image that use the screen encoding mode.

S500: Determine, according to the statistical result, whether to use the screen coding tool for continuous non-key frame video images after the at least one frame of video image before the arrival of the next key frame.

Specifically, when the statistical result is the proportion, each of the (M+1) proportions from the first proportion to the (M+1)th proportion is greater than or When the ratio is equal to the preset ratio, the embodiment of the present disclosure may determine to use the screen encoding tool for the continuous non-key frame video image; otherwise, determine not to use the screen encoding tool for the continuous non-key frame video image. When the statistical result is a numerical value, the number of the image blocks using the screen encoding mode in each of the Nth frame of video image and the at least one frame of video image is greater than or equal to the predetermined number. When setting the value, it is determined to use the screen coding tool for the continuous non-key frame video image; otherwise, it is determined not to use the screen coding tool for the continuous non-key frame video image. More specifically, the setting standard adopted in the embodiments of the present disclosure may be a preset value or a preset ratio. The specific value can be determined according to requirements, such as 50%, 80%, etc., which are not limited in the embodiment of the present disclosure. Refer to Figure 2 again, from the Nth frame to the (N+M)th frame of video images totaling (M+1) frames, which is equivalent to sampling (M+1) frames of video images in this GOP. N+M+1) Whether to start the screen coding tool at the beginning of the frame, as shown by the dotted line in Figure 2. The embodiments of the present disclosure can compare the number/proportion of image blocks of the screen video encoding mode in each sample frame with a threshold (value or ratio), and if the number/proportion in each frame is greater than a certain threshold, continue to turn on Screen coding tool; otherwise, close the screen coding tool and select the traditional coding tool. In other words, if it is greater than or equal to the preset value, the video image in the image group is screen video content; if it is less than the preset value, the video image in the image group is non-screen video content. It can be understood that the embodiment of the present disclosure can also be used when the ratio of all image blocks in the screen encoding mode to all image blocks in the sampled video image frames is greater than a threshold, instead of the proportion corresponding to each frame being greater than a threshold, that is, You can choose to continue to open the screen encoding tool.

In addition, when it is determined not to use the screen encoding tool for non-key frame video images, the embodiment of the present disclosure may turn off the screen encoding tool that has been turned on until the next type of video image frame of the key frame is detected. Turn on the screen coding tool. That is, repeat the steps from S100 to S500 in the next image group. For details, please refer to the above description, which will not be repeated here.

In the embodiments of the present disclosure, the first few frames in each I-frame interval are used as sampling frames, and the video encoding mode ratio of the sampling frames is used to determine whether the frames in the current I-frame interval need to start the screen encoding tool. When each I frame encoding arrives, first turn on the screen encoding tool, encode several frames continuously, and then count the proportion of image blocks that are finally encoded in SCC mode (IBC, Hashme, Palette, ACT, etc.). If the proportion is greater than a certain threshold, it is determined that several frames before the arrival of the next I frame are screen video content, and the on-screen video encoding tool is turned on; if the proportion is not greater than a certain threshold, it is determined that the frames before the arrival of the next I frame Several frames are natural content, turn off the screen encoding tool. That is, the SCC mode ratio of the sampled frame is used as the judgment basis to determine whether the frame in the current I frame interval needs to be turned on the screen encoding tool. Among them, the video coding mode can refer to the coding mode of the current coding block, which will be written into the code stream; when the decoder receives the code stream, the coding mode can be parsed to restore the original image. For example, image blocks can be coded as intra (Intra), inter (inter), skip, and so on. Typical screen video content such as text and graphics is often encoded as a screen video encoding mode, but it can also be encoded as a regular mode. Specifically, if the current frame is an I frame and the frame number is N, then the screen video encoding tool is started, and after the encoding of the current sample frame is finished, the proportion of the encoding in the SCC mode p[0] is counted; if the current frame is a non-I frame, The frame number is K, and the sequence number of the first frame in this GOP is N. If KN is less than M, start the screen video coding tool. After the current sample frame is coded, the proportion of the coding in SCC mode is counted p[i](i=1... M); When KN is equal to M, count p[i](i=0,1,...M), if for each i, p[i]>thresh (preset threshold), then judge the current frame to the next The frames before the arrival of the I frame are all SCC content, open the screen coding tool, otherwise, close the screen coding tool; when KN is greater than M, judge whether to open the screen coding tool according to the aforementioned results. Repeat the above steps to complete all frame encoding.

The present disclosure can determine whether it is a typical screen video content by detecting the type of the video; if it is, the screen coding tool is turned on to improve coding efficiency; if it is not, the screen coding tool is turned off to reduce coding complexity. Compared with the setting that the screen encoding tool is always turned on, the present disclosure can effectively reduce the encoding time while ensuring the encoding and compression efficiency of the screen video content.

As shown in FIG. 3, an embodiment of the present disclosure also provides an encoding device 10, which includes an acquisition module 11, a detection module 13, an operation module 15, a statistics module 17 and a determination module 19. Wherein, the acquiring module 11 can be used to acquire the Nth frame of video image in the video; wherein, N is a positive integer, specifically, N is a positive integer increasing from 1. The detection module 13 can be used to detect the type of the Nth frame of video image. The operation module 15 may be configured to enable a screen encoding tool for at least one frame of video image after the Nth frame of video image when the type of the Nth frame of video image is the key frame, and based on the screen encoding The tool encodes the at least one frame of video image. The statistics module 17 may be used to count the number of image blocks in the at least one frame of video image that adopt the screen encoding mode in each frame of the video image to obtain a statistical result. The determining module 19 may be configured to determine, according to the statistical result, whether to use the screen encoding tool for the continuous non-key frame video image after the at least one frame of video image before the next key frame arrives.

As shown in FIG. 4, an embodiment of the present disclosure also provides an encoding device 30. Different from the device 10 of the foregoing embodiment, the device 30 of the embodiment of the present disclosure further includes a switch module 36, which can be used to turn off the screen when it is determined not to use the screen encoding tool for the continuous non-key frame video image. The coding tool is not started until the next video image frame whose type is the key frame is detected.

For the device embodiment, since it basically corresponds to the method embodiment, the relevant part can refer to the part of the description of the method embodiment. The device embodiments described above are merely illustrative, and the modules described as separate modules may or may not be separate. Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement it without creative work.

Above, the encoding method and device of the present disclosure have been described based on the embodiments and application examples. In addition, this publication also provides a terminal and storage medium, which are described below.

Next, refer to FIG. 5, which shows a schematic structural diagram of an electronic device (such as a terminal device or a server) 800 suitable for implementing the embodiments of the present disclosure. Terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 5 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 5, the electronic device 800 may include a processing device (such as a central processing unit, a graphics processor, etc.) 801, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 802 or from a storage device 808 The program in the memory (RAM) 803 executes various appropriate actions and processing. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, the ROM 802, and the RAM 803 are connected to each other through a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.

Generally, the following devices can be connected to the I/O interface 805: including input devices 806 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, liquid crystal display (LCD), speakers, vibration An output device 807 such as a device; a storage device 808 such as a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the electronic device 800 to perform wireless or wired communication with other devices to exchange data. Although FIG. 5 shows an electronic device 800 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may be implemented alternatively or provided with more or fewer devices.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above, for example. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate with any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. Communication (e.g., communication network) interconnects. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.

The aforementioned computer-readable medium carries one or more programs, and when the aforementioned one or more programs are executed by the electronic device, the electronic device is caused to execute the aforementioned method of the present disclosure.

The computer program code used to perform the operations of the present disclosure may be written in one or more programming languages or a combination thereof. The above-mentioned programming languages include object-oriented programming languages—such as Java, Smalltalk, C++, and also conventional Procedural programming language-such as "C" language or similar programming language. The program code may be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).

The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logic function. Executable instructions. It should also be noted that, in some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown one after another can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure can be implemented in software or hardware. Among them, the name of the unit does not constitute a limitation on the unit itself under certain circumstances.

The functions described above in this document may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided an encoding method, including:

Acquire the Nth frame of video image in the video; where N is a positive integer, specifically, N is a positive integer that increases from 1;

Counting the number of image blocks in the at least one frame of video image that adopt the screen encoding mode in each frame of video image to obtain a statistical result; and

According to one or more embodiments of the present disclosure, there is provided a method, wherein the at least one frame of video image includes the Nth frame of video image and subsequent M frames of non-key frame video images (M +1) Frames of continuous video images, the M is a positive integer.

According to one or more embodiments of the present disclosure, there is provided a method, characterized in that the number of image blocks in each frame of the video image in the at least one frame of video image that adopts the screen encoding mode is counted to obtain a statistical result include:

Encoding the Nth frame of video image based on the screen encoding tool to obtain the number of first image blocks that adopt the screen encoding mode in the first image area of the Nth frame of video image;

Based on the screen coding tool, sequentially encode the (i+1)th image area in the (N+i)th frame of video image, and obtain the screen coding in the (i+1)th image area respectively The number of (i+1)th image blocks in the pattern; where i is an integer increasing from 1 to M; and

And sequentially obtain the first proportions of the first image blocks that adopt the screen encoding mode in the first image area until the screen encoding mode is adopted in the (M+1)th image area. The (M+1)th proportion of the (M+1)th image block;

Wherein, the statistical result includes (M+1) proportions from the first proportion to the (M+1)th proportion.

According to one or more embodiments of the present disclosure, there is provided a method, characterized in that, according to the statistical result, it is determined whether to determine whether to determine whether the next key frame before the arrival of the next key frame is continuous after the at least one frame of video image. The use of the screen encoding tools for non-key frame video images includes:

If each of the (M+1) proportions from the first proportion to the (M+1)th proportion is greater than or equal to the preset proportion, it is determined that the continuous Using the screen coding tool for non-key frame video images;

Otherwise, it is determined not to use the screen encoding tool for the continuous non-key frame video image.

According to one or more embodiments of the present disclosure, there is provided a method, characterized in that, according to the statistical result, it is determined whether to determine whether to determine whether the next key frame before the arrival of the next key frame is continuous after the at least one frame of video image. The non-key frame video image using the screen encoding tool also includes:

In the at least one frame of video image, the number of the image blocks using the screen encoding mode in each frame of the video image is greater than or equal to the first preset value and/or the proportion is greater than or equal to the second preset Value, determine to use the screen coding tool for the continuous non-key frame video image;

According to one or more embodiments of the present disclosure, there is provided a method, characterized in that the method further includes:

When it is determined not to use the screen encoding tool for the continuous non-key frame video image, turn off the screen encoding tool that has been turned on, and turn on the screen until the next type of video image frame of the key frame is detected Coding tools.

According to one or more embodiments of the present disclosure, there is provided a method, wherein the screen encoding mode includes at least one of the following:

Intra-frame block copy mode, hash-based arithmetic search mode, palette coding mode and adaptive color space conversion mode.

According to one or more embodiments of the present disclosure, there is provided an encoding device, including:

The obtaining module is used to obtain the Nth frame of video image in the video; wherein, N is a positive integer, specifically, a positive integer increasing from 1;

The detection module is used to detect the type of the Nth frame of video image;

A statistics module, configured to count the number of image blocks in the at least one frame of video image that adopt the screen coding mode in each frame of video image to obtain a statistical result; and

According to one or more embodiments of the present disclosure, there is provided a terminal, including: at least one memory and at least one processor;

The at least one memory is used to store program code, and the at least one processor is used to call the program code stored in the at least one memory to execute the method described in any one of the above.

According to one or more embodiments of the present disclosure, a storage medium is provided, the storage medium is used to store program code, and the program code is used to execute the above-mentioned method.

The above description is only a preferred embodiment of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of disclosure involved in this disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover the above technical features or technical solutions without departing from the above disclosed concept. Other technical solutions formed by arbitrarily combining the equivalent features. For example, the above-mentioned features and the technical features disclosed in the present disclosure (but not limited to) having similar functions are replaced with each other to form a technical solution.

In addition, although the operations are depicted in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or logical actions of the method, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely exemplary forms of implementing the claims.

Claims

An encoding method including:

Acquiring the Nth frame of video image in the video, where the N is a positive integer;

Detecting the type of the Nth frame of video image; wherein, the type includes key frames and non-key frames;

When the type of the Nth frame of video image is the key frame, a screen encoding tool is turned on for at least one frame of video image after the Nth frame of video image, and the screen encoding tool is used for the at least Encode one frame of video image;

Counting the number of image blocks in each frame of video image in the at least one frame of video image that adopt the screen encoding mode to obtain a statistical result; and

According to the statistical result, it is determined whether to use the screen encoding tool for the continuous non-key frame video image after the at least one frame of video image before the arrival of the next key frame.
The method according to claim 1, wherein the determining whether to use the continuous non-key frame video image after the at least one frame of video image before the arrival of the next key frame according to the statistical result Screen coding tools include:

In the at least one frame of video image, the number of the image blocks using the screen encoding mode in each frame of the video image is greater than or equal to the first preset value and/or the proportion is greater than or equal to the second preset Value, determine to use the screen coding tool for the continuous non-key frame video image;

Otherwise, it is determined not to use the screen encoding tool for the continuous non-key frame video image.
The method according to claim 1 or 2, wherein the method further comprises:

When it is determined not to use the screen encoding tool for the continuous non-key frame video image, turn off the screen encoding tool that has been turned on, and turn on the screen until the next type of video image frame of the key frame is detected Coding tools.
The method according to claim 1, wherein the at least one frame of video image includes (M+1) frames of continuous video images composed of the Nth frame of video images and subsequent M frames of non-key frame video images , The M is a positive integer.
The method according to claim 4, wherein the counting the number of image blocks in each frame of the video image in the at least one frame of video image that adopts the screen encoding mode, and obtaining the statistical result comprises:

Encoding the Nth frame of video image based on the screen encoding tool to obtain the number of first image blocks that adopt the screen encoding mode in the first image area of the Nth frame of video image;

Based on the screen coding tool, sequentially encode the (i+1)th image area in the (N+i)th frame of video image, and obtain the screen coding in the (i+1)th image area respectively The number of (i+1)th image blocks in the pattern; where i is an integer increasing from 1 to M; and

And sequentially obtain the first proportions of the first image blocks using the screen encoding mode in the first image area until the screen encoding mode is used in the (M+1)th image area. The (M+1)th proportion of the (M+1)th image block;

Wherein, the statistical result includes (M+1) proportions from the first proportion to the (M+1)th proportion.
The method according to claim 5, characterized in that, according to the statistical result, it is determined whether to use the continuous non-key frame video image after the at least one frame of video image before the next key frame. Screen coding tools also include:

If each of the (M+1) proportions from the first proportion to the (M+1)th proportion is greater than or equal to the preset proportion, it is determined that the continuous Using the screen coding tool for non-key frame video images;

Otherwise, it is determined not to use the screen encoding tool for the continuous non-key frame video image.
The method according to claim 1, wherein the screen encoding mode comprises at least one of the following:

Intra-frame block copy mode, hash-based arithmetic search mode, palette coding mode and adaptive color space conversion mode.
An encoding device includes:

The obtaining module is used to obtain the Nth frame of video image in the video; wherein, the N is a positive integer;

The detection module is used to detect the type of the Nth frame of video image; wherein, the type includes key frames and non-key frames;

An operation module, configured to enable a screen encoding tool for at least one frame of video image after the Nth frame of video image when the type of the Nth frame of video image is the key frame, and based on the screen encoding The tool encodes the at least one frame of video image;

A statistics module, configured to count the number of image blocks in each frame of the video image in the at least one frame of video image that adopt the screen encoding mode, and obtain a statistical result; and

The determining module is configured to determine, according to the statistical result, whether to use the screen encoding tool for the continuous non-key frame video image after the at least one frame of video image before the arrival of the next key frame.
A terminal, including:

At least one memory and at least one processor;

The at least one memory is used to store program code, and the at least one processor is used to call the program code stored in the at least one memory to execute the method according to any one of claims 1 to 7.
A storage medium, the storage medium is used to store program code, and the program code is used to execute the method according to any one of claims 1 to 7.