WO2017167194A1 - 一种提升视频分辨率和视频质量的方法、编码器及解码器 - Google Patents

一种提升视频分辨率和视频质量的方法、编码器及解码器 Download PDF

Info

Publication number
WO2017167194A1
WO2017167194A1 PCT/CN2017/078556 CN2017078556W WO2017167194A1 WO 2017167194 A1 WO2017167194 A1 WO 2017167194A1 CN 2017078556 W CN2017078556 W CN 2017078556W WO 2017167194 A1 WO2017167194 A1 WO 2017167194A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
processing algorithm
video processing
information
data
Prior art date
Application number
PCT/CN2017/078556
Other languages
English (en)
French (fr)
Inventor
李应樵
吴景涛
Original Assignee
万维数码有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 万维数码有限公司 filed Critical 万维数码有限公司
Priority to US16/089,062 priority Critical patent/US11051080B2/en
Priority to CN201780019767.0A priority patent/CN109196859A/zh
Publication of WO2017167194A1 publication Critical patent/WO2017167194A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H04N21/6547—Transmission by server directed to the client comprising parameters, e.g. for client setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H04N21/8193—Monomedia components thereof involving executable data, e.g. software dedicated tools, e.g. video decoder software or IPMP tool
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/22—Adaptations for optical transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding

Definitions

  • the invention belongs to the field of image and video processing, and in particular relates to a method for improving video resolution and video quality, a video encoder and a decoder for a display terminal.
  • the method for improving the resolution and quality of the video is that the server transmits the video data to the decoder, and the video data is automatically processed by the decoder, but the method is not targeted when the video algorithm is automatically calculated, and the video is different. The same processing method will reduce the video processing effect and affect the user experience.
  • the invention provides a method, an encoder and a decoder for improving video resolution and quality, which are used for solving the problem that the existing automatic calculation technology cannot perform targeted processing on the video data, so that the processed video cannot reach the expected result. Effects, issues that affect the user experience.
  • the present invention provides a method for improving video resolution and quality, including: calculating and determining video processing algorithm information and parameter information corresponding to video processing algorithm information; encoding video data, the video processing algorithm information, and Parameter information corresponding to the video processing algorithm; transmitting the encoded video data, the video processing algorithm information, and the parameter information corresponding to the video processing algorithm to the decoder of the display terminal.
  • the parameter information corresponding to the video processing algorithm information is video auxiliary data, including a video filter type parameter and/or a filter window size parameter, and/or a depth map video data of an object and/or a scene for dividing a video, Used to process video processes.
  • the present invention provides a method for improving video resolution and quality, comprising: receiving video data, video processing algorithm information, and parameter information corresponding to video processing algorithm information sent by a video encoder; decoding the video data, the video processing algorithm Information and parameter information corresponding to the video processing algorithm information; searching for a corresponding video processing algorithm according to the video processing algorithm information, inputting parameter information corresponding to the video processing algorithm into a corresponding video processing algorithm, and starting the corresponding video processing algorithm to process the video data.
  • the parameter information corresponding to the video processing algorithm information is video auxiliary data, including a video filter type parameter and/or a filter window size parameter, and/or a depth map video data of an object and/or a scene for dividing a video, For processing video processes.
  • the present invention further provides a video encoder, including: a processing information determining unit, configured to calculate video processing algorithm information and parameter information corresponding to video processing algorithm information; and a coding unit, configured to encode video data, the video processing algorithm information, and Parameter information corresponding to the video processing algorithm; a sending unit, configured to send the encoded
  • the video data, the video processing algorithm information, and the parameter information corresponding to the video processing algorithm are sent to the decoder of the display terminal.
  • the parameter information corresponding to the video processing algorithm information is video auxiliary data, including a video filter type parameter and/or a filter window size parameter, and/or a depth map video data of an object and/or a scene for dividing a video, For processing video processes.
  • the present invention also provides a decoder for a display terminal, comprising: a receiving unit, configured to receive video data, video processing algorithm information, and parameter information corresponding to video processing algorithm information sent by a video encoder; and a decoding unit, configured to decode the The video data, the video processing algorithm information, and the parameter information corresponding to the video processing algorithm information; the processing unit is configured to search for a corresponding video processing algorithm according to the video processing algorithm information, and input the parameter information corresponding to the video processing algorithm into the corresponding video. Processing the algorithm, initiating the corresponding video processing algorithm to process the video data.
  • the parameter information corresponding to the video processing algorithm information is video auxiliary data, including a video filter type parameter and/or a filter window size parameter, and/or a depth map video data of an object and/or a scene for dividing a video, For processing video processes.
  • the method for improving video quality determines and encodes video processing algorithm information and parameter information corresponding to the video processing algorithm by the video encoder, and the decoder of the display terminal calls the corresponding video processing algorithm to process the video data according to the video processing algorithm information.
  • Ability to do targeted processing of video data By analyzing the characteristics of the video data and determining the parameter information corresponding to the video processing algorithm, the video processing can be more targeted, so that the processed video quality is better and the user experience is improved.
  • FIG. 1 is a flowchart of a method for improving video quality of a display terminal according to an embodiment of the present invention:
  • FIG. 2 is a flowchart of a method for improving video quality of a display terminal according to another embodiment of the present invention:
  • FIG. 3 is a flowchart of a method for improving video quality of a display terminal according to another embodiment of the present invention:
  • FIG. 4 is a flowchart of a method for improving video quality of a display terminal according to still another embodiment of the present invention:
  • FIG. 5 is a schematic structural diagram of a video encoder according to an embodiment of the present invention:
  • FIG. 6 is a schematic structural diagram of a decoder of a display terminal according to an embodiment of the present invention:
  • FIG. 7 is a flowchart of a method for improving video quality of a display terminal according to an embodiment of the present invention:
  • FIG. 8 is a flowchart of a method for improving video quality of a display terminal including object segmentation and depth map transmission according to an embodiment of the present invention.
  • Figure 9 is an illustration of an embodiment of the present invention for segmenting video data using a depth map.
  • Figure 10 schematically shows a block diagram of a server for performing the method according to the invention
  • Fig. 11 schematically shows a storage unit for holding or carrying program code implementing the method according to the invention.
  • the video encoder of the present invention is a video encoder with a video distribution right, a video encoder of a video website, and the display terminal is a terminal device with a display such as a mobile phone, a computer, a notebook, a platform computer, etc., each terminal device has a built-in
  • a variety of video processing algorithms, different video processing algorithms for video processing methods and interpretation are different.
  • FIG. 1 is a flowchart of a method for improving video quality of a display terminal according to an embodiment of the present invention.
  • the method includes the following steps: Step 101: Calculate and determine video processing algorithm information, where the video processing algorithm information may be a video processing algorithm.
  • the numbering or video processing algorithm uniquely represents information of the video processing algorithm, such as a storage address in the display terminal.
  • the video processing algorithm may be determined by an artificial judgment manner.
  • Step 102 Encoding the video data and the video processing algorithm information: the encoding may be performed by using an existing method, and the present invention does not limit the specific encoding method.
  • FIG. 2 is a flowchart of a method for improving video quality of a display terminal according to another embodiment of the present invention.
  • the method for improving video quality is further, in step 201, calculating and determining video processing algorithm information and a video processing algorithm.
  • Parameter information wherein the parameter information includes, but is not limited to, a noise reduction parameter, a contrast enhancement parameter, and a color enhancement parameter.
  • the video processing algorithm information and the parameter information corresponding to the video processing algorithm may be manually determined and modified.
  • the parameter information corresponding to the video processing algorithm is determined according to the characteristics of the video data. For example, according to the scenario information of the video data, different scenarios correspond to different parameter information. For example, landscape video requires high color and brightness, and parameter information should include color enhancement and contrast enhancement parameter information.
  • Step 202 Encode video data, video processing algorithm information, and parameter information corresponding to the video processing algorithm.
  • Step 203 Send the encoded video data, the video processing algorithm information, and the parameter information corresponding to the video processing algorithm to the decoder of the display terminal.
  • the parameter information corresponding to the video processing algorithm is encapsulated into a video data packet
  • the video processing algorithm information is encapsulated into a video processing algorithm information packet
  • the video data packet and the video processing algorithm information packet are encapsulated.
  • the video stream is transmitted to the display terminal.
  • the video processing algorithm stored by the display terminal comprises a 2K video to 4K video algorithm for implementing 2K video to 4K video.
  • the method for improving video quality sends video data and video processing algorithm information to a decoder of a display terminal, and a decoder of the display terminal calls a corresponding video processing algorithm to process video data according to video processing algorithm information, and can perform video data. Do targeted processing. By analyzing the characteristics of the video data and determining the parameter information corresponding to the video processing algorithm, the video processing can be more targeted, so that the processed video quality is better and the user experience is improved.
  • FIG. 3 is a flowchart of a method for improving video quality of a display terminal according to still another embodiment of the present invention.
  • the display terminal has a plurality of video processing algorithms built in.
  • the method includes: Step 301: Receive video data and video processing algorithm information sent by the video encoder: in detail, the video data and video processing can also be obtained from the memory of the video encoder. Algorithm information.
  • Step 302 Decode the video data and video processing algorithm information.
  • Step 303 Search for a corresponding video processing algorithm according to the decoded video processing algorithm information, and process the decoded video data by a corresponding video processing algorithm.
  • the video processing algorithm information is information that uniquely represents a video processing algorithm, such as a storage address of a video processing algorithm in a display terminal or a number of a video processing algorithm.
  • step 303 is further configured to: locate a video processing algorithm of the storage address, and process the video data by the located video processing algorithm: when the video processing algorithm information is numbered, the step 303 further: matching the video processing algorithm corresponding to the video processing algorithm number, and processing the video data by the matched video processing algorithm.
  • FIG. 4 is a flowchart of a method for improving video quality by a display terminal according to still another embodiment of the present invention.
  • the method includes the following steps: Step 401: Receive video data, video processing algorithm information, and video processing algorithms corresponding to a video encoder. Parameter information: Step 402: Decoding the video data, the video processing algorithm information, and the parameter information corresponding to the video processing algorithm; Step 403: Find a corresponding video processing algorithm according to the video processing algorithm information, and input the parameter information corresponding to the video processing algorithm.
  • the video processing algorithm starts the corresponding video processing algorithm to process the video data.
  • the video processing algorithm stored by the display terminal comprises a 2K video to 4K video algorithm for implementing 2K video to 4K video.
  • the method for improving video quality provides that the terminal receives the video data and the video processing algorithm information, and calls the corresponding video processing algorithm to process the video data according to the video processing algorithm information, and can perform targeted processing on the video data.
  • the display terminal receives the video data, the video processing algorithm information, and the parameter information corresponding to the video processing algorithm, and invokes a corresponding video processing algorithm according to the video processing algorithm information, and inputs the parameter information corresponding to the video processing algorithm into the corresponding video processing algorithm to start processing the video.
  • the data makes the video processing more targeted, so that the processed video quality is better and the user experience is improved.
  • the video encoder includes a processing information determining unit 501, configured to calculate and determine video processing algorithm information, where the video processing algorithm information may be The number of the storage address or the video processing algorithm in the display terminal of the video processing algorithm; the encoding unit 502 is configured to encode the video data and the video processing algorithm information; and the sending unit 503 is configured to send the number of the encoded video According to the video processing algorithm information to the decoder of the display terminal.
  • a processing information determining unit 501 configured to calculate and determine video processing algorithm information, where the video processing algorithm information may be The number of the storage address or the video processing algorithm in the display terminal of the video processing algorithm
  • the encoding unit 502 is configured to encode the video data and the video processing algorithm information
  • the sending unit 503 is configured to send the number of the encoded video According to the video processing algorithm information to the decoder of the display terminal.
  • the processing information determining unit 501 is further configured to calculate and determine parameter information corresponding to the video processing algorithm; the encoding unit 502 is further configured to encode parameter information corresponding to the video processing algorithm; and the sending unit 503 is further configured to send the video processing algorithm corresponding to The parameter information is to the decoder of the display terminal.
  • the above parameter information can be artificially set.
  • the video processing parameter information is determined according to the characteristics of the video data. For example, according to the scene information of the video data, different scenes correspond to different video processing parameter information. For example, landscape video requires high color and brightness, and video processing parameter information should include color enhancement and contrast enhancement parameter information.
  • FIG. 6 is a schematic diagram of an encoder of a display terminal according to an embodiment of the present invention.
  • the encoder of the display terminal includes a receiving unit 601, configured to receive video data and video processing algorithm information sent by a video encoder.
  • a decoding unit 602 configured to decode the video data and video processing algorithm information
  • a processing unit 603, configured to search, according to the video processing algorithm information, a corresponding video processing algorithm, where the video is processed by the corresponding video processing algorithm data.
  • the video processing algorithm information is a storage address of the video processing algorithm in the display terminal or a number of the video processing algorithm.
  • the processing unit is configured to locate the storage address.
  • a video processing algorithm wherein the video processing algorithm processes the video data; when the video processing algorithm information is numbered, the processing unit is configured to match the video processing algorithm corresponding to the video processing algorithm number, and the matched video The processing algorithm processes the video data.
  • the receiving unit 601 is further configured to receive parameter information corresponding to the video processing algorithm, the video data, and video processing algorithm information; and the encoding unit 602 is further configured to decode the video data and the video processing algorithm information.
  • the parameter information corresponding to the video processing algorithm; the processing unit 603 is further configured to: search for a corresponding video processing algorithm according to the video processing algorithm information, and input parameter information corresponding to the video processing algorithm into the corresponding video processing algorithm, The corresponding video processing algorithm is initiated to process the video data.
  • the video server and the display terminal for improving video quality provided by the present invention are used together, and the video data and the video processing algorithm information are sent by the video server to the display terminal, and the display terminal calls the corresponding video processing algorithm to process the video data according to the video processing algorithm information.
  • Ability to do targeted processing of video data By analyzing the characteristics of the video data and determining the video processing parameter information, the video processing can be made more targeted, so that the processed video quality is better and the user experience is improved.
  • the video server transmits the landscape video to the user display terminal (the decoder of the display terminal), and the landscape video is 2K video data, and the landscape video has requirements for noise reduction, contrast enhancement, and color enhancement.
  • the video processing parameter information is parameter information of noise reduction, contrast enhancement and color enhancement algorithm
  • the video processing algorithm information packet includes a noise reduction algorithm, a contrast enhancement algorithm and a color enhancement algorithm to store address information in the display terminal.
  • FIG. 7 is a flowchart of a method for improving video quality of a display terminal according to the embodiment, including: Step 701: The video server side includes a video data packet (including 2K video data + noise reduction, contrast enhancement, and color enhancement). The parameter information of the algorithm and the processing algorithm address information packet (including the noise reduction, contrast enhancement, and the storage address of the color enhancement algorithm in the display terminal) are sent to the display terminal. Step 702: The display terminal receives and decodes the landscape video data packet and the processing algorithm address information packet sent by the video server.
  • Step 703 The display terminal retrieves a corresponding algorithm according to the noise reduction algorithm, the contrast enhancement algorithm, and the color enhancement algorithm in the storage address in the display terminal, and inputs the parameter information of the noise reduction algorithm.
  • the noise reduction algorithm the parameter information of the contrast enhancement algorithm is input into the contrast enhancement algorithm
  • the color enhancement algorithm parameters are input into the color enhancement algorithm
  • the above video processing algorithms noise reduction algorithm, contrast enhancement algorithm and color enhancement algorithm
  • the method for improving video quality sends video data and video processing algorithm information to a decoder of a display terminal, and a decoder of the display terminal calls a corresponding video processing algorithm to process video data according to video processing algorithm information, and can perform video data.
  • Do targeted processing For depth image video data for object segmentation of video, it is more accurate to determine object segmentation through later modification. Each segment will use different video processing algorithms and/or process video data, so that the processed video quality is better. Better, improve the user experience.
  • FIG. 8 is a flowchart of a method for improving video quality of a display terminal according to still another embodiment of the present invention.
  • the video processing algorithm built into the terminal is used to segment the video objects and scenes with depth map video data, and different video processing algorithms and parameters, including filter type, window size, and other parameters, are used in different divided objects such as foreground and background.
  • the method includes, in step 801, receiving video data sent by a video encoder, video processing algorithm information, and parameter information corresponding to video processing algorithm information, including depth map video data; the video data, video processing algorithm information, and video processing
  • the parameter information corresponding to the algorithm information is in the memory of the video encoder.
  • Step 802 Decode the video data and video processing algorithm information, and have different video processing algorithms and parameters in different divided objects such as foreground and background; step 803: compress the depth map video data, and decode the depth map video data in step 804. .
  • Step 805 Segment the object and the scene of the video according to the decoded depth map video data.
  • the video data and depth map video data are acquired in a memory of the video decoder.
  • Step 806 Raise the video resolution and quality to the desired output q(u,v), using different video processing algorithms F 1 (), F 2 (), F 3 () in different partitioned objects such as foreground and background.
  • the parameters ⁇ n , ⁇ n , ⁇ n , ... ⁇ (n 1, 2, 3), including filter type, window size, and other parameters.
  • Step 807 Completing the correction of each divided part of the 2K video data, adding together to obtain the enhanced video resolution to 4K and the video quality, and outputting the video.
  • FIG. 9 is a flow chart showing an image of the example of FIG.
  • Step 901 Decode video data and compress depth map video data, and obtain a video image and a depth map.
  • Step 902 Segment the object and/or the scene of the video according to the decoded depth map video data. As shown in the figure, in this embodiment, the video is segmented into three parts: the front, the back, and the object.
  • Step 903 Raise the video resolution and quality to the desired output, using different video processing algorithms and parameters in different partitioned objects such as foreground and background, including filter type, window size, and other parameters. The video processing algorithm corresponding to the video processing algorithm number is matched, and the video data is processed by the matched video processing algorithm.
  • Step 904 Complete the correction of each divided part of the 2K video data, add together to obtain the enhanced video resolution to 4K and the video quality, and output the video.
  • Various component embodiments of the present invention may be implemented in hardware or on one or more processors Software modules are implemented or implemented in a combination of these.
  • DSP digital signal processor
  • a microprocessor or digital signal processor (DSP) can be used in practice to implement methods for improving video resolution and quality and decoders for video encoders and display terminals in accordance with embodiments of the present invention.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
  • Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.
  • Figure 10 illustrates a server, such as an application server, in accordance with the present invention.
  • the server conventionally includes a processor 1010 and a computer program product or computer readable medium in the form of a memory 1020.
  • the memory 1020 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM.
  • the memory 1020 has a memory space 1030 for executing program code 1031 of any of the above method steps.
  • storage space 1030 for program code may include various program code 1031 for implementing various steps in the above methods, respectively.
  • the program code can be read from or written to one or more computer program products.
  • Such computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks.
  • Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG.
  • the storage unit may have a storage section, a storage space, and the like arranged similarly to the storage 1020 in the server of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit includes computer readable code 1031', i.e., code that can be read by, for example, a processor such as 1010, which when executed by the server causes the server to perform various steps in the methods described above.
  • the method for improving video quality, the video encoder and the decoder of the display terminal provided by the invention can perform targeted processing on the video data, thereby improving the quality of the processed video and improving the user experience.
  • the flowcharts, logic modules, and other symbolic operations described above are presented in the form of representations that can be executed on a computer system.
  • a program, computer executed step, logic block, process, etc. is contemplated herein as a self-consistent sequence of one or more steps or instructions for obtaining a desired result.
  • These steps are physical operations on physical quantities. These physical quantities include electrical, magnetic or radio signals that are stored, transferred, combined, compared, and otherwise manipulated in a computer system. These signals can be bits, values, elements, symbols, characters, conditions, numbers, and the like.
  • Each step can be performed by hardware, software, firmware, or a combination thereof.

Abstract

本发明特别涉及一种提升视频分辨率和视频质量的方法、视频编码器及显示终端的解码器。为了解决现有自动计算技术中不能对视频数据做有针对性的处理，从而导致处理后的视频不能达到预期的效果，影响用户体验的问题。本发明提供一种提升视频分辨率和质量的方法，包括：计算并确定视频处理算法信息及视频处理算法信息对应的参数信息；编码视频数据、所述视频处理算法信息及视频处理算法对应的参数信息；发送编码后的视频数据、视频处理算法信息、及视频处理算法对应的参数信息至显示终端的解码器。所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数,,和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。本发明提供的提升视频质量的方法由视频编码器确定和编码视频处理算法信息及视频处理算法对应的参数信息,由显示终端的解码器根据视频处理算法信息调用相应的视频处理算法处理视频数据，能够对视频数据做有针对性的处理。通过对视频数据特性的分析，确定视频处理算法对应的参数信息，能使视频处理更具有针对性，从而使处理后的视频质量更佳，提升了用户的体验效果。

Description

一种提升视频分辨率和视频质量的方法、编码器及解码器 技术领域
本发明属于图像和视频处理领域，特别涉及一种提升视频分辨率和视频质量的方法、视频编码器及显示终端的解码器。
背景技术
随着科技的发展，人们对视频显示质量要求越来越高，如何快速的从现有的视频来源(如光盘、蓝光和广播)获得高质量的视频数据已被广泛研究。然而，现有技术中的一些转换技术，由于其计算复杂、计算质量不理想或不适用于有限宽带传输通道而不能被广泛应用。现有技术中，提升视频分辨率和质量的方法为服务器将视频数据传输给解码器，由解码器自动处理视频数据后显示，但是这种方法自动计算视频算法时不具有针对性，对不同视频处理方法相同，将降低视频处理效果，影响用户体验。
发明内容
本发明提供一种提升视频分辨率和质量的方法、编码器及解码器，用于解决现有自动计算技术中不能对视频数据做有针对性的处理，从而导致处理后的视频不能达到预期的效果，影响用户体验的问题。
为了解决上述技术问题，本发明提供一种提升视频分辨率和质量的方法，包括：计算并确定视频处理算法信息及视频处理算法信息对应的参数信息；编码视频数据、所述视频处理算法信息及视频处理算法对应的参数信息；发送编码后的视频数据、视频处理算法信息、及视频处理算法对应的参数信息至显示终端的解码器。所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数,,和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
本发明提供一种提升视频分辨率和质量的方法，包括，接收视频编码器发送的视频数据、视频处理算法信息和视频处理算法信息对应的参数信息；解码所述视频数据、所述视频处理算法信息和所述视频处理算法信息对应的参数信息；根据视频处理算法信息查找相应的视频处理算法，将视频处理算法对应的参数信息输入相应的视频处理算法，启动所述相应的视频处理算法处理视频数据。所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数，和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
本发明进一步提供一种视频编码器，包括，处理信息确定单元，用于计算视频处理算法信息和视频处理算法信息对应的参数信息；编码单元，用于编码视频数据、所述视频处理算法信息及所述视频处理算法对应的参数信息；发送单元，用于发送编码后的 视频数据、视频处理算法信息及视频处理算法对应的参数信息至显示终端的解码器。所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数，和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
本发明还提供一种显示终端的解码器，包括，接收单元，用于接收视频编码器发送的视频数据、视频处理算法信息和视频处理算法信息对应的参数信息；解码单元，用于解码所述视频数据、所述视频处理算法信息和所述视频处理算法信息对应的参数信息；处理单元，用于根据视频处理算法信息查找相应的视频处理算法，将视频处理算法对应的参数信息输入相应的视频处理算法，启动所述相应的视频处理算法处理视频数据。所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数,和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
本发明提供的提升视频质量的方法由视频编码器确定和编码视频处理算法信息及视频处理算法对应的参数信息,由显示终端的解码器根据视频处理算法信息调用相应的视频处理算法处理视频数据，能够对视频数据做有针对性的处理。通过对视频数据特性的分析，确定视频处理算法对应的参数信息，能使视频处理更具有针对性，从而使处理后的视频质量更佳，提升了用户的体验效果。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明一实施例的提升显示终端视频质量方法的流程图:
图2为本发明另一实施例的提升显示终端视频质量方法的流程图:
图3为本发明又一实施例的提升显示终端视频质量方法的流程图:
图4为本发明再一实施例的提升显示终端视频质量方法的流程图:
图5为本发明一实施例的视频编码器的结构示意图:
图6为本发明一实施例的显示终端的解码器的结构示意图:
图7为本发明一实施例的提升显示终端视频质量方法的流程图:
图8为本发明一实施例包括对象分割和深度图传输的提升显示终端视频质量方法的流程图。
图9为本发明利用深度图分割视频数据的示例。
图10示意性地示出了用于执行根据本发明的方法的服务器的框图；以及
图11示意性地示出了用于保持或者携带实现根据本发明的方法的程序代码的存储单元。
具体实施方式
为了使本发明的技术特点及效果更加明显，下面结合附图对本发明的技术方案做进一步说明，本发明也可有其他不同的具体实例来加以说明或实施，任何本领域技术人员在权利要求范围内做的等同变换均属于本发明的保护范畴。
本发明所述的视频编码器为具有视频发行权的电视台、视频网站的视频编码器，显示终端为手机、电脑、笔记本、平台电脑等带有显示器的终端设备，每台终端设备内都内置有多种视频处理算法，不同视频处理算法对视频处理实行方法及解读都不相同。
如图1所示，图1为本发明一实施例的提升显示终端视频质量方法的流程图，该方法包括□步骤101，计算并确定视频处理算法信息,该视频处理算法信息可以为视频处理算法编号或视频处理算法在显示终端内的存储地址等唯一表示视频处理算法的信息。具体实施时，视频处理算法可由人工的判断方式确定。步骤102，编码视频数据及视频处理算法信息:编码时可采用现有的方法进行编码，本发明对具体的编码方法不做限制。步骤103，发送编码后的视频数据及视频处理算法信息至显示终端的解码器。
本发明一实施例中，将视频数据及视频处理算法信息存储于一存储器中。如图2所示，图2为本发明另一实施例的提升显示终端视频质量方法的流程图，提升视频质量的方法进一步为，步骤201，计算并确定视频处理算法信息及视频处理算法对应的参数信息，其中，该参数信息包括但不限于降噪参数、反差增强参数及颜色增强参数。
本发明一实施例中，视频处理算法信息及视频处理算法对应的参数信息可人工的为其判断和修改。本发明另一实施例中，视频处理算法对应的参数信息是根据视频数据的特征确定的，如根据视频数据的场景信息确定，不同场景对应不同的参数信息。例如山水视频对色彩及亮度要求较高，参数信息应包含色彩增强及反差增强参数信息。步骤202，编码视频数据、视频处理算法信息及视频处理算法对应的参数信息；步骤203，将编码后的视频数据、视频处理算法信息及视频处理算法对应的参数信息发送至显示终端的解码器。具体实施时，所述视频处理算法对应的参数信息与所述视频数据融合封装成视频数据包，所述视频处理算法信息封装为视频处理算法信息包，将视频数据包及视频处理算法信息包以视频流的方式传输至显示终端。
本发明一实施例中，显示终端存储的视频处理算法包括2K视频转4K视频算法，用于实现2K视频转4K视频。
本发明提供的提升视频质量的方法将视频数据及视频处理算法信息发送给显示终端的解码器，由显示终端的解码器根据视频处理算法信息调用相应的视频处理算法处理视频数据，能够对视频数据做有针对性的处理。通过对视频数据特性的分析，确定视频处理算法对应的参数信息，能使视频处理更具有针对性，从而使处理后的视频质量更佳，提升了用户的体验效果。
如图3所示，图3为本发明又一实施例的提升显示终端视频质量的方法的流程图。显示终端内置有多种视频处理算法，该方法包括，步骤301:接收视频编码器发送的视频数据和视频处理算法信息:详细地说，还可从视频编码器的存储器中获取视频数据和视频处理算法信息。步骤302:解码所述视频数据和视频处理算法信息；步骤303:根据解码后的视频处理算法信息查找相应的视频处理算法，由相应的视频处理算法处理解码后的视频数据。
详细地说，所述视频处理算法信息为视频处理算法在显示终端内的存储地址或视频处理算法的编号等唯一表示视频处理算法的信息。
当所述视频处理算法信息为存储地址时，步骤303进一步为:定位所述存储地址的视频处理算法，由定位到的视频处理算法处理视频数据:当所述视频处理算法信息为编号时，步骤303进一步为:匹配与视频处理算法编号相对应的视频处理算法，由匹配出的视频处理算法处理视频数据。
如图4所示，图4为本发明再一实施例的显示终端提升视频质量方法的流程图，包括，步骤401:接收视频编码器发送的视频数据、视频处理算法信息及视频处理算法对应的参数信息；步骤402:解码所述视频数据、视频处理算法信息及视频处理算法对应的参数信息；步骤403:根据视频处理算法信息查找相应的视频处理算法，将视频处理算法对应的参数信息输入相应的视频处理算法，启动相应的视频处理算法处理视频数据。本发明一实施例中，显示终端存储的视频处理算法包括2K视频转4K视频算法，用于实现2K视频转4K视频。
本发明提供的提升视频质量的方法，显示终端接收视频数据及视频处理算法信息，根据视频处理算法信息调用相应的视频处理算法处理视频数据，能够对视频数据做有针对性的处理。显示终端接收视频数据、视频处理算法信息及视频处理算法对应的参数信息，根据视频处理算法信息调用相应的视频处理算法，将视频处理算法对应的参数信息输入相应的视频处理算法中，启动处理视频数据，使得视频处理更具有针对性，从而使处理后的视频质量更佳，提升用户的体验效果。
本发明一实施例中提供一种视频编码器，如图5所示，该视频编码器包括，处理信息确定单元501，用于计算并确定视频处理算法信息，其中，所述视频处理算法信息可以为视频处理算法在显示终端内的存储地址或视频处理算法的编号；编码单元502，用于编码视频数据及所述视频处理算法信息；发送单元503,用于发送编码后的视频数 据及视频处理算法信息至显示终端的解码器。
进一步的，处理信息确定单元501还用于计算并确定视频处理算法对应的参数信息；编码单元502还用于编码视频处理算法对应的参数信息；发送单元503还用于发送所述视频处理算法对应的参数信息至显示终端的解码器。上述参数信息可人为设定。本发明另一实施例中，视频处理参数信息是根据视频数据的特征确定的，如根据视频数据的场景信息确定，不同场景对应不同的视频处理参数信息。例如山水视频对色彩及亮度要求较高，视频处理参数信息应包含色彩增强及反差增强参数信息。
如图6所示，图6为本发明一实施例的显示终端的编码器的示意图，该显示终端的编码器包括，接收单元601，用于接收视频编码器发送的视频数据及视频处理算法信息；解码单元602，用于解码所述视频数据及视频处理算法信息；处理单元603,用于根据所述视频处理算法信息查找相应的视频处理算法，由所述相应的视频处理算法处理所述视频数据。详细地说，视频处理算法信息为视频处理算法在显示终端内的存储地址或视频处理算法的编号，当所述视频处理算法信息为存储地址时，所述处理单元用于定位所述存储地址的视频处理算法，由定位到的视频处理算法处理视频数据；当所述视频处理算法信息为编号时，所述处理单元用于匹配与视频处理算法编号相对应的视频处理算法，由匹配出的视频处理算法处理视频数据。
本发明另一实施例中，接收单元601进一步用于接收视频处理算法对应的参数信息、所述视频数据和视频处理算法信息；；编码单元602进一步用于解码所述视频数据、视频处理算法信息及所述视频处理算法对应的参数信息；处理单元603进一步用于根据所述视频处理算法信息查找相应的视频处理算法，将所述视频处理算法对应的参数信息输入所述相应的视频处理算法，启动所述相应的视频处理算法处理所述视频数据。
本发明提供的提升视频质量的视频服务器及显示终端配合使用，由视频服务器将视频数据及视频处理算法信息发送给显示终端，由显示终端根据视频处理算法信息调用相应的视频处理算法处理视频数据，能够对视频数据做有针对性的处理。通过对视频数据特性的分析，确定视频处理参数信息，能够使视频处理更具有针对性，从而使处理后的视频质量更佳，提升了用户的体验效果。
下面以一具体实施例来说明本发明技术方案。本实施例中，视频服务器(视频编码器)向用户显示终端(显示终端的解码器)传送的是山水视频，该山水视频为2K视频数据，山水视频对降噪、反差增强及颜色增强要求较高，视频处理参数信息为降噪、反差增强及色彩增强算法的参数信息，视频处理算法信息包包括降噪算法、反差增强算法及色彩增强算法在显示终端内存储的地址信息。
如图7所示，图7为本实施例的提升显示终端视频质量的方法流程图，包括:步骤701:视频服务器端将山水视频数据包(包含2K视频数据+降噪、反差增强及色彩增强算法的参数信息)及处理算法地址信息包(包括降噪、反差增强及色彩增强算法在显示终端内的存储地址)发送至显示终端。步骤702:显示终端接收并解码视频服务器发送的山水视频数据包及处理算法地址信息包。步骤703:显示终端根据降噪算法、反差增强算法及色彩增强算法在显示终端内的存储地址调取相应的算法，将降噪算法参数信息输入 降噪算法中，将反差增强算法参数信息输入反差增强算法中，将色彩增强算法参数输入色彩增强算法中，分别运行上述视频处理算法(降噪算法、反差增强算法及色彩增强算法)完成2K视频数据修正。
本发明提供的提升视频质量的方法将视频数据及视频处理算法信息发送给显示终端的解码器，由显示终端的解码器根据视频处理算法信息调用相应的视频处理算法处理视频数据，能够对视频数据做有针对性的处理。如用于视频的物体分割的深度图视频数据,通过后期修改，确定物体分割能更准确，每个分割段将使用不同的视频处理算法和/或处理视频数据,从而使处理后的视频质量更佳，提升了用户的体验效果。
如图8所示，图8为本发明又一实施例的提升显示终端视频质量的方法的流程图。显示终端内置的视频处理算法，用深度图视频数据分割视频的物体和场景,在不同的分割物件如前景和背景使用不同的视频处理算法和参数，包括滤波器类型，窗口大小，等参数。该方法包括，步骤801:接收视频编码器发送的视频数据，视频处理算法信息和与视频处理算法信息对应的参数信息，包括深度图视频数据；所述视频数据，视频处理算法信息和与视频处理算法信息对应的参数信息在视频编码器的存储器中。步骤802:解码所述视频数据和视频处理算法信息,在不同的分割物件如前景和背景有不同的视频处理算法和参数；步骤803:压缩深度图视频数据，并在步骤804解码深度图视频数据。步骤805:根据解码后的深度图视频数据,把视频的物体和场景分割。
详细地说，所述视频数据和深度图视频数据在视频解码器的存储器中获取。假设是视频V内所有坐标的像素p(x,y),视频分割得到的前、后景物体3个分割部分S(n＝1,2,3)，即
Figure PCTCN2017078556-appb-000001
V＝S1∪S2∪S3。步骤806:提升视频分辨率和质量到所需的输出q(u,v)，在不同的分割物件如前景和背景使用不同的视频处理算法F1(),F2(),F3()和参数{αn,βn,γn,……}(n＝1,2,3)，包括滤波器类型，窗口大小，等参数。
p1(x,y)∈S1,q(u,v)＝F1(p1(x,y),{α1,β1,γ1,……}),
p2(x,y)∈S2,q(u,v)＝F2(p2(x,y),{α2,β2,γ2,……}),
p3(x,y)∈S3,q(u,v)＝F3(p3(x,y),{α3,β3,γ3,……})。
匹配与视频处理算法编号相对应的视频处理算法，由匹配出的视频处理算法处理视频数据。步骤807:完成2K视频数据每个分割部分的修正,加在一起获得提升视频分辨率到4K和视频质量,并输出视频。
如图9所示，图9为图8示例的图像示意的流程图。步骤901:解码视频数据和压缩深度图视频数据，并获得视频图像和深度图。步骤902:根据解码后的深度图视频数据,把视频的物体和/或场景分割。如图所示，在这施例中视频分割得到的前、后景和物体3个分割部分。步骤903:提升视频分辨率和质量到所需的输出，在不同的分割物件如前景和背景使用不同的视频处理算法和参数，包括滤波器类型，窗口大小，等参数。匹配与视频处理算法编号相对应的视频处理算法，由匹配出的视频处理算法处理视频数据。步骤904:完成2K视频数据每个分割部分的修正,加在一起获得提升视频分辨率到4K和视频质量,并输出视频。
本发明的各个部件实施例可以以硬件实现，或者以在一个或者多个处理器上运行的 软件模块实现，或者以它们的组合实现。本领域的技术人员应当理解，可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本发明实施例的提升视频分辨率和质量的方法以及视频编码器和显示终端的解码器的一些或者全部部件的一些或者全部功能。本发明还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如，计算机程序和计算机程序产品)。这样的实现本发明的程序可以存储在计算机可读介质上，或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到，或者在载体信号上提供，或者以任何其他形式提供。
例如，图10示出了可以实现根据本发明的服务器，例如应用服务器。该服务器传统上包括处理器1010和以存储器1020形式的计算机程序产品或者计算机可读介质。存储器1020可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。存储器1020具有用于执行上述方法中的任何方法步骤的程序代码1031的存储空间1030。例如，用于程序代码的存储空间1030可以包括分别用于实现上面的方法中的各种步骤的各个程序代码1031。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。这些计算机程序产品包括诸如硬盘，紧致盘(CD)、存储卡或者软盘之类的程序代码载体。这样的计算机程序产品通常为如参考图11所述的便携式或者固定存储单元。该存储单元可以具有与图10的服务器中的存储器1020类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常，存储单元包括计算机可读代码1031’，即可以由例如诸如1010之类的处理器读取的代码，这些代码当由服务器运行时，导致该服务器执行上面所描述的方法中的各个步骤。
本文中所称的“一个实施例”、“实施例”或者“一个或者多个实施例”意味着，结合实施例描述的特定特征、结构或者特性包括在本发明的至少一个实施例中。此外，请注意，这里“在一个实施例中”的词语例子不一定全指同一个实施例。
本发明提供的提升视频质量的方法、视频编码器及显示终端的解码器，能够对视频数据做有针对性的处理，从而使处理后的视频质量更佳，提升了用户的体验效果。以上所述的流程图、逻辑模块和其他的符号操作表达的形式给出，可以在计算机系统上执行。一个程序、计算机执行步、逻辑块，过程等，在这里被设想为得到所希望的结果的一个或多个步骤或指令的自洽序列。这些步骤是对物理量的物理操作。这些物理量包括电、磁或者无线电信号，它们在计算机系统中被存储、传输、组合、比较以及其他操作。这些信号可是比特、数值、元素、符号、字符、条件、数字等。每个步骤都可以通过硬件、软件、固件或它们的组合执行。
以上所述仅用于说明本发明的技术方案，任何本领域普通技术人员均可在不违背本发明的精神及范畴下，对上述实施例进行修饰与改变。因此，本发明的权利保护范围应视权利要求范围为准。

Claims (38)

  1. 一种提升视频分辨率和质量的方法，其特征在于，包括，
    计算并确定视频处理算法信息及视频处理算法信息对应的参数信息；
    编码视频数据、所述视频处理算法信息及视频处理算法对应的参数信息；
    发送编码后的视频数据、视频处理算法信息、及视频处理算法对应的参数信息至显示终端的解码器。
  2. 如权利要求1所述的提升视频分辨率和质量的方法，其特征在于，还包括封装所述视频处理算法对应的参数信息与所述视频数据为视频数据包；
    封装所述视频处理算法信息为视频处理算法信息包；
    以视频流的方式将所述视频数据包及所述视频处理算法信息包传输至显示终端。
  3. 如权利要求1所述的提升视频分辨率和质量的方法，其特征在于，所述视频处理算法信息为视频处理算法在显示终端内的存储地址或视频处理算法的编号。
  4. 如权利要求1所述的提升视频分辨率和质量的方法，其特征在于，所述视频处理算法对应的参数信息是根据视频数据的特征确定的。
  5. 如权利要求4所述的提升视频分辨率和质量的方法，其特征在于，所述视频处理算法对应的参数信息是根据视频数据的场景信息确定的。
  6. 如权利要求1－5任意一个所述提升视频分辨率和质量的方法，其特征在于，所述视频处理算法包括2K转4K视频算法。
  7. 如权利要求1－5任意一个所述提升视频分辨率和质量的方法，其特征在于，所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数,和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
  8. 如权利要求7所述提升视频分辨率和质量的方法，其特征在于：所述视频辅助数据所包括的参数取决于应用时的质量和带宽需要。
  9. 一种提升视频分辨率和质量的方法，其特征在于，包括，
    接收视频编码器发送的视频数据、视频处理算法信息和视频处理算法信息对应的参数信息；
    解码所述视频数据、所述视频处理算法信息和所述视频处理算法信息对应的参数信息；
    根据视频处理算法信息查找相应的视频处理算法，将视频处理算法对应的参数信息输入相应的视频处理算法，启动所述相应的视频处理算法处理视频数据。
  10. 如权利要求9所述的提升分辨率和质量的方法，其特征在于，
    所述视频处理算法信息为视频处理算法在显示终端内的存储地址。
  11. 如权利要求10所述的提升分辨率和质量的方法，其特征在于，
    定位所述存储地址的视频处理算法，由定位到的所述视频处理算法处理该视频数据。
  12. 如权利要求9所述的提升分辨率和质量的方法，其特征在于，所述视频处理算法信息为视频处理算法的编号。
  13. 如权利要求12所述的提升分辨率和质量的方法，其特征在于，匹配与所述视频处理算法编号相对应的视频处理算法，用匹配出的视频处理算法处理所述视频数据。
  14. 如权利要求9－13所述的提升分辨率和质量的方法，其特征在于，所述视频处理算法包括2K视频转4K视频算法。
  15. 如权利要求9－13任意一个所述提升视频分辨率和质量的方法，其特征在于，所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数，和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
  16. 如权利要求9－13任意一个所述提升视频分辨率和质量的方法，其特征在于：所述视频辅助数据所包括的参数取决于应用时的质量和带宽需要。
  17. 如权利要求15所述提升视频分辨率和质量的方法，其特征在于，在解码包括所述深度图视频数据在内的所述视频处理算法信息的步骤以后，将所述视频数据的物体和/或场景进行分割，且在分割后不同的物体和/或场景中设定不同的视频处理算法和参数。
  18. 如权利要求9－13任意一个所述提升视频分辨率和质量的方法，其特征在于，所述参数信息可以是全局附加或者本地附加的。
  19. 一种视频编码器，其特征在于，包括，
    处理信息确定单元，用于计算视频处理算法信息和视频处理算法信息对应的参数信息；
    编码单元，用于编码视频数据、所述视频处理算法信息及所述视频处理算法对应的参数信息；
    发送单元，用于发送编码后的视频数据、视频处理算法信息及视频处理算法对应的参数信息至显示终端的解码器。
  20. 如权利要求19所述的视频编码器，其特征在于，还包括
    封装单元，用于封装所述视频处理算法对应的参数信息与所述视频数据为视频数据包；并封装所述视频处理算法信息为视频处理算法信息包；
    传输单元，用于以视频流的方式传输所述视频数据包及所述视频处理算法信息包至显示终端。
  21. 如权利要求19所述的视频编码器，其特征在于，所述视频处理算法信息为
    视频处理算法在显示终端内的存储地址或视频处理算法的编号。
  22. 如权利要求19所述的视频编码器，其特征在于，所述视频处理算法对应的参数信息是根据视频数据的特征确定的。
  23. 如权利要求22所述的视频编码器，其特征在于，所述视频处理算法对应的参数信息是根据视频数据的场景信息确定的。
  24. 如权利要求19－23所述的视频编码器，其特征在于，所述视频处理算法包括2K视频转4K视频算法。
  25. 如权利要求19－23所述的视频编码器，其特征在于，所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数,和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
  26. 如权利要求25所述的视频编码器，其特征在于：所述视频辅助数据所包含的参数取决于应用时的质量和带宽需要。
  27. 一种显示终端的解码器，其特征在于，包括，
    接收单元，用于接收视频编码器发送的视频数据、视频处理算法信息和视频处理算法信息对应的参数信息；
    解码单元，用于解码所述视频数据、所述视频处理算法信息和所述视频处理算法信息对应的参数信息；
    处理单元，用于根据视频处理算法信息查找相应的视频处理算法，将视频处理算法对应的参数信息输入相应的视频处理算法，启动所述相应的视频处理算法处理视频数据。
  28. 如权利要求27所述的显示终端的解码器，其特征在于，所述视频处理算法信息为视频处理算法在显示终端内的存储地址。
  29. 如权利要求28所述的显示终端的解码器，其特征在于，还包括
    定位单元，用于定位所述存储地址的视频处理算法，由定位到所述视频处理算法处理该视频数据。
  30. 如权利要求27所述的显示终端的解码器，其特征在于，所述视频处理算法信息为视频处理算法在显示终端内的存储地址或视频处理算法的编号。
  31. 如权利要求30所述的显示终端的解码器，其特征在于，还包括匹配单元，匹配与所 述视频处理算法编号相对应的视频处理算法，用匹配出的视频处理算法处理所述视频数据。
  32. 如权利要求27－31任意一个所述的显示终端的解码器，其特征在于，所述视频处理算法包括2K视频转4K视频算法。
  33. 如权利要求27－31任意一个所述的显示终端的解码器，其特征在于，所述视频处理算法信息对应的参数信息为视频辅助数据,包括视频滤波器类型参数和/或滤波器窗口大小参数,和/或用于分割视频的物体和/或场景的深度图视频数据，用于处理视频流程。
  34. 如权利要求27－31任意一个所述的显示终端的解码器，其特征在于，所述视频辅助数据所包含的参数取决于应用时的质量和带宽需要。
  35. 如权利要求34所述的显示终端的解码器，其特征在于：还包括分割单元，在解码单元解码包括所述深度图视频数据在内的所述视频处理算法信息以后，将所述视频数据的物体和/或场景进行分割，且在分割后不同的物体和/或场景中设定不同的视频处理算法和参数。
  36. 如权利要求27－31任意一个所述的显示终端的解码器，其特征在于，所述参数信息可以是全局附加或者本地附加的。
  37. 一种计算机程序，包括计算机可读代码，当所述计算机可读代码在服务器上运行时，导致所述服务器执行根据权利要求1－18中的任一个所述的提升视频分辨率和质量的方法。
  38. 一种计算机可读介质，其中存储了如权利要求37所述的计算机程序。
PCT/CN2017/078556 2016-03-29 2017-03-29 一种提升视频分辨率和视频质量的方法、编码器及解码器 WO2017167194A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US16/089,062 US11051080B2 (en) 2016-03-29 2017-03-29 Method for improving video resolution and video quality, encoder, and decoder
CN201780019767.0A CN109196859A (zh) 2016-03-29 2017-03-29 一种提升视频分辨率和视频质量的方法、编码器及解码器

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
HK16103565.1A HK1221373A2 (zh) 2016-03-29 2016-03-29 種提升視頻分辨率和視頻質量的方法、編碼器及解碼器
HK16103565.1 2016-03-29

Publications (1)

Publication Number Publication Date
WO2017167194A1 true WO2017167194A1 (zh) 2017-10-05

Family

ID=58716723

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/078556 WO2017167194A1 (zh) 2016-03-29 2017-03-29 一种提升视频分辨率和视频质量的方法、编码器及解码器

Country Status (4)

Country Link
US (1) US11051080B2 (zh)
CN (1) CN109196859A (zh)
HK (1) HK1221373A2 (zh)
WO (1) WO2017167194A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110430398B (zh) * 2019-08-06 2021-01-19 杭州微帧信息科技有限公司 一种基于强化学习的视频编码分布式方法
CN111369475B (zh) * 2020-03-26 2023-06-23 北京百度网讯科技有限公司 用于处理视频的方法和装置
CN112702511B (zh) * 2020-12-17 2023-04-07 北京达佳互联信息技术有限公司 用于输出视频的方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070274385A1 (en) * 2006-05-26 2007-11-29 Zhongli He Method of increasing coding efficiency and reducing power consumption by on-line scene change detection while encoding inter-frame
CN102404560A (zh) * 2010-09-17 2012-04-04 中兴通讯股份有限公司 实现可伸缩视频编码业务协同传输的方法及系统
CN102611690A (zh) * 2011-12-22 2012-07-25 南京邮电大学 一种基于超文本传输协议流化的容器格式转化方法
CN104581199A (zh) * 2014-12-12 2015-04-29 百视通网络电视技术发展有限责任公司 视频处理系统及其处理方法
CN105409222A (zh) * 2013-07-17 2016-03-16 索尼公司 图像处理装置及方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5987181A (en) * 1995-10-12 1999-11-16 Sharp Kabushiki Kaisha Coding and decoding apparatus which transmits and receives tool information for constructing decoding scheme
JP4596212B2 (ja) * 2001-06-15 2010-12-08 ソニー株式会社 画像処理装置および方法、記録媒体、並びにプログラム
US20090316793A1 (en) * 2008-06-20 2009-12-24 Yang Zhijie Michael Method and system for adaptive deblocking for avs1-p2
CN102450010A (zh) * 2009-04-20 2012-05-09 杜比实验室特许公司 定向内插和数据后处理
US20140092953A1 (en) * 2012-10-02 2014-04-03 Sharp Laboratories Of America, Inc. Method for signaling a step-wise temporal sub-layer access sample
US20160156915A1 (en) * 2013-07-18 2016-06-02 Samsung Electronics Co., Ltd. Video encoding method and apparatus and video decoding method and apparatus using video format parameter delivery
CN103996168B (zh) * 2014-01-21 2017-02-01 公安部第一研究所 一种基于区域自适应处理的x射线安全检查图像增强方法
CN104915929A (zh) * 2014-03-14 2015-09-16 电子科技大学 一种图像滤波处理方法
CN106034241B (zh) * 2015-03-19 2019-04-26 华为技术有限公司 一种多媒体重定向的方法、客户端、服务器和系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070274385A1 (en) * 2006-05-26 2007-11-29 Zhongli He Method of increasing coding efficiency and reducing power consumption by on-line scene change detection while encoding inter-frame
CN102404560A (zh) * 2010-09-17 2012-04-04 中兴通讯股份有限公司 实现可伸缩视频编码业务协同传输的方法及系统
CN102611690A (zh) * 2011-12-22 2012-07-25 南京邮电大学 一种基于超文本传输协议流化的容器格式转化方法
CN105409222A (zh) * 2013-07-17 2016-03-16 索尼公司 图像处理装置及方法
CN104581199A (zh) * 2014-12-12 2015-04-29 百视通网络电视技术发展有限责任公司 视频处理系统及其处理方法

Also Published As

Publication number Publication date
US11051080B2 (en) 2021-06-29
US20190132649A1 (en) 2019-05-02
CN109196859A (zh) 2019-01-11
HK1221373A2 (zh) 2017-05-26

Similar Documents

Publication Publication Date Title
US10110936B2 (en) Web-based live broadcast
JP5996013B2 (ja) 立体画像の視差マップ推定のための方法，装置及びコンピュータプログラム製品
US11330197B2 (en) Method for processing image data by using information generated from external electronic device, and electronic device
WO2017167194A1 (zh) 一种提升视频分辨率和视频质量的方法、编码器及解码器
WO2023159746A1 (zh) 基于图像分割的图像抠图方法、装置、计算机设备及介质
US10839489B2 (en) Techniques for synthesizing film grain
CN110463206A (zh) 图像滤波方法及装置
WO2021057684A1 (zh) 视频解码方法和装置、视频编码方法和装置、存储介质及电子装置
WO2021057477A1 (zh) 视频编解码方法和相关装置
US11854164B2 (en) Method for denoising omnidirectional videos and rectified videos
WO2019037471A1 (zh) 视频处理方法、视频处理装置以及终端
JP2023533680A (ja) Ｖ３ｃ／ｖ－ｐｃｃのための復号タイルハッシュｓｅｉメッセージ
CN110769241B (zh) 视频帧处理方法、装置、用户端及存储介质
WO2023142715A1 (zh) 视频编码方法、实时通信方法、装置、设备及存储介质
WO2021057464A1 (zh) 视频处理方法和装置、存储介质和电子装置
WO2018120230A1 (zh) 图像滤波方法、装置以及设备
WO2018133472A1 (zh) 一种数据信息处理方法及装置
CN114390307A (zh) 图像画质增强方法、装置、终端及可读存储介质
CN110706169A (zh) 一种明星人像优化方法、装置以及存储装置
WO2023082773A1 (zh) 视频编解码方法、装置、设备、存储介质及计算机程序
US20230362367A1 (en) System and method for training artificial intelligence models for in-loop filters
CN112565819B (zh) 一种视频数据处理的方法及装置、电子设备、存储介质
CN111225210B (zh) 视频编码方法、视频编码装置及终端设备
KR102224299B1 (ko) 깊이 영상의 계층적 부호화, 복호화 방법 및 장치
US20230306687A1 (en) Mesh zippering

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17773224

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17773224

Country of ref document: EP

Kind code of ref document: A1