WO2016107215A1 - 一种图像处理方法与装置 - Google Patents

一种图像处理方法与装置 Download PDF

Info

Publication number
WO2016107215A1
WO2016107215A1 PCT/CN2015/089800 CN2015089800W WO2016107215A1 WO 2016107215 A1 WO2016107215 A1 WO 2016107215A1 CN 2015089800 W CN2015089800 W CN 2015089800W WO 2016107215 A1 WO2016107215 A1 WO 2016107215A1
Authority
WO
WIPO (PCT)
Prior art keywords
image processing
video
processing apparatus
delay
bandwidth
Prior art date
Application number
PCT/CN2015/089800
Other languages
English (en)
French (fr)
Inventor
李勇
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2016107215A1 publication Critical patent/WO2016107215A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation

Definitions

  • the present invention relates to the field of image processing, and in particular, to an image processing method and apparatus.
  • the desktop cloud is an emerging network application that is subject to conditions such as bandwidth limitations and network latency. Different bandwidth conditions and different network delays have a great impact on the performance indicators such as fluency and clarity of the desktop cloud.
  • the network traffic control method is introduced into the desktop cloud system in the prior art to achieve the effect of maximizing the user experience.
  • Network traffic control is a popular technology widely used in networking programs. It is widely used in network multimedia scenarios such as broadcasting and television. It aims to make full use of limited bandwidth and provide users with high-quality audio, video or gaming experience.
  • the method will calculate the total amount of data sent by the desktop cloud server within a certain control period (such as 1s), and then calculate the real-time bandwidth value in the control period, and control the desktop in real time according to the deviation between the real-time bandwidth value and the expected bandwidth value.
  • the frame rate of the cloud server (that is, the number of data transmissions per unit time). This method can achieve stable control of bandwidth by changing the frame rate of the server.
  • this method is in exchange for the adaptive ability of network traffic at the cost of reducing the frame rate, and often causes service jams in scenes requiring high frame rate and high fluency such as video and games. Therefore, the existing network traffic control method is not suitable for use in scenes requiring high frame rate and high fluency such as video and games.
  • Embodiments of the present invention provide an image processing method for reducing network delay.
  • a first aspect of the embodiments of the present invention provides an image processing method, which is applicable to an image processing apparatus, the image processing apparatus is configured to process video data, and an operation mode of the image processing apparatus includes a bandwidth control mode, and the method includes :
  • the image processing device determines a current network delay
  • the image processing apparatus determines whether the network delay is greater than a preset expected delay
  • the image processing apparatus determines that the network delay is greater than the expected delay, and the image processing apparatus is currently in the bandwidth control mode, the image processing apparatus reduces the video encoding average bandwidth value to reduce the processed
  • the average bandwidth of the video data is used to control the average transmission bandwidth of the processed video data in the bandwidth control mode.
  • the image processing apparatus determines that the network delay is greater than the expected delay, and the image processing The device is currently in the bandwidth control mode, and the method further includes:
  • the image processing apparatus reduces a video encoding maximum bandwidth value to reduce a transmission maximum bandwidth of the processed video data, and the video encoding maximum bandwidth value is used to control a transmission maximum bandwidth of the processed video data.
  • the working mode of the image processing apparatus further includes a quality control mode, where the method further include:
  • the image processing apparatus determines that the network delay is greater than the expected delay and the image processing apparatus is currently in the quality control mode, the image processing apparatus increases the video average quality coefficient to reduce the processed video a maximum value of the peak signal to noise ratio PSNR of the data; and/or the image processing device increases a video worst quality coefficient to reduce a minimum value of the PSNR of the processed video data; and/or the image processing device Reducing a video encoding maximum bandwidth value to reduce a maximum transmission bandwidth of the processed video data, the video average quality coefficient being used to control a maximum value of a PSNR of the processed video data in a quality control mode, the video being the worst The quality factor is used to control the minimum value of the PSNR of the processed video data in the quality control mode.
  • the first or second implementation manner of the first aspect, the third implementation manner of the first aspect of the embodiment of the present invention further includes:
  • the image processing apparatus determines that the network delay is not greater than the expected delay, and the image processing apparatus is currently in a bandwidth control mode, the image processing apparatus increases a video encoding average bandwidth value to improve processing The average bandwidth of the video data is transmitted; and/or the image processing apparatus increases the maximum bandwidth value of the video encoding to increase the maximum bandwidth of the processed video data;
  • the image processing apparatus determines that the network delay is not greater than the expected delay, and the image processing apparatus is currently in the quality control mode, the image processing apparatus reduces the video average quality a coefficient to increase a maximum value of a PSNR of the processed video data; and/or the image processing apparatus reduces a video worst quality coefficient to increase a minimum value of a PSNR of the processed video data; and/or The image processing apparatus increases the maximum bandwidth value of the video encoding to increase the maximum bandwidth of the processed video data.
  • the image processing The device is configured with the video encoding average bandwidth value, the video encoding maximum bandwidth value, the video average quality coefficient, and the value range of the video worst quality coefficient, and the image processing apparatus averages the video encoding The bandwidth value, the video encoded maximum bandwidth value, the video average quality coefficient, and/or the video worst quality coefficient increase and/or decrease operation does not exceed the value range.
  • the image processing The device is further configured to process the picture data, and the method further includes:
  • the image processing apparatus determines that the network delay is greater than the expected delay, the image processing apparatus increases an edge intensity threshold to improve lossy compressed picture data and losslessly compressed picture data during image processing. a ratio, the edge intensity threshold is used to control a ratio of lossy compressed picture data to losslessly compressed picture data during image processing;
  • the image processing apparatus determines that the network delay is not greater than the expected delay, the image processing apparatus reduces the edge intensity threshold to reduce lossy compressed picture data and lossless compression during image processing The ratio of image data.
  • the method further includes:
  • the image processing apparatus determines that the network delay is greater than the expected delay, the image processing apparatus reduces a picture quality coefficient to increase a compression ratio of lossy compression of picture data during image processing,
  • the picture quality coefficient is used to control the compression ratio of the lossy compression of the picture data during image processing;
  • the image processing apparatus determines that the network delay section is greater than the expected delay, the image processing apparatus increases a picture quality coefficient to reduce a compression ratio of lossy compression of picture data during image processing.
  • a second aspect of an embodiment of the present invention provides an image processing apparatus for processing video data, an operation mode of the image processing apparatus including a bandwidth control mode,
  • the image processing apparatus includes:
  • a delay calculation module for determining a current network delay
  • a delay judging module configured to determine whether the network delay is greater than a preset expected delay
  • a video adjustment module configured to: when the time delay determination module determines that the network delay is greater than the expected delay, and the image processing apparatus is currently in a bandwidth control mode, reduce a video coding average bandwidth value to reduce processing The average bandwidth of the video data after transmission is used to control the average transmission bandwidth of the processed video data in the bandwidth control mode.
  • the time delay determining module determines that the network delay is greater than the expected delay, and the image When the processing device is currently in the bandwidth control mode, the video adjustment module is further configured to:
  • the video encoding maximum bandwidth value is reduced to reduce the maximum transmission bandwidth of the processed video data, and the video encoding maximum bandwidth value is used to control the maximum bandwidth of the processed video data.
  • the working mode of the image processing apparatus includes a bandwidth control mode, and the video adjustment module Also used for:
  • the delay determination module determines that the network delay is greater than the expected delay, and the image processing apparatus is currently in the quality control mode, increasing the video average quality coefficient to reduce the peak value of the processed video data a maximum value of the noise ratio PSNR; and/or, increasing the video worst quality coefficient to reduce the minimum value of the PSNR of the processed video data; and/or decreasing the maximum bandwidth value of the video encoding to reduce the processed video Maximum bandwidth of data transmission, the video average quality coefficient is used to control the maximum value of the PSNR of the processed video data in the quality control mode, and the video worst quality coefficient is used to control the processed video in the quality control mode The minimum value of the PSNR of the data.
  • the video adjustment module is further configured to:
  • the delay determination module determines that the network delay is not greater than the expected delay, and the image processing apparatus is currently in the bandwidth control mode, increasing the video coding average bandwidth value to improve the processed video data. Transmitting the average bandwidth; and/or increasing the maximum bandwidth value of the video encoding to increase the maximum bandwidth of the processed video data;
  • the delay determination module determines that the network delay is not greater than the expected delay, and the image processing apparatus is currently in the quality control mode, reducing the video average quality coefficient to improve the PSNR of the processed video data. Maximum value; and/or, reduce the video's worst quality coefficient to promote The minimum value of the PSNR of the video data to be processed; and/or, increasing the maximum bandwidth value of the video encoding to increase the maximum bandwidth of the processed video data.
  • the image processing The device is configured with the video encoding average bandwidth value, the video encoding maximum bandwidth value, the video average quality coefficient, and the value range of the video worst quality coefficient, and the video adjusting module averages the video encoding.
  • the bandwidth value, the video encoded maximum bandwidth value, the video average quality coefficient, and/or the video worst quality coefficient increase and/or decrease operation does not exceed the value range.
  • the image processing The device is further configured to process the picture data, and the device further includes:
  • a picture adjustment module configured to: when the time delay determining module determines that the network delay is greater than the expected time delay, increase an edge intensity threshold to improve lossy compressed picture data and lossless compressed pictures during image processing a ratio of the data, the edge intensity threshold is used to control a ratio of lossy compressed picture data to losslessly compressed picture data during image processing; and when the delay determination module determines that the network delay is not greater than the expected Delaying, reducing the edge intensity threshold to reduce the ratio of lossy compressed picture data to losslessly compressed picture data during image processing.
  • the image adjustment module is further configured to:
  • the delay determining module determines that the network delay is greater than the expected time delay, reducing the picture quality coefficient to increase the compression ratio of the lossy compression of the picture data during image processing, where the picture quality coefficient is used Controlling the compression ratio of the lossy compression of the picture data during image processing; when the image processing apparatus determines that the network delay is not greater than the expected time delay, increasing the picture quality coefficient to reduce the picture during image processing The compression ratio of the lossy compression of the data.
  • the image processing apparatus determines the current network delay; determines whether the network delay is greater than a preset expected delay; and if the network delay is determined to be greater than the expected delay, and the image
  • the processing device is currently in the bandwidth control mode, and the image processing device reduces the video encoding average bandwidth value to reduce the transmission average bandwidth of the processed video data.
  • the embodiment of the invention can reduce the transmission average bandwidth of the processed video data when the network delay is greater than expected, to achieve compression of the video data, reduce the quality of the processed video, and reduce the amount of data transmitted by the network, thereby reducing The purpose of network delay. In exchange with the prior art, the network is exchanged at the cost of reducing the frame rate.
  • the method provided by the embodiment of the present invention does not need to reduce the frame rate, and does not cause service jam in a scenario requiring high frame rate and high fluency, and is suitable for applications requiring high frames in video, games, and the like. Rate, high fluency in the scene.
  • FIG. 1 is a schematic diagram showing the principle of image processing performed by an image processing apparatus at a current stage
  • FIG. 2 is a flowchart of an embodiment of an image processing method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of another embodiment of an image processing method according to an embodiment of the present invention.
  • FIG. 4 is a structural diagram of an embodiment of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 5 is a structural diagram of another embodiment of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 6 is a structural diagram of another embodiment of an image processing apparatus according to an embodiment of the present invention.
  • Embodiments of the present invention provide an image processing method for reducing network delay. Embodiments of the present invention also provide related image processing devices, which will be separately described below.
  • the display driver of the desktop cloud performs video pattern recognition on the image data, and divides the image data into video data and image data.
  • the image processing apparatus first performs video encoding, performs data compression, and then outputs the image processing apparatus.
  • the image processing apparatus first recognizes the complexity of the picture data, determines the picture data with higher complexity as a natural picture, and performs lossy compression using the lossy encoder; and determines the picture data with lower complexity.
  • the compressed picture data is subjected to data compression again and output to the image processing apparatus.
  • FIG. 2 The flow of the image processing method provided by the embodiment of the present invention is shown in FIG. 2, and includes:
  • the image processing apparatus determines a current network delay.
  • the image processing device determines the current network delay.
  • the server may send the difference between the command signal sent to the client and the response signal received by the client as the current network delay to the image processing device, and the image processing device receives the server.
  • the image processing apparatus may determine the current network delay by other methods, which is not limited in this embodiment.
  • the image processing apparatus determines whether the network delay is greater than a preset expected delay.
  • a desired delay is preset in the graphics processing device. If the network delay is less than the expected delay, the current network fluency is considered to satisfy the user experience.
  • the image processing apparatus determines whether the network delay is greater than a preset desired delay.
  • the image processing apparatus is configured to process video data, and the operation mode of the image processing apparatus includes a bandwidth control mode.
  • the bandwidth control mode is used to control the transmission bandwidth of the encoded video data, and is suitable for scenarios with limited network bandwidth.
  • the image processing apparatus determines that the network delay is greater than the expected delay and the image processing apparatus is currently in the bandwidth control mode, the operation of step 203 is triggered.
  • the image processing apparatus reduces a video coding average bandwidth value.
  • the image processing apparatus When the image processing apparatus performs video encoding in the bandwidth control mode, it has a parameter video encoding average bandwidth value and a video encoding maximum bandwidth value.
  • the video coding average bandwidth value is used to control the average bandwidth of the video data after the image processing apparatus performs video encoding in the bandwidth control mode (ie, the average value of the transmission bandwidth), and the maximum bandwidth value of the video encoding is used to control the image processing apparatus.
  • the maximum bandwidth ie, the maximum transmission bandwidth of the video encoded video data.
  • the image processing apparatus determines that the network delay is greater than the expected delay, and the image processing apparatus is currently in the bandwidth control mode, the image processing apparatus reduces the video encoding average bandwidth value to reduce the transmission average of the processed video data. bandwidth.
  • the average transmission bandwidth of the video data is related to the amount of video data, and the smaller the average transmission bandwidth is, the more the image processing apparatus compresses the video data when performing video encoding, and the more the processed video data is. Small, the worse the quality of the video.
  • the image processing device determines the current network delay; determines whether the network delay is greater than a preset expected delay; and if the network delay is determined to be greater than the expected delay, and the image processing device is currently in the bandwidth
  • the image processing apparatus reduces the video coding average bandwidth value to reduce the transmission average bandwidth of the processed video data.
  • the network delay may be greater than the expected time delay, and the average transmission bandwidth of the processed video data may be reduced, so as to achieve video data compression, reduce the quality of the processed video, and reduce the amount of data transmitted by the network, thereby reducing the network.
  • the purpose of network delay is not limited to achieve video data compression, reduce the quality of the processed video, and reduce the amount of data transmitted by the network, thereby reducing the network.
  • the method provided in this embodiment does not need to reduce the frame rate, and does not cause a service card in a scenario requiring high frame rate and high fluency, as compared with the adaptive capability of the network to exchange network traffic at the cost of reducing the frame rate. It is suitable for applications such as video and games that require high frame rate and high fluency. In the scenery.
  • the embodiment shown in FIG. 2 provides an image processing method for reducing network latency by reducing the video encoding average bandwidth value when the network delay is large and the image processing device is in the bandwidth control mode.
  • the bandwidth control mode further includes a parameter video coding maximum bandwidth value for controlling the maximum bandwidth of the processed video data.
  • the image processing apparatus may also reduce the maximum bandwidth value of the video encoding to reduce the maximum transmission bandwidth of the processed video data.
  • the reduction of the maximum bandwidth of the video data transmission means that the instantaneous peak of the transmission bandwidth is also reduced, which is advantageous for further reducing the average bandwidth of the video encoded transmission, and can better reduce the network delay.
  • the image processing apparatus generally includes not only a bandwidth control mode but also a quality control mode. Different from the bandwidth control mode, the transmission bandwidth of the video data is the control standard, and the quality control mode takes the quality of the processed video as the control standard.
  • the present invention also provides another image processing method, which can be used not only in the bandwidth control mode but also in the quality control mode. Referring to FIG. 3, the basic process includes:
  • the image processing device determines a current network delay.
  • the image processing apparatus determines whether the network delay is greater than a preset expected delay.
  • Steps 301 and 302 are basically the same as steps 201 and 202, and are not described herein.
  • the image processing apparatus is configured to process video data
  • the operation modes of the image processing apparatus include a bandwidth control mode and a quality control mode.
  • the bandwidth control mode is used to control the transmission bandwidth of the encoded video data. It is suitable for scenarios with limited network bandwidth.
  • the quality control mode is used to control the quality of the encoded video. It is suitable for scenarios where video quality is required.
  • the operation of step 303 is triggered; if the image processing apparatus determines that the network delay is greater than the expected delay, and the image The processing device is currently in the quality control mode, and the operation of step 304 is triggered.
  • the image processing apparatus reduces a video encoding average bandwidth value.
  • Step 303 is basically the same as step 203, and details are not described herein.
  • the image processing device increases the video average quality coefficient.
  • the image processing apparatus When the image processing apparatus performs video encoding in the quality control mode, it has a parameter video average quality coefficient, a video worst quality coefficient, and a video encoding maximum bandwidth value.
  • the video average quality coefficient is used to control the maximum value of the peak signal to noise ratio (PSNR) of the video encoded video data, and the video average quality coefficient is larger, and the video is encoded.
  • PSNR peak signal to noise ratio
  • the PSNR of the video-encoded video data is between the maximum value and the minimum value, so whether the maximum value or the minimum value is reduced, it is advantageous to reduce the PSNR of the video-encoded video data, so that the video quality is deteriorated. Therefore, it can be understood that increasing the video average quality coefficient, and/or increasing the video worst quality coefficient, and/or reducing the video encoding maximum bandwidth value can reduce the video quality to achieve the effect of reducing the network delay.
  • the image processing apparatus determines that the network delay is greater than the expected delay and the image processing apparatus is currently in the quality control mode, the image processing apparatus increases the video average quality coefficient.
  • the image processing device determines the current network delay; determines whether the network delay is greater than a preset expected delay; and if the network delay is determined to be greater than the expected delay, and the image processing device is currently in the bandwidth
  • the image processing apparatus reduces the video coding average bandwidth value to reduce the transmission average bandwidth of the processed video data; if it is determined that the network delay is greater than the expected delay, and the image processing apparatus is currently in the quality control mode, the image processing The device increases the video average quality coefficient to reduce the maximum value of the PSNR of the video encoded video data.
  • the network delay may be greater than the expected time delay, and the average transmission bandwidth or the video average quality coefficient of the processed video data may be reduced to implement compression of the video data, reduce the quality of the processed video, and reduce data transmitted by the network. Quantity, to achieve the purpose of reducing network delay.
  • the method provided in this embodiment does not need to reduce the frame rate, and does not cause a service card in a scenario requiring high frame rate and high fluency, as compared with the adaptive capability of the network to exchange network traffic at the cost of reducing the frame rate. It is suitable for applications such as video and games that require high frame rate and high fluency.
  • the image processing apparatus in step 303 can also reduce the video encoding maximum bandwidth value; in step 304, the image processing apparatus can also increase the video worst quality coefficient and/or reduce the video encoding maximum bandwidth value, and can also achieve the reduction.
  • the effect of small network delay is not described here.
  • the method provided by the embodiment of FIG. 2 and FIG. 3 can reduce the video quality by adjusting the parameters of the video coding to reduce the delay when the network delay is greater than the expected time delay. It can be understood that, when the network delay is not greater than the expected time delay, the video quality can be improved by adjusting the parameters of the video coding, thereby improving the user's visual experience. Specifically, if the image processing apparatus determines that the network delay is not greater than the expected delay and the image processing apparatus is currently in the bandwidth control mode, the image processing apparatus increases the video encoding average bandwidth value to improve the transmission average bandwidth of the processed video data. And/or, the image processing device increases the maximum bandwidth value of the video encoding to improve the transmission of the processed video data. Large bandwidth.
  • the image processing apparatus determines that the network delay is not greater than the expected delay and the image processing apparatus is currently in the quality control mode, the image processing apparatus reduces the video average quality coefficient to increase the maximum value of the PSNR of the processed video data; and / Or, the image processing apparatus reduces the video worst quality coefficient to increase the minimum value of the PSNR of the processed video data; and/or, the image processing apparatus increases the video encoding maximum bandwidth value to enhance the transmission of the processed video data. Maximum bandwidth.
  • the video encoding parameters include a video encoding average bandwidth value, a video encoding maximum bandwidth value, a video average quality coefficient, and a video worst quality coefficient.
  • the image processing apparatus may be configured with a video encoding average bandwidth value, a video encoding maximum bandwidth value, a video average quality coefficient, and a value range of a video worst quality coefficient, and the image processing apparatus encodes an average bandwidth value of the video, the video.
  • the operation of encoding the maximum bandwidth value, the video average quality coefficient, and/or the video worst quality coefficient should not exceed this range of values.
  • the quality of the video does not need to be infinitely improved, and only needs to meet the normal use requirements of the user.
  • the PSNR of the video data reaches 45 or more, it is difficult for the human eye to distinguish the quality of the video, so the PSNR of the video data only needs to reach 45. Therefore, in this embodiment, the image processing apparatus may be configured with an optimal value of a video encoding average bandwidth value, a video encoding maximum bandwidth value, a video average quality coefficient, and a video worst quality coefficient, and these optimal values are When the quality of the video is just enough to meet the normal usage requirements of the user, the values of the video encoding average bandwidth value, the video encoding maximum bandwidth value, the video average quality coefficient, and the video worst quality coefficient are used.
  • the image processing apparatus improves the video quality by adjusting the parameters of the video encoding, specifically, the image processing apparatus reduces the difference between the parameters of the video encoding and the optimal values of the parameters, When the parameters of the video encoding reach an optimum value, the image processing apparatus stops the adjustment of the parameters of the video encoding. In this way, the quality of the video is not infinitely improved, and the network delay caused by the improvement of the meaningless video quality is avoided.
  • the image processing apparatus can be used not only for processing video data but also for processing picture data.
  • the image processing apparatus has a parameter edge intensity threshold and/or a picture quality coefficient when processing the picture data, wherein the edge intensity threshold is used to control the lossy compressed picture data in the picture data when the image complexity is recognized (ie, is confirmed to be complicated)
  • the ratio of the picture data of the picture to the picture data of the lossless compression ie, the picture data confirmed as a simple picture
  • the picture quality coefficient is used to control the compression ratio of the data of the complex picture in the lossy compression process, and the picture quality coefficient is more Small, figure
  • the larger the compression ratio of the slice data lossy compression process the more compressed picture data is, the worse the quality of the compressed picture is, which is more conducive to reducing the network delay.
  • the image processing apparatus may increase the edge intensity threshold to improve lossy compression during image processing.
  • the ratio of the picture data to the losslessly compressed picture data, and/or the image processing device reduces the picture quality coefficient to increase the compression ratio of the lossy compression of the picture data during image processing; when the image processing device determines that the network delay is not
  • the image processing apparatus reduces the edge intensity threshold to reduce the ratio of the lossy compressed picture data to the losslessly compressed picture data during image processing, and/or the image processing apparatus increases the picture quality coefficient to Reduce the compression ratio of lossy compression of picture data during image processing. In this way, when the network delay is greater than the expected delay, the network delay can be reduced by reducing the picture quality, and the picture quality can be improved when the network delay is not greater than the expected time delay.
  • the image processing device may also be configured with an edge intensity threshold and a value range of the picture quality coefficient, and the operation of the edge intensity threshold and/or the picture quality coefficient by the image processing device should not exceed the value range.
  • the image processing apparatus can also be configured with an optimal value of the edge intensity threshold and the picture quality coefficient.
  • the image processing apparatus reduces the edge intensity threshold and the picture quality coefficient and the optimal value.
  • the difference between the edge intensity threshold and the picture quality coefficient reaches an optimum value, and the image processing apparatus stops the adjustment of the edge intensity threshold and the picture quality coefficient. In this way, the quality of the picture will not be infinitely improved, and the network delay caused by the improvement of the meaningless picture quality is avoided.
  • the invention also provides an increase step size and a reduction of the value range of the video coding average bandwidth value, the video coding maximum bandwidth value, the video average quality coefficient, the video worst quality coefficient, the edge intensity threshold, and the picture quality coefficient.
  • the reference value of the parameters in the method provided by the embodiment of the present invention refer to Table 1.
  • the image processing apparatus determines that the current network delay is 0.2 s.
  • the expected delay of the preset is 0.1s.
  • the image processing device determines that the network delay is greater than the expected delay.
  • the image processing device is currently in the bandwidth control mode for video encoding, and the image processing device adjusts the parameters used in the video encoding process. Specifically, the video encoding average bandwidth value is reduced from 15000000 to 10000000, and the video encoding maximum bandwidth value is reduced from 20000000. As small as 15000000; the image processing device also adjusts the parameter edge intensity threshold used in the picture complexity recognition process, and adjusts the edge intensity threshold from 100 to 105; the image processing device also adjusts the parameter picture quality coefficient used in complex image lossy compression. , adjust the picture quality factor from 80 to 78.
  • the image processing apparatus reduces the PSNR of the video encoded video data by the above adjustment, and the ratio of the lossy compressed picture data to the losslessly compressed picture data in the picture data becomes high, and the compression ratio of the lossy compression of the complex picture data increases. Large, the quality of video and pictures is getting worse, and the network delay is reduced to 0.05s.
  • the embodiment of the present invention further provides an image processing apparatus for implementing the image processing method provided by the above embodiments.
  • the basic structure is shown in Figure 4, including:
  • a delay calculation module 401 configured to determine a current network delay
  • the delay determining module 402 is configured to determine whether the network delay is greater than a preset expected delay
  • the video adjustment module 403 is configured to: when the time delay determination module 402 determines that the network delay is greater than the expected delay, and the image processing apparatus is currently in the bandwidth control mode, reduce the video coding average bandwidth value, so as to reduce the transmission average of the processed video data. Bandwidth, the video encoding average bandwidth value is used to control the average transmission bandwidth of the processed video data in the bandwidth control mode.
  • the delay calculation module 401 determines the current network delay; the delay determination module 402 determines whether the network delay is greater than a preset expected delay; if it is determined that the network delay is greater than the expected delay, And the image processing device is currently in the bandwidth control mode, then the video adjustment module 403 reduces the video coding average bandwidth value to reduce the transmission average bandwidth of the processed video data.
  • the network delay may be longer than the expected time delay, and the transmission of the processed video data is reduced.
  • the average bandwidth is used to achieve compression of video data, reduce the quality of processed video, reduce the amount of data transmitted by the network, and achieve the purpose of reducing network delay.
  • the device provided in this embodiment does not need to reduce the frame rate, and does not cause a service card in a scenario requiring high frame rate and high fluency, compared with the adaptive capability of the network to exchange network traffic at the cost of reducing the frame rate. It is suitable for applications such as video and games that require high frame rate and high fluency.
  • the video adjustment module 403 is further configured to:
  • the time delay determination module 402 determines that the network delay is greater than the expected delay, and when the image processing apparatus is currently in the bandwidth control mode, reduces the maximum bandwidth of the video encoding to reduce the maximum bandwidth of the processed video data, and the maximum bandwidth of the video encoding.
  • the value is used to control the maximum bandwidth of the processed video data.
  • the reduction of the maximum bandwidth of the video data transmission means that the instantaneous peak of the transmission bandwidth is also reduced, which is advantageous for further reducing the average bandwidth of the video encoded transmission, and can better reduce the network delay.
  • the video adjustment module 403 is further configured to:
  • the time delay determination module 402 determines that the network delay is greater than the expected delay, and when the image processing apparatus is currently in the quality control mode, increases the video average quality coefficient to reduce the maximum value of the peak signal to noise ratio PSNR of the processed video data; Or, increase the video worst quality coefficient to reduce the minimum value of the PSNR of the processed video data; and/or reduce the video encoding maximum bandwidth value to reduce the maximum transmission bandwidth of the processed video data, the video
  • the average quality coefficient is used to control the maximum value of the PSNR of the processed video data in the quality control mode for controlling the minimum value of the PSNR of the processed video data in the quality control mode.
  • the network delay is greater than the expected delay
  • the video data is compressed
  • the quality of the processed video is reduced
  • the amount of data transmitted by the network is reduced, thereby reducing the network delay.
  • the method provided in this embodiment does not need to reduce the frame rate, and does not cause a service card in a scenario requiring high frame rate and high fluency, as compared with the adaptive capability of the network to exchange network traffic at the cost of reducing the frame rate. It is suitable for applications such as video and games that require high frame rate and high fluency.
  • the video adjustment module 403 is further configured to:
  • the time delay determination module 402 determines that the network delay is not greater than the expected delay, and when the image processing device is currently in the bandwidth control mode, increases the video coding average bandwidth value to improve the average transmission bandwidth of the processed video data; and/or, Increase the maximum bandwidth of the video encoding to increase the maximum bandwidth of the processed video data;
  • the time delay determination module 402 determines that the network delay is not greater than the expected delay, and the image processing device When in the quality control mode, the video average quality coefficient is reduced to increase the maximum value of the PSNR of the processed video data; and/or the video worst quality coefficient is reduced to improve the minimum PSNR of the processed video data. Value; and/or, increase the maximum bandwidth of the video encoding to increase the maximum bandwidth of the processed video data.
  • the image processing device is configured with a video encoding average bandwidth value, a video encoding maximum bandwidth value, a video average quality coefficient, and a value range of the video worst quality coefficient, and the video adjustment module encodes an average bandwidth value and a video encoding maximum bandwidth.
  • the increase, and/or decrease operation of the value, the video average quality factor, and/or the video worst quality coefficient does not exceed this range of values.
  • the embodiment of the present invention further provides an image processing apparatus based on the embodiment shown in FIG. 4, which can be used not only for processing video data but also for processing picture data.
  • the basic structure includes a delay calculation module 501, a delay determination module 502, and a video adjustment module 503.
  • the modules 501 to 503 are substantially the same as the modules 401 to 403, and are not described herein.
  • the image processing apparatus further includes:
  • the picture adjustment module 504 is configured to determine that the network delay is greater than the expected time delay and increase the edge intensity threshold to improve the ratio of the lossy compressed picture data to the losslessly compressed picture data during image processing.
  • the edge intensity threshold is used to control the ratio of the lossy compressed picture data to the losslessly compressed picture data during image processing; the time delay determination module 502 determines that the network delay is not greater than the expected time delay, and reduces the edge intensity threshold to reduce the image. The ratio of lossy compressed image data to losslessly compressed image data during processing.
  • the delay calculation module 501 determines the current network delay; the delay determination module 502 determines whether the network delay is greater than a preset expected delay; if it is determined that the network delay is greater than the expected delay, And the image processing device is currently in the bandwidth control mode, and the video adjustment module 503 reduces the video encoding average bandwidth value, and/or the video encoding maximum bandwidth value, and/or the video average quality coefficient, and/or the video worst quality coefficient.
  • the quality of the video encoded video; the picture adjustment module 504 increases the edge intensity threshold to improve the ratio of the lossy compressed picture data to the losslessly compressed picture data during image processing, so that more picture data is lossy compressed. Causes the quality of the compressed image to deteriorate.
  • the video delay and the picture data are further compressed when the network delay is greater than the expected time delay, so as to reduce the quality of the processed video and the picture, and reduce the amount of data transmitted by the network, thereby achieving the purpose of reducing the network delay.
  • the device provided in this embodiment does not need to reduce the frame rate, and does not cause a service card in a scenario requiring high frame rate and high fluency, compared with the adaptive capability of the network to exchange network traffic at the cost of reducing the frame rate. Suitable for video, Games and other scenarios that require high frame rates and high fluency.
  • the image processing apparatus not only has a parameter edge intensity threshold when processing picture data, but also generally has a picture quality coefficient.
  • the picture quality coefficient is used to control the compression ratio of the data of the complex picture in the lossy compression process.
  • the time delay determination module 502 determines that the network delay is greater than the expected time delay, reduces the picture quality coefficient to increase the compression ratio of the lossy compression of the picture data during image processing, and the picture quality coefficient is used to control the picture data during the image processing process.
  • the compression ratio of the lossy compression when the image processing apparatus determines that the network delay section is greater than the expected time delay, increasing the picture quality coefficient to reduce the compression ratio of the lossy compression of the picture data during image processing.
  • the delay calculation module 501 determines that the current network delay is 0.2 s.
  • the expected delay of the preset is 0.1s.
  • the delay decision module 502 determines that the network delay is greater than the expected delay.
  • the image processing device is currently in the bandwidth control mode for video encoding, and the video adjustment module 503 adjusts the parameters used in the video encoding process. Specifically, the video encoding average bandwidth value is reduced from 15000000 to 10000000, and the video encoding maximum bandwidth value is from 20000000.
  • the picture adjustment module 504 adjusts the parameter edge intensity threshold used by the picture complexity recognition process to adjust the edge intensity threshold from 100 to 105; the picture adjustment module 504 also adjusts the parameter picture used in the complex picture lossy compression.
  • the quality factor adjusts the picture quality factor from 80 to 78.
  • the image processing apparatus reduces the PSNR of the video encoded video data by the above adjustment, and the ratio of the lossy compressed picture data to the losslessly compressed picture data in the picture data becomes high, and the compression ratio of the lossy compression of the complex picture data increases. Large, the quality of video and pictures is getting worse, and the network delay is reduced to 0.05s.
  • Another embodiment of the image processing apparatus 600 includes:
  • the input device 601, the output device 602, the processor 603, and the memory 604 (wherein the number of processors 603 in the image processing device 600 may be one or more, and one processor 603 in FIG. 6) For example).
  • the input device 601, the output device 602, the processor 603, and the memory 604 may be connected by a bus or other means, wherein the bus connection is taken as an example in FIG.
  • the processor 603 is configured to perform the following steps by calling an operation instruction stored in the memory 604:
  • the image processing apparatus If it is determined that the network delay is greater than the expected delay, and the image processing apparatus is currently in a bandwidth control mode, reducing a video encoding average bandwidth value to reduce a transmission average bandwidth of the processed video data, the video The coded average bandwidth value is used to control the average transmission bandwidth of the processed video data in the bandwidth control mode.
  • the processor 603 if it is determined that the network delay is greater than the expected delay, and the image processing apparatus is currently in the bandwidth control mode, the processor 603 further performs the following steps:
  • the video encoding maximum bandwidth value is reduced to reduce the maximum transmission bandwidth of the processed video data, and the video encoding maximum bandwidth value is used to control the maximum bandwidth of the processed video data.
  • the processor 603 further performs the following steps:
  • the video average quality coefficient is used to control a maximum value of a PSNR of the processed video data in a quality control mode for controlling a minimum PSNR of the processed video data in the quality control mode .
  • the processor 603 further performs the following steps:
  • the image processing apparatus If it is determined that the network delay is not greater than the expected delay, and the image processing apparatus is currently in the bandwidth control mode, increasing a video coding average bandwidth value to improve a transmission average bandwidth of the processed video data; and Or, increase the maximum bandwidth value of the video encoding to increase the maximum bandwidth of the processed video data;
  • the image processing apparatus If it is determined that the network delay is not greater than the expected delay, and the image processing apparatus is currently in the quality control mode, reducing the video average quality coefficient to increase the maximum value of the PSNR of the processed video data; and / Or, reduce the video worst quality coefficient to improve the processed video data The minimum value of the PSNR; and/or, increasing the maximum bandwidth value of the video encoding to increase the maximum bandwidth of the processed video data.
  • the processor 603 is configured with the video encoding average bandwidth value, the video encoding maximum bandwidth value, the video average quality coefficient, and the value range of the video worst quality coefficient, and processing The 603 may not exceed the value of the video encoding average bandwidth value, the video encoding maximum bandwidth value, the video average quality coefficient, and/or the video worst quality coefficient increase and/or decrease operation range.
  • the processor 603 further performs the following steps:
  • edge intensity threshold to improve a ratio of lossy compressed picture data to losslessly compressed picture data during image processing, the edge intensity threshold being used for controlling The ratio of lossy compressed picture data to losslessly compressed picture data during image processing;
  • the edge intensity threshold is decreased to reduce a ratio of lossy compressed picture data to losslessly compressed picture data during image processing.
  • the processor 603 further performs the following steps:
  • the picture quality coefficient is increased to reduce the compression ratio of the lossy compression of the picture data during image processing.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separate.
  • the components displayed for the unit may or may not be physical units, ie may be located in one place, or may be distributed over multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

公开了一种图像处理方法，用于减小网络时延。实施例方法包括：图像处理装置确定当前的网络时延；图像处理装置判断所述网络时延是否大于预置的期望时延；若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，所述视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。实施例还提供了相关的图像处理装置。

Description

一种图像处理方法与装置
本申请要求于2014年12月30日提交中国专利局、申请号为201410841944.1、发明名称为“一种图像处理方法与装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及图像处理领域，尤其涉及一种图像处理方法与装置。
背景技术
桌面云是一种新兴的网络应用，它会受到诸如带宽限制、网络延时等条件的制约。不同的带宽条件、不同的网络延时对桌面云的流畅度、清晰度等性能指标有很大的影响。为适应不同的网络带宽或延时条件，现有技术中将网络流量控制方法引入桌面云系统中，以实现最大化用户体验的效果。
网络流量控制是一种联网程序广泛应用的流行技术，广泛应用于广播、电视等网络多媒体场景，旨在充分利用有限的带宽，给用户提供高质量的音、视频或游戏体验。该方法会在一定的控制周期内(如1s)，统计桌面云服务端数据发送的总量，然后计算出该控制周期内的实时带宽值，根据实时带宽值与期望带宽值的偏差实时控制桌面云服务端的帧率(即单位时间内的数据发送次数)。这种方法可以通过改变服务端帧率，来实现带宽的稳定控制。
但是，这种方法以降低帧率为代价来换取网络流量的自适应能力，在视频、游戏等需要高帧率、高流畅度的场景下往往会造成服务卡顿。因此现有的网络流量控制方法不适宜应用在视频、游戏等需要高帧率、高流畅度的场景中。
发明内容
本发明实施例提供了一种图像处理方法，用于减小网络时延。
本发明实施例的第一方面提供了一种图像处理方法，适用于图像处理装置，所述图像处理装置用于处理视频数据，所述图像处理装置的工作模式包括带宽控制模式，所述方法包括：
图像处理装置确定当前的网络时延；
所述图像处理装置判断所述网络时延是否大于预置的期望时延；
若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，所述视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。
结合本发明实施例的第一方面，本发明实施例的第一方面的第一种实现方式中，若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述方法还包括：
所述图像处理装置减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频编码最大带宽值用于控制处理后的视频数据的传输最大带宽。
结合本发明实施例的第一方面的第一种实现方式，本发明实施例的第一方面的第二种实现方式中，所述图像处理装置的工作模式还包括质量控制模式，所述方法还包括：
若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于质量控制模式，则所述图像处理装置增大视频平均质量系数，以降低处理后的视频数据的峰值信噪比PSNR的最大值；和/或，所述图像处理装置增大视频最差质量系数，以降低处理后的视频数据的PSNR的最小值；和/或，所述图像处理装置减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频平均质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最大值，所述视频最差质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最小值。
结合本发明实施例的第一方面、第一方面的第一种或第二种实现方式，本发明实施例的第一方面的第三种实现方式还包括：
若所述图像处理装置确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述图像处理装置增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，所述图像处理装置增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽；
若所述图像处理装置确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于质量控制模式，则所述图像处理装置减小视频平均质量 系数，以提升处理后的视频数据的PSNR的最大值；和/或，所述图像处理装置减小视频最差质量系数，以提升处理后的视频数据的PSNR的最小值；和/或，所述图像处理装置增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
结合本发明实施例的第一方面、或第一方面的第一种至第三种实现方式中的任一项，本发明实施例的第一方面的第四种实现方式中，所述图像处理装置配置有所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、与所述视频最差质量系数的取值范围，所述图像处理装置对所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、和/或所述视频最差质量系数的增大和/或减小操作不超出所述取值范围。
结合本发明实施例的第一方面、或第一方面的第一种至第四种实现方式中的任一项，本发明实施例的第一方面的第五种实现方式中，所述图像处理装置还用于处理图片数据，所述方法还包括：
若所述图像处理装置确定所述网络时延大于所述期望时延，则所述图像处理装置增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，所述边缘强度阈值用于控制图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例；
若所述图像处理装置确定所述网络时延不大于所述期望时延，则所述图像处理装置减小所述边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例。
结合本发明实施例的第一方面的第五种实现方式，本发明实施例的第一方面的第六种实现方式中，所述方法还包括：
若所述图像处理装置确定所述网络时延大于所述期望时延，则所述图像处理装置减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比，所述图片质量系数用于控制图像处理过程中图片数据的有损压缩的压缩比；
若所述图像处理装置确定所述网络时延部大于所述期望时延，则所述图像处理装置增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。
本发明实施例的第二方面提供了一种图像处理装置，所述图像处理装置用于处理视频数据，所述图像处理装置的工作模式包括带宽控制模式，所述 图像处理装置包括：
时延计算模块，用于确定当前的网络时延；
时延判断模块，用于判断所述网络时延是否大于预置的期望时延；
视频调节模块，用于当所述时延判断模块确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式时，减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，所述视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。
结合本发明实施例的第二方面，本发明实施例的第二方面的第一种实现方式中，当所述时延判断模块确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式时，则所述视频调节模块还用于：
减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频编码最大带宽值用于控制处理后的视频数据的传输最大带宽。
结合本发明实施例的第二方面的第一种实现方式，本发明实施例的第二方面的第二种实现方式中，所述图像处理装置的工作模式包括带宽控制模式，所述视频调节模块还用于：
当所述时延判断模块确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于质量控制模式时，增大视频平均质量系数，以降低处理后的视频数据的峰值信噪比PSNR的最大值；和/或，增大视频最差质量系数，以降低处理后的视频数据的PSNR的最小值；和/或，减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频平均质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最大值，所述视频最差质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最小值。
结合本发明实施例的第二方面、第二方面的第一种或第二种实现方式，本发明实施例的第二方面的第三种实现方式中，所述视频调节模块还用于：
当所述时延判断模块确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于带宽控制模式时，增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽；
当所述时延判断模块确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于质量控制模式时，减小视频平均质量系数，以提升处理后的视频数据的PSNR的最大值；和/或，减小视频最差质量系数，以提升处 理后的视频数据的PSNR的最小值；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
结合本发明实施例的第二方面、或第二方面的第一种至第三种实现方式中的任一项，本发明实施例的第二方面的第四种实现方式中，所述图像处理装置配置有所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、与所述视频最差质量系数的取值范围，所述视频调节模块对所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、和/或所述视频最差质量系数的增大和/或减小操作不超出所述取值范围。
结合本发明实施例的第二方面、或第二方面的第一种至第四种实现方式中的任一项，本发明实施例的第二方面的第五种实现方式中，所述图像处理装置还用于处理图片数据，所述装置还包括：
图片调节模块，用于当所述时延判断模块确定所述网络时延大于所述期望时延时，增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，所述边缘强度阈值用于控制图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例；当所述时延判断模块确定所述网络时延不大于所述期望时延时，减小所述边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例。
结合本发明实施例的第二方面的第五种实现方式，本发明实施例的第二方面的第六种实现方式中，所述图片调节模块还用于：
当所述时延判断模块确定所述网络时延大于所述期望时延时，减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比，所述图片质量系数用于控制图像处理过程中图片数据的有损压缩的压缩比；当所述图像处理装置确定所述网络时延不大于所述期望时延时，增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。
本发明实施例提供的图像处理方法中，图像处理装置确定当前的网络时延；判断网络时延是否大于预置的期望时延；若确定网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽。本发明实施例可以在网络时延大于期望时延时降低处理后的视频数据的传输平均带宽，以实现视频数据的压缩，降低处理后的视频的质量，减少网络传输的数据量，达到减小网络时延的目的。与现有技术中以降低帧率为代价来换取网 络流量的自适应能力相比，本发明实施例提供的方法无需降低帧率，在需要高帧率、高流畅度的场景下不会造成服务卡顿，适宜应用在视频、游戏等需要高帧率、高流畅度的场景中。
附图说明
图1为现阶段的图像处理装置进行图像处理的原理的示意图；
图2为本发明实施例中图像处理方法一个实施例流程图；
图3为本发明实施例中图像处理方法另一个实施例流程图；
图4为本发明实施例中图像处理装置一个实施例结构图；
图5为本发明实施例中图像处理装置另一个实施例结构图；
图6为本发明实施例中图像处理装置另一个实施例结构图。
具体实施方式
本发明实施例提供了一种图像处理方法，用于减小网络时延。本发明实施例还提供了相关的图像处理装置，以下将分别进行描述。
网络流量控制技术中，现阶段的图像处理装置进行图像处理的原理请参阅图1，包括：
应用程序产生了图像数据后，桌面云的显示驱动对图像数据进行视频模式识别，将图像数据分为视频数据与图片数据。对于视频数据，图像处理装置首先进行视频编码，再进行数据压缩，然后输出图像处理装置。对于图片数据，图像处理装置先对图片数据的复杂度进行识别，将复杂度较高的图片数据确定为自然图片，并使用有损编码器进行有损压缩；将复杂度较低的图片数据确定为简单图片，并使用无损编码器进行无损压缩，压缩后的图片数据经过再次的数据压缩后输出图像处理装置。
在现阶段的图像处理装置进行图像处理的原理的基础上，本发明实施例提供的图像处理方法的流程请参阅图2，包括：
201、图像处理装置确定当前的网络时延；
图像处理装置确定当前的网络时延。具体的确定方法有很多，例如，服务器可以将向客户端发送指令信号与接收到客户端反馈的应答信号之间的差值作为当前的网络时延发送给图像处理装置，图像处理装置接收服务器发送 的当前的网络时延；或，图像处理装置自发计算当前的网络时延。图像处理装置也可以通过其他方法确定当前的网络时延，本实施例中不做限定。
202、图像处理装置判断网络时延是否大于预置的期望时延；
图形处理装置中预置有期望时延，若网络时延小于该期望时延，则认为当前网络的流畅度能够满足用户体验。图像处理装置判断网络时延是否大于预置的期望时延。
本实施例中，图像处理装置用于处理视频数据，图像处理装置的工作模式包括带宽控制模式。带宽控制模式用于控制编码后的视频数据的传输带宽，适用于网络带宽有限的场景下。本实施例中，若图像处理装置确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则触发步骤203的操作。
203、图像处理装置减小视频编码平均带宽值。
图像处理装置在带宽控制模式下进行视频编码时，具有参数视频编码平均带宽值和视频编码最大带宽值。其中，视频编码平均带宽值用于在带宽控制模式下控制图像处理装置进行视频编码后的视频数据的传输平均带宽(即传输带宽的平均值)，视频编码最大带宽值用于控制图像处理装置进行视频编码后的视频数据的传输最大带宽(即传输带宽的最大值)。本实施例中，若图像处理装置确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽。其中，视频数据的传输平均带宽与视频数据的量相关，传输平均带宽越小，意味着图像处理装置在进行视频编码时就要对视频数据做越多的压缩，处理后的视频数据的量越小，视频的质量越差。
本实施例提供的图像处理方法中，图像处理装置确定当前的网络时延；判断网络时延是否大于预置的期望时延；若确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽。本实施例可以在网络时延大于期望时延时，降低处理后的视频数据的传输平均带宽，以实现视频数据的压缩，降低处理后的视频的质量，减少网络传输的数据量，达到减小网络时延的目的。与现有技术中以降低帧率为代价来换取网络流量的自适应能力相比，本实施例提供的方法无需降低帧率，在需要高帧率、高流畅度的场景下不会造成服务卡顿，适宜应用在视频、游戏等需要高帧率、高流畅度的场 景中。
图2所示的实施例提供了一种图像处理方法，用于在网络延时较大，且图像处理装置处于带宽控制模式时，通过减小视频编码平均带宽值来减小网络时延。但是图2所示的实施例中提到，带宽控制模式还包括参数视频编码最大带宽值，用于控制处理后的视频数据的传输最大带宽。为了获得更好的减小网络时延的效果，步骤203中，图像处理装置还可以减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽。而视频数据的传输最大带宽的降低，意味着传输带宽的瞬时峰值也被降低，这样有利于进一步的降低视频编码后的传输平均带宽，可以更好的减小网络时延。
在实际应用中，图像处理装置一般不仅包括带宽控制模式，也包括质量控制模式。与带宽控制模式以视频数据的传输带宽大小为控制标准不同，质量控制模式以处理后的视频的质量为控制标准。本发明还提供了另一种图像处理方法，不仅可以用于带宽控制模式，还可以用于质量控制模式，请参阅图3，其基本流程包括：
301、图像处理装置确定当前的网络时延；
302、图像处理装置判断网络时延是否大于预置的期望时延；
步骤301、302与步骤201、202基本相同，此处不做赘述。
本实施例中，图像处理装置用于处理视频数据，图像处理装置的工作模式包括带宽控制模式和质量控制模式。带宽控制模式用于控制编码后的视频数据的传输带宽，适用于网络带宽有限的场景下；质量控制模式用于控制编码后的视频的质量，适用于对视频质量有要求的场景下。本实施例中，若图像处理装置确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则触发步骤303的操作；若图像处理装置确定网络时延大于期望时延，且图像处理装置当前处于质量控制模式，则触发步骤304的操作。
303、图像处理装置减小视频编码平均带宽值；
步骤303与步骤203基本相同，此处不做赘述。
304、图像处理装置增大视频平均质量系数。
图像处理装置在质量控制模式下进行视频编码时，具有参数视频平均质量系数、视频最差质量系数、和视频编码最大带宽值。其中，其中，视频平均质量系数用于控制视频编码后的视频数据的峰值信噪比(PSNR，Peak Signal to Noise Ratio)的最大值，视频平均质量系数越大，视频编码后的 视频数据的PSNR的最大值越小；视频最差质量系数用于控制视频编码后的视频数据的PSNR的最小值，视频最差质量系数越大，视频编码后的视频数据的PSNR越小。视频编码后的视频数据的PSNR处于该最大值与最小值之间，因此不论是降低该最大值还是最小值，都有利于降低视频编码后的视频数据的PSNR，使得视频质量变差。因此可以理解的，增大视频平均质量系数、和/或增大视频最差质量系数、和/或减小视频编码最大带宽值，都可以降低视频质量，以达到减小网络时延的效果。本实施例中，若图像处理装置确定网络时延大于期望时延，且图像处理装置当前处于质量控制模式，则图像处理装置增大视频平均质量系数。
本实施例提供的图像处理方法中，图像处理装置确定当前的网络时延；判断网络时延是否大于预置的期望时延；若确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽；若确定网络时延大于期望时延，且图像处理装置当前处于质量控制模式，则图像处理装置增大视频平均质量系数，以降低视频编码后的视频数据的PSNR的最大值。本实施例可以在网络时延大于期望时延时，降低处理后的视频数据的传输平均带宽或视频平均质量系数，以实现视频数据的压缩，降低处理后的视频的质量，减少网络传输的数据量，达到减小网络时延的目的。与现有技术中以降低帧率为代价来换取网络流量的自适应能力相比，本实施例提供的方法无需降低帧率，在需要高帧率、高流畅度的场景下不会造成服务卡顿，适宜应用在视频、游戏等需要高帧率、高流畅度的场景中。
可以理解的，步骤303中图像处理装置还可以减小视频编码最大带宽值；步骤304中图像处理装置还可以增大视频最差质量系数和/或减小视频编码最大带宽值，同样可以达到减小网络时延的效果，此处不做赘述。
图2与图3的实施例提供的方法可以在网络时延大于期望时延时，通过视频编码的参数的调节来降低视频质量，达到减小时延的目的。可以理解的，在网络时延不大于期望时延时，可以通过视频编码的参数的调节来提升视频质量，进而提升用户的视觉体验。具体的，若图像处理装置确定网络时延不大于期望时延，且图像处理装置当前处于带宽控制模式，则图像处理装置增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，图像处理装置增大视频编码最大带宽值，以提升处理后的视频数据的传输最 大带宽。若图像处理装置确定网络时延不大于期望时延，且图像处理装置当前处于质量控制模式，则图像处理装置减小视频平均质量系数，以提升处理后的视频数据的PSNR的最大值；和/或，图像处理装置减小视频最差质量系数，以提升处理后的视频数据的PSNR的最小值；和/或，图像处理装置增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
本发明实施例中，图像处理装置在进行视频编码时，视频编码的参数包括视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、与视频最差质量系数。优选的，图像处理装置可以配置有视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、与视频最差质量系数的取值范围，图像处理装置对视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、和/或所述视频最差质量系数的操作应不超出该取值范围。
可以理解的，视频的质量不需要无限提升，只需要满足用户的正常使用需求即可。例如，当视频数据的PSNR达到45以上时，人的肉眼很难再分辨出视频的质量的差别，因此视频数据的PSNR只需要达到45即可。因此优选的，本实施例中，图像处理装置可以配置有视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、与视频最差质量系数这些参数的最优值，这些最优值为使得视频的质量恰好能够满足用户的正常使用需求时，视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、与视频最差质量系数这些参数的取值。当网络时延不大于期望时延，图像处理装置通过视频编码的参数的调节来提升视频质量时，具体的，图像处理装置缩小视频编码的参数与这些参数的最优值之间的差值，当视频编码的参数达到最优值时，图像处理装置停止对视频编码的参数的调节。这样使得视频的质量不会被无限提升，避免了无意义的视频质量的提升造成的网络时延的增大。
一般的，图像处理装置不仅可以用于处理视频数据，还可以用于处理图片数据。图像处理装置在处理图片数据的时候具有参数边缘强度阈值和/或图片质量系数，其中边缘强度阈值用于在图像复杂度识别时，控制图片数据中有损压缩的图片数据(即被确认为复杂图片的图片数据)与无损压缩的图片数据(即被确认为简单图片的图片数据)的比例，边缘强度阈值的值越大，有损压缩的图片数据与无损压缩的图片数据的比例越高，被压缩的图片数据越多，压缩后的图片的质量越差，越有利于减小网络时延；图片质量系数用于控制复杂图片的数据在有损压缩过程中的压缩比，图片质量系数越小，图 片数据有损压缩过程中的压缩比越大，被压缩的图片数据越多，压缩后的图片的质量越差，越有利于减小网络时延。因此优选的，在图2或图3所示的实施例中，当图像处理装置确定网络时延大于期望时延时，图像处理装置可以增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，和/或图像处理装置减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比；当图像处理装置确定网络时延不大于期望时延时，图像处理装置减小边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，和/或，图像处理装置增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。通过这样的方法，使得当网络时延大于期望时延时，可以通过降低图片质量来减小网络时延，当网络时延不大于期望时延时，可以提升图片质量。
优选的，图像处理装置也可以配置有边缘强度阈值和图片质量系数的取值范围，图像处理装置对边缘强度阈值和/或图片质量系数的操作应不超出该取值范围。
可以理解的，图像处理装置还可以配置有边缘强度阈值和图片质量系数的最优值，当网络时延不大于期望时延时，图像处理装置缩小边缘强度阈值和图片质量系数与最优值之间的差值，当边缘强度阈值和图片质量系数达到最优值时，图像处理装置停止对边缘强度阈值和图片质量系数的调节。这样使得图片的质量不会被无限提升，避免了无意义的图片质量的提升造成的网络时延的增大。
本发明还提供了视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、视频最差质量系数、边缘强度阈值、图片质量系数这些参数的取值范围与调节是的增步长与减步长的经验值，以作为本发明实施例提供的方法中各参数的取值的参考，请参阅表1。
Figure PCTCN2015089800-appb-000001
Figure PCTCN2015089800-appb-000002
表1
上面的实施例详细解释了本发明实施例提供的图像处理方法的基本流程，下面将以一个具体的应用场景为例进行描述。
图像处理装置确定当前的网络时延为0.2s。
预置的期望时延为0.1s。图像处理装置确定网络时延大于期望时延。
图像处理装置当前处于带宽控制模式以进行视频编码，图像处理装置调节视频编码过程所用到的参数，具体的，将视频编码平均带宽值从15000000减小到10000000，将视频编码最大带宽值从20000000减小到15000000；图像处理装置还调节图片复杂度识别过程所用到的参数边缘强度阈值，将边缘强度阈值从100调节到105；图像处理装置还调节复杂图片有损压缩时所用到的参数图片质量系数，将图片质量系数从80调节到78。
图像处理装置通过上述调节，使得视频编码后的视频数据的PSNR得到降低，图片数据中有损压缩的图片数据与无损压缩的图片数据的比例变高，复杂图片数据的有损压缩的压缩比增大，视频与图片的质量都变差，网络时延减小到0.05s。
本发明实施例还提供了一种图像处理装置，用于实现上面的实施例提供的图像处理方法。其基本结构请参阅图4，包括：
时延计算模块401，用于确定当前的网络时延；
时延判断模块402，用于判断网络时延是否大于预置的期望时延；
视频调节模块403，用于当时延判断模块402确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式时，减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，该视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。
本实施例提供的图像处理装置中，时延计算模块401确定当前的网络时延；时延判断模块402判断网络时延是否大于预置的期望时延；若确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则视频调节模块403减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽。本实施例可以在网络时延大于期望时延时，降低处理后的视频数据的传输平 均带宽，以实现视频数据的压缩，降低处理后的视频的质量，减少网络传输的数据量，达到减小网络时延的目的。与现有技术中以降低帧率为代价来换取网络流量的自适应能力相比，本实施例提供的装置无需降低帧率，在需要高帧率、高流畅度的场景下不会造成服务卡顿，适宜应用在视频、游戏等需要高帧率、高流畅度的场景中。
优选的，作为本发明的又一个实施例，视频调节模块403还用于：
当时延判断模块402确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式时，减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，该视频编码最大带宽值用于控制处理后的视频数据的传输最大带宽。视频数据的传输最大带宽的降低，意味着传输带宽的瞬时峰值也被降低，这样有利于进一步的降低视频编码后的传输平均带宽，可以更好的减小网络时延。
优选的，作为本发明的又一个实施例，视频调节模块403还用于：
当时延判断模块402确定网络时延大于期望时延，且图像处理装置当前处于质量控制模式时，增大视频平均质量系数，以降低处理后的视频数据的峰值信噪比PSNR的最大值；和/或，增大视频最差质量系数，以降低处理后的视频数据的PSNR的最小值；和/或，减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，该视频平均质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最大值，该视频最差质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最小值。本实施例可以在网络时延大于期望时延时，实现视频数据的压缩，降低处理后的视频的质量，减少网络传输的数据量，达到减小网络时延的目的。与现有技术中以降低帧率为代价来换取网络流量的自适应能力相比，本实施例提供的方法无需降低帧率，在需要高帧率、高流畅度的场景下不会造成服务卡顿，适宜应用在视频、游戏等需要高帧率、高流畅度的场景中。
优选的，作为本发明的又一个实施例，视频调节模块403还用于：
当时延判断模块402确定网络时延不大于期望时延，且图像处理装置当前处于带宽控制模式时，增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽；
当时延判断模块402确定网络时延不大于期望时延，且图像处理装置当 前处于质量控制模式时，减小视频平均质量系数，以提升处理后的视频数据的PSNR的最大值；和/或，减小视频最差质量系数，以提升处理后的视频数据的PSNR的最小值；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
优选的，图像处理装置配置有视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、与视频最差质量系数的取值范围，视频调节模块对视频编码平均带宽值、视频编码最大带宽值、视频平均质量系数、和/或视频最差质量系数的增大和/或减小操作不超出该取值范围。
本发明实施例在图4所示的实施例的基础上还提供了一种图像处理装置，不仅可以用于处理视频数据，还可以用于处理图片数据。请参阅图5，其基本结构包括时延计算模块501、时延判断模块502和视频调节模块503，模块501至503与模块401至403基本相同，此处不做赘述。
本实施例中，图像处理装置还包括：
图片调节模块504，用于当时延判断模块502确定网络时延大于期望时延时，增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，该边缘强度阈值用于控制图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例；当时延判断模块502确定网络时延不大于期望时延时，减小边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例。
本实施例提供的图像处理装置中，时延计算模块501确定当前的网络时延；时延判断模块502判断网络时延是否大于预置的期望时延；若确定网络时延大于期望时延，且图像处理装置当前处于带宽控制模式，则视频调节模块503通过调节视频编码平均带宽值、和/或视频编码最大带宽值、和/或视频平均质量系数、和/或视频最差质量系数，降低视频编码后视频的质量；图片调节模块504增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，使得更多的图片数据进行了有损压缩，导致压缩后的图片质量变差。本实施例可以在网络时延大于期望时延时，进一步压缩视频数据与图片数据，以降低处理后的视频和图片的质量，减少网络传输的数据量，进而达到减小网络时延的目的。与现有技术中以降低帧率为代价来换取网络流量的自适应能力相比，本实施例提供的装置无需降低帧率，在需要高帧率、高流畅度的场景下不会造成服务卡顿，适宜应用在视频、 游戏等需要高帧率、高流畅度的场景中。
图像处理装置在处理图片数据的时候不仅具有参数边缘强度阈值，一般还具有图片质量系数。图片质量系数用于控制复杂图片的数据在有损压缩过程中的压缩比，图片质量系数越小，图片数据有损压缩过程中的压缩比越大，被压缩的图片数据越多，压缩后的图片的质量越差，越有利于减小网络时延。因此优选的，作为本发明的又一个实施例，图5中图片调节模块504还用于：
当时延判断模块502确定网络时延大于期望时延时，减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比，图片质量系数用于控制图像处理过程中图片数据的有损压缩的压缩比；当图像处理装置确定网络时延部大于所述期望时延时，增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。
上面的实施例详细解释了本发明实施例提供的图像处理装置的基本结构，下面将以一个具体的应用场景为例进行描述。
时延计算模块501确定当前的网络时延为0.2s。
预置的期望时延为0.1s。时延判断模块502确定网络时延大于期望时延。
图像处理装置当前处于带宽控制模式以进行视频编码，视频调节模块503调节视频编码过程所用到的参数，具体的，将视频编码平均带宽值从15000000减小到10000000，将视频编码最大带宽值从20000000减小到15000000；图片调节模块504调节图片复杂度识别过程所用到的参数边缘强度阈值，将边缘强度阈值从100调节到105；图片调节模块504还调节复杂图片有损压缩时所用到的参数图片质量系数，将图片质量系数从80调节到78。
图像处理装置通过上述调节，使得视频编码后的视频数据的PSNR得到降低，图片数据中有损压缩的图片数据与无损压缩的图片数据的比例变高，复杂图片数据的有损压缩的压缩比增大，视频与图片的质量都变差，网络时延减小到0.05s。
上面从单元化功能实体的角度对本发明实施例中的图像处理装置进行了描述，下面从硬件处理的角度对本发明实施例中的图像处理装置进行描述，请参阅图6，本发明实施例中的图像处理装置600另一实施例包括：
输入装置601、输出装置602、处理器603和存储器604(其中图像处理装置600中的处理器603的数量可以一个或多个，图6中以一个处理器603 为例)。在本发明的一些实施例中，输入装置601、输出装置602、处理器603和存储器604可通过总线或其它方式连接，其中，图6中以通过总线连接为例。
其中，通过调用存储器604存储的操作指令，处理器603用于执行如下步骤：
确定当前的网络时延；
判断所述网络时延是否大于预置的期望时延；
若确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，所述视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。
本发明的一些实施例中，若确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则处理器603还执行如下步骤：
减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频编码最大带宽值用于控制处理后的视频数据的传输最大带宽。
本发明的一些实施例中，处理器603还执行如下步骤：
若确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于质量控制模式，则增大视频平均质量系数，以降低处理后的视频数据的峰值信噪比PSNR的最大值；和/或，增大视频最差质量系数，以降低处理后的视频数据的PSNR的最小值；和/或，减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频平均质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最大值，所述视频最差质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最小值。
本发明的一些实施例中，处理器603还执行如下步骤：
若确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽；
若确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于质量控制模式，则减小视频平均质量系数，以提升处理后的视频数据的PSNR的最大值；和/或，减小视频最差质量系数，以提升处理后的视频数据 的PSNR的最小值；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
本发明的一些实施例中，处理器603配置有所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、与所述视频最差质量系数的取值范围，处理器603对所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、和/或所述视频最差质量系数的增大和/或减小操作不超出所述取值范围。
本发明的一些实施例中，处理器603还执行如下步骤：
若确定所述网络时延大于所述期望时延，则增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，所述边缘强度阈值用于控制图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例；
若确定所述网络时延不大于所述期望时延，则减小所述边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例。
本发明的一些实施例中，处理器603还执行如下步骤：
若确定所述网络时延大于所述期望时延，则减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比，所述图片质量系数用于控制图像处理过程中图片数据的有损压缩的压缩比；
若确定所述网络时延部大于所述期望时延，则增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作 为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (14)

  1. 一种图像处理方法，适用于图像处理装置，其特征在于，所述图像处理装置用于处理视频数据，所述图像处理装置的工作模式包括带宽控制模式，所述方法包括：
    图像处理装置确定当前的网络时延；
    所述图像处理装置判断所述网络时延是否大于预置的期望时延；
    若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述图像处理装置减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，所述视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。
  2. 根据权利要求1所述的图像处理方法，其特征在于，若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述方法还包括：
    所述图像处理装置减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频编码最大带宽值用于控制处理后的视频数据的传输最大带宽。
  3. 根据权利要求2所述的图像处理方法，其特征在于，所述图像处理装置的工作模式还包括质量控制模式，所述方法还包括：
    若所述图像处理装置确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于质量控制模式，则所述图像处理装置增大视频平均质量系数，以降低处理后的视频数据的峰值信噪比PSNR的最大值；和/或，所述图像处理装置增大视频最差质量系数，以降低处理后的视频数据的PSNR的最小值；和/或，所述图像处理装置减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频平均质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最大值，所述视频最差质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最小值。
  4. 根据权利要求1至3中任一项所述的图像处理方法，其特征在于，所述方法还包括：
    若所述图像处理装置确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于带宽控制模式，则所述图像处理装置增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，所述图像处理 装置增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽；
    若所述图像处理装置确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于质量控制模式，则所述图像处理装置减小视频平均质量系数，以提升处理后的视频数据的PSNR的最大值；和/或，所述图像处理装置减小视频最差质量系数，以提升处理后的视频数据的PSNR的最小值；和/或，所述图像处理装置增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
  5. 根据权利要求4所述的图像处理方法，其特征在于，所述图像处理装置配置有所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、与所述视频最差质量系数的取值范围，所述图像处理装置对所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、和/或所述视频最差质量系数的增大和/或减小操作不超出所述取值范围。
  6. 根据权利要求4或5所述的图像处理方法，其特征在于，所述图像处理装置还用于处理图片数据，所述方法还包括：
    若所述图像处理装置确定所述网络时延大于所述期望时延，则所述图像处理装置增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，所述边缘强度阈值用于控制图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例；
    若所述图像处理装置确定所述网络时延不大于所述期望时延，则所述图像处理装置减小所述边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例。
  7. 根据权利要求6所述的图像处理方法，其特征在于，所述方法还包括：
    若所述图像处理装置确定所述网络时延大于所述期望时延，则所述图像处理装置减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比，所述图片质量系数用于控制图像处理过程中图片数据的有损压缩的压缩比；
    若所述图像处理装置确定所述网络时延部大于所述期望时延，则所述图像处理装置增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。
  8. 一种图像处理装置，其特征在于，所述图像处理装置用于处理视频数据，所述图像处理装置的工作模式包括带宽控制模式，所述图像处理装置包括：
    时延计算模块，用于确定当前的网络时延；
    时延判断模块，用于判断所述网络时延是否大于预置的期望时延；
    视频调节模块，用于当所述时延判断模块确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式时，减小视频编码平均带宽值，以降低处理后的视频数据的传输平均带宽，所述视频编码平均带宽值用于在带宽控制模式下控制处理后的视频数据的传输平均带宽。
  9. 根据权利要求8所述的图像处理装置，其特征在于，当所述时延判断模块确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于带宽控制模式时，则所述视频调节模块还用于：
    减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频编码最大带宽值用于控制处理后的视频数据的传输最大带宽。
  10. 根据权利要求9所述的图像处理装置，其特征在于，所述图像处理装置的工作模式包括带宽控制模式，所述视频调节模块还用于：
    当所述时延判断模块确定所述网络时延大于所述期望时延，且所述图像处理装置当前处于质量控制模式时，增大视频平均质量系数，以降低处理后的视频数据的峰值信噪比PSNR的最大值；和/或，增大视频最差质量系数，以降低处理后的视频数据的PSNR的最小值；和/或，减小视频编码最大带宽值，以降低处理后的视频数据的传输最大带宽，所述视频平均质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最大值，所述视频最差质量系数用于在质量控制模式下控制处理后的视频数据的PSNR的最小值。
  11. 根据权利要求8至10中任一项所述的图像处理装置，其特征在于，所述视频调节模块还用于：
    当所述时延判断模块确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于带宽控制模式时，增大视频编码平均带宽值，以提升处理后的视频数据的传输平均带宽；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽；
    当所述时延判断模块确定所述网络时延不大于所述期望时延，且所述图像处理装置当前处于质量控制模式时，减小视频平均质量系数，以提升处理 后的视频数据的PSNR的最大值；和/或，减小视频最差质量系数，以提升处理后的视频数据的PSNR的最小值；和/或，增大视频编码最大带宽值，以提升处理后的视频数据的传输最大带宽。
  12. 根据权利要求11所述的图像处理装置，其特征在于，所述图像处理装置配置有所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、与所述视频最差质量系数的取值范围，所述视频调节模块对所述视频编码平均带宽值、所述视频编码最大带宽值、所述视频平均质量系数、和/或所述视频最差质量系数的增大和/或减小操作不超出所述取值范围。
  13. 根据权利要求11或12所述的图像处理装置，其特征在于，所述图像处理装置还用于处理图片数据，所述装置还包括：
    图片调节模块，用于当所述时延判断模块确定所述网络时延大于所述期望时延时，增大边缘强度阈值，以提升图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例，所述边缘强度阈值用于控制图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例；当所述时延判断模块确定所述网络时延不大于所述期望时延时，减小所述边缘强度阈值，以降低图像处理过程中有损压缩的图片数据与无损压缩的图片数据的比例。
  14. 根据权利要求13所述的图像处理方法，其特征在于，所述图片调节模块还用于：
    当所述时延判断模块确定所述网络时延大于所述期望时延时，减小图片质量系数，以增大图像处理过程中图片数据的有损压缩的压缩比，所述图片质量系数用于控制图像处理过程中图片数据的有损压缩的压缩比；当所述图像处理装置确定所述网络时延不大于所述期望时延时，增大图片质量系数，以降低图像处理过程中图片数据的有损压缩的压缩比。
PCT/CN2015/089800 2014-12-30 2015-09-16 一种图像处理方法与装置 WO2016107215A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410841944.1 2014-12-30
CN201410841944.1A CN105812837A (zh) 2014-12-30 2014-12-30 一种图像处理方法与装置

Publications (1)

Publication Number Publication Date
WO2016107215A1 true WO2016107215A1 (zh) 2016-07-07

Family

ID=56284136

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/089800 WO2016107215A1 (zh) 2014-12-30 2015-09-16 一种图像处理方法与装置

Country Status (2)

Country Link
CN (1) CN105812837A (zh)
WO (1) WO2016107215A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109257647A (zh) * 2018-10-31 2019-01-22 南昌努比亚技术有限公司 视频图像补偿方法、移动终端及可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101621681A (zh) * 2009-07-30 2010-01-06 腾讯科技（深圳）有限公司 一种调节视频通信质量的方法和设备
CN101765000A (zh) * 2009-11-27 2010-06-30 广东亿迅科技有限公司 基于移动网络的车载视频监控系统的实现方法
CN101800697A (zh) * 2010-01-27 2010-08-11 深圳市宇速科技有限公司 一种自适应网络带宽实时视频传输方法
CN102378003A (zh) * 2010-08-12 2012-03-14 索尼公司 信息处理装置和方法以及程序
CN103929654A (zh) * 2013-01-11 2014-07-16 浙江大华技术股份有限公司 一种图像数据处理方法及装置
JP2014187448A (ja) * 2013-03-22 2014-10-02 Fujitsu Ltd 映像配信システム及びデコーダ並びに映像配信方法

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100540655B1 (ko) * 2003-01-23 2006-01-10 삼성전자주식회사 비디오 코딩시의 비트율 제어 방법 및 장치
CN100588249C (zh) * 2006-07-27 2010-02-03 腾讯科技（深圳）有限公司 调节视频质量的方法、系统及终端
WO2011150654A1 (zh) * 2010-12-31 2011-12-08 华为技术有限公司 视频质量的评估方法、终端、服务器及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101621681A (zh) * 2009-07-30 2010-01-06 腾讯科技（深圳）有限公司 一种调节视频通信质量的方法和设备
CN101765000A (zh) * 2009-11-27 2010-06-30 广东亿迅科技有限公司 基于移动网络的车载视频监控系统的实现方法
CN101800697A (zh) * 2010-01-27 2010-08-11 深圳市宇速科技有限公司 一种自适应网络带宽实时视频传输方法
CN102378003A (zh) * 2010-08-12 2012-03-14 索尼公司 信息处理装置和方法以及程序
CN103929654A (zh) * 2013-01-11 2014-07-16 浙江大华技术股份有限公司 一种图像数据处理方法及装置
JP2014187448A (ja) * 2013-03-22 2014-10-02 Fujitsu Ltd 映像配信システム及びデコーダ並びに映像配信方法

Also Published As

Publication number Publication date
CN105812837A (zh) 2016-07-27

Similar Documents

Publication Publication Date Title
US11792451B2 (en) Method and system for low latency high frame rate streaming
WO2017080214A1 (zh) 视频清晰度自适应调节方法、装置与终端设备、存储介质
WO2017219896A1 (zh) 视频流的传输方法及装置
WO2016050145A1 (zh) 编码参数调整方法及装置
US20140292751A1 (en) Rate control bit allocation for video streaming based on an attention area of a gamer
TWI743919B (zh) 視訊處理裝置及視訊串流的處理方法
CN110149555B (zh) 视频处理方法和视频接收装置
US10834405B2 (en) Bit rate allocation method and device, and storage medium
US11197051B2 (en) Systems and methods for achieving optimal network bitrate
CN103096084A (zh) 一种无线传输中码率自适应调节的方法、装置及系统
TWI497986B (zh) 具畫面品質調整功能之影像傳輸方法以及系統
KR102131745B1 (ko) 3d 이미지 시퀀스의 처리
WO2021129007A1 (zh) 视频码率的确定方法、装置、计算机设备及存储介质
CN105812711A (zh) 视频通话过程中优化图像质量的方法及系统
KR20150062745A (ko) 가상화 서비스 장치 및 방법
WO2020107971A1 (zh) 视频增强控制方法、装置、电子设备及存储介质
WO2020244328A1 (zh) 图像处理方法及装置
CN113411643A (zh) 一种视频质量优化方法、系统、电子设备及存储介质
CN111970565A (zh) 视频数据处理方法、装置、电子设备及存储介质
US11212537B2 (en) Side information for video data transmission
WO2016107215A1 (zh) 一种图像处理方法与装置
TWI586175B (zh) 視訊會議頻寬管理方法及系統
US11164545B2 (en) Compression of display data
CN112422967B (zh) 视频的编码方法及装置、存储介质、电子设备
US20230396766A1 (en) Content-adaptive signal-to noise-ratio-guided two-pass video encoding for cloud gaming

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15874901

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15874901

Country of ref document: EP

Kind code of ref document: A1