WO2016023158A1 - Video transmission method and device - Google Patents

Video transmission method and device Download PDF

Info

Publication number
WO2016023158A1
WO2016023158A1 PCT/CN2014/084108 CN2014084108W WO2016023158A1 WO 2016023158 A1 WO2016023158 A1 WO 2016023158A1 CN 2014084108 W CN2014084108 W CN 2014084108W WO 2016023158 A1 WO2016023158 A1 WO 2016023158A1
Authority
WO
WIPO (PCT)
Prior art keywords
code rate
video
reference code
rates
score
Prior art date
Application number
PCT/CN2014/084108
Other languages
French (fr)
Chinese (zh)
Inventor
王飞
韩广林
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201480035791.XA priority Critical patent/CN106464981B/en
Priority to PCT/CN2014/084108 priority patent/WO2016023158A1/en
Publication of WO2016023158A1 publication Critical patent/WO2016023158A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless

Definitions

  • the present invention relates to the field of mobile communications technologies, and in particular, to a video transmission method and apparatus. Background technique
  • the solution provided by the prior art includes: application HAS (HTTP Adaptive Streaming) technology can select the code rate of a video segment to be transmitted according to channel conditions, so that there is no long delay in video playback. Rushing, enabling users to get a better viewing experience.
  • the HAS technology implementation method includes: (1) segmenting the video to be encoded to obtain a plurality of video segments. (2) Each video segment is encoded based on a plurality of code rates specified by the vendor to obtain a video version of a plurality of code rates corresponding to each video segment.
  • the prior art proposes that when encoding a video segment, the video segment is encoded according to only a plurality of code rates specified by the video operator, such as If the vendor specifies four code rates such as 100k, 300k, 500k and 700k, the video fragments of the above four code rates are stored on the server. At this time, the terminal requests In the case of line video transmission, if the transmission condition of the terminal allows transmission of a video segment below 500k code rate, the server will select a video segment of 300k code rate from the above four code rates for transmission.
  • the embodiment of the present invention provides a video transmission method and apparatus.
  • the technical solution is as follows:
  • a video transmission apparatus comprising:
  • a code rate determining module configured to obtain video information of the video to be encoded and network transmission conditions, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate; Determining, according to the historical play score and the preset gradient value of the second code rate, a number of code rate levels of the reference code rate; a reference code rate obtaining module, configured to perform, according to the code rate level of the first code rate and the first code rate a second code rate and a code rate level of the second code rate, to obtain a plurality of reference code rates of the to-be-coded video, and a video coding module, configured to encode the to-be-coded video according to the multiple reference code rates a video transmission module, configured to perform video transmission based on a video segment of a plurality of reference code rates obtained by encoding.
  • the code rate level number determining module includes:
  • a difference calculation unit configured to calculate a difference between a preset score and a historical play score of the second code rate
  • a score interval determining unit configured to divide the difference according to the preset gradient to obtain a plurality of score intervals
  • the code rate level number determining unit is configured to use the number of the obtained score sections as the number of code rate levels of the reference code rate.
  • the reference code rate obtaining module includes: a code rate level determining unit, configured to determine a code rate level of the first code rate according to a number of code rate levels of the reference code rate; a correspondence determining unit, configured to use, according to the first code rate, the first code rate a code rate level, the second code rate, a code rate level of the second code rate, determining an index correspondence relationship between a code rate level and a code rate; a reference code rate obtaining unit, configured to use the index correspondence relationship and the reference A code rate level of the code rate, and obtaining a plurality of reference code rates of the video to be encoded.
  • the reference code rate obtaining module includes:
  • the preset formula is: y Ddn ⁇ ⁇ —ra ⁇ + b ; where y is the code rate level, Vide0 _ mte is the reference code rate, and ⁇ is the first constant, which is the second constant.
  • the video transmission module includes:
  • a first video segment transmission unit configured to: transmit, according to a transmission request of the terminal to the encoded video, a first video segment, where the first video segment is a first reference code rate; and a transmission condition determining unit, configured to use the first video segment Transmitting to detect, determining a current transmission condition of the terminal; a second video segment determining unit, configured to determine a second reference code rate from the plurality of reference code rates of the encoded video, the second reference code rate and the terminal current The transmission condition is matched; the second video segment transmission unit is configured to select a second video segment of the second reference code rate, where the second video segment is the next segment of the first video segment.
  • the first video segment is the first video segment to be transmitted in the encoded video
  • the first reference code rate is less than a code rate requested by the terminal.
  • the device further includes: a play score acquisition module, configured to obtain a play rating of the encoded video in different play scenarios.
  • the play score is used to determine a score of a plurality of reference code rates;
  • the score standard deviation calculation module is configured to calculate a score standard deviation of the plurality of reference code rates according to the scores of the plurality of reference code rates; and preferably a reference code rate selection module, And selecting a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video.
  • the score determining module is further configured to include the specified video segment in the encoded video played in the first scenario And playing the score in the first scene as a score of a reference code rate corresponding to the specified video segment, where the specified video segment is a video segment having the same reference code rate, and the number of the specified video segments is greater than a preset number.
  • the preferred reference rate selection module includes:
  • a correlation coefficient calculation unit configured to calculate a correlation coefficient between a score of the plurality of reference code rates and a quality evaluation value of the played video
  • a specified code rate selection unit configured to select a specified code from the plurality of reference code rates Rate, the standard deviation of the corresponding code rate corresponding to the specified code rate is smaller than the first preset threshold, and the correlation coefficient corresponding to the specified code rate is the maximum value of the correlation coefficients corresponding to the multiple reference code rates; , for using the specified code rate as the preferred reference code rate.
  • a video transmission method includes:
  • determining a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate including:
  • the gradient is divided to obtain a plurality of scoring intervals; the number of the obtained scoring intervals is taken as the number of code rate levels of the reference code rate.
  • the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate obtaining multiple reference code rates of the video to be encoded, including:
  • the first code rate, the code rate level of the first code rate, the second code rate, and the code rate of the second code rate Level determining the exponential correspondence between the code rate level and the code rate, including:
  • the preset formula is: y Ddn ⁇ ⁇ —ra ⁇ + b ; where y is the code rate level, Vide0 _ mte is the reference code rate, and ⁇ is the first constant, which is the second constant.
  • the video transmission is performed based on the obtained video segments of the multiple reference code rates, including:
  • Transmitting a first video segment according to a transmission request of the terminal to the encoded video the first video segment is a first reference code rate; detecting transmission of the first video segment, determining a current transmission condition of the terminal; from the encoded video a plurality of reference code rates, determining a second reference code rate, the second reference code rate matching a current transmission condition of the terminal; selecting a second video segment of the second reference code rate for transmission, the second video segment Is the next segment of the first video segment.
  • the method further includes:
  • the scores for multiple reference bit rates include:
  • the play score in the first scenario is used as a score of the reference code rate corresponding to the specified video segment, and the specified video segment has the same reference code rate.
  • Video clip, and the number of the specified video clips is greater than a preset number.
  • the standard value of the score of the multiple reference code rates and the quality evaluation value of the played video are Selecting a preferred reference code rate from among multiple reference code rates includes:
  • Calculating a correlation coefficient between the score of the plurality of reference code rates and the quality evaluation value of the played video selecting a specified code rate from the plurality of reference code rates, the standard deviation corresponding to the specified code rate is smaller than the first pre- A threshold value is set, and a correlation coefficient corresponding to the specified code rate is a maximum value of correlation coefficients corresponding to the plurality of reference code rates; the designated code rate is used as the preferred reference code rate.
  • the invention determines the first code rate and the second code rate by acquiring video information of the video to be encoded and the network transmission condition, where the first code rate is greater than the second code rate; and the historical play score and the preset gradient value according to the second code rate Determining a number of code rate levels of the reference code rate; obtaining a plurality of reference code rates of the to-be-coded video according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate Encoding the encoded video according to multiple reference code rates; based on the encoded video fragments of multiple reference bit rates, Perform video transmission.
  • the reference code rate captured by the code can be determined according to the rating information for reflecting the user's intuitive experience of video playback, so that the coding according to the reference code rate and the video transmission are performed. , can make the transmitted video more in line with the user's actual playback needs, under the same transmission conditions, significantly improve the video playback effect.
  • FIG. 1 is a flowchart of a video transmission method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a video transmission method according to an embodiment of the present invention.
  • Figure 3 is an exponential curve relationship between the code rate level of the video and the code rate
  • FIG. 5 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present invention. detailed description
  • FIG. 1 is a flowchart of a video transmission method according to an embodiment of the present invention. Referring to Figure 1, the method flow includes:
  • determining a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate including: calculating a preset score and the second code rate The difference of the historical play scores; dividing the difference according to the preset gradient to obtain a plurality of score intervals; and using the obtained number of score intervals as the number of code rate levels of the reference code rate.
  • the plurality of to-be-encoded videos are obtained according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate.
  • a reference code rate comprising: determining a code rate level of the first code rate according to a number of code rate levels of the reference code rate; and according to the first code rate, a code rate level of the first code rate, the second code Rate, the code rate level of the second code rate, determining an exponential correspondence relationship between the code rate level and the code rate; obtaining a plurality of references of the to-be-coded video according to the index correspondence relationship and the code rate level of the reference code rate Code rate.
  • the code rate level and the code are determined according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate.
  • the video transmission is performed based on the encoded video segments of the plurality of reference code rates, including: transmitting, according to the transmission request of the terminal to the encoded video, the first video segment, the first video The segment is a first reference code rate; detecting transmission of the first video segment, determining a current transmission condition of the terminal; determining, from a plurality of reference code rates of the encoded video, the second reference code, the second reference code The rate matches the current transmission condition of the terminal; the second video segment of the second reference code rate is selected for transmission, and the second video segment is the next segment of the first video segment.
  • the first reference code rate is smaller than the code requested by the terminal. rate.
  • the method further includes: acquiring the encoded video in different playback scenarios, and determining multiple references. a score of the code rate; calculating a score standard deviation of the plurality of reference code rates according to the scores of the plurality of reference code rates; from the score standard deviation of the plurality of reference code rates and the quality evaluation value of the played video, from the A preferred reference code rate is selected among a plurality of reference code rates.
  • determining the scores of the plurality of reference code rates according to the reference code rate of each video segment included in the encoded video and the play score comprises: encoding the played when the first scene is played When a video segment is included in the video, the play score in the first scene is used as a score of a reference code rate corresponding to the specified video segment, and the specified video segment is a video segment having the same reference code rate, and the specified video segment is The number is greater than the preset number.
  • selecting a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video includes: calculating the multiple Correlation coefficient between the score of the reference code rate and the quality evaluation value of the played video; selecting a specified code rate from the plurality of reference code rates, the standard deviation corresponding to the specified code rate is less than the first preset threshold And the correlation coefficient corresponding to the specified code rate is a maximum value of the correlation coefficients corresponding to the plurality of reference code rates; the designated code rate is used as the preferred reference code rate.
  • the method provided in this embodiment determines the first code rate and the second code rate by acquiring video information of the video to be encoded and network transmission conditions, where the first code rate is greater than the second code rate; and playing the score according to the history of the second code rate And determining a number of code rate levels of the reference code rate; and obtaining a code to be encoded according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate.
  • FIG. 2 is a flowchart of a video transmission method according to an embodiment of the present invention.
  • the execution body of the method may be a video server. Referring to FIG. 2, the method flow includes:
  • the video to be encoded may be any video stored on the video server side, or may be directly obtained by the video collection device.
  • the video information refers to parameters describing the state of the video, including the resolution of the video, the format of the sample, the original rate, the frame rate, and the compression rate parameters.
  • the network transmission condition refers to the lowest transmission rate provided by the current network to the transmission service. For example, the integrated 3G network can provide a minimum transmission rate of 144 kbs for the high-speed mobile transmission service.
  • the historical play score of the video is that the video is encoded at a certain code rate, and the video coded video is played, and the user experience score obtained based on the video playback quality.
  • the video A is encoded at a code rate of 128 kbs, and the encoded video A is played, and after the playback is completed, the playback quality of the video A is scored according to the viewing experience of the plurality of users, and the obtained multiple scores are recorded, that is,
  • the multiple scores in the record are the historical play scores for the 128 kbs code rate of the video A.
  • the historical broadcast score is represented by MOS (Mean Opinion Score).
  • the first code rate is used to refer to the highest code rate of the video to be encoded.
  • the channel rate corresponding to the to-be-coded video may be determined according to the video information of the video to be encoded, and the highest code rate is the channel rate. For video with different video information, the channel rate determined according to the video information is different, so that the highest code rate corresponding to the video is also different.
  • the video with a resolution of 988*420 is taken as an example.
  • the channel rate of the video can be obtained, that is, the calculation formula is 149 Mbps/110. « 1.4Mbps, and the channel rate of the video is also the highest bit rate of the video.
  • the selection of the first code rate of the to-be-coded video is not limited to the channel rate, and a code rate slightly larger than the channel rate may be selected, so that the selection is to reserve redundancy for the code rate of the to-be-coded video. If the network conditions are extremely ideal, the video code rate can be changed in the redundant space, and the channel transmission resources can be fully utilized. For example, for a video with a resolution of 988*420 shown in Table 1, the video channel rate is 1.4 Mbps, and more than 1410 kbps may be selected as the first code rate.
  • the second code rate refers to a historical play score corresponding to the second code rate based on the network transmission condition and based on the history play score of the code rate, the lowest code rate selected for the video to be encoded.
  • the user's minimum acceptable video bit rate For example, the integrated 3G network can provide a minimum transmission rate of 144 kbs for high-speed mobile transmission services.
  • the average MOS of users with a video rate of 128 kbs is 2 points, that is, the 128 kbs code rate is considered acceptable to the user.
  • the lowest video bit rate, then the 128 kbs code rate is the lowest bit rate that can satisfy the user's viewing quality. For a bit rate less than 128 kbs, the corresponding MOS is lower, and the playback quality of the code rate video cannot satisfy the user's viewing experience, and thus the reference value is lost.
  • the preset score refers to the highest score set for a certain video playback rating. For example, if the highest score is set to 5, if a video is scored, the optional score range is 0 to 5, and if the highest score is set to 10, The video is scored, and the optional score range is 0 to 10 points. This embodiment does not specifically limit this. If the video preset score is set to 5 for a video and the historical play score of the second rate is 2, the difference is 3.
  • the difference is divided according to the preset gradient to obtain multiple score intervals.
  • the preset gradient refers to a change interval set by a historical play score of a video code rate, and the preset gradient can reflect subjective evaluation changes of different code rates.
  • the scoring interval is a MOS interval corresponding to each of the video bit rates, and different scoring intervals may reflect subjective evaluations of the user's video playback quality encoded by different code rates.
  • the difference is 3
  • the preset gradient is set to 0.5, and then divided into 0.5 for each 0.5. In the interval, you can get the six MOS intervals (2, 2.5], (2.5, 3], (3, 3.5), (3.5, 4], (4, 4.5), and (4.5, 5).
  • the number of the obtained score intervals is used as the number of code rate levels of the reference code rate.
  • each score interval corresponds to a reference code rate level
  • the number of the score intervals is the number of reference code rate levels.
  • the reference code rate refers to a video code rate corresponding to different code rate levels, that is, a code rate having a different history play score.
  • selecting different levels of reference code rates to encode the video will result in different quality videos.
  • the video transmission quality and playback quality of different effects will also be obtained. Therefore, different playback effects are generated, and accordingly, the video that the user views based on the reference code rate of different levels may also have different viewing effects.
  • each reference code rate level corresponds to a different MOS score interval, indicating that the user has a video of the video coded based on each reference code rate.
  • the subjective experience of quality, transmission quality or playback quality is different.
  • the value rate level value of the reference code rate is the highest reference code rate level, and the highest code rate level is determined as the code rate level of the first code rate.
  • the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate are substituted into a preset formula to determine the first constant and the second constant.
  • the value can be used to obtain an exponential correspondence between the determined code rate level and the code rate.
  • Figure 3 shows the exponential curve relationship between the bit rate level and the code rate of the video A.
  • the index correspondence relationship may also reflect the correspondence between the user's subjective score of the video quality and the code rate, that is, the index is adopted.
  • the correspondence can determine the video reference bit rate that meets the user's experience of video quality.
  • the code rate levels of the reference code rate are brought into the index correspondence relationship to obtain a reference code rate corresponding to the code rate level of each reference code rate, that is, the subsequent step is to encode the video based on the multiple reference code rates.
  • the reference code rate corresponding to level 1 is 128 kbs
  • the reference code rate corresponding to reference code rate level 2 is 210 kbs
  • the reference code rate corresponding to reference code rate level 3 is 350 kbs
  • the reference code rate corresponding to reference code rate level 4 is 545 kbs.
  • the reference code rate corresponding to the code rate level 5 is 876 kbs
  • the reference code rate corresponding to the reference code rate level 6 is 1410 kbs.
  • the process of encoding the video to be encoded can be implemented by the following steps (1) - (3).
  • the video A is segmented to obtain N video segments, and each video segment is encoded based on m reference code rates, to obtain m video versions corresponding to each video segment, and each will be
  • the m video versions of the video clip are stored in the server and are selected by the subsequent video transmission process.
  • the video A of the 110s duration is averaged and segmented to obtain 22 video segments of 5s duration. It is known that the video A corresponds to 6 reference code rates, and 22 video segments of 5s duration are based on 6 reference code rates.
  • the codes are separately encoded, so that the video A gets 6*22 video versions, stores the 6*22 video versions in the server and waits for subsequent transmission processing.
  • the first video segment refers to any video segment of the encoded video that the terminal currently applies for transmission, and the “first” does not specifically refer to a certain video segment.
  • the first reference code rate refers to a video version in which the first video segment is encoded based on a certain reference code rate.
  • the first video segment is the first transmitted video segment of the encoded video
  • the first reference bit rate should be smaller than the terminal device.
  • the requested code rate that is, the first reference code rate should be less than one level of the bit rate requested by the terminal, and is not an exact match.
  • the code rate can match the terminal transmission condition.
  • the first video segment transmitted in the encoded video may be the already
  • the first video clip of the encoded video may also be that the terminal requests to transmit any one of the video clips during the operation of opening the video.
  • the preset code rate may be a rate limit set by the video provider.
  • the server selects less than the preset bit rate.
  • the maximum reference code rate is transmitted as the first reference code rate.
  • the reference code rates of the six code rate levels corresponding to a video are 128 kbs, 210 kbs, 350 kbs, 545 kbs, 876 kbs, and 1410 kbs.
  • the preset code rate is set to 300 kbs, that is, the first video clip encoded by the reference code rate of 210 kbs is selected for transmission, so that the video playback quality requirement can be satisfied to some extent, and the first one can be transmitted.
  • the video clip can be downloaded quickly in the terminal to reduce the buffering time of the video download waiting, preventing frequent and excessive buffering delay in the video playback, thereby ensuring the user's viewing experience.
  • the transmission condition refers to a channel rate of data transmitted by the channel.
  • the current transmission condition of the terminal may also be determined by other calculation methods, which is not specifically limited in this embodiment.
  • the second reference code rate refers to a reference code rate suitable for the current transmission condition of the terminal, which is selected according to the current transmission condition of the terminal after the first video segment is transmitted. Under the limitation of the current transmission condition of the terminal, the highest reference code rate that meets the limit is selected as the second reference code rate for the transmission of the video segment. 212. Select a second video segment of the second reference code rate, where the second video segment is the next segment of the first video segment.
  • steps 209-212 only describe the transmission process of two video segments in the preceding and succeeding sequence, and in the transmission process of the entire video, multiple video segments need to be transmitted, and then the transmission is performed.
  • the process of multiple video segments follows the transmission method of the two video segments described in steps 209-212 in this embodiment.
  • Steps 201-212 illustrate the video transmission method.
  • the reference code rate captured by the encoding is determined, and therefore, after the encoding and video transmission according to the reference code rate, the transmitted video can be made. More in line with the user's actual playback needs, significantly improved video playback under the same transmission conditions
  • the playback scenario means that each video segment transmitted during the transmission process of the encoded video can select a different reference code rate, so that for different transmission processes of the same encoded video, the process is a Play the scene.
  • the video B is divided into six video segments, and the reference code rate includes 100 kbs, 200 kbs, 300 kbs, 400 kbs, and 500 kbs, and each video segment includes five video versions encoded based on the five reference code rates.
  • the video A may also include a play scene 2 as abcdee, a play scene 3 as aaabdc, and other play scenes.
  • the play score refers to an online play score performed by the user at the terminal after the encoded video is transmitted and played.
  • the number of playback scenes for a certain video can be determined according to the number of video segments of the video and the number of reference code rates.
  • the video is The playback scenes will not all appear, or some of the playback scenes will not appear frequently, so you can play scores only for frequently occurring playback scenes.
  • the obtained play score and the corresponding play scene are stored in the server, and are called when the preferred reference code rate is subsequently selected.
  • the play score in the first scenario is used as a score of a reference code rate corresponding to the specified video segment, and the specified video segment has the same reference.
  • a video clip of a code rate, and the number of the specified video clips is greater than a preset number.
  • the preset number may be a number set by the video provider.
  • the approximate video is considered to be And performing the transmission at the reference code rate corresponding to the specified video segment, and determining that the play score in the first scenario may represent a score of the reference code rate corresponding to the specified video segment. For example, will video
  • the reference code rate includes 100 kbs, 200 kbs, 300 kbs, 400 kbs, and 500 kbs.
  • Each video segment includes 5 video versions encoded based on the 5 reference bit rates, and the preset number is set to 3.
  • Set the flag for each reference bit rate to get the lOOkbs flag as a, the 200kbs flag as b, the 300kbs flag as c, the 400kbs flag as d, and the 500kbs flag as e. If there is a playback scene for the first video segment, select the reference bit rate.
  • the second video clip selects the reference code rate a
  • the third video clip selects the reference code rate a
  • the fourth video clip selects the reference code rate c
  • the fifth video clip selects the reference code rate a
  • the sixth video When the clip selects the reference code rate a, the play scene is also represented as aaacaa, wherein the reference code rate of the five video clips is a, which is greater than the preset number of 3, then the play score of the play scene may be considered as Refer to the score of the code rate a.
  • the scores of all the reference code rates obtained are stored in the server for later calculation of the scoring standard deviation call of the reference code rate.
  • the play scores of the six reference code rates of the video A described herein refer to the play scores obtained by transmitting and playing the video A based on the six reference code rates. For example, suppose the video A is divided into 10 video segments, each of which is encoded at the six reference code rates shown in Table 4.
  • the 128 kbs encoded video segment is selected, that is, the playback score obtained by the video A after transmission and playback is regarded as the playback score obtained by the reference rate of 128 kbs.
  • the video A is separately transmitted and played under the six reference code rates, and the play score of each reference code rate is recorded, and the play score standard deviation of each reference code rate is calculated based on the play score of each reference code rate. That is, the subjective MOS standard deviation shown in Table 4.
  • the quality evaluation value refers to an objective evaluation parameter of the played video.
  • the correlation coefficient can be calculated by the process of the following steps (1) - (3).
  • the played video is calculated based on each reference code rate dPSNR (Difference of Peak Signal to Noise Ratio).
  • dPSNR PSNR, - PSNR ( 1 )
  • the dPSNR shown in the formula (1) is a peak signal between the video segment J′ and the video reference code rate.
  • j m
  • N represents the N video segments of the video
  • i represents the first video segment in the video time direction
  • j:N represents the last video segment in the video time direction.
  • the PSN is the peak signal to noise ratio corresponding to the video segment j of the reference code rate i
  • the PSNR n is the peak signal to noise ratio corresponding to the reference code rate n.
  • the dPSNR of the played video based on each reference code rate is calculated by the formula (1).
  • ePSNR ax mean(dPSNR) + bx max(dPSNR) + cx min(dPSNR) + dx std(dPSNR) ( 2 )
  • meanWPS is the peak signal to noise ratio difference of the N video segments in the played video Mean
  • ⁇ (dPSNR is the maximum value of the peak signal-to-noise ratio difference of N video segments in the whole video
  • minW/ ⁇ WR is the peak signal-to-noise ratio difference of N video segments in the whole video. The minimum value of the value
  • ⁇ /WPSM is the standard deviation of the peak signal-to-noise ratio difference for the N video segments in the entire video, a, b, c, and ⁇ are pending coefficients.
  • MOS p x ePSNR+q ( 3 )
  • Equation (3) is the relationship between the ePSNR of the played video and the MO score corresponding to the reference code rate n, and p is the parameter to be determined. By fitting the relationship, the parameters p and q can be determined as the correlation coefficient.
  • the quality evaluation value may be an EPSNR (Evolved Peak Signal to Noise Ratio) value of the video, or may be another parameter value that can reflect the quality of the video playback.
  • EPSNR Extended Peak Signal to Noise Ratio
  • the correlation coefficient reflects the correlation between the quality evaluation value of the broadcast video and each reference code rate. The larger the correlation coefficient is, the greater the correlation between the reference code rate and the play score of the video is, that is, the selection is selected.
  • the reference bit rate for video transmission can better meet the actual playback needs of the user. As shown in FIG. 4, the correlation coefficient between the scores of the plurality of reference code rates of the video A and the quality evaluation values of the played video A is shown.
  • the specified code rate is selected from the multiple reference code rates, where the standard deviation of the corresponding code rate is smaller than the first preset threshold, and the correlation coefficient corresponding to the specified code rate is corresponding to the multiple reference code rates. The maximum value in the correlation coefficient.
  • the first preset threshold may be a value set by the video provider, and the first preset threshold is used to define a standard deviation of the reference code rate, and the preferred one is selected from the reference code rate that meets the qualified condition.
  • Reference code rate For example, for video eight, the first preset threshold is set to 0.7, if the correlation coefficient between the scores of the plurality of reference code rates of the video A and the quality evaluation value of the played video A is as shown in FIG. 4, The standard deviation of the scores of the reference codes of the video A is as shown in Table 4.
  • the reference code rate of less than 0.7 can be selected from Table 4 to be 210 kbs and 545 kbs, which can be obtained according to the figure shown in FIG. 4, and the 210 kbs reference code.
  • the correlation coefficient corresponding to the rate is 0.8846, and the correlation coefficient corresponding to the reference code rate of 545 kbs is 0.8804, and 0.8846 is greater than 0.8804, that is, 210 kbs is selected as the specified code rate.
  • the specified bit rate is more in line with the actual playback needs of the user.
  • the greater the correlation coefficient between the playback score of the reference code rate and the video quality evaluation value the closer the objective quality evaluation of the video is to the actual playback requirement of the user. Therefore, selecting the specified code rate with the correlation coefficient can be Significantly enhances video playback under the same transmission conditions.
  • the designated code rate is used as the preferred reference code rate.
  • the video is scored according to the preferred reference code rate, that is, the play score is considered to have higher accuracy in evaluating the video playback quality, and is consistent with the user viewing experience.
  • the playback of the video may be evaluated according to the preferred reference code rate, and the obtained MOS score can better reflect the subjective experience of the user.
  • the specific evaluation process refer to the descriptions of the formulas (1), (2) and (3) described above, and no further description is given here.
  • video content providers can use the above formula to evaluate video playback to improve playback strategies or network optimization to meet the user's viewing experience.
  • the method provided in this embodiment determines the first code rate and the second code rate by acquiring video information of the video to be encoded and network transmission conditions, where the first code rate is greater than the second code rate; and playing the score according to the history of the second code rate And determining a number of code rate levels of the reference code rate; and obtaining a code to be encoded according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. a plurality of reference code rates; encoding the coded video according to the plurality of reference code rates; performing video transmission based on the obtained video segments of the plurality of reference code rates.
  • FIG. 5 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present invention.
  • the apparatus includes a code rate determining module 501, a code rate level number determining module 502, a reference code rate obtaining module 503, a video encoding module 504, and a video transmission module 505.
  • the code rate determining module 501 is configured to obtain video information of the video to be encoded and network transmission conditions, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate.
  • the code rate level number determining module 502 is configured to determine a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate.
  • the reference code rate obtaining module 503 is configured to obtain multiple references of the to-be-coded video according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. Code rate.
  • the video encoding module 504 is configured to encode the to-be-coded video according to the multiple reference code rates.
  • the video transmission module 505 is configured to perform video transmission based on the video segments of the plurality of reference code rates obtained by the encoding.
  • the code rate level number determining module comprises: a difference calculation a unit, configured to calculate a difference between a preset score and a historical play score of the second code rate; a score interval determining unit configured to divide the difference according to the preset gradient to obtain a plurality of score intervals; a code rate level The number determining unit is configured to use the number of the obtained score sections as the number of code rate levels of the reference code rate.
  • the reference code rate obtaining module includes: a code rate level determining unit, configured to determine a code rate level of the first code rate according to a number of code rate levels of the reference code rate; a relationship determining unit, configured to determine an index between a code rate level and a code rate according to the first code rate, a code rate level of the first code rate, the second code rate, and a code rate level of the second code rate Corresponding relationship; the reference code rate obtaining unit is configured to obtain a plurality of reference code rates of the to-be-coded video according to the index correspondence relationship and the code rate level of the reference code rate.
  • the reference code rate obtaining module includes: a code rate according to the first code rate, the code rate level of the first code rate, the second code rate, and the second code rate.
  • Level, applying a preset formula, determining an exponential correspondence between a code rate level and a code rate; the preset formula is: y ax l ⁇ video - rate , + where , ; y is a code rate level, and video_mte is Referring to the code rate, a is the first constant and b is the second constant.
  • the video transmission module includes: a first video segment transmission unit, configured to transmit a first video segment according to a transmission request of the terminal to the encoded video, where the first video segment is the first a transmission rate determining unit, configured to detect a transmission of the first video segment, and determine a current transmission condition of the terminal; and a second video segment determining unit, configured to use, from the plurality of reference code rates of the encoded video, Determining a second reference code rate, the second reference code rate is matched with a current transmission condition of the terminal; a second video segment transmission unit, configured to select a second video segment of the second reference code rate for transmission, the second video The segment is the next segment of the first video segment.
  • the first reference code rate is smaller than the code requested by the terminal. rate.
  • the device further includes: a play score acquisition module, configured to acquire a play score of the encoded video in different play scenarios; a score determining module, configured to a reference code rate of each video segment included in the encoded video and the play score, determining a score of the plurality of reference code rates; a score standard deviation calculation module, configured to calculate the multiple references according to the scores of the plurality of reference code rates a standard deviation rate of the code rate; a preferred reference rate selection module, configured to select a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video .
  • a play score acquisition module configured to acquire a play score of the encoded video in different play scenarios
  • a score determining module configured to a reference code rate of each video segment included in the encoded video and the play score, determining a score of the plurality of reference code rates
  • a score standard deviation calculation module configured to calculate the multiple references according to the scores of the plurality of reference code rates a standard
  • the score determining module further includes: when the specified video segment is included in the encoded video played in the first scene, the play score in the first scene is corresponding to the specified video segment.
  • the score of the reference code rate, the specified video segment is a video segment having the same reference code rate, and the number of the specified video segments is greater than a preset number.
  • the preferred reference rate selection module includes: a correlation coefficient calculation unit, configured to calculate a correlation coefficient between the score of the plurality of reference code rates and the quality evaluation value of the played video; a code rate selection unit, configured to select a specified code rate from the plurality of reference code rates, where a standard deviation of the corresponding code rate is less than a first preset threshold, and the correlation coefficient corresponding to the specified code rate is more a maximum of the correlation coefficients corresponding to the reference code rate; a preferred reference code rate determining unit for using the designated code rate as the preferred reference code rate.
  • Determining a first code rate and a second code rate by acquiring video information of the video to be encoded and a network transmission condition, where the first code rate is greater than the second code rate; determining the historical play score and the preset gradient value according to the second code rate The number of code rate levels of the reference code rate; obtaining a plurality of reference code rates of the video to be encoded according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate; Multiple reference code rates, encoding the coded video; performing video transmission based on the video segments of the plurality of reference code rates obtained by the coding.
  • the reference code rate captured by the code can be determined according to the rating information for reflecting the user's intuitive experience of video playback, so that the coding according to the reference code rate and the video transmission are performed. , can make the transmitted video more in line with the user's actual playback needs, under the same transmission conditions, significantly improve the video playback effect.
  • the completion of the hardware may also be performed by a program to instruct related hardware.
  • the program may be stored in a computer readable storage medium.
  • the storage medium mentioned above may be a read only memory, a magnetic disk or an optical disk.

Abstract

The present invention relates to the technical field of mobile communications. Disclosed are a video transmission method and device, the method comprising: acquiring a video information and network transmission condition of a video to be encoded, and determining a first code rate and a second code rate; according to a historical play score and preset gradient value of the second code rate, determining a code rate level number of a reference code rate; according to the first code rate, the second code rate, and the code rate levels of the first code rate and the second code rate, acquiring a plurality of reference code rates of the video to be encoded; according to the plurality of reference code rates, encoding the video to be encoded; and based on the encoded video clip of the plurality of reference code rates, conducting video transmission. The technical solution determines, according to score information representing the intuitive experience of a user of video playing, the reference code rate employed in encoding, such that the transmitted video better satisfies an actual play requirement of the user after being encoded and transmitted according to the reference code rate, thus significantly improving the play effect of the video under the same transmission condition.

Description

视频传输方法和装置 技术领域  Video transmission method and device
本发明涉及移动通信技术领域, 特别涉及一种视频传输方法和装置。 背景技术  The present invention relates to the field of mobile communications technologies, and in particular, to a video transmission method and apparatus. Background technique
随着移动通信技术的快速发展,移动视频业务已经成为移动通信业务中的 主流。 如视频点播、 视频电话或视频彩铃等各种形式的移动视频逐渐融入人们 的日常生活。 目前, 随着各种高清、 超高清的移动视频的普及, 用户对在线视 频播放的质量也提出了更高的要求。 基于这种情况, 传统的基于 HTTP ( Hypertext transfer protocol, 超文本传输协议)的渐进下载流媒体播放方式已 经不能满足用户的需求, 因此如何提供高质量的视频传输业务, 已成为运营商 和视频提供商共同关注的焦点。  With the rapid development of mobile communication technologies, mobile video services have become the mainstream in mobile communication services. Various forms of mobile video such as video on demand, video telephony or video ring tones are gradually integrated into people's daily lives. At present, with the popularization of various high-definition and ultra-high-definition mobile videos, users have put forward higher requirements for the quality of online video playback. Based on this situation, the traditional HTTP (Hypertext Transfer Protocol)-based progressive download streaming media playback method can no longer meet the needs of users. Therefore, how to provide high-quality video transmission services has become an operator and video provider. The focus of common concern.
目前,现有技术提供的解决方案包括:应用 HAS( HTTP Adaptive Streaming, 码流自适应 )技术可以根据信道条件来选择待传输视频片段的码率, 从而使视 频播放中不会有很长的緩冲, 使得用户能获得较好的观看体验。 该 HAS技术 实现方法包括: (1 )将待编码视频进行分段处理, 得到由多个视频片段。 (2 ) 基于供应商指定的多个码率, 对每个视频片段进行编码, 得到每个视频片段对 应的多个码率的视频版本。 (3 ) 当服务器接收到对视频的传输请求时, 根据当 前终端的传输条件, 确定当前终端的传输条件下能够传输的码率, 才艮据该码率 从视频片段的多个视频版本中, 选择一个较高码率的视频版本进行传输。  At present, the solution provided by the prior art includes: application HAS (HTTP Adaptive Streaming) technology can select the code rate of a video segment to be transmitted according to channel conditions, so that there is no long delay in video playback. Rushing, enabling users to get a better viewing experience. The HAS technology implementation method includes: (1) segmenting the video to be encoded to obtain a plurality of video segments. (2) Each video segment is encoded based on a plurality of code rates specified by the vendor to obtain a video version of a plurality of code rates corresponding to each video segment. (3) when the server receives the transmission request for the video, according to the transmission condition of the current terminal, determining the code rate that can be transmitted under the transmission condition of the current terminal, according to the code rate, from the multiple video versions of the video segment, Select a higher bit rate video version for transmission.
在实现本发明的过程中, 发明人发现现有技术至少存在以下问题: 现有技术提出在对视频片段进行编码时, 由于只依据视频运营商指定的多 个码率对视频片段进行编码,如,若供应商指定了如 100k、 300k, 500k和 700k 的 4种码率, 则服务器上会存储上述 4种码率的视频片段, 此时, 终端请求进 行视频传输时, 如果终端的传输条件允许传输 500k码率以下的视频片段, 则 服务器将从上述 4种码率中, 选择 300k码率的视频片段进行传输。 然而, 从 终端的角度可以看出, 此时的信道条件实际上也允许传输 400k-500k码率的视 频片段。 在信道允许的情况下, 码率越大, 播放效果越好, 但是由于视频运营 商在编码过程中的局限性, 并没有提供相应码率的视频片段, 视频的播放效果 受到限制, 导致所提供的视频片段与用户的实际播放需求不符。 发明内容 In the process of implementing the present invention, the inventors have found that the prior art has at least the following problems: The prior art proposes that when encoding a video segment, the video segment is encoded according to only a plurality of code rates specified by the video operator, such as If the vendor specifies four code rates such as 100k, 300k, 500k and 700k, the video fragments of the above four code rates are stored on the server. At this time, the terminal requests In the case of line video transmission, if the transmission condition of the terminal allows transmission of a video segment below 500k code rate, the server will select a video segment of 300k code rate from the above four code rates for transmission. However, it can be seen from the perspective of the terminal that the channel conditions at this time actually allow transmission of video clips of 400k-500k code rate. In the case of the channel, the larger the bit rate, the better the playback effect. However, due to the limitation of the video operator in the encoding process, the video segment of the corresponding bit rate is not provided, and the video playback effect is limited, resulting in the provided The video clip does not match the user's actual playback needs. Summary of the invention
为了解决所提供的视频片段与用户的实际播放需求不符的问题, 本发明实 施例提供了一种视频传输方法和装置。 所述技术方案如下:  In order to solve the problem that the provided video clip does not match the actual playing requirement of the user, the embodiment of the present invention provides a video transmission method and apparatus. The technical solution is as follows:
第一方面, 提供了一种视频传输装置, 所述装置包括:  In a first aspect, a video transmission apparatus is provided, the apparatus comprising:
码率确定模块, 用于获取待编码视频的视频信息及网络传输条件, 确定第 一码率和第二码率, 该第一码率大于该第二码率; 码率等级数目确定模块, 用 于根据该第二码率的历史播放评分和预设梯度值,确定参考码率的码率等级数 目; 参考码率获取模块, 用于根据该第一码率、 第一码率的码率等级、 该第二 码率和该第二码率的码率等级, 获取该待编码视频的多个参考码率; 视频编码 模块, 用于根据该多个参考码率, 对该待编码视频进行编码; 视频传输模块, 用于基于编码得到的多个参考码率的视频片段, 进行视频传输。  a code rate determining module, configured to obtain video information of the video to be encoded and network transmission conditions, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate; Determining, according to the historical play score and the preset gradient value of the second code rate, a number of code rate levels of the reference code rate; a reference code rate obtaining module, configured to perform, according to the code rate level of the first code rate and the first code rate a second code rate and a code rate level of the second code rate, to obtain a plurality of reference code rates of the to-be-coded video, and a video coding module, configured to encode the to-be-coded video according to the multiple reference code rates a video transmission module, configured to perform video transmission based on a video segment of a plurality of reference code rates obtained by encoding.
结合第一方面, 在第一方面的第一种可能的实现方式中, 该码率等级数 目确定模块包括:  In conjunction with the first aspect, in a first possible implementation manner of the first aspect, the code rate level number determining module includes:
差值计算单元, 用于计算预设评分和该第二码率的历史播放评分的差值; 评分区间确定单元, 用于将该差值按照该预设梯度进行划分, 得到多个评分区 间; 码率等级数目确定单元, 用于将所得到的评分区间的数目作为该参考码率 的码率等级数目。  a difference calculation unit, configured to calculate a difference between a preset score and a historical play score of the second code rate; a score interval determining unit, configured to divide the difference according to the preset gradient to obtain a plurality of score intervals; The code rate level number determining unit is configured to use the number of the obtained score sections as the number of code rate levels of the reference code rate.
结合第一方面, 在第一方面的第二种可能的实现方式中, 该参考码率获取 模块包括: 码率等级确定单元, 用于根据该参考码率的码率等级数目, 确定该第一码 率的码率等级; 对应关系确定单元, 用于根据该第一码率、 该第一码率的码率 等级、 该第二码率、 该第二码率的码率等级, 确定码率等级与码率之间的指数 对应关系; 参考码率获取单元, 用于根据该指数对应关系与该参考码率的码率 等级, 获取该待编码视频的多个参考码率。 With reference to the first aspect, in a second possible implementation manner of the first aspect, the reference code rate obtaining module includes: a code rate level determining unit, configured to determine a code rate level of the first code rate according to a number of code rate levels of the reference code rate; a correspondence determining unit, configured to use, according to the first code rate, the first code rate a code rate level, the second code rate, a code rate level of the second code rate, determining an index correspondence relationship between a code rate level and a code rate; a reference code rate obtaining unit, configured to use the index correspondence relationship and the reference A code rate level of the code rate, and obtaining a plurality of reference code rates of the video to be encoded.
结合第一方面, 在第一方面的第三种可能的实现方式中, 该参考码率获取 模块包括:  With reference to the first aspect, in a third possible implementation manner of the first aspect, the reference code rate obtaining module includes:
根据该第一码率、 该第一码率的码率等级、 该第二码率、 该第二码率的码 率等级, 应用预设公式, 确定码率等级与码率之间的指数对应关系; 该预设公 式为: y Ddn^ ^—ra^ + b ; 其中, y为码率等级, Vide0_mte为参考码率, β为第一常数, 为第二常数。 Determining an index corresponding to a code rate level and a code rate according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. The preset formula is: y Ddn^ ^—ra^ + b ; where y is the code rate level, Vide0 _ mte is the reference code rate, and β is the first constant, which is the second constant.
结合第一方面, 在第一方面的第四种可能的实现方式中, 该视频传输模块 包括:  With reference to the first aspect, in a fourth possible implementation manner of the first aspect, the video transmission module includes:
第一视频片段传输单元, 用于根据终端对已编码视频的传输请求, 传输第 一视频片段, 该第一视频片段为第一参考码率; 传输条件确定单元, 用于对第 一视频片段的传输进行检测, 确定该终端当前传输条件; 第二视频片段确定单 元, 用于从该已编码视频的多个参考码率中, 确定第二参考码率, 该第二参考 码率与该终端当前传输条件相匹配; 第二视频片段传输单元, 用于选择该第二 参考码率的第二视频片段进行传输, 该第二视频片段为该第一视频片段的下一 个片段。  a first video segment transmission unit, configured to: transmit, according to a transmission request of the terminal to the encoded video, a first video segment, where the first video segment is a first reference code rate; and a transmission condition determining unit, configured to use the first video segment Transmitting to detect, determining a current transmission condition of the terminal; a second video segment determining unit, configured to determine a second reference code rate from the plurality of reference code rates of the encoded video, the second reference code rate and the terminal current The transmission condition is matched; the second video segment transmission unit is configured to select a second video segment of the second reference code rate, where the second video segment is the next segment of the first video segment.
结合第一方面的第四种可能的实现方式, 在第一方面的第五种可能的实现 方式中, 当所述第一视频片段为所述已编码视频中第一个被传输的视频片段 时, 所述第一参考码率小于所述终端所请求的码率。  In conjunction with the fourth possible implementation of the first aspect, in a fifth possible implementation manner of the first aspect, when the first video segment is the first video segment to be transmitted in the encoded video The first reference code rate is less than a code rate requested by the terminal.
结合第一方面,在第一方面的第六种可能的实现方式中,所述装置还包括: 播放评分获取模块, 用于获取该已编码视频在不同播放场景下的播放评 该播放评分, 确定多个参考码率的评分; 评分标准差计算模块, 用于根据该多 个参考码率的评分, 计算该多个参考码率的评分标准差; 优选参考码率选取模 块, 用于根据该多个参考码率的评分标准差和该已播放视频的质量评价值, 从 该多个参考码率中选取优选参考码率。 In conjunction with the first aspect, in a sixth possible implementation manner of the first aspect, the device further includes: a play score acquisition module, configured to obtain a play rating of the encoded video in different play scenarios. The play score is used to determine a score of a plurality of reference code rates; the score standard deviation calculation module is configured to calculate a score standard deviation of the plurality of reference code rates according to the scores of the plurality of reference code rates; and preferably a reference code rate selection module, And selecting a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video.
结合第一方面的第六种可能的实现方式, 在第一方面的第七种可能的实现 方式中, 该评分确定模块还用于当第一场景下所播放的已编码视频中包括指定 视频片段时, 将该第一场景下的播放评分作为该指定视频片段对应的参考码率 的评分, 该指定视频片段为具有相同参考码率的视频片段, 且该指定视频片段 的个数大于预设数目。  In conjunction with the sixth possible implementation of the first aspect, in a seventh possible implementation of the first aspect, the score determining module is further configured to include the specified video segment in the encoded video played in the first scenario And playing the score in the first scene as a score of a reference code rate corresponding to the specified video segment, where the specified video segment is a video segment having the same reference code rate, and the number of the specified video segments is greater than a preset number. .
结合第一方面的第六种可能的实现方式, 在第一方面的第八种可能的实现 方式中, 优选参考码率选取模块包括:  With reference to the sixth possible implementation of the first aspect, in an eighth possible implementation manner of the first aspect, the preferred reference rate selection module includes:
相关系数计算单元, 用于计算该多个参考码率的评分和该已播放视频的质 量评价值之间的相关系数; 指定码率选取单元, 用于从该多个参考码率中选取 指定码率, 该指定码率对应的评分标准差小于第一预设阔值, 且该指定码率对 应的相关系数为该多个参考码率对应的相关系数中的最大值; 优选参考码率确 定单元, 用于将该指定码率作为该优选参考码率。  a correlation coefficient calculation unit, configured to calculate a correlation coefficient between a score of the plurality of reference code rates and a quality evaluation value of the played video; and a specified code rate selection unit, configured to select a specified code from the plurality of reference code rates Rate, the standard deviation of the corresponding code rate corresponding to the specified code rate is smaller than the first preset threshold, and the correlation coefficient corresponding to the specified code rate is the maximum value of the correlation coefficients corresponding to the multiple reference code rates; , for using the specified code rate as the preferred reference code rate.
第二方面, 提供了一种视频传输方法, 所述方法包括:  In a second aspect, a video transmission method is provided, where the method includes:
获取待编码视频的视频信息及网络传输条件, 确定第一码率和第二码率, 该第一码率大于该第二码率; 根据该第二码率的历史播放评分和预设梯度值, 确定参考码率的码率等级数目; 根据该第一码率、 第一码率的码率等级、 该第 二码率和该第二码率的码率等级, 获取该待编码视频的多个参考码率; 根据该 多个参考码率, 对该待编码视频进行编码; 基于编码得到的多个参考码率的视 频片段, 进行视频传输。  Obtaining video information of the video to be encoded and network transmission conditions, and determining a first code rate and a second code rate, where the first code rate is greater than the second code rate; and a historical play score and a preset gradient value according to the second code rate Determining a number of code rate levels of the reference code rate; obtaining, according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate, acquiring the to-be-coded video a reference code rate; encoding the video to be encoded according to the plurality of reference code rates; performing video transmission based on the video segments of the plurality of reference code rates obtained by the encoding.
结合第二方面, 在第二方面的第一种可能的实现方式中, 根据该第二码率 的历史播放评分和预设梯度值, 确定参考码率的码率等级数目, 包括:  With reference to the second aspect, in a first possible implementation manner of the second aspect, determining a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate, including:
计算预设评分和该第二码率的历史播放评分的差值; 将该差值按照该预设 梯度进行划分, 得到多个评分区间; 将所得到的评分区间的数目作为该参考码 率的码率等级数目。 Calculating a difference between a preset score and a historical play score of the second code rate; the difference is according to the preset The gradient is divided to obtain a plurality of scoring intervals; the number of the obtained scoring intervals is taken as the number of code rate levels of the reference code rate.
结合第二方面,在第二方面的第二种可能的实现方式中,根据该第一码率、 第一码率的码率等级、 该第二码率和该第二码率的码率等级, 获取该待编码视 频的多个参考码率, 包括:  With reference to the second aspect, in a second possible implementation manner of the second aspect, the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate , obtaining multiple reference code rates of the video to be encoded, including:
根据该参考码率的码率等级数目, 确定该第一码率的码率等级; 根据该第 一码率、 该第一码率的码率等级、 该第二码率、 该第二码率的码率等级, 确定 码率等级与码率之间的指数对应关系; 根据该指数对应关系与该参考码率的码 率等级, 获取该待编码视频的多个参考码率。  Determining, according to the number of code rate levels of the reference code rate, a code rate level of the first code rate; according to the first code rate, a code rate level of the first code rate, the second code rate, and the second code rate a code rate level, determining an index correspondence between the code rate level and the code rate; obtaining a plurality of reference code rates of the to-be-coded video according to the index correspondence and the code rate level of the reference code rate.
结合第二方面,在第二方面的第三种可能的实现方式中,根据该第一码率、 该第一码率的码率等级、 该第二码率、 该第二码率的码率等级, 确定码率等级 与码率之间的指数对应关系, 包括:  With reference to the second aspect, in a third possible implementation manner of the second aspect, the first code rate, the code rate level of the first code rate, the second code rate, and the code rate of the second code rate Level, determining the exponential correspondence between the code rate level and the code rate, including:
根据该第一码率、 该第一码率的码率等级、 该第二码率、 该第二码率的码 率等级, 应用预设公式, 确定码率等级与码率之间的指数对应关系; 该预设公 式为: y Ddn^ ^—ra^ + b ; 其中, y为码率等级, Vide0_mte为参考码率, β为第一常数, 为第二常数。 Determining an index corresponding to a code rate level and a code rate according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. The preset formula is: y Ddn^ ^—ra^ + b ; where y is the code rate level, Vide0 _ mte is the reference code rate, and β is the first constant, which is the second constant.
结合第二方面, 在第二方面的第四种可能的实现方式中, 基于编码得到的 多个参考码率的视频片段, 进行视频传输, 包括:  With reference to the second aspect, in a fourth possible implementation manner of the second aspect, the video transmission is performed based on the obtained video segments of the multiple reference code rates, including:
根据终端对已编码视频的传输请求, 传输第一视频片段, 该第一视频片段 为第一参考码率;对第一视频片段的传输进行检测,确定该终端当前传输条件; 从该已编码视频的多个参考码率中, 确定第二参考码率, 该第二参考码率与该 终端当前传输条件相匹配; 选择该第二参考码率的第二视频片段进行传输, 该 第二视频片段为该第一视频片段的下一个片段。  Transmitting a first video segment according to a transmission request of the terminal to the encoded video, the first video segment is a first reference code rate; detecting transmission of the first video segment, determining a current transmission condition of the terminal; from the encoded video a plurality of reference code rates, determining a second reference code rate, the second reference code rate matching a current transmission condition of the terminal; selecting a second video segment of the second reference code rate for transmission, the second video segment Is the next segment of the first video segment.
结合第二方面的第四种可能的实现方式, 在第二方面的第五种可能的实现 方式中, 当所述第一视频片段为所述已编码视频中第一个被传输的视频片段 时, 所述第一参考码率小于所述终端所请求的码率。 结合第二方面, 在第二方面的第六种可能的实现方式中, 基于编码得到的 多个参考码率的视频片段, 进行视频传输之后, 所述方法还包括: With reference to the fourth possible implementation of the second aspect, in a fifth possible implementation manner of the second aspect, when the first video segment is the first video segment to be transmitted in the encoded video The first reference code rate is less than a code rate requested by the terminal. With reference to the second aspect, in a sixth possible implementation manner of the second aspect, after the video transmission is performed on the video segments of the multiple reference code rates that are obtained by the encoding, the method further includes:
获取该已编码视频在不同播放场景下的播放评分; 根据已编码视频所包括 的各个视频片段的参考码率和该播放评分, 确定多个参考码率的评分; 根据该 多个参考码率的评分, 计算该多个参考码率的评分标准差; 根据该多个参考码 率的评分标准差和该已播放视频的质量评价值,从该多个参考码率中选取优选 参考码率。  Obtaining a play score of the encoded video in different play scenarios; determining a score of the multiple reference code rates according to the reference code rate of each video segment included in the encoded video and the play score; according to the multiple reference code rates a score, a score standard deviation of the plurality of reference code rates is calculated; and a preferred reference code rate is selected from the plurality of reference code rates according to a score standard deviation of the plurality of reference code rates and a quality evaluation value of the played video.
结合第二方面的第六种可能的实现方式, 在第二方面的第七种可能的实现  In conjunction with the sixth possible implementation of the second aspect, the seventh possible implementation in the second aspect
定多个参考码率的评分包括: The scores for multiple reference bit rates include:
当第一场景下所播放的已编码视频中包括指定视频片段时,将该第一场景 下的播放评分作为该指定视频片段对应的参考码率的评分, 该指定视频片段为 具有相同参考码率的视频片段, 且该指定视频片段的个数大于预设数目。  When the specified video segment is included in the encoded video played in the first scenario, the play score in the first scenario is used as a score of the reference code rate corresponding to the specified video segment, and the specified video segment has the same reference code rate. Video clip, and the number of the specified video clips is greater than a preset number.
结合第二方面的第六种可能的实现方式, 在第二方面的第八种可能的实现 方式中, 根据该多个参考码率的评分标准差和该已播放视频的质量评价值, 从 该多个参考码率中选取优选参考码率包括:  With reference to the sixth possible implementation manner of the second aspect, in an eighth possible implementation manner of the second aspect, the standard value of the score of the multiple reference code rates and the quality evaluation value of the played video are Selecting a preferred reference code rate from among multiple reference code rates includes:
计算该多个参考码率的评分和该已播放视频的质量评价值之间的相关系 数; 从该多个参考码率中选取指定码率, 该指定码率对应的评分标准差小于第 一预设阔值, 且该指定码率对应的相关系数为该多个参考码率对应的相关系数 中的最大值; 将该指定码率作为该优选参考码率。  Calculating a correlation coefficient between the score of the plurality of reference code rates and the quality evaluation value of the played video; selecting a specified code rate from the plurality of reference code rates, the standard deviation corresponding to the specified code rate is smaller than the first pre- A threshold value is set, and a correlation coefficient corresponding to the specified code rate is a maximum value of correlation coefficients corresponding to the plurality of reference code rates; the designated code rate is used as the preferred reference code rate.
本发明实施例提供的技术方案带来的有益效果是:  The beneficial effects brought by the technical solutions provided by the embodiments of the present invention are:
本发明通过获取待编码视频的视频信息及网络传输条件, 确定第一码率和 第二码率, 第一码率大于第二码率; 根据第二码率的历史播放评分和预设梯度 值, 确定参考码率的码率等级数目; 根据第一码率、 第一码率的码率等级、 第 二码率和第二码率的码率等级, 获取待编码视频的多个参考码率; 根据多个参 考码率, 对待编码视频进行编码; 基于编码得到的多个参考码率的视频片段, 进行视频传输。 釆用本发明实施例提供的技术方案, 能够根据用于反映用户对 视频播放的直观体验的评分信息, 确定编码所釆取的的参考码率, 从而使得根 据参考码率进行编码以及视频传输后, 能够使传输的视频更加符合用户的实际 播放需求, 在相同的传输条件下, 显著提升了视频播放效果。 附图说明 The invention determines the first code rate and the second code rate by acquiring video information of the video to be encoded and the network transmission condition, where the first code rate is greater than the second code rate; and the historical play score and the preset gradient value according to the second code rate Determining a number of code rate levels of the reference code rate; obtaining a plurality of reference code rates of the to-be-coded video according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate Encoding the encoded video according to multiple reference code rates; based on the encoded video fragments of multiple reference bit rates, Perform video transmission. With the technical solution provided by the embodiment of the present invention, the reference code rate captured by the code can be determined according to the rating information for reflecting the user's intuitive experience of video playback, so that the coding according to the reference code rate and the video transmission are performed. , can make the transmitted video more in line with the user's actual playback needs, under the same transmission conditions, significantly improve the video playback effect. DRAWINGS
为了更清楚地说明本发明实施例中的技术方案, 下面将对实施例描述中所 需要使用的附图作简单地介绍, 显而易见地, 下面描述中的附图仅仅是本发明 的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下, 还可以根据这些附图获得其他的附图。  In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.
图 1是本发明实施例提供的一种视频传输方法流程图;  FIG. 1 is a flowchart of a video transmission method according to an embodiment of the present invention;
图 2是本发明实施例提供的一种视频传输方法流程图;  2 is a flowchart of a video transmission method according to an embodiment of the present invention;
图 3是视频的码率等级与码率之间的指数曲线关系;  Figure 3 is an exponential curve relationship between the code rate level of the video and the code rate;
图 4是视频的多个参考码率的评分和该已播放视频的质量评价值之间的相 关系数;  4 is a correlation coefficient between a score of a plurality of reference code rates of a video and a quality evaluation value of the played video;
图 5是本发明实施例提供的一种视频传输装置结构示意图。 具体实施方式  FIG. 5 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present invention. detailed description
为使本发明的目的、 技术方案和优点更加清楚, 下面将结合附图对本发明 实施方式作进一步地详细描述。  The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.
图 1是本发明实施例提供的一种视频传输方法流程图。 参见图 1, 方法流 程包括:  FIG. 1 is a flowchart of a video transmission method according to an embodiment of the present invention. Referring to Figure 1, the method flow includes:
101、 获取待编码视频的视频信息及网络传输条件, 确定第一码率和第二 码率, 该第一码率大于该第二码率。  101. Obtain video information of the video to be encoded and network transmission conditions, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate.
102、 根据该第二码率的历史播放评分和预设梯度值, 确定参考码率的码 率等级数目。 103、 根据该第一码率、 第一码率的码率等级、 该第二码率和该第二码率 的码率等级, 获取该待编码视频的多个参考码率。 102. Determine a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate. 103. Acquire a plurality of reference code rates of the to-be-coded video according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate.
104、 根据该多个参考码率, 对该待编码视频进行编码。  104. Encode the to-be-coded video according to the multiple reference code rates.
105、 基于编码得到的多个参考码率的视频片段, 进行视频传输。  105. Perform video transmission based on the video segments of the multiple reference code rates obtained by the encoding.
在本发明提供的另一实施例中,根据该第二码率的历史播放评分和预设梯 度值, 确定参考码率的码率等级数目, 包括: 计算预设评分和该第二码率的历 史播放评分的差值; 将该差值按照该预设梯度进行划分, 得到多个评分区间; 将所得到的评分区间的数目作为该参考码率的码率等级数目。  In another embodiment provided by the present invention, determining a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate, including: calculating a preset score and the second code rate The difference of the historical play scores; dividing the difference according to the preset gradient to obtain a plurality of score intervals; and using the obtained number of score intervals as the number of code rate levels of the reference code rate.
在本发明提供的另一实施例中, 根据该第一码率、 第一码率的码率等级、 该第二码率和该第二码率的码率等级, 获取该待编码视频的多个参考码率, 包 括: 根据该参考码率的码率等级数目, 确定该第一码率的码率等级; 根据该第 一码率、 该第一码率的码率等级、 该第二码率、 该第二码率的码率等级, 确定 码率等级与码率之间的指数对应关系; 根据该指数对应关系与该参考码率的码 率等级, 获取该待编码视频的多个参考码率。  In another embodiment of the present invention, the plurality of to-be-encoded videos are obtained according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. a reference code rate, comprising: determining a code rate level of the first code rate according to a number of code rate levels of the reference code rate; and according to the first code rate, a code rate level of the first code rate, the second code Rate, the code rate level of the second code rate, determining an exponential correspondence relationship between the code rate level and the code rate; obtaining a plurality of references of the to-be-coded video according to the index correspondence relationship and the code rate level of the reference code rate Code rate.
在本发明提供的另一实施例中,根据该第一码率、该第一码率的码率等级、 该第二码率、 该第二码率的码率等级, 确定码率等级与码率之间的指数对应关 系, 包括: 根据该第一码率、 该第一码率的码率等级、 该第二码率、 该第二码 率的码率等级, 应用预设公式, 确定码率等级与码率之间的指数对应关系; 该 预设公式为: y = " x ln(v^o _ ra ) + b其中, y为码率等级, video_rate为参考 码率, a为第一常数, b为第二常数。 In another embodiment provided by the present invention, the code rate level and the code are determined according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. The exponential correspondence between the rates includes: applying a preset formula according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate, and determining a code The exponential correspondence between the rate level and the code rate; the default formula is: y = " x ln(v^o _ ra ) + b where y is the code rate level, video _ rate is the reference code rate, a is The first constant, b is the second constant.
在本发明提供的另一实施例中, 基于编码得到的多个参考码率的视频片 段, 进行视频传输, 包括: 根据终端对已编码视频的传输请求, 传输第一视频 片段, 该第一视频片段为第一参考码率; 对第一视频片段的传输进行检测, 确 定该终端当前传输条件; 从该已编码视频的多个参考码率中, 确定第二参考码 率, 该第二参考码率与该终端当前传输条件相匹配; 选择该第二参考码率的第 二视频片段进行传输, 该第二视频片段为该第一视频片段的下一个片段。 在本发明提供的另一实施例中, 当所述第一视频片段为所述已编码视频中 第一个被传输的视频片段时, 所述第一参考码率小于所述终端所请求的码率。 In another embodiment of the present invention, the video transmission is performed based on the encoded video segments of the plurality of reference code rates, including: transmitting, according to the transmission request of the terminal to the encoded video, the first video segment, the first video The segment is a first reference code rate; detecting transmission of the first video segment, determining a current transmission condition of the terminal; determining, from a plurality of reference code rates of the encoded video, the second reference code, the second reference code The rate matches the current transmission condition of the terminal; the second video segment of the second reference code rate is selected for transmission, and the second video segment is the next segment of the first video segment. In another embodiment provided by the present invention, when the first video segment is the first video segment to be transmitted in the encoded video, the first reference code rate is smaller than the code requested by the terminal. rate.
在本发明提供的另一实施例中, 基于编码得到的多个参考码率的视频片 段, 进行视频传输之后, 所述方法还包括: 获取该已编码视频在不同播放场景 分, 确定多个参考码率的评分; 根据该多个参考码率的评分, 计算该多个参考 码率的评分标准差; 根据该多个参考码率的评分标准差和该已播放视频的质量 评价值, 从该多个参考码率中选取优选参考码率。  In another embodiment of the present invention, after the video transmission is performed on the video segments of the plurality of reference code rates obtained by the encoding, the method further includes: acquiring the encoded video in different playback scenarios, and determining multiple references. a score of the code rate; calculating a score standard deviation of the plurality of reference code rates according to the scores of the plurality of reference code rates; from the score standard deviation of the plurality of reference code rates and the quality evaluation value of the played video, from the A preferred reference code rate is selected among a plurality of reference code rates.
在本发明提供的另一实施例中,根据已编码视频所包括的各个视频片段的 参考码率和该播放评分, 确定多个参考码率的评分包括: 当第一场景下所播放 的已编码视频中包括指定视频片段时,将该第一场景下的播放评分作为该指定 视频片段对应的参考码率的评分, 该指定视频片段为具有相同参考码率的视频 片段, 且该指定视频片段的个数大于预设数目。  In another embodiment provided by the present invention, determining the scores of the plurality of reference code rates according to the reference code rate of each video segment included in the encoded video and the play score comprises: encoding the played when the first scene is played When a video segment is included in the video, the play score in the first scene is used as a score of a reference code rate corresponding to the specified video segment, and the specified video segment is a video segment having the same reference code rate, and the specified video segment is The number is greater than the preset number.
在本发明提供的另一实施例中,根据该多个参考码率的评分标准差和该已 播放视频的质量评价值, 从该多个参考码率中选取优选参考码率包括: 计算该 多个参考码率的评分和该已播放视频的质量评价值之间的相关系数; 从该多个 参考码率中选取指定码率, 该指定码率对应的评分标准差小于第一预设阔值, 且该指定码率对应的相关系数为该多个参考码率对应的相关系数中的最大值; 将该指定码率作为该优选参考码率。  In another embodiment provided by the present invention, selecting a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video includes: calculating the multiple Correlation coefficient between the score of the reference code rate and the quality evaluation value of the played video; selecting a specified code rate from the plurality of reference code rates, the standard deviation corresponding to the specified code rate is less than the first preset threshold And the correlation coefficient corresponding to the specified code rate is a maximum value of the correlation coefficients corresponding to the plurality of reference code rates; the designated code rate is used as the preferred reference code rate.
上述所有可选技术方案, 可以釆用任意结合形成本发明的可选实施例, 在 此不再——赘述。  All of the above optional technical solutions may be combined with any combination to form an alternative embodiment of the present invention, and are not described again.
本实施例提供的方法, 通过获取待编码视频的视频信息及网络传输条件, 确定第一码率和第二码率, 第一码率大于第二码率; 根据第二码率的历史播放 评分和预设梯度值, 确定参考码率的码率等级数目; 根据第一码率、 第一码率 的码率等级、 第二码率和第二码率的码率等级, 获取待编码视频的多个参考码 率; 根据多个参考码率, 对待编码视频进行编码; 基于编码得到的多个参考码 率的视频片段, 进行视频传输。 釆用本发明实施例提供的技术方案, 能够根据 用于反映用户对视频播放的直观体验的评分信息,确定编码所釆取的的参考码 率, 从而使得根据参考码率进行编码以及视频传输后, 能够使传输的视频更加 符合用户的实际播放需求, 在相同的传输条件下, 显著提升了视频播放效果。 图 2是本发明实施例提供的一种视频传输方法流程图。 该方法的执行主体 可以为视频服务器, 参见图 2, 方法流程包括: The method provided in this embodiment determines the first code rate and the second code rate by acquiring video information of the video to be encoded and network transmission conditions, where the first code rate is greater than the second code rate; and playing the score according to the history of the second code rate And determining a number of code rate levels of the reference code rate; and obtaining a code to be encoded according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. Multiple reference code rates; encoding the coded video according to multiple reference code rates; multiple reference codes based on the coding Rate video clips for video transmission. With the technical solution provided by the embodiment of the present invention, the reference code rate captured by the coding can be determined according to the rating information for reflecting the intuitive experience of the user on the video playing, so that the encoding according to the reference code rate and the video transmission are performed. , can make the transmitted video more in line with the user's actual playback needs, under the same transmission conditions, significantly improve the video playback effect. FIG. 2 is a flowchart of a video transmission method according to an embodiment of the present invention. The execution body of the method may be a video server. Referring to FIG. 2, the method flow includes:
201、 获取待编码视频的视频信息、 网络传输条件及视频的历史播放评分, 确定第一码率和第二码率, 该第一码率大于该第二码率。  201. Obtain video information of the video to be encoded, network transmission conditions, and a historical play score of the video, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate.
其中, 该待编码视频可以是在视频服务器侧存储的任一视频, 也可以是通 过视频釆集设备直接获取到的视频。 该视频信息是指描述视频状态特征的参 数, 包括视频的分辨率、 釆样格式、 原始速率、 帧速率及压缩率参数等。 该网 络传输条件是指当前网络对传输业务提供的最低传输速率, 如综合 3G网络对 高速移动的传输业务可提供 144kbs的最低传输速率。  The video to be encoded may be any video stored on the video server side, or may be directly obtained by the video collection device. The video information refers to parameters describing the state of the video, including the resolution of the video, the format of the sample, the original rate, the frame rate, and the compression rate parameters. The network transmission condition refers to the lowest transmission rate provided by the current network to the transmission service. For example, the integrated 3G network can provide a minimum transmission rate of 144 kbs for the high-speed mobile transmission service.
该视频的历史播放评分是指将该视频以某一码率进行编码, 并且播放该码 率编码的视频, 基于该视频播放质量得到的用户体验分值。 如, 对于视频 A以 128kbs码率进行编码, 播放编码后的视频 A, 并在播放完成后根据多个用户的 观看体验对视频 A的播放质量进行评分,将得到的多个评分记录下来, 即该记 录中的多个评分即为该视频 A的 128kbs码率的历史播放评分。 一般地, 该历 史播放评分用 MOS ( Mean Opinion Score, 主观测试分数)表示。  The historical play score of the video is that the video is encoded at a certain code rate, and the video coded video is played, and the user experience score obtained based on the video playback quality. For example, the video A is encoded at a code rate of 128 kbs, and the encoded video A is played, and after the playback is completed, the playback quality of the video A is scored according to the viewing experience of the plurality of users, and the obtained multiple scores are recorded, that is, The multiple scores in the record are the historical play scores for the 128 kbs code rate of the video A. Generally, the historical broadcast score is represented by MOS (Mean Opinion Score).
需要说明的是, 该第一码率用于指代该待编码视频的最高码率。 根据待编 码视频的视频信息可以确定该待编码视频对应的信道速率, 则该最高码率即为 该信道速率。 具有不同视频信息的视频, 根据该视频信息确定的信道速率也不 同, 从而该视频对应的最高码率也不同。  It should be noted that the first code rate is used to refer to the highest code rate of the video to be encoded. The channel rate corresponding to the to-be-coded video may be determined according to the video information of the video to be encoded, and the highest code rate is the channel rate. For video with different video information, the channel rate determined according to the video information is different, so that the highest code rate corresponding to the video is also different.
如表 1所示, 以分辨率为 988*420的视频为例进行说明, 根据该视频的原 始速率与压缩率的比值,即可得到该视频的信道速率,即计算式为 149Mbps/110 « 1.4Mbps, 而该视频的信道速率也即是该视频的最高码率。 进一步地, 对于 该待编码视频的第一码率的选取也不局限于该信道速率, 可以选取略大于该信 道速率的码率, 这样选取是为该待编码视频的码率留有冗余, 若在网络条件极 端理想的情况下, 可以使该视频码率在冗余空间中变动, 充分利用信道传输资 源。如,对于表 1中所示分辨率为 988*420的视频,该视频信道速率为 1.4Mbps, 则可以选取大于 1410kbps作为该第一码率。 As shown in Table 1, the video with a resolution of 988*420 is taken as an example. According to the ratio of the original rate of the video to the compression ratio, the channel rate of the video can be obtained, that is, the calculation formula is 149 Mbps/110. « 1.4Mbps, and the channel rate of the video is also the highest bit rate of the video. Further, the selection of the first code rate of the to-be-coded video is not limited to the channel rate, and a code rate slightly larger than the channel rate may be selected, so that the selection is to reserve redundancy for the code rate of the to-be-coded video. If the network conditions are extremely ideal, the video code rate can be changed in the redundant space, and the channel transmission resources can be fully utilized. For example, for a video with a resolution of 988*420 shown in Table 1, the video channel rate is 1.4 Mbps, and more than 1410 kbps may be selected as the first code rate.
需要说明的是, 该第二码率是指基于该网络传输条件, 并根据该码率的历 史播放评分, 对该待编码视频选取的最低码率, 该第二码率对应的历史播放评 分反映了用户最低可接受的视频码率。 如, 综合 3G网络对高速移动的传输业 务可提供最低传输速率为 144kbs, 在该网络中, 码率为 128kbs的视频的用户 评分的平均 MOS为 2分,即认为该 128kbs码率是用户可接受的最低视频码率, 则该 128kbs码率即是可以满足用户观看质量的最低码率。 而对小于 128kbs的 码率, 其对应的 MOS更低, 则该码率视频的播放质量不能满足用户的观看体 验, 从而也失去了参考价值。  It should be noted that the second code rate refers to a historical play score corresponding to the second code rate based on the network transmission condition and based on the history play score of the code rate, the lowest code rate selected for the video to be encoded. The user's minimum acceptable video bit rate. For example, the integrated 3G network can provide a minimum transmission rate of 144 kbs for high-speed mobile transmission services. In this network, the average MOS of users with a video rate of 128 kbs is 2 points, that is, the 128 kbs code rate is considered acceptable to the user. The lowest video bit rate, then the 128 kbs code rate is the lowest bit rate that can satisfy the user's viewing quality. For a bit rate less than 128 kbs, the corresponding MOS is lower, and the playback quality of the code rate video cannot satisfy the user's viewing experience, and thus the reference value is lost.
表 1  Table 1
Figure imgf000013_0001
Figure imgf000013_0001
202、 计算预设评分和该第二码率的历史播放评分的差值。 202. Calculate a difference between a preset score and a historical play score of the second code rate.
其中, 该预设评分是指为某一视频播放评分设置的最高分值。 如, 将该最 高分值设置为 5,则若对某一视频进行评分,可选的分值范围即为 0分至 5分, 而若将该最高分值设置为 10,则若对某一视频进行评分,可选的分值范围即为 0分至 10分, 本实施例对此不做具体限制。 若对于某一视频, 该视频预设评分 设置为 5, 该第二码率的历史播放评分为 2, 则该差值即为 3。  The preset score refers to the highest score set for a certain video playback rating. For example, if the highest score is set to 5, if a video is scored, the optional score range is 0 to 5, and if the highest score is set to 10, The video is scored, and the optional score range is 0 to 10 points. This embodiment does not specifically limit this. If the video preset score is set to 5 for a video and the historical play score of the second rate is 2, the difference is 3.
203、 将该差值按照该预设梯度进行划分, 得到多个评分区间。 其中, 该预设梯度是指对视频码率的历史播放评分设置的变化间隔, 该预 设梯度能够反映不同码率的主观评价变化。该评分区间是与每个该视频码率相 对应的 MOS区间, 不同评分区间可以反映用户对不同码率编码的视频播放质 量的主观评价。 如, 视频 A的预设评分为 MOS=5, 该第二码率的历史播放评 分为 MOS=2, 则该差值为 3, 将该预设梯度设置为 0.5, 则按照每 0.5划分为 一个区间, 即可得到(2,2.5]、 (2.5,3] , (3,3.5] , (3.5,4] , (4,4.5]及 (4.5,5]这六个 MOS区间。 203. The difference is divided according to the preset gradient to obtain multiple score intervals. The preset gradient refers to a change interval set by a historical play score of a video code rate, and the preset gradient can reflect subjective evaluation changes of different code rates. The scoring interval is a MOS interval corresponding to each of the video bit rates, and different scoring intervals may reflect subjective evaluations of the user's video playback quality encoded by different code rates. For example, the preset score of video A is MOS=5, the historical play score of the second code rate is MOS=2, then the difference is 3, and the preset gradient is set to 0.5, and then divided into 0.5 for each 0.5. In the interval, you can get the six MOS intervals (2, 2.5], (2.5, 3], (3, 3.5), (3.5, 4], (4, 4.5), and (4.5, 5).
204、 将所得到的评分区间的数目作为该参考码率的码率等级数目。  204. The number of the obtained score intervals is used as the number of code rate levels of the reference code rate.
其中, 每个评分区间对应一个参考码率等级, 则评分区间的数目即为参考 码率等级的数目。 该参考码率是指对应不同码率等级的视频码率, 也即是具有 不同历史播放评分的码率。一般地,选取不同等级的参考码率对视频进行编码, 会得到不同质量的视频, 基于不同等级的参考码率编码的视频在传输和播放 时, 也会得到不同效果的视频传输质量及播放质量, 从而会产生不同的播放效 果, 相应地, 用户观看基于不同等级的参考码率编码的视频也会得到不同的观 看效果。 如表 2所示, 根据表中 6个 MOS区间确定有 6个参考码率等级, 每 个参考码率等级对应不同的 MOS评分区间, 则说明用户对基于每个参考码率 编码的视频的视频质量、 传输质量或播放质量的主观体验不同。  Wherein, each score interval corresponds to a reference code rate level, and the number of the score intervals is the number of reference code rate levels. The reference code rate refers to a video code rate corresponding to different code rate levels, that is, a code rate having a different history play score. Generally, selecting different levels of reference code rates to encode the video will result in different quality videos. When the video coded based on different levels of reference code rate is transmitted and played, the video transmission quality and playback quality of different effects will also be obtained. Therefore, different playback effects are generated, and accordingly, the video that the user views based on the reference code rate of different levels may also have different viewing effects. As shown in Table 2, according to the six MOS intervals in the table, there are six reference code rate levels, and each reference code rate level corresponds to a different MOS score interval, indicating that the user has a video of the video coded based on each reference code rate. The subjective experience of quality, transmission quality or playback quality is different.
表 2
Figure imgf000014_0001
Table 2
Figure imgf000014_0001
205、 根据该参考码率的码率等级数目, 确定该第一码率的码率等级。 其中, 该参考码率的码率等级数目值即是最高参考码率等级, 则将该最高 码率等级确定为该第一码率的码率等级。 205. Determine a code rate level of the first code rate according to the number of code rate levels of the reference code rate. The value rate level value of the reference code rate is the highest reference code rate level, and the highest code rate level is determined as the code rate level of the first code rate.
206、 根据该第一码率、 该第一码率的码率等级、 该第二码率、 该第二码 率的码率等级, 应用预设公式, 确定码率等级与码率之间的指数对应关系。 该预设公式为: y = " x ln(v^o _ ra ) + b ; 其中, y为码率等级, video_rate 为参考码率, β为第一常数, b为第二常数。 206. Apply a preset formula to determine a code rate level and a code rate according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. Index correspondence. The preset formula is: y = " x ln(v^o _ ra ) + b ; where y is the code rate level, video _ rate is the reference code rate, β is the first constant, and b is the second constant.
其中, 将该第一码率、 该第一码率的码率等级、 该第二码率、 该第二码率 的码率等级代入预设公式, 确定该第一常数和该第二常数的值, 即可得到确定 的码率等级与码率之间的指数对应关系。 如, 对视频 A, 根据该第一码率 128kbs、 该第一码率的码率等级 1、 该第二码率 1410kbs、 该第二码率的码率等 级 6, 将这 4个参数带入该预设公式, 即得到该第一常数 a=2.079及该第二常 数 b=-9.1144, 即该视频 A 的码率等级与码率之间的指数对应关系为 y = 2.079 x ln(v ifco _ ra ) - 9.1144。 图 3所示为该视频 A的码率等级与码率之 间的指数曲线关系。  The first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate are substituted into a preset formula to determine the first constant and the second constant. The value can be used to obtain an exponential correspondence between the determined code rate level and the code rate. For example, for the video A, according to the first code rate of 128 kbs, the code rate level of the first code rate, the second code rate of 1410 kbs, and the code rate level of the second code rate, the four parameters are brought into The preset formula obtains the first constant a=2.079 and the second constant b=−9.1144, that is, the exponential correspondence between the code rate level of the video A and the code rate is y = 2.079 x ln(v ifco _ ra ) - 9.1144. Figure 3 shows the exponential curve relationship between the bit rate level and the code rate of the video A.
由于每个参考码率等级与用户对视频质量的每个历史评分区间存在对应 关系, 则该指数对应关系也可以反映用户对视频质量的主观评分与码率之间的 对应关系, 即通过该指数对应关系可以确定符合用户对视频质量的体验需求的 视频参考码率。  Since each reference code rate level has a corresponding relationship with each historical score interval of the user for the video quality, the index correspondence relationship may also reflect the correspondence between the user's subjective score of the video quality and the code rate, that is, the index is adopted. The correspondence can determine the video reference bit rate that meets the user's experience of video quality.
207、 根据该指数对应关系与该参考码率的码率等级, 获取该待编码视频 的多个参考码率。  207. Acquire a plurality of reference code rates of the to-be-coded video according to the index correspondence and the code rate level of the reference code rate.
其中, 将该参考码率的各码率等级带入该指数对应关系中, 得到与各参考 码率的码率等级对应的参考码率, 即后续步骤将基于该多个参考码率对待编码 视频进行编码。 如, 视频 A 的码率等级与码率之间的指数对应关系为 y = 2.079 X \n(video _ rate) - 9.1144,将该参考码率等级分别带入该对应关系可得 到, 参考码率等级 1对应的参考码率为 128kbs, 参考码率等级 2对应的参考码 率为 210kbs,参考码率等级 3对应的参考码率为 350kbs,参考码率等级 4对应 的参考码率为 545kbs,参考码率等级 5对应的参考码率为 876kbs,参考码率等 级 6对应的参考码率为 1410kbs。  The code rate levels of the reference code rate are brought into the index correspondence relationship to obtain a reference code rate corresponding to the code rate level of each reference code rate, that is, the subsequent step is to encode the video based on the multiple reference code rates. Encode. For example, the exponential correspondence between the bit rate level of the video A and the code rate is y = 2.079 X \n(video _ rate) - 9.1144, and the reference bit rate level is respectively brought into the correspondence relationship, and the reference bit rate is obtained. The reference code rate corresponding to level 1 is 128 kbs, the reference code rate corresponding to reference code rate level 2 is 210 kbs, the reference code rate corresponding to reference code rate level 3 is 350 kbs, and the reference code rate corresponding to reference code rate level 4 is 545 kbs. The reference code rate corresponding to the code rate level 5 is 876 kbs, and the reference code rate corresponding to the reference code rate level 6 is 1410 kbs.
208、 根据该多个参考码率, 对该待编码视频进行编码。  208. Encode the to-be-coded video according to the multiple reference code rates.
其中, 对该待编码视频进行编码的过程可通过下述(1 ) - ( 3 ) 步骤实现。 ( 1 )将待编码视频进行分段处理, 得到多个视频片段。 (2 )基于该多个参考 码率, 对每个视频片段进行编码, 得到每个视频片段对应的多个参考码率编码 的视频版本。 (3 )将该多个视频版本存储在服务器中, 待后续视频传输过程选 取。 如表 3所示, 将视频 A进行分段处理, 得到 N个视频片段, 基于 m个参 考码率, 对每个视频片段进行编码, 得到每个视频片段对应的 m个视频版本, 将每个视频片段的 m个视频版本存储在服务器中, 待后续视频传输过程选取。 如, 将 110s时长的视频 A进行平均分段处理, 得到 22个 5s时长的视频片段, 已知该视频 A对应 6种参考码率,则将 22个 5s时长的视频片段基于 6种参考 码率分别编码,从而该视频 A得到 6*22个视频版本,将该 6*22个视频版本存 储在服务器中并等待后续传输处理。 The process of encoding the video to be encoded can be implemented by the following steps (1) - (3). (1) Segmenting the video to be encoded to obtain a plurality of video segments. (2) encoding each video segment based on the plurality of reference code rates to obtain a plurality of reference code rate encoded video versions corresponding to each video segment. (3) storing the plurality of video versions in the server, and selecting the subsequent video transmission process. As shown in Table 3, the video A is segmented to obtain N video segments, and each video segment is encoded based on m reference code rates, to obtain m video versions corresponding to each video segment, and each will be The m video versions of the video clip are stored in the server and are selected by the subsequent video transmission process. For example, the video A of the 110s duration is averaged and segmented to obtain 22 video segments of 5s duration. It is known that the video A corresponds to 6 reference code rates, and 22 video segments of 5s duration are based on 6 reference code rates. The codes are separately encoded, so that the video A gets 6*22 video versions, stores the 6*22 video versions in the server and waits for subsequent transmission processing.
表 3  table 3
Figure imgf000016_0001
Figure imgf000016_0001
209、 根据终端对已编码视频的传输请求, 传输第一视频片段, 该第一视 频片段为第一参考码率。 209. Transmit a first video segment according to a transmission request of the terminal to the encoded video, where the first video segment is a first reference code rate.
其中, 该第一视频片段是指终端当前申请传输的该已编码视频中的任一个 视频片段, "第一" 并不特指某一个视频片段。 该第一参考码率是指该第一视 频片段基于某一参考码率进行编码的视频版本。  The first video segment refers to any video segment of the encoded video that the terminal currently applies for transmission, and the “first” does not specifically refer to a certain video segment. The first reference code rate refers to a video version in which the first video segment is encoded based on a certain reference code rate.
而当该第一视频片段为已编码视频的第一个被传输的视频片段时, 为了保 证终端有足够的緩冲时间, 用户观看视频没有卡顿现象, 该第一参考码率应小 于终端所请求的码率,也即是,第一参考码率应小于终端请求的码率一个等级, 并不是完全匹配。 而在传输该视频片段以后的视频片段时, 其码率可以与终端 传输条件相匹配。 其中, 该已编码视频中第一个被传输的视频片段可以是该已 编码视频的第一个视频片段,也可以是终端在打开视频的操作过程中申请传输 该视频中的任一个视频片段。该预设码率可以是视频供应商自行设置的一个码 率限制, 当该第一视频片段为该已编码视频中第一个被传输的视频片段时, 则 服务器选取小于该预设码率的最大参考码率作为该第一参考码率进行传输。 如, 某一视频对应的 6 个码率等级的参考码率为 128kbs、 210kbs、 350kbs、 545kbs、 876kbs及 1410kbs, 在传输该视频时, 当第一视频片段为该视频中第 一个被传输的视频片段时, 该预设码率设置为 300kbs, 即选取 210kbs参考码 率编码的第一视频片段进行传输, 这样既可以在一定程度上满足视频播放质量 的需求, 也可以使得第一个被传输的视频片段能快速在终端下载完, 以减小视 频下载等待的緩冲时间, 防止视频播放中出现频繁、 过长的緩冲延时, 从而保 证了用户的观看体验。 When the first video segment is the first transmitted video segment of the encoded video, in order to ensure that the terminal has sufficient buffering time, the user watching the video has no jamming, and the first reference bit rate should be smaller than the terminal device. The requested code rate, that is, the first reference code rate should be less than one level of the bit rate requested by the terminal, and is not an exact match. When the video clip after the video clip is transmitted, the code rate can match the terminal transmission condition. Wherein, the first video segment transmitted in the encoded video may be the already The first video clip of the encoded video may also be that the terminal requests to transmit any one of the video clips during the operation of opening the video. The preset code rate may be a rate limit set by the video provider. When the first video segment is the first video segment to be transmitted in the encoded video, the server selects less than the preset bit rate. The maximum reference code rate is transmitted as the first reference code rate. For example, the reference code rates of the six code rate levels corresponding to a video are 128 kbs, 210 kbs, 350 kbs, 545 kbs, 876 kbs, and 1410 kbs. When the video is transmitted, when the first video segment is the first one of the video to be transmitted. In the case of a video clip, the preset code rate is set to 300 kbs, that is, the first video clip encoded by the reference code rate of 210 kbs is selected for transmission, so that the video playback quality requirement can be satisfied to some extent, and the first one can be transmitted. The video clip can be downloaded quickly in the terminal to reduce the buffering time of the video download waiting, preventing frequent and excessive buffering delay in the video playback, thereby ensuring the user's viewing experience.
210、 对第一视频片段的传输进行检测, 确定该终端当前传输条件。  210. Detect a transmission of the first video segment, and determine a current transmission condition of the terminal.
其中, 该传输条件是指信道传输数据的信道速率。 在本步骤中, 具体确定 该终端当前传输条件的过程具体可以通过下述(1 ) - ( 3 ) 步骤实现。 (1 )获 取该第一视频片段的数据容量。 (2 )获取该第一视频片段的传输时长。 (3 )根 据该第一视频片段的数据容量和传输时长, 确定当前传输条件。 如, 传输视频 C时, 获取到当前传输的第一视频片段的数据容量为 600k,传输该第一视频片 段的传输时长为 2s,则可确定信道当前传输数据的信道速率为 600k/2s=300kbs。 然而, 也可以通过其他计算方式确定该终端当前的传输条件, 本实施例对此方 式不做具体限定。  Wherein, the transmission condition refers to a channel rate of data transmitted by the channel. In this step, the process of specifically determining the current transmission condition of the terminal may be specifically implemented by the following steps (1) - (3). (1) Obtaining the data capacity of the first video segment. (2) Obtaining a transmission duration of the first video segment. (3) determining the current transmission condition based on the data capacity and the transmission duration of the first video segment. For example, when the video C is transmitted, the data capacity of the first video segment currently transmitted is 600k, and the transmission duration of the first video segment is 2s, the channel rate of the current transmission data of the channel is determined to be 600k/2s=300kbs. . However, the current transmission condition of the terminal may also be determined by other calculation methods, which is not specifically limited in this embodiment.
211、 从该已编码视频的多个参考码率中, 确定第二参考码率, 该第二参 考码率与该终端当前传输条件相匹配。  211. Determine, from a plurality of reference code rates of the encoded video, a second reference code rate, where the second reference code rate matches a current transmission condition of the terminal.
其中, 该第二参考码率是指在该第一视频片段传输后, 根据终端当前传输 条件选取的一个适合终端当前传输条件的参考码率。在终端当前传输条件的限 制下, 选取符合该限制的最高参考码率作为第二参考码率进行视频片段的传 输。 212、 选择该第二参考码率的第二视频片段进行传输, 该第二视频片段为 该第一视频片段的下一个片段。 The second reference code rate refers to a reference code rate suitable for the current transmission condition of the terminal, which is selected according to the current transmission condition of the terminal after the first video segment is transmitted. Under the limitation of the current transmission condition of the terminal, the highest reference code rate that meets the limit is selected as the second reference code rate for the transmission of the video segment. 212. Select a second video segment of the second reference code rate, where the second video segment is the next segment of the first video segment.
需要说明的是, 本实施例中步骤 209-212仅对处于前后顺序中的两个视频 片段的传输过程进行了说明, 而在整段视频的传输过程中, 需要传输多个视频 片段, 则传输多个视频片段的过程均遵循本实施例中步骤 209-212所述的两个 视频片段的传输方法。  It should be noted that, in the embodiment, steps 209-212 only describe the transmission process of two video segments in the preceding and succeeding sequence, and in the transmission process of the entire video, multiple video segments need to be transmitted, and then the transmission is performed. The process of multiple video segments follows the transmission method of the two video segments described in steps 209-212 in this embodiment.
步骤 201-212对视频传输方法进行了说明。 在该视频传输方法中, 根据用 于反映用户对视频播放的直观体验的评分信息, 确定编码所釆取的参考码率, 因此, 根据参考码率进行编码及视频传输后, 能够使传输的视频更加符合用户 的实际播放需求, 在相同的传输条件下, 显著提升了视频播放效果  Steps 201-212 illustrate the video transmission method. In the video transmission method, according to the scoring information for reflecting the user's intuitive experience of video playback, the reference code rate captured by the encoding is determined, and therefore, after the encoding and video transmission according to the reference code rate, the transmitted video can be made. More in line with the user's actual playback needs, significantly improved video playback under the same transmission conditions
213、 获取该已编码视频在不同播放场景下的播放评分。  213. Obtain a play score of the encoded video in different play scenarios.
其中, 该播放场景是指在该已编码视频的传输过程中, 传输的每个视频片 段都可选择不同的参考码率, 因此对于同一个已编码视频的不同传输过程, 可 程即是一种播放场景。如,将视频 B分为 6个视频片段,参考码率包括 100kbs、 200kbs、 300kbs、 400kbs及 500kbs, 每个视频片段都包含基于这 5种参考码率 下进行编码的 5个视频版本。 为每个参考码率设置标志得到 lOOkbs标志为 a、 200kbs标志为 b、 300kbs标志为 c、 400kbs标志为 d及 500kbs标志为 e, 则存 在一种传输过程为第一个视频片段选取参考码率 a、 第二个视频片段选取参考 码率 b、 第三个视频片段选取参考码率1?、 第四个视频片段选取参考码率 第 五个视频片段选取参考码率 d及第六个视频片段选取参考码率 a, 即将该传输 过程表示为 abbcda, 则该播放场景也表示为 abbcda。 如上述过程同理, 该视频 A还可以包含播放场景 2为 abcdee、 播放场景 3为 aaabdc及其他播放场景等。  The playback scenario means that each video segment transmitted during the transmission process of the encoded video can select a different reference code rate, so that for different transmission processes of the same encoded video, the process is a Play the scene. For example, the video B is divided into six video segments, and the reference code rate includes 100 kbs, 200 kbs, 300 kbs, 400 kbs, and 500 kbs, and each video segment includes five video versions encoded based on the five reference code rates. Set the flag for each reference bit rate to get the lOOkbs flag as a, the 200kbs flag as b, the 300kbs flag as c, the 400kbs flag as d, and the 500kbs flag as e, then there is a transmission process to select the reference code rate for the first video segment. a, the second video segment selects the reference code rate b, the third video segment selects the reference code rate 1?, the fourth video segment selects the reference code rate, the fifth video segment selects the reference code rate d, and the sixth video segment The reference code rate a is selected, that is, the transmission process is represented as abbcda, and the play scene is also represented as abbcda. As the above process is similar, the video A may also include a play scene 2 as abcdee, a play scene 3 as aaabdc, and other play scenes.
需要说明的是, 该播放评分是指在该已编码视频传输并播放完成后, 用户 在终端进行的在线播放评分。对于某一视频的播放场景数量可以根据该视频的 视频片段数量及参考码率数量确定, 通常在实际网络中传输视频时, 该视频的 播放场景不会全部出现, 或是一部分播放场景不会经常出现, 因此可以只对经 常出现的播放场景进行播放评分。将获取的该播放评分与对应的该播放场景存 储在服务器中, 以备后续选取优选参考码率时进行调用。 It should be noted that the play score refers to an online play score performed by the user at the terminal after the encoded video is transmitted and played. The number of playback scenes for a certain video can be determined according to the number of video segments of the video and the number of reference code rates. When the video is transmitted in an actual network, the video is The playback scenes will not all appear, or some of the playback scenes will not appear frequently, so you can play scores only for frequently occurring playback scenes. The obtained play score and the corresponding play scene are stored in the server, and are called when the preferred reference code rate is subsequently selected.
214、 当第一场景下所播放的已编码视频中包括指定视频片段时, 将该第 一场景下的播放评分作为该指定视频片段对应的参考码率的评分, 该指定视频 片段为具有相同参考码率的视频片段, 且该指定视频片段的个数大于预设数 。  214. When a specified video segment is included in the encoded video played in the first scenario, the play score in the first scenario is used as a score of a reference code rate corresponding to the specified video segment, and the specified video segment has the same reference. A video clip of a code rate, and the number of the specified video clips is greater than a preset number.
其中, 该预设数目可以是由视频提供商自行设置的数目, 当第一场景下所 播放的已编码视频中包括的指定视频片段的个数大于该预设数目时, 即近似认 为整个视频是以该指定视频片段对应的参考码率进行传输, 则认为对该第一场 景下的播放评分可以代表该指定视频片段对应的参考码率的评分。 如, 将视频 The preset number may be a number set by the video provider. When the number of the specified video segments included in the encoded video played in the first scene is greater than the preset number, the approximate video is considered to be And performing the transmission at the reference code rate corresponding to the specified video segment, and determining that the play score in the first scenario may represent a score of the reference code rate corresponding to the specified video segment. For example, will video
B分为 6个视频片段,参考码率包括 100kbs、 200kbs、 300kbs、 400kbs及 500kbs, 每个视频片段都包含基于这 5种参考码率下进行编码的 5个视频版本,设置该 预设数目为 3。 为每个参考码率设置标志得到 lOOkbs标志为 a、 200kbs标志为 b、 300kbs标志为 c、 400kbs标志为 d及 500kbs标志为 e, 若存在一种播放场 景为第一个视频片段选取参考码率 a、 第二个视频片段选取参考码率 a、 第三 个视频片段选取参考码率 a、 第四个视频片段选取参考码率 c、 第五个视频片 段选取参考码率 a及第六个视频片段选取参考码率 a, 则该播放场景也表示为 aaacaa, 其中有 5个视频片段的参考码率都为 a, 大于该预设数目 3, 那么可认 为对该播放场景的播放评分即为该参考码率 a的评分。 B is divided into 6 video segments, and the reference code rate includes 100 kbs, 200 kbs, 300 kbs, 400 kbs, and 500 kbs. Each video segment includes 5 video versions encoded based on the 5 reference bit rates, and the preset number is set to 3. Set the flag for each reference bit rate to get the lOOkbs flag as a, the 200kbs flag as b, the 300kbs flag as c, the 400kbs flag as d, and the 500kbs flag as e. If there is a playback scene for the first video segment, select the reference bit rate. a, the second video clip selects the reference code rate a, the third video clip selects the reference code rate a, the fourth video clip selects the reference code rate c, the fifth video clip selects the reference code rate a, and the sixth video When the clip selects the reference code rate a, the play scene is also represented as aaacaa, wherein the reference code rate of the five video clips is a, which is greater than the preset number of 3, then the play score of the play scene may be considered as Refer to the score of the code rate a.
需要说明的是, 将获取到的所有参考码率的评分存储在服务器中, 以备后 续计算该参考码率的评分标准差调用。  It should be noted that the scores of all the reference code rates obtained are stored in the server for later calculation of the scoring standard deviation call of the reference code rate.
215、 根据该多个参考码率的评分, 计算该多个参考码率的评分标准差。 其中, 从服务器中调用该各个参考码率的评分, 计算各个参考码率的评分 基于视频 A的六种参考码率, 播放视频 A, 并记录该视频 A的六种参考码率 的播放评分。需要说明的是,此处所述的该视频 A的六种参考码率的播放评分, 是指在视频 A分别基于该六种参考码率下进行传输及播放得到的播放评分。 如, 假设将该视频 A分割为 10个视频片段, 每个视频片段在表 4中所示的六 种参考码率下编码, 在该视频 A的传输过程中, 10个或 8个视频片段均选取 128kbs编码的视频片段, 即该视频 A在传输及播放后得到的播放评分则认为 是 128kbs参考码率得到的播放评分。 将该视频 A在该六种参考码率下分别进 行传输及播放, 并记录每种参考码率的播放评分, 基于每种参考码率的播放评 分计算每种参考码率的播放评分标准差, 也即是表 4中所示的主观 MOS标准 差。 215. Calculate a standard deviation of the plurality of reference code rates according to the scores of the multiple reference code rates. The scores of the respective reference code rates are called from the server, and the scores of the respective reference code rates are calculated based on the six reference code rates of the video A, the video A is played, and the six reference code rates of the video A are recorded. Play score. It should be noted that the play scores of the six reference code rates of the video A described herein refer to the play scores obtained by transmitting and playing the video A based on the six reference code rates. For example, suppose the video A is divided into 10 video segments, each of which is encoded at the six reference code rates shown in Table 4. During the transmission of the video A, 10 or 8 video segments are The 128 kbs encoded video segment is selected, that is, the playback score obtained by the video A after transmission and playback is regarded as the playback score obtained by the reference rate of 128 kbs. The video A is separately transmitted and played under the six reference code rates, and the play score of each reference code rate is recorded, and the play score standard deviation of each reference code rate is calculated based on the play score of each reference code rate. That is, the subjective MOS standard deviation shown in Table 4.
表 4  Table 4
Figure imgf000020_0001
Figure imgf000020_0001
216、 计算该多个参考码率的评分和该已播放视频的质量评价值之间的相 关系数。 216. Calculate a correlation coefficient between the score of the multiple reference code rates and the quality evaluation value of the played video.
其中, 该质量评价值是指对该播放视频的客观评价参数。 该相关系数可以 通过下述步骤( 1 ) - ( 3 ) 的过程计算得到。  Wherein, the quality evaluation value refers to an objective evaluation parameter of the played video. The correlation coefficient can be calculated by the process of the following steps (1) - (3).
( 1 )在同一播放场景中, 计算该已播放视频基于各个参考码率 dPSNR ( Difference of Peak Signal to Noise Ratio, 峰值信噪比差值)。  (1) In the same play scene, the played video is calculated based on each reference code rate dPSNR (Difference of Peak Signal to Noise Ratio).
其中, 该计算公式为下述公式(1 )所示。  Wherein, the calculation formula is as shown in the following formula (1).
dPSNR = PSNR, - PSNR ( 1 )  dPSNR = PSNR, - PSNR ( 1 )
其中, 公式( 1 )中所示 dPSNR为视频片段 J'与该视频参考码率间的峰值信 噪比差值。 '' = 1,23,· · ·,Μ 表示 Μ个参考码率, =1表示最小的一个参考码率, =Μ表示最大的一个参考码率。 j = m , N 表示视频的 N个视频分段, =i 表示视频时间方向上第一个视频片段, j:N表示视频时间方向上最后一个视频 片段。 PSN 为参考码率 i的视频片段 j对应的峰值信噪比, PSNRn为参考码率 n对应的峰值信噪比。 通过公式( 1 )计算得到该已播放视频基于各个参考码率 的 dPSNR。 Wherein, the dPSNR shown in the formula (1) is a peak signal between the video segment J′ and the video reference code rate. Noise ratio difference. '' = 1, 2 , 3 , · · ·, Μ denotes a reference code rate, =1 denotes the smallest reference code rate, and =Μ denotes the largest reference code rate. j = m , N represents the N video segments of the video, =i represents the first video segment in the video time direction, and j:N represents the last video segment in the video time direction. The PSN is the peak signal to noise ratio corresponding to the video segment j of the reference code rate i, and the PSNR n is the peak signal to noise ratio corresponding to the reference code rate n. The dPSNR of the played video based on each reference code rate is calculated by the formula (1).
( 2 )根据该已播放视频基于各个参考码率得到的 dPSNR, 计算该已播放 视频的 ePSNR ( Evoloved Peak Signal to Noise Ratio , 改进型峰值信噪比 )值。  (2) Calculating an ePSNR (Evoloved Peak Signal to Noise Ratio) value of the played video according to the dPSNR obtained by the played video based on each reference code rate.
其中, 该计算公式为下述公式(2 )所示。  Wherein, the calculation formula is as shown in the following formula (2).
ePSNR = a x mean(dPSNR) + b x max(dPSNR) + c x min(dPSNR) + d x std(dPSNR) ( 2 ) 其中, meanWPS 为对该已播放视频中 N个视频分段的峰值信噪比差值 的均值,丽 (dPSNR 为在整段视频中 N个视频分段的峰值信噪比差值的最大值, minW/^WR)为在整段视频中 N 个视频分段的峰值信噪比差值的最小值,ePSNR = ax mean(dPSNR) + bx max(dPSNR) + cx min(dPSNR) + dx std(dPSNR) ( 2 ) where meanWPS is the peak signal to noise ratio difference of the N video segments in the played video Mean, 丽 (dPSNR is the maximum value of the peak signal-to-noise ratio difference of N video segments in the whole video, minW/^WR) is the peak signal-to-noise ratio difference of N video segments in the whole video. The minimum value of the value,
^/WPSM?)为对整段视频中 N个视频分段的峰值信噪比差值的标准差, a、 b、 c 和 < 为待定系数。 ^/WPSM?) is the standard deviation of the peak signal-to-noise ratio difference for the N video segments in the entire video, a, b, c, and < are pending coefficients.
( 3 )根据该已播放视频的 ePSNR与该参考码率 n对应的 MOS评分, 进 行拟合运算,得到该参考码率 n的评分和该已播放视频的质量评价值之间的相 关系数。 其中, 该已播放视频的 ePSNR与该参考码率 n对应的 MOS评分之间 的关系如下述公式(3 )所示。  (3) performing a fitting operation according to the MOS score corresponding to the ePSNR of the played video and the reference code rate n, and obtaining a correlation coefficient between the score of the reference code rate n and the quality evaluation value of the played video. The relationship between the ePSNR of the played video and the MOS score corresponding to the reference code rate n is as shown in the following formula (3).
MOS = p x ePSNR+q ( 3 )  MOS = p x ePSNR+q ( 3 )
公式( 3 ) 为该已播放视频的 ePSNR与该参考码率 n对应的 MO 评分之 间的关系, p和 为待确定的参数。 通过该关系进行拟合运算, 即可确定参数 p和 q, 的取值即为该相关系数。  Equation (3) is the relationship between the ePSNR of the played video and the MO score corresponding to the reference code rate n, and p is the parameter to be determined. By fitting the relationship, the parameters p and q can be determined as the correlation coefficient.
需要说明的是, 该质量评价值可以是视频的 ePSNR ( Evoloved Peak Signal to Noise Ratio, 改进型峰值信噪比)值, 也可以是其他可以反映该视频播放质 量的参数值, 本实施例仅以视频的 ePSNR值进行说明, 其他参数值不再赘述。 该相关系数反映了该播放视频的质量评价值与各参考码率之间的相关程度, 该 相关系数越大, 则该参考码率与该视频的播放评分间的相关程度越大, 即说明 选取该参考码率进行视频传输能更符合用户的实际播放需求。如图 4所示为视 频 A的多个参考码率的评分和该已播放视频 A的质量评价值之间的相关系数。 It should be noted that the quality evaluation value may be an EPSNR (Evolved Peak Signal to Noise Ratio) value of the video, or may be another parameter value that can reflect the quality of the video playback. The ePSNR value of the video is explained, and other parameter values are not described again. The correlation coefficient reflects the correlation between the quality evaluation value of the broadcast video and each reference code rate. The larger the correlation coefficient is, the greater the correlation between the reference code rate and the play score of the video is, that is, the selection is selected. The reference bit rate for video transmission can better meet the actual playback needs of the user. As shown in FIG. 4, the correlation coefficient between the scores of the plurality of reference code rates of the video A and the quality evaluation values of the played video A is shown.
217、 从该多个参考码率中选取指定码率, 该指定码率对应的评分标准差 小于第一预设阔值, 且该指定码率对应的相关系数为该多个参考码率对应的相 关系数中的最大值。  217. The specified code rate is selected from the multiple reference code rates, where the standard deviation of the corresponding code rate is smaller than the first preset threshold, and the correlation coefficient corresponding to the specified code rate is corresponding to the multiple reference code rates. The maximum value in the correlation coefficient.
其中, 该第一预设阔值可以是视频供应商自行设置的数值, 用该第一预设 阔值来限定参考码率的评分标准差, 并从符合该限定条件的参考码率中选取优 选参考码率。 如, 对于视频八, 该第一预设阔值设置为 0.7, 若该视频 A的多 个参考码率的评分和该已播放视频 A的质量评价值之间的相关系数如图 4所 示, 该视频 A的各个参考码率的评分标准差如表 4所示, 则可从表 4中选出小 于 0.7的参考码率为 210kbs和 545kbs, 再根据图 4中所示可得到, 210kbs参 考码率对应的相关系数为 0.8846, 545kbs参考码率对应的相关系数为 0.8804, 0.8846大于 0.8804, 即选取 210kbs为该指定码率。  The first preset threshold may be a value set by the video provider, and the first preset threshold is used to define a standard deviation of the reference code rate, and the preferred one is selected from the reference code rate that meets the qualified condition. Reference code rate. For example, for video eight, the first preset threshold is set to 0.7, if the correlation coefficient between the scores of the plurality of reference code rates of the video A and the quality evaluation value of the played video A is as shown in FIG. 4, The standard deviation of the scores of the reference codes of the video A is as shown in Table 4. The reference code rate of less than 0.7 can be selected from Table 4 to be 210 kbs and 545 kbs, which can be obtained according to the figure shown in FIG. 4, and the 210 kbs reference code. The correlation coefficient corresponding to the rate is 0.8846, and the correlation coefficient corresponding to the reference code rate of 545 kbs is 0.8804, and 0.8846 is greater than 0.8804, that is, 210 kbs is selected as the specified code rate.
需要说明的是, 一方面, 参考码率的标准差越小, 则该参考码率的播放评 分波动就越小, 从而说明该参考码率的播放效果越稳定, 因此, 选取评分标准 差小的指定码率更能符合用户的实际播放需求。 另一方面, 参考码率的播放评 分与视频质量评价值的相关系数越大, 则该视频的客观质量评价就越接近用户 的实际播放需求,因此,选取该相关系数大的指定码率能在相同的传输条件下, 显著提升视频播放效果。  It should be noted that, on the one hand, the smaller the standard deviation of the reference code rate is, the smaller the play score fluctuation of the reference code rate is, so that the more stable the playback effect of the reference code rate is, therefore, the selection standard deviation is small. The specified bit rate is more in line with the actual playback needs of the user. On the other hand, the greater the correlation coefficient between the playback score of the reference code rate and the video quality evaluation value, the closer the objective quality evaluation of the video is to the actual playback requirement of the user. Therefore, selecting the specified code rate with the correlation coefficient can be Significantly enhances video playback under the same transmission conditions.
218、 将该指定码率作为该优选参考码率。  218. The designated code rate is used as the preferred reference code rate.
其中, 根据该优选参考码率对该视频进行播放评分, 即认为该播放评分对 该视频播放质量的评价具有较高准确度, 且符合用户观看体验。  The video is scored according to the preferred reference code rate, that is, the play score is considered to have higher accuracy in evaluating the video playback quality, and is consistent with the user viewing experience.
在本发明实施例中, 在确定了优选参考码率之后, 可根据优选参考码率对 视频的播放进行评估,所得到的 MOS评分能更好的反映用户的观看主观体验。 其具体评估过程可以参见上文所述的公式(1 )、 (2 )和(3 ) 的描述, 在此不 做赘述。 另外, 视频内容提供商可以利用上述公式对视频播放情况进行评价, 以改进播放策略, 或进行网络优化, 以满足用户的观看体验。 In the embodiment of the present invention, after the preferred reference code rate is determined, the playback of the video may be evaluated according to the preferred reference code rate, and the obtained MOS score can better reflect the subjective experience of the user. For the specific evaluation process, refer to the descriptions of the formulas (1), (2) and (3) described above, and no further description is given here. In addition, video content providers can use the above formula to evaluate video playback to improve playback strategies or network optimization to meet the user's viewing experience.
本实施例提供的方法, 通过获取待编码视频的视频信息及网络传输条件, 确定第一码率和第二码率, 第一码率大于第二码率; 根据第二码率的历史播放 评分和预设梯度值, 确定参考码率的码率等级数目; 根据第一码率、 第一码率 的码率等级、 第二码率和第二码率的码率等级, 获取待编码视频的多个参考码 率; 根据多个参考码率, 对待编码视频进行编码; 基于编码得到的多个参考码 率的视频片段, 进行视频传输。 釆用本发明实施例提供的技术方案, 能够根据 用于反映用户对视频播放的直观体验的评分信息,确定编码所釆取的的参考码 率, 从而使得根据参考码率进行编码以及视频传输后, 能够使传输的视频更加 符合用户的实际播放需求, 在相同的传输条件下, 显著提升了视频播放效果。 图 5是本发明实施例提供的一种视频传输装置结构示意图。 参见图 5, 该 装置包括码率确定模块 501、 码率等级数目确定模块 502、 参考码率获取模块 503、 视频编码模块 504和视频传输模块 505。  The method provided in this embodiment determines the first code rate and the second code rate by acquiring video information of the video to be encoded and network transmission conditions, where the first code rate is greater than the second code rate; and playing the score according to the history of the second code rate And determining a number of code rate levels of the reference code rate; and obtaining a code to be encoded according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. a plurality of reference code rates; encoding the coded video according to the plurality of reference code rates; performing video transmission based on the obtained video segments of the plurality of reference code rates. With the technical solution provided by the embodiment of the present invention, the reference code rate captured by the coding can be determined according to the rating information for reflecting the intuitive experience of the user on the video playing, so that the encoding according to the reference code rate and the video transmission are performed. , can make the transmitted video more in line with the user's actual playback needs, under the same transmission conditions, significantly improve the video playback effect. FIG. 5 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present invention. Referring to FIG. 5, the apparatus includes a code rate determining module 501, a code rate level number determining module 502, a reference code rate obtaining module 503, a video encoding module 504, and a video transmission module 505.
码率确定模块 501, 用于获取待编码视频的视频信息及网络传输条件, 确 定第一码率和第二码率, 该第一码率大于该第二码率。  The code rate determining module 501 is configured to obtain video information of the video to be encoded and network transmission conditions, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate.
码率等级数目确定模块 502, 用于根据该第二码率的历史播放评分和预设 梯度值, 确定参考码率的码率等级数目。  The code rate level number determining module 502 is configured to determine a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate.
参考码率获取模块 503, 用于根据该第一码率、 第一码率的码率等级、 该 第二码率和该第二码率的码率等级, 获取该待编码视频的多个参考码率。  The reference code rate obtaining module 503 is configured to obtain multiple references of the to-be-coded video according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. Code rate.
视频编码模块 504,用于根据该多个参考码率,对该待编码视频进行编码。 视频传输模块 505, 用于基于编码得到的多个参考码率的视频片段, 进行 视频传输。  The video encoding module 504 is configured to encode the to-be-coded video according to the multiple reference code rates. The video transmission module 505 is configured to perform video transmission based on the video segments of the plurality of reference code rates obtained by the encoding.
在本发明提供的另一实施例中, 该码率等级数目确定模块包括: 差值计算 单元, 用于计算预设评分和该第二码率的历史播放评分的差值; 评分区间确定 单元, 用于将该差值按照该预设梯度进行划分, 得到多个评分区间; 码率等级 数目确定单元, 用于将所得到的评分区间的数目作为该参考码率的码率等级数 。 In another embodiment provided by the present invention, the code rate level number determining module comprises: a difference calculation a unit, configured to calculate a difference between a preset score and a historical play score of the second code rate; a score interval determining unit configured to divide the difference according to the preset gradient to obtain a plurality of score intervals; a code rate level The number determining unit is configured to use the number of the obtained score sections as the number of code rate levels of the reference code rate.
在本发明提供的另一实施例中, 该参考码率获取模块包括: 码率等级确定 单元, 用于根据该参考码率的码率等级数目, 确定该第一码率的码率等级; 对 应关系确定单元,用于根据该第一码率、该第一码率的码率等级、该第二码率、 该第二码率的码率等级, 确定码率等级与码率之间的指数对应关系; 参考码率 获取单元, 用于根据该指数对应关系与该参考码率的码率等级, 获取该待编码 视频的多个参考码率。  In another embodiment of the present invention, the reference code rate obtaining module includes: a code rate level determining unit, configured to determine a code rate level of the first code rate according to a number of code rate levels of the reference code rate; a relationship determining unit, configured to determine an index between a code rate level and a code rate according to the first code rate, a code rate level of the first code rate, the second code rate, and a code rate level of the second code rate Corresponding relationship; the reference code rate obtaining unit is configured to obtain a plurality of reference code rates of the to-be-coded video according to the index correspondence relationship and the code rate level of the reference code rate.
在本发明提供的另一实施例中, 该参考码率获取模块包括: 根据该第一码 率、 该第一码率的码率等级、 该第二码率、 该第二码率的码率等级, 应用预设 公式, 确定码率等级与码率之间的指数对应关系; 该预设公式为: y = ax l^video - rate、 + 其中, ; y为码率等级, video—mte为参考码率, a为第一 常数, b为第二常数。 In another embodiment provided by the present invention, the reference code rate obtaining module includes: a code rate according to the first code rate, the code rate level of the first code rate, the second code rate, and the second code rate. Level, applying a preset formula, determining an exponential correspondence between a code rate level and a code rate; the preset formula is: y = ax l ^ video - rate , + where , ; y is a code rate level, and video_mte is Referring to the code rate, a is the first constant and b is the second constant.
在本发明提供的另一实施例中, 该视频传输模块包括: 第一视频片段传输 单元, 用于根据终端对已编码视频的传输请求, 传输第一视频片段, 该第一视 频片段为第一参考码率; 传输条件确定单元, 用于对第一视频片段的传输进行 检测, 确定该终端当前传输条件; 第二视频片段确定单元, 用于从该已编码视 频的多个参考码率中, 确定第二参考码率, 该第二参考码率与该终端当前传输 条件相匹配; 第二视频片段传输单元, 用于选择该第二参考码率的第二视频片 段进行传输, 该第二视频片段为该第一视频片段的下一个片段。  In another embodiment of the present invention, the video transmission module includes: a first video segment transmission unit, configured to transmit a first video segment according to a transmission request of the terminal to the encoded video, where the first video segment is the first a transmission rate determining unit, configured to detect a transmission of the first video segment, and determine a current transmission condition of the terminal; and a second video segment determining unit, configured to use, from the plurality of reference code rates of the encoded video, Determining a second reference code rate, the second reference code rate is matched with a current transmission condition of the terminal; a second video segment transmission unit, configured to select a second video segment of the second reference code rate for transmission, the second video The segment is the next segment of the first video segment.
在本发明提供的另一实施例中, 当所述第一视频片段为所述已编码视频中 第一个被传输的视频片段时, 所述第一参考码率小于所述终端所请求的码率。  In another embodiment provided by the present invention, when the first video segment is the first video segment to be transmitted in the encoded video, the first reference code rate is smaller than the code requested by the terminal. rate.
在本发明提供的另一实施例中, 所述装置还包括: 播放评分获取模块, 用 于获取该已编码视频在不同播放场景下的播放评分; 评分确定模块, 用于根据 已编码视频所包括的各个视频片段的参考码率和该播放评分, 确定多个参考码 率的评分; 评分标准差计算模块, 用于根据该多个参考码率的评分, 计算该多 个参考码率的评分标准差; 优选参考码率选取模块, 用于根据该多个参考码率 的评分标准差和该已播放视频的质量评价值,从该多个参考码率中选取优选参 考码率。 In another embodiment of the present invention, the device further includes: a play score acquisition module, configured to acquire a play score of the encoded video in different play scenarios; a score determining module, configured to a reference code rate of each video segment included in the encoded video and the play score, determining a score of the plurality of reference code rates; a score standard deviation calculation module, configured to calculate the multiple references according to the scores of the plurality of reference code rates a standard deviation rate of the code rate; a preferred reference rate selection module, configured to select a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video .
在本发明提供的另一实施例中, 评分确定模块还包括: 当第一场景下所播 放的已编码视频中包括指定视频片段时, 将该第一场景下的播放评分作为该指 定视频片段对应的参考码率的评分, 该指定视频片段为具有相同参考码率的视 频片段, 且该指定视频片段的个数大于预设数目。  In another embodiment of the present invention, the score determining module further includes: when the specified video segment is included in the encoded video played in the first scene, the play score in the first scene is corresponding to the specified video segment. The score of the reference code rate, the specified video segment is a video segment having the same reference code rate, and the number of the specified video segments is greater than a preset number.
在本发明提供的另一实施例中, 优选参考码率选取模块包括: 相关系数计 算单元, 用于计算该多个参考码率的评分和该已播放视频的质量评价值之间的 相关系数; 指定码率选取单元, 用于从该多个参考码率中选取指定码率, 该指 定码率对应的评分标准差小于第一预设阔值, 且该指定码率对应的相关系数为 该多个参考码率对应的相关系数中的最大值; 优选参考码率确定单元, 用于将 该指定码率作为该优选参考码率。  In another embodiment of the present invention, the preferred reference rate selection module includes: a correlation coefficient calculation unit, configured to calculate a correlation coefficient between the score of the plurality of reference code rates and the quality evaluation value of the played video; a code rate selection unit, configured to select a specified code rate from the plurality of reference code rates, where a standard deviation of the corresponding code rate is less than a first preset threshold, and the correlation coefficient corresponding to the specified code rate is more a maximum of the correlation coefficients corresponding to the reference code rate; a preferred reference code rate determining unit for using the designated code rate as the preferred reference code rate.
通过获取待编码视频的视频信息及网络传输条件, 确定第一码率和第二码 率, 第一码率大于第二码率; 根据第二码率的历史播放评分和预设梯度值, 确 定参考码率的码率等级数目; 根据第一码率、 第一码率的码率等级、 第二码率 和第二码率的码率等级,获取待编码视频的多个参考码率;根据多个参考码率, 对待编码视频进行编码; 基于编码得到的多个参考码率的视频片段, 进行视频 传输。 釆用本发明实施例提供的技术方案, 能够根据用于反映用户对视频播放 的直观体验的评分信息, 确定编码所釆取的的参考码率, 从而使得根据参考码 率进行编码以及视频传输后, 能够使传输的视频更加符合用户的实际播放需 求, 在相同的传输条件下, 显著提升了视频播放效果。 本领域普通技术人员可以理解实现上述实施例的全部或部分步骤可以通 过硬件来完成, 也可以通过程序来指令相关的硬件完成, 所述的程序可以存储 于一种计算机可读存储介质中, 上述提到的存储介质可以是只读存储器, 磁盘 或光盘等。 以上所述仅为本发明的较佳实施例, 并不用以限制本发明, 凡在本发明的 精神和原则之内, 所作的任何修改、 等同替换、 改进等, 均应包含在本发明的 保护范围之内。 Determining a first code rate and a second code rate by acquiring video information of the video to be encoded and a network transmission condition, where the first code rate is greater than the second code rate; determining the historical play score and the preset gradient value according to the second code rate The number of code rate levels of the reference code rate; obtaining a plurality of reference code rates of the video to be encoded according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate; Multiple reference code rates, encoding the coded video; performing video transmission based on the video segments of the plurality of reference code rates obtained by the coding. With the technical solution provided by the embodiment of the present invention, the reference code rate captured by the code can be determined according to the rating information for reflecting the user's intuitive experience of video playback, so that the coding according to the reference code rate and the video transmission are performed. , can make the transmitted video more in line with the user's actual playback needs, under the same transmission conditions, significantly improve the video playback effect. Those skilled in the art can understand that all or part of the steps of implementing the above embodiments can be The completion of the hardware may also be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium. The storage medium mentioned above may be a read only memory, a magnetic disk or an optical disk. The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

权 利 要 求 书 Claim
1、 一种视频传输装置, 其特征在于, 所述装置包括: A video transmission device, the device comprising:
码率确定模块, 用于获取待编码视频的视频信息及网络传输条件, 确定第 一码率和第二码率, 所述第一码率大于所述第二码率;  a code rate determining module, configured to obtain video information of the video to be encoded and network transmission conditions, and determine a first code rate and a second code rate, where the first code rate is greater than the second code rate;
码率等级数目确定模块, 用于根据所述第二码率的历史播放评分和预设梯 度值, 确定参考码率的码率等级数目;  a code rate level number determining module, configured to determine a number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate;
参考码率获取模块, 用于根据所述第一码率、 第一码率的码率等级、 所述 第二码率和所述第二码率的码率等级, 获取所述待编码视频的多个参考码率; 视频编码模块, 用于根据所述多个参考码率, 对所述待编码视频进行编码; 视频传输模块, 用于基于编码得到的多个参考码率的视频片段, 进行视频 传输。  a reference code rate obtaining module, configured to acquire, according to the first code rate, a code rate level of the first code rate, the second code rate, and a code rate level of the second code rate, a plurality of reference code rates; a video encoding module, configured to encode the to-be-encoded video according to the multiple reference code rates; and a video transmission module, configured to perform video segments based on the plurality of reference code rates obtained by the encoding, Video transmission.
2、 根据权利要求 1所述的装置, 其特征在于, 所述码率等级数目确定模块 包括: 2. The apparatus according to claim 1, wherein the code rate level number determining module comprises:
差值计算单元, 用于计算预设评分和所述第二码率的历史播放评分的差值; 评分区间确定单元, 用于将所述差值按照所述预设梯度进行划分, 得到多 个评分区间;  a difference calculation unit, configured to calculate a difference between a preset score and a historical play score of the second code rate; a score interval determining unit, configured to divide the difference according to the preset gradient, to obtain multiple Grading interval
码率等级数目确定单元, 用于将所得到的评分区间的数目作为所述参考码 率的码率等级数目。  The code rate level number determining unit is configured to use the number of the obtained score sections as the number of code rate levels of the reference code rate.
3、根据权利要求 1所述的装置, 其特征在于, 所述参考码率获取模块包括: 码率等级确定单元, 用于根据所述参考码率的码率等级数目, 确定所述第 一码率的码率等级; The apparatus according to claim 1, wherein the reference code rate obtaining module comprises: a code rate level determining unit, configured to determine the first code according to a number of code rate levels of the reference code rate Rate rate level;
对应关系确定单元, 用于根据所述第一码率、 所述第一码率的码率等级、 所述第二码率、 所述第二码率的码率等级, 确定码率等级与码率之间的指数对 应关系; a correspondence determining unit, configured to determine a code rate level and a code according to the first code rate, a code rate level of the first code rate, the second code rate, and a code rate level of the second code rate Index pair between rates Should be related;
参考码率获取单元, 用于根据所述指数对应关系与所述参考码率的码率等 级, 获取所述待编码视频的多个参考码率。  And a reference code rate obtaining unit, configured to acquire, according to the index correspondence relationship and a code rate level of the reference code rate, a plurality of reference code rates of the to-be-coded video.
4、 根据权利要求 1所述的装置, 其特征在于, 所述参考码率获取模块用于 根据所述第一码率、 所述第一码率的码率等级、 所述第二码率、 所述第二码率 的码率等级, 应用预设公式, 确定码率等级与码率之间的指数对应关系; The apparatus according to claim 1, wherein the reference code rate obtaining module is configured to use, according to the first code rate, a code rate level of the first code rate, the second code rate, The code rate level of the second code rate is determined by using a preset formula to determine an index correspondence between a code rate level and a code rate;
所述预设公式为: y = α x l vide°― mte + bThe preset formula is: y = α xl vide ° - mte + b ;
其中, y为码率等级, video_rate为参考码率, α为第一常数, b为第二常数。  Where y is the code rate level, video_rate is the reference code rate, α is the first constant, and b is the second constant.
5、 根据权利要求 1所述的装置, 其特征在于, 所述视频传输模块包括: 第一视频片段传输单元, 用于根据终端对已编码视频的传输请求, 传输第 一视频片段, 所述第一视频片段为第一参考码率; The device according to claim 1, wherein the video transmission module comprises: a first video segment transmission unit, configured to transmit a first video segment according to a transmission request of the terminal to the encoded video, a video segment is a first reference code rate;
传输条件确定单元, 用于对第一视频片段的传输进行检测, 确定所述终端 当前传输条件;  a transmission condition determining unit, configured to detect a transmission of the first video segment, and determine a current transmission condition of the terminal;
第二视频片段确定单元, 用于从所述已编码视频的多个参考码率中, 确定 第二参考码率, 所述第二参考码率与所述终端当前传输条件相匹配;  a second video segment determining unit, configured to determine, from a plurality of reference code rates of the encoded video, a second reference code rate, where the second reference code rate matches a current transmission condition of the terminal;
第二视频片段传输单元, 用于选择所述第二参考码率的第二视频片段进行 传输, 所述第二视频片段为所述第一视频片段的下一个片段。  And a second video segment transmission unit, configured to select a second video segment of the second reference code rate, where the second video segment is a next segment of the first video segment.
6、 根据权利要求 5所述的装置, 其特征在于, 当所述第一视频片段为所述 已编码视频中第一个被传输的视频片段时, 所述第一参考码率小于所述终端所 请求的码率。 The device according to claim 5, wherein when the first video segment is the first video segment to be transmitted in the encoded video, the first reference code rate is smaller than the terminal The requested code rate.
7、 根据权利要求 1所述的装置, 其特征在于, 所述装置还包括: 7. The device according to claim 1, wherein the device further comprises:
播放评分获取模块, 用于获取所述已编码视频在不同播放场景下的播放评 所述播放评分, 确定多个参考码率的评分; a play score obtaining module, configured to obtain a play rating of the encoded video in different play scenarios Playing a score to determine a score of a plurality of reference code rates;
评分标准差计算模块, 用于根据所述多个参考码率的评分, 计算所述多个 参考码率的评分标准差;  a scoring standard deviation calculation module, configured to calculate a scoring standard deviation of the plurality of reference code rates according to the scores of the plurality of reference code rates;
优选参考码率选取模块, 用于根据所述多个参考码率的评分标准差和所述 已播放视频的质量评价值, 从所述多个参考码率中选取优选参考码率。  Preferably, the reference code rate selection module is configured to select a preferred reference code rate from the plurality of reference code rates according to the standard deviation of the plurality of reference code rates and the quality evaluation value of the played video.
8、 根据权利要求 7所述的装置, 其特征在于, 所述评分确定模块还用于: 当第一场景下所播放的已编码视频中包括指定视频片段时, 将所述第一场 景下的播放评分作为所述指定视频片段对应的参考码率的评分, 所述指定视频 片段为具有相同参考码率的视频片段, 且所述指定视频片段的个数大于预设数 。 The apparatus according to claim 7, wherein the score determining module is further configured to: when the specified video segment is included in the encoded video played in the first scene, the first scene is The play score is a score of a reference code rate corresponding to the specified video segment, the specified video segment is a video segment having the same reference code rate, and the number of the specified video segments is greater than a preset number.
9、根据权利要求 7所述的装置, 其特征在于,优选参考码率选取模块包括: 相关系数计算单元, 用于计算所述多个参考码率的评分和所述已播放视频 的质量评价值之间的相关系数; The apparatus according to claim 7, wherein the preferred reference rate selection module comprises: a correlation coefficient calculation unit, configured to calculate a score of the plurality of reference code rates and a quality evaluation value of the played video Correlation coefficient between
指定码率选取单元, 用于从所述多个参考码率中选取指定码率, 所述指定 码率对应的评分标准差小于第一预设阔值, 且所述指定码率对应的相关系数为 所述多个参考码率对应的相关系数中的最大值;  a code rate selection unit, configured to select a specified code rate from the plurality of reference code rates, where a standard deviation of the corresponding code rate is less than a first preset threshold, and a correlation coefficient corresponding to the specified code rate a maximum value of correlation coefficients corresponding to the plurality of reference code rates;
优选参考码率确定单元, 用于将所述指定码率作为所述优选参考码率。  Preferably, a reference code rate determining unit is configured to use the specified code rate as the preferred reference code rate.
10、 一种视频传输方法, 其特征在于, 所述方法包括: 10. A video transmission method, the method comprising:
获取待编码视频的视频信息及网络传输条件, 确定第一码率和第二码率, 所述第一码率大于所述第二码率;  Obtaining video information of the video to be encoded and network transmission conditions, and determining a first code rate and a second code rate, where the first code rate is greater than the second code rate;
根据所述第二码率的历史播放评分和预设梯度值, 确定参考码率的码率等 级数目; Determining the code rate of the reference code rate according to the historical play score and the preset gradient value of the second code rate Number of stages;
根据所述第一码率、 第一码率的码率等级、 所述第二码率和所述第二码率 的码率等级, 获取所述待编码视频的多个参考码率;  Acquiring, according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate, a plurality of reference code rates of the to-be-coded video;
根据所述多个参考码率, 对所述待编码视频进行编码;  And encoding the to-be-encoded video according to the multiple reference code rates;
基于编码得到的多个参考码率的视频片段, 进行视频传输。  Video transmission is performed based on the video segments of the plurality of reference code rates obtained by the encoding.
11、 根据权利要求 10所述的方法, 其特征在于, 根据所述第二码率的历史 播放评分和预设梯度值, 确定参考码率的码率等级数目, 包括: The method according to claim 10, wherein determining the number of code rate levels of the reference code rate according to the historical play score and the preset gradient value of the second code rate comprises:
计算预设评分和所述第二码率的历史播放评分的差值;  Calculating a difference between a historical play score of the preset score and the second code rate;
将所述差值按照所述预设梯度进行划分, 得到多个评分区间;  And dividing the difference according to the preset gradient to obtain a plurality of scoring intervals;
将所得到的评分区间的数目作为所述参考码率的码率等级数目。  The number of the obtained score sections is taken as the number of code rate levels of the reference code rate.
12、 根据权利要求 10所述的方法, 其特征在于, 根据所述第一码率、 第一 码率的码率等级、 所述第二码率和所述第二码率的码率等级, 获取所述待编码 视频的多个参考码率, 包括: The method according to claim 10, wherein, according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate, Obtaining a plurality of reference code rates of the video to be encoded, including:
根据所述参考码率的码率等级数目, 确定所述第一码率的码率等级; 根据所述第一码率、 所述第一码率的码率等级、 所述第二码率、 所述第二 码率的码率等级, 确定码率等级与码率之间的指数对应关系;  Determining, according to the number of code rate levels of the reference code rate, a code rate level of the first code rate; according to the first code rate, a code rate level of the first code rate, the second code rate, Determining a relationship between a code rate level and a code rate by a code rate level of the second code rate;
根据所述指数对应关系与所述参考码率的码率等级, 获取所述待编码视频 的多个参考码率。  Obtaining a plurality of reference code rates of the video to be encoded according to the index correspondence and the code rate level of the reference code rate.
13、 根据权利要求 10所述的方法, 其特征在于, 根据所述第一码率、 所述 第一码率的码率等级、 所述第二码率、 所述第二码率的码率等级, 确定码率等 级与码率之间的指数对应关系, 包括: The method according to claim 10, wherein: according to the first code rate, a code rate level of the first code rate, the second code rate, and a code rate of the second code rate Level, determining the exponential correspondence between the code rate level and the code rate, including:
根据所述第一码率、 所述第一码率的码率等级、 所述第二码率、 所述第二 码率的码率等级, 应用预设公式, 确定码率等级与码率之间的指数对应关系; 所述预设公式为: y = α x l vide°― mte、 + bAnd applying a preset formula to determine a code rate level and a code rate according to the first code rate, the code rate level of the first code rate, the second code rate, and the code rate level of the second code rate. Index correspondence between them; The preset formula is: y = α xl vide ° - mte , + b ;
其中, y为码率等级, video_rate为参考码率, α为第一常数, b为第二常数。  Where y is the code rate level, video_rate is the reference code rate, α is the first constant, and b is the second constant.
14、 根据权利要求 10所述的方法, 其特征在于, 基于编码得到的多个参考 码率的视频片段, 进行视频传输, 包括: The method according to claim 10, wherein the video transmission is performed based on the encoded video segments of the plurality of reference code rates, including:
根据终端对已编码视频的传输请求, 传输第一视频片段, 所述第一视频片 段为第一参考码率;  Transmitting a first video segment according to a transmission request of the terminal to the encoded video, where the first video segment is a first reference code rate;
对第一视频片段的传输进行检测, 确定所述终端当前传输条件;  Detecting transmission of the first video segment, determining a current transmission condition of the terminal;
从所述已编码视频的多个参考码率中, 确定第二参考码率, 所述第二参考 码率与所述终端当前传输条件相匹配;  Determining, from a plurality of reference code rates of the encoded video, a second reference code rate, where the second reference code rate matches a current transmission condition of the terminal;
选择所述第二参考码率的第二视频片段进行传输, 所述第二视频片段为所 述第一视频片段的下一个片段。  And transmitting a second video segment of the second reference code rate, the second video segment being a next segment of the first video segment.
15、 根据权利要求 14所述的方法, 其特征在于, 当所述第一视频片段为所 述已编码视频中第一个被传输的视频片段时, 所述第一参考码率小于所述终端 所请求的码率。 The method according to claim 14, wherein when the first video segment is the first video segment to be transmitted in the encoded video, the first reference code rate is smaller than the terminal The requested code rate.
16、 根据权利要求 10所述的方法, 其特征在于, 基于编码得到的多个参考 码率的视频片段, 进行视频传输之后, 所述方法还包括: The method according to claim 10, wherein after the video transmission is performed on the video segments of the plurality of reference code rates obtained by the encoding, the method further includes:
获取所述已编码视频在不同播放场景下的播放评分; 多个参考码率的评分;  Obtaining a play score of the encoded video in different play scenarios; a score of multiple reference code rates;
根据所述多个参考码率的评分, 计算所述多个参考码率的评分标准差; 根据所述多个参考码率的评分标准差和所述已播放视频的质量评价值, 从 所述多个参考码率中选取优选参考码率。 Calculating a scoring standard deviation of the plurality of reference code rates according to the scores of the plurality of reference code rates; determining, according to the scoring standard deviation of the plurality of reference code rates, and the quality evaluation value of the played video, A preferred reference code rate is selected among a plurality of reference code rates.
17、 根据权利要求 16所述的方法, 其特征在于, 根据已编码视频所包括的 各个视频片段的参考码率和所述播放评分, 确定多个参考码率的评分包括: 当第一场景下所播放的已编码视频中包括指定视频片段时, 将所述第一场 景下的播放评分作为所述指定视频片段对应的参考码率的评分, 所述指定视频 片段为具有相同参考码率的视频片段, 且所述指定视频片段的个数大于预设数 。 17. The method according to claim 16, wherein determining a score of the plurality of reference code rates according to a reference code rate of each video segment included in the encoded video and the play score comprises: When the specified video clip is included in the played video, the play score in the first scene is used as the score of the reference code rate corresponding to the specified video clip, and the specified video clip is a video having the same reference code rate. a segment, and the number of the specified video segments is greater than a preset number.
18、 根据权利要求 16所述的方法, 其特征在于, 根据所述多个参考码率的 评分标准差和所述已播放视频的质量评价值, 从所述多个参考码率中选取优选 参考码率包括: The method according to claim 16, wherein the preferred reference is selected from the plurality of reference code rates according to a standard deviation of the plurality of reference code rates and a quality evaluation value of the played video. The code rate includes:
计算所述多个参考码率的评分和所述已播放视频的质量评价值之间的相关 系数;  Calculating a correlation coefficient between a score of the plurality of reference code rates and a quality evaluation value of the played video;
从所述多个参考码率中选取指定码率, 所述指定码率对应的评分标准差小 于第一预设阔值, 且所述指定码率对应的相关系数为所述多个参考码率对应的 相关系数中的最大值;  Selecting a specified code rate from the plurality of reference code rates, the standard deviation of the corresponding code rate corresponding to the specified code rate is less than the first preset threshold, and the correlation coefficient corresponding to the specified code rate is the multiple reference code rate The maximum of the corresponding correlation coefficients;
将所述指定码率作为所述优选参考码率。  The specified code rate is taken as the preferred reference code rate.
PCT/CN2014/084108 2014-08-11 2014-08-11 Video transmission method and device WO2016023158A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201480035791.XA CN106464981B (en) 2014-08-11 2014-08-11 Video transmission method and device
PCT/CN2014/084108 WO2016023158A1 (en) 2014-08-11 2014-08-11 Video transmission method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/084108 WO2016023158A1 (en) 2014-08-11 2014-08-11 Video transmission method and device

Publications (1)

Publication Number Publication Date
WO2016023158A1 true WO2016023158A1 (en) 2016-02-18

Family

ID=55303765

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084108 WO2016023158A1 (en) 2014-08-11 2014-08-11 Video transmission method and device

Country Status (2)

Country Link
CN (1) CN106464981B (en)
WO (1) WO2016023158A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110312150B (en) * 2019-04-24 2022-04-05 网宿科技股份有限公司 Video frame transmission method, system and server

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102802089A (en) * 2012-09-13 2012-11-28 浙江大学 Shifting video code rate regulation method based on experience qualitative forecast
CN102833219A (en) * 2011-06-16 2012-12-19 华为技术有限公司 Method and device for transmitting data files to client side
CN103051982A (en) * 2012-12-28 2013-04-17 上海华为技术有限公司 Video stream transmission control method and video stream transmission control device
JP2013207355A (en) * 2012-03-27 2013-10-07 Softbank Mobile Corp Receiving device and radio communication control method in ofdm transmission system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102111381A (en) * 2009-12-24 2011-06-29 中国移动通信集团公司 Streaming media code rate dynamic adjustment method, terminal and streaming media server
CN103024342B (en) * 2012-12-25 2016-05-18 广东威创视讯科技股份有限公司 Band width control method in video conferencing system and system
CN103533386A (en) * 2013-10-21 2014-01-22 腾讯科技(深圳)有限公司 Live broadcasting control method and anchor equipment
CN103501429A (en) * 2013-10-22 2014-01-08 中国农业银行股份有限公司 Data coding method and device based on dynamic code rate

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833219A (en) * 2011-06-16 2012-12-19 华为技术有限公司 Method and device for transmitting data files to client side
JP2013207355A (en) * 2012-03-27 2013-10-07 Softbank Mobile Corp Receiving device and radio communication control method in ofdm transmission system
CN102802089A (en) * 2012-09-13 2012-11-28 浙江大学 Shifting video code rate regulation method based on experience qualitative forecast
CN103051982A (en) * 2012-12-28 2013-04-17 上海华为技术有限公司 Video stream transmission control method and video stream transmission control device

Also Published As

Publication number Publication date
CN106464981B (en) 2019-08-20
CN106464981A (en) 2017-02-22

Similar Documents

Publication Publication Date Title
US10305947B2 (en) Pre-buffering audio streams
JP6058677B2 (en) Signaling segment characteristics for streaming media data over a network
US9398301B2 (en) Parallel video encoding based on complexity analysis
WO2017031692A1 (en) Video downloading method, apparatus, and system
WO2021147448A1 (en) Video data processing method and apparatus, and storage medium
US20170347159A1 (en) Qoe analysis-based video frame management method and apparatus
US8923411B2 (en) Method and system for determining a quality value of a video stream
KR20110138134A (en) Storage file format for multimedia streaming file, storage method and client apparatus using the same
AU2020206243B2 (en) Optimizing encoding operations when generating a buffer-constrained version of a media title
US20140109156A1 (en) Method, terminal, server and system for playing media file
WO2018028547A1 (en) Channel switching method and device
WO2012162995A1 (en) Method and device for transmitting stream media
WO2014161498A1 (en) Preparation method and device for segments of stream media
MX2013013373A (en) Method for dynamic adaptation of the reception bitrate and associated receiver.
US9665646B1 (en) Method and system for providing bit rate adaptaion to video files having metadata
CA2904959A1 (en) Communication devices, communication data generation method, and communication data processing method
CN108124192B (en) HLS streaming media playing method and system
WO2015089793A1 (en) Method and device for measuring quality of experience of mobile video service
US9294821B2 (en) Scrubbing noise remover and methods for use therewith
WO2015106383A1 (en) Method for assessing video quality and related device
WO2016023158A1 (en) Video transmission method and device
WO2021064754A2 (en) Systems and methods for dynamic optimization of content delivery in a wireless communication network
JP6053180B2 (en) Video playback state estimation device, video playback state estimation method, and program
WO2022185534A1 (en) Coding parameter derivation device, coding parameter derivation method, and program
WO2022003902A1 (en) View completion rate estimating device, view completion rate estimating method and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14899869

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14899869

Country of ref document: EP

Kind code of ref document: A1