Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/80—Responding to QoS
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
  • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/75—Media network packet handling
  • H04L65/752—Media network packet handling adapting media to network capabilities
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
  • H04L65/60—Network streaming of media packets
  • H04L65/75—Media network packet handling
  • H04L65/756—Media network packet handling adapting media to device capabilities
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
  • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
  • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/845—Structuring of content, e.g. decomposing content into time segments
  • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

• the present invention relates to video communication technologies in a communication system, and more particularly to a method, a player and a terminal for selecting a stream segment based on streaming media. Background technique
• Streaming media technology is a technology for realizing media data transmission using HTTP (Hypertext Transfer Protocol) in the application layer. This technology can also watch media programs while downloading media programs.
• HTTP Hypertext Transfer Protocol
• a plurality of code streams are simultaneously stored for the same media content on the server providing the media content.
• the audio and video coding parameters between the code streams, the code rate or the resolution of the video are all different, and each code stream is divided into a plurality of segments, and each segment can be independently played.
• the terminal may request segmentation of different code rates according to the network bandwidth information, and segments of different code rates can be continuously played in the terminal.
• the server provides an MPD (media presentation description) of the media content to the terminal, where the code rate, time, and the like of each code stream are described, and each point is also described.
• Information such as the code rate, time, URL (Uniform I Universal Resource Locator) of the segment; after obtaining the MPD, the terminal parses the MPD to obtain information such as the code rate of the code stream provided by the corresponding media content in the server,
• the terminal requests a media program segment whose code rate is smaller than the maximum bit rate of the current bandwidth according to the network bandwidth condition of the terminal; the method implements the device, but the method only considers the case where the segmentation code rate does not exceed the bandwidth. With this method, neither the bandwidth resources can be fully utilized nor the user can have a good video experience. Summary of the invention
• an embodiment of the present invention provides a method, a device, and a terminal for selecting a stream segment based on a streaming media according to a method, a player, and a terminal for selecting a stream segment based on a streaming media according to an embodiment of the present invention.
• Fully utilizing bandwidth ensuring that the final selected code stream is segmented while making full use of bandwidth by adjusting the quality and/or the upward adjustment of the quality/code rate of the low quality segment while the buffer is not underflowing. At the same time, the quality of the segments is closer, and the video quality is smoother during video playback.
• An embodiment of the first aspect of the present invention discloses a method for selecting a code stream segment based on a streaming media, the method comprising: obtaining each segment of the at least two segments corresponding to the first time in the streaming media. Segmentation information, where the segmentation information includes segmentation quality; selecting an initial segment from at least two segments corresponding to the first time according to the segmentation quality and the preset quality threshold of each segment Segment; if it is determined that downloading the initial segment does not cause the terminal to play abnormally, the initial segment is segmented as the selected code stream.
• the quality of the segmentation is closer to that of the finally selected code stream segment, and the video quality is smoother during video playback.
• the determining that downloading the initial segment does not cause the terminal to play abnormally includes: obtaining cache parameter information of the terminal, where the cache parameter information includes a preset a cache threshold; if it is determined according to the segmentation information of the initial segment and the cache parameter information of the terminal that downloading the initial segment does not cause the available cache of the terminal to be smaller than the preset cache threshold, It is then determined that downloading the initial segment does not cause the terminal to play abnormally.
• the segmentation information further includes a segmentation time length and a segmentation code rate
• the cache parameter information of the terminal is further Include a length of time for the unplayed streaming media in the cache; determining, according to the segmentation information of the initial segment and the cache parameter information of the terminal, that downloading the initial segment does not cause the cache of the terminal to be smaller than a preset
• the method further includes: obtaining, by the terminal, the available network bandwidth of the streaming media; and determining, according to the segmentation information of the initial segment, and the cache parameter information of the terminal, downloading the The initial segmentation does not cause the buffer of the terminal to be smaller than the preset cache threshold, including: completing the initial segment according to the segmentation time length of the initial segment and the segmentation code rate and the available network bandwidth.
• the length of time of downloading if the sum of the length of the unplayed streaming media in the terminal buffer and the segmentation time length of the initial segment is not less than The initial segment length of time the download is complete and the preset threshold value and the buffer, the download does not result in the initial segment of the terminal buffer available less than a preset threshold cache.
• the method further includes: if according to the initial segmentation The segment information and the cache parameter information of the terminal determine that downloading the initial segment causes the available cache of the terminal to be smaller than a preset cache threshold, and then, in all the segments corresponding to the first moment Selecting a second segment whose segment quality is smaller than the segment quality of the initial segment, and using the second segment as the updated initial segment, repeating the above steps until it is determined that the updated initial is downloaded.
• the segmentation does not cause the available cache of the terminal to be less than a preset cache threshold, and the updated initial segment is segmented as the selected codestream.
• the value of the preset quality threshold may be preset; or the value of the preset quality threshold is Calculated according to the segment quality weight that the terminal has downloaded; or the value of the preset quality threshold is based on the segment quality that the terminal has downloaded and the segmentation of all segments of the first time segment Mass weighted calculations.
• a second aspect of the present invention discloses a method for selecting a code stream segment based on a streaming media, where the method includes: separately obtaining segments of at least two code stream segments corresponding to a first play time of the streaming media Information and segmentation information corresponding to at least two code stream segments of the second play time, the segment information of the code stream segment of the first play time and the segment information of the code stream segment of the second play time include Segmentation quality; selecting a first code stream segment in the code stream segment corresponding to the first play time, and selecting a second code stream segment in a code stream segment corresponding to the second play time, Forming a first stream segment group, wherein the first stream segment group is a code stream segment group that can be continuously played in the terminal; and the code stream is not selected in the first code stream segment group Selecting, in the segmented segment, the code stream segment with the smallest segment quality, according to the segment quality in all the code stream segments of the first play time corresponding to the segment stream segment with the smallest segment quality Selecting the segment quality from the lowest
• the stream segment is the segment of the code stream segment having the largest segment quality among all the code stream segments at the first playing time; if the updated first code stream segment group is not in the terminal a stream segment group that is continuously played, in which the segment before the non-continuous play time or the segment in the segment that cannot be continuously played is selected in the updated first stream segment group
• the highest quality code stream segment if the updated segment of the first code stream segment group has the largest segment quality
• the third segment is a flow stream segment, then, And selecting, in all the code stream segments of the first play time or the second play time corresponding to the third code stream segment, that the segment quality is lower than the third according to the segment quality from high to low.
• the selected code stream segment obtains the second code stream segment group according to the selected code stream segment corresponding to the first play time and the selected code stream segment corresponding to the second play time.
• a method for selecting a stream segment based on streaming media according to an embodiment of the second aspect of the present invention, so that the finally selected stream segment is more fully utilized while the segment quality is closer, and the video quality is more during video playback. smooth.
• the segmentation information includes a segmentation time length and a segmentation code rate; and at least obtaining the first playback time corresponding to the streaming media
• the method further includes: obtaining cache parameter information of the terminal, and buffering parameter information of the terminal The length of time of the streaming media that is not played in the cache is obtained; the available network bandwidth of the streaming media is obtained by the terminal; and the first stream segment group is determined to be a stream segment group that can be continuously played in the terminal.
• Determining, according to the segmentation time length of the first code stream segment in the first code stream segment group, a segmentation code rate, and the available network bandwidth, a length of time for completing downloading of the first code stream segment Determining, according to the segmentation time length and the segmentation code rate of the second code stream segment in the first code stream segment group, and the available network bandwidth, the length of time for downloading the second code stream segment ;
• the sum of the length of the unplayed streaming media in the terminal cache and the segmentation time length of the first segment is not less than the length of time that the first stream segment is downloaded and the preset cache And a sum of the thresholds, and the sum of the length of the unplayed streaming media in the terminal buffer, the segmentation time length of the first segment, and the segmentation time length of the second segment is not less than the first
• the length of time that the stream segment download is completed, the second And a length of the preset buffer threshold; and the first rate segment group is a stream segment group that can be continuously played in the terminal.
• the method further includes: if the segment of the first code stream segment group after the update cannot be continuously played, or the continuous playback time The segment of the segment with the highest segment quality is not the segment of the third stream, and then, according to the segment quality, the segment quality is high to low in all the stream segments corresponding to the second playing time.
• the sequential selection segment quality is smaller than the fourth code stream segment of the updated first code stream segment group corresponding to the second play time code stream segment, and is replaced by the fourth code stream segment Updating the updated first code stream segment group in the updated first code stream segment group corresponding to the second play time code stream segment, if the updated The first stream segment group is a code stream that can be continuously played in the terminal And the segment group, the code stream segment with the smallest segment quality is selected in the segment of the unselected code stream segment in the updated first code stream segment group, and the code stream with the smallest segment quality is selected. Selecting, in all code stream segments of the first play time or the second play time corresponding to the segment, the segment quality is greater than the segment quality minimum segmentation according to the segment quality from high to low.
• the segment group is a code stream segment group that cannot be continuously played in the terminal or the updated third code stream segment is all codes corresponding to the first play time or the second play time. a segment of the stream segment having the largest segmentation quality, and repeating the above steps until the updated third stream segment is the segmentation quality of the updated first stream segment group
• the code stream segment or the fourth code stream segment is its corresponding first play time or the first All playback time code stream segment in a code segment minimum mass stream segments.
• the method further includes: obtaining, according to the second code stream segment group, the corresponding first part of the second code stream segment group The segmentation quality of the code stream segment of the playback time; if the segment quality of the code stream segment corresponding to the first play time in the second code stream segment group is greater than a preset quality threshold, The fifth code stream segment whose segment quality is smaller than the segment quality of the selected code stream segment corresponding to the first play time is sequentially selected in all the code stream segments of the first play time, and the fifth code segment is And the code stream segment is updated as the code stream segment corresponding to the first play time to update the second code stream segment group, and the step is repeated until the second code stream segment group corresponds to the first play time segment.
• the segment quality of the code stream segment is not greater than the preset quality threshold;
• the quality threshold may be preset in a fourth possible implementation manner of the second aspect of the embodiment of the present invention, or the quality threshold is based on the segment that the terminal has downloaded.
• the quality weighting is calculated; or the quality threshold is calculated according to the segment quality that the terminal has downloaded and the segment quality weight of all segments of the first time segment.
• a third embodiment of the present invention discloses a player that selects a stream segment based on a streaming media, wherein the player includes: a receiving module, where the receiving module is configured to obtain a corresponding number in the streaming media. Segmentation information of each segment of at least two segments at a time, wherein the segmentation information includes segmentation quality; an initial segmentation selection module, configured for each segment obtained according to the receiving module The segment quality and the preset quality threshold select one initial segment in at least two segments corresponding to the first time; the segment selection module, if it is determined that downloading the initial segment does not cause the terminal to play If the exception is abnormal, the segment selection module is configured to use the initial segment obtained by the initial segment selection module as the selected code stream segment.
• the player for selecting a stream segment based on streaming media according to the embodiment of the third aspect of the present invention, so that the finally selected code stream segmentation is more close to the bandwidth while the quality of the segment is closer, and the video quality is smoother during video playback. .
• the receiving module is further configured to obtain cache parameter information of the terminal, where the cache parameter information includes a preset buffer threshold; if received according to the receiving module The segmentation information of the initial segment and the cache parameter information of the terminal determine that downloading the initial segment does not cause the available cache of the terminal to be smaller than the preset cache threshold, and then determining the download site The initial segmentation does not cause the terminal to play abnormally.
• the initial segment selection module is specifically configured to: in all the segments corresponding to the first moment The segment with the smallest absolute value of the difference between the segment quality and the quality threshold is selected as the initial segment.
• the segmentation information further includes a segmentation time length and a segmentation code rate; and the cache parameter information of the terminal is further The time length of the streaming media that is not played in the cache is included; the receiving module is further configured to obtain an available network bandwidth that the terminal downloads the streaming media; and the code stream selection module is specifically configured to be used according to the initial segmentation
• the segmentation time length and the segmentation code rate and the available network bandwidth determine a length of time for completing the initial segment download; and determining a length of the unplayed streaming media in the terminal buffer and a score of the initial segmentation
• the sum of the length of the segment time is not less than the sum of the length of the initial segment download completion and the preset cache threshold, and it is considered that downloading the initial segment does not cause the available terminal cache to be smaller than the preset cache. Threshold, segmenting the initial segment as a selected codestream.
• the code stream selection module is further configured to: select, in a manner corresponding to the segment quality, in a descending order of segment quality in all segments corresponding to the first time, a second segment having a segment quality smaller than a segment quality of the initial segment And using the second segment as the updated initial segment, repeating the foregoing steps until it is determined that downloading the updated initial segment does not cause the available cache of the terminal to be smaller than a preset cache threshold, The updated initial segment is described as the selected codestream segment.
• the embodiment of the fourth aspect of the present invention discloses a terminal for selecting a stream segment based on a streaming media, wherein the terminal includes: a receiver, a processor; and the receiver is configured to obtain a corresponding in the streaming media. Segmentation information for each segment of at least two segments of the first time, wherein the segmentation information includes segmentation quality; the processor is configured to use the segmentation of each segment obtained by the receiver The segment quality and the preset quality threshold select one initial segment in at least two segments corresponding to the first time; if it is determined that downloading the initial segment does not cause the terminal to play abnormally, the processor further The initial segment obtained by the initial segment selection module is used as a segment of the selected code stream.
• the terminal for selecting a stream segment based on the streaming media enables the finally selected code stream segment to make full use of the bandwidth, the segment quality is closer, and the video quality is smoother during video playback.
• the receiver is further configured to obtain cache parameter information of the terminal, where the cache parameter information includes a preset cache threshold; Determining that downloading the initial segment does not cause the available cache of the terminal to be smaller than the preset cache according to the segmentation information of the initial segment received by the receiver and the cache parameter information of the terminal The threshold determines that downloading the initial segment does not cause the terminal to play abnormally.
• the segmentation information further includes a segmentation time length and a segmentation code rate
• the cache parameter information of the terminal is further The time length of the unplayed streaming media in the cache is included; the receiver is further configured to obtain the available network bandwidth of the terminal to download the streaming media; the processor is further configured to be configured to correspond to the first moment And selecting, in the all of the segments, the segment having the smallest absolute value of the difference between the segment quality and the quality threshold as an initial segment; according to the segmentation time length and the segmentation code rate of the initial segment and the Determining, by using the network bandwidth, a length of time for completing the initial segment downloading; and determining that a sum of a length of the unplayed streaming media in the terminal buffer and a segmentation time length of the initial segment is not less than the initial segmentation If the downloading of the initial segment does not cause the available terminal cache to be smaller than a preset cache threshold, the initial segment is selected as the selected one.
• the processor is further configured to: if the segmentation information according to the initial segmentation and the cache parameter information of the terminal Determining that downloading the initial segment causes the available cache of the terminal to be smaller than a preset cache threshold, and the code stream selection module is further configured to use all the segments corresponding to the first moment.
• FIG. 1 is a flow chart of a method for selecting a stream segment based on streaming media according to an embodiment of the first aspect of the present invention.
• FIG. 2 is another flow chart of a method for selecting a stream segment based on streaming media according to an embodiment of the first aspect of the present invention.
• FIG. 3 is a flowchart of a method for selecting a code stream segmentation based on a streaming media according to an embodiment of the second aspect of the present invention.
• FIG. 4 is a schematic structural diagram of a player for selecting a stream segment based on streaming media according to an embodiment of the third aspect of the present invention.
• FIG. 5 is a schematic structural diagram of a terminal for selecting a stream segment based on a streaming media according to an embodiment of the fourth aspect of the present invention.
• a method for selecting a stream segment based on a streaming media according to an embodiment of the present invention is described below with reference to FIG. 1. As shown in FIG. 1, the method includes:
• S11 Obtain segmentation information of each segment of the at least two segments corresponding to the first time in the streaming media, where the segmentation information includes segmentation quality.
• S12 Select an initial segment in at least two segments corresponding to the first moment according to the segment quality and the preset quality threshold of each segment.
• the initial segment is segmented as the selected code stream.
• the method for selecting a stream segment based on streaming media enables the finally selected code stream segmentation to make full use of bandwidth while the segment quality is closer, and the video quality is smoother during video playback.
• a method for selecting a code stream segment based on a streaming media according to an embodiment of the present invention is described below with reference to FIG. 2. As shown in FIG. 2, the method includes: S21: Obtain segmentation information.
• the terminal obtains the information of the segment Fij of the code stream of the program by parsing the information of the MPD (media presentation descriptor), the segmentation duration information Dij, and the segmentation rate.
• the information may be a PSNR (Peak Signal to Noise Ratio) value, a SIMM (Structural SIMilarity), a MOS (MeanOpinion Score), or other subjective objective quality data or quality. Rating information.
• the size of the segmentation quality described below refers to the result of the segmentation quality represented by the quality data or the quality classification information, rather than specifically the numerical value of the quality data or the quality classification information; i, j Is an integer greater than 0.
• the unit of code rate in the table is (kbps)
• the unit of PSNR is (db)
• the data set forth in this table is only an example for the purpose of understanding the embodiments of the present invention, and is not intended to be a limitation of the embodiments of the present invention.
• the code rate, quality and duration of the stream segment can have other values.
• the time segmentation can also take 2 segments, 4 segments and so on.
• the manner in which the segmentation information is obtained in the embodiment of the present invention and the content of the segmentation information also include other modes that other ordinary people skilled in the art can implement without creative labor.
• the segmentation quality may be obtained by the MPD, may also be obtained from a media data stream sent by the server, or may be sent by the server to other communication or data transmission methods that can be conceived by those skilled in the art. terminal.
• the time length Tbuf of the unplayed streaming media content in the cache may be obtained by detecting the media cache.
• Tb Uf 6s.
• the cache information may be sent by the terminal to the server, or may be estimated on the server side. It can be understood that, in general, the server side does not need to obtain the cache information, which is generally performed on the terminal side. Only when the server side applies the selective code stream segmentation method according to the embodiment of the present invention, the server side Only need to get the cache information.
• the representation manner of the media cache information may be represented by the length of time of the unplayed streaming media content in the terminal cache, or may be represented by the amount of data that can be stored in the terminal cache, where the length of time is used to indicate the cache information.
• the buffer overflow may refer to "cache is less than a certain threshold", and the threshold may be 0 or 1 or the like.
• the available bandwidth BW (Bandwidth) 1000 kbps.
• the method of obtaining the available bandwidth value can be either measured or estimated by the terminal itself, or the available bandwidth value can be sent to the terminal after the server measures or estimates.
• the average of the segmentation quality is obtained by the quality threshold), or the value calculated from the quality of the segment that has been downloaded and the quality of the segment to be downloaded (the segment quality that has been downloaded and the value to be downloaded can be separately assigned)
• the weight values of the segments are different in quality, and the quality threshold is obtained by weighting calculation). It can be understood that the foregoing method for obtaining the quality threshold is only an example for facilitating understanding of the embodiment of the present invention, and is not considered as a limitation on the embodiment of the present invention. Those skilled in the art can realize without creative labor. Other ways.
• the threshold interval may be selected (static or dynamic) to be a quality threshold interval such as [QTH1, QTH2] or (QTH1, QTH2) or (QTH1, QTH2) or [QTH1, QTH2), quality
• the expression of the threshold interval may also be in other ways such as the quality threshold upper limit QTH2 and the downward fluctuation range DeltaQ2, the quality threshold lower limit QTH1 and the upward fluctuation range DeltaQl, the quality threshold QTH and the upper and lower fluctuation ranges DeltaQl, DeltaQ2 and the like. It is to be understood that the above-described selection of the quality threshold interval is merely an example for facilitating understanding of the embodiments of the present invention, and is not a limitation of the embodiments of the present invention.
• segment selection first select the code stream segment whose segment quality is closest to the quality threshold as the initial segment, and then judge whether the download initial segment will cause the terminal buffer overflow, if it does not cause the terminal buffer overflow, then select If the terminal buffer overflow occurs, the code stream segment with the segment quality smaller than the initial segment is selected in descending order in the code stream segment, and it is determined whether downloading the segment will cause the terminal buffer to overflow or not. This step terminates the operation until the selected stream segment does not cause the terminal buffer to overflow.
• a segment that can fully utilize bandwidth and buffer resources is first selected, and then a quality/code rate of a segment whose final segment quality is greater than a quality threshold QTH is lowered; And/or up-scaling the quality/code rate of the segment of mass less than QTH.
• the quality or rate reduction may be a segmentation of a quality higher than QTH, a codestream segment with a quality lower than QTH, or a segment of a quality threshold QTH with the closest quality selected.
• the same quality or rate up-scaling can be to abandon the segment whose quality is lower than QTH, select the segment of the code stream whose quality is higher than QTH, or the segment of the quality threshold QTH that is the closest to the quality.
• the initially selected code stream segment is F21
• F11 is selected.
• Lowering the quality means selecting the segment with PSNR less than F21, and selecting F31 in the table; then comparing the PSNR value of the selected segment with the quality threshold QTH to determine whether the selection is appropriate, if not Continue with the selection of the stream segmentation.
• the up-and-down adjustment of the segment quality of the code stream is only a specific example to help understand the embodiment of the present invention, instead of the embodiment of the present invention. A limitation.
• a method for selecting a stream segment based on a streaming media so that the quality of the selected stream segment is close to a quality threshold, thereby ensuring that the selected segment quality is within a relatively close range. , greatly reducing the quality volatility during segment playback, making the video playback quality smoother, effectively improving the user experience of watching the program.
• a method for selecting a code stream segment based on a streaming media according to an embodiment of the present invention is described below with reference to FIG. 3. As shown in FIG. 3, the method includes:
• the terminal acquires the information of the segment Fij of the code stream of the program, the segmentation duration information Dij, the segmented code rate information Rij, and the segmented quality information Qij by parsing the MPD information.
• Fij denotes the jth segment of the code stream i
• Dij denotes the length of time in which the segment Fij is played
• Rij is the piece rate information of the segment
• Qij is the piecewise quality information
• the information may be the segmented PSNR ( Peak Signal to Noise Ratio, SIMM (Structural SIMilarity), MOS (MeanOpinion Score), or other subjective objective quality data or quality rating information.
• the size of the segmentation quality refers to the result of representing the segmentation quality represented by the quality data or the quality classification information, rather than specifically the numerical value of the quality data or the quality classification information; i, j is an integer greater than zero.
• the unit of the code rate in the table is (kbps)
• the unit of PSNR is (db)
• the segmentation quality may be obtained by the MPD, may also be obtained from a media data stream sent by the server, or may be sent by the server to other communication or data transmission methods that can be conceived by those skilled in the art. terminal.
• the cache information may be sent by the terminal to the server, or may be estimated on the server side. It can be understood that, in general, the server side does not need to obtain the cache information, which is generally performed on the terminal side. Only when the server side applies the selective code stream segmentation method according to the embodiment of the present invention, the server side Only need to get the cache information.
• the representation manner of the media cache information may be represented by the length of time of the unplayed streaming media content in the terminal cache, or may be represented by the amount of data that can be stored in the terminal cache, where the length of time is used to indicate the cache information.
• the manner is merely an example made to help understand the embodiment of the present invention.
• other methods such as the amount of data that the terminal cache can store can be used, which can be realized by other people in the field without creative labor.
• the available bandwidth BW (Bandwidth) 1000 kbps.
• the method of obtaining the available bandwidth value may be measured or estimated by the terminal itself, or may be sent to the terminal by the server after measuring or estimating the available bandwidth value.
• a set of segment groups [F21, F22, F33] capable of continuous playback is selected.
• a method for selecting a segment group that can be continuously played continuously is specifically described.
• a group of initial segment groups [F11, F12, F13] may be randomly selected, and then judged. Whether the initial segment group can be continuously played.
• determining whether the initial segment group can be continuously played may adopt a manner of determining whether downloading the packet end may cause buffer overflow of the terminal; The condition that the segment group can be continuously played may also be whether the segment has been downloaded before a certain segment is played.
• This replacement can be either a random replacement or a replacement according to certain rules. Repeat this step until you find the initial segment group that can be played continuously.
• the rule of replacing the code stream segment of the initial segment group may be that, in each moment, the segment quality is selected according to the segment quality order, which is lower than other segments in the current segment group.
• the stream segment is segmented as a stream to be replaced at that time in the segment group.
• the binning operation may first select a segment group having the smallest code stream quality among the plurality of segments at each time, and combine the data shown in the above table. You can first select the segment group as [F31, F32, F33], and then judge whether the segment group can be played continuously. If it can play continuously, the segment group [F31, F32, F33] is determined to be able to play continuously. Segmentation group. It is to be understood that the above-described manner of selecting a group of segments that can be played in a continuous manner is only an example for facilitating understanding of the embodiments of the present invention, and is not to be considered as a limitation on the embodiments of the present invention.
• S35 Select the segment with the smallest segment quality for processing in the initial segment group capable of continuous playback.
• the segment with the smallest segment quality is selected among the segment groups that can be continuously played in the segment selection selected in step S34.
• the code segment with the highest value may be selected as the segment with the lowest quality. This will not be repeated here.
• the operation at this time is to sequentially select the code stream segment whose segment quality is greater than F33 in the plurality of code stream segments corresponding to the time t3, as shown in the table, at this time, select The stream segment is F23, that is, the new segment group is [F21, F32, F23].
• S36 Determine whether the new segment group can be played continuously.
• steps S35 and S36 are repeated, and the found minimum quality segment is F23, and the code rate of the segment selected at time t3 is F13, and the first two segments are unchanged, so only t3 is calculated.
• S37 Select to process the segment with the highest segment quality before the segment can not be played continuously.
• step S36 Select the highest quality segment before the segment can not be played continuously (including segments that cannot play consecutive points), such as segmentation at time t2, F22; select the segment with lower segment quality than F22 in segmentation at time t2 Segment, go to step S36; if the selected highest quality segment is the segment after the low-quality segment lifting code rate selected in step S35, then the segmentation code rate is lowered (ie, re-selecting the previous step S35)
• the selected code stream segment where the promotion and down adjustment refer to the relative change of the segment quality or code rate selected in the code stream segment at a certain moment and the previously selected segment, rather than the pair
• the segment will not participate in the subsequent quality adjustment; when all segments do not participate in the adjustment or can no longer increase the code rate, the adjustment ends, and the process goes to step S38. (In the subsequent loop adjustment, the number of segments that do not participate in the quality adjustment is more and more, and finally the code rate of all the segments is not adjusted, and the adjustment ends).
• step S35 continue to select the lowest quality segment F32 in [F21, F32], the new combination is [F21, F22, F13]; the combination has been calculated before, can not be played continuously, go to step S37,
• the highest quality segment before the discontinuous play point selected at this time is F22, and F22 is the segment after the lowest quality segment lifting code rate selected in step S35, and the code rate of the lower F22 is F32 (ie, the reselection point is Segment F32), F32 will not participate in the subsequent quality adjustment, the combination at this time is [F21, F32, F13], and can be continuously played, then go to step S35, at this time, the segment for adjusting the code rate can be selected only F21,
• the final selected segment is [F21, F32, F13], we can see that the segment quality combination is [40, 39, 40]; the quality fluctuation is the smallest, and the combination makes full use of it. Bandwidth and cache resources.
• the buffer value in the above step may be the data amount of the media that is not played by the terminal, or may be the data amount of the media that is not played by the terminal minus a preset value.
• the segments in the segment combination may be downloaded in sequence, and then a new segment combination selection may be performed, or each segment may be downloaded again.
• the new segment combination selection is performed again.
• Another method for selecting a code stream segment based on a streaming media according to an embodiment of the present invention is described below with reference to FIG. 3, as shown in FIG. 3, after the code stream segment group is selected, the method further includes:
• the average of the segmentation quality is obtained by the quality threshold), or the value calculated from the quality of the segment that has been downloaded and the quality of the segment to be downloaded (the segment quality that has been downloaded and the value to be downloaded can be separately assigned)
• the weight values of the segments are different in quality, and the quality threshold is obtained by weighting calculation). It can be understood that the foregoing method for determining the quality threshold is only an example for helping to understand the embodiment of the present invention, and is not considered as a limitation on the embodiment of the present invention.
• the manner in which the quality threshold is obtained also includes other means that would be accomplished by one of ordinary skill in the art without the need for creative labor.
• the threshold interval may be selected (static or dynamic) to be a quality threshold interval such as [QTH1, QTH2] or (QTH1, QTH2) or (QTH1, QTH2) or [QTH1, QTH2), quality
• the expression of the threshold interval may also be in other ways such as the quality threshold upper limit QTH2 and the downward fluctuation range DeltaQ2, the quality threshold lower limit QTH1 and the upward fluctuation range DeltaQl, the quality threshold QTH and the upper and lower fluctuation ranges DeltaQl, DeltaQ2 and the like. It is to be understood that the above-described selection of the quality threshold interval is merely an example for facilitating understanding of the embodiments of the present invention, and is not a limitation of the embodiments of the present invention.
• step S310 Adjust the selected code stream segment group according to the quality threshold QTH to obtain a final segment group.
• the code stream segment group selected in step S38 is adjusted according to the quality threshold value QTH obtained in step S9.
• the quality of the stream segment with a quality higher than QTH is lowered to below QTH (that is, the stream segment with the segmentation quality lower than QTH is selected), or the quality of the segment may be down-regulated to the closest quality threshold.
• QTH The quality of the segment after the adjustment is close to the quality threshold, thus ensuring that the selected segment quality is relatively close, and the quality volatility after segmentation is greatly reduced. Improve the subjective quality of the user watching the program.
• the cache value may be the amount of data of the media that is not played by the terminal, or may be the amount of data of the media that is not played by the terminal minus one value.
• the device includes: a receiving module 401, an initial segment selecting module 402, and segment selection. Module 403.
• the receiving module 401 is configured to obtain segmentation information, media cache information, and network bandwidth in an embodiment of the present invention.
• the receiving module 401 can be configured to receive MPD information sent by the server.
• the information is obtained by acquiring the information of the segment Fij of the code stream of the program, the segmentation duration information Dij, the segmented code rate information Rij, and the segmented quality information Qij;
• Fij represents the jth segment of the code stream i, Dij Indicates the length of time for the playback of the segmentation Fij, Rij is the piece rate information of the segment, Qij is the piecewise quality information, and the information may be the PSNR (Peak Signal to Noise Ratio) value of the segment, SIMM (Structural SIMilarity, structural similarity), MOS (MeanOpinionScore), or other subjective objective quality data or quality grading information.
• PSNR Peak Signal to Noise Ratio
• SIMM Structural SIMilarity, structural similarity
• MOS MeanOpinionScore
• the quality grading information represents a result indicating the quality of the segmentation, rather than specifically the numerical value of the quality data or the quality grading information; i, j is an integer greater than zero.
• the receiving module 401 can obtain the time length Tbuf of the unplayed media content in the cache by detecting the media buffer.
• the receiving module 401 can also obtain the available bandwidth of the terminal to download the media data.
• the initial segment selection module 402 is configured to first select a code stream segment whose segment quality is closest to the quality threshold as the initial segment when segment selection, and then determine, by the segment selection module 403, whether the initial segment is downloaded or not
• the terminal buffer is lower than a certain set value, and the set value may be 0, or other non-zero value. If the terminal buffer is not caused to fall below a certain set value, the segment selection module 403 selects the Segmentation; if the terminal buffer is caused to be lower than a certain set value, the segment selection module 403 continues to select the code stream segment whose segment quality is smaller than the initial segment in the descending order of the code stream segment, and then continues to judge Downloading this segment will cause the terminal buffer to be lower than a certain set value. Repeat this step until the selected stream segment does not cause the terminal buffer to fall below a certain set value. Then the operation is terminated and the output is selected. The stream segmentation.
• a segment that can fully utilize bandwidth and buffer resources is first selected, and then a quality/code rate of a segment whose final segment quality is greater than a quality threshold QTH is lowered; And/or up-scaling the quality/code rate of the segment of mass less than QTH.
• the quality or rate reduction may be a segmentation of a quality higher than QTH, a codestream segment with a quality lower than QTH, or a segment of a quality threshold QTH with the closest quality selected.
• the same quality or rate up-scaling can be to abandon the segment whose quality is lower than QTH, select the segment of the code stream whose quality is higher than QTH, or the segment of the quality threshold QTH that is the closest to the quality.
• a player 40 that selects a stream segment based on a streaming media, so that the quality of the selected stream segment is close to a quality threshold, thereby ensuring that the selected segment quality is relatively close.
• the quality volatility during segment playback is greatly reduced, which makes the video playback quality smoother and effectively improves the user experience of watching the program.
• a terminal 50 for selecting a stream segment based on a streaming media according to an embodiment of the present invention is described below with reference to FIG. 5.
• the terminal 50 includes: a receiver 501 and a processor 502.
• the terminal 50 When the user views the program, the terminal 50 first acquires the MPD, and the program-related MPD can be obtained by: the program publisher transmitting the MPD of the program to the terminal in advance; and the program publisher presenting the URL of the MPD to the terminal user, and the user passes the website Obtain MPD;
• the receiver 501 can be configured to acquire segmentation information of all code streams related to the program according to the MPD, the information including but not limited to segmentation duration information, segmentation rate information, segmentation quality information, segmentation URL Information, which may be obtained from the MPD of the program, may be obtained from other program-related information sent by the server, or may be obtained from the media stream data of the program, or may be obtained from a combination of the above methods;
• the device 501 further acquires a media buffer status of the decoder during playback of the program, and a time length or a data amount of the media data that is not played in the media cache; the receiver 501 also acquires network status information of the terminal, where the information is a network download.
• the bandwidth of the data and the fluctuation of the bandwidth, thereby estimating the available bandwidth of the downloaded media data; the receiver 501 can also acquire the information of the segment that the terminal has downloaded.
• the processor 502 determines, by the receiver 501, the amount of media data in the buffer, downloads the available bandwidth of the media data, and the obtained information of the segment to be downloaded and/or the information of the segment that has been downloaded, and determines which code stream is to be downloaded.
• the method of the processor 502 to select the code stream segment reference may be made to the foregoing embodiments of the method and apparatus, and details are not described herein again.
• the terminal further includes a sender 503, and the sender 503 obtains the segment URL selected by the processor 502 to be downloaded, and sends a GET request to the server.
• the receiver 501 is further configured to receive media data sent by the server or other response information sent by the server, or an MPD.
• the media buffer (ie, cache) of the terminal is used to store the program-related media data received by the receiver 501 that has not been decoded and played.
• the terminal further includes a display 504, the processor 502 is further configured to decode data such as media audio and video subtitles received by the receiver 501, and the display 504 is configured to display the decoded content of the processor 502. .
• the terminal 50 based on the stream media selection code stream segmenting makes the quality of the selected code stream segments relatively close, thereby ensuring that the selected segment quality is in a small difference.
• the quality volatility during segment playback is greatly reduced, which makes the video playback quality smoother and effectively improves the user experience of watching the program.
• the disclosed systems, devices, and methods may be implemented in other ways.
• the device embodiments described above are merely illustrative.
• the division of the unit is only a logical function division.
• there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed.
• the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
• each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
• the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
• the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
• the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
• the foregoing storage medium includes: a USB flash drive, a mobile hard disk, a read-only memory (ROM), and a random access memory.
• a medium that can store program code such as a RAM (RAM, Random Access Memory), a disk, or an optical disk.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Computer Networks & Wireless Communication (AREA)
• Computer Security & Cryptography (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Information Transfer Between Computers (AREA)
• Data Exchanges In Wide-Area Networks (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Publications (1)

Family

ID=51147739

Family Applications (1)

Country Status (6)

Cited By (2)

Families Citing this family (10)

Citations (3)

Family Cites Families (13)

• 2013
  • 2013-01-14 CN CN201310012242.8A patent/CN103929684B/zh active Active
  • 2013-07-23 ES ES13871204.7T patent/ES2627579T3/es active Active
  • 2013-07-23 JP JP2015544321A patent/JP6155519B2/ja active Active
  • 2013-07-23 WO PCT/CN2013/079881 patent/WO2014107951A1/zh not_active Ceased
  • 2013-07-23 KR KR1020157013302A patent/KR101708728B1/ko active Active
  • 2013-07-23 EP EP13871204.7A patent/EP2903219B1/en active Active
  • 2013-07-23 EP EP17150018.4A patent/EP3214820A1/en not_active Withdrawn

Patent Citations (3)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events