CN106941630A - A kind of method and apparatus for the code check for obtaining video slicing - Google Patents

A kind of method and apparatus for the code check for obtaining video slicing Download PDF

Info

Publication number
CN106941630A
CN106941630A CN201610006221.9A CN201610006221A CN106941630A CN 106941630 A CN106941630 A CN 106941630A CN 201610006221 A CN201610006221 A CN 201610006221A CN 106941630 A CN106941630 A CN 106941630A
Authority
CN
China
Prior art keywords
index file
captured
network data
data packet
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610006221.9A
Other languages
Chinese (zh)
Inventor
陈书炫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201610006221.9A priority Critical patent/CN106941630A/en
Publication of CN106941630A publication Critical patent/CN106941630A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a kind of method for the code check for obtaining video slicing, including:The network packet containing HLS protocol transferring content is captured at least one times;By parsing captured network packet, the data volume and reproduction time length of at least one video slicing transmitted using HLS protocol are drawn;Data volume and reproduction time length based on any one video slicing drawn, draw the code check of correspondence video slicing.The embodiment of the invention also discloses a kind of device for the code check for obtaining video slicing.

Description

Method and device for acquiring code rate of video slicing
Technical Field
The present invention relates to the field of video slicing, and in particular, to a method and an apparatus for obtaining a bit rate of a video slice.
Background
The HLS (HTTP Live streaming) protocol supports a dynamic code rate self-adaption technology and is mainly used for audio and video services of a PC (personal computer) and an Apple terminal; according to the HLS protocol, the media file is divided into a plurality of files according to the set time interval, media coding format and code rate, and the divided single file is called video fragment; all video fragments are stored in a server, and information such as each video fragment and the time length of each video fragment is stored in an index file such as an M3U8 format file; when the media file is played, the server transmits the index file to the client, and the client requests the designated video fragment from the server according to the current playing time position or user operation requirements and plays the video fragment.
The method for acquiring the video slicing code rate supported by the HLS protocol mainly comprises the following two methods: the first method is that the BANDWIDTH field of the index file in the HLS protocol is obtained; the second method is reported by a media player at the bottom of a client operating system.
For the first method, the bitrate of a video slice for reference provided by the BANDWIDTH field of the index file is generally the average bitrate of the entire media file, and is not the bitrate of a single video slice, so the bitrate obtained by the first method is often not accurate enough; for the second method, although the accuracy of the code rate of the obtained video fragment is high, the second method needs to modify an operating system of the client, such as an Android system, so that a large modification workload and high insecurity are brought; in addition, clients also typically do not have the authority to modify the operating system.
Disclosure of Invention
In order to solve the above technical problem, embodiments of the present invention are expected to provide a method and an apparatus for obtaining a bitrate of a video slice, which can accurately obtain the bitrate of the video slice.
The technical scheme of the invention is realized as follows:
the embodiment of the invention provides a method for acquiring the code rate of video slicing, which comprises the following steps:
at least one time, capturing a network data packet containing HLS protocol transmission content;
obtaining the data volume and the playing time length of at least one video fragment transmitted by utilizing the HLS protocol by analyzing the captured network data packet;
and obtaining the code rate of the corresponding video fragment based on the obtained data volume and the playing time length of any one video fragment.
In the foregoing solution, the obtaining the data amount of at least one video slice transmitted by using the HLS protocol includes: when any captured network data packet contains video fragments specified by the HLS protocol, acquiring the data volume of the video fragments specified by the HLS protocol and contained in the network data packet corresponding to one capture.
In the foregoing solution, obtaining the playing time length of at least one video slice transmitted by using the HLS protocol includes: obtaining the playing sequence of each video fragment corresponding to the index file of the video fragment based on the index file of the video fragment specified by the HLS protocol contained in the network data packet captured each time; when any captured network data packet contains video fragments specified by an HLS protocol, obtaining the starting playing time point of the corresponding video fragment based on the video fragments specified by the HLS protocol contained in the network data packet captured for the corresponding time; and when the video fragment with the acquired play starting time point is not the last video fragment arranged according to the play sequence, arranging according to the obtained play sequence of each video fragment to acquire the next video fragment of the video fragment with the acquired play starting time point, and acquiring the play time length of the video fragment with the acquired play starting time point based on the video fragment with the acquired play starting time point and the play starting time point of the next video fragment of the video fragment with the acquired play starting time point.
In the above scheme, the method further comprises: when any captured network data packet contains an index file of video fragments specified by an HLS protocol, recording the network data packet captured at one time as an index file network data packet;
the obtaining, based on the index file of the video segment specified by the HLS protocol included in the network data packet captured each time, a playing sequence of each video segment corresponding to the index file of the video segment includes:
step 101A: acquiring the sequence number seq of the index file network data packet captured for the 1 st time, and storing the index file of the video fragment of the index file network data packet captured for the 1 st time into a preset playing sequence text;
step 101B: let j be a natural number greater than 1, i be from 1 to j-1; acquiring seq of a j-th captured index file network data packet;
if the seq of the index file network data packet captured at the jth time is equal to the sum of the seq of the index file network data packet captured at the ith time and the data volume of the index file of the video fragment of the index file network data packet captured at the ith time, marking the index file network data packet captured at the ith time as a preamble packet of the index file network data packet captured at the jth time;
if the sum of the seq of the jth captured index file network data packet and the data amount of the index file of the video fragment of the jth captured index file network data packet is equal to the seq of the ith captured index file network data packet, marking the ith captured index file network data packet as a subsequent packet of the jth captured index file network data packet;
step 101C: in the index file of the video fragment of the jth captured index file network data packet, if the beginning of any line of character strings is "# extinn" and at least one line of character strings not beginning with "#" exists in the subsequent lines of character strings, in the playing sequence text, inserting the index file of the video fragment of the jth captured index file network data packet behind the index file of the video fragment of the preorder packet of the jth captured index file network data packet or in front of the index file of the video fragment of the subsequent packet of the jth captured index file network data packet;
step 101D: obtaining the playing sequence of each video fragment corresponding to the playing sequence text according to the arrangement sequence of each index file in the playing sequence text; and the playing sequence of each video fragment corresponding to the index file of the video fragment is the playing sequence of each video fragment corresponding to the playing sequence text.
In the above scheme, the method further comprises: in step 101B, if the seq of the jth fetched network packet of the index file is equal to the seq of the ith fetched network packet of the index file, the value of j is incremented by 1, and step 101B is executed again.
In the foregoing scheme, the step 101B further includes: and when the preorder packet and the postorder packet of the jth captured index file network data packet do not exist and the seq of the index file network data packet captured at the previous j-1 time is smaller than the seq of the index file network data packet captured at the jth time, storing the index file of the video fragment of the index file network data packet captured at the jth time behind the index file of the video fragment of the index file network data packet captured at the previous j-1 time in the playing sequence text.
In the foregoing scheme, the step 101B further includes: when the seq of the index file network data packet captured at least one time is larger than the seq of the index file network data packet captured at the jth time in the index file network data packets captured at the first j-1 time, finding out the index file network data packet with the smallest difference between the seq and the seq of the index file network data packet captured at the jth time from the index file network data packets with the seq larger than the seq of the index file network data packet captured at the jth time, and marking the found index file network data packet as a post packet of the index file network data packet captured at the jth time;
the step 101C further includes: in the index file of the video fragment of the jth captured index file network data packet, if the beginning of any line of character strings is "# extinn" and at least one line of character strings not beginning with "#" exists in the subsequent lines of character strings, in the playing sequence text, the index file of the video fragment of the jth captured index file network data packet is inserted before the index file of the video fragment of the subsequent packet of the jth captured index file network data packet.
In the foregoing scheme, after step 101B, the method further includes: when at least one line of character string ending with '\ n' exists in the index file of the video fragment of the index file network data packet captured at the jth time, taking the first line of character string ending with '\ n' as the head of the index file of the video fragment of the index file network data packet captured at the jth time;
when the last row of character strings of the index file of the video fragment of the jth captured index file network data packet does not end with '\ n', marking the last row of character strings of the index file of the video fragment of the jth captured index file network data packet as the tail of the index file of the video fragment of the jth captured index file network data packet;
merging the head of the index file of the video fragment of the jth captured index file network data packet and the tail of the index file of the video fragment of the preorder packet of the jth captured index file network data packet into a first row of character strings of the index file of the video fragment of the jth captured index file network data packet when the head of the index file of the video fragment of the jth captured index file network data packet and the tail of the index file of the video fragment of the preorder packet of the jth captured index file network data packet both exist; jumping to the step 101C;
merging the tail part of the index file of the video fragment of the jth captured index file network data packet and the head part of the index file of the video fragment of the subsequent packet of the jth captured index file network data packet into the last line of character strings of the index file of the video fragment of the jth captured index file network data packet when the tail part of the index file of the video fragment of the jth captured index file network data packet and the head part of the index file of the subsequent packet of the jth captured index file network data packet both exist; after that, the process proceeds to step 101C.
In the foregoing solution, the obtaining a playing start time point of a corresponding video segment based on the video segment specified by the HLS protocol included in the network data packet captured for one time includes: finding out a first TS packet in the video fragments specified by the HLS protocol contained in the network data packets captured at the corresponding time; and acquiring a program clock reference PCR value contained in the found first TS packet, and acquiring a playing starting time point of the corresponding video fragment based on the acquired PCR value.
In the foregoing solution, the obtaining a playing time length of at least one video slice transmitted by using the HLS protocol includes: when any captured network data packet contains an index file of video fragments specified by an HLS protocol, finding out mark duration information of each corresponding video fragment from the index file of the video fragment specified by the HLS protocol contained in the network data packet captured at one time; and obtaining the playing time length of each corresponding video fragment based on the found mark time length information of each corresponding video fragment.
In the foregoing solution, the obtaining a playing time length of at least one video slice transmitted by using the HLS protocol includes: when any captured network data packet contains video fragments specified by an HLS protocol, finding out the video fragments specified by the HLS protocol contained in the network data packet captured at the corresponding time; in the found video fragments, a first PCR value and a last PCR value are found out according to the arrangement sequence of characters; and subtracting the first PCR value from the last PCR value to obtain the playing time length of the found video fragment.
In the above scheme, the HLS protocol transmission content includes at least one of the following files: video clips, index files for video clips.
The embodiment of the invention also provides a device for acquiring the code rate of the video fragment, which comprises the following steps: the device comprises a grabbing module, an analyzing module and a code rate obtaining module; wherein,
the grabbing module is used for grabbing the network data packet containing the HLS protocol transmission content at least once;
the analysis module is used for analyzing the captured network data packet to obtain the data volume and the playing time length of at least one video fragment transmitted by utilizing the HLS protocol;
and the code rate obtaining module is used for obtaining the code rate of the corresponding video fragment based on the obtained data volume and the playing time length of any one video fragment.
In the foregoing scheme, the parsing module is specifically configured to, when a network data packet captured at any time contains a video fragment specified by an HLS protocol, obtain a data amount of the video fragment specified by the HLS protocol and contained in the network data packet captured at the corresponding time.
In the foregoing solution, the parsing module is specifically configured to obtain, based on the index file of the video segment specified by the HLS protocol included in the network data packet captured each time, a playing sequence of each video segment corresponding to the index file of the video segment; when any captured network data packet contains video fragments specified by an HLS protocol, obtaining the starting playing time point of the corresponding video fragment based on the video fragments specified by the HLS protocol contained in the network data packet captured for the corresponding time; and when the video fragment with the acquired play starting time point is not the last video fragment arranged according to the play sequence, arranging according to the obtained play sequence of each video fragment to acquire the next video fragment of the video fragment with the acquired play starting time point, and acquiring the play time length of the video fragment with the acquired play starting time point based on the video fragment with the acquired play starting time point and the play starting time point of the next video fragment of the video fragment with the acquired play starting time point.
In the foregoing solution, the parsing module is specifically configured to find out a first TS packet in the video fragment specified by the HLS protocol included in the network data packet captured at a corresponding time; and acquiring a program clock reference PCR value contained in the found first TS packet, and acquiring a playing starting time point of the corresponding video fragment based on the acquired PCR value.
In the above scheme, the HLS protocol transmission content includes at least one of the following files: video clips, index files for video clips.
In the method and the device for acquiring the code rate of the video slicing, provided by the embodiment of the invention, a network data packet containing HLS protocol transmission content is captured at least once; obtaining the data volume and the playing time length of at least one video fragment transmitted by utilizing the HLS protocol by analyzing the captured network data packet; obtaining the code rate of the corresponding video fragment based on the obtained data volume and the playing time length of any one video fragment; therefore, the code rate of the video fragments can be accurately obtained, the operating system of the client does not need to be modified, and the efficiency of obtaining the code rate of the video fragments is improved.
Drawings
FIG. 1 is a flowchart illustrating a method for obtaining a bitrate of video slices according to a first embodiment of the present invention;
fig. 2 is a schematic structural diagram of a device for obtaining a code rate of video slicing according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
First embodiment
Fig. 1 is a flowchart of a method for obtaining a bitrate of a video slice according to a first embodiment of the present invention, as shown in fig. 1, the flowchart includes:
step 100: at least one time, capturing a network data packet containing HLS protocol transmission content;
here, the HLS protocol transmission content includes at least one of the following files: video clips and index files of the video clips; illustratively, the video clips may be TS media clip files, and the index file of the video files may be M3U8 format files;
in practical application, the corresponding video fragment can be searched and played according to the index file of the video fragment; specifically, the index file of the video fragment includes a Uniform Resource Locator (URL) of at least one video fragment, so that the corresponding video fragment can be found according to the URL of the video fragment in the index file.
In this step, for example, the network data packet capture function library Libpcap may be used to capture the network data packet, and Libpcap is a network data packet capture function package under the unix/linux platform, on which most network monitoring software is based. Libpcap can work under most unix-like platforms.
In practical application, a network data packet containing transmission content of the HLS protocol can be captured from a transmission path of video data of the HLS protocol; the grabbed network packets may be TCP packets.
Step 101: and analyzing the captured network data packet to obtain the data volume and the playing time length of at least one video fragment transmitted by utilizing the HLS protocol.
In this step, obtaining the data size of at least one video slice transmitted by using the HLS protocol includes: judging whether the network data packet captured each time contains video fragments specified by an HLS protocol or not by analyzing the network data packet captured each time; and when the network data packet captured at any time contains the video fragment specified by the HLS protocol, acquiring the data volume of the video fragment specified by the corresponding HLS protocol.
Here, when any captured network packet contains video slices specified by the HLS protocol, a plurality of existing implementations may be adopted to obtain the data volume of the corresponding video slices specified by the HLS protocol, and details are not described here.
Here, when determining whether each captured network packet contains video fragments specified by the HLS protocol, specifically, if the URL of any captured network packet contains the character string ". ts", it indicates that the network packet corresponding to one time contains video fragments specified by the HLS protocol;
it should be noted that, in the embodiment of the present invention, the quotation marks used for describing the content of the character string only describe the reference relationship, and do not represent the content of the character string; for example, the quotation marks in the ". ts" are used for illustrative purposes only and do not represent the contents of a character string.
Specifically, when analyzing each captured network packet, analyzing a TCP session corresponding to each captured network packet and an HTTP protocol session in the TCP session, and if a URL requested by any one HTTP protocol session includes a character string ". ts", it indicates that the URL corresponding to the captured network packet at one time includes the character string ". ts".
Here, when any captured network data packet contains video fragments specified by the HLS protocol, the video fragments specified by the HLS protocol are TS media fragment files; illustratively, the video slices specified by the HLS protocol include at least one TS packet, and the data size of each TS packet is 188 bytes.
In this step, the playing time length of at least one video fragment transmitted by using the HLS protocol may be obtained according to the first obtaining manner, the second obtaining manner, or the third obtaining manner; these three acquisition modes will be described below.
Specifically, the obtaining the playing time length of the at least one video slice transmitted by using the HLS protocol according to the first obtaining manner includes: judging whether the network data packet captured each time contains video fragments specified by an HLS protocol or an index file of the video fragments specified by the HLS protocol by analyzing the captured network data packet each time; obtaining the playing sequence of each video fragment corresponding to the index file of the video fragment based on the index file of the video fragment specified by the HLS protocol contained in the network data packet captured each time; when any captured network data packet contains video fragments specified by an HLS protocol, obtaining the starting playing time point of the corresponding video fragment based on the video fragments specified by the HLS protocol contained in the network data packet captured for the corresponding time; and when the video fragment with the acquired play starting time point is not the last video fragment arranged according to the play sequence, arranging according to the obtained play sequence of each video fragment to acquire the next video fragment of the video fragment with the acquired play starting time point, and acquiring the play time length of the video fragment with the acquired play starting time point based on the video fragment with the acquired play starting time point and the play starting time point of the next video fragment of the video fragment with the acquired play starting time point.
Here, when determining whether each captured network packet contains an index file of a video slice specified by the HLS protocol, specifically, if the URL of any captured network packet contains the character string ". m3u 8", it indicates that the network packet corresponding to one captured contains an index file of a video slice specified by the HLS protocol; it should be noted that the quotation marks in the ". m3u 8" are used for illustrative reference only and do not represent the content of the character string.
Specifically, when each captured network packet is parsed, the TCP session corresponding to each captured network packet and the HTTP protocol session in the TCP session are analyzed, and if the URL requested by any one of the HTTP protocol sessions includes the character string ". m3u 8", it is described that the URL corresponding to the captured network packet at one time includes the character string ". m3u 8".
It can be understood that, since the index file of the video slice includes a Uniform Resource Locator (URL) of at least one video slice, the index file of the video slice specified by the HLS protocol corresponds to at least one video slice; in this way, the data volume of at least one video slice transmitted by using the HLS protocol obtained in this step is the data volume of each video slice corresponding to the index file of the video slice specified by the HLS protocol.
In this step, for convenience of description, the network data packet captured at any time contains an index file of video fragments specified by the HLS protocol, and the network data packet captured at the corresponding time is referred to as an index file network data packet; the obtaining, based on the index file of the video segment specified by the HLS protocol included in the network data packet captured each time, a playing sequence of each video segment corresponding to the index file of the video segment includes:
step 101A: and acquiring the sequence number (seq) of the index file network data packet captured for the 1 st time, and storing the index file of the video fragment of the index file network data packet captured for the 1 st time into a preset playing sequence text.
Here, the preset playing sequence text is initially a blank text; obviously, the index file of the video fragment of the index file network data packet captured at the 1 st time can be stored at any position of the preset playing sequence text; for example, the index file of the video clip of the index file network packet grabbed 1 st time may be stored at the beginning of the preset play order text.
Step 101B: let j be a natural number greater than 1, i be from 1 to j-1; and acquiring the seq of the network data packet of the index file captured at the jth time.
And if the seq of the jth captured index file network data packet is equal to the sum of the seq of the ith captured index file network data packet and the data volume of the index file of the video fragment of the ith captured index file network data packet, marking the ith captured index file network data packet as a preamble packet of the jth captured index file network data packet.
And if the sum of the seq of the jth captured index file network data packet and the data quantity of the index file of the video fragment of the jth captured index file network data packet is equal to the seq of the ith captured index file network data packet, marking the ith captured index file network data packet as a subsequent packet of the jth captured index file network data packet.
Further, in step 101B, if the seq of the jth captured index file network packet is equal to the seq of the ith captured index file network packet, it indicates that the jth captured index file network packet is a duplicate packet, and at this time, the value of j is increased by 1, and step 101B is executed again.
In this step, if neither the pre-order packet nor the post-order packet of the jth captured index file network data packet exists, it is indicated that the jth captured index file network data packet may be an out-of-order packet, at this time, the index files of the video segments of the jth captured index file network data packet are correspondingly processed, and the following detailed description is provided.
And when the preorder packet and the postorder packet of the jth captured index file network data packet do not exist and the seq of the index file network data packet captured at the previous j-1 time is smaller than the seq of the index file network data packet captured at the jth time, storing the index file of the video fragment of the index file network data packet captured at the jth time behind the index file of the video fragment of the index file network data packet captured at the previous j-1 time in the playing sequence text.
And when the seq of the index file network data packet captured at least one time in the index file network data packets captured at the previous j-1 times does not exist, finding out the index file network data packet with the smallest difference between the seq and the seq of the index file network data packet captured at the jth time from the index file network data packets with the seq larger than the seq of the index file network data packet captured at the jth time, and marking the found index file network data packet as a post packet of the index file network data packet captured at the jth time.
Step 101C: in the index file of the video fragment of the jth captured index file network data packet, if the beginning of any line of character strings is "# extinn" and at least one line of character strings not beginning with "#" exists in the following lines of character strings, in the play order text, the index file of the video fragment of the jth captured index file network data packet is inserted behind the index file of the video fragment of the preorder packet of the jth captured index file network data packet, or the index file of the video fragment of the jth captured index file network data packet is inserted in front of the index file of the video fragment of the postorder packet of the jth captured index file network data packet.
It should be added that, in the index file of the video segment of the jth captured index file network data packet, if the beginning of any line of character strings is "# extinn", at least one line of character strings not beginning with "#" exists in the subsequent lines of character strings, and neither the preamble packet nor the subsequent packet of the jth captured index file network data packet exists, the index file of the video segment of the jth captured index file network data packet is inserted in front of the index file of the video segment of the subsequent packet of the jth captured index file network data packet in the play sequence text.
Step 101D: and after the insertion process of the effective data of the jth captured index file network data packet is finished, obtaining the playing sequence of each video fragment corresponding to the playing sequence text according to the arrangement sequence of each index file in the playing sequence text.
Here, each index file in the playing sequence text corresponds to at least one video file, and thus, the playing sequence of each video fragment corresponding to the playing sequence text is obtained according to the arrangement sequence of each index file in the playing sequence text and the sequence of at least one video file corresponding to each index file of the playing sequence text.
The arrangement sequence of each index file in the playing sequence text is the playing sequence of each corresponding video fragment; illustratively, each index file in the playing sequence text includes URLs of one or more video files arranged in sequence, and each index file in the playing sequence text also has a corresponding arrangement sequence, so that the playing sequence of each video slice corresponding to the playing sequence text can be obtained based on the arrangement sequence of each index file in the playing sequence text and the arrangement sequence of at least one URL in each index file of the playing sequence text.
Further, after step 101B, when at least one line of character string ending with "\ n" exists in the index file of the video segment of the jth captured index file network data packet, taking the first line of character string ending with "\ n" as the header of the index file of the video segment of the jth captured index file network data packet; here, the ending character string of a line character string ending with "\ n" may be "\ r \ n".
After step 101B, when the last row of character strings of the index file of the video segment of the jth captured index file network data packet does not end with "\\ n", the last row of character strings of the index file of the video segment of the jth captured index file network data packet is marked as the tail of the index file of the video segment of the jth captured index file network data packet.
If the head of the index file of the video fragment of the jth captured index file network data packet and the tail of the index file of the video fragment of the preorder packet of the jth captured index file network data packet both exist, merging the head of the index file of the video fragment of the jth captured index file network data packet and the tail of the index file of the video fragment of the preorder packet of the jth captured index file network data packet into a first row of character strings of the index file of the video fragment of the jth captured index file network data packet; then, jumping to the step 101C;
merging the tail part of the index file of the video fragment of the jth captured index file network data packet and the head part of the index file of the video fragment of the subsequent packet of the jth captured index file network data packet into the last row of character strings of the index file of the video fragment of the jth captured index file network data packet if the tail part of the index file of the video fragment of the jth captured index file network data packet and the head part of the index file of the subsequent packet of the jth captured index file network data packet exist; after that, the process proceeds to step 101C.
It should be noted that, in step 101C, if the beginning of any line of character strings in the index file of the video segment of the index file network data packet grabbed at the jth time is "# EXTM 3U", the corresponding line of character strings is identified as the beginning of the index file of the video segment in the play order text; in the index file of the video segment of the jth captured index file network data packet, if the beginning of any line of character strings is "# EXT-X-ENDLIST", the corresponding line of character strings is identified as the end of the index file of the video segment in the playing sequence text.
In step 101, the obtaining a play start time point of a corresponding video fragment based on the video fragment specified by the HLS protocol included in the network data packet captured at a corresponding time includes: finding out a first TS packet in the video fragments specified by the HLS protocol contained in the network data packets captured at the corresponding time; and acquiring a Program Clock Reference (PCR) value contained in the found first TS packet, and obtaining the playing starting time point of the corresponding video fragment based on the acquired PCR value.
Here, the video slice specified by the HLS protocol included in the network data packet captured at any one time is composed of a plurality of TS packets; illustratively, the data size of each TS packet is 188 bytes, and each TS packet contains two parts: a header and a payload, wherein the header includes synchronization information, packet information, and the like; finding out the first continuous character meeting the following conditions according to the arrangement sequence of the characters in the video fragments specified by the HLS protocol contained in the network data packet captured at any time: the first byte value is 0x47 and the data size is 188 bytes; thus, the consecutive characters found are the first TS packets.
Here, the found first TS packet may be recorded as a buffer array of 188 bytes, and when the adaptive region identifier and the PCR identifier of the first TS packet are both 1, the play start time point of the corresponding video segment is obtained based on the first 33 bits of the adaptive field of the found first TS packet; specifically, the adaptation field of the first TS packet is 6 bytes in total, specifically, the 7 th byte to the 11 th byte of the first TS packet.
It is understood that the adaptation field of the first TS packet is identified as the 3 rd bit of the 4 th byte of the first TS packet, and the PCR of the first TS packet is identified as the 4 th bit of the 6 th byte of the first TS packet.
In step 101, the deriving a playing time length of the video segment for which the playing start time point is derived based on the video segment for which the playing start time point is derived and the playing start time point of the next video segment of the video segment for which the playing start time point is derived includes: and subtracting the play starting time point of the video segment of which the play starting time point is obtained from the play starting time point of the next video segment of the video segment of which the play starting time point is obtained, so as to obtain the play time length of the video segment of which the play starting time point is obtained.
Specifically, the obtaining the playing time length of the at least one video slice transmitted by using the HLS protocol according to the second obtaining manner includes: judging whether the network data packet captured each time contains an index file of video fragments specified by an HLS protocol or not by analyzing the captured network data packet each time; when any captured network data packet contains an index file of video fragments specified by an HLS protocol, finding out mark duration information of each corresponding video fragment from the index file of the video fragment specified by the HLS protocol contained in the network data packet captured at one time; and obtaining the playing time length of each corresponding video fragment based on the found mark time length information of each corresponding video fragment.
It can be understood that, if the index file of the video slice specified by the HLS protocol is included in any captured network packet, the index file of the video slice specified by the HLS protocol corresponding to the captured network packet corresponds to at least one video slice.
Here, after the playing time length of any one video slice corresponding to the index file of the video slice specified by the HLS protocol is obtained according to the first obtaining mode or the second obtaining mode, the data size of the corresponding video slice can be found out from the obtained data size of at least one video slice transmitted by using the HLS protocol according to the corresponding relationship between the index file of the existing video slice and the video slice; in this way, the data volume and the playing time length can be obtained for any video fragment corresponding to the index file of the video fragment specified by the HLS protocol.
Here, the correspondence between the index file of the video slice and the video slice may be: and the corresponding relation between the URL information recorded in the index file of the video fragment and the URL of the video fragment.
Specifically, the obtaining the playing time length of the at least one video slice transmitted by using the HLS protocol according to the third obtaining manner includes: judging whether the network data packet captured each time contains video fragments specified by an HLS protocol or not by analyzing the captured network data packet each time; when any captured network data packet contains video fragments specified by an HLS protocol, finding out the video fragments specified by the HLS protocol contained in the network data packet captured at the corresponding time; in the found video fragments, a first PCR value and a last PCR value are found out according to the arrangement sequence of characters; and subtracting the first PCR value from the last PCR value to obtain the playing time length of the found video fragment.
Here, the first PCR value found is usually located in the first TS packet of the corresponding video slice, and the last PCR value found is usually located in the last TS packet of the corresponding video slice.
Step 102: and obtaining the code rate of the corresponding video fragment based on the obtained data volume and the playing time length of any one video fragment.
The method specifically comprises the following steps: and dividing the data volume of any one video fragment by the playing time length of the corresponding video fragment to obtain the code rate of the corresponding video fragment.
As will be understood by those skilled in the art, the bit rate of a video slice indicates the amount of data of the video slice data transmitted per unit time, and the unit of the amount of data may be a bit (bit).
It should be noted that, if the playing time length is obtained based on the first obtaining manner in step 101, when the video segment where the playing start time point is obtained is the last video segment arranged according to the playing sequence, the average value of the code rates of the video segments arranged according to the playing sequence obtained based on this step is used as the code rate of the video segment where the playing start time point is obtained.
By applying the method for acquiring the code rate of the video fragment of the first embodiment of the invention, the code rate of the video fragment can be acquired more accurately, and the efficiency of acquiring the code rate of the video fragment can be improved without modifying an operating system of a client.
Second embodiment
Aiming at the method for obtaining the code rate of the video fragments in the first embodiment of the invention, the second embodiment of the invention also provides a device for obtaining the code rate of the video fragments.
Fig. 2 is a schematic structural diagram of a device for obtaining a bitrate of video slicing according to an embodiment of the present invention, and as shown in fig. 2, the device includes: the device comprises a grabbing module 200, an analyzing module 201 and a code rate obtaining module 202; wherein,
a fetching module 200, configured to fetch a network data packet containing HLS protocol transmission content at least once;
the analysis module 201 is configured to obtain a data amount and a playing time length of at least one video fragment transmitted by using the HLS protocol by analyzing the captured network data packet;
and the code rate obtaining module 202 is configured to obtain a code rate of a corresponding video segment based on the obtained data amount and the obtained playing time length of any one video segment.
Here, the HLS protocol transmission content includes at least one of the following files: video clips, index files for video clips.
Specifically, the parsing module 201 is specifically configured to, when a network data packet captured at any time contains a video fragment specified by the HLS protocol, obtain a data amount of the video fragment specified by the HLS protocol that is included in the network data packet captured at the corresponding time.
The parsing module 201 is configured to obtain, based on the index file of the video segment specified by the HLS protocol included in the network data packet captured each time, a playing sequence of each video segment corresponding to the index file of the video segment; when any captured network data packet contains video fragments specified by an HLS protocol, obtaining the starting playing time point of the corresponding video fragment based on the video fragments specified by the HLS protocol contained in the network data packet captured for the corresponding time; and when the video fragment with the acquired play starting time point is not the last video fragment arranged according to the play sequence, arranging according to the obtained play sequence of each video fragment to acquire the next video fragment of the video fragment with the acquired play starting time point, and acquiring the play time length of the video fragment with the acquired play starting time point based on the video fragment with the acquired play starting time point and the play starting time point of the next video fragment of the video fragment with the acquired play starting time point.
The parsing module 201 is configured to find out a first TS packet in the video fragment specified by the HLS protocol included in the network data packet captured at a corresponding time; and acquiring a program clock reference PCR value contained in the found first TS packet, and acquiring a playing starting time point of the corresponding video fragment based on the acquired PCR value.
In practical applications, the capturing module 200, the parsing module 201, and the code rate obtaining module 202 may be implemented by a Central Processing Unit (CPU), a microprocessor Unit (MPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or the like in a terminal device.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.

Claims (17)

1. A method for obtaining a bitrate of video slicing, the method comprising:
at least one time, capturing a network data packet containing HLS protocol transmission content;
obtaining the data volume and the playing time length of at least one video fragment transmitted by utilizing the HLS protocol by analyzing the captured network data packet;
and obtaining the code rate of the corresponding video fragment based on the obtained data volume and the playing time length of any one video fragment.
2. The method of claim 1, wherein the deriving the amount of data for the at least one video slice transmitted using the HLS protocol comprises: when any captured network data packet contains video fragments specified by the HLS protocol, acquiring the data volume of the video fragments specified by the HLS protocol and contained in the network data packet corresponding to one capture.
3. The method of claim 1, wherein deriving a playout duration for at least one video slice transported using HLS protocol comprises: obtaining the playing sequence of each video fragment corresponding to the index file of the video fragment based on the index file of the video fragment specified by the HLS protocol contained in the network data packet captured each time; when any captured network data packet contains video fragments specified by an HLS protocol, obtaining the starting playing time point of the corresponding video fragment based on the video fragments specified by the HLS protocol contained in the network data packet captured for the corresponding time; and when the video fragment with the acquired play starting time point is not the last video fragment arranged according to the play sequence, arranging according to the obtained play sequence of each video fragment to acquire the next video fragment of the video fragment with the acquired play starting time point, and acquiring the play time length of the video fragment with the acquired play starting time point based on the video fragment with the acquired play starting time point and the play starting time point of the next video fragment of the video fragment with the acquired play starting time point.
4. The method of claim 3, further comprising: when any captured network data packet contains an index file of video fragments specified by an HLS protocol, recording the network data packet captured at one time as an index file network data packet;
the obtaining, based on the index file of the video segment specified by the HLS protocol included in the network data packet captured each time, a playing sequence of each video segment corresponding to the index file of the video segment includes:
step 101A: acquiring the sequence number seq of the index file network data packet captured for the 1 st time, and storing the index file of the video fragment of the index file network data packet captured for the 1 st time into a preset playing sequence text;
step 101B: let j be a natural number greater than 1, i be from 1 to j-1; acquiring seq of a j-th captured index file network data packet;
if the seq of the index file network data packet captured at the jth time is equal to the sum of the seq of the index file network data packet captured at the ith time and the data volume of the index file of the video fragment of the index file network data packet captured at the ith time, marking the index file network data packet captured at the ith time as a preamble packet of the index file network data packet captured at the jth time;
if the sum of the seq of the jth captured index file network data packet and the data amount of the index file of the video fragment of the jth captured index file network data packet is equal to the seq of the ith captured index file network data packet, marking the ith captured index file network data packet as a subsequent packet of the jth captured index file network data packet;
step 101C: in the index file of the video fragment of the jth captured index file network data packet, if the beginning of any line of character strings is "# extinn" and at least one line of character strings not beginning with "#" exists in the subsequent lines of character strings, in the playing sequence text, inserting the index file of the video fragment of the jth captured index file network data packet behind the index file of the video fragment of the preorder packet of the jth captured index file network data packet or in front of the index file of the video fragment of the subsequent packet of the jth captured index file network data packet;
step 101D: obtaining the playing sequence of each video fragment corresponding to the playing sequence text according to the arrangement sequence of each index file in the playing sequence text; and the playing sequence of each video fragment corresponding to the index file of the video fragment is the playing sequence of each video fragment corresponding to the playing sequence text.
5. The method of claim 4, further comprising: in step 101B, if the seq of the jth fetched network packet of the index file is equal to the seq of the ith fetched network packet of the index file, the value of j is incremented by 1, and step 101B is executed again.
6. The method of claim 4, wherein the step 101B further comprises: and when the preorder packet and the postorder packet of the jth captured index file network data packet do not exist and the seq of the index file network data packet captured at the previous j-1 time is smaller than the seq of the index file network data packet captured at the jth time, storing the index file of the video fragment of the index file network data packet captured at the jth time behind the index file of the video fragment of the index file network data packet captured at the previous j-1 time in the playing sequence text.
7. The method of claim 4, wherein the step 101B further comprises: when the seq of the index file network data packet captured at least one time is larger than the seq of the index file network data packet captured at the jth time in the index file network data packets captured at the first j-1 time, finding out the index file network data packet with the smallest difference between the seq and the seq of the index file network data packet captured at the jth time from the index file network data packets with the seq larger than the seq of the index file network data packet captured at the jth time, and marking the found index file network data packet as a post packet of the index file network data packet captured at the jth time;
the step 101C further includes: in the index file of the video fragment of the jth captured index file network data packet, if the beginning of any line of character strings is "# extinn" and at least one line of character strings not beginning with "#" exists in the subsequent lines of character strings, in the playing sequence text, the index file of the video fragment of the jth captured index file network data packet is inserted before the index file of the video fragment of the subsequent packet of the jth captured index file network data packet.
8. The method of claim 4, wherein after step 101B, the method further comprises: when at least one line of character string ending with '\ n' exists in the index file of the video fragment of the index file network data packet captured at the jth time, taking the first line of character string ending with '\ n' as the head of the index file of the video fragment of the index file network data packet captured at the jth time;
when the last row of character strings of the index file of the video fragment of the jth captured index file network data packet does not end with '\ n', marking the last row of character strings of the index file of the video fragment of the jth captured index file network data packet as the tail of the index file of the video fragment of the jth captured index file network data packet;
merging the head of the index file of the video fragment of the jth captured index file network data packet and the tail of the index file of the video fragment of the preorder packet of the jth captured index file network data packet into a first row of character strings of the index file of the video fragment of the jth captured index file network data packet when the head of the index file of the video fragment of the jth captured index file network data packet and the tail of the index file of the video fragment of the preorder packet of the jth captured index file network data packet both exist; jumping to the step 101C;
merging the tail part of the index file of the video fragment of the jth captured index file network data packet and the head part of the index file of the video fragment of the subsequent packet of the jth captured index file network data packet into the last line of character strings of the index file of the video fragment of the jth captured index file network data packet when the tail part of the index file of the video fragment of the jth captured index file network data packet and the head part of the index file of the subsequent packet of the jth captured index file network data packet both exist; after that, the process proceeds to step 101C.
9. The method according to claim 3, wherein the deriving a starting playing time point of a corresponding video slice based on the video slices specified by the HLS protocol included in the network data packet grabbed at a corresponding time comprises: finding out a first TS packet in the video fragments specified by the HLS protocol contained in the network data packets captured at the corresponding time; and acquiring a program clock reference PCR value contained in the found first TS packet, and acquiring a playing starting time point of the corresponding video fragment based on the acquired PCR value.
10. The method of claim 1, wherein the deriving a playout time length for at least one video slice transmitted using HLS protocol comprises: when any captured network data packet contains an index file of video fragments specified by an HLS protocol, finding out mark duration information of each corresponding video fragment from the index file of the video fragment specified by the HLS protocol contained in the network data packet captured at one time; and obtaining the playing time length of each corresponding video fragment based on the found mark time length information of each corresponding video fragment.
11. The method of claim 1, wherein the deriving a playout time length for at least one video slice transmitted using HLS protocol comprises: when any captured network data packet contains video fragments specified by an HLS protocol, finding out the video fragments specified by the HLS protocol contained in the network data packet captured at the corresponding time; in the found video fragments, a first PCR value and a last PCR value are found out according to the arrangement sequence of characters; and subtracting the first PCR value from the last PCR value to obtain the playing time length of the found video fragment.
12. Method according to any of claims 1 to 11, wherein said HLS protocol transport content comprises at least one of the following files: video clips, index files for video clips.
13. An apparatus for obtaining a bitrate of a video slice, the apparatus comprising: the device comprises a grabbing module, an analyzing module and a code rate obtaining module; wherein,
the grabbing module is used for grabbing the network data packet containing the HLS protocol transmission content at least once;
the analysis module is used for analyzing the captured network data packet to obtain the data volume and the playing time length of at least one video fragment transmitted by utilizing the HLS protocol;
and the code rate obtaining module is used for obtaining the code rate of the corresponding video fragment based on the obtained data volume and the playing time length of any one video fragment.
14. The apparatus according to claim 13, wherein the parsing module is specifically configured to, when any captured network packet contains a video fragment specified by the HLS protocol, obtain a data amount of the video fragment specified by the HLS protocol that is included in the network packet captured at a corresponding time.
15. The apparatus according to claim 13, wherein the parsing module is specifically configured to obtain, based on the index file of the video segment specified by the HLS protocol included in the network data packet captured each time, a playing order of each video segment corresponding to the index file of the video segment; when any captured network data packet contains video fragments specified by an HLS protocol, obtaining the starting playing time point of the corresponding video fragment based on the video fragments specified by the HLS protocol contained in the network data packet captured for the corresponding time; and when the video fragment with the acquired play starting time point is not the last video fragment arranged according to the play sequence, arranging according to the obtained play sequence of each video fragment to acquire the next video fragment of the video fragment with the acquired play starting time point, and acquiring the play time length of the video fragment with the acquired play starting time point based on the video fragment with the acquired play starting time point and the play starting time point of the next video fragment of the video fragment with the acquired play starting time point.
16. The apparatus according to claim 15, wherein the parsing module is specifically configured to find a first TS packet in the video slices specified by the HLS protocol included in the network data packet captured at a corresponding time; and acquiring a program clock reference PCR value contained in the found first TS packet, and acquiring a playing starting time point of the corresponding video fragment based on the acquired PCR value.
17. The apparatus according to any of claims 13 to 16, wherein the HLS protocol transport content comprises at least one of the following files: video clips, index files for video clips.
CN201610006221.9A 2016-01-05 2016-01-05 A kind of method and apparatus for the code check for obtaining video slicing Pending CN106941630A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610006221.9A CN106941630A (en) 2016-01-05 2016-01-05 A kind of method and apparatus for the code check for obtaining video slicing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610006221.9A CN106941630A (en) 2016-01-05 2016-01-05 A kind of method and apparatus for the code check for obtaining video slicing

Publications (1)

Publication Number Publication Date
CN106941630A true CN106941630A (en) 2017-07-11

Family

ID=59468786

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610006221.9A Pending CN106941630A (en) 2016-01-05 2016-01-05 A kind of method and apparatus for the code check for obtaining video slicing

Country Status (1)

Country Link
CN (1) CN106941630A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114449340A (en) * 2020-10-30 2022-05-06 南京中兴新软件有限责任公司 Video code rate identification method of encrypted video, and video playing index estimation method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104509061A (en) * 2013-02-17 2015-04-08 华为技术有限公司 Method and device for regulating streaming media data transmission
US20150163273A1 (en) * 2011-09-29 2015-06-11 Avvasi Inc. Media bit rate estimation based on segment playback duration and segment data length
CN106911926A (en) * 2015-12-23 2017-06-30 华为技术服务有限公司 A kind of video code rate recognition methods and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150163273A1 (en) * 2011-09-29 2015-06-11 Avvasi Inc. Media bit rate estimation based on segment playback duration and segment data length
CN104509061A (en) * 2013-02-17 2015-04-08 华为技术有限公司 Method and device for regulating streaming media data transmission
CN106911926A (en) * 2015-12-23 2017-06-30 华为技术服务有限公司 A kind of video code rate recognition methods and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114449340A (en) * 2020-10-30 2022-05-06 南京中兴新软件有限责任公司 Video code rate identification method of encrypted video, and video playing index estimation method and device

Similar Documents

Publication Publication Date Title
US12028585B2 (en) Manifest customization in adaptive bitrate streaming
US10200723B2 (en) Converting live streaming content to video-on-demand streaming content
CN105282627B (en) A kind of method and server obtaining live video slice
Wei et al. Low latency live video streaming over HTTP 2.0
JP5499314B2 (en) Video stream encoding for adaptive video streaming
CN107277081A (en) Section method for down loading and device, the stream media system of stream medium data
CN111343511B (en) HLS live broadcast system and method realized through multicast
US20240107097A1 (en) Packager for segmenter fluidity
EP3570538A1 (en) Storage method, regeneration method, storage device, and regeneration device
CN105228001B (en) A kind of method and system that FLV format videos play online
CN107277563B (en) Method, server and terminal for generating and playing video file
CN104702978B (en) A kind of method and netcast equipment of video data positioning
US11095699B1 (en) Streaming media file management
WO2016053526A1 (en) Systems and methods for signaling request acceleration in the transport layer
CN104837033B (en) A kind of information processing method and server
CN108769830B (en) Method for caching video and related equipment
CN108833968B (en) Method for caching video and related equipment
CN110677736B (en) HLS on-demand fast playing method and system
CN111327964B (en) Method and device for positioning video playing pause
EP3007450A1 (en) Transmission device, transmission method, receiving device, and receiving method
CN111510790A (en) Video request method, system, computer device and computer readable storage medium
CN113079386A (en) Video online playing method and device, electronic equipment and storage medium
CN112203105A (en) New media mobile live broadcasting method and system
CN106941630A (en) A kind of method and apparatus for the code check for obtaining video slicing
CN113409801A (en) Noise processing method, system, medium, and apparatus for real-time audio stream playback

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170711

RJ01 Rejection of invention patent application after publication