CN107979783B - Streaming data analysis method and device and electronic equipment - Google Patents
Streaming data analysis method and device and electronic equipment Download PDFInfo
- Publication number
- CN107979783B CN107979783B CN201610941486.8A CN201610941486A CN107979783B CN 107979783 B CN107979783 B CN 107979783B CN 201610941486 A CN201610941486 A CN 201610941486A CN 107979783 B CN107979783 B CN 107979783B
- Authority
- CN
- China
- Prior art keywords
- data
- index
- frame
- analyzed
- offset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a streaming data analysis method, a streaming data analysis device and electronic equipment, relates to a data analysis technology, and can improve the compatibility of streaming data analysis. The streaming data analysis method comprises the following steps: receiving data to be analyzed, and analyzing a file type box of the data to be analyzed to obtain a file type field if the data to be analyzed is streaming data; if the file type field is identified as an MP4 file, analyzing the atomic structure behind the file type box; identifying the MP4 packaging format of the data to be analyzed according to the information contained in the atomic structure and a preset packaging format identification strategy; and calling an analysis module of the identified MP4 package format mapping to analyze the data to be analyzed. The invention is suitable for analyzing various packaged MP4 files.
Description
Technical Field
The present invention relates to data analysis technologies, and in particular, to a streaming data analysis method and apparatus, and an electronic device.
Background
MP4 is a set of compression coding standards for audio and video information, which is established by the Moving Picture Experts Group (MPEG) under the international organization for standardization (ISO) and the International Electrotechnical Commission (IEC), MP4 file is a media file packaged based on the ISO/IEC14496-12 standard, and MP4 file has higher practicability and popularity than other media files packaged in other packaging formats, such as RMVB, AVI, FLV, WMV, MKV, etc., and thus has been widely used.
To be applicable in different scenarios, MP4 files have a variety of packaging formats, including: MP 4-front package, MP 4-back package, MP4-H5 package, and MP4-DASH package. When the MP 4-front package and the MP 4-rear package are applied to a file data scene and a packaged MP4 file (data) is analyzed at a client, the index can be searched by acquiring a file handle in the packaged MP4 file (data), the data can be positioned and analyzed according to the index, and the playing is started from the positioned data. The MP4-H5 package and the MP4-DASH package are mainly applied to streaming data scenes, and are novel streaming media technologies, wherein MP4 files packaged by the MP4-H5 can be played without plug-in on a browser based on a hypertext markup language 5(HTML5, Hyper Text Mark-up language 5) frame, MP4 files packaged by the MP4-DASH package need to be played on a browser with plug-in installed, but better user experience can be provided for a client because MP4 files packaged by the MP4-DASH package adopt a bitrate adaptive transmission technology of streaming media.
Currently, for a streaming data scenario, for MP 4-front encapsulation, MP4-H5 encapsulation, and MP4-DASH encapsulation, mutually independent parsing modules are respectively designed to correspondingly parse corresponding streaming data. When streaming data analysis is carried out, after a client side knows that received data is streaming data, the client side calls one analysis module to analyze the received data, if the analysis fails, another analysis module is called to analyze the data until the data analysis succeeds or all the called analysis modules fail to analyze, and no analysis module aiming at MP 4-rear encapsulation is designed at present. However, for streaming data, the streaming data can be successfully analyzed by calling different analysis modules for multiple times and repeatedly analyzing the streaming data, and the streaming data analysis method is low in compatibility, so that the time for analyzing the streaming data is long.
Disclosure of Invention
In view of this, embodiments of the present invention provide a streaming data analysis method, a streaming data analysis device, and an electronic device, which can improve the compatibility of streaming data analysis, so as to solve the problem of low compatibility of streaming data analysis caused by repeatedly analyzing streaming data by calling different analysis modules multiple times in the existing streaming data analysis method.
In a first aspect, an embodiment of the present invention provides a streaming data parsing method, including:
receiving data to be analyzed, and analyzing a file type box of the data to be analyzed to obtain a file type field if the data to be analyzed is streaming data;
if the file type field is identified as an MP4 file, analyzing the atomic structure behind the file type box;
identifying the MP4 packaging format of the data to be analyzed according to the information contained in the atomic structure and a preset packaging format identification strategy;
and calling an analysis module of the identified MP4 package format mapping to analyze the data to be analyzed.
With reference to the first aspect, in a first implementation manner of the first aspect, the identifying, according to the information included in the atomic structure and a preset package format identification policy, an MP4 package format of the data to be parsed includes:
if the type structure in the atomic structure is identified as an index structure, analyzing the index structure;
if the offset table structure in the analyzed index structure is empty, analyzing the fragment structure, and if the fragment index is obtained from the analyzed fragment structure, identifying that the MP4 encapsulation format of the data to be analyzed is MP 4-DASH; if the fragment index is not acquired, identifying that the MP4 encapsulation format of the data to be analyzed is MP 4-H5;
and if the offset table in the analyzed index structure is not empty, identifying the MP4 packaging format of the data to be analyzed as MP 4-front.
With reference to the first implementation manner of the first aspect, in a second implementation manner of the first aspect, the method further includes:
and if the type structure information is identified as a data structure, identifying the MP4 packaging format of the data to be analyzed as MP 4-postscript.
With reference to the first aspect, the first implementation manner, or the second implementation manner of the first aspect, in a third implementation manner of the first aspect, the MP4 encapsulation format of the data to be parsed is MP4 — postconfigured, and the invoking a parsing module of the identified MP4 encapsulation format mapping, where parsing the data to be parsed includes:
calculating an index offset according to information of a first threshold byte in the atomic structure;
requesting data from the index offset, and analyzing the atomic structure behind the file type box;
if the type structure information in the atomic structure is identified as an index structure, analyzing the index structure to obtain an index;
and requesting data, and analyzing the requested data according to the index.
With reference to the third implementation manner of the first aspect, in a fourth implementation manner of the first aspect, the calculating an index offset according to information of a first threshold byte in the atomic structure information includes:
acquiring a stored reserved index offset;
adding the length corresponding to the information of the first threshold byte and the stored reserved index offset to obtain index offset;
updating the stored reserved index offset with the index offset.
With reference to the first aspect, the first implementation manner, or the second implementation manner of the first aspect, in a fifth implementation manner of the first aspect, the method further includes:
the analysis layer identifies the analyzed data to be analyzed, if the data is a first frame and the first frame is a B frame or a P frame, the B frame or the P frame is discarded, and if the first frame is an I frame, the data is transmitted to the play layer for playing;
and if the frame is not the first frame, transmitting the B frame or the P frame or the I frame obtained by analysis to a playing layer for playing.
In a second aspect, an embodiment of the present invention provides a streaming data parsing apparatus, including: a file type field acquisition module, an atomic structure analysis module, a packaging format identification module and an analysis module, wherein,
the file type field acquisition module is used for receiving data to be analyzed, and if the data to be analyzed is streaming data, analyzing a file type box of the data to be analyzed to acquire a file type field;
the atomic structure analysis module is used for analyzing the atomic structure behind the file type box if the file type field is identified as the MP4 file;
the package format identification module is used for identifying the MP4 package format of the data to be analyzed according to the information contained in the atomic structure and a preset package format identification strategy;
and the analysis module is used for calling the analysis module of the identified MP4 packaging format mapping to analyze the data to be analyzed.
With reference to the second aspect, in a first implementation manner of the second aspect, the package format identifying module includes: a first processing unit, an index structure analysis unit, a second processing unit, a slice structure analysis unit and a third processing unit,
the first processing unit is used for judging whether the type structure identifier in the atomic structure is an index structure or not, and if so, informing the index structure analysis unit;
the index structure analysis unit is used for analyzing the index structure;
the second processing unit is used for judging whether an offset table structure in the analyzed index structure is empty or not, and if so, informing the fragment structure analyzing unit; if not, identifying the MP4 packaging format of the data to be analyzed as MP 4-front;
the fragment structure analysis unit is used for analyzing the fragment structure;
the third processing unit is configured to determine whether an analyzed fragment structure includes a fragment index, and if so, identify that an MP4 encapsulation format of the data to be analyzed is MP 4-DASH; if not, identifying the MP4 packaging format of the data to be parsed as MP 4-H5.
With reference to the first implementation manner of the second aspect, in a second implementation manner of the second aspect, the first processing unit is further configured to identify that the MP4 encapsulation format of the data to be parsed is MP 4-postamble if the type structure information is identified as a data structure.
With reference to the second aspect, the first implementation manner or the second implementation manner of the second aspect, in a third implementation manner of the second aspect, the MP4 encapsulation format of the data to be parsed is MP4 — post, and the parsing module includes: an index offset calculation unit, a data request unit, an index acquisition unit, and a data parsing unit, wherein,
the index offset calculation unit is used for calculating the index offset according to the information of the first threshold byte in the atomic structure;
the data request unit is used for requesting data from the index offset and analyzing the atomic structure behind the file type box;
the index acquisition unit analyzes the index structure to obtain an index if the type structure information in the atomic structure is identified as the index structure;
and the data analysis unit is used for requesting data and analyzing the requested data according to the index.
With reference to the third embodiment of the second aspect, in a fourth embodiment of the second aspect, the index offset calculation unit includes: a reserved index offset acquisition subunit, an index offset calculation subunit, and an update subunit, wherein,
a reserved index offset obtaining subunit, configured to obtain a stored reserved index offset;
the index offset calculation subunit is configured to add the length corresponding to the information of the first threshold byte to the stored reserved index offset to obtain an index offset;
an updating subunit, configured to update the stored reserved index offset with the index offset.
With reference to the second aspect, the first implementation manner or the second implementation manner of the second aspect, in a fifth implementation manner of the second aspect, the apparatus further includes:
the optimized playing module is used for identifying the analyzed data to be analyzed at the analysis layer:
if the first frame is the first frame and the first frame is the B frame or the P frame, discarding the B frame or the P frame, and if the first frame is the I frame, transmitting to a playing layer for playing;
and if the frame is not the first frame, transmitting the B frame or the P frame or the I frame obtained by analysis to a playing layer for playing.
In a third aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes: the device comprises a shell, a processor, a memory, a circuit board and a power circuit, wherein the circuit board is arranged in a space enclosed by the shell, and the processor and the memory are arranged on the circuit board; a power supply circuit for supplying power to each circuit or device of the electronic apparatus; the memory is used for storing executable program codes; the processor reads the executable program code stored in the memory to run a program corresponding to the executable program code, and is used for executing the streaming data analysis method.
According to the streaming data analysis method, the streaming data analysis device and the electronic equipment provided by the embodiment of the invention, data to be analyzed is received, and if the data to be analyzed is streaming data, a file type box of the data to be analyzed is analyzed to obtain a file type field; if the file type field is identified as an MP4 file, analyzing the atomic structure behind the file type box; identifying the MP4 packaging format of the data to be analyzed according to the information contained in the atomic structure and a preset packaging format identification strategy; the method comprises the steps of calling an analysis module of the identified MP4 package format mapping, analyzing the data to be analyzed, and improving the compatibility of stream data analysis, so as to solve the problem of low compatibility of stream data analysis caused by repeated analysis of stream data by calling different analysis modules for multiple times in the existing stream data analysis method.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a method for analyzing streaming data according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a method for analyzing streaming data according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a three-stream data analysis apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an embodiment of an electronic device according to the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a streaming data parsing method according to an embodiment of the present invention, and as shown in fig. 1, the method of this embodiment may include:
in this embodiment, before the server transmits data to the client, the server notifies the type of the transmitted data to be analyzed in advance, that is, whether the data to be analyzed is file data or streaming data, so that the client knows that the data to be analyzed is streaming data (stream type) or file data (file type).
In this embodiment, if the data to be analyzed received by the client is streaming data, a File header of the data to be analyzed, that is, a File Type Box (FTYP Box) is analyzed, and a File Type field is obtained.
In this embodiment, for MP4 files, according to the specification of ISO/IEC14496-12, files or data in MP4 package format are started in a file type box, and the file type box contains a file type (FTYP, FileType) field at the start of the file type box for identifying MP4 files.
In this embodiment, as an optional embodiment, the method may further include:
and if the data to be analyzed is file data, acquiring a file handle in the data to be analyzed, searching an index by using the file handle, realizing the positioning and analysis of the data to be analyzed according to the index, and starting playing from the positioned data.
In this embodiment, if the data to be analyzed received by the client is file data, the data is analyzed according to the file data type until the analysis is finished or the data fails in the middle.
in this embodiment, according to the specification and definition of the ISO/IEC14496-12 standard, no matter what encapsulation structure is adopted by the MP4 file, the description of the basic atomic structure is followed, that is, in the first 8 bytes of streaming Data (frame), an atomic structure description mode including a length structure and a type structure is adopted, where 4 bytes are the length structure and identify the length of payload Data, for example, multimedia Data (MDAT, Media Data), and the other 4 bytes are the type structure and identify the type of the streaming Data (frame). Therefore, in this embodiment, by acquiring the atomic structure of the streaming data (frame), the specific MP4 encapsulation format can be determined by using the atomic structure.
In this embodiment, the MP4 file is a structure of MDAT (multimedia data) + MOOV (index), or a structure of MOOV (index) + MDAT (data), where MOOV is an index (type structure) and is an index structure containing information such as codec parameters, frame time stamps, frame offsets, frame lengths, frame positions, and the MDAT is transmitted payload data.
in this embodiment, as an optional embodiment, identifying the MP4 package format of the data to be analyzed according to the information contained in the atomic structure and a preset package format identification policy includes:
a11, if the type structure in the atomic structure is identified as an index structure, resolving the index structure;
in this embodiment, the index structure is a MOOV Box structure.
A12, if the offset table structure in the analyzed index structure is empty, analyzing the fragment structure, and if the fragment index is obtained from the analyzed fragment structure, identifying that the MP4 encapsulation format of the data to be analyzed is MP 4-DASH; if the fragment index is not acquired, identifying that the MP4 encapsulation format of the data to be analyzed is MP 4-H5;
in this embodiment, the Offset table structure is a block Offset information table Box (STCO Box, Chunk Offset Box) structure, and is an Offset information table of each sample (frame) with respect to a file header.
In this embodiment, the fragment structure is a fragment Index information (SIDX) structure, and only the MP4-DASH contains the SIDX structure.
A13, if the offset table in the parsed index structure is not empty, identifying the MP4 encapsulation format of the data to be parsed as MP 4-front.
As another alternative embodiment, identifying the MP4 package format of the data to be parsed according to the information contained in the atomic structure and a preset package format identification policy includes:
and if the type structure information is identified as a data structure, identifying the MP4 packaging format of the data to be analyzed as MP 4-postscript.
In this embodiment, if the data structure is used, it indicates that the data to be parsed is multimedia data (MDAT, MediaData) instead of index data.
In this embodiment, if the type structure information identifier is neither an index structure nor a data structure, it indicates that the file type is not supported.
And 104, calling an analysis module of the identified MP4 package format mapping, and analyzing the data to be analyzed.
In this embodiment, if the data is MP4-DASH, the MP4-DASH parsing module is invoked to parse the data to be parsed; if the data is MP4-H5, calling an MP4-H5 analysis module to analyze the data to be analyzed; if the data is MP 4-preposition, calling an MP 4-preposition analysis module to analyze the data to be analyzed; and if the data is MP 4-post, calling an MP 4-post analysis module to analyze the data to be analyzed.
In this embodiment, after the determination of the file type field, if the type structure in the atomic structure is not the MOOV structure (index structure), the determination is performed again:
if not, the file type is not supported temporarily;
if the structure is the MDAT structure, the structure is confirmed to be MP 4-post encapsulation, and an MP 4-post analysis module is called to carry out analysis until the analysis is finished or fails in the middle.
In this embodiment, if the type structure in the atomic structure is a MOOV structure, the MOOV structure field is analyzed:
if the STCO structure is not empty, judging that the package is an MP 4-preposed package, calling an MP 4-preposed analysis module to analyze until the analysis is finished or the midway fails;
if the STCO structure is empty, continue the analysis:
if the SIDX structure is contained, judging that the package is an MP4-DASH package, calling an MP4-DASH analysis module to analyze until the analysis is finished or the midway fails;
if the package does not contain the SIDX structure, the package is judged to be MP4-H5 package, and an MP4-H5 analysis module is called to carry out analysis until the analysis is finished or fails in the middle.
In this embodiment, as an optional embodiment, if the MP4 package format of the data to be parsed is identified as MP4 — post, invoking an parsing module mapped by the identified MP4 package format, and parsing the data to be parsed includes:
b11, calculating an index offset according to the information of the first threshold byte in the atomic structure;
in this embodiment, the information of the first threshold byte is a length structure in an atomic structure, which indicates the length of the payload data, and the first threshold is set to 4.
In this embodiment, as an optional embodiment, the calculating the index offset according to the information of the first threshold byte in the atomic structure information includes:
c11, obtaining the stored reserved index offset;
in this embodiment, if the preset storage area does not store the reserved index offset, the stored reserved index offset is set to zero.
C12, adding the length corresponding to the information of the first threshold byte to the stored reserved index offset to obtain an index offset;
in this embodiment, if the current structure is not a MOOV Box structure, the index offset is calculated: and adding the length of the current atomic structure to the analyzed data length to obtain the data length needing to be offset, and then sending the data length to the server. And the server starts to send data from the offset position corresponding to the data length of the requested offset, the client side continues to analyze the data after acquiring new data, judges whether the current structure is the MOOV Box again, and the process is circulated until the file analysis is finished or the MOOV Box is found. For example, assuming that the field type structure of the last 4 bytes is parsed for the first time, if it is determined that the field type structure is not the index structure, the server is notified to skip the data of the length information according to the length information of the first 4 bytes and then transmit the data, and then, the server is determined according to the first 8 bytes, and if the field type structure of the last 4 bytes is not the index structure, the data offset of the time is calculated, that is, the sum of the data length skipped last time and the data length required to be skipped this time.
C13, updating the stored reserved index offset with the index offset.
B12, requesting data from the index offset, and analyzing the atomic structure behind the file type box;
in this embodiment, the server is notified to skip the streaming data of the load data length indicated by the length structure, that is, to start transmitting the streaming data from the calculated index offset, and to do not transmit the streaming data before the index offset.
B13, if the type structure information in the atomic structure is marked as an index structure, analyzing the index structure to obtain an index;
in this embodiment, as an optional embodiment, if the type structure information is identified as an index structure, the method further includes:
clearing the stored reservation index offset.
B14, requesting data, and resolving the requested data according to the index.
In this embodiment, for the MP 4-post, an atomic structure is obtained by parsing the first 8 bytes of the data, and the type structure information of the last 4 bytes in the atomic structure information is used to determine whether the current structure is a required index (MOOV Box) structure, if the type structure information indicates that the current structure is not an index structure, the server may be notified according to the length type indicated by the first 4 bytes to skip the atomic structure of the current non-index structure, that is, the type structure of the last 4 bytes in the atomic structure information is used to determine whether the type structure is an index structure, if not, the structure is skipped according to the length information (load data length) indicated by the length structure of the first 4 bytes, so that the server skips the streaming data of the length information until the type structure is skipped to be the index structure, without transmitting the length data of the length type identifier, therefore, the length data does not need to be analyzed, and the time required by analysis is effectively reduced.
In this embodiment, as an optional embodiment, requesting data, and parsing the requested data according to the index includes:
d11, acquiring a playing positioning time point;
in this embodiment, the playing location time point is a location timestamp.
D12, requesting and resolving the data of the time point located from the playing.
In this embodiment, as an optional embodiment, the requesting the data from the play positioning time point includes:
e11, accumulating the frame timestamp in the video track timestamp-frame mapping table structure Box (STTS Box, Time timestamp Box) in the client;
e12, obtaining the frame number corresponding to the frame time stamp closest to the playing positioning time point from the accumulated frame time stamps;
in this embodiment, the frame timestamps in the STTS Box structure field are accumulated one by one according to the linked list sequence until the sum of the frame timestamps reaches the play positioning time point, and the frame number corresponding to the frame timestamp that participates in the accumulation at last is obtained.
In this embodiment, for the first frame of the multimedia data, the media data starting from the I frame is the valid data (the B/P frame cannot independently present a complete picture, which may cause a screen splash phenomenon).
E13, using the block Offset information table Box (STCO Box, Chunk Offset Box) of the video track to query the video frame Offset corresponding to the frame number;
in this embodiment, as an optional embodiment, the video frame offset is an I-frame video frame offset.
In this embodiment, for audio and video synchronization, the audio needs to find corresponding data, directly search the audio STCO Box, and obtain a first offset greater than the video frame offset to obtain the audio offset.
E14, requesting data at an offset from the video frame from the server.
In this embodiment, the STCO Box is an offset information table of each sample (frame) with respect to the header.
In this embodiment, as an optional embodiment, the method may further include:
the analysis layer identifies the analyzed data to be analyzed, if the data is a first frame and the first frame is a B frame or a P frame, the B frame or the P frame is discarded, and if the first frame is an I frame, the data is transmitted to the play layer for playing;
and if the frame is not the first frame, transmitting the B frame or the P frame or the I frame obtained by analysis to a playing layer for playing.
In this embodiment, if the frame number of the data to be analyzed is an I-frame number, the requested data is analyzed, and the first frame is an I-frame and is transmitted to the playing layer; if the frame number of the data to be analyzed is not the frame number of the I frame, analyzing the requested data, wherein the first frame can be the I frame, the B frame or the P frame, and if the frame number of the data to be analyzed is the B frame or the P frame, discarding the B frame or the P frame.
Fig. 2 is a schematic flow chart of a streaming data parsing method according to an embodiment of the present invention, and as shown in fig. 2, the method of this embodiment may include:
in this embodiment, if the streaming type is file data, step 221 is performed.
in this embodiment, the file header is an FTYP Box.
in this embodiment, the index structure corresponds to a MOOV Box structure in the package.
Step 204, analyzing an index structure;
in this embodiment, the offset table structure corresponds to the STCO Box structure in the package.
in this embodiment, the fragment index corresponds to a SIDX structure in the package.
in this embodiment, the data structure corresponds to an MDAT structure in the package.
step 211, performing MP 4-preanalysis;
As can be seen from the above, in the streaming data parsing method of this embodiment, data to be parsed is received, and if the data to be parsed is streaming data, a file type box of the data to be parsed is parsed, so as to obtain a file type field; if the file type field is identified as an MP4 file, analyzing the atomic structure behind the file type box; identifying the MP4 packaging format of the data to be analyzed according to the information contained in the atomic structure and a preset packaging format identification strategy; and calling an analysis module of the identified MP4 package format mapping to analyze the data to be analyzed. Therefore, the streaming data analysis frame can judge the packaging format of the data (file) to be analyzed before the load data is acquired, so that after the specific packaging format is determined, corresponding analysis logic (modules) are called to analyze and position the bare data, each analysis module does not need to be sequentially called to analyze, repeated analysis of the streaming data is effectively avoided, the streaming data analysis frame is equivalent to pretreatment of analysis, the packaging format of the packaged MP4 file can be quickly judged, and the compatibility of streaming data analysis is improved. The streaming data analysis framework is used as a strong compatible framework, can be applied to all environments for performing streaming analysis on MP4 format files, performs uniform preprocessing and guided analysis on MP4 files, and realizes streaming analysis compatibility of cross-application scenes for various packaged MP4 files.
Fig. 3 is a schematic structural diagram of a three-stream data analysis apparatus according to an embodiment of the present invention, and as shown in fig. 3, the apparatus according to this embodiment may include: a file type field acquisition module 31, an atomic structure parsing module 32, a package format recognition module 33, and a parsing module 34, wherein,
a file type field obtaining module 31, configured to receive data to be analyzed, and if the data to be analyzed is streaming data, analyze a file type box of the data to be analyzed, and obtain a file type field;
in this embodiment, before the server transmits data to the client, the server notifies the streaming type of the transmitted data to be analyzed in advance, that is, whether the data to be analyzed is file data or streaming data.
In this embodiment, as an optional embodiment, the file type field obtaining module 31 is further configured to, if the data to be analyzed is file data, obtain a file handle in the data to be analyzed, search an index by using the file handle, implement positioning and analysis of the data to be analyzed according to the index, and start playing from the positioned data.
The atomic structure analysis module 32 is used for analyzing the atomic structure behind the file type box if the file type field is identified as the MP4 file;
in this embodiment, the atomic structure is 8 bytes, and an atomic structure description mode including a length structure and a type structure is adopted, where 4 bytes are the length structure and identify the length of the payload data, and the other 4 bytes are the type structure and identify the type of the streaming data (frame). The index in the type structure includes information such as encoding and decoding parameters, frame time stamps, frame offset, frame length, frame position, and the like.
The package format identification module 33 is configured to identify an MP4 package format of the data to be analyzed according to information included in the atomic structure and a preset package format identification policy;
in this embodiment, as an optional embodiment, the package format identifying module 33 includes: a first processing unit, an index structure parsing unit, a second processing unit, a slice structure parsing unit, and a third processing unit (not shown in the figure), wherein,
the first processing unit is used for judging whether the type structure identifier in the atomic structure is an index structure or not, and if so, informing the index structure analysis unit;
in this embodiment, the index structure is a MOOV Box structure.
The index structure analysis unit is used for analyzing the index structure;
the second processing unit is used for judging whether an offset table structure in the analyzed index structure is empty or not, and if so, informing the fragment structure analyzing unit; if not, identifying the MP4 packaging format of the data to be analyzed as MP 4-front;
in this embodiment, the offset table structure is an STCO Box structure, and is an offset information table of each sample (frame) with respect to the header.
In this embodiment, the slice structure is a SIDX structure, and only the MP4-DASH contains the SIDX structure.
The fragment structure analysis unit is used for analyzing the fragment structure;
the third processing unit is configured to determine whether an analyzed fragment structure includes a fragment index, and if so, identify that an MP4 encapsulation format of the data to be analyzed is MP 4-DASH; if not, identifying the MP4 packaging format of the data to be parsed as MP 4-H5.
In this embodiment, as an optional embodiment, if the type structure information is identified as a data structure, the first processing unit is further configured to identify that an MP4 encapsulation format of the data to be parsed is MP 4-postamble.
In this embodiment, the data structure is an MDAT structure, which is a package structure for loading data (bare data).
And the analysis module 34 is configured to invoke an analysis module of the identified MP4 package format mapping, and analyze the data to be analyzed.
In this embodiment, if the data is MP4-DASH, the MP4-DASH parsing module is invoked to parse the data to be parsed; if the data is MP4-H5, calling an MP4-H5 analysis module to analyze the data to be analyzed; if the data is MP 4-preposition, calling an MP 4-preposition analysis module to analyze the data to be analyzed; and if the data is MP 4-post, calling an MP 4-post analysis module to analyze the data to be analyzed.
In this embodiment, as an optional embodiment, if the MP4 package format of the data to be parsed is MP 4-postamble, the parsing module 34 includes: an index offset calculation unit, a data request unit, an index acquisition unit, and a data parsing unit (not shown in the figure), wherein,
the index offset calculation unit is used for calculating the index offset according to the information of the first threshold byte in the atomic structure;
in this embodiment, as an optional embodiment, the index offset calculation unit includes: a reserved index offset acquisition subunit, an index offset calculation subunit, and an update subunit, wherein,
a reserved index offset obtaining subunit, configured to obtain a stored reserved index offset;
the index offset calculation subunit is configured to add the length corresponding to the information of the first threshold byte to the stored reserved index offset to obtain an index offset;
an updating subunit, configured to update the stored reserved index offset with the index offset.
The data request unit is used for requesting data from the index offset and analyzing the atomic structure behind the file type box;
the index acquisition unit analyzes the index structure to obtain an index if the type structure information in the atomic structure is identified as the index structure;
in this embodiment, as an optional embodiment, if the type structure information is identified as an index structure, the index obtaining unit is further configured to empty the stored reserved index offset.
And the data analysis unit is used for requesting data and analyzing the requested data according to the index.
In this embodiment, as an optional embodiment, requesting data, and parsing the requested data according to the index includes:
acquiring a play positioning time point;
requesting and parsing data locating a time point from the playing.
In this embodiment, as an optional embodiment, the requesting the data from the play positioning time point includes:
accumulating the video track time stamps in the client, namely frame time stamps in a frame corresponding table structure box;
acquiring a frame number corresponding to the frame timestamp closest to the playing positioning time point from the accumulated frame timestamps;
inquiring video frame offset corresponding to the frame number by using a block offset information table box of the video track;
requesting data from a server at an offset from the video frame.
In this embodiment, as an optional embodiment, the video frame offset is an I-frame video frame offset.
In this embodiment, for audio and video synchronization, the audio needs to find corresponding data, directly search the audio STCO Box, and obtain a first offset greater than the video frame offset to obtain the audio offset.
In this embodiment, as an optional embodiment, the apparatus further includes:
an optimized playing module (not shown in the figure) for identifying the analyzed data to be analyzed at the analysis layer:
if the first frame is the first frame and the first frame is the B frame or the P frame, discarding the B frame or the P frame, and if the first frame is the I frame, transmitting to a playing layer for playing;
and if the frame is not the first frame, transmitting the B frame or the P frame or the I frame obtained by analysis to a playing layer for playing.
The apparatus of this embodiment may be used to implement the technical solutions of the method embodiments shown in fig. 1 to fig. 2, and the implementation principles and technical effects are similar, which are not described herein again.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The term "comprising", without further limitation, means that the element so defined is not excluded from the group consisting of additional identical elements in the process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments.
In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof.
In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
The embodiment of the invention also provides electronic equipment, and the electronic equipment comprises the device in any one of the embodiments.
Fig. 4 is a schematic structural diagram of an embodiment of an electronic device of the present invention, which can implement the processes of the embodiments shown in fig. 1 to 3 of the present invention, and as shown in fig. 4, the electronic device may include: the device comprises a shell 41, a processor 42, a memory 43, a circuit board 44 and a power circuit 45, wherein the circuit board 44 is arranged inside a space enclosed by the shell 41, and the processor 42 and the memory 43 are arranged on the circuit board 44; a power supply circuit 45 for supplying power to each circuit or device of the electronic apparatus; the memory 43 is used for storing executable program code; the processor 42 executes a program corresponding to the executable program code by reading the executable program code stored in the memory 43, so as to execute the streaming data parsing method according to any of the foregoing embodiments.
The specific execution process of the above steps by the processor 42 and the steps further executed by the processor 42 by running the executable program code may refer to the description of the embodiment shown in fig. 1 to 3 of the present invention, and are not described herein again.
The electronic device exists in a variety of forms, including but not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.
(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.
(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.
(4) A server: the device for providing the computing service comprises a processor, a hard disk, a memory, a system bus and the like, and the server is similar to a general computer architecture, but has higher requirements on processing capacity, stability, reliability, safety, expandability, manageability and the like because of the need of providing high-reliability service.
(5) And other electronic equipment with data interaction function.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
For convenience of description, the above devices are described separately in terms of functional division into various units/modules. Of course, the functionality of the units/modules may be implemented in one or more software and/or hardware implementations of the invention.
From the above description of the embodiments, it is clear to those skilled in the art that the present invention can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (13)
1. A method for parsing streaming data, comprising:
receiving data to be analyzed, and analyzing a file type box of the data to be analyzed to obtain a file type field if the data to be analyzed is streaming data;
if the file type field is identified as an MP4 file, analyzing the atomic structure behind the file type box;
identifying the MP4 packaging format of the data to be analyzed according to the information contained in the atomic structure and a preset packaging format identification strategy;
calling an analysis module mapped by the identified MP4 packaging format to analyze the data to be analyzed;
the identifying the MP4 encapsulation format of the data to be parsed according to the information contained in the atomic structure and a preset encapsulation format identification policy includes:
if the type structure in the atomic structure is identified as an index structure, analyzing the index structure;
if the offset table structure in the analyzed index structure is empty, analyzing the fragment structure;
if the fragment index is obtained from the analyzed fragment structure, identifying that the MP4 packaging format of the data to be analyzed is MP 4-DASH; and if the fragment index is not acquired, identifying the MP4 encapsulation format of the data to be analyzed as MP 4-H5.
2. The streaming data parsing method according to claim 1, wherein the identifying the MP4 package format of the data to be parsed according to the information contained in the atomic structure and a preset package format identification policy further comprises:
and if the offset table in the analyzed index structure is not empty, identifying the MP4 packaging format of the data to be analyzed as MP 4-front.
3. The streaming data parsing method of claim 2, wherein the method further comprises:
and if the type structure is identified as a data structure, identifying the MP4 packaging format of the data to be analyzed as MP 4-postback.
4. The streaming data parsing method according to any one of claims 1 to 3, wherein the MP4 package format of the data to be parsed is MP 4-postamble, the invoking the parsing module of the identified MP4 package format mapping, and the parsing the data to be parsed includes:
calculating an index offset according to information of a first threshold byte in the atomic structure;
requesting data from the index offset, and analyzing the atomic structure behind the file type box;
if the type structure information in the atomic structure is identified as an index structure, analyzing the index structure to obtain an index;
and requesting data, and analyzing the requested data according to the index.
5. The streaming data parsing method of claim 4, wherein the calculating an index offset from information of a first threshold byte in the atomic structure information comprises:
acquiring a stored reserved index offset;
adding the length corresponding to the information of the first threshold byte and the stored reserved index offset to obtain index offset;
updating the stored reserved index offset with the index offset.
6. The streaming data parsing method according to any one of claims 1 to 3, wherein the method further comprises:
the analysis layer identifies the analyzed data to be analyzed, if the data is a first frame and the first frame is a B frame or a P frame, the B frame or the P frame is discarded, and if the first frame is an I frame, the data is transmitted to the play layer for playing;
and if the frame is not the first frame, transmitting the B frame or the P frame or the I frame obtained by analysis to a playing layer for playing.
7. A streaming data parsing apparatus, comprising: a file type field acquisition module, an atomic structure analysis module, a packaging format identification module and an analysis module, wherein,
the file type field acquisition module is used for receiving data to be analyzed, and if the data to be analyzed is streaming data, analyzing a file type box of the data to be analyzed to acquire a file type field;
the atomic structure analysis module is used for analyzing the atomic structure behind the file type box if the file type field is identified as the MP4 file;
the package format identification module is used for identifying the MP4 package format of the data to be analyzed according to the information contained in the atomic structure and a preset package format identification strategy;
the analysis module is used for calling the analysis module mapped by the identified MP4 packaging format to analyze the data to be analyzed;
the package format recognition module includes: a first processing unit, an index structure analysis unit, a second processing unit, a slice structure analysis unit and a third processing unit,
the first processing unit is used for judging whether the type structure identifier in the atomic structure is an index structure or not, and if so, informing the index structure analysis unit;
the index structure analysis unit is used for analyzing the index structure;
the second processing unit is used for judging whether an offset table structure in the analyzed index structure is empty or not, and if so, informing the fragment structure analyzing unit; if not, identifying the MP4 packaging format of the data to be analyzed as MP 4-front;
the fragment structure analysis unit is used for analyzing the fragment structure;
and the third processing unit is configured to determine whether the parsed fragment structure includes a fragment index, and if so, identify that the MP4 encapsulation format of the data to be parsed is MP 4-DASH.
8. The streaming data parsing apparatus of claim 7, wherein the third processing unit is further configured to determine whether a parsed fragment structure includes a fragment index, and if not, identify that an MP4 encapsulation format of the data to be parsed is MP 4-H5.
9. The streaming data parser of claim 8, wherein the first processing unit is further configured to identify the MP4 encapsulation format of the data to be parsed as MP 4-postpositioned if the type structure is identified as a data structure.
10. The streaming data parsing device as claimed in any one of claims 7 to 9, wherein the MP4 package format of the data to be parsed is MP 4-postamble, and the parsing module comprises: an index offset calculation unit, a data request unit, an index acquisition unit, and a data parsing unit, wherein,
the index offset calculation unit is used for calculating the index offset according to the information of the first threshold byte in the atomic structure;
the data request unit is used for requesting data from the index offset and analyzing the atomic structure behind the file type box;
the index acquisition unit analyzes the index structure to obtain an index if the type structure information in the atomic structure is identified as the index structure;
and the data analysis unit is used for requesting data and analyzing the requested data according to the index.
11. The streaming data parsing apparatus of claim 10, wherein the index offset calculation unit comprises: a reserved index offset acquisition subunit, an index offset calculation subunit, and an update subunit, wherein,
a reserved index offset obtaining subunit, configured to obtain a stored reserved index offset;
the index offset calculation subunit is configured to add the length corresponding to the information of the first threshold byte to the stored reserved index offset to obtain an index offset;
an updating subunit, configured to update the stored reserved index offset with the index offset.
12. The streaming data parser apparatus according to any one of claims 7 to 9, further comprising:
the optimized playing module is used for identifying the analyzed data to be analyzed at the analysis layer:
if the first frame is the first frame and the first frame is the B frame or the P frame, discarding the B frame or the P frame, and if the first frame is the I frame, transmitting to a playing layer for playing;
and if the frame is not the first frame, transmitting the B frame or the P frame or the I frame obtained by analysis to a playing layer for playing.
13. An electronic device, characterized in that the electronic device comprises: the device comprises a shell, a processor, a memory, a circuit board and a power circuit, wherein the circuit board is arranged in a space enclosed by the shell, and the processor and the memory are arranged on the circuit board; a power supply circuit for supplying power to each circuit or device of the electronic apparatus; the memory is used for storing executable program codes; the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory, for executing the streaming data parsing method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610941486.8A CN107979783B (en) | 2016-10-25 | 2016-10-25 | Streaming data analysis method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610941486.8A CN107979783B (en) | 2016-10-25 | 2016-10-25 | Streaming data analysis method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107979783A CN107979783A (en) | 2018-05-01 |
| CN107979783B true CN107979783B (en) | 2020-03-24 |
Family
ID=62005151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610941486.8A Active CN107979783B (en) | 2016-10-25 | 2016-10-25 | Streaming data analysis method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107979783B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110545254B (en) * | 2018-05-29 | 2021-05-04 | 北京字节跳动网络技术有限公司 | Method and device for analyzing metadata container and storage medium |
| CN110545468B (en) * | 2018-05-29 | 2021-03-16 | 北京字节跳动网络技术有限公司 | Media file playing method and device based on parameter encapsulation and storage medium |
| CN110545490B (en) * | 2018-05-29 | 2021-03-16 | 北京字节跳动网络技术有限公司 | Media file conversion method, device and storage medium |
| CN110545463B (en) * | 2018-05-29 | 2021-03-16 | 北京字节跳动网络技术有限公司 | Play control method and device based on media file conversion and storage medium |
| CN110545472B (en) * | 2019-09-04 | 2021-04-16 | 北京字节跳动网络技术有限公司 | Video data processing method and device, electronic equipment and computer readable medium |
| CN111787396B (en) * | 2020-07-28 | 2023-02-21 | 北京金山云网络技术有限公司 | Video stream parsing method and device |
| CN111966868B (en) * | 2020-09-07 | 2021-04-06 | 航天云网数据研究院(广东)有限公司 | Data management method based on identification analysis and related equipment |
| CN112001164B (en) * | 2020-10-27 | 2021-01-08 | 南京中孚信息技术有限公司 | Document content streaming analysis method and system |
| CN113542764A (en) * | 2021-07-12 | 2021-10-22 | 中国电信股份有限公司 | Video quick starting method and device, electronic equipment and computer readable medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1516184A (en) * | 2003-01-10 | 2004-07-28 | 华为技术有限公司 | Processing method of multi-media data |
| CN1558681A (en) * | 2004-02-04 | 2004-12-29 | 中华电信股份有限公司 | Coding system integrating a variety of different image data sources |
| CN1643875A (en) * | 2002-03-27 | 2005-07-20 | 英国电讯有限公司 | Data streaming system and method |
| CN1870757A (en) * | 2004-10-13 | 2006-11-29 | 美国博通公司 | Multistandard video decoder |
| CN101060623A (en) * | 2006-04-20 | 2007-10-24 | 佳能株式会社 | Moving image reproducing apparatus and method |
| CN101146212A (en) * | 2006-09-11 | 2008-03-19 | 思华科技（上海）有限公司 | Stream media encapsulation and unpacking method and system for video order network |
| CN102045338A (en) * | 2009-10-15 | 2011-05-04 | 索尼公司 | Content reproduction system, content reproduction apparatus, program and content reproduction method |
| CN102754444A (en) * | 2010-01-08 | 2012-10-24 | 索尼公司 | Image processing device, information recording medium, image processing medium, and program |
| CN103355000A (en) * | 2010-12-31 | 2013-10-16 | 阿卡麦科技公司 | Extending data confidentiality into a player application |
| CN103392344A (en) * | 2010-12-17 | 2013-11-13 | 阿卡麦科技公司 | Format-agnostic streaming architecture using an http network for streamings |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8214655B2 (en) * | 2002-03-29 | 2012-07-03 | Kabushiki Kaisha Toshiba | Data structure of multimedia file format, encrypting method and device thereof, and decrypting method and device thereof |
| JP5086879B2 (en) * | 2008-04-21 | 2012-11-28 | キヤノン株式会社 | Image processing apparatus, control method therefor, and program |
| WO2013137697A1 (en) * | 2012-03-16 | 2013-09-19 | 엘지전자 주식회사 | Method for storing image information, method for parsing image information and apparatus using same |
-
2016
- 2016-10-25 CN CN201610941486.8A patent/CN107979783B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1643875A (en) * | 2002-03-27 | 2005-07-20 | 英国电讯有限公司 | Data streaming system and method |
| CN1516184A (en) * | 2003-01-10 | 2004-07-28 | 华为技术有限公司 | Processing method of multi-media data |
| CN1558681A (en) * | 2004-02-04 | 2004-12-29 | 中华电信股份有限公司 | Coding system integrating a variety of different image data sources |
| CN1870757A (en) * | 2004-10-13 | 2006-11-29 | 美国博通公司 | Multistandard video decoder |
| CN101060623A (en) * | 2006-04-20 | 2007-10-24 | 佳能株式会社 | Moving image reproducing apparatus and method |
| CN101146212A (en) * | 2006-09-11 | 2008-03-19 | 思华科技（上海）有限公司 | Stream media encapsulation and unpacking method and system for video order network |
| CN102045338A (en) * | 2009-10-15 | 2011-05-04 | 索尼公司 | Content reproduction system, content reproduction apparatus, program and content reproduction method |
| CN102754444A (en) * | 2010-01-08 | 2012-10-24 | 索尼公司 | Image processing device, information recording medium, image processing medium, and program |
| CN103392344A (en) * | 2010-12-17 | 2013-11-13 | 阿卡麦科技公司 | Format-agnostic streaming architecture using an http network for streamings |
| CN103355000A (en) * | 2010-12-31 | 2013-10-16 | 阿卡麦科技公司 | Extending data confidentiality into a player application |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107979783A (en) | 2018-05-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107979783B (en) | Streaming data analysis method and device and electronic equipment | |
| CN103141069B (en) | For retrieving the method and system with transmitting multimedia data | |
| US10140105B2 (en) | Converting source code | |
| CN107872422B (en) | Data transmission method and device and electronic equipment | |
| US10924801B2 (en) | Method and device for playing media file while switching resolution in webpage and storage medium | |
| CN110545466B (en) | Webpage-based media file playing method and device and storage medium | |
| US10978109B2 (en) | Synchronously playing method and device of media file, and storage medium | |
| CN110545490B (en) | Media file conversion method, device and storage medium | |
| CN110545491B (en) | Network playing method, device and storage medium of media file | |
| CN110662017B (en) | Video playing quality detection method and device | |
| JP7181308B2 (en) | MEDIA PLAYBACK LOADING CONTROL METHOD, APPARATUS AND STORAGE MEDIUM | |
| US11025991B2 (en) | Webpage playing method and device and storage medium for non-streaming media file | |
| CN112104909A (en) | Interactive video playing method and device, computer equipment and readable storage medium | |
| CN107872716B (en) | post-packaged streaming data analysis method and device and electronic equipment | |
| US10979759B2 (en) | Analysis method, device and storage medium of moov box | |
| CN113132759A (en) | Method, device, server, system and storage medium for determining video playing time delay | |
| CN110545471B (en) | Playing control method and device based on offline conversion and storage medium | |
| CN110545463B (en) | Play control method and device based on media file conversion and storage medium | |
| CN110798731A (en) | Video data processing method and device, electronic equipment and computer readable medium | |
| CN110545461A (en) | Resolution switching method and device of media file and storage medium | |
| KR101310894B1 (en) | Method and apparatus of referencing stream in other SAF session for LASeR service and apparatus for the LASeR service | |
| CN117768683A (en) | Method and system for testing live broadcast encoding time delay |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |