CN108696770A - Multimedia resource live play method and device - Google Patents

Multimedia resource live play method and device Download PDF

Info

Publication number
CN108696770A
CN108696770A CN201710228433.6A CN201710228433A CN108696770A CN 108696770 A CN108696770 A CN 108696770A CN 201710228433 A CN201710228433 A CN 201710228433A CN 108696770 A CN108696770 A CN 108696770A
Authority
CN
China
Prior art keywords
data
time
medium data
spatial cache
live
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710228433.6A
Other languages
Chinese (zh)
Inventor
刘军立
李奎
姜秀平
孙冰晶
李明杰
顾思斌
潘柏宇
谢菲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
1Verge Internet Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 1Verge Internet Technology Beijing Co Ltd filed Critical 1Verge Internet Technology Beijing Co Ltd
Priority to CN201710228433.6A priority Critical patent/CN108696770A/en
Publication of CN108696770A publication Critical patent/CN108696770A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23106Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

This disclosure relates to a kind of multimedia resource live play method and device.This method includes:Obtain the live streaming flow data of multimedia resource;The live streaming flow data is decoded and is encapsulated again, multi-medium data is obtained;It will be in multi-medium data storage to the first spatial cache;Play the multi-medium data in first spatial cache.In accordance with an embodiment of the present disclosure, the live streaming flow data of multimedia resource can be decoded and be encapsulated again to obtain multi-medium data, and multi-medium data is stored and played in spatial cache, it is played independent of the compatible of net cast flow data format to realize, promotes user experience.

Description

Multimedia resource live play method and device
Technical field
This disclosure relates to field of computer technology more particularly to a kind of multimedia resource live play method and device.
Background technology
Continuous with terminal device is popularized, to the broadcasting demand of various multimedia resources (such as high definition/super clear video) More and more, the broadcasting experience of multimedia resource is increasingly taken seriously.In the related art, to multimedia resource (such as Video resource) when being broadcast live, it will usually download live streaming flow data (such as the live TV stream of HLS or RTMP formats of specific format Data), live streaming flow data is directly decoded and is played, and this broadcast mode possibly can not support all formats simultaneously Flow data is broadcast live.
Invention content
In view of this, the present disclosure proposes a kind of multimedia resource live play method and device, multimedia resource is realized The compatible of live streaming flow data play.
According to the one side of the disclosure, a kind of multimedia resource live play method is provided, the method includes:It obtains The live streaming flow data of multimedia resource;
The live streaming flow data is decoded and is encapsulated again, multi-medium data is obtained;
It will be in multi-medium data storage to the first spatial cache;
Play the multi-medium data in first spatial cache.
For the above method, in one possible implementation, the method further includes:
Obtain the storage address of the multi-medium data in first spatial cache and the multi-medium data Index mapping pair between time.
For the above method, in one possible implementation, the multimedia number in first spatial cache is played According to, including:
In the case where live streaming progress control is triggered, obtain more corresponding to the trigger position of the live streaming progress control The first time of media data;
In the case where the first time belonging to the time of the multi-medium data in first spatial cache, Based on index mapping pair, the first storage address corresponding with the first time is obtained;
Since playing the multi-medium data in first spatial cache first storage address.
For the above method, in one possible implementation, the first time is obtained by following formula:
Playout length/total playout length of the live play time × trigger position of first time=.
For the above method, in one possible implementation, described is played since first storage address Multi-medium data in one spatial cache, including:
It is less than after the first time in first spatial cache, and with the time interval of the first time Or the multi-medium data equal to first time threshold, replace the multi-medium data in the second spatial cache of player.
For the above method, in one possible implementation, the live streaming stream packets include HLS, RTMP or HTTP- Flow data is broadcast live in FLV.
According to another aspect of the present disclosure, a kind of multimedia resource live play device, described device device packet are provided It includes:
Live data acquisition module, the live streaming flow data for obtaining multimedia resource;
Multi-medium data acquisition module obtains multimedia number for being decoded to the live streaming flow data and encapsulating again According to;
Data memory module, for storing the multi-medium data into the first spatial cache;
Data playing module, for playing the multi-medium data in first spatial cache.
For above-mentioned apparatus, in one possible implementation, described device further includes:
Mapping is to acquisition module, the storage address for obtaining the multi-medium data in first spatial cache Index mapping pair between the time of the multi-medium data.
For above-mentioned apparatus, in one possible implementation, the data playing module includes:
Time acquisition submodule, in the case where live streaming progress control is triggered, obtaining the live streaming progress control Trigger position corresponding to multi-medium data first time;
Address acquisition submodule, for belonging to the multimedia in first spatial cache in the first time In the case of the time of data, based on index mapping pair, the first storage address corresponding with the first time is obtained;
Data playback submodule, for since playing more matchmakers in first spatial cache first storage address Volume data.
For above-mentioned apparatus, in one possible implementation, the first time is obtained by following formula:
Playout length/total playout length of the live play time × trigger position of first time=.
For above-mentioned apparatus, in one possible implementation, the data playback submodule includes:
Data replace submodule, after using the first time in first spatial cache, and with described the The time interval of one time is less than or equal to the multi-medium data of first time threshold, in the second spatial cache for replacing player Multi-medium data.
For above-mentioned apparatus, in one possible implementation, the live streaming stream packets include HLS, RTMP or HTTP- Flow data is broadcast live in FLV.
According to another aspect of the present disclosure, a kind of multimedia resource live play device is provided, which is characterized in that packet It includes:
Processor;Memory for storing processor-executable instruction;
Wherein, the processor is configured as:
Obtain the live streaming flow data of multimedia resource;
The live streaming flow data is decoded and is encapsulated again, multi-medium data is obtained;
It will be in multi-medium data storage to the first spatial cache;
Play the multi-medium data in first spatial cache.
According to another aspect of the present disclosure, a kind of non-volatile computer readable storage medium storing program for executing is provided, when the storage When instruction in medium is executed by the processor of terminal and/or server so that terminal and/or server are able to carry out above-mentioned side Method.
Live broadcasting method and device are played according to the multimedia resource of the embodiment of the present disclosure, it can be to the live streaming of multimedia resource Flow data is decoded and is encapsulated again to obtain multi-medium data, and multi-medium data is stored and played in spatial cache, from And it realizes and is played independent of the compatible of net cast flow data format.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, the other feature and aspect of the disclosure will become It is clear.
Description of the drawings
Including in the description and the attached drawing of a part for constitution instruction and specification together illustrate the disclosure Exemplary embodiment, feature and aspect, and for explaining the principles of this disclosure.
Fig. 1 is a kind of flow chart of multimedia resource live play method shown according to an exemplary embodiment.
Fig. 2 is a kind of flow chart of multimedia resource live play method shown according to an exemplary embodiment.
Fig. 3 is the stream of the step S14 of multimedia resource live play method shown according to an exemplary embodiment a kind of Cheng Tu.
Fig. 4 is the stream of the step S14 of multimedia resource live play method shown according to an exemplary embodiment a kind of Cheng Tu.
Fig. 5 is a kind of showing for the application scenarios of multimedia resource live play method shown according to an exemplary embodiment It is intended to.
Fig. 6 is a kind of block diagram of multimedia resource live play device shown according to an exemplary embodiment.
Fig. 7 is a kind of block diagram of multimedia resource live play device shown according to an exemplary embodiment.
Fig. 8 is a kind of block diagram of multimedia resource live play device shown according to an exemplary embodiment.
Specific implementation mode
Various exemplary embodiments, feature and the aspect of the disclosure are described in detail below with reference to attached drawing.It is identical in attached drawing Reference numeral indicate functionally the same or similar element.Although the various aspects of embodiment are shown in the accompanying drawings, remove It non-specifically points out, it is not necessary to attached drawing drawn to scale.
Dedicated word " exemplary " means " being used as example, embodiment or illustrative " herein.Here as " exemplary " Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the disclosure, numerous details is given in specific implementation mode below. It will be appreciated by those skilled in the art that without certain details, the disclosure can equally be implemented.In some instances, for Method, means, element and circuit well known to those skilled in the art are not described in detail, in order to highlight the purport of the disclosure.
Embodiment 1
Fig. 1 is a kind of flow chart of multimedia resource live play method shown according to an exemplary embodiment.The party Method can be applied in terminal device (such as smart mobile phone).As shown in Figure 1, being broadcast live according to the multimedia resource of the embodiment of the present disclosure Playback method includes:
Step S11 obtains the live streaming flow data of multimedia resource;
Step S12 is decoded the live streaming flow data and encapsulates again, obtains multi-medium data;
Step S13, will be in multi-medium data storage to the first spatial cache;
Step S14 plays the multi-medium data in first spatial cache.
In accordance with an embodiment of the present disclosure, the live streaming flow data of multimedia resource can be decoded and is encapsulated again to obtain Multi-medium data, and multi-medium data is stored and played in spatial cache, to realize independent of net cast flow data The compatible of format plays;Also, the multi-medium data directly read when user's selection is reviewed in spatial cache plays out, real Reviewing immediately when having showed live streaming, to promote user experience.
For example, in the related art live multimedia resource (such as video resource) when, it will usually calling system group Part directly plays live TV stream data address, to live streaming flow data carry out physical segment, segmentation download simultaneously plays, the broadcast mode according to Rely the live TV stream data format in multimedia resource, can not accomplish that the compatible of various formats plays.
It in one possible implementation, in accordance with an embodiment of the present disclosure can be by the broadcasting of the client of terminal device Mode setting is data playing mode.It, can be to the download of flow data be broadcast live and plays separately processing under data playing mode. For any type of live streaming flow data of multimedia resource, can initiate to ask for the live streaming flow data download of multimedia resource It asks, obtains the live streaming flow data after physical segment.Wherein, live streaming flow data may include HLS, RTMP or HTTP-FLV live streaming Flow data, the disclosure do not limit the specific format that flow data is broadcast live.
In one possible implementation, can be decoded to the live streaming flow data of download (can be downloaded with side and be broadcast live Flow data side decodes).Illustrate document according to disclosed HLS, RTMP or HTTP-FLV stream protocol format, writes decoder respectively Decode video data (such as h264 video datas) and the audio data (such as aac audio datas) etc. in live streaming flow data; Decoded video data and audio data are uniformly packaged into Flv tag data packets, as multi-medium data.According to live TV stream The temporal information (such as timestamp sequence of live streaming flow data) of data, can also be to multi-medium data (Flv tag data packets) It is ranked up, it will be in the multi-medium data storage to the first spatial cache after sequence.It will be appreciated by those skilled in the art that also may be used Decoded video data and audio data to be packaged into the data packet of extended formatting (such as mp4 formats), the disclosure is to this It is not limited.
In one possible implementation, multi-medium data can be stored into the first spatial cache, wherein first Spatial cache can be the buffer area of self-built live data (such as Flv tag flow datas), be one based on byte arrays Storage object, deposit is the data byte as unit of Flv tag data packets of temporally stamp sequence, and controls Flv tag Data packet first in first out within the scope of the restriction of the first spatial cache.When the first spatial cache is close buys securities with all one's capital, can delete more The tag data bytes between first key frame tag to second key frame tag in media data, or delete first Tag data bytes between key frame tag to n-th key frame tag, to ensure that follow-up data can enter the first spatial cache In.Wherein, n indicates the quantity of key frame tag to be deleted.
It in one possible implementation, can be slow according to condition settings first such as the memory usable ranges of terminal device The capacity in space is deposited, and can be adjusted according to actual conditions, such as the first spatial cache can be set to 100M, also may be used To be configured to the first spatial cache to accommodate the multi-medium data of 0.5h-1h, the disclosure is not construed as limiting this.
It in one possible implementation, can be according to multimedia for the multi-medium data in the first spatial cache The sequence of data, the tag byte packets for taking out multi-medium data successively are supplied to player plays.
Fig. 2 is a kind of flow chart of multimedia resource live play method shown according to an exemplary embodiment.Such as Fig. 2 Shown, in one possible implementation, the method further includes:
Step S15 obtains the storage address of the multi-medium data in first spatial cache and more matchmakers Index mapping pair between the time of volume data.
For example, the storage address that the multi-medium data in the first spatial cache can be obtained and the index between the time Mapping pair, which can be the timestamp of multi-medium data.It, can when by multi-medium data storage to the first spatial cache Mapping the index to also being stored in the first spatial cache, and the index of synchronous maintenance storage address and time map It is right, for example, in the storage address variation of multi-medium data, to index mapping to being updated;It is close in the first spatial cache When buying securities with all one's capital, when deleting a part of multi-medium data, while corresponding index mapping pair is deleted.
It in this way, can be with the storage address of storing multimedia data and the correspondence between the time.
Fig. 3 is the stream of the step S14 of multimedia resource live play method shown according to an exemplary embodiment a kind of Cheng Tu.As shown in figure 3, in one possible implementation, step S14 includes:
Step S141 obtains the trigger position of the live streaming progress control in the case where live streaming progress control is triggered The first time of corresponding multi-medium data;
Step S142 belongs to the time of the multi-medium data in first spatial cache in the first time In the case of, based on index mapping pair, obtain the first storage address corresponding with the first time;
Step S143, since playing the multi-medium data in first spatial cache first storage address.
For example, in the related art, reviewed if a certain position of user's click live streaming progress bar is broadcast live, Live streaming flow data can be reloaded, certain broadcast time-delay is generated, causes the broadcasting of user to be experienced and is deteriorated.
In one possible implementation, in accordance with an embodiment of the present disclosure, if user clicks live streaming progress bar, directly The progress control of broadcasting is triggered, and can obtain the first time of the multi-medium data corresponding to the trigger position of live streaming progress control, Such as when the progress of live streaming is 1h, user, which clicks, corresponds to the position that live streaming progress is 40 minutes on live streaming progress bar, then triggers The first time of multi-medium data corresponding to position is 40 minutes.
In one possible implementation, it can be obtained at the first time by following formula:The first time= The playout length of live play time × trigger position/total playout length.Since the time of live play is with directly The progress broadcast and constantly change, first time of the multi-medium data corresponding to same trigger position it can also happen that variation, because This, can determine at the first time according to live play time, the playout length of trigger position and total playout length, thus Determine the time point reviewed.
In one possible implementation, for the time point (first time) reviewed, the first caching sky can be checked Between in multi-medium data timestamp with the presence or absence of this at the first time.If this belongs at the first time in the first spatial cache Multi-medium data time (timestamp), then can find corresponding multimedia number at the first time according to index mapping pair According to the first storage address.And it is possible to since playing the multi-medium data in the first spatial cache the first storage address.Example Such as, 30 minutes multi-medium datas are stored in the first spatial cache, live streaming progress be 1h, and user triggering when reviewing Between (first time) be 40 minutes when, the multi-medium data of the time is stored in the first spatial cache, then directly from the time (40 minutes) position starts to play, and realization redirects (review immediately) in real time.
In one possible implementation, if this is not belonging to the multimedia number in the first spatial cache at the first time According to time (timestamp), cached except range that is, reviewing time point, then can with re-request be broadcast live interface from first when Between start to download live streaming flow data, repeat the broadcasting step of step S11-S13.
In this way, reviewing in real time when multimedia resource live streaming may be implemented, meanwhile, under live streaming flow data Carry, decoding and encapsulate again etc. remain unaffected it is lasting carry out, so as to when user switches back into the newest live streaming time, quickly Jump back to newest live streaming time point.
Fig. 4 is the stream of the step S14 of multimedia resource live play method shown according to an exemplary embodiment a kind of Cheng Tu.As shown in figure 4, in one possible implementation, step S141 includes:
Step S1431, after the first time in first spatial cache, and with the first time when Between interval less than or equal to first time threshold multi-medium data, replace the multimedia number in the second spatial cache of player According to.
For example, player can have the second spatial cache, and more matchmakers of certain length are preserved in the second spatial cache Volume data, to be rendered and to be played to multi-medium data, interim card when avoiding playing.Live streaming progress control is triggered in user It is broadcast live when reviewing, there is also the multi-medium datas near current point in time in the second spatial cache, are returned in real time to realize It sees, the multi-medium data in the second spatial cache can be replaced.After the first time in the first spatial cache may be used, And it is less than or equal to the multi-medium data of first time threshold with the time interval of first time, replace the second caching of player Multi-medium data in space.The first time threshold can be the second spatial cache in can store multi-medium data when Between threshold value, for example, the first time threshold can be 1s or 2s.The tag bytes of player caching are replaced, and are continued from caching In take tag bytes to thrust player plays, more matchmakers in first spatial cache can be played since at the first time at once Volume data is achieved in live streaming in buffer area and reviews immediately.
In this way, real-time live broadcast may be implemented to review, to improve user experience.
Using example
Below in conjunction with this exemplary application scene of network direct broadcasting, the application example according to the embodiment of the present disclosure is provided, with The flow for being easy to understand data playback and reviewing in real time.It will be understood by those skilled in the art that being only below using example In the purpose for being easy to understand the embodiment of the present invention, it is not construed as the limitation to the embodiment of the present invention.
Fig. 5 is a kind of showing for the application scenarios of multimedia resource live play method shown according to an exemplary embodiment It is intended to.As shown in figure 5, in this is using example, can be decoded to the live streaming flow data of download (can download live TV stream with side Data side decodes), obtain the video data (such as h264 video datas) and audio data (such as aac sounds in live streaming flow data Frequency evidence) etc.;Decoded video data and audio data are uniformly packaged into Flv tag data packets (multi-medium data);It will Temporally stab in the tag data packets storage to the first spatial cache after sequence permutation (such as tag data packet k, the tag numbers in Fig. 5 According to packet k+1, tag data packet k+2 ..., tag data packet n, wherein k, n be positive integer, k<N), and by player access according into Row plays.Hereby it is achieved that the live play of data playing mode.
In this is using example, there can be playing progress bar in broadcast interface, be used to indicate playing progress rate, such as scheme Currently playing in 5 to arrive position 1, multi-medium data being played on is tag data packets n.When the user clicks when position 2, be broadcast live into Degree control is triggered, and can obtain 2 corresponding reproduction time (first time) of position, for example, first time=live play The playout length (playout length of position 2) of time × trigger position/total playout length (playout length of position 1), to really Surely the time point reviewed.
According to the index mapping between the storage address of the tag data packets in the first spatial cache and time (timestamp) It is right, corresponding tag data packets can be found, such as the reproduction time of position 2 corresponds to tag data packets k in Fig. 5;And it is possible to With tag data packets k to tag data packet k+i (i>0, i value depends on the size of the second spatial cache) replace the of player Whole tag data packets in two spatial caches, so as to directly be played since tag data packets k, realization redirects (i.e. in real time When review).
In accordance with an embodiment of the present disclosure, can use data pattern play multi-medium data, to realize independent of regarding The compatible of frequency live TV stream data format plays;Also, the multimedia number in directly reading spatial cache when user's selection is reviewed According to playing out, reviewing immediately when realizing live streaming, to promote user experience.
Embodiment 2
Fig. 6 is a kind of block diagram of multimedia resource live play device shown according to an exemplary embodiment.Such as Fig. 6 institutes Show, which includes:Live data acquisition module 51, multi-medium data acquisition module 52, data Memory module 53 and data playing module 54.
Live data acquisition module 51, the live streaming flow data for obtaining multimedia resource;
Multi-medium data acquisition module 52 obtains multimedia for being decoded to the live streaming flow data and encapsulating again Data;
Data memory module 53, for storing the multi-medium data into the first spatial cache;
Data playing module 54, for playing the multi-medium data in first spatial cache.
Fig. 7 is a kind of block diagram of multimedia resource playing device shown according to an exemplary embodiment.As shown in fig. 7, In one possible implementation, described device further includes:
Mapping is to acquisition module 55, the storage for obtaining the multi-medium data in first spatial cache Index mapping pair between location and the time of the multi-medium data.
As shown in fig. 7, in one possible implementation, the data playing module 54 includes:
Time acquisition submodule 541, in the case where live streaming progress control is triggered, obtaining the live streaming progress control The first time of multi-medium data corresponding to the trigger position of part;
Address acquisition submodule 542, for belonging to described more in first spatial cache in the first time In the case of the time of media data, based on index mapping pair, the first storage corresponding with the first time is obtained Location;
Data playback submodule 543, for since being played in first spatial cache first storage address Multi-medium data.
In one possible implementation, the first time is obtained by following formula:
Playout length/total playout length of the live play time × trigger position of first time=.
As shown in fig. 7, in one possible implementation, the data playback submodule 543 includes:
Data replace submodule 5431, after using the first time in first spatial cache, and with institute The time interval for stating first time is less than or equal to the multi-medium data of first time threshold, and the second caching for replacing player is empty Between in multi-medium data.
In one possible implementation, the live streaming stream packets include HLS, RTMP or HTTP-FLV live streaming fluxion According to.
In accordance with an embodiment of the present disclosure, the live streaming flow data of multimedia resource can be decoded and is encapsulated again to obtain Multi-medium data, and multi-medium data is stored and played in spatial cache, to realize independent of net cast flow data The compatible of format plays;Also, the multi-medium data directly read when user's selection is reviewed in spatial cache plays out, real Reviewing immediately when having showed live streaming, to promote user experience.
Embodiment 3
Fig. 8 is a kind of block diagram of multimedia resource live play device 800 shown according to an exemplary embodiment.Example Such as, device 800 can be mobile phone, computer, digital broadcast terminal, messaging devices, game console, and tablet is set It is standby, Medical Devices, body-building equipment, personal digital assistant etc..
With reference to Fig. 8, device 800 may include following one or more components:Processing component 802, memory 804, power supply Component 806, multimedia component 808, audio component 810, the interface 812 of input/output (I/O), sensor module 814, and Communication component 816.
The integrated operation of 802 usual control device 800 of processing component, such as with display, call, data communication, phase Machine operates and record operates associated operation.Processing component 802 may include that one or more processors 820 refer to execute It enables, to perform all or part of the steps of the methods described above.In addition, processing component 802 may include one or more modules, just Interaction between processing component 802 and other assemblies.For example, processing component 802 may include multi-media module, it is more to facilitate Interaction between media component 808 and processing component 802.
Memory 804 is configured as storing various types of data to support the operation in device 800.These data are shown Example includes instruction for any application program or method that are operated on device 800, contact data, and telephone book data disappears Breath, picture, video etc..Memory 804 can be by any kind of volatibility or non-volatile memory device or their group It closes and realizes, such as static RAM (SRAM), electrically erasable programmable read-only memory (EEPROM) is erasable to compile Journey read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash Device, disk or CD.
Power supply module 806 provides electric power for the various assemblies of device 800.Power supply module 806 may include power management system System, one or more power supplys and other generated with for device 800, management and the associated component of distribution electric power.
Multimedia component 808 is included in the screen of one output interface of offer between described device 800 and user.One In a little embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, screen Curtain may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or more touch sensings Device is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding action Boundary, but also detect duration and pressure associated with the touch or slide operation.In some embodiments, more matchmakers Body component 808 includes a front camera and/or rear camera.When device 800 is in operation mode, such as screening-mode or When video mode, front camera and/or rear camera can receive external multi-medium data.Each front camera and Rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 810 is configured as output and/or input audio signal.For example, audio component 810 includes a Mike Wind (MIC), when device 800 is in operation mode, when such as call model, logging mode and speech recognition mode, microphone by with It is set to reception external audio signal.The received audio signal can be further stored in memory 804 or via communication set Part 816 is sent.In some embodiments, audio component 810 further includes a loud speaker, is used for exports audio signal.
I/O interfaces 812 provide interface between processing component 802 and peripheral interface module, and above-mentioned peripheral interface module can To be keyboard, click wheel, button etc..These buttons may include but be not limited to:Home button, volume button, start button and lock Determine button.
Sensor module 814 includes one or more sensors, and the state for providing various aspects for device 800 is commented Estimate.For example, sensor module 814 can detect the state that opens/closes of device 800, and the relative positioning of component, for example, it is described Component is the display and keypad of device 800, and sensor module 814 can be with 800 1 components of detection device 800 or device Position change, the existence or non-existence that user contacts with device 800,800 orientation of device or acceleration/deceleration and device 800 Temperature change.Sensor module 814 may include proximity sensor, be configured to detect without any physical contact Presence of nearby objects.Sensor module 814 can also include optical sensor, such as CMOS or ccd image sensor, at As being used in application.In some embodiments, which can also include acceleration transducer, gyro sensors Device, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 816 is configured to facilitate the communication of wired or wireless way between device 800 and other equipment.Device 800 can access the wireless network based on communication standard, such as WiFi, 2G or 3G or combination thereof.In an exemplary implementation In example, communication component 816 receives broadcast singal or broadcast related information from external broadcasting management system via broadcast channel. In one exemplary embodiment, the communication component 816 further includes near-field communication (NFC) module, to promote short range communication.Example Such as, NFC module can be based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band (UWB) technology, Bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 800 can be believed by one or more application application-specific integrated circuit (ASIC), number Number processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, it includes the non-volatile computer readable storage medium storing program for executing instructed, example to additionally provide a kind of Such as include the memory 804 of instruction, above-metioned instruction can be executed by the processor 820 of device 800 to complete the above method.
The disclosure can be system, method and/or computer program product.Computer program product may include computer Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the disclosure.
Computer readable storage medium can be can keep and store the instruction used by instruction execution equipment tangible Equipment.Computer readable storage medium for example can be-- but be not limited to-- storage device electric, magnetic storage apparatus, optical storage Equipment, electromagnetism storage device, semiconductor memory apparatus or above-mentioned any appropriate combination.Computer readable storage medium More specific example (non exhaustive list) includes:Portable computer diskette, random access memory (RAM), read-only is deposited hard disk It is reservoir (ROM), erasable programmable read only memory (EPROM or flash memory), static RAM (SRAM), portable Compact disk read-only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanical coding equipment, for example thereon It is stored with punch card or groove internal projection structure and the above-mentioned any appropriate combination of instruction.Calculating used herein above Machine readable storage medium storing program for executing is not interpreted that instantaneous signal itself, the electromagnetic wave of such as radio wave or other Free propagations lead to It crosses the electromagnetic wave (for example, the light pulse for passing through fiber optic cables) of waveguide or the propagation of other transmission mediums or is transmitted by electric wire Electric signal.
Computer-readable program instructions as described herein can be downloaded to from computer readable storage medium it is each calculate/ Processing equipment, or outer computer or outer is downloaded to by network, such as internet, LAN, wide area network and/or wireless network Portion's storage device.Network may include copper transmission cable, optical fiber transmission, wireless transmission, router, fire wall, interchanger, gateway Computer and/or Edge Server.Adapter or network interface in each calculating/processing equipment are received from network to be counted Calculation machine readable program instructions, and the computer-readable program instructions are forwarded, for the meter being stored in each calculating/processing equipment In calculation machine readable storage medium storing program for executing.
For execute the disclosure operation computer program instructions can be assembly instruction, instruction set architecture (ISA) instruction, Machine instruction, machine-dependent instructions, microcode, firmware instructions, condition setup data or with one or more programming languages Arbitrarily combine the source code or object code write, the programming language include the programming language-of object-oriented such as Smalltalk, C++ etc., and conventional procedural programming languages-such as " C " language or similar programming language.Computer Readable program instructions can be executed fully, partly execute on the user computer, is only as one on the user computer Vertical software package executes, part executes or on the remote computer completely in remote computer on the user computer for part Or it is executed on server.In situations involving remote computers, remote computer can pass through network-packet of any kind It includes LAN (LAN) or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as profit It is connected by internet with ISP).In some embodiments, by using computer-readable program instructions Status information carry out personalized customization electronic circuit, such as programmable logic circuit, field programmable gate array (FPGA) or can Programmed logic array (PLA) (PLA), the electronic circuit can execute computer-readable program instructions, to realize each side of the disclosure Face.
Referring herein to according to the flow chart of the method, apparatus (system) of the embodiment of the present disclosure and computer program product and/ Or block diagram describes various aspects of the disclosure.It should be appreciated that flowchart and or block diagram each box and flow chart and/ Or in block diagram each box combination, can be realized by computer-readable program instructions.
These computer-readable program instructions can be supplied to all-purpose computer, special purpose computer or other programmable datas The processor of processing unit, to produce a kind of machine so that these instructions are passing through computer or other programmable datas When the processor of processing unit executes, work(specified in one or more of implementation flow chart and/or block diagram box is produced The device of energy/action.These computer-readable program instructions can also be stored in a computer-readable storage medium, these refer to It enables so that computer, programmable data processing unit and/or other equipment work in a specific way, to be stored with instruction Computer-readable medium includes then a manufacture comprising in one or more of implementation flow chart and/or block diagram box The instruction of the various aspects of defined function action.
Computer-readable program instructions can also be loaded into computer, other programmable data processing units or other In equipment so that series of operation steps are executed on computer, other programmable data processing units or miscellaneous equipment, with production Raw computer implemented process, so that executed on computer, other programmable data processing units or miscellaneous equipment Instruct function action specified in one or more of implementation flow chart and/or block diagram box.
Flow chart and block diagram in attached drawing show the system, method and computer journey of multiple embodiments according to the disclosure The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation One module of table, program segment or a part for instruction, the module, program segment or a part for instruction include one or more use The executable instruction of the logic function as defined in realization.In some implementations as replacements, the function of being marked in box It can occur in a different order than that indicated in the drawings.For example, two continuous boxes can essentially be held substantially in parallel Row, they can also be executed in the opposite order sometimes, this is depended on the functions involved.It is also noted that block diagram and/or The combination of each box in flow chart and the box in block diagram and or flow chart can use function or dynamic as defined in executing The dedicated hardware based system made is realized, or can be realized using a combination of dedicated hardware and computer instructions.
The presently disclosed embodiments is described above, above description is exemplary, and non-exclusive, and It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill Many modifications and changes will be apparent from for the those of ordinary skill in art field.The selection of term used herein, purport In the principle, practical application or technological improvement to the technology in market for best explaining each embodiment, or this technology is made to lead Other those of ordinary skill in domain can understand each embodiment disclosed herein.

Claims (13)

1. a kind of multimedia resource live play method, which is characterized in that including:
Obtain the live streaming flow data of multimedia resource;
The live streaming flow data is decoded and is encapsulated again, multi-medium data is obtained;
It will be in multi-medium data storage to the first spatial cache;
Play the multi-medium data in first spatial cache.
2. according to the method described in claim 1, it is characterized in that, the method further includes:
Obtain the time of the storage address and the multi-medium data of the multi-medium data in first spatial cache Between index mapping pair.
3. according to the method described in claim 2, it is characterized in that, play the multi-medium data in first spatial cache, Including:
In the case where live streaming progress control is triggered, the multimedia corresponding to the trigger position of the live streaming progress control is obtained The first time of data;
In the case where the first time belonging to the time of the multi-medium data in first spatial cache, it is based on The index mapping pair, obtains the first storage address corresponding with the first time;
Since playing the multi-medium data in first spatial cache first storage address.
4. according to the method described in claim 3, it is characterized in that, obtaining the first time by following formula:
Playout length/total playout length of the live play time × trigger position of first time=.
5. according to the method described in claim 3, delaying it is characterized in that, playing described first since first storage address The multi-medium data in space is deposited, including:
It is less than or waits after the first time in first spatial cache, and with the time interval of the first time In the multi-medium data of first time threshold, the multi-medium data in the second spatial cache of player is replaced.
6. according to the method described in any one of claim 1-5, which is characterized in that the live streaming stream packets include HLS, Flow data is broadcast live in RTMP or HTTP-FLV.
7. a kind of multimedia resource live play device, which is characterized in that including:
Live data acquisition module, the live streaming flow data for obtaining multimedia resource;
Multi-medium data acquisition module obtains multi-medium data for being decoded to the live streaming flow data and encapsulating again;
Data memory module, for storing the multi-medium data into the first spatial cache;
Data playing module, for playing the multi-medium data in first spatial cache.
8. device according to claim 7, which is characterized in that described device further includes:
Mapping is to acquisition module, the storage address for obtaining the multi-medium data in first spatial cache and institute Index mapping pair between the time for stating multi-medium data.
9. device according to claim 8, which is characterized in that the data playing module includes:
Time acquisition submodule, in the case where live streaming progress control is triggered, obtaining touching for the live streaming progress control Send out the first time of the multi-medium data corresponding to position;
Address acquisition submodule, for belonging to the multi-medium data in first spatial cache in the first time Time in the case of, based on index mapping pair, corresponding with the first time the first storage address of acquisition;
Data playback submodule, for since playing the multimedia number in first spatial cache first storage address According to.
10. device according to claim 9, which is characterized in that obtain the first time by following formula:
Playout length/total playout length of the live play time × trigger position of first time=.
11. device according to claim 9, which is characterized in that the data playback submodule includes:
Data replace submodule, after using the first time in first spatial cache, and when with described first Between time interval be less than or equal to first time threshold multi-medium data, replace more in the second spatial cache of player Media data.
12. according to the device described in any one of claim 7-11, which is characterized in that the live streaming stream packets include HLS, Flow data is broadcast live in RTMP or HTTP-FLV.
13. a kind of multimedia resource live play device, which is characterized in that including:
Processor;
Memory for storing processor-executable instruction;
Wherein, the processor is configured as:
Obtain the live streaming flow data of multimedia resource;
The live streaming flow data is decoded and is encapsulated again, multi-medium data is obtained;
It will be in multi-medium data storage to the first spatial cache;
Play the multi-medium data in first spatial cache.
CN201710228433.6A 2017-04-10 2017-04-10 Multimedia resource live play method and device Pending CN108696770A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710228433.6A CN108696770A (en) 2017-04-10 2017-04-10 Multimedia resource live play method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710228433.6A CN108696770A (en) 2017-04-10 2017-04-10 Multimedia resource live play method and device

Publications (1)

Publication Number Publication Date
CN108696770A true CN108696770A (en) 2018-10-23

Family

ID=63843121

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710228433.6A Pending CN108696770A (en) 2017-04-10 2017-04-10 Multimedia resource live play method and device

Country Status (1)

Country Link
CN (1) CN108696770A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100552605B1 (en) * 2003-01-16 2006-02-15 사운드그래프 Multi track audio format converting/recovering method and system
CN101917590A (en) * 2009-12-17 2010-12-15 新奥特(北京)视频技术有限公司 Network live broadcasting system with playback function and player
US20120151080A1 (en) * 2010-12-14 2012-06-14 of California Media Repackaging Systems and Software for Adaptive Streaming Solutions, Methods of Production and Uses Thereof
CN103051941A (en) * 2013-01-28 2013-04-17 北京暴风科技股份有限公司 Method and system for playing local video on mobile platform
CN104254012A (en) * 2013-06-28 2014-12-31 广州华多网络科技有限公司 Network video live broadcast method and network video live broadcast system
CN104394476A (en) * 2014-11-28 2015-03-04 乐视致新电子科技(天津)有限公司 Time shifting playing method and media player
CN105763941A (en) * 2016-03-02 2016-07-13 深圳市茁壮网络股份有限公司 Channel switching method and system
CN106534946A (en) * 2016-10-26 2017-03-22 腾讯科技(深圳)有限公司 Control method and device for video playing

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100552605B1 (en) * 2003-01-16 2006-02-15 사운드그래프 Multi track audio format converting/recovering method and system
CN101917590A (en) * 2009-12-17 2010-12-15 新奥特(北京)视频技术有限公司 Network live broadcasting system with playback function and player
US20120151080A1 (en) * 2010-12-14 2012-06-14 of California Media Repackaging Systems and Software for Adaptive Streaming Solutions, Methods of Production and Uses Thereof
CN103051941A (en) * 2013-01-28 2013-04-17 北京暴风科技股份有限公司 Method and system for playing local video on mobile platform
CN104254012A (en) * 2013-06-28 2014-12-31 广州华多网络科技有限公司 Network video live broadcast method and network video live broadcast system
CN104394476A (en) * 2014-11-28 2015-03-04 乐视致新电子科技(天津)有限公司 Time shifting playing method and media player
CN105763941A (en) * 2016-03-02 2016-07-13 深圳市茁壮网络股份有限公司 Channel switching method and system
CN106534946A (en) * 2016-10-26 2017-03-22 腾讯科技(深圳)有限公司 Control method and device for video playing

Similar Documents

Publication Publication Date Title
CN109981607A (en) Media stream processing method and device, electronic equipment and storage medium
CN108093315A (en) Video generation method and device
CN109963166A (en) Online Video edit methods and device
CN108259991A (en) Method for processing video frequency and device
CN108985176A (en) image generating method and device
CN109963168A (en) Video previewing method and device
CN108260020A (en) The method and apparatus that interactive information is shown in panoramic video
CN106664433B (en) Multimedia messages playback method and system, standardized server, live streaming terminal
CN110121106A (en) Video broadcasting method and device
CN104837057A (en) Video file playing method, device and system
CN108737891A (en) Video material processing method and processing device
CN109803158A (en) Video broadcasting method and device
CN109063101A (en) The generation method and device of video cover
CN110493627A (en) Multimedia content synchronization method and device
CN108174269A (en) Visualize audio frequency playing method and device
CN108924491A (en) video stream processing method and device, electronic equipment and storage medium
JP2024513640A (en) Virtual object action processing method, device, and computer program
CN110234020A (en) Video broadcasting method and device
CN108667871A (en) Transmission method based on P2P and device
CN108495162A (en) Method for processing video frequency and device
CN109359218A (en) Multimedia resource methods of exhibiting and device
CN108289229A (en) The interactive approach and device of multimedia resource
CN108574860A (en) Multimedia resource playback method and device
CN109962958A (en) Document processing method and device
CN110121081A (en) Video broadcasting method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Applicant after: Youku network technology (Beijing) Co.,Ltd.

Address before: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Applicant before: 1VERGE INTERNET TECHNOLOGY (BEIJING) Co.,Ltd.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200618

Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Applicant after: Alibaba (China) Co.,Ltd.

Address before: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C

Applicant before: Youku network technology (Beijing) Co.,Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181023