CN112019905A - Live broadcast playback method, computer equipment and readable storage medium - Google Patents

Live broadcast playback method, computer equipment and readable storage medium Download PDF

Info

Publication number
CN112019905A
CN112019905A CN201910463110.4A CN201910463110A CN112019905A CN 112019905 A CN112019905 A CN 112019905A CN 201910463110 A CN201910463110 A CN 201910463110A CN 112019905 A CN112019905 A CN 112019905A
Authority
CN
China
Prior art keywords
data
live
media stream
stream data
live broadcast
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910463110.4A
Other languages
Chinese (zh)
Inventor
姜军
秦永芳
王皓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Bilibili Technology Co Ltd
Original Assignee
Shanghai Bilibili Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Bilibili Technology Co Ltd filed Critical Shanghai Bilibili Technology Co Ltd
Priority to CN201910463110.4A priority Critical patent/CN112019905A/en
Publication of CN112019905A publication Critical patent/CN112019905A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • H04N21/42607Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4335Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44004Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a live broadcast playback method, computer equipment and a readable storage medium, and belongs to the technical field of internet. The method comprises the steps of synthesizing the acquired live broadcast data into media stream data, respectively sending the media stream data to a server and a local cache module, locally caching the media stream data by adopting the cache module, and extracting the media stream data stored in the cache module when a local live broadcast end user wants to acquire a video; the cache module can be cleared regularly according to preset rules so as to avoid occupying the memory space of the local client, and the playback video can be generated independently without consuming server resources.

Description

Live broadcast playback method, computer equipment and readable storage medium
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a live playback method, a computer device, and a readable storage medium.
Background
With the continuous development of the live broadcast industry, the network live broadcast is more and more popular, and through live broadcast software, users can share fresh things around the users in real time, so that other users can chat and interact at a closer distance. In a live scene, a main broadcast user can carry out live broadcast in a live broadcast room, and audience users can enter the live broadcast room of the main broadcast user through logging in a server to watch live broadcast video of the main broadcast user. When the audience user misses the real-time live broadcast of the anchor user or the live broadcast user wants to watch the playback live broadcast, the live broadcast of the anchor user can be watched in a playback mode. However, the current watching and playing back of the video requires accessing the server, and the server generates the live video, which consumes more server resources.
Disclosure of Invention
Aiming at the problem that server resources are consumed for obtaining playback videos, a live playback method, computer equipment and a readable storage medium which aim at independently generating playback videos and do not need to consume the server resources are provided.
A live playback method providing a buffer module for storing media stream data, the method comprising the steps of:
acquiring live broadcast data, and synthesizing the live broadcast data into media stream data;
respectively sending the media stream data to a server and the cache module;
and clearing the media stream data in the cache module according to a preset rule, or sending the media stream data in the cache module to a storage module.
Preferably, the step of acquiring live data and synthesizing the live data into media stream data includes:
collecting a live broadcast signal;
encoding the live broadcast signal to obtain live broadcast data;
and converting the live broadcast data into streaming media data with time stamps according to the time sequence for acquiring the live broadcast signals.
Preferably, before the step of converting the live data into streaming media data with time stamps according to the time sequence of acquiring the live signal, the method includes:
and compressing the live data.
Preferably, the live signal includes at least one of an audio signal and a video signal.
Preferably, when the live broadcast signal includes an audio signal and a video signal, the step of acquiring live broadcast data and synthesizing the live broadcast data into media stream data includes:
respectively collecting audio signals and video information;
encoding the audio signal to generate audio live broadcast data;
encoding the video signal to generate video live broadcast data;
and reordering the audio live broadcast data and the video live broadcast data according to the time sequence of collecting the audio signals and the video information to generate streaming media data marked with time stamps.
Preferably, the step of sending the media stream data to the server and the cache module respectively includes:
and copying the media stream data into two parts of media stream data, wherein one part of the media stream data is sent to the server, and the other part of the media stream data is sent to the cache module.
Preferably, the step of clearing the media stream data in the cache module according to a preset rule or sending the media stream data in the cache module to a storage module includes:
monitoring whether a playback instruction is acquired;
if not, clearing at least one video frame data segment in the media stream data in the cache module according to a preset rule;
and if so, sending the media stream data in the cache module to a storage module.
Preferably, the preset rule is as follows:
the storage space in the cache module is smaller than a preset threshold value, or
A preset time period.
The invention also provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method when executing the computer program.
The invention also provides a computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
The beneficial effects of the above technical scheme are that:
in the technical scheme, the obtained live broadcast data are synthesized into media stream data, and then the media stream data are respectively sent to the server and the local cache module, the media stream data can be locally cached by adopting the cache module, and when a local live broadcast end user wants to obtain a playback video, the media stream data stored in the cache module can be extracted; the cache module can be cleared regularly according to preset rules so as to avoid occupying the memory space of the local client, and the playback video can be generated independently without consuming server resources.
Drawings
FIG. 1 is a block diagram of one embodiment of live playback according to the present invention;
fig. 2 is a flowchart of a live playback method according to an embodiment of the present invention;
FIG. 3 is a flow diagram of a method of one embodiment for synthesizing acquired live data into media stream data;
fig. 4 is a flowchart of a live playback method according to another embodiment of the present invention;
fig. 5 is a block diagram of an embodiment of a live playback system according to the present invention;
fig. 6 is a schematic hardware structure diagram of a computer device for executing a live playback method according to an embodiment of the present invention;
fig. 7 is a schematic flow chart diagram of one embodiment of a live playback method.
Detailed Description
The advantages of the invention are further illustrated in the following description of specific embodiments in conjunction with the accompanying drawings.
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "at … …" depending on the context.
In the description of the present invention, it should be understood that the numerical references before the steps do not identify the order of performing the steps, but merely serve to facilitate the description of the present invention and to distinguish each step, and thus should not be construed as limiting the present invention.
The video of the embodiment of the application may be presented on clients such as large-scale video playing devices, game machines, desktop computers, smart phones, tablet computers, MP3(movingpicture expeerpercgroupandioudiolayer iii) players, MP4(movingpicture expeerpercgroupandioudiolayer rlv) players, laptop portable computers, e-book readers, and other display terminals.
The video in the embodiment of the application can be applied to not only the video playing program of the match type, but also any application scene capable of presenting the video, for example, the video can be applied to some job-seeking programs, some relatives, entertainment programs of multi-party confrontation, and the like. The embodiment of the present application takes the application of video to game-like live video playing programs as an example, but is not limited to this.
In the embodiment of the application, a user at a live broadcast end (i.e., a stream push end) can send live broadcast information to each watching end (i.e., a stream pull end) through the server after processing the live broadcast information, and each watching end plays the live broadcast information again. Referring to fig. 1, fig. 1 is a diagram of a live playback system architecture according to an embodiment of the present application. As shown in fig. 1, a user a transmits live broadcast information to a server W through a wireless network, users B and C watch live broadcast video of the user a through the wireless network, and users D and E watch live broadcast video of the user a through a wired network and transmit respective barrage information to the server W. Only one server W is shown here, and the application scenario here may also include multiple servers in communication with each other. The server W may be a cloud server or a local server. In the embodiment of the present application, the server W is placed on the cloud side. If the user A sends the live broadcast information, the server W processes the live broadcast information and forwards the live broadcast information to the user A, the user B, the user C, the user D and the user E. It should be noted that: the device of the user a is not limited to the illustrated mobile device, and all intelligent terminals capable of performing push streaming/live broadcasting are applicable.
The invention provides a live broadcast playback method for solving the defect that a client cannot independently obtain a playback video and needs to consume server resources. It should be noted that: a cache module is provided for storing media stream data. Referring to fig. 2, which is a schematic flow chart of a live playback method according to a preferred embodiment of the present invention, it can be seen that the live playback method provided in this embodiment mainly includes the following steps:
s1, acquiring live broadcast data, and synthesizing the live broadcast data into media stream data;
it should be noted that: the live broadcast playback method is mainly applied to a live broadcast end, and live broadcast data are collected by the live broadcast end.
Further, in step S1, the step of acquiring live data and synthesizing the live data into media stream data (shown in fig. 3) includes:
s11, collecting a live broadcast signal;
wherein the live signal may include at least one of an audio signal and a video signal.
S12, encoding the live broadcast signal to obtain live broadcast data;
and S13, converting the live broadcast data into streaming media data with time stamps according to the time sequence of the collected live broadcast signals.
In a preferred embodiment, before performing step S13, the method may further include:
and compressing the live broadcast data, and reducing the memory of the live broadcast data so as to facilitate data transmission.
In a preferred embodiment, when the live signal includes an audio signal and a video signal, the step S1 of acquiring live data and synthesizing the live data into media stream data includes:
respectively collecting audio signals and video information;
encoding the audio signal to generate audio live broadcast data;
encoding the video signal to generate video live broadcast data;
further, the live video data includes a plurality of video frame data segments, and when the live video data is compressed, a key frame picture of the video frame data segments (i.e. a first frame picture of the video frame data segments) and change data different from a previous frame picture are sequentially recorded, so as to form a Group of Pictures (GOP) queue.
It should be noted that: each group of fields can be considered as a whole and need to exist simultaneously.
And reordering the audio live broadcast data and the video live broadcast data according to the time sequence of collecting the audio signals and the video information to generate streaming media data marked with time stamps. And reordering the audio signals and the video information according to the collected time sequence to generate streaming media data carrying audio and video.
S2, the media stream data are respectively sent to a server and the cache module;
further, the step S2 of sending the media stream data to the server and the cache module respectively includes:
copying the media stream data into two parts of media stream data, and sending one part of media stream data to the server for a watching end to watch video data; and the other part of the media stream data is sent to the cache module for the live broadcast end user to watch the playback video.
It should be noted that: the media stream data stored in the buffer module is valid.
And S3, clearing the media stream data in the cache module according to a preset rule, or sending the media stream data in the cache module to a storage module.
In this embodiment, the obtained live broadcast data is synthesized into media stream data, and then the media stream data is respectively sent to the server and the local cache module, the media stream data can be locally cached by the cache module, and when a user at the local live broadcast end wants to watch a playback video, the media stream data stored in the cache module can be extracted, so that the user can watch the just-stored wonderful instant video; the cache module can be cleared regularly according to preset rules so as to avoid occupying the memory space of the local client, and the playback video can be generated independently without consuming server resources.
In a preferred embodiment, the step S3 of clearing the media stream data in the cache module according to a preset rule, or sending the media stream data in the cache module to a storage module (shown in fig. 4) includes:
s31, monitoring whether a playback instruction is acquired; if yes, go to step S32; if not, go to step S33;
the playback instruction is triggered by a live broadcast end user, and when the live broadcast end user wants to watch the wonderful instant video data which is just played, the playback instruction can be triggered; if the playback instruction is not monitored, the media stream data stored in the cache module can be periodically cleared according to a preset rule so as to ensure that the data stored in the cache module is the latest media stream data.
S32, clearing at least one video frame data segment in the media stream data in the cache module according to a preset rule;
wherein, the preset rule is as follows: the storage space in the cache module is smaller than a preset threshold value or a preset time period.
The number of the video frame data segments to be removed in step S32 can be set by the user according to the requirement.
And S33, sending the media stream data in the cache module to a storage module.
By way of example and not limitation, in step S33, the MP4 packager may be used to convert the media stream data into MP4 format, and send the MP4 format media data to the storage module for local storage for viewing by the user at the live end.
It should be noted that: the media data stored in the storage module can be used for playing, so that a user can play back the wonderful segment at the client; media stream data can also be uploaded to a server to be displayed as a live clip; the media data can be cut by a video editing tool; the user can also share and propagate the media data through third-party software.
In this embodiment, when the preset rule is that the storage space in the cache module is less than 20 megabytes, if the memory space of the cache module is greater than or equal to 20 megabytes and a playback instruction triggered by a user is not monitored, at least one video frame data segment of the cache module is cleared; if the memory space of the cache module is less than 20 megabytes, and a playback instruction triggered by a user is monitored, the media stream data stored in the cache module is sent to the storage module. When the preset rule is 20 seconds, if the storage time of the cache module reaches 20 seconds and a playback instruction triggered by a user is not monitored, clearing at least one video frame data segment in the cache module and timing the storage time of the cache module again; and if a playback instruction triggered by the user is monitored within the time range of 0-20 seconds, transmitting the media stream data stored in the cache module to the storage module.
As shown in fig. 5, a live playback system 1, the system comprising: a buffer module 13, an obtaining unit 11, a distributing unit 14 and a control unit 12, wherein:
a buffer module 13, configured to store media stream data;
the acquisition unit 11 is configured to acquire live broadcast data and synthesize the live broadcast data into media stream data;
further, the acquiring unit 11 may include: an acquisition module 111, an encoding module 112 and a conversion module 113, wherein:
the acquisition module 111 is used for acquiring a live broadcast signal; wherein the live signal may include at least one of an audio signal and a video signal.
An encoding module 112, configured to encode the live broadcast signal to obtain live broadcast data;
and the conversion module 113 is configured to convert the live broadcast data into streaming media data with time stamps according to the time sequence for acquiring the live broadcast signal.
The live video data comprises a plurality of video frame data segments, and when the live video data is compressed, a key frame picture of the video frame data segments (namely, a first frame picture of the video frame data segments) and change data different from a previous frame picture of the video frame data segments are recorded in sequence, so that a Group of Pictures (GOP for short) queue is formed. It should be noted that: each group of fields can be considered as a whole and need to exist simultaneously.
A distribution unit 14, configured to send the media stream data to a server and the cache module 13, respectively;
the control unit 12 is configured to clear the media stream data in the cache module 13 according to a preset rule, or send the media stream data in the cache module 13 to a storage module.
Among them, the control unit 12 may include: a monitoring module 121, a purging module 122, and a processing module 123, wherein:
a monitoring module 121, configured to monitor whether a playback instruction is obtained;
the playback instruction is triggered by a live broadcast end user, and when the live broadcast end user wants to watch the wonderful instant video data which is just played, the playback instruction can be triggered; if the playback instruction is not monitored, at least one video frame data segment in the cache module 13 may be periodically cleared according to a preset rule, so as to ensure that the data stored in the cache module 13 is the latest media stream data.
A clearing module 122, when the monitoring module 121 does not monitor the playback instruction, the clearing module 122 is configured to clear at least one video frame data segment in the cache module 13 according to a preset rule;
wherein, the preset rule is as follows: the storage space in the cache module 13 is smaller than a preset threshold, or a preset time period.
When the monitoring module 121 monitors a playback instruction, the processing module 123 is configured to send the media stream data in the cache module 13 to the storage module.
It should be noted that: the media data stored in the storage module can be used for playing, so that a user can play back the wonderful segment at the client; media stream data can also be uploaded to a server to be displayed as a live clip; the media data can be cut by a video editing tool; the user can also share and propagate the media data through third-party software.
By way of example and not limitation, the processing module 123 may employ an MP4 wrapper to convert the media stream data into MP4 format, and send the MP4 format media data to the storage module for local storage for viewing by a user at the live end.
In this embodiment, the obtained live broadcast data is synthesized into media stream data, and then the media stream data is respectively sent to the server and the local cache module 13, the media stream data can be locally cached by using the cache module 13, and when a user at the local live broadcast end wants to watch a playback video, the media stream data stored in the cache module 13 can be extracted, so that the user can watch the just-saved wonderful instant video; the cache module 13 may periodically clear the video frame data segments according to a preset rule to avoid occupying the memory space of the local client, and may independently generate the playback video without consuming server resources.
As shown in fig. 6, a computer device 2, the computer device 2 comprising:
a memory 21 for storing executable program code; and
a processor 22 for calling said executable program code in said memory 21, the execution steps including the live playback method described above.
One processor 22 is illustrated in fig. 6.
The memory 21, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules (e.g., the cache module 13, the obtaining unit 11, the distributing unit 14, and the control unit 12 shown in fig. 5) corresponding to the live playback method in the embodiment of the present application. The processor 22 executes various functional applications and data processing of the computer device 2 by running the nonvolatile software programs, instructions and modules stored in the memory 21, namely, the live playback method of the above-mentioned method embodiment is realized.
The memory 21 may include a program storage area and a data storage area, wherein the program storage area may store an application program required for at least one function of the operating system; the storage data area may store playback information of the user on the computer device 2. Further, the memory 21 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the memory 21 optionally includes memory 21 located remotely from the processor 22, and these remote memories 21 may be connected to the live playback system 1 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory 21 and when executed by the one or more processors 22 perform the live playback method in any of the method embodiments described above, e.g., performing the method steps S1-S3 in fig. 2 described above, implementing the functions of the caching module 13, the obtaining unit 11, the distributing unit 14 and the control unit 12 shown in fig. 5.
The product can execute the method provided by the embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the methods provided in the embodiments of the present application.
The computer device 2 of the embodiment of the present application exists in various forms, including but not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.
(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.
(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.
(4) A server: the device for providing the computing service comprises a processor, a hard disk, a memory, a system bus and the like, and the server is similar to a general computer architecture, but has higher requirements on processing capacity, stability, reliability, safety, expandability, manageability and the like because of the need of providing high-reliability service.
(5) And other electronic devices with data interaction functions.
The present application provides a non-volatile computer-readable storage medium, which stores computer-executable instructions, which are executed by one or more processors, such as one processor 22 in fig. 6, so that the one or more processors 22 may execute the live playback method in any of the above method embodiments, for example, execute the above-described method steps S1 to S3 in fig. 2, and implement the functions of the cache module 13, the obtaining unit 11, the distributing unit 14, and the control unit 12 shown in fig. 5.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on at least two network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the embodiments of the present application. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a general hardware platform, and certainly can also be implemented by hardware. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a computer readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-only memory (ROM), a Random Access Memory (RAM), or the like.
The first embodiment,
Referring to fig. 7, the live playback method based on the live playback system includes: respectively collecting a video signal and an audio signal; encoding the video signal by using a video encoder to generate video live broadcast data, and encoding the audio signal by using an audio encoder to generate audio live broadcast data; the conversion module is adopted to reorder the video live broadcast data and the audio live broadcast data to generate streaming media data; the media stream data are respectively sent to a server and a cache module through a distribution unit; monitoring a playback instruction by using a monitoring module of the control unit, converting media stream data into an MP4 format by using an MP4 wrapper in the processing module when the playback instruction is monitored, and sending the media stream data to the storage module for local storage; when the playback instruction is not monitored, the clearing module can be adopted to delete at least one video frame data segment in the media stream data in the cache module.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A live playback method, wherein a buffer module is provided for storing media stream data, the method comprising the steps of:
acquiring live broadcast data, and synthesizing the live broadcast data into media stream data;
respectively sending the media stream data to a server and the cache module;
and clearing the media stream data in the cache module according to a preset rule, or sending the media stream data in the cache module to a storage module.
2. The live playback method of claim 1, wherein the step of obtaining live data and synthesizing the live data into media stream data comprises:
collecting a live broadcast signal;
encoding the live broadcast signal to obtain live broadcast data;
and converting the live broadcast data into streaming media data with time stamps according to the time sequence for acquiring the live broadcast signals.
3. The live playback method of claim 2, wherein prior to performing the step of converting the live data into time-stamped streaming media data according to the chronological order of capturing the live signal, comprising:
and compressing the live data.
4. The live playback method of claim 2, wherein the live signal comprises at least one of an audio signal and a video signal.
5. The live playback method according to claim 4, wherein the step of acquiring live data and synthesizing the live data into media stream data when the live signal includes an audio signal and a video signal includes:
respectively collecting audio signals and video information;
encoding the audio signal to generate audio live broadcast data;
encoding the video signal to generate video live broadcast data;
and reordering the audio live broadcast data and the video live broadcast data according to the time sequence of collecting the audio signals and the video information to generate streaming media data marked with time stamps.
6. The live playback method of claim 1, wherein the step of sending the media stream data to a server and the cache module, respectively, comprises:
and copying the media stream data into two parts of media stream data, wherein one part of the media stream data is sent to the server, and the other part of the media stream data is sent to the cache module.
7. The live playback method according to claim 1, wherein the step of clearing the media stream data in the cache module according to a preset rule or sending the media stream data in the cache module to a storage module comprises:
monitoring whether a playback instruction is acquired;
if not, clearing at least one video frame data segment in the media stream data in the cache module according to a preset rule;
and if so, sending the media stream data in the cache module to a storage module.
8. The live playback method according to claim 1 or 7, wherein the preset rule is:
the storage space in the cache module is smaller than a preset threshold value, or
A preset time period.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method of any one of claims 1 to 8 when executing the computer program.
10. A computer-readable storage medium having stored thereon a computer program, characterized in that: the computer program, when executed by a processor, implements the steps of the method of any one of claims 1 to 8.
CN201910463110.4A 2019-05-30 2019-05-30 Live broadcast playback method, computer equipment and readable storage medium Pending CN112019905A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910463110.4A CN112019905A (en) 2019-05-30 2019-05-30 Live broadcast playback method, computer equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910463110.4A CN112019905A (en) 2019-05-30 2019-05-30 Live broadcast playback method, computer equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN112019905A true CN112019905A (en) 2020-12-01

Family

ID=73501242

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910463110.4A Pending CN112019905A (en) 2019-05-30 2019-05-30 Live broadcast playback method, computer equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN112019905A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110708314A (en) * 2019-10-09 2020-01-17 北京字节跳动网络技术有限公司 Live streaming data uploading method and device, electronic equipment and storage medium
CN114245216A (en) * 2021-12-16 2022-03-25 北京数码视讯技术有限公司 Multimedia stream playback apparatus and method
CN114302155A (en) * 2021-12-08 2022-04-08 中广创思网络科技有限公司 Live broadcast delay method and device
CN114679599A (en) * 2022-03-24 2022-06-28 上海哔哩哔哩科技有限公司 Live broadcast watching method and device
CN114786052A (en) * 2022-04-29 2022-07-22 同方知网数字出版技术股份有限公司 Academic live video fast browsing method based on key frame extraction
WO2023185590A1 (en) * 2022-03-28 2023-10-05 华为技术有限公司 Media information acquisition method and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140321826A1 (en) * 2013-04-26 2014-10-30 Microsoft Corporation Synchronizing external data to video playback
CN106385619A (en) * 2016-09-14 2017-02-08 乐视控股(北京)有限公司 Replay method and device for live broadcast video stream
CN106937129A (en) * 2015-12-31 2017-07-07 广州华多网络科技有限公司 A kind of live real-time clipping method of Online Video and device
CN108632675A (en) * 2018-04-09 2018-10-09 北京潘达互娱科技有限公司 A kind of direct playing and playback method, apparatus and equipment
CN108668163A (en) * 2018-05-03 2018-10-16 广州虎牙信息科技有限公司 Live play method, apparatus, computer readable storage medium and computer equipment
CN109618180A (en) * 2019-01-30 2019-04-12 网宿科技股份有限公司 A kind of live data processing method, system and server

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140321826A1 (en) * 2013-04-26 2014-10-30 Microsoft Corporation Synchronizing external data to video playback
CN106937129A (en) * 2015-12-31 2017-07-07 广州华多网络科技有限公司 A kind of live real-time clipping method of Online Video and device
CN106385619A (en) * 2016-09-14 2017-02-08 乐视控股(北京)有限公司 Replay method and device for live broadcast video stream
CN108632675A (en) * 2018-04-09 2018-10-09 北京潘达互娱科技有限公司 A kind of direct playing and playback method, apparatus and equipment
CN108668163A (en) * 2018-05-03 2018-10-16 广州虎牙信息科技有限公司 Live play method, apparatus, computer readable storage medium and computer equipment
CN109618180A (en) * 2019-01-30 2019-04-12 网宿科技股份有限公司 A kind of live data processing method, system and server

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110708314A (en) * 2019-10-09 2020-01-17 北京字节跳动网络技术有限公司 Live streaming data uploading method and device, electronic equipment and storage medium
CN114302155A (en) * 2021-12-08 2022-04-08 中广创思网络科技有限公司 Live broadcast delay method and device
CN114245216A (en) * 2021-12-16 2022-03-25 北京数码视讯技术有限公司 Multimedia stream playback apparatus and method
CN114679599A (en) * 2022-03-24 2022-06-28 上海哔哩哔哩科技有限公司 Live broadcast watching method and device
WO2023185590A1 (en) * 2022-03-28 2023-10-05 华为技术有限公司 Media information acquisition method and electronic device
CN114786052A (en) * 2022-04-29 2022-07-22 同方知网数字出版技术股份有限公司 Academic live video fast browsing method based on key frame extraction

Similar Documents

Publication Publication Date Title
CN112019905A (en) Live broadcast playback method, computer equipment and readable storage medium
CN108391179B (en) Live broadcast data processing method and device, server, terminal and storage medium
WO2016150317A1 (en) Method, apparatus and system for synthesizing live video
CN109889543B (en) Video transmission method, root node, child node, P2P server and system
CN106488273B (en) A kind of method and apparatus for transmitting live video
CN105704504B (en) Method, device, equipment and storage medium for inserting push information in live video
CN109257631B (en) Video carousel playing method and device, computer equipment and storage medium
CN106603503B (en) The treating method and apparatus of live data
CN106998485B (en) Video live broadcasting method and device
CN111866457B (en) Monitoring image processing method, electronic device, storage medium and system
CN108881931B (en) Data buffering method and network equipment
CN106358050A (en) Android based audio and video streaming push method and device as well as Android based audio and video streaming playing method and device
CN108924577B (en) Program production and broadcasting system and method based on live broadcast
CN112492347A (en) Method for processing information flow and displaying bullet screen information and information flow processing system
CN110784757A (en) Game live broadcast method and device in live broadcast client, medium and electronic equipment
CN112312145B (en) Access server, burst traffic caching method, system, computer device and readable storage medium
CN104539984A (en) Video playing method, device and system
CN111436009B (en) Real-time video stream transmission and display method and transmission and play system
CN113794942B (en) Method, apparatus, system, device and medium for switching view angle of free view angle video
CN112492324A (en) Data processing method and system
CN112153401B (en) Video processing method, communication device and readable storage medium
CN105245514B (en) Plug-in recognition methods, apparatus and system
CN109862385B (en) Live broadcast method and device, computer readable storage medium and terminal equipment
CN111954041A (en) Video loading method, computer equipment and readable storage medium
CN114501052B (en) Live broadcast data processing method, cloud platform, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination