WO2017092561A1 - 实现音视频内容播放的方法和装置 - Google Patents

实现音视频内容播放的方法和装置 Download PDF

Info

Publication number
WO2017092561A1
WO2017092561A1 PCT/CN2016/105393 CN2016105393W WO2017092561A1 WO 2017092561 A1 WO2017092561 A1 WO 2017092561A1 CN 2016105393 W CN2016105393 W CN 2016105393W WO 2017092561 A1 WO2017092561 A1 WO 2017092561A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
player
video
user interface
graphical user
Prior art date
Application number
PCT/CN2016/105393
Other languages
English (en)
French (fr)
Inventor
管坤
曾新海
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2017092561A1 publication Critical patent/WO2017092561A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341Demultiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782Web browsing, e.g. WebTV
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/10Adaptations for transmission by electrical cable

Definitions

  • the present application relates to the field of Internet application technologies, and in particular, to a method and apparatus for implementing audio and video content playback.
  • terminal device With the development of Internet applications, users can use the terminal device to obtain media data streams from the Internet at any time and place, and play audio and video content in the terminal device to meet their entertainment needs.
  • Terminal devices mostly use the browser to realize the playback of Internet audio and video content.
  • the Adobe Flash Player is embedded in the web page.
  • the Adobe Flash Player captures the media data stream and plays the audio and video content, thereby presenting the video content in the playback interface provided by the Adobe Flash Player, and outputting the corresponding audio content.
  • the embodiment of the present application provides an apparatus for implementing a method for playing audio and video content, which can ensure the transmission speed of the media data stream, and no longer needs to pay attention to the version difference between the browser and the player in the terminal device, thereby improving each The versatility of type terminal devices.
  • a method for realizing audio and video content playback comprising:
  • the audio and video content is played in the loaded player through the audio data and video data.
  • a device for implementing audio and video content playback the device running on a terminal side, the device comprising:
  • a loading module for loading a P2P kernel and a player in a running graphical user interface application
  • a pull module configured to pull a media data stream by loading the P2P core
  • a splitting module configured to offload the obtained media data stream to obtain audio data and video data
  • a playing module configured to play the audio and video content in the loaded player through the audio data and the video data.
  • the P2P kernel and the player are loaded in the running graphical user interface application, the media data stream is pulled through the loaded P2P core, and the media data stream is divided to obtain audio data and video data, and the audio data and the audio data are utilized. Video data plays audio and video content. Since the acquisition of the media data stream in the Internet is implemented by the P2P core, it is no longer necessary to pay attention to the version difference between the browser and the player in the terminal device, and the versatility of each type of terminal device is improved.
  • FIG. 1 is a schematic diagram of a terminal device according to an embodiment of the present application.
  • FIG. 2 is a flow chart of a method for implementing audio and video content playback in an embodiment
  • FIG. 3 is a flow chart of a method for loading a P2P kernel and a player in a running graphical user interface application of FIG. 2;
  • FIG. 4 is a flow chart of a method for obtaining audio data and video data by splitting the media data stream obtained in FIG. 2;
  • FIG. 5 is a flow chart of a method for playing audio and video content in a loaded player by using audio data and video data in FIG. 2;
  • FIG. 6 is a schematic diagram of a graphical user interface application in one embodiment
  • FIG. 7 is a schematic diagram of an apparatus for implementing audio and video content playback in an embodiment
  • Figure 8 is a schematic view of the loading module of Figure 7;
  • Figure 9 is a schematic view of the shunt module of Figure 7.
  • Figure 10 is a schematic illustration of the playback module of Figure 7.
  • FIG. 1 is a schematic diagram of a terminal device provided by an embodiment of the present application.
  • the terminal device 100 is an example that is adapted to the present application and is not to be considered as providing any limitation on the scope of use of the present application.
  • the terminal device 100 is also not to be construed as requiring a combination of one or more of the exemplary terminal devices 100 that are dependent on or have the illustrations.
  • the terminal device 100 includes a processor 100, a memory 120, and a system bus 130.
  • Processor 110 is a hardware for executing computer program instructions through basic arithmetic and logic operations in a computer system.
  • Memory 120 is a physical device for temporarily or permanently storing computer programs or data.
  • the load module, the pull module, the shunt module, and the play module may be stored in the memory 120. These modules can be implemented by program instructions.
  • the processor 110 can execute program instructions stored in the memory 120 to run a corresponding graphical user interface application, and the graphical user interface application can obtain the media data stream from the internet by loading the P2P kernel and the player to present the sound to the user. Video content.
  • the terminal device 100 also includes various input interfaces 170, input devices 140 to enable input of various operations.
  • the input device 140 may be at least one of a touch screen, a button, a keyboard, and a mouse.
  • the terminal device 100 also includes a storage device 180, which can be selected from a variety of computer readable storage media, which are any available media that can be accessed, including both mobile and fixed media.
  • a computer readable medium including but not limited to a flash memory (micro SD card), a CD-ROM, a digital versatile disc (DVD) or other optical disc, a magnetic tape cartridge, a tape storage or other storage device, or can be used for storage Information and any other media that can be accessed.
  • the present application can also be implemented by a hardware circuit or a hardware circuit in combination with software instructions. Therefore, implementation of the present application is not limited to any particular hardware circuit, software, and combinations thereof.
  • the method for implementing audio and video content playback is as shown in FIG. 2.
  • the method can include the following steps.
  • Step 210 Load the P2P kernel and player in the graphical user interface application.
  • a graphical user interface application is any application with a graphical user interface that can be viewed The user interface interacts with the user.
  • the graphical user interface application can be any application that needs to continuously acquire media data streams and display audio and video content, for example, an audio and video live application, a game live application, and the like.
  • graphical user interface applications can be built from the C++ language.
  • the P2P core is used to implement P2P transmission in graphical user interface applications to increase transmission speed and save network overhead. That is to say, the P2P core can make the terminal device become a node of the P2P network.
  • the player can be embedded in a graphical user interface application.
  • the loaded graphical user interface application can provide a graphical user interface including a player.
  • step 230 the P2P core pulls the media data stream.
  • the graphical user interface application can listen for audio and video content triggering instructions.
  • the audio and video content triggering instruction may be a live broadcast instruction of a certain program (such as a large event).
  • the media stream is pulled by the P2P core loaded in the graphical user interface application.
  • the P2P kernel in the graphical user interface application when it is running, it can register with the seed server to make itself a seed node and perform P2P communication with other seed nodes through the seed server to request media data streams from other seed nodes. If other seed nodes can provide the requested media data stream, the media data stream is pulled from any of the seed nodes. If the other seed node is unable to provide the requested media data stream, the requested media data stream is pulled from the content distribution server.
  • graphical user interface applications such as audio and video live applications and game live broadcast applications
  • the remote server no longer assumes the role of the server in the traditional http download, but is only responsible for the data transfer between the clients (ie, the seed nodes). It does not store any data for download.
  • the media data can be divided into several blocks and stored in different seed nodes respectively.
  • the seed node that needs to download the media data only needs to download each media data block from various sub-nodes storing the media data block respectively.
  • the download of the media data blocks does not need to be in the set order, as long as the downloaded media data blocks can finally be pieced together to obtain the complete media data.
  • the P2P core in the graphical interface application does not need to rely on the media data stored by the remote server, but does not need to rely on the media data stored by the remote server to pull the media data, thereby ensuring data integrity. Increased media data pull speed and make full use of bandwidth. For example, in a live broadcast scenario of a large game event, since the media data stream includes various video content and corresponding commentary content, the media data stream itself occupies a large bandwidth; since the media data stream needs to be acquired in real time, any delay will be Affect the effect of live broadcast.
  • P2P communication using P2P kernel in graphical interface application can realize the live broadcast of large game events in the graphical interface application, and no longer depends on the remote game live server, but the client of each user who broadcasts this large game event.
  • Step 250 offloading the obtained media data stream, thereby obtaining audio data and video data.
  • the media data stream is obtained by combining audio content and video content according to certain rules (for example, video data first and audio data after), that is, audio data and video data are combined and transmitted. Therefore, after the media data stream is obtained, it needs to be shunted to obtain corresponding audio data and video data respectively.
  • certain rules for example, video data first and audio data after
  • the media data stream is shunted in units of time, and the media data stream corresponding to each unit time is shunted to obtain audio data and video data corresponding to the unit time.
  • the audio data stream is obtained by splicing all the audio data together, and all the video data are spliced together to obtain a video data stream.
  • Step 270 Perform audio and video playback in the player according to the audio data and the video data.
  • the shunted audio data and video data are passed into the player, so that the player outputs the audio and video content, thereby causing the graphical user interface provided by the graphical user interface application to present the continuously transformed video content while outputting the video content. Matching audio content.
  • the above audio and video content playback is realized by the P2P kernel and player loaded in the graphical user interface application, and can be easily operated in various types of terminal devices regardless of the version difference between the browser and the Adobe Flash Player.
  • the graphical user interface application since the graphical user interface application is running at the operating system level, compared with the browser, it is closer to the bottom layer, so it has higher performance and can handle complex Business logic, which can be customized according to the functions that need to be implemented, greatly expands the scope of application.
  • the present application may also use media data obtained by a coding method such as H.265 encoding with strong video compression capability, and adopt The corresponding decoder, thereby reducing the amount of data to be transmitted, enables smoother audio and video services in various graphical user interface applications (such as audio and video live applications, game live applications, audio and video communication tools, etc.).
  • a coding method such as H.265 encoding with strong video compression capability
  • the above step 210 may include the following steps.
  • Step 211 running a graphical user interface application.
  • step 213 the P2P kernel and player are loaded in the graphical user interface application to obtain a graphical user interface including the player.
  • the player loaded by the graphical user interface application can have a decoder and player in the H.265 format, such as the H.265 Decoder Player.
  • the player can play audio and video content in a graphical user interface of a graphical user interface application.
  • the H.265 format decoder and player can run directly on the operating system and can support H.265 format video compression, which means the same video.
  • H.265 format video compression which means the same video.
  • the amount of data obtained is smaller, right
  • the network bandwidth cost is reduced.
  • network resources can be saved and playback fluency can be improved.
  • the above step 250 may include the following steps.
  • step 251 the media data stream obtained by the communication between the P2P core and the player is transmitted from the P2P core to the player.
  • communication between the P2P core and the player can be accomplished via local network communication (Localhost) communication.
  • Localhost local network communication
  • the media data stream can be transmitted to the player through Localhost communication.
  • Step 253 The player divides the media data stream according to a predetermined format to obtain audio data and video data included in the media data stream.
  • the player processes the media data stream to enable playback of audio and video content.
  • the player can offload it first.
  • the player may offload the media data stream in a predetermined format, i.e., the shunt process is a process of extracting audio data and video data in a predetermined format.
  • the video data obtained here is H.265 video data, that is, the video data obtained by encoding according to the H.265 video coding standard, which can improve the video compression ratio.
  • H.265 encoding can maximize the compression of video data, so that the amount of data of video data is as small as possible. Since the live organizer needs to purchase media streams from content providers, a smaller amount of data helps to reduce network bandwidth costs.
  • the above step 270 may include the following steps.
  • step 271 the audio data and the video data are respectively decoded according to a preset audio coding standard and a video coding standard.
  • the video data is H.265 video data, which takes advantage of the high compression ratio of H.265 to reduce the bandwidth of the network bandwidth.
  • the audio data can be AAC audio data.
  • the graphical user interface application as described above can use the streaming transmission and playback mechanism of the H.265+AAC+H.265 Decoder Player+P2P kernel to realize Internet audio and video playback, such as live broadcast of large events and streaming media in a game environment. Play, etc., thereby saving network bandwidth resources while ensuring sound quality.
  • Step 273 The player plays the decoded audio data and the video data, so that the player interface in the graphical user interface continuously plays the audio and video content corresponding to the media data stream.
  • Audio and video synchronization can be performed on the decoded audio data and video data, and the audio and video content in the graphical user interface application can be played by separately playing.
  • the foregoing method may further include:
  • the audio data and video data in the media data stream are combined in a predetermined format for any graphical user interface application to pull through the P2P core.
  • This step can be performed by the output side device of the media data stream.
  • the output side may be a content distribution server in a P2P network, or may be any seed node. That is, any device before the output of the media data stream to the graphical user interface application can perform this step.
  • the graphical user interface application can be built by a C++ program.
  • the graphical user interface application includes a P2P Core (P2P Core) 310 and a player C++ App Player 330 that communicates with the P2P Core.
  • the C++ App Player 330 is the H.265 Decoder Player.
  • the above graphical user interface application adopts the mechanism of H.265+AAC+H.265 Decoder Player+P2P kernel, which can be used in the live broadcast of large-scale events, and can play H.265 high compression rate under the premise that P2P technology saves 50% bandwidth. The advantage of further saving 30% of the bandwidth.
  • the network bandwidth of H.265 encoding is compared with H.264 encoding, and the code rate of H.265 encoding is smaller.
  • the graphical user interface application described above may be a live application of a large gaming event. If the live broadcast application is triggered to play the live content of a large game event, the P2P kernel and player will be loaded in the running graphical user interface application, and the player is embedded in the graphical user interface application through the P2P kernel and other Users who watch this live broadcast of a large game event conduct P2P communication, pull the live media data stream from all places, and transmit it to the player.
  • the player is H.265 Decoder Player, and the video data in the media stream will be H.265 video data, enabling the media stream to achieve very high video compression rates and support for the player.
  • H.265 video data can not only obtain video data with a small amount of data for users who watch live broadcasts of large game events; for live broadcast organizers, it pays content providers according to the amount of data. Therefore, the smaller amount of data also reduces the cost for the live broadcast organizer.
  • the player decodes the received media data stream to obtain corresponding audio data and H.265 video data, broadcasts the live content and corresponding commentary, and ensures synchronization of the content and the commentary.
  • One embodiment provides an apparatus for implementing audio and video content playback.
  • the device can operate in a terminal.
  • the apparatus may include a loading module 410, a pull module 430, a shunt module 450, and a play module 470.
  • the load module 410 can load the P2P kernel and player in a running graphical user interface application.
  • the pull module 430 can pull the media data stream through the P2P core.
  • the offloading module 450 can offload the media data stream to obtain audio data and video data.
  • the play module 470 can play the audio and video content in the player according to the audio data and the video data.
  • a graphical user interface application is any application with a graphical user interface that interacts with the user through a graphical user interface.
  • the graphical user interface application can be any application that needs to continuously acquire media data streams and play audio and video content in a graphical user interface, for example, a video live application, a game application, and the like.
  • graphical user interface applications can be built from the C++ language.
  • the P2P core can implement P2P transmission in a graphical user interface application. That is, the P2P core can make the terminal device become a node of the P2P network to improve the transmission speed and save network overhead.
  • the loaded player can be embedded in a graphical user interface application, and the loaded graphical user interface application can provide a graphical user interface including the player.
  • the load module 410 can cause the two components to perform related operations in the graphical user interface application by loading the P2P kernel and the player in the graphical user interface application.
  • the P2P core in the pull module 430 can be registered with the seed server to make the terminal a seed node, and then perform P2P communication with other seed nodes through the seed server to request media data streams from other seed nodes. Pulling the requested media data from one or more of the seed nodes if other seed nodes can provide the requested media data stream Stream; if the other seed node is unable to provide the requested media data stream, the requested media data stream is pulled from the content distribution server.
  • the P2P core enables graphical user interface applications, especially live applications, to quickly acquire live data without consuming a large amount of bandwidth, greatly reducing data transmission costs.
  • the audio content and the video content are combined to form a media data stream according to a set format (for example, video data first, audio data is followed), that is, the audio data and the video data are combined and transmitted, and therefore, the pull data is obtained.
  • a set format for example, video data first, audio data is followed
  • the shunt module 450 also needs to split the streams to obtain audio data and video data, respectively.
  • the splitting of the media data stream will be based on unit time.
  • the offloading module 450 performs offloading on the media data stream corresponding to each unit time to obtain audio data and video data corresponding to the unit time. All the audio data are spliced together to obtain an audio data stream, and all the video data are spliced together to obtain a video data stream.
  • the audio data and video data obtained by the shunting are transmitted to the player, and the playing module 470 causes the player to output the audio and video content according to the audio data and the video data, so that the graphical user interface provided by the graphical user interface application displays the continuously transformed video content. And enter the audio content that matches the video content.
  • the above audio and video content playback is realized by the P2P kernel and player loaded in the graphical user interface application, avoiding the browser and Adobe Flash Player.
  • the impact of version differences on content playback is easier to run in various types of terminal devices.
  • the graphical user interface application runs at the operating system level, it is closer to the underlying layer than the Adobe Flash Player loaded in the browser, so it has higher performance and can handle more complex business logic, according to the functions that need to be implemented. Try to customize, and then The earth expands the scope of application.
  • the load module 410 can include an application execution unit 411 and a component load unit 413.
  • the application execution unit 411 can trigger the running graphical user interface application.
  • Component loading unit 413 can load the P2P kernel and player in a running graphical user interface application to obtain a graphical user interface that includes the player.
  • the shunt module 450 can include a transmitting unit 451 and an audio and video shunt unit 453.
  • the transmitting unit 451 can transfer the captured media data stream from the P2P core to the player through communication between the P2P core and the player.
  • the audio and video distribution unit 453 may split the obtained media data stream according to a predetermined combined format to obtain audio data and H.265 video data included in the media data stream.
  • the play module 470 can include a decoding unit 471 and an interface content playback unit 473.
  • the decoding unit 471 can separately decode the audio data and the video data in accordance with a preset audio encoding standard and an H.265 video encoding standard.
  • the interface content playing unit 473 can play the decoded audio data and the video data in the loaded player to enable the player in the graphical user interface to play the audio and video content corresponding to the media data stream.
  • means for effecting playback of audio and video content will run on the output side of the media data stream, the means for combining audio data and video data in the media data stream for any graphics in a predetermined combined format User interface applications are pulled through the P2P core.
  • the hardware modules in the embodiments may be implemented in a hardware manner or a hardware platform plus software.
  • the above software includes machine readable instructions stored in a non-volatile storage medium.
  • embodiments can also be embodied as software products.
  • the hardware may be implemented by specialized hardware or hardware that executes machine readable instructions.
  • the hardware can be a specially designed permanent circuit or logic device (such as a dedicated processor such as an FPGA or ASIC) for performing a particular operation.
  • the hardware may also include programmable logic devices or circuits (such as including general purpose processors or other programmable processors) that are temporarily configured by software for performing particular operations.
  • the machine readable instructions corresponding to the modules in the figures may cause an operating system or the like operating on a computer to perform some or all of the operations described herein.
  • the non-transitory computer readable storage medium may be inserted into a memory provided in an expansion board within the computer or written to a memory provided in an expansion unit connected to the computer.
  • the CPU or the like installed on the expansion board or the expansion unit can perform part and all of the actual operations according to the instructions.
  • the non-transitory computer readable storage medium includes a floppy disk, a hard disk, a magneto-optical disk, an optical disk (such as a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, a DVD-RW, a DVD+RW), and a magnetic tape. , non-volatile memory card and ROM.
  • the program code can be downloaded from the server computer by the communication network.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请提供了一种实现音视频内容播放的方法,包括:加载P2P内核和播放器于运行的图形用户界面应用中;通过加载的所述P2P内核拉取媒体数据流;分流拉取得到的所述媒体数据流,以得到音频数据和视频数据;通过所述音频数据和视频数据在加载的所述播放器中进行音视频内容的播放。此外,还提供了一种与该方法匹配的实现音视频内容播放的装置。上述实现音视频内容播放的方法和装置能够保障媒体数据流传输速度,不再需要关注终端设备中浏览器和播放器的版本差异,提高了各类型终端设备的通用性。

Description

实现音视频内容播放的方法和装置 技术领域
本申请涉及互联网应用技术领域,特别涉及一种实现音视频内容播放的方法和装置。
背景
随着互联网应用的发展,用户可以随时随地使用终端设备从互联网络获取媒体数据流,并在终端设备中进行音视频内容的播放,从而满足其娱乐等需求。
终端设备大都是通过浏览器实现互联网音视频内容的播放。通过终端设备中浏览器访问某网页,该网页中嵌入了Adobe Flash Player。该Adobe Flash Player获取媒体数据流并进行音视频内容的播放,从而在Adobe Flash Player所提供的播放界面中呈现视频内容,并输出相应的音频内容。
在Adobe Flash Player所实现的媒体数据流传输和播放架构下,往往存在多个网络连接以提供有效的速度保障。但是,终端设备的浏览器和播放器之间的版本差异可能会影响媒体数据流的接收和播放。
技术内容
基于此,本申请实施例提供一种实现音视频内容播放的方法的装置,所述方法能够保障媒体数据流传输速度,不再需要关注终端设备中浏览器和播放器的版本差异,提高了各类型终端设备的通用性。
一种实现音视频内容播放的方法,包括:
加载P2P内核和播放器于运行的图形用户界面应用中;
通过加载的所述P2P内核拉取媒体数据流;
分流拉取得到的所述媒体数据流,以得到音频数据和视频数据;
通过所述音频数据和视频数据在加载的所述播放器中进行音视频内容的播放。
一种实现音视频内容播放的装置,所述装置运行于终端侧,所述装置包括:
加载模块,用于加载P2P内核和播放器于运行的图形用户界面应用中;
拉取模块,用于通过加载的所述P2P内核拉取媒体数据流;
分流模块,用于分流拉取得到的所述媒体数据流,以得到音频数据和视频数据;
播放模块,用于通过所述音频数据和视频数据在加载的所述播放器中进行音视频内容的播放。
由上述技术方案可知,在运行的图形用户界面应用中加载P2P内核和播放器,通过加载的P2P内核拉取媒体数据流,分流该媒体数据流,以得到音频数据和视频数据,利用音频数据和视频数据进行音视频内容的播放。由于互联网中媒体数据流的获取是由P2P内核实现的,不再需要关注终端设备中浏览器和播放器的版本差异,提高了各类型终端设备的通用性。
附图简要说明
以下附图仅为本申请技术方案的一些例子,本申请并不局限于图中示出的特征。以下附图中,相似的标号表示相似的元素:
图1是本申请实施例提供的一种终端设备的示意图;
图2是一个实施例中实现音视频内容播放的方法流程图;
图3是图2中加载P2P内核和播放器于运行的图形用户界面应用中的方法流程图;
图4是图2中分流拉取得到的媒体数据流,以得到音频数据和视频数据的方法流程图;
图5是图2中通过音频数据和视频数据在加载的播放器中进行音视频内容的播放的方法流程图;
图6是一个实施例中图形用户界面应用的示意图;
图7是一个实施例中实现音视频内容播放的装置示意图;
图8是图7中加载模块的示意图;
图9是图7中分流模块的示意图;
图10是图7中播放模块的示意图。
实施方式
为了描述上的简洁和直观,下文通过描述若干代表性的实施例来对本申请的方案进行阐述。但本文并未示出所有实施方式。实施例中大量的细节仅用于帮助理解本申请的方案,本申请的技术方案实现时可以不局限于这些细节。为了避免不必要地模糊了本申请的方案,一些实施方式没有进行细致地描述,而是仅给出了框架。下文中,“包括”是指“包括但不限于”,“根据......”是指“至少根据......,但不限于仅根据......”。说明书和权利要求书中的“包括”是指某种程度上至少包括,应当解释为除了包括之后提到的特征外,其它特征也可以存在。
图1示出了本申请实施例提供的一种终端设备的示意图。该终端设备100中是一个适配本申请的示例,不能认为是提供了对本申请的使用范围的任何限制。该终端设备100也不能解释为需要依赖于或具有图示的示例性的终端设备100中的一个或者多个部件的组合。
如图1所示,终端设备100包括处理器100、存储器120和系统总线130。包括存储器120和处理器110在内的各种组件将连接到系统总线130上。处理器110是一个用于通过计算机系统中基本的算术和逻辑运算来执行计算机程序指令的硬件。存储器120是一个用于临时或永久性存储计算机程序或数据的物理设备。
其中,存储器120中可以存储有加载模块、拉取模块、分流模块和播放模块。这些模块可以由程序指令实现。处理器110可以执行存储器120中存储的程序指令,以运行相应的图形用户界面应用,图形用户界面应用可以通过加载P2P内核和播放器的来从互联网络中得到媒体数据流,从而向用户呈现音视频内容。
终端设备100还包括各种输入接口170、输入装置140,以实现各种操作的输入。其中,该输入装置140可以是触摸屏幕、按键、键盘和鼠标等至少一种。
终端设备100还包括存储设备180,存储设备180可以从多种计算机可读存储介质中选择,计算机可读介质是指可以进行访问的任何可利用的介质,包括移动的和固定的两种介质。例如,计算机可读介质,包括但不限于闪速存储器(微型SD卡)、CD-ROM、数字通用光盘(DVD)或其它光盘、磁带盒、磁带存储或其它存储设备、或者可用于存储所需信息并可访问的任何其它介质。
此外,通过硬件电路或者硬件电路结合软件指令也能实现本申请,因此,实现本申请并不限于任何特定硬件电路、软件及其组合。
在一个实施例中,该实现音视频内容播放的方法如图2所示。该方法可以包括以下步骤。
步骤210,在图形用户界面应用中加载P2P内核和播放器。
图形用户界面应用是具备图形用户界面的任一应用程序,可通过图 形用户界面与用户交互。例如,该图形用户界面应用可以是任一需要持续获取媒体数据流并进行音视频内容展示的应用,例如,音视频直播应用、游戏直播应用等。一些例子中,图形用户界面应用可以由C++语言构建。
P2P内核用于在图形用户界面应用中实现P2P传输,以提高传输速度,并节省网络开销。也就是说,P2P内核可以使得终端设备成为P2P网络的一个节点。
播放器可以被嵌入到图形用户界面应用中。加载完成的图形用户界面应用可以提供包括播放器的图形用户界面。
步骤230,P2P内核拉取媒体数据流。
完成组件加载后,图形用户界面应用可以侦听音视频内容触发指令。例如,该音视频内容触发指令可以是某一节目(如一大型赛事)的直播指令等。此时,由图形用户界面应用中加载的P2P内核拉取媒体数据流。
例如,图形用户界面应用中的P2P内核运行时,可以在种子服务器注册,以使自身成为一个种子节点,并通过种子服务器与其它种子节点进行P2P通信,从而向其它种子节点请求媒体数据流。若其它种子节点可提供所请求的媒体数据流,则从这些种子节点中的任一节点拉取媒体数据流。若其它种子节点无法提供所请求的媒体数据流,则从内容分发服务器中拉取所请求的媒体数据流。
通过使用P2P内核使得图形用户界面应用(例如音视频直播应用和游戏直播应用)可以快速获取直播数据,并且不需要占用大量的带宽,极大地降低了数据传输成本。
P2P内核拉取媒体数据流的过程中,远端的服务器,例如,种子服务器不再承担传统http下载中服务器的角色,而仅仅负责在各客户端(即种子节点)之间进行数据的中转,其本身并不存放任何供下载的数据。 媒体数据可以被分成若干块,并分别存储于不同的种子节点中,需要下载该媒体数据的种子节点只需要分别从存储了媒体数据块的各种子节点下载各媒体数据块即可。媒体数据块的下载不需要按照设定的顺序,只要下载的媒体数据块最终能够拼凑得到完整的媒体数据即可。
图形界面应用中的P2P内核基于P2P通信进行的媒体数据拉取并不需要依赖于远端服务器存储的媒体数据,而是通过连接多个种子节点拉取媒体数据,在保证数据完整性的同时进而提升了媒体数据拉取速度,充分利用了带宽。例如,在大型游戏赛事的直播场景中,由于媒体数据流中包括了各种视频内容以及相应的解说内容,媒体数据流本身会占用较大带宽;由于需要实时获取媒体数据流,任何的延迟都会影响直播的效果。在图形界面应用中利用P2P内核进行P2P通信可以在图形界面应用中实现大型游戏赛事的直播,并不再依赖于远端的游戏直播服务器,而是观看此大型游戏赛事直播的各用户的客户端相互配合实现实时获取媒体数据流,保证了数据获取速度,从而实现直播。
步骤250,对拉取得到的媒体数据流进行分流,从而得到音频数据和视频数据。
媒体数据流是将音频内容和视频内容按照某种规则(例如视频数据在前,音频数据在后)结合起来得到的,也就是说,音频数据和视频数据是组合在一起进行传输的。因此,在拉取得到媒体数据流之后,还需对其进行分流,以分别得到对应的音频数据和视频数据。
一些例子中,以时间为单位进行媒体数据流的分流,对每一单位时间所对应的媒体数据流执行分流,以得到这一单位时间对应的音频数据和视频数据。将所有的音频数据拼接在一起即可得到音频数据流,将所有的视频数据拼接在一起可以得到视频数据流。
步骤270,根据音频数据和视频数据在播放器中进行音视频播放。
分流得到的音频数据和视频数据被传入播放器中,以使播放器输出音视频内容,进而使得图形用户界面应用所提供的图形用户界面中呈现持续变换的视频内容,同时输出与该视频内容匹配的音频内容。
上述音视频内容播放是通过图形用户界面应用中加载的P2P内核和播放器所实现的,可无视浏览器和Adobe Flash Player的版本差异,更易于运行于各种类型的终端设备中。
在图形用户界面应用的作用下实现的音视频内容播放中,由于图形用户界面应用是运行在操作系统层面的,与浏览器相比较,其更接近底层,因此具备更高性能,可以处理复杂的业务逻辑,可根据所需要实现的功能进行尝试定制,进而极大地扩展了应用范围。
一些例子中,区别于现有的依赖于浏览器以及浏览器中加载Adobe Flash Player的方式,本申请还可以采用基于H.265编码等视频压缩能力较强的编码方式得到的媒体数据,并采用相应的解码器,从而缩小需传输的数据量,从而在各种图形用户界面应用(例如音视频直播应用、游戏直播应用、音视频通信工具等)中实现更为顺畅的音视频服务。
在一个实施例中,如图3所示,上述步骤210可以包括如下步骤。
步骤211,运行图形用户界面应用。
步骤213,在图形用户界面应用中加载P2P内核和播放器,以得到包含播放器的图形用户界面。
图形用户界面应用所加载的播放器可具有H.265格式的解码器和播放器,如H.265 Decoder Player。该播放器可以在图形用户界面应用的图形用户界面中实现音视频内容的播放。
不同于运行在浏览器的网页页面中的Adobe Flash Player,H.265格式的解码器和播放器可以直接运行在操作系统上,可以支持H.265格式的视频压缩,这意味着在相同的视频画质下,所得到的数据量更小,对 于各种音视频直播、游戏直播场景而言,降低了网络带宽成本。对于消耗更多网络资源的实时交互而言,相较于原有的基于H.264+Adobe Flash Player的实现方式,可以节约网络资源,提高播放流畅性。
一个实施例中,如图4所示,上述步骤250可以包括如下步骤。
步骤251,通过P2P内核与播放器之间的通信将拉取得到的媒体数据流由P2P内核传送至播放器。
图形用户界面应用中,P2P内核与播放器之间的通信可以通过本地网络回路(Localhost)通信实现。P2P内核在从多个种子节点所形成的P2P网络中拉取得到媒体数据流之后,可以通过Localhost通信将媒体数据流传送至播放器。
步骤253,播放器按照预定的格式对媒体数据流进行分流,得到媒体数据流包含的音频数据和视频数据。
播放器对媒体数据流进行处理,以实现音视频内容的播放。对于采用音视频混用策略进行传输的媒体数据流而言,播放器可以先对其进行分流。
一些例子中,播放器可以按照预定的格式对媒体数据流进行分流,即,该分流过程是按照预定的格式提取音频数据和视频数据的过程。
一些例子中,这里得到的视频数据为H.265视频数据,即按照H.265视频编码标准编码所得到的视频数据,可以提高视频压缩率。
H.265编码可以使得视频数据得到最大限度的压缩,进而使得视频数据的数据量尽可能小。由于直播组织方需要向内容提供方购买媒体数据流,较小的数据量有助于降低网络带宽成本。
一个实施例中,如图5所示,上述步骤270可以包括如下步骤。
步骤271,按照预设的音频编码标准和视频编码标准分别解码音频数据和视频数据。
在本实施例中,视频数据为H.265视频数据,发挥H.265高压缩率的优势,以降低网络带宽的耗费。
一些例子中,音频数据可以为AAC音频数据。这样,如上所述的图形用户界面应用可以采用H.265+AAC+H.265 Decoder Player+P2P内核的流媒体传输播放机制来实现互联网音视频播放,如大型赛事直播、游戏环境下的流媒体播放等,从而在保证音质画质的同时节省网络带宽资源。
步骤273,播放器播放解码得到的音频数据和视频数据,以使图形用户界面中的播放器界面持续播放媒体数据流对应的音视频内容。
可以对解码后的音频数据和视频数据进行音视频同步,并分别播放即可实现图形用户界面应用中音视频内容的播放。
在另一个实施例中,步骤210之前,上述方法还可以包括:
按照预定的格式组合媒体数据流中的音频数据和视频数据,以供任一图形用户界面应用通过P2P内核拉取。
该步骤可以由媒体数据流的输出侧设备执行。该输出侧可以是P2P网络中的内容分发服务器,也可以是任一种子节点。也就是说,向图形用户界面应用输出媒体数据流之前的任一设备均可执行此步骤。
下面结合一个具体的实施例来详细阐述如上所述的方法。该实施例中,图形用户界面应用中的组件架构如图6所示。该图形用户界面应用可以由C++程序构建。该图形用户界面应用中包括了P2P内核(P2P Core)310和与P2P Core通信的播放器C++App Player 330。其中,该C++App Player330为H.265 Decoder Player。
上述图形用户界面应用采用H.265+AAC+H.265 Decoder Player+P2P内核的机制,应用在大型赛事直播中时,可在P2P技术节省50%带宽的前提下,发挥H.265高压缩率的优势,进一步节省30%的带宽。
如下表所示,在相同清晰度下,H.265编码的网络带宽与H.264编码相对比,可见H.265编码的码率更小。
Figure PCTCN2016105393-appb-000001
表1
一个实施例中,上述图形用户界面应用可以是大型游戏赛事的直播应用。若触发该直播应用进行某大型游戏赛事直播内容的播放时,将在运行的图形用户界面应用中加载P2P内核和播放器,该播放器被嵌入到此图形用户界面应用中,通过P2P内核与其他观看此大型游戏赛事直播的用户进行P2P通信,从各处拉取直播的媒体数据流,并传送至播放器中。
该播放器是H.265 Decoder Player,而媒体数据流中的视频数据将是H.265视频数据,以使得媒体数据流能够实现非常高的视频压缩率,并且能够得到播放器的支持。
H.265视频数据的采用,不但对于观看大型游戏赛事直播的用户而言能够得到数据量较小的视频数据;对于直播组织方而言,由于其是根据数据量的大小而向内容提供方付费的,因此,较小的数据量也为直播组织方降低了成本。
播放器对接收的媒体数据流进行解码得到相应的音频数据和H.265视频数据,播出直播内容和相应的解说,保证了该内容和解说的同步性。
一个实施例提供了一种实现音视频内容播放的装置。该装置可以运行在终端中。如图7所示,该装置可以包括加载模块410、拉取模块430、分流模块450和播放模块470。
加载模块410可以加载P2P内核和播放器于运行的图形用户界面应用中。
拉取模块430可以通过P2P内核拉取媒体数据流。
分流模块450可以对媒体数据流进行分流,得到音频数据和视频数据。
播放模块470可以根据音频数据和视频数据在播放器中进行音视频内容的播放。
图形用户界面应用是具备图形用户界面的任一应用程序,可通过图形用户界面与用户交互。该图形用户界面应用可以是任一需要持续获取媒体数据流并在图形用户界面进行音视频内容播放的应用,例如,某一视频直播应用、某一游戏应用等。一些例子中,图形用户界面应用可以由C++语言构建。P2P内核可以实现图形用户界面应用中的P2P传输,即,P2P内核可以使得所在终端设备成为P2P网络的一个节点,以提高传输速度,并节省网络开销。
加载的播放器可以被嵌入到图形用户界面应用中,加载完成的图形用户界面应用可以提供包括播放器的图形用户界面。
加载模块410可以通过在图形用户界面应用中加载P2P内核和播放器,使得这两大组件可自行在图形用户界面应用中执行相关的操作。
拉取模块430中的P2P内核可以在种子服务器注册,以使终端成为一个种子节点,然后通过种子服务器与其它种子节点进行P2P通信,以向其它种子节点请求媒体数据流。如若其它种子节点可提供请求的媒体数据流,则从这些种子节点中的一个或多个节点拉取所请求的媒体数据 流;如若其它种子节点无法提供请求的媒体数据流,则从内容分发服务器中拉取请求的媒体数据流。
P2P内核可以使图形用户界面应用,特别是直播应用快速获取直播数据,并且不需要占用大量的带宽,极大地降低了数据传输成本。
音频内容和视频内容是按照设定格式(例如视频数据在前,音频数据在后)组合形成媒体数据流的,即,音频数据和视频数据是组合在一起进行传输的,因此,在拉取得到媒体数据流之后,分流模块450还需对其进行分流,以分别得到音频数据和视频数据。
一些例子中,媒体数据流的分流将是按照单位时间进行的。分流模块450对每一单位时间所对应的媒体数据流执行分流,以得到这一单位时间对应的音频数据和视频数据。所有的音频数据拼接在一起即可得到音频数据流,所有的视频数据拼接在一起可以得到视频数据流。
分流所得到的音频数据和视频数据被传入播放器中,播放模块470根据音频数据和视频数据使播放器输出音视频内容,使得图形用户界面应用所提供的图形用户界面展示持续变换的视频内容,并输入与该视频内容匹配的音频内容。
通过如上所述的方式,将使得直播应用、游戏应用、音视频通信工具等各种图形用户界面应用提供更为顺畅的音视频服务。
区别于现有的依赖于浏览器以及浏览器中加载Adobe Flash Player的方式,上述音视频内容播放是通过图形用户界面应用中加载的P2P内核和播放器所实现的,避免浏览器和Adobe Flash Player的版本差异对内容播放的影响,更易于运行于各种类型的终端设备中。
由于图形用户界面应用是运行在操作系统层面的,与浏览器中加载的Adobe Flash Player相比较,更接近底层,因此具备更高性能,可以处理更复杂的业务逻辑,可根据所需要实现的功能进行尝试定制,进而极 大地扩展了应用范围。
如图8所示,在一个实施例中,加载模块410可以包括应用运行单元411和组件加载单元413。
应用运行单元411可以触发运行图形用户界面应用。
组件加载单元413可以在运行的图形用户界面应用中加载P2P内核和播放器,以得到包含播放器的图形用户界面。
如图9所示,在一个实施例中,分流模块450可以包括传送单元451和音视频分流单元453。
传送单元451可以通过P2P内核与播放器之间的通信将拉取得到的媒体数据流由P2P内核传送至播放器。
音视频分流单元453可以按照预定的组合格式分流拉取得到的媒体数据流,以得到媒体数据流包含的音频数据和H.265视频数据。
如图10所示,在一个实施例中,播放模块470可以包括解码单元471和界面内容播放单元473。
解码单元471可以按照预设的音频编码标准和H.265视频编码标准分别解码音频数据和视频数据。
界面内容播放单元473可以在加载的播放器中对解码的音频数据和视频数据进行播放,以使图形用户界面中播放器播放媒体数据流对应的音视频内容。
在另一个实施例中,实现音视频内容播放的装置将运行于媒体数据流的输出侧,该装置用于按照预定的组合格式组合媒体数据流中的音频数据和视频数据,以供任一图形用户界面应用通过P2P内核拉取。
需要说明的是,上述各流程和各结构图中不是所有的步骤和模块都是必须的,可以根据实际的需要忽略某些步骤或模块。各步骤的执行顺序不是固定的,可以根据需要进行调整。各模块的划分仅仅是为了便于 描述采用的功能上的划分,实际实现时,一个模块可以分由多个模块实现,多个模块的功能也可以由同一个模块实现,这些模块可以位于同一个设备中,也可以位于不同的设备中。另外,上面描述中采用“第一”、“第二”仅仅为了方便区分具有同一含义的两个对象,并不表示其有实质的区别。
各实施例中的硬件模块可以以硬件方式或硬件平台加软件的方式实现。上述软件包括机器可读指令,存储在非易失性存储介质中。因此,各实施例也可以体现为软件产品。
各例中,硬件可以由专门的硬件或执行机器可读指令的硬件实现。例如,硬件可以为专门设计的永久性电路或逻辑器件(如专用处理器,如FPGA或ASIC)用于完成特定的操作。硬件也可以包括由软件临时配置的可编程逻辑器件或电路(如包括通用处理器或其它可编程处理器)用于执行特定操作。
图中的模块对应的机器可读指令可以使计算机上操作的操作系统等来完成这里描述的部分或者全部操作。非易失性计算机可读存储介质可以是插入计算机内的扩展板中所设置的存储器中或者写到与计算机相连接的扩展单元中设置的存储器。安装在扩展板或者扩展单元上的CPU等可以根据指令执行部分和全部实际操作。
非易失性计算机可读存储介质包括软盘、硬盘、磁光盘、光盘(如CD-ROM、CD-R、CD-RW、DVD-ROM、DVD-RAM、DVD-RW、DVD+RW)、磁带、非易失性存储卡和ROM。可选择地,可以由通信网络从服务器计算机上下载程序代码。
综上所述,权利要求的范围不应局限于以上描述的例子中的实施方式,而应当将说明书作为一个整体并给予最宽泛的解释。

Claims (15)

  1. 一种实现音视频内容播放的方法,其特征在于,包括:
    将P2P内核和播放器加载到图形用户界面应用中;
    利用所述P2P内核拉取媒体数据流;
    对所述媒体数据流进行分流,得到音频数据和视频数据;
    根据所述音频数据和视频数据在所述播放器中播放音视频内容。
  2. 根据权利要求1所述的方法,其特征在于,所述将P2P内核和播放器加载到图形用户界面应用中包括:
    运行图形用户界面应用;
    在运行的图形用户界面应用中加载P2P内核和播放器,以得到包含所述播放器的图形用户界面。
  3. 根据权利要求1所述的方法,其特征在于,对所述媒体数据流进行分流以得到音频数据和视频数据包括:
    通过所述P2P内核与所述播放器之间的通信将所述媒体数据流由所述P2P内核传送至所述播放器;
    所述播放器按照预定的格式分流所述媒体数据流,以得到所述媒体数据流包含的音频数据和视频数据。
  4. 根据权利要求1所述的方法,其特征在于,根据所述音频数据和视频数据在所述播放器中播放音视频内容包括:
    按照预设的音频编码标准和视频编码标准分别解码所述音频数据和视频数据;
    所述播放器中播放解码得到的所述音频数据和视频数据,以使所述图形用户界面持续输出媒体数据流对应的音视频内容。
  5. 根据权利要求1所述的方法,其特征在于,所述将P2P内核和 播放器加载到图形用户界面应用中之前,所述方法进一步包括:
    按照预定的格式组合所述媒体数据流中的音频数据和视频数据,以供任一图形用户界面应用通过P2P内核拉取。
  6. 一种实现音视频内容播放的装置,其特征在于,所述终端包括处理器和存储器,所述存储器中存储有计算机可读指令,可以使所述处理器执行以下操作:
    将P2P内核和播放器加载到图形用户界面应用中;
    利用所述P2P内核拉取媒体数据流;
    对所述媒体数据流进行分流,以得到音频数据和视频数据;
    根据所述音频数据和视频数据在所述播放器中播放音视频内容。
  7. 根据权利要求6所述的装置,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    运行所述图形用户界面应用;
    在所述图形用户界面应用中加载所述P2P内核和所述播放器,以得到包含所述播放器的图形用户界面。
  8. 根据权利要求6所述的装置,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    通过所述P2P内核与所述播放器之间的通信将所述媒体数据流由所述P2P内核传送至所述播放器;
    按照预定的格式分流所述媒体数据流,以得到所述媒体数据流包含的音频数据和视频数据。
  9. 根据权利要求6所述的装置,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    按照预设的音频编码标准和视频编码标准分别解码所述音频数据和 视频数据;
    在所述播放器中对解码得到的所述音频数据和视频数据进行播放,以使所述图形用户界面持续输出所述媒体数据流对应的音视频内容。
  10. 根据权利要求6所述的装置,其特征在于,所述装置进一步用于按照预定的格式组合所述媒体数据流中的音频数据和视频数据,以另一装置中的P2P内核拉取。
  11. 一种计算机可读存储介质,
    存储有计算机可读指令,可以使至少一个处理器执行以下操作:
    将P2P内核和播放器加载到图形用户界面应用中;
    利用所述P2P内核拉取媒体数据流;
    对所述媒体数据流进行分流,以得到音频数据和视频数据;
    根据所述音频数据和视频数据在所述播放器中播放音视频内容。
  12. 根据权利要求11所述的计算机可读存储介质,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    运行所述图形用户界面应用;
    在所述图形用户界面应用中加载所述P2P内核和所述播放器,以得到包含所述播放器的图形用户界面。
  13. 根据权利要求11所述的计算机可读存储介质,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    通过所述P2P内核与所述播放器之间的通信将所述媒体数据流由所述P2P内核传送至所述播放器;
    按照预定的格式分流所述媒体数据流,以得到所述媒体数据流包含的音频数据和视频数据。
  14. 根据权利要求11所述的装置,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    按照预设的音频编码标准和视频编码标准分别解码所述音频数据和视频数据;
    在所述播放器中对解码得到的所述音频数据和视频数据进行播放,以使所述图形用户界面持续输出所述媒体数据流对应的音视频内容。
  15. 根据权利要求11所述的装置,其特征在于,所述计算机可读指令可以使所述处理器执行以下操作:
    按照预定的格式组合所述媒体数据流中的音频数据和视频数据,以另一装置中的P2P内核拉取。
PCT/CN2016/105393 2015-11-30 2016-11-11 实现音视频内容播放的方法和装置 WO2017092561A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510863962.4 2015-11-30
CN201510863962.4A CN106817613B (zh) 2015-11-30 2015-11-30 实现音视频内容播放的方法和装置

Publications (1)

Publication Number Publication Date
WO2017092561A1 true WO2017092561A1 (zh) 2017-06-08

Family

ID=58796262

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/105393 WO2017092561A1 (zh) 2015-11-30 2016-11-11 实现音视频内容播放的方法和装置

Country Status (2)

Country Link
CN (1) CN106817613B (zh)
WO (1) WO2017092561A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851647A (zh) * 2019-09-29 2020-02-28 广州荔支网络技术有限公司 音频内容流量智能分配方法、装置、设备及可读存储介质
CN113038237A (zh) * 2021-03-17 2021-06-25 百度(中国)有限公司 直播信息处理方法、装置、设备及存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107920072B (zh) * 2017-11-14 2021-02-09 深圳市视维科技股份有限公司 一种基于数据特征的多媒体共享方法及系统
CN109218824B (zh) * 2018-09-29 2021-02-12 视联动力信息技术股份有限公司 一种业务处理的方法和装置
CN111327585B (zh) * 2019-11-28 2022-06-03 北京新奥特体育科技有限公司 处理音视频的方法和系统
CN114697746A (zh) * 2020-12-28 2022-07-01 北京金山云网络技术有限公司 视频启播方法、装置、电子设备及系统
CN112804549B (zh) * 2021-01-15 2023-07-28 北京字节跳动网络技术有限公司 直播数据处理方法及设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1659531A (zh) * 2002-04-08 2005-08-24 索尼电子有限公司 使用学习机制对内容进行过滤
US20090125936A1 (en) * 2007-11-13 2009-05-14 Ravi Kulasekaran Apparatus and Method for Continuous Video Advertising
CN101827116A (zh) * 2010-01-04 2010-09-08 山东大学 一种基于dm6446的嵌入式p2p流媒体直播系统及其工作方法
CN101868938A (zh) * 2007-11-01 2010-10-20 高通股份有限公司 用于增强对用户产生的内容递送的支持的方法和设备
CN101877724A (zh) * 2009-04-28 2010-11-03 英特尔公司 已连接设备之间的直观数据传送
CN104838333A (zh) * 2012-08-31 2015-08-12 谷歌公司 在多个多媒体内容之间切换时调整多媒体的音频音量

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1992602A (zh) * 2005-12-29 2007-07-04 盛趣信息技术(上海)有限公司 将基于p2p网络下载的多媒体文件实现实时播放方法
CN101030938B (zh) * 2007-02-05 2010-04-14 北京大学 QoS自适应的P2P流媒体数据组织与传输系统及方法
KR101089562B1 (ko) * 2010-04-27 2011-12-05 주식회사 나우콤 고화질 미디어 방송을 위한 피투피 라이브 스트리밍 시스템 및 방법
CN103139262A (zh) * 2011-11-25 2013-06-05 上海聚力传媒技术有限公司 一种为网页资源播放器提供资源访问数据的方法与设备
CN104980814A (zh) * 2014-04-03 2015-10-14 南京汇智明华信息科技有限公司 一种适用于高清无失真视频的播放器引擎

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1659531A (zh) * 2002-04-08 2005-08-24 索尼电子有限公司 使用学习机制对内容进行过滤
CN101868938A (zh) * 2007-11-01 2010-10-20 高通股份有限公司 用于增强对用户产生的内容递送的支持的方法和设备
US20090125936A1 (en) * 2007-11-13 2009-05-14 Ravi Kulasekaran Apparatus and Method for Continuous Video Advertising
CN101877724A (zh) * 2009-04-28 2010-11-03 英特尔公司 已连接设备之间的直观数据传送
CN101827116A (zh) * 2010-01-04 2010-09-08 山东大学 一种基于dm6446的嵌入式p2p流媒体直播系统及其工作方法
CN104838333A (zh) * 2012-08-31 2015-08-12 谷歌公司 在多个多媒体内容之间切换时调整多媒体的音频音量

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ZHU, CHENJIE ET AL.: "Clear P2P IPTV Live Streaming System for Set-top Box Clients", SEVENTH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY, 31 December 2007 (2007-12-31), pages 540, XP031338089 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110851647A (zh) * 2019-09-29 2020-02-28 广州荔支网络技术有限公司 音频内容流量智能分配方法、装置、设备及可读存储介质
CN110851647B (zh) * 2019-09-29 2022-10-18 广州荔支网络技术有限公司 音频内容流量智能分配方法、装置、设备及可读存储介质
CN113038237A (zh) * 2021-03-17 2021-06-25 百度(中国)有限公司 直播信息处理方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN106817613B (zh) 2020-08-28
CN106817613A (zh) 2017-06-09

Similar Documents

Publication Publication Date Title
WO2017092561A1 (zh) 实现音视频内容播放的方法和装置
US11019119B2 (en) Web-based live broadcast
WO2019205872A1 (zh) 视频流处理方法、装置、计算机设备及存储介质
WO2017063399A1 (zh) 一种视频播放方法和装置
US20210291045A1 (en) Method, system and electronic device for achieving remote control of computer game by game controller
CN113423018A (zh) 一种游戏数据处理方法、装置及存储介质
WO2017080168A1 (zh) 视频审核的方法及系统
KR20160113230A (ko) 미디어 애플리케이션 백그라운딩
US9462323B1 (en) Method and system for display of mixed media content on devices without standard video
WO2012106272A1 (en) System and method for custom segmentation for streaming
CN103475927B (zh) 在线视频实时变速播放方法及系统
WO2015188575A1 (zh) 视频数据提供方法、视频播放方法、装置及系统
US8127036B2 (en) Remote session media data flow and playback
WO2016188276A1 (zh) 视频播放方法、客户端和计算机存储介质
WO2020155964A1 (zh) 音视频的切换方法、装置、计算机设备及可读存储介质
CN112653700A (zh) 一种基于webrtc网页视频通信的方法
WO2017101418A1 (zh) 多路流媒体播放方法及设备
KR20160039888A (ko) 클라우드 스트리밍 서비스 시스템, 최적 gpu를 이용한 클라우드 스트리밍 서비스 방법 및 이를 위한 장치
WO2017088394A1 (zh) 在线直播视频播放器及方法
Kim et al. Cloud‐based gaming service platform supporting multiple devices
WO2023045973A1 (zh) 直播礼物云渲染方法、装置、电子设备及存储介质
US20230050596A1 (en) Playback mode determining method and apparatus
CN103581741A (zh) 特效播放设备和方法
TWI493362B (zh) 針對多媒體內容支援瀏覽器之服務
WO2024061243A1 (en) Live stream interactive method, device, apparatus and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16869871

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 2.11.18)

122 Ep: pct application non-entry in european phase

Ref document number: 16869871

Country of ref document: EP

Kind code of ref document: A1