WO2017071523A1 - 弹幕处理方法、系统及终端 - Google Patents

弹幕处理方法、系统及终端 Download PDF

Info

Publication number
WO2017071523A1
WO2017071523A1 PCT/CN2016/102760 CN2016102760W WO2017071523A1 WO 2017071523 A1 WO2017071523 A1 WO 2017071523A1 CN 2016102760 W CN2016102760 W CN 2016102760W WO 2017071523 A1 WO2017071523 A1 WO 2017071523A1
Authority
WO
WIPO (PCT)
Prior art keywords
barrage
data
dvb
code stream
network
Prior art date
Application number
PCT/CN2016/102760
Other languages
English (en)
French (fr)
Inventor
万俊杰
刘振华
张孝猛
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017071523A1 publication Critical patent/WO2017071523A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614—Multiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window

Definitions

  • Embodiments of the present invention relate to the field of communications, and in particular, to a barrage processing method, system, and terminal.
  • the barrage is a kind of video program interaction method which has gradually emerged in recent years. It is mainly used in the Internet video service to perform message interaction on the program on-demand and live broadcast. Users can participate in message comments while watching the program. The content will be displayed in the program play window, the user can see the comments content of other users, and form a content interaction such as a message dialogue.
  • the embodiment of the invention provides a method and a device for processing a barrage, so as to at least solve the problem that the application of the barrage application in the field of broadcast television is limited in the related art.
  • a barrage processing method including:
  • the code stream is broadcasted to the terminal via a DVB network.
  • receiving the barrage data includes:
  • the barrage data is received by a server, wherein the server receives the barrage data through a network other than the DVB network.
  • receiving the barrage data includes:
  • inserting the barrography data into the code stream of the DVB includes:
  • inserting the barrography data into the code stream of the DVB includes:
  • the filtered barrage data is inserted into the code stream of the DVB.
  • the method further includes
  • the barrage data is sent to a barrage server of an IP network, the barrage data being used to insert a code stream of the IP network.
  • a barrage processing method including:
  • a barrage corresponding to the barrage data is displayed.
  • displaying the barrage corresponding to the barrage data includes:
  • the canvas generated by the barrage data is overlapped with the current play interface, and the barrage corresponding to the barrage data is displayed.
  • displaying the barrage corresponding to the barrage data includes at least one of the following:
  • the barrage is displayed in accordance with the order of the priority of the barrage.
  • the barrage data includes:
  • Barrage data that carries the animation properties of coordinates, colors, or actions.
  • a barrage processing system including:
  • a barrage server configured to receive barrage data
  • a headend multiplexing playback device configured to insert the barrage data into a code stream of a digital video broadcast DVB;
  • the head end multiplexing playback device is further configured to broadcast the code stream to the terminal through a DVB network.
  • the barrage server receives the barrage data, wherein the barrage server receives the barrage data through a network other than the DVB network.
  • the barrage server receives the barrage data collected or transmitted by the predetermined network platform or the terminal through the other network.
  • the head end multiplex playback device inserts the barrage data into the code stream of the DVB according to the preset service description, where the preset service description is used as the barrage The data is inserted into the standard of the DVB stream.
  • the head end multiplexing playing device buffers the data of the barrage, filters the buffered data, and inserts the filtered barr data into the code stream of the DVB.
  • the barrage server sends the barrage data to a barrage service of an IP network
  • the barrage data is used to insert a code stream of the IP network.
  • a terminal including:
  • a receiving module configured to receive a code stream of a digital video broadcast DVB
  • a decoding module configured to demultiplex the barrage data from the code stream of the DVB, wherein the barrage data is inserted into the code stream of the DVB;
  • the display module is configured to display a barrage corresponding to the barrage data.
  • the display module includes
  • the overlapping display unit is configured to overlap the canvas generated by the barrage data with the current playing interface, and display the barrage corresponding to the barrage data.
  • the display module includes at least one of the following:
  • Displaying a speed time unit configured to display the barrage according to a preset scrolling speed and a disappearing time
  • Displaying the number of units configured to stop displaying the barrage when the number of the barrage exceeds the preset number of barrages
  • Displaying a time unit configured to stop displaying the barrage when the display delay time of the barrage exceeds a preset time
  • the priority units are displayed, and are set to display the barrage according to the order of the salivation priorities.
  • the barrage data includes:
  • Barrage data that carries the animation properties of coordinates, colors, or actions.
  • a computer storage medium is further provided, and the computer storage medium may store an execution instruction for executing the barrage processing method in the above embodiment.
  • the barrage data is received, the barrage data is inserted into the code stream of the digital video broadcasting DVB, and the code stream is broadcasted to the terminal through the DVB network, thereby solving the barrage.
  • the application of the barrage in the field of radio and television has been realized by the limited application of the field of broadcasting and television.
  • FIG. 1 is a flow chart 1 of a method for processing a barrage according to an embodiment of the present invention
  • FIG. 2 is a second flowchart of a method for processing a barrage according to an embodiment of the present invention
  • FIG. 3 is a block diagram showing the structure of a barrage processing system according to an embodiment of the present invention.
  • FIG. 4 is a structural block diagram of a terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a barrage transceiver process according to a preferred embodiment of the present invention.
  • Figure 6 is a schematic illustration of the structure of a head end device in accordance with a preferred embodiment of the present invention.
  • Figure 7 is a schematic illustration of the structure of a barrage server in accordance with a preferred embodiment of the present invention.
  • FIG. 8 is a schematic diagram showing a processing flow of a terminal side to a barrage according to a preferred embodiment of the present invention.
  • FIG. 9 is a block diagram showing the architecture of a dual mode single mode set top box in a coexistence environment according to a preferred embodiment of the present invention.
  • FIG. 1 is a flowchart 1 of a barrage processing method according to an embodiment of the present invention. As shown in FIG. 1, the process includes the following steps:
  • Step S102 receiving barrage data
  • Step S104 inserting the barrage data into the code stream of the digital video broadcast
  • Step S106 The code stream is broadcasted to the terminal through the DVB network.
  • the barrage data is received, the barrage data is inserted into the code stream of the digital video broadcasting DVB, and the code stream is broadcasted to the terminal through the DVB network, thereby solving the limited application of the barrage application in the field of broadcasting and television.
  • the problem has realized the application of the barrage in the field of radio and television.
  • the barrage data can be received in a variety of ways, including the following:
  • the barrage data is received by a server, wherein the server receives the barrage data through a network other than the DVB network.
  • inserting the barrographic data into the code stream of the DVB includes:
  • the barrage data is inserted into the code stream of the DVB according to the preset service description, wherein the preset service description is used as a standard for inserting the barrage data into the DVB code stream.
  • inserting the barrage data into the code stream of the DVB includes: buffering the received data of the barrage; filtering the buffered data of the barrage; and inserting the filtered barrographic data into the DVB The stream of code.
  • the barrage data is sent to a barrage server of an IP network, and the barrage data is used to insert a code stream of the IP network.
  • FIG. 2 is a second flowchart of a barrage processing method according to an embodiment of the present invention. As shown in FIG. 2, the process includes the following steps:
  • Step S202 receiving a code stream of a digital video broadcast DVB
  • Step S204 de-multiplexing the barrage data from the code stream of the DVB, wherein the barrage data is inserted into the code stream of the DVB;
  • Step S206 displaying a barrage corresponding to the barrage data.
  • the code stream of the digital video broadcast DVB is received, and the barrage data is demultiplexed from the code stream of the DVB, wherein the barrage data is inserted into the code stream of the DVB, and the bullet is displayed.
  • the barrage corresponding to the curtain data solves the problem that the application of the barrage application in the field of radio and television is limited, and realizes the application of the barrage in the field of radio and television.
  • the barrage corresponding to the barrage data is displayed
  • the canvas generated by the barrage data is overlapped with the current play interface, and the barrage corresponding to the barrage data is displayed.
  • the barrage corresponding to the barrage data is displayed to include at least one of the following:
  • the barrage is displayed in order of the priority of the barrage.
  • the barrage data includes:
  • Barrage data that carries the animation properties of coordinates, colors, or actions.
  • a barrage processing system is also provided, which is used to implement the above embodiments and preferred embodiments, and has not been described again.
  • the term “module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 3 is a structural block diagram of a barrage processing system according to an embodiment of the present invention. As shown in FIG. 3, the system includes:
  • the barrage server 32 is configured to receive the barrage data
  • the headend multiplexing playback device 34 is configured to insert the barrary data into the code stream of the digital video broadcast DVB;
  • the headend multiplexing playback device 34 is further configured to broadcast the code stream to the terminal over a DVB network.
  • the barrage server 32 receives the barrage data, and the head end multiplexed playback device 34
  • the barrage data is inserted into the code stream of the digital video broadcast DVB, and the head end multiplex playback device 34 broadcasts the code stream to the terminal through the DVB network, thereby solving the problem that the application of the barrage application in the field of broadcast television is limited.
  • the barrage server receives the barrage data, wherein the barrage server receives the barrage data through a network other than the DVB network;
  • the barrage server receives the barrage data collected or transmitted by the predetermined network platform or the terminal through the other network.
  • the head end multiplex playback device inserts the barrage data into the DVB code stream according to the preset service description, where the preset service description is used as the barrage data inserted into the DVB. Standard of code stream;
  • the head-end multiplexed playback device receives the data of the barrage for buffering, filters the buffered data of the barrage, and inserts the filtered barrographic data into the code stream of the DVB.
  • the barrage server sends the barrage data to the barrage server of the IP network, and the barrage data is used to insert the code stream of the IP network.
  • FIG. 4 is a structural block diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 4, the terminal includes:
  • the receiving module 42 is configured to receive a code stream of the digital video broadcast DVB;
  • the decoding module 44 is configured to demultiplex the barrage data from the code stream of the DVB, wherein the barrage data is inserted into the code stream of the DVB;
  • the display module 46 is configured to display a barrage corresponding to the barrage data.
  • the receiving module 42 receives the code stream of the digital video broadcast DVB, and the decoding module 44 demultiplexes the barrage data from the code stream of the DVB, wherein the barrage data is inserted into the code stream of the DVB, and the display module 46 shows the barrage corresponding to the barrage data, which solves the problem that the application of the barrage application in the field of radio and television is limited, and realizes the application of the barrage in the field of radio and television.
  • the display module 46 includes:
  • the overlapping display unit is arranged to overlap the canvas generated by the barrage data with the current playing interface.
  • the barrage corresponding to the barrage data is displayed.
  • the display module 46 includes at least one of the following:
  • Displaying a speed time unit configured to display the barrage according to a preset scrolling speed and a disappearing time
  • the priority unit is displayed, and is set to display the barrage according to the order of the priority of the barrage.
  • the barrage data includes:
  • Barrage data that carries the animation properties of coordinates, colors, or actions.
  • the preferred embodiment of the present invention provides an implementation of the user's barrage interaction in the field of broadcast television.
  • the embodiment of the present invention is to modify or add corresponding equipment to the devices and services in the broadcast television system.
  • Headend transformation In order to reduce the change of related equipment and reduce the dependence of new services on related equipment, the headend has a new barrage server, which is configured according to performance to realize receiving, management and filtering of the barrage.
  • the service description specified in the service transformation must be implemented in the head transformation.
  • the specified service description is similar to the service implemented by the DVB system, such as advertising and data broadcasting. It can be specified according to the headend free description and the content is Convention.
  • the head of the barrage collected by the head reconstruction First, the user-provided content can be equipped with certain animation properties. Set buffer filtering in the server, filter out some uncivilized content such as dirty words, spoilers, etc., and then package according to the format agreed by the business transformation, and use the codec after encapsulation.
  • the device is multiplexed with other services and video programs to form a stream output.
  • the service description specified in the business transformation must be analyzed in the terminal transformation.
  • the barrage can be used as a new service of the terminal.
  • the effect that needs to be achieved after parsing is to display some comments and comments on the program during the program playback. Display on the screen by scrolling or popping up, etc., according to the performance, you need to display some special animations to provide more fun for the barrage interaction.
  • Step 1 The headend adds a barrage server for receiving the user's barrage, which may be collected by a designated network platform, or may be collected by a terminal with a network function.
  • the specific barrage collection scheme is limited by the characteristics of one-way broadcasting of broadcast and television, and can only be carried out using other networks.
  • the barrage server itself requires a certain amount of network bandwidth to receive the barrage data.
  • Step 2 The barrage server accesses the head end playback system, and the filtered barrage data is inserted into the code stream through the coding multiplexing device according to a certain standard.
  • This standard is a new DVB description designed for the barrage.
  • the head-end related equipment has the ability to handle this multiplexing process. The only thing to be aware of is to add software or hardware that is content-encapsulated for the standard implementation of the barrage convention.
  • step 3 the broadcast television program is broadcasted, and the terminal side receives the DVB signal and decodes the broadcast.
  • the terminal should control the opening and closing of the barrage. If it is closed, the barrage content will not be displayed. When it is turned on, only the corresponding barrage for the channel will be displayed on the corresponding channel.
  • Step 4 When the user is watching the program, when there is a need to participate in the barrage, connect to the barrage server through a device with other network functions, such as a mobile phone app, upload and submit his own comment, and the commentary should be able to edit the barrage display. effect.
  • a device with other network functions such as a mobile phone app
  • the realization of the new interactive form of the barrage in the field of radio and television is achieved, so that the television user can realize the display of the barrage on the set-top box of the television set. Adding more fun and interaction to traditional TV playback.
  • the embodiment of the present invention newly designs a service for the DVB system, which bears the broadcast of the content of the barrage.
  • a service for the DVB system which bears the broadcast of the content of the barrage.
  • the incremental change of the system is small, and the impact on the relevant network changes is small.
  • the support of the barrage function of the terminal device is implemented, so that the process of displaying the barrage on the terminal reduces the influence on the relevant terminal architecture.
  • FIG. 5 is a schematic diagram of a barrage transceiver process according to a preferred embodiment of the present invention, as shown in FIG.
  • Step 501 the barrage server independently and other services and video input, receiving barrage data uploaded by various terminals (which may be mobile phones, apps, or two-way set top boxes, etc.);
  • Step 502 inputting a barrage server to other services and videos
  • Step 503 the head end playing device combines the barrage data and the video to the terminal;
  • Step 504 The terminal decodes the display, and the user views the program and browses the bullet review;
  • Step 505 the user submits his own comment to the server, and the server again delivers the comment according to the above process. There is no direct interaction between users, and the interaction under the barrage is realized through the display of the barrage submitted by the user at all terminals.
  • FIG. 6 is a schematic diagram showing the structure of a head end device according to a preferred embodiment of the present invention, as shown in FIG.
  • the source access receives the video stream broadcasted by other TV stations through SDH, satellite, etc. and joins the multiplexer.
  • the audio and video server also adds the local program to the multiplexer, and the service system adds the unexpected service information of the video stream.
  • the TS multiplexing system multiplexes the video code stream and the service into one code stream, and finally performs scrambling and modulating into a corresponding broadcast signal.
  • the head end of the market has this structure.
  • a barrage server device has been added to the service system, and the device requires software and hardware to work together to implement the barrage collection filtering and encapsulation function of the present invention. Compared with the barrage storage mode under the Internet video service, the server does not have the necessary function for storing the barrage information.
  • the code stream can be directly discarded while the processed data is discarded. Therefore, the server mainly focuses on After the network data is received, it is buffered and packed into a stream format.
  • the network receiving 701 is responsible for receiving the barrage comment data through the network, and the buffer database 702 temporarily stores the received user barraries in chronological order.
  • the filtering module 703 blocks some of the language requirements for the television program. The civilization information, the filtering module 703 filters each time according to its own processing capability, and sends it to the filtered data 704. The data is immediately encapsulated into MPEG (Moving Picture Experts Group) by the MPEG package 705. Format, which is the business format before head-end multiplexing.
  • MPEG Motion Picture Experts Group
  • the network feedback 706 is also a network module that is responsible for feeding back the user, commenting whether the submission was successful, and if the reason for the failure is based on the network load capacity, this part is optional. According to the number of users of the operator, it is necessary to estimate the network traffic caused by the barrage service, and finally determine the performance and quantity of the barrage server. Otherwise, feedback such as information exceeding the system capacity is needed, and the user experience is affected.
  • Management Monitoring 707 is the corresponding module used by the operator to monitor and manage.
  • FIG. 8 is a schematic diagram of a processing flow of a terminal side to a barrage according to a preferred embodiment of the present invention, as shown in FIG.
  • Step 801 first demultiplexing the TS (Transport Stream) code stream to obtain various services and a Packet Identifier (PID);
  • Step 802 playing a program
  • Step 803 filtering and parsing the barrage service, and obtaining a barrage, that is, some comments with animation attributes such as coordinates, colors, and actions;
  • Step 804 drawing a barrage on a canvas according to the information of the barrage attribute, and continuously refreshing according to the information until the barrage display is complete;
  • Step 805 superimposing the canvas drawn by the barrage and the interface of the playing program, and combining the two into one can obtain a barrage interaction effect on the video layer.
  • Other implementation effects may also be that the screen portion area is used to display the barrage.
  • the above digital broadcasting only involves the live broadcast service.
  • the barrage data is only used for one broadcast. Even if the front end stores part of the barrage information, the subsequent broadcast will not be broadcast.
  • the operator only needs to process the barrage data of the user, and the number of servers and performance of the erection is predictable considering the size of the user.
  • the interaction is not limited to one operator at a time.
  • the head-end barrage server needs to add a function. Add servers or related software to retrieve relevant barrage data from the barrage servers of other authorized operators, and simultaneously copy the local barrage data. This process should avoid the impact of other operators. Then, the barrage of other operators and the local barrage will be processed at the same time.
  • the number of audience groups is often large, the operator cannot estimate the exact quantity, and the barrage information is displayed in the terminal.
  • There is a performance bottleneck that is, the number of barrage that can be accommodated under a single screen, considering these factors.
  • the scrolling speed and disappearance time of the barrage should be specified, and the maximum number of display bars should be limited during the rolling time of each screen display range. If the number of displays exceeds the number, the barrage is still submitted, according to certain strategies.
  • the processing is performed, such as first attempting to cache and queuing the delay, and directly abandoning the delivery for more than a certain period of time, so that the content of the comment does not match the content of the broadcast.
  • the data of this carrier and other operators can be set with a certain priority.
  • the interval for submitting comments can also be changed according to the program to ensure a balance between the number of displays and the number of receptions.
  • the application mentioned in the embodiment of the present invention is a single-mode set-top box for digital broadcasting.
  • the dual-mode set-top box with OTT or IPTV mode due to the existence of an IP network, the architecture designed by the present invention is not needed, and the network service is directly used.
  • the hair curtain data is consistent with the related network barrage service.
  • the single-mode set-top box cannot utilize the IP network, and the present invention can still be utilized.
  • FIG. 9 is a schematic diagram of a dual-mode single-mode set-top box in a coexistence environment according to a preferred embodiment of the present invention, as shown in FIG.
  • the barrage server is deployed by the network, and the single-mode set-top box will not be affected.
  • the function of the barrage server on the DVB side and the barrage server on the IP side are different, but considering that for the live broadcast program on the network side, the source of the program will be the same set for the same operator.
  • the barrage information can be shared, so the barrage information of the two is copied to each other.
  • IP The on-demand program on the side is not shared with the DVB side, and the on-demand program needs to save the barrage data.
  • only the BD side barrage server adopts the structure described in the present invention.
  • the process of receiving and transmitting the barrage data by using the barrage server of the present invention in several different scenarios is given.
  • the format adopted by the barrage service in any scenario should be consistent.
  • the specific design format can refer to the PES standard of DVB but is not limited to this. Some conditions mentioned in the above several embodiments need to be considered in the design and considered. Factors such as system performance capacity.
  • FIG. 8 is a parsing and showing process, which is specific to different architecture boxes, and the manners adopted according to the UI architecture are different, but the implementation process is consistent.
  • the parsed data of the barrage is drawn to the specific position on the canvas, and the canvas is continuously refreshed, and the data position of the relevant barrage on the canvas is changed to achieve the effect of the barrage animation.
  • the efficiency of the barrage animation refresh if the performance of the set-top box is limited, another way is to cache the barrage data locally, in a time-ordered manner in a specified area without animating with a specified time. Text display.
  • the implementation manner on the terminal is not limited to this, and the content can be completely displayed according to the performance evaluation of the set top box.
  • the terminal side sets a switch in the interface or performs a key switch on the remote controller to control the display and hiding of the barrage content, so that the user can select whether to watch or not.
  • the terminal should not be limited to this, such as using China Mobile Multimedia Broadcasting (CMMB) mobile terminal viewing, or digital television ground.
  • CMMB China Mobile Multimedia Broadcasting
  • DTMB Digital Television Terrestrial Multimedia Broadcasting
  • DVB-T Digital Video Broadcasting
  • the mobile phone itself also has a cellular or IP network access, and the uploading and displaying of the barrage data can be realized directly on the playing software of the mobile terminal.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be through hardware, but in many cases the former is a better implementation.
  • the technical solution of the present invention in essence or the contribution to the related art can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM).
  • the instructions include a plurality of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the method of various embodiments of the present invention.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the modules are located in multiple In the processor.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • the code stream broadcast is sent to the terminal through the DVB network.
  • the storage medium is further arranged to store program code for performing the following steps: receiving the barrage data through the server, wherein the server receives the barrage data through a network other than the DVB network.
  • the storage medium is further arranged to store program code for performing the step of receiving the barrage data collected or transmitted by the predetermined network platform or the terminal through the other network.
  • the storage medium is further configured to store program code for performing the following steps: inserting the barrographic data into the code stream of the DVB according to the preset service description, wherein the preset service description is inserted as the barrage data The standard for DVB streams.
  • the storage medium is further configured to store program code for performing the steps of: buffering the received barrage data; filtering the buffered barrage data; and inserting the filtered barrage data into the DVB stream.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the processor performs the method steps of the foregoing embodiments according to the stored program code in the storage medium.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the barrage data is received, the barrage data is inserted into the code stream of the digital video broadcasting DVB, and the code stream is broadcasted to the terminal through the DVB network, thereby solving the application of the barrage application in the field of broadcast television.
  • the limited problem has realized the application of the barrage in the field of radio and television.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

提供了一种弹幕处理方法、系统及终端，其中，该方法包括：接收弹幕数据，将该弹幕数据插入数字视频广播DVB的码流中，通过DVB网络将该码流广播发送给终端，解决了弹幕应用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。

Description

弹幕处理方法、系统及终端 技术领域
本发明实施例涉及通信领域，具体而言，涉及一种弹幕处理方法、系统及终端。
背景技术
弹幕是近年来逐渐兴起的一种视频节目互动方式，主要是互联网视频业务下应用的可在节目点播、直播中进行留言互动的技术，用户可以在观看节目的同时参与留言点评，所点评留言内容将在节目播放窗口进行展示，用户可以看到其他用户的点评内容，形成留言对话等内容互动。
在广播电视领域，虽然在内容上与互联网视频的目标都是提供视频、电视节目的播放，实现技术是不一样的。广播电视领域，所有节目内容是同时广播出去，由用户选择观看，其天然的带宽是要比互联网更大的，弹幕实现利用的条件接收的通道进行弹幕数据的发送，限定了机顶盒必须带有IP网络，限定了一般用户的使用，该限定不利于弹幕业务的。
在相关技术中，弹幕应用在广播电视领域的应用受限的问题，目前还没有有效的技术方案。
发明内容
本发明实施例提供了一种弹幕处理方法及装置，以至少解决相关技术中弹幕应用在广播电视领域的应用受限的问题。
根据本发明实施例的一个方面，提供了一种弹幕处理方法，包括：
接收弹幕数据；
将所述弹幕数据插入数字视频广播(Digital Video Broadcasting，简称为DVB)的码流中；
通过DVB网络将所述码流广播发送给终端。
可选地，接收所述弹幕数据包括：
通过服务器接收所述弹幕数据，其中，所述服务器通过除所述DVB网络之外的其他网络接收所述弹幕数据。
可选地，接收所述弹幕数据包括：
接收预定网络平台或者终端通过所述其他网络收集并发送的所述弹幕数据。
可选地，将所述弹幕数据插入所述DVB的码流中包括：
按照所述预设的业务描述将所述弹幕数据插入所述DVB的码流中，其中，所述预设的业务描述作为将所述弹幕数据插入所述DVB码流的标准。
可选地，将所述弹幕数据插入所述DVB的码流中包括：
将接收带所述弹幕数据进行缓冲；
对缓冲的所述弹幕数据过滤；
将过滤后的所述弹幕数据插入所述DVB的码流。
可选地，接收弹幕数据之后，还包括，
将所述弹幕数据发送给IP网络的弹幕服务器，所述弹幕数据用于插入所述IP网络的码流。
根据本发明实施例的另一个方面，还提供了一种弹幕处理方法，包括：
接收数字视频广播DVB的码流；
从所述DVB的码流中解复用出弹幕数据，其中，所述弹幕数据插入所述DVB的码流中；
显示所述弹幕数据对应的弹幕。
可选地，显示所述弹幕数据对应的弹幕包括，
将所述弹幕数据生成的画布与当前播放界面重叠，显示所述弹幕数据对应的弹幕。
可选地，显示所述弹幕数据对应的弹幕包括以下至少之一：
依据预设的滚动速度以及消失时间显示所述弹幕；
在所述弹幕的条数超过预设弹幕条数的情况下，不再显示所述弹幕；
在所述弹幕的显示延迟时间超过预设时间的情况下，不再显示所述弹幕；
依据所述弹幕优先级的高低顺序显示所述弹幕。
可选地，所述弹幕数据包括：
携带坐标，色彩或者动作的动画属性的弹幕数据。
根据本发明实施例的另一个方面，还提供了一种弹幕处理系统，包括：
弹幕服务器，设置为接收弹幕数据；
头端复用播放设备，设置为将所述弹幕数据插入数字视频广播DVB的码流中；
所述头端复用播放设备，还设置为通过DVB网络将所述码流广播发送给终端。
可选地，所述弹幕服务器接收所述弹幕数据，其中，所述弹幕服务器通过除所述DVB网络之外的其他网络接收所述弹幕数据。
可选地，所述弹幕服务器接收预定网络平台或者终端通过所述其他网络收集并发送的所述弹幕数据。
可选地，所述头端复用播放设备按照所述预设的业务描述将所述弹幕数据插入所述DVB的码流中，其中，所述预设的业务描述作为将所述弹幕数据插入所述DVB码流的标准。
可选地，所述头端复用播放设备将接收带所述弹幕数据进行缓冲，对缓冲的所述弹幕数据过滤，将过滤后的所述弹幕数据插入所述DVB的码流。
可选地，所述弹幕服务器将所述弹幕数据发送给IP网络的弹幕服务 器，所述弹幕数据用于插入所述IP网络的码流。
根据本发明实施例的另一个方面，还提供了一种终端，包括：
接收模块，设置为接收数字视频广播DVB的码流；
解码模块，设置为从所述DVB的码流中解复用出弹幕数据，其中，所述弹幕数据插入所述DVB的码流中；
显示模块，设置为显示所述弹幕数据对应的弹幕。
可选地，所述显示模块包括，
重叠显示单元，设置为将所述弹幕数据生成的画布与当前播放界面重叠，显示所述弹幕数据对应的弹幕。
可选地，所述显示模块包括以下至少之一：
显示速度时间单元，设置为依据预设的滚动速度以及消失时间显示所述弹幕；
显示条数单元，设置为在所述弹幕的条数超过预设弹幕条数的情况下，不再显示所述弹幕；
显示时间单元，设置为在所述弹幕的显示延迟时间超过预设时间的情况下，不再显示所述弹幕；
显示优先级单元，设置为依据所述弹幕优先级的高低顺序显示所述弹幕。
可选地，所述弹幕数据包括：
携带坐标，色彩或者动作的动画属性的弹幕数据。
在本发明实施例中，还提供了一种计算机存储介质，该计算机存储介质可以存储有执行指令，该执行指令用于执行上述实施例中的弹幕处理方法。
通过本发明实施例，接收弹幕数据，将该弹幕数据插入数字视频广播DVB的码流中，通过DVB网络将该码流广播发送给终端，解决了弹幕应 用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：
图1是根据本发明实施例的一种弹幕处理方法的流程图一；
图2是根据本发明实施例的一种弹幕处理方法的流程图二；
图3是根据本发明实施例的一种弹幕处理系统的结构框图；
图4是根据本发明实施例的一种终端的结构框图；
图5是根据本发明优选实施例的弹幕收发流程示意图；
图6是根据本发明优选实施例的头端设备的结构的示意图；
图7是根据本发明优选实施例的是弹幕服务器的结构的示意图；
图8是根据本发明优选实施例的是终端侧对弹幕的处理流程的示意图；
图9是根据本发明优选实施例的双模单模机顶盒共存环境下的架构示意图。
具体实施方式
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。
在本实施例中提供了一种弹幕处理方法，图1是根据本发明实施例的一种弹幕处理方法的流程图一，如图1所示，该流程包括如下步骤：
步骤S102，接收弹幕数据；
步骤S104，将该弹幕数据插入数字视频广播的码流中；
步骤S106，通过DVB网络将该码流广播发送给终端。
通过上述步骤，接收弹幕数据，将该弹幕数据插入数字视频广播DVB的码流中，通过DVB网络将该码流广播发送给终端，解决了弹幕应用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。
在本实施例中，接收该弹幕数据可以有多种方式，包括以下方式：
通过服务器接收该弹幕数据，其中，该服务器通过除该DVB网络之外的其他网络接收该弹幕数据。
接收预定网络平台或者终端通过该其他网络收集并发送的该弹幕数据。
在本实施例中，将该弹幕数据插入该DVB的码流中包括：
按照该预设的业务描述将该弹幕数据插入该DVB的码流中，其中，该预设的业务描述作为将该弹幕数据插入该DVB码流的标准。
在本实施例中，将该弹幕数据插入该DVB的码流中包括：将接收带该弹幕数据进行缓冲；对缓冲的该弹幕数据过滤；将过滤后的该弹幕数据插入该DVB的码流。
在本实施例中，将该弹幕数据发送给IP网络的弹幕服务器，该弹幕数据用于插入该IP网络的码流。
在本实施例中提供了一种弹幕处理方法，图2是根据本发明实施例的一种弹幕处理方法的流程图二，如图2所示，该流程包括如下步骤：
步骤S202，接收数字视频广播DVB的码流；
步骤S204，从该DVB的码流中解复用出弹幕数据，其中，该弹幕数据插入该DVB的码流中；
步骤S206，显示该弹幕数据对应的弹幕。
通过上述步骤，接收数字视频广播DVB的码流，从该DVB的码流中解复用出弹幕数据，其中，该弹幕数据插入该DVB的码流中，显示该弹 幕数据对应的弹幕，解决了弹幕应用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。
在本实施例中，显示该弹幕数据对应的弹幕包括，
将该弹幕数据生成的画布与当前播放界面重叠，显示该弹幕数据对应的弹幕。
在本实施例中，显示该弹幕数据对应的弹幕包括以下至少之一：
依据预设的滚动速度以及消失时间显示该弹幕；
在该弹幕的条数超过预设弹幕条数的情况下，不再显示该弹幕；
在该弹幕的显示延迟时间超过预设时间的情况下，不再显示该弹幕；
依据该弹幕优先级的高低顺序显示该弹幕。
在上述实施例中，该弹幕数据包括：
携带坐标，色彩或者动作的动画属性的弹幕数据。
在本实施例中还提供了一种弹幕处理系统，该装置用于实现上述实施例及优选实施方式，已经进行过说明的不再赘述。如以下所使用的，术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现，但是硬件，或者软件和硬件的组合的实现也是可能并被构想的。
图3是根据本发明实施例的一种弹幕处理系统的结构框图，如图3所示，该系统包括：
弹幕服务器32，设置为接收弹幕数据；
头端复用播放设备34，设置为将该弹幕数据插入数字视频广播DVB的码流中；
该头端复用播放设备34，还设置为通过DVB网络将该码流广播发送给终端。
通过上述系统，弹幕服务器32接收弹幕数据，头端复用播放设备34 将该弹幕数据插入数字视频广播DVB的码流中，该头端复用播放设备34通过DVB网络将该码流广播发送给终端，解决了弹幕应用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。
在本实施例中，该弹幕服务器接收该弹幕数据，其中，该弹幕服务器通过除该DVB网络之外的其他网络接收该弹幕数据；
该弹幕服务器接收预定网络平台或者终端通过该其他网络收集并发送的该弹幕数据。
在本实施例中，该头端复用播放设备按照该预设的业务描述将该弹幕数据插入该DVB的码流中，其中，该预设的业务描述作为将该弹幕数据插入该DVB码流的标准；
该头端复用播放设备将接收带该弹幕数据进行缓冲，对缓冲的该弹幕数据过滤，将过滤后的该弹幕数据插入该DVB的码流。
在本实施例中，该弹幕服务器将该弹幕数据发送给IP网络的弹幕服务器，该弹幕数据用于插入该IP网络的码流。
图4是根据本发明实施例的一种终端的结构框图，如图4示，该终端包括：
接收模块42，设置为接收数字视频广播DVB的码流；
解码模块44，设置为从该DVB的码流中解复用出弹幕数据，其中，该弹幕数据插入该DVB的码流中；
显示模块46，设置为显示该弹幕数据对应的弹幕。
通过上述终端，接收模块42接收数字视频广播DVB的码流，解码模块44从该DVB的码流中解复用出弹幕数据，其中，该弹幕数据插入该DVB的码流中，显示模块46显示该弹幕数据对应的弹幕，解决了弹幕应用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。
在本实施例中，该显示模块46包括：
重叠显示单元，设置为将该弹幕数据生成的画布与当前播放界面重叠， 显示该弹幕数据对应的弹幕。
在本实施例中，该显示模块46包括以下至少之一：
显示速度时间单元，设置为依据预设的滚动速度以及消失时间显示该弹幕；
显示条数单元，设置为在该弹幕的条数超过预设弹幕条数的情况下，不再显示该弹幕；
显示时间单元，设置为在该弹幕的显示延迟时间超过预设时间的情况下，不再显示该弹幕；
显示优先级单元，设置为依据该弹幕优先级的高低顺序显示该弹幕。
在本实施例中，该弹幕数据包括：
携带坐标，色彩或者动作的动画属性的弹幕数据。
下面结合优选实施例和实施方式对本发明进行详细说明。
本发明的优选实施例是在广播电视领域内为用户的弹幕互动提供一种实现，本发明的实施例是对广播电视系统内的设备、业务分别在三个层面进行改造或增加相应设备、功能。
1、头端改造：为减少对相关设备的变动，减少新业务对相关设备的依赖，头端新增弹幕服务器，根据性能决定配置，实现对弹幕进行接收、管理、过滤等。
2、业务改造，在相关的DVB业务里实现弹幕是不合适的，需要为弹幕业务开辟专门的业务描述，在系统中为弹幕传输预留一定带宽。
3、终端改造：终端对弹幕的展示需要进行业务实现，这部分的变动更多的是参考网络视频播放器的弹幕实现，对一条有一定属性的弹幕评论进行展示。
业务改造中所规定的业务描述在头部改造中必须予以实现，具体规定的业务描述与DVB系统实现的如广告、数据广播等业务类似，可以根据头端空余描述子进行指定，并对内容进行约定。头部改造所搜集的弹幕首 先是用户提供的内容，可带有一定动画属性，在服务器中设置缓冲过滤，过滤掉一些如脏话、剧透等不文明内容后，按照业务改造所约定的格式进行封装，封装后使用编解码复用设备与其他业务以及视频节目一起复用形成码流输出。
业务改造中所规定的业务描述在终端改造中必须进行解析，弹幕可作为终端的一个新的业务，解析后需要达到的效果是在节目播放的过程中，展示针对该节目的一些评论，评论在屏幕上以滚动或者弹出方式等进行展示，根据性能还需展示一些特殊动画，为弹幕互动提供更多的趣味性。
本发明优选实施例中基于广播电视的弹幕实现方法包括以下步骤：
步骤1，头端增加了弹幕服务器，用于接收用户弹幕，可以是指定网络平台收集，可以是带有网络功能的终端收集。具体的弹幕搜集方案受广播电视单向广播特点的限制，只能使用其他网络进行。弹幕服务器本身需要一定的网络带宽接收弹幕数据。
步骤2，弹幕服务器接入头端播放系统，将经过过滤的弹幕数据按照一定标准通过编码复用设备插入码流中，这个标准即为为弹幕设计的新的DVB描述。头端相关设备有能力处理这一复用过程，唯一需要注意的是增加为弹幕约定的标准实现内容封装的软件或硬件。
步骤3，播发广播电视节目，终端侧接收DVB信号并解码播放。终端应对弹幕进行开关控制，关闭即不显示弹幕内容，开启时在相应的频道只显示针对该频道相应的弹幕。
步骤4，用户观看节目的过程中有参与弹幕的需要的时候，通过有其他网络功能的设备，如手机app等连接到弹幕服务器，上传提交自己的评论，评论时应当可以编辑弹幕显示效果。
之后，重复这一过程，完整实现了整个弹幕从某个用户提交到展示给所有用户的过程，实现弹幕在广播电视上的互动。
通过上述本发明的实施例，达成了弹幕这一新的互动形式在广播电视领域内的实现，使得电视用户可以在电视机顶盒终端上实现弹幕的展示， 为传统的电视播放增加了更多趣味性和互动感。
本发明的实施例为DVB系统新设计了一种业务，该业务承担对弹幕内容的播发。在头端系统层面，只需额外增加一台弹幕业务的服务器设备，系统增量变化较小，对相关网络改动影响小。并且对终端设备支持弹幕功能进行了实现，使得终端对弹幕展示的流程减少对相关终端架构的影响。
图5是根据本发明优选实施例的弹幕收发流程示意图，如图5所示，
步骤501，弹幕服务器独立与其他业务和视频输入，接收各种终端(可以是手机、app、或者双向机顶盒等)上传的弹幕数据；
步骤502，其他业务和视频输入弹幕服务器；
步骤503，头端播放设备将弹幕数据汇同视频打包传输至终端；
步骤504，终端解码展示，用户观看节目并浏览弹幕评论；
步骤505，用户提交自己的评论至服务器，服务器再次将此评论按上述流程下发。用户之间不存在直接的互动，通过用户提交的弹幕在所有终端的展示，实现了弹幕下的互动。
图6是根据本发明优选实施例的头端设备的结构的示意图，如图6所示，
信源接入通过SDH、卫星等方式接收其他电视台播发出的视频码流并加入复用器，音视频服务器将本地的节目也加入复用器，业务系统将视频码流意外的业务信息加入复用器，TS复用系统将视频码流和业务复用成一个码流，最后进行加扰并调制成相应的播发信号，市场上较多头端均为此结构。在业务系统中新增了一个弹幕服务器设备，该设备需要软硬件协同工作，实现本发明所述的弹幕搜集过滤和封装功能。相较于互联网视频服务下的弹幕保存方式，该服务器对弹幕信息的存储不是必需功能，当弹幕数据处理后，码流下发的同时可以直接丢弃已处理数据，故该服务器主要关注对网络数据接收后缓冲过滤和打包为码流格式。
图7是根据本发明优选实施例的是弹幕服务器的结构的示意图，如图 7所示，网络接收701负责通过网络接收弹幕评论数据，缓冲数据库702将收到的用户弹幕全部按照时间顺序进行暂时保存，过滤模块703，为了电视节目对语言的要求，屏蔽掉一些不文明信息，过滤模块703按照自身处理能力，每次取一定的弹幕进行过滤，发送到过滤后数据704，这部分数据立即通过MPEG封装705封装为MPEG(Moving Picture Experts Group，动态图像专家组)格式，即头端复用前的业务格式。网络反馈(feedback)706也是一个网络模块，负责反馈用户，评论是否成功提交，以及如果失败是什么原因，根据网络负载能力，该部分可选。根据运营商的用户数量，需要估算弹幕业务所造成的网络流量，并最终决定弹幕服务器的性能和数量，否则需要反馈如超出系统容量的信息，并影响了用户体验。管理监控707为运营商监控管理使用的相应模块。
图8是根据本发明优选实施例的是终端侧对弹幕的处理流程的示意图，如图8所示，
步骤801，首先对TS(Transport Stream)码流进行解复用，得到各种业务以及节目包识别码(Packet Identifier，简称为PID)；
步骤802，对节目进行播放；
步骤803，对弹幕业务进行过滤解析，得到弹幕，即一些带有坐标、色彩、动作等动画属性的评论；
步骤804，在一个画布上根据弹幕属性信息画出弹幕，并根据信息不断刷新，直至弹幕显示完全；
步骤805，将显示弹幕所画出的画布与播放节目的界面进行叠加，二者合二为一即可得到一个实现了视频层之上的弹幕互动效果。其他实现效果也可以是画面部分区域用于显示弹幕。
上述数字广播只涉及直播业务，对头端来说弹幕数据只是一次播发利用，即使前端存储部分弹幕信息，后续将不在播发。对于带有录制功能的机顶盒，在录制时可以选择对弹幕数据录制，回看时继续按照图8方式进行解析展示。
上述实施例中，运营商只需要处理自己的用户的弹幕数据，考虑到自身的用户规模，架设的服务器数量和性能是可预估的。在其他场景下，如针对某些群体性较强的节目如阅兵式、春节晚会等，互动不只限于一地一个运营商的情形，考虑弹幕数据融合，头端的弹幕服务器需要增加一个功能，增设服务器或相关软件从其他授权的运营商的弹幕服务器上取相关的弹幕数据，同时对本地弹幕数据进行一次拷贝，这个过程应避免其他运营商的相关影响。而后将从其他运营商的弹幕和本地的弹幕同时进行处理下发。本实施例的条件下，往往观众群体数量庞大，运营商无法预估准确数量，且弹幕信息在终端展示是有性能瓶颈的，即单个画面下能容纳的弹幕条数，考虑到这些因素，在设计弹幕业务时，应当指定弹幕的滚动速度和消失时间，并保证每屏展示范围滚动时间内，限制最大的展示条数，超过该条数仍存在提交弹幕的，按照一定策略进行处理，如先尝试缓存并排队延时下发，超过一定时长任未下发的直接放弃下发，避免评论内容与播放内容不符合。对本运营商和其他运营商的数据可设置一定优先级。在提交弹幕的终端侧也可根据节目改变提交评论的间隔，以保证在显示数目和接收数目间达到平衡。
本发明实施例所提到的应用是在数字广播的单模机顶盒，在存在OTT或者IPTV模式的双模机顶盒下，由于存在IP网络，将不需要采用本发明设计的架构，直接利用网络服务下发弹幕数据，和相关网络弹幕服务一致。而当运营商当前网络下存在多种机顶盒共存的模式下，单模机顶盒无法利用IP网络，本发明仍可被利用。
图9是根据本发明优选实施例的双模单模机顶盒共存环境下的架构示意图，如图9所示，
考虑到网络模式下的弹幕是由用户播放节目发起请求获取弹幕服务器的数据的，弹幕服务器利用网络下发，单模机顶盒将不受影响。DVB侧的弹幕服务器和IP侧的弹幕服务器结构功能是不一样的，但考虑到对于网络侧的直播节目而言，对于同一家运营商而言其节目片源将是同一套，此时的弹幕信息是可以共享的，故此时两者的弹幕信息是互相拷贝的。IP 侧的点播节目则不与DVB侧共享，且点播节目需要对弹幕数据进行保存。本发明实施例中仅DVB侧的弹幕服务器是采用本发明所述的结构。
本发明上述几个实施例中，侧重在系统架构的不同上，给出了几个不同场景下应用本发明所述的弹幕服务器接收和发送弹幕数据的过程。在任何场景下的弹幕业务所采用的格式应当是一致的，具体的设计格式可参考DVB的PES标准但不限于此，设计时需要考虑上述几个实施例所提到的一些条件，并考虑系统性能容量等因素。
在终端侧，图8是给出的一个解析展示流程，具体到不同架构的盒子上，根据UI架构采用的方式各异，但实现过程一致。解析的弹幕数据根据时间属性，画到画布上具体位置，不断刷新画布，改变画布上相关弹幕的数据位置，达到弹幕动画效果。考虑到弹幕动画刷新的效率，若机顶盒性能受限，另一种方式是可将弹幕数据在本地进行一定的缓存，以一个带有指定时间无动画的方式，在指定区域按时间顺序简单文字展示。终端上实施方式不限于此，根据机顶盒性能评估后完整展示内容即可。终端侧在界面设置开关或在遥控器进行一键开关，控制弹幕内容的显示和隐藏，方便用户选择是否观看。在界面菜单内，也可增加设置项，如去除动画，限定显示数目等条件设置，或为设置项性能高中低，控制弹幕显示效果，适配机顶盒性能。
以上实施例以机顶盒的工作为主要对象进行了描述，在数字广播领域内，终端应不限于此，如采用中国移动多媒体广播(China Mobile Multimedia Broadcasting，简称为CMMB)手机终端收看，或者数字电视地面广播传输系统(Digital Television Terrestrial Multimedia Broadcasting，简称为DTMB)、地面数字电视广播(Digital Video Broadcasting–Terrestrial，简称为DVB-T)的电视终端收看，其工作原理也是一致的。特别是CMMB手机终端下，手机本身也带有蜂窝或IP网络接入，可直接在手机终端的播放软件上即可实现弹幕数据的上传和显示。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到根 据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行本发明各个实施例该的方法。
需要说明的是，上述各个模块是可以通过软件或硬件来实现的，对于后者，可以通过以下方式实现，但不限于此：上述模块均位于同一处理器中；或者，上述模块分别位于多个处理器中。
本发明的实施例还提供了一种存储介质。可选地，在本实施例中，上述存储介质可以被设置为存储用于执行以下步骤的程序代码：
S1，接收弹幕数据；
S2，将弹幕数据插入数字视频广播DVB的码流中；
S3，通过DVB网络将码流广播发送给终端。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：通过服务器接收弹幕数据，其中，服务器通过除DVB网络之外的其他网络接收弹幕数据。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：接收预定网络平台或者终端通过其他网络收集并发送的弹幕数据。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：按照预设的业务描述将弹幕数据插入DVB的码流中，其中，预设的业务描述作为将弹幕数据插入DVB码流的标准。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：将接收带弹幕数据进行缓冲；对缓冲的弹幕数据过滤；将过滤后的弹幕数据插入DVB的码流。
可选地，在本实施例中，上述存储介质可以包括但不限于：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
可选地，在本实施例中，处理器根据存储介质中已存储的程序代码执行上述实施例的方法步骤。
可选地，本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例，本实施例在此不再赘述。
显然，本领域的技术人员应该明白，上述的本发明的各模块或各步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执行的程序代码来实现，从而，可以将它们存储在存储装置中由计算装置来执行，并且在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤，或者将它们分别制作成各个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样，本发明不限制于任何特定的硬件和软件结合。
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。
工业实用性
在本发明实施例中，接收弹幕数据，将该弹幕数据插入数字视频广播DVB的码流中，通过DVB网络将该码流广播发送给终端，解决了弹幕应用在广播电视领域的应用受限的问题，实现了弹幕在广播电视领域的应用。

Claims (20)

  1. 一种弹幕处理方法，包括：
    接收弹幕数据；
    将所述弹幕数据插入数字视频广播DVB的码流中；
    通过DVB网络将所述码流广播发送给终端。
  2. 根据权利要求1所述的方法，其中，接收所述弹幕数据包括：
    通过服务器接收所述弹幕数据，其中，所述服务器通过除所述DVB网络之外的其他网络接收所述弹幕数据。
  3. 根据权利要求2所述的方法，其中，接收所述弹幕数据包括：
    接收预定网络平台或者终端通过所述其他网络收集并发送的所述弹幕数据。
  4. 根据权利要求1所述的方法，其中，将所述弹幕数据插入所述DVB的码流中包括：
    按照所述预设的业务描述将所述弹幕数据插入所述DVB的码流中，其中，所述预设的业务描述作为将所述弹幕数据插入所述DVB码流的标准。
  5. 根据权利要求1所述的方法，其中，将所述弹幕数据插入所述DVB的码流中包括：
    将接收带所述弹幕数据进行缓冲；
    对缓冲的所述弹幕数据过滤；
    将过滤后的所述弹幕数据插入所述DVB的码流。
  6. 根据权利要求1所述的方法，其中，接收弹幕数据之后，还包括，
    将所述弹幕数据发送给IP网络的弹幕服务器，所述弹幕数据用于插入所述IP网络的码流。
  7. 一种弹幕处理方法，包括：
    接收数字视频广播DVB的码流；
    从所述DVB的码流中解复用出弹幕数据，其中，所述弹幕数据插入所述DVB的码流中；
    显示所述弹幕数据对应的弹幕。
  8. 根据权利要求7所述的方法，其中，显示所述弹幕数据对应的弹幕包括，
    将所述弹幕数据生成的画布与当前播放界面重叠，显示所述弹幕数据对应的弹幕。
  9. 根据权利要求7所述的方法，其中，显示所述弹幕数据对应的弹幕包括以下至少之一：
    依据预设的滚动速度以及消失时间显示所述弹幕；
    在所述弹幕的条数超过预设弹幕条数的情况下，不再显示所述弹幕；
    在所述弹幕的显示延迟时间超过预设时间的情况下，不再显示所述弹幕；
    依据所述弹幕优先级的高低顺序显示所述弹幕。
  10. 根据权利要求7所述的方法，其中，所述弹幕数据包括：
    携带坐标，色彩或者动作的动画属性的弹幕数据。
  11. 一种弹幕处理系统，包括：
    弹幕服务器，设置为接收弹幕数据；
    头端复用播放设备，设置为将所述弹幕数据插入数字视频广播DVB的码流中；
    所述头端复用播放设备，还设置为通过DVB网络将所述码流广播发送给终端。
  12. 根据权利要求11所述的系统，其中，包括：
    所述弹幕服务器接收所述弹幕数据，其中，所述弹幕服务器通过除所述DVB网络之外的其他网络接收所述弹幕数据。
  13. 根据权利要求12所述的系统，其中，包括：
    所述弹幕服务器接收预定网络平台或者终端通过所述其他网络收集并发送的所述弹幕数据。
  14. 根据权利要求11所述的系统，其中，包括：
    所述头端复用播放设备按照所述预设的业务描述将所述弹幕数据插入所述DVB的码流中，其中，所述预设的业务描述作为将所述弹幕数据插入所述DVB码流的标准。
  15. 根据权利要求11所述的系统，其中，包括：
    所述头端复用播放设备将接收带所述弹幕数据进行缓冲，对缓冲的所述弹幕数据过滤，将过滤后的所述弹幕数据插入所述DVB的码 流。
  16. 根据权利要求11所述的系统，其中，包括，
    所述弹幕服务器将所述弹幕数据发送给IP网络的弹幕服务器，所述弹幕数据用于插入所述IP网络的码流。
  17. 一种终端，包括：
    接收模块，设置为接收数字视频广播DVB的码流；
    解码模块，设置为从所述DVB的码流中解复用出弹幕数据，其中，所述弹幕数据插入所述DVB的码流中；
    显示模块，设置为显示所述弹幕数据对应的弹幕。
  18. 根据权利要求17所述的终端，其中，所述显示模块包括，
    重叠显示单元，设置为将所述弹幕数据生成的画布与当前播放界面重叠，显示所述弹幕数据对应的弹幕。
  19. 根据权利要求17所述的终端，其中，所述显示模块包括以下至少之一：
    显示速度时间单元，设置为依据预设的滚动速度以及消失时间显示所述弹幕；
    显示条数单元，设置为在所述弹幕的条数超过预设弹幕条数的情况下，不再显示所述弹幕；
    显示时间单元，设置为在所述弹幕的显示延迟时间超过预设时间的情况下，不再显示所述弹幕；
    显示优先级单元，设置为依据所述弹幕优先级的高低顺序显示所 述弹幕。
  20. 根据权利要求17所述的终端，其中，所述弹幕数据包括：
    携带坐标，色彩或者动作的动画属性的弹幕数据。
PCT/CN2016/102760 2015-10-27 2016-10-20 弹幕处理方法、系统及终端 WO2017071523A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510708937.9 2015-10-27
CN201510708937.9A CN106612463A (zh) 2015-10-27 2015-10-27 弹幕处理方法、系统及终端

Publications (1)

Publication Number Publication Date
WO2017071523A1 true WO2017071523A1 (zh) 2017-05-04

Family

ID=58615069

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/102760 WO2017071523A1 (zh) 2015-10-27 2016-10-20 弹幕处理方法、系统及终端

Country Status (2)

Country Link
CN (1) CN106612463A (zh)
WO (1) WO2017071523A1 (zh)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109121015A (zh) * 2018-10-17 2019-01-01 武汉斗鱼网络科技有限公司 一种转换弹幕格式的方法及相关装置
CN110231867A (zh) * 2019-05-31 2019-09-13 重庆爱奇艺智能科技有限公司 在虚拟现实设备中调整弹幕的显示属性的方法和装置
CN110969673A (zh) * 2018-09-30 2020-04-07 武汉斗鱼网络科技有限公司 一种直播换脸交互实现方法、存储介质、设备及系统
TWI699998B (zh) * 2017-07-04 2020-07-21 英屬開曼群島商阿里巴巴集團控股有限公司 彈幕信息的處理方法及客戶端
CN112118484A (zh) * 2019-06-19 2020-12-22 上海哔哩哔哩科技有限公司 视频弹幕显示方法、装置、计算机设备及可读存储介质
US11513937B2 (en) 2019-06-19 2022-11-29 Shanghai Bilibili Technology Co., Ltd. Method and device of displaying video comments, computing device, and readable storage medium

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197392B (zh) * 2017-05-24 2019-05-28 中广热点云科技有限公司 在弹幕视频流传输过程中的丢包方法及丢包装置
CN107105313A (zh) * 2017-06-12 2017-08-29 微鲸科技有限公司 信息推送方法及视频播放系统
CN107371056A (zh) * 2017-07-18 2017-11-21 北京蜜莱坞网络科技有限公司 一种加载弹幕的方法和装置
CN109429088B (zh) * 2017-08-22 2021-09-07 北京国双科技有限公司 节目互动方法、系统、存储介质和处理器
CN108200451A (zh) * 2017-12-29 2018-06-22 广东九联科技股份有限公司 一种机顶盒osd弹幕交互系统及方法
CN108471541A (zh) * 2018-02-01 2018-08-31 北京奇艺世纪科技有限公司 一种视频弹幕显示的方法及装置
CN108966035B (zh) * 2018-09-03 2021-02-02 武汉斗鱼网络科技有限公司 弹幕消息传输方法、装置、设备与存储介质
CN109089170A (zh) * 2018-09-11 2018-12-25 传线网络科技（上海）有限公司 弹幕显示方法及装置
CN109600634A (zh) * 2018-12-21 2019-04-09 东莞市纽格力信息技术有限公司 一种数字电视弹幕输出系统、方法和遥控器
CN109413484B (zh) * 2018-12-29 2022-05-10 咪咕文化科技有限公司 一种弹幕展示方法、装置及存储介质
CN114979790B (zh) * 2022-05-11 2024-06-04 深圳创维－Rgb电子有限公司 数字电视弹幕互动方法、电子设备及可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020092019A1 (en) * 2000-09-08 2002-07-11 Dwight Marcus Method and apparatus for creation, distribution, assembly and verification of media
CN102932672A (zh) * 2011-08-12 2013-02-13 国家广播电影电视总局广播科学研究院 基于数字电视网络的紧急广播消息适配插入系统
CN104010222A (zh) * 2014-04-28 2014-08-27 小米科技有限责任公司 评论信息展示方法、装置及系统
CN104869437A (zh) * 2015-03-20 2015-08-26 四川长虹电器股份有限公司 基于数字电视条件接收的双向终端弹幕实现方法
CN104954832A (zh) * 2015-06-15 2015-09-30 深圳市九洲电器有限公司 基于机顶盒的用户交互方法及系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1859558A (zh) * 2006-03-06 2006-11-08 华为技术有限公司 基于无线传输的数字电视广播系统及其方法
CN101510995A (zh) * 2009-02-25 2009-08-19 深圳创维数字技术股份有限公司 一种网络电视的信息交流方法、系统及网络电视终端
CN102427562B (zh) * 2011-10-11 2018-07-06 中兴通讯股份有限公司 电视交互设备、系统和方法
US9215503B2 (en) * 2012-11-16 2015-12-15 Ensequence, Inc. Method and system for providing social media content synchronized to media presentation
CN104539980A (zh) * 2014-12-29 2015-04-22 康佳集团股份有限公司 电视机上的在线视频弹幕点评方法及其装置
CN104754396B (zh) * 2015-03-12 2018-02-23 腾讯科技（北京）有限公司 弹幕数据的显示方法及装置
CN104936033B (zh) * 2015-06-11 2018-03-23 四川长虹电器股份有限公司 基于数字电视条件接收的单向终端弹幕方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020092019A1 (en) * 2000-09-08 2002-07-11 Dwight Marcus Method and apparatus for creation, distribution, assembly and verification of media
CN102932672A (zh) * 2011-08-12 2013-02-13 国家广播电影电视总局广播科学研究院 基于数字电视网络的紧急广播消息适配插入系统
CN104010222A (zh) * 2014-04-28 2014-08-27 小米科技有限责任公司 评论信息展示方法、装置及系统
CN104869437A (zh) * 2015-03-20 2015-08-26 四川长虹电器股份有限公司 基于数字电视条件接收的双向终端弹幕实现方法
CN104954832A (zh) * 2015-06-15 2015-09-30 深圳市九洲电器有限公司 基于机顶盒的用户交互方法及系统

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI699998B (zh) * 2017-07-04 2020-07-21 英屬開曼群島商阿里巴巴集團控股有限公司 彈幕信息的處理方法及客戶端
CN110969673A (zh) * 2018-09-30 2020-04-07 武汉斗鱼网络科技有限公司 一种直播换脸交互实现方法、存储介质、设备及系统
CN110969673B (zh) * 2018-09-30 2023-12-15 西藏博今文化传媒有限公司 一种直播换脸交互实现方法、存储介质、设备及系统
CN109121015A (zh) * 2018-10-17 2019-01-01 武汉斗鱼网络科技有限公司 一种转换弹幕格式的方法及相关装置
CN110231867A (zh) * 2019-05-31 2019-09-13 重庆爱奇艺智能科技有限公司 在虚拟现实设备中调整弹幕的显示属性的方法和装置
CN112118484A (zh) * 2019-06-19 2020-12-22 上海哔哩哔哩科技有限公司 视频弹幕显示方法、装置、计算机设备及可读存储介质
US11513937B2 (en) 2019-06-19 2022-11-29 Shanghai Bilibili Technology Co., Ltd. Method and device of displaying video comments, computing device, and readable storage medium

Also Published As

Publication number Publication date
CN106612463A (zh) 2017-05-03

Similar Documents

Publication Publication Date Title
WO2017071523A1 (zh) 弹幕处理方法、系统及终端
US10726871B2 (en) Variable speed playback
US11930250B2 (en) Video assets having associated graphical descriptor data
CN101917389B (zh) 一种网络电视直播系统
US8606073B2 (en) Broadcast management system
CN102111660B (zh) 交互式智能网络电视
US8731047B2 (en) Mixing of video content
WO2015064211A1 (ja) 送信装置、送信方法、受信装置、及び、受信方法
KR101472013B1 (ko) 부가 데이터를 포함하는 음원 스트리밍을 제공하는 서버 및 방법, 그리고 디바이스
CN102333243A (zh) 一种流媒体直播时移点播装置
US20140281011A1 (en) System and method for replicating a media stream
WO2015064212A1 (ja) 送信装置、送信方法、受信装置、及び、受信方法
US20220295127A1 (en) Consolidating content streams to conserve bandwidth
US10637904B2 (en) Multimedia streaming service presentation method, related apparatus, and related system
JP5997500B2 (ja) 放送通信連携受信装置
WO2019218741A1 (zh) 信息传输方法及装置、存储介质、电子装置
CN202143178U (zh) 交互式智能网络电视
EP3197151B1 (en) Mosaic service presentation/delivery method and apparatus
US10322348B2 (en) Systems, methods and apparatus for identifying preferred sporting events based on fantasy league data
Cymbalák et al. Next generation IPTV solution for educational purposes
US20170318340A1 (en) Systems, Methods And Apparatus For Identifying Preferred Sporting Events Based On Viewing Preferences
TWI568254B (zh) 無線端對端串流的隨選廣播方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16858958

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16858958

Country of ref document: EP

Kind code of ref document: A1