CN110225365A - A kind of method, server and the client of the interaction of masking-out barrage - Google Patents

A kind of method, server and the client of the interaction of masking-out barrage Download PDF

Info

Publication number
CN110225365A
CN110225365A CN201910330879.9A CN201910330879A CN110225365A CN 110225365 A CN110225365 A CN 110225365A CN 201910330879 A CN201910330879 A CN 201910330879A CN 110225365 A CN110225365 A CN 110225365A
Authority
CN
China
Prior art keywords
masking
data
out data
server
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910330879.9A
Other languages
Chinese (zh)
Inventor
朱俊敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201910330879.9A priority Critical patent/CN110225365A/en
Publication of CN110225365A publication Critical patent/CN110225365A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G06V20/47Detecting features for summarising video content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8126Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the present application discloses the method, apparatus and computer readable storage medium of a kind of masking-out barrage interaction, belongs to field of computer technology.The embodiment of the present application method includes: that server obtains video data, configuration data and barrage data;Server analyzes video data according to preset different type partitioning algorithm, obtains different types of masking-out data;Server determines first object type masking-out data according to different types of masking-out data and configuration data;Server sends first object type masking-out data, video data and barrage data to client, first object type masking-out data, video data and barrage data show that the corresponding page, the corresponding page include the first barrage page and the first masking-out barrage page for client.For according to configuration data, the barrage page that can be shown with flexibly adjustment client to improve user experience.

Description

A kind of method, server and the client of the interaction of masking-out barrage
Technical field
This application involves field of computer technology more particularly to method, server and the clients of a kind of interaction of masking-out barrage End.
Background technique
In the prior art, relatively good in order to be realized in video display process usually in video on demand or live streaming User-interaction experience, barrage apply and give birth to.Barrage can give spectators' illusion of a kind of " real-time interactive ", although different barrages Sending time different from, but its only can in video specific one at time point occur, therefore mutually sending in the same time Barrage substantially also theme having the same, just has the illusion commented on simultaneously with other spectators when participating in comment.And it is traditional Player Commentary Systems be independently of except player, therefore comment on content be centered around on entire video mostly, topic Property is not strong, does not also have the feeling of " real-time interactive ".As shown in Figure 1, being the display mode schematic diagram of existing barrage.
So masking-out analysis can also be carried out to video on demand or live streaming now, can extract interesting to user Masking-out entity, for realizing friendly user's interaction in video display process.Such as: barrage scene first passes through algorithm and identifies The masking-out of star, user issues corresponding masking-out data simultaneously when playing video, at this moment according to masking-out information to barrage Rendering layer is wiped in real time, so that it may realize the effect of masking-out barrage, that is, star and subsequent background be visually every From, sandwich barrage, realization can not only see barrage, but also can see star.When there are many solution video barrage, Zhi Neng The problem of video content and barrage alternative.As shown in Fig. 2, being the display mode schematic diagram of existing masking-out barrage.But now Masking-out barrage interaction it is still too dull, the masking-out barrage effect that all users see is the same, and user can not basis The actual demand of oneself and the effect for adjusting masking-out barrage are experienced bad.
Summary of the invention
The embodiment of the present application provides method, server and the client of a kind of masking-out barrage interaction, matches for basis Data and different types of masking-out data are set, target type masking-out data is generated, includes bullet in the page that client can be shown The curtain page and masking-out barrage page, it can according to configuration data, and the barrage page that flexibly adjustment client show, raising User experience.
In view of this, on the one hand the embodiment of the present invention provides a kind of method of masking-out barrage interaction, the method application In the system including server and client side, which comprises
The another aspect of the embodiment of the present invention provides a kind of method of masking-out barrage interaction, may include:
The server obtains video data, configuration data and barrage data;
The server analyzes the video data, obtains difference according to preset different type partitioning algorithm The masking-out data of type;
The server determines that first object type is covered according to the different types of masking-out data and the configuration data Version data;
The server sends the first object type masking-out data, the video data and the barrage to client Data;
The client receives first object type masking-out data, video data and the barrage data that server is sent;
The client is shown according to the first object type masking-out data, the video data and the barrage data The corresponding page, the corresponding page include the first barrage page and the first masking-out page.
Optionally, in some embodiments of the invention, which includes that the first user configuration data and operation are matched Set at least one of data;
The server obtains configuration data, may include:
The server receives the first user configuration data of client transmission;
Alternatively,
The server responds the input operation of operation personnel, generates the operation configuration data.
Optionally, in some embodiments of the invention, the priority of the operation configuration data is higher than first user and matches Set the priority of data.
Optionally, in some embodiments of the invention, which matches according to the different types of masking-out data with this Data are set, determine first object type masking-out data, comprising:
The server is obtained according to the different types of masking-out data and preset object recognition algorithm comprising object identity Masking-out data;
The server obtains first object object masking-out according to the masking-out data and the configuration data that should include object identity Data;
The server sends the first object type masking-out data to client, comprising:
The server sends the first object object masking-out data to client.
Optionally, in some embodiments of the invention, the server is according to preset different type partitioning algorithm, to this Video data is analyzed, and different types of masking-out data are obtained, including following one or more:
The server obtains the masking-out comprising human body type identification according to preset human body segmentation's algorithm and the video data Data;
The server obtains the masking-out comprising logo type identification according to preset logo partitioning algorithm and the video data Data;
The server obtains the masking-out comprising sphere type identification according to preset segmentation of spheres algorithm and the video data Data;
The server obtains the masking-out comprising type of animal mark according to preset animal partitioning algorithm and the video data Data;
The server obtains the masking-out comprising vegetation type mark according to preset plant partitioning algorithm and the video data Data;
The server obtains the masking-out comprising advertisement type mark according to preset advertisement partitioning algorithm and the video data Data.
Optionally, in some embodiments of the invention,
The server is obtained according to the different types of masking-out data and preset object recognition algorithm comprising object identity Masking-out data;The server obtains first object object according to the masking-out data and the configuration data that should include object identity Masking-out data, comprising:
When the different types of masking-out data include the masking-out data of human body type identification,
Masking-out data and preset human bioequivalence algorithm of the server according to human body type identification are obtained comprising human body The masking-out data of mark;
The server obtains first object human body masking-out according to the masking-out data and the configuration data that should include human identification Data;
Alternatively,
When the different types of masking-out data include the masking-out data of the logo type identification,
Masking-out data and preset TV station symbol recognition algorithm of the server according to the logo type identification are obtained comprising logo The masking-out data of mark;
The server obtain first object logo masking-out according to the masking-out data and the configuration data that should include logo mark Data;
Alternatively,
When the different types of masking-out data include the masking-out data of the sphere type identification,
The server is obtained according to the masking-out data and preset sphere recognizer of the sphere type identification comprising sphere The masking-out data of mark;
The server obtain first object sphere masking-out according to the masking-out data and the configuration data that should include sphere mark Data;
Alternatively,
When the different types of masking-out data include the masking-out data of type of animal mark,
The masking-out data and preset animal identification algorithm that the server is identified according to the type of animal, obtain comprising animal The masking-out data of mark;
The server obtains first object animal masking-out according to the masking-out data and the configuration data that should include animal identification Data;
Alternatively,
When the different types of masking-out data include the masking-out data of vegetation type mark,
The masking-out data and preset plants identification algorithm that the server is identified according to the vegetation type, obtain comprising plant The masking-out data of mark;
The server obtain first object plant masking-out according to the masking-out data and the configuration data that should include plant mark Data;
Alternatively,
When the different types of masking-out data include the masking-out data of advertisement type mark,
The masking-out data and preset advertisement recognizer that the server is identified according to the advertisement type are obtained comprising advertisement The masking-out data of mark;
The server obtains first object advertisement masking-out according to the masking-out data and the configuration data that should include advertising logo Data.
Optionally, in some embodiments of the invention, this method further include:
The server receives the second user configuration data of client transmission;
The server determines the second target type according to the second user configuration data and the different types of masking-out data Masking-out data;
The server sends the second target type masking-out data to the client, which uses The second masking-out barrage page is shown in the client.
The another aspect of the embodiment of the present invention provides a kind of method of masking-out barrage interaction, may include:
Client receives first object type masking-out data, video data and the barrage data that server is sent;
The client shows corresponding page according to first object type masking-out data, the video data and the barrage data Face, the corresponding page include the first barrage page and the first masking-out page.
Optionally, in some embodiments of the invention,
Before the client receives the first object type masking-out data that server is sent, this method can also include:
The input of client end response user operates, and generates the first user configuration data;
The client sends the first user configuration data to the server, which is used for the service Device determines the first object type masking-out data.
Optionally, in some embodiments of the invention,
After the client shows the corresponding page according to the first object type masking-out data, this method further include:
The input of client end response user operates, and generates second user configuration data;
The client sends the second user configuration data to the server, which is used for the service Device determines the second target type masking-out data;
The client receives the second target type masking-out data of server transmission;
The client is covered according to the second target type masking-out data, the video data and the barrage data, display second The version barrage page.
The another aspect of the embodiment of the present invention provides a kind of server, may include:
Receiving module, for obtaining video data, configuration data and barrage data;
Processing module, for analyzing the video data, obtaining difference according to preset different type partitioning algorithm The masking-out data of type;According to the different types of masking-out data and the configuration data, first object type masking-out data are determined;
Sending module, for sending first object type masking-out data, the video data and the barrage number to client According to first object type masking-out data, the video data and the barrage data show the corresponding page for the client, should The corresponding page includes the first barrage page and the first masking-out barrage page.
Optionally, in some embodiments of the invention, which includes that the first user configuration data and operation are matched Set at least one of data;
The receiving module, specifically for receiving the first user configuration data of client transmission;
Alternatively,
The receiving module, the input specifically for responding operation personnel operate, and generate the operation configuration data.
Optionally, in some embodiments of the invention, the priority of the operation configuration data is higher than first user and matches Set the priority of data.
Optionally, in some embodiments of the invention,
The processing module, specifically for obtaining according to the different types of masking-out data and preset object recognition algorithm Masking-out data comprising object identity;Include the masking-out data and the configuration data of object identity according to this, obtains first object Object masking-out data;
The sending module, specifically for sending the first object object masking-out data to client.
Optionally, in some embodiments of the invention, the processing module is specifically used for following one or more:
According to preset human body segmentation's algorithm and the video data, the masking-out data comprising human body type identification are obtained;
According to preset logo partitioning algorithm and the video data, the masking-out data comprising logo type identification are obtained;
According to preset segmentation of spheres algorithm and the video data, the masking-out data comprising sphere type identification are obtained;
According to preset animal partitioning algorithm and the video data, the masking-out data comprising type of animal mark are obtained;
According to preset plant partitioning algorithm and the video data, the masking-out data comprising vegetation type mark are obtained;
According to preset advertisement partitioning algorithm and the video data, the masking-out data comprising advertisement type mark are obtained.
Optionally, in some embodiments of the invention,
The processing module, specifically for including the masking-out data of human body type identification when the different types of masking-out data When, according to the masking-out data of human body type identification and preset human bioequivalence algorithm, obtain the masking-out number comprising human identification According to;Include the masking-out data and the configuration data of human identification according to this, obtains first object human body masking-out data;
Alternatively,
The processing module, specifically for including the masking-out data of the logo type identification when the different types of masking-out data When, according to the masking-out data of the logo type identification and preset TV station symbol recognition algorithm, obtain the masking-out number comprising logo mark According to;Include the masking-out data and the configuration data of logo mark according to this, obtains first object logo masking-out data;
Alternatively,
The processing module, specifically for including the masking-out data of the sphere type identification when the different types of masking-out data When, according to the masking-out data of the sphere type identification and preset sphere recognizer, obtain the masking-out number comprising sphere mark According to;Include the masking-out data and the configuration data of sphere mark according to this, obtains first object sphere masking-out data;
Alternatively,
The processing module, specifically for including the masking-out data of type of animal mark when the different types of masking-out data When, according to the masking-out data of type of animal mark and preset animal identification algorithm, obtain the masking-out number comprising animal identification According to;Include the masking-out data and the configuration data of animal identification according to this, obtains first object animal masking-out data;
Alternatively,
The processing module, specifically for including the masking-out data of vegetation type mark when the different types of masking-out data When, according to the masking-out data of vegetation type mark and preset plants identification algorithm, obtain the masking-out number comprising plant mark According to;Include the masking-out data and the configuration data of plant mark according to this, obtains first object plant masking-out data;
Alternatively,
The processing module, specifically for including the masking-out data of advertisement type mark when the different types of masking-out data When, according to masking-out data and preset advertisement recognizer that the advertisement type identifies, obtain the masking-out number comprising advertising logo According to;Include the masking-out data and the configuration data of advertising logo according to this, obtains first object advertisement masking-out data.
Optionally, in some embodiments of the invention,
The receiving module, specifically for receiving the second user configuration data of client transmission;It is sent to the client The second target type masking-out data, the second target type masking-out data show the second masking-out barrage page for the client Face;
The processing module is specifically used for being determined according to the second user configuration data and the different types of masking-out data Second target type masking-out data.
The another aspect of the embodiment of the present invention provides a kind of live streaming interactive system, the system comprises: server and client End;
The server, for obtaining video data, configuration data and barrage data;
The server, for analyzing the video data, obtaining according to preset different type partitioning algorithm Different types of masking-out data;
The server, for determining first object according to the different types of masking-out data and the configuration data Type masking-out data;
The server, for sending the first object type masking-out data, the video data to the client With the barrage data;
The client, first object type masking-out data, video data and the bullet sent for receiving the server Curtain data;
The client, for according to the first object type masking-out data, the video data and the barrage number According to the corresponding page of display, the corresponding page includes the first barrage page and the first masking-out page.
The another aspect of the embodiment of the present invention provides a kind of client, may include:
Receiving module, for receiving first object type masking-out data, video data and the barrage data of server transmission;
Display module, for being shown pair according to first object type masking-out data, the video data and the barrage data The page answered, the corresponding page include the first barrage page and the first masking-out page.
Optionally, in some embodiments of the invention, which can also include:
Processing module, the input for responding user operate, and generate the first user configuration data;
Sending module, for sending the first user configuration data to the server, which is used for The server determines the first object type masking-out data.
Optionally, in some embodiments of the invention, which can also include:
Processing module, the input for responding user operate, and generate second user configuration data;
Sending module, for sending the second user configuration data to the server, which is used for The server determines the second target type masking-out data;
The receiving module is also used to receive the second target type masking-out data of server transmission;
The display module is also used to be shown according to the second target type masking-out data, the video data and the barrage data Show the second masking-out barrage page.
The another aspect of the embodiment of the present invention provides a kind of server, may include:
Transceiver, memory and processor, the transceiver, the memory and the processor are connected by bus;
The memory, for storing operational order;
The transceiver, for obtaining video data, configuration data and barrage data;The first object class is sent to client Type masking-out data, the video data and the barrage data, first object type masking-out data, the video data and the barrage number The corresponding page is shown according to for the client, which includes the first barrage page and the first masking-out barrage page;
The processor, for analyzing the video data, obtaining difference according to preset different type partitioning algorithm The masking-out data of type;According to the different types of masking-out data and the configuration data, first object type masking-out data are determined.
Optionally, in some embodiments of the invention, which includes that the first user configuration data and operation are matched Set at least one of data;
The transceiver, specifically for receiving the first user configuration data of client transmission;
Alternatively,
The transceiver, the input specifically for responding operation personnel operate, and generate the operation configuration data.
Optionally, in some embodiments of the invention, the priority of the operation configuration data is higher than first user and matches Set the priority of data.
Optionally, in some embodiments of the invention,
The processor, specifically for being wrapped according to the different types of masking-out data and preset object recognition algorithm Masking-out data containing object identity;Include the masking-out data and the configuration data of object identity according to this, obtains first object pair As masking-out data;
The transceiver, specifically for sending the first object object masking-out data to client.
Optionally, in some embodiments of the invention, which is specifically used for following one or more:
According to preset human body segmentation's algorithm and the video data, the masking-out data comprising human body type identification are obtained;
According to preset logo partitioning algorithm and the video data, the masking-out data comprising logo type identification are obtained;
According to preset segmentation of spheres algorithm and the video data, the masking-out data comprising sphere type identification are obtained;
According to preset animal partitioning algorithm and the video data, the masking-out data comprising type of animal mark are obtained;
According to preset plant partitioning algorithm and the video data, the masking-out data comprising vegetation type mark are obtained;
According to preset advertisement partitioning algorithm and the video data, the masking-out data comprising advertisement type mark are obtained.
Optionally, in some embodiments of the present application,
The processor, specifically for including the masking-out data of human body type identification when the different types of masking-out data When, according to the masking-out data of human body type identification and preset human bioequivalence algorithm, obtain the masking-out number comprising human identification According to;Include the masking-out data and the configuration data of human identification according to this, obtains first object human body masking-out data;
Alternatively,
The processor, specifically for including the masking-out data of the logo type identification when the different types of masking-out data When, according to the masking-out data of the logo type identification and preset TV station symbol recognition algorithm, obtain the masking-out number comprising logo mark According to;Include the masking-out data and the configuration data of logo mark according to this, obtains first object logo masking-out data;
Alternatively,
The processor, specifically for including the masking-out data of the sphere type identification when the different types of masking-out data When, according to the masking-out data of the sphere type identification and preset sphere recognizer, obtain the masking-out number comprising sphere mark According to;Include the masking-out data and the configuration data of sphere mark according to this, obtains first object sphere masking-out data;
Alternatively,
The processor, specifically for including the masking-out data of type of animal mark when the different types of masking-out data When, according to the masking-out data of type of animal mark and preset animal identification algorithm, obtain the masking-out number comprising animal identification According to;Include the masking-out data and the configuration data of animal identification according to this, obtains first object animal masking-out data;
Alternatively,
The processor, specifically for including the masking-out data of vegetation type mark when the different types of masking-out data When, according to the masking-out data of vegetation type mark and preset plants identification algorithm, obtain the masking-out number comprising plant mark According to;Include the masking-out data and the configuration data of plant mark according to this, obtains first object plant masking-out data;
Alternatively,
The processor, specifically for including the masking-out data of advertisement type mark when the different types of masking-out data When, according to masking-out data and preset advertisement recognizer that the advertisement type identifies, obtain the masking-out number comprising advertising logo According to;Include the masking-out data and the configuration data of advertising logo according to this, obtains first object advertisement masking-out data.
Optionally, in some embodiments of the invention,
The transceiver, specifically for receiving the second user configuration data of client transmission;Sending to the client should Second target type masking-out data, the second target type masking-out data show the second masking-out barrage page for the client;
The processor, is specifically used for according to the second user configuration data and the different types of masking-out data, determines the Two target type masking-out data.
The another aspect of the embodiment of the present invention provides a kind of client, may include:
Transceiver, memory and processor, the transceiver, the memory and the processor are connected by bus;
The memory, for storing operational order;
The transceiver, for receiving first object type masking-out data, video data and the barrage data of server transmission;
The processor, for being shown pair according to first object type masking-out data, the video data and the barrage data The page answered, the corresponding page include the first barrage page and the first masking-out page.
Optionally, in some embodiments of the invention,
The processor is also used to respond the input operation of user, generates the first user configuration data;
The transceiver, is also used to send the first user configuration data to the server, which uses The first object type masking-out data are determined in the server.
Optionally, in some embodiments of the invention,
The processor is also used to respond the input operation of user, generates second user configuration data;According to second target Type masking-out data, the video data and the barrage data show the second masking-out barrage page;
The transceiver is also used to send the second user configuration data to the server, which uses The second target type masking-out data are determined in the server;Receive the second target type masking-out data of server transmission.
The another aspect of the embodiment of the present invention provides a kind of computer readable storage medium, including instruction, when it is being calculated When being run on machine, so that computer executes the method as described in above-mentioned second aspect or second aspect any optional way.
The another aspect of the embodiment of the present invention provides a kind of computer readable storage medium, including instruction, when it is being calculated When being run on machine, so that computer executes the method as described in the above-mentioned third aspect or the third aspect any optional way.
As can be seen from the above technical solutions, the embodiment of the present application has the advantage that
In embodiments of the present invention, server obtains video data, configuration data and barrage data;The server is according to pre- The different type partitioning algorithm set, analyzes the video data, obtains different types of masking-out data;The server according to The different types of masking-out data and the configuration data, determine first object type masking-out data;The server is sent out to client First object type masking-out data, the video data and the barrage data are given, the first object type masking-out data, the video Data and the barrage data are used for the client and show the corresponding page, which includes the first barrage page and first The masking-out barrage page.Server can determine first object type masking-out data according to configuration data, then, then by target type Masking-out data, video data and barrage data are sent to client, and the page that client is shown includes the first barrage page and first The masking-out barrage page.Can the barrage page that shows of flexibly adjustment client, improve user experience.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be to institute in embodiment and description of the prior art Attached drawing to be used is needed to be briefly described.
Fig. 1 is the display mode schematic diagram of existing barrage;
Fig. 2 is the display mode schematic diagram of existing masking-out barrage;
Fig. 3 is system architecture diagram applied by the embodiment of the present invention;
Fig. 4 is one embodiment schematic diagram of the method for masking-out barrage interaction in the embodiment of the present invention;
Fig. 5 A is to obtain the schematic diagram of different types of masking-out data in the embodiment of the present invention;
Fig. 5 B is that client shows the schematic diagram including the first barrage page and the first masking-out barrage page;
Fig. 6 is one embodiment schematic diagram of the method for masking-out barrage interaction in the embodiment of the present invention;
Fig. 7 is one embodiment schematic diagram of the method for masking-out barrage interaction in the embodiment of the present invention;
Fig. 8 is one embodiment schematic diagram of server in the embodiment of the present invention;
Fig. 9 A is one embodiment schematic diagram of client in the embodiment of the present invention;
Fig. 9 B is another embodiment schematic diagram of client in the embodiment of the present invention;
Figure 10 is another embodiment schematic diagram of server in the embodiment of the present invention;
Figure 11 is another embodiment schematic diagram of client in the embodiment of the present invention.
Specific embodiment
The embodiment of the present application provides method, server and the client of a kind of masking-out barrage interaction, matches for basis Data and different types of masking-out data are set, target type masking-out data is generated, includes bullet in the page that client can be shown The curtain page and masking-out barrage page, it can according to configuration data, and the barrage page that flexibly adjustment client show, raising User experience.
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application Attached drawing, technical solutions in the embodiments of the present application are described, it is clear that described embodiment is only the application a part Embodiment, instead of all the embodiments.Based on the embodiment in the application, it shall fall within the protection scope of the present application.
In existing technical solution, masking-out barrage can not be used to run.In the technical solution of the present invention, it can determine Different types of masking-out, so that the interactive mode of masking-out barrage can run, thousand people of Lai Shixian, thousand face.Such as: can to advertisement and Logo does masking-out, and guarantee will not be covered by barrage, to realize commercial value.Or different user can see different illiteracies Version realizes personalized user experience, because the star that different user is liked is different, user can be directed to interested bright Star opens masking-out barrage.
As shown in figure 3, for system architecture diagram applied by the embodiment of the present invention.It as shown in Figure 3, may include server And client.
Illustratively, client may include general hand held electronic terminals, such as smart phone, portable terminal, end End, personal digital assistant (Personal Digital Assistant, PDA), portable media player (Personal Media Player, PMP) device, laptop, notebook (Note Pad), WiMAX (Wireless Broadband, Wibro) terminal, tablet computer (personal computer, PC) and intelligence PC.It is also possible to apply the invention to Non-portable electronic device such as provides the smart television of display function.
Below by way of examples, the embodiment of the present invention is described further, as shown in figure 4, real for the present invention One embodiment schematic diagram for applying the method for the interaction of masking-out barrage in example may include:
401, server obtains video data, configuration data and barrage data.
In embodiments of the present invention, server obtains video data, configuration data and barrage data.Wherein, video is obtained The timing of data, configuration data and barrage data is without limitation.
Video data refers to continuous image sequence, its essence is by one group of continuous image construction of group, and for figure As itself, in addition to sequencing that it occurs and other than, without any structural information.Video data can use story unit, field Scape, camera lens, frame describe.
Configuration data may include user configuration data and operation configuration data.Wherein, user configuration data can be needle Demand to personalized, some data of configuration.Such as: if the video data is about performer A, performer B, performer C, performer The video of D and performer E, but the user prefers performer A and performer B, then, it include to performer A in user configuration data The information liked is labeled as with performer B.
Operation configuration data can be the data of the configurations such as advertisement for logo, sponsor, it is desirable that be to be unable to masking-out to broadcast It puts.Such as: what logo referred to is usually the logos such as Beijing TV, Hunan Satellite TV, Zhejiang Satellite TV, Dragon TV.Sponsor Advertisement can be the advertising logos such as blue moon, profoundness.
Barrage data refer to the comment subtitle popped up when watching video on network.
402, server analyzes video data, obtains different type according to preset different type partitioning algorithm Masking-out data.
Here preset different type partitioning algorithm can be preparatory trained some algorithms, be referred to as type Partitioning algorithm.Such as: human body segmentation's algorithm, logo partitioning algorithm, segmentation of spheres algorithm, animal partitioning algorithm, plant segmentation are calculated Method, advertisement partitioning algorithm etc..
Here different types of masking-out data, can be the masking-out data of human body type, the masking-out data of logo type, Masking-out data, the masking-out data of type of animal, the masking-out data of vegetation type, the masking-out data of advertisement type of sphere type Deng.
Server obtains the masking-out number comprising human body type identification according to preset human body segmentation's algorithm and video data According to;Illustratively, human body segmentation's algorithm is that model training is carried out by a large amount of somatic data, obtained somatic data model, Then, server analyzes video data according to somatic data model, the available masking-out data about human body type.
Server obtains the masking-out number comprising logo type identification according to preset logo partitioning algorithm and video data According to;Illustratively, logo partitioning algorithm is by a large amount of station logo data (such as Beijing TV logo, Hunan Satellite TV logo etc.) Model training is carried out, obtained station logo data model, then, server divides video data according to station logo data model Analysis, the available masking-out data about logo type.
Server obtains the masking-out number comprising sphere type identification according to preset segmentation of spheres algorithm and video data According to;Illustratively, segmentation of spheres algorithm is to carry out mould by a large amount of sphere data (such as football, basketball, baseball, ball etc.) Type training, obtained sphere data model, then, server analyzes video data according to sphere data model, can be with Obtain the masking-out data about sphere type.
Server obtains the masking-out number comprising type of animal mark according to preset animal partitioning algorithm and video data According to;Illustratively, animal partitioning algorithm is to carry out model instruction by a large amount of animal data (such as lion, tiger, elephant etc.) Practice, obtained animal data model, then, server analyzes video data according to animal data model, available Masking-out data about type of animal.
Server obtains the masking-out number comprising vegetation type mark according to preset plant partitioning algorithm and video data According to;Illustratively, plant partitioning algorithm is to carry out model instruction by a large amount of animal data (such as peach, apricot, pear tree etc.) Practice, obtained plant data model, then, server analyzes video data according to plant data model, available Masking-out data about vegetation type.
Server obtains the masking-out number comprising advertisement type mark according to preset advertisement partitioning algorithm and video data According to.Illustratively, advertisement partitioning algorithm is that model training is carried out by a large amount of ad data, obtained ad data model, Then, server analyzes video data according to ad data model, the available masking-out data about advertisement type.
403, server determines first object type masking-out data according to different types of masking-out data and configuration data.
Server determines first object type masking-out data according to different types of masking-out data and configuration data, can be with Include: server according to different types of masking-out data and preset object recognition algorithm, obtains the masking-out comprising object identity Data;Server obtains first object object masking-out data according to masking-out data and configuration data comprising object identity.
It illustratively, may include advertisement, logo, personage in a video data;So, comprising different type mark Masking-out data can be personage, and the masking-out data comprising object identity can be which specific people in personage, such as: Di Lire Bar, Zhang Yixing etc.;First object object masking-out data can be the Zhang Yixing determined according to configuration data.
It as shown in Figure 5A, is to obtain the schematic diagram of different types of masking-out data in the embodiment of the present invention.It is understood that It is that carrying out pretreated process to video data is to extract different types of masking-out data by different algorithms.
Such as: server can identify foot by preset sphere recognizer according to the masking-out data of sphere type Ball, basketball or table tennis etc..It can be calculated according to the masking-out data of human body type by human bioequivalence algorithm or recognition of face Method identifies which specific star.Which can be identified by TV station symbol recognition algorithm according to the masking-out data of logo type TV station or the network platform.Finally these masking-out information (such as orientation and size information), label and correspondent times have been deposited Come, forms masking-out data.
404, server sends first object type masking-out data, video data and barrage data, the first mesh to client Mark type masking-out data, video data and barrage data show that the corresponding page, the corresponding page include first for client The barrage page and the first masking-out barrage page.
It should be noted that server sends first object type masking-out data, video data and barrage number to client According to timing without limitation.
Optionally, server sends first object type masking-out data to client, may include: server to client Send first object object masking-out data.
It illustratively, as shown in Figure 5 B, is that client is shown including the first barrage page and the first masking-out barrage page Schematic diagram.
In embodiments of the present invention, server obtains video data, configuration data and barrage data;Server is according to preset Different type partitioning algorithm, video data is analyzed, different types of masking-out data are obtained;Server is according to inhomogeneity The masking-out data and configuration data of type determine first object type masking-out data;Server sends first object class to client Type masking-out data, video data and barrage data, first object type masking-out data, video data and barrage data are used for client End shows that the corresponding page, the corresponding page include the first barrage page and the first masking-out barrage page.Because server can be with Different types of masking-out data are obtained according to preset different type partitioning algorithm and video data are corresponding, further according to inhomogeneity The masking-out data and configuration data of type determine first object type masking-out data.Then, server is first object type masking-out Data, video data and barrage data are sent to client, and client can be according to first object type masking-out data, video counts Video playing is carried out according to barrage data.User can carry out input operation, client pair in client according to the hobby of oneself It should generate configuration data, then configuration data is sent to server, server can be according to configuration data, video data and preset Different type partitioning algorithm, determine first object type masking-out data, then by first object type masking-out data, video data It is sent with barrage data to client, client can show the corresponding page, which includes the first barrage page With the first masking-out barrage page, and then improve user experience.
As shown in fig. 6, can wrap for one embodiment schematic diagram of the method for masking-out barrage interaction in the embodiment of the present invention It includes:
601, client receives first object type masking-out data, video data and the barrage data that server is sent.
Client receives the timing of first object type masking-out data, video data and barrage data that server is sent not It limits.It should be noted that the explanation to first object type masking-out data, video data and barrage data, in Fig. 4 Shown in embodiment, details are not described herein again.
Optionally, first object type masking-out data, video data and the barrage number that server is sent are received in client According to before, this method may include: the input operation of client end response user, generate the first user configuration data;Client to Server sends the first user configuration data, and the first user configuration data determine first object type masking-out number for server According to.
Illustratively, first object type masking-out data can refer to the masking-out data of human body type, the masking-out of logo type Data, the masking-out data of sphere type, the masking-out data of type of animal, the masking-out data of vegetation type, the masking-out of advertisement type Data etc..
Optionally, client also can receive the first object object masking-out data of server transmission.Illustratively, this First object object masking-out data can specifically refer to personage A, personage B or personage C in the masking-out data of human body type Deng;It can also refer to the Beijing TV logo etc. in the masking-out data of logo type;It can also refer in the masking-out data of sphere type Football, basketball, table tennis etc.;It can also refer to dog, cat, bird, the elephant etc. in the masking-out data of type of animal;It can also refer to Peach, apricot etc. in the masking-out data of vegetation type;It can also refer to blue moon in the masking-out data of advertisement type, Maotai Deng.
602, client shows the corresponding page according to first object type masking-out data, video data and barrage data, The corresponding page includes the first barrage page and the first masking-out page.
Client can play video according to video data, play barrage according to barrage data, and barrage is generally shown In the top of video pictures.Further according to first object type masking-out data, corresponding barrage data are shown in video pictures Lower section.In this case, it is achieved that personalized user experience.
It should be noted that user may be interested in a certain type video data in video data, it is undesirable to It is kept off by barrage, but less interested in other kinds of video data, is kept off by barrage and also having no relations.So to user Interested this kind of video data, is shown in a manner of masking-out, and both masking-out mode was properly termed as the first mesh come the data shown Mark type masking-out data.
Optionally, client shows corresponding page according to first object object masking-out data, video data and barrage data Face, the corresponding page include the first barrage page and the first masking-out page.
Such as: in a video playing, it is Lee that the interested star of user oneself, which is Zhang Yixing, uninterested star, Rong Hao, then, first object object masking-out data are just the masking-out data of Zhang Yixing.In playing process, barrage data are being removed It outside the display area of Zhang Yixing, is shown in the top of video data;In the display area of Zhang Yixing, barrage data are to regard What the lower section of frequency evidence was shown.
In the embodiment of the present application, client receives first object type masking-out data, the video data that server is sent With barrage data;Client shows the corresponding page according to first object type masking-out data, video data and barrage data, right The page answered includes the first barrage page and the first masking-out page.Client can be according to first object type masking-out data, view Frequency evidence and barrage data carry out video playing.The corresponding page of the display of being adapted to property of client, the corresponding page packet The first barrage page and the first masking-out barrage page are included, and then improves user experience.
As shown in fig. 7, can wrap for one embodiment schematic diagram of the method for masking-out barrage interaction in the embodiment of the present invention It includes:
701, server obtains video data, configuration data and barrage data.
In embodiments of the present invention, configuration data includes at least one in the first user configuration data and operation configuration data Kind.
Server obtains configuration data, may include: that server receives the first user configuration data that client is sent;Or Person, server respond the input operation of operation personnel, generate operation configuration data.
First user configuration data are mainly the history interaction and personal information of all users, analyze the hobby of user, right The customized information (such as: liking deer break, like Zhang Yixing etc.) of user achieves, and optionally, client can be supported Request the information.
Operation configuration data according to the strategy of content and company, such as can be forced by operation personnel's manual configuration The enabling of logo masking-out, or in sports cast realize sphere masking-out enabling.To the business demand and production of guarantee company The experience demand of product.If user configuration and operation are configured with conflict, default operation configuration is preferential.
Optionally, before server receives the first user configuration data that client is sent, this method can also include: visitor Family end responds the input operation of user, generates the first user configuration data;User end to server sends the first user configuration number According to the first user configuration data determine first object type masking-out data for server.
It should be noted that the priority of operation configuration data is higher than the priority of the first user configuration data.For example, with Family is not intended to see the advertising logo of sponsor during playing video, so, inside configuration file, just want this Advertising logo barrage shows that still, usually, advertising logo is to present in video playing in the form of what kind of, consideration It is entire commercial value and business demand, belongs to operation configuration.So the experience of user cannot only be subject to, it is undesirable to aobvious Show that advertising logo is not just shown, it is this or be subject to and run configuration data.I.e. when the first user configuration data and operation are matched When setting data and mutually conflicting, the priority for runing configuration data is higher than the priority of the first user configuration data.
702, server analyzes video data, obtains different type according to preset different type partitioning algorithm Masking-out data.
It should be noted that step 702 can be with reference in step 402, details are not described herein again.
703, server determines first object type masking-out data according to different types of masking-out data and configuration data.
Server determines first object type masking-out data according to different types of masking-out data and configuration data, can be with Include: server according to different types of masking-out data and preset object recognition algorithm, obtains the masking-out comprising object identity Data;Server obtains first object object masking-out data according to masking-out data and configuration data comprising object identity.
Further, server obtains including pair according to different types of masking-out data and preset object recognition algorithm As the masking-out data of mark;Server obtains first object object according to masking-out data and configuration data comprising object identity Masking-out data may include:
When different types of masking-out data include the masking-out data of human body type identification, server is according to human body type mark The masking-out data of knowledge and preset human bioequivalence algorithm, obtain the masking-out data comprising human identification;Server is according to including people The masking-out data and configuration data of body mark, obtain first object human body masking-out data;
Alternatively,
When different types of masking-out data include the masking-out data of logo type identification, server is according to logo type mark The masking-out data of knowledge and preset TV station symbol recognition algorithm obtain the masking-out data comprising logo mark;Server is according to including platform The masking-out data and configuration data of mark, obtain first object logo masking-out data;
Alternatively,
When different types of masking-out data include the masking-out data of sphere type identification, server is according to sphere type mark The masking-out data of knowledge and preset sphere recognizer obtain the masking-out data comprising sphere mark;Server is according to including ball The masking-out data and configuration data of body mark, obtain first object sphere masking-out data;
Alternatively,
When different types of masking-out data include the masking-out data of type of animal mark, server is according to type of animal mark The masking-out data of knowledge and preset animal identification algorithm, obtain the masking-out data comprising animal identification;Server is according to comprising dynamic The masking-out data and configuration data of object mark, obtain first object animal masking-out data;
Alternatively,
When different types of masking-out data include the masking-out data of vegetation type mark, server is according to vegetation type mark The masking-out data of knowledge and preset plants identification algorithm obtain the masking-out data comprising plant mark;Server is according to comprising planting The masking-out data and configuration data of object mark, obtain first object plant masking-out data;
Alternatively,
When different types of masking-out data include the masking-out data of advertisement type mark, server is according to advertisement type mark The masking-out data of knowledge and preset advertisement recognizer, obtain the masking-out data comprising advertising logo;Server is according to comprising wide The masking-out data and configuration data for accusing mark, obtain first object advertisement masking-out data.
704, server sends first object type masking-out data, video data and barrage data to client.
First object type masking-out data, video data and barrage data show the corresponding page for client, corresponding The page include the first barrage page and the first masking-out barrage page.Client receives the first object type that server is sent and covers Version data, video data and barrage data.
Optionally, server sends first object type masking-out data to client, may include: server to client Send first object object masking-out data.
705, client shows the corresponding page according to first object type masking-out data, video data and barrage data, The corresponding page includes the first barrage page and the first masking-out page.
Step 705 can be with reference to the description of step 602 in embodiment illustrated in fig. 6, and details are not described herein again.
706, the input operation of client end response user, generates second user configuration data.
The input of client end response user operates, and input operation can be manual input operation, it is defeated to be also possible to voice Enter operation, is also possible to remote control input operation etc., generates the second configuration data, second configuration data and the first configuration data are not Together, i.e., user may miss potter for a period of time some star at certain, but just not like this star after a period of time, happiness Joyous is another, it is possible to be updated operation, the update operation of client end response user generates second user and matches Set data.
707, user end to server sends second user configuration data, and second user configuration data is determined for server Second target type masking-out data.
Server receives the second user configuration data that client is sent.
708, server determines that the second target type is covered according to second user configuration data and different types of masking-out data Version data.
Server determines the second target type masking-out number according to second user configuration data and different types of masking-out data According to process, can refer to previous embodiment description, details are not described herein again.
709, server sends the second target type masking-out data to client, and the second target type masking-out data are for visitor Family end shows the second masking-out barrage page.
Client receives the second target type masking-out data that server is sent.
710, client shows the second masking-out bullet according to the second target type masking-out data, video data and barrage data The curtain page.
Client can show the second barrage page according to the second target type masking-out data, video data and barrage data Face optionally can also show the barrage page.It should be noted that step 706-710 is optional step.
In embodiments of the present invention, masking-out is extracted using different type identification algorithms, is realized different types of Masking-out classification guarantees that masking-out can run;Object recognition algorithm is introduced simultaneously, such as: face recognition algorithms, to the masking-out area of human body Divide entity, realize masking-out minute mark label, then in conjunction with the interaction and hobby of user, the interaction of Lai Shixian masking-out barrage is personalized.
Further, masking-out classifying type can also be given, such as: human body, sphere, logo etc.;Increase to the masking-out of same type Label distinguishes entity.Such as: in human body masking-out, which is deer break, which is Chen Weiting, which is Zhang Yixing, is calculated in conjunction with masking-out Method and face recognition algorithms can be with accurate identifications.Different masking-out interactive modes, example can also be provided according to the hobby of user Such as: some people only like seeing deer break, can choose the masking-out with deer break label, realize the effect of deer break masking-out barrage.It can be with It supports the expansible of interaction protocol, is used to expansion type and label, personalized configuration is realized by landing service.
In embodiments of the present invention, server obtains video data, configuration data and barrage data;Server is according to preset Different type partitioning algorithm, video data is analyzed, different types of masking-out data are obtained;Server is according to inhomogeneity The masking-out data and configuration data of type determine first object type masking-out data;Server sends first object class to client Type masking-out data, video data and barrage data, first object type masking-out data, video data and barrage data are used for client End shows that the corresponding page, the corresponding page include the first barrage page and the first masking-out barrage page.Client receives service First object type masking-out data, video data and the barrage data that device is sent;Client is according to first object type masking-out number Show that the corresponding page, the corresponding page include the first barrage page and the first masking-out page according to, video data and barrage data. Server can determine first object type masking-out data according to configuration data, then, then by target type masking-out data, video Data and barrage data are sent to client, and the page that client is shown includes the first barrage page and the first masking-out barrage page. Can the barrage page that shows of flexibly adjustment client, improve user experience.
As shown in figure 8, may include: for one embodiment schematic diagram of server in the embodiment of the present invention
Receiving module 801, for obtaining video data, configuration data and barrage data;
Processing module 802, for analyzing video data, obtaining not according to preset different type partitioning algorithm The masking-out data of same type;According to different types of masking-out data and configuration data, first object type masking-out data are determined;
Sending module 803, for sending first object type masking-out data, video data and barrage data to client, First object type masking-out data, video data and barrage data show the corresponding page, corresponding page packet for client Include the first barrage page and the first masking-out barrage page.
Optionally, in some embodiments of the invention, configuration data includes the first user configuration data and operation configuration At least one of data;
Receiving module 801, the first user configuration data sent specifically for receiving client;
Alternatively,
Receiving module 801, the input specifically for responding operation personnel operate, and generate operation configuration data.
Optionally, in some embodiments of the invention, the priority for runing configuration data is higher than the first user configuration number According to priority.
Optionally, in some embodiments of the invention,
Processing module 802, specifically for obtaining according to the different types of masking-out data and preset object recognition algorithm To the masking-out data comprising object identity;According to the masking-out data and the configuration data comprising object identity, is obtained One target object masking-out data;
Sending module 803 is specifically used for sending the first object object masking-out data to client.
Optionally, in some embodiments of the invention, processing module 802, specifically for following one or more:
Processing module 802, specifically for according to preset human body segmentation's algorithm and the video data, obtaining comprising human body The masking-out data of type identification;
Processing module 802, specifically for according to preset logo partitioning algorithm and the video data, obtaining comprising logo The masking-out data of type identification;
Processing module 802, specifically for according to preset segmentation of spheres algorithm and the video data, obtaining comprising sphere The masking-out data of type identification;
Processing module 802, specifically for according to preset animal partitioning algorithm and the video data, obtaining comprising animal The masking-out data of type identification;
Processing module 802, specifically for according to preset plant partitioning algorithm and the video data, obtaining comprising plant The masking-out data of type identification;
Processing module 802, specifically for according to preset advertisement partitioning algorithm and the video data, obtaining comprising advertisement The masking-out data of type identification.
Optionally, in some embodiments of the invention,
Processing module 802, specifically for including the illiteracy of the human body type identification when the different types of masking-out data When version data, according to the masking-out data of the human body type identification and preset human bioequivalence algorithm, obtain comprising human identification Masking-out data;According to the masking-out data and the configuration data comprising human identification, first object human body masking-out is obtained Data;
Alternatively,
Processing module 802, specifically for including the illiteracy of the logo type identification when the different types of masking-out data When version data, according to the masking-out data of the logo type identification and preset TV station symbol recognition algorithm, obtain identifying comprising logo Masking-out data;According to the masking-out data and the configuration data comprising logo mark, first object logo masking-out is obtained Data;
Alternatively,
Processing module 802, specifically for including the illiteracy of the sphere type identification when the different types of masking-out data When version data, according to the masking-out data of the sphere type identification and preset sphere recognizer, obtain identifying comprising sphere Masking-out data;According to the masking-out data and the configuration data comprising sphere mark, first object sphere masking-out is obtained Data;
Alternatively,
Processing module 802, specifically for including the illiteracy of the type of animal mark when the different types of masking-out data When version data, according to the masking-out data of type of animal mark and preset animal identification algorithm, obtain comprising animal identification Masking-out data;According to the masking-out data and the configuration data comprising animal identification, first object animal masking-out is obtained Data;
Alternatively,
Processing module 802, specifically for including the illiteracy of the vegetation type mark when the different types of masking-out data When version data, according to the masking-out data of vegetation type mark and preset plants identification algorithm, obtain identifying comprising plant Masking-out data;According to the masking-out data and the configuration data comprising plant mark, first object plant masking-out is obtained Data;
Alternatively,
Processing module 802, specifically for including the illiteracy of the advertisement type mark when the different types of masking-out data When version data, according to masking-out data and preset advertisement recognizer that the advertisement type identifies, obtain comprising advertising logo Masking-out data;According to the masking-out data and the configuration data comprising advertising logo, first object advertisement masking-out is obtained Data.
Optionally, in some embodiments of the invention,
Receiving module 801, the second user configuration data sent specifically for receiving the client;To the client The second target type masking-out data are sent, the second target type masking-out data show the second illiteracy for the client The version barrage page;
Processing module 802 is specifically used for according to the second user configuration data and the different types of masking-out data, Determine the second target type masking-out data.
As shown in Figure 9 A, it is one embodiment schematic diagram of client in the embodiment of the present invention, may include:
Receiving module 901, for receiving first object type masking-out data, video data and the barrage number of server transmission According to;
Display module 902, it is corresponding for being shown according to first object type masking-out data, video data and barrage data The page, the corresponding page include the first barrage page and the first masking-out page.
It optionally, in some embodiments of the invention, as shown in Figure 9 B, is the another of client in the embodiment of the present invention A embodiment schematic diagram, client can also include:
Processing module 903, the input for responding user operate, and generate the first user configuration data;
Sending module 904, for sending the first user configuration data to server, the first user configuration data are for servicing Device determines first object type masking-out data.
Optionally, in some embodiments of the invention, client can also include:
Processing module 903, the input for responding user operate, and generate second user configuration data;
Sending module 904, for sending second user configuration data to server, second user configuration data is for servicing Device determines the second target type masking-out data;
Receiving module 901 is also used to receive the second target type masking-out data of server transmission;
Display module 902 is also used to according to the second target type masking-out data, video data and barrage data, display the The two masking-out barrage pages.
As shown in Figure 10, it is another embodiment schematic diagram of server in the embodiment of the present invention, may include:
Transceiver 1001, memory 1002 and processor 1003, the transceiver 1001, the memory 1002 and described Processor 1003 is connected by bus 1004;It is understood that server shown in Fig. 10 it is corresponding can also be performed it is above-mentioned Step performed by server, is no longer described in detail herein in embodiment shown in Fig. 4, Fig. 6, Fig. 7.
As shown in figure 11, it is another embodiment schematic diagram of client in the embodiment of the present invention, may include:
Transceiver 1101, memory 1102 and processor 1103, the transceiver 1101, the memory 1102 and described Processor 1103 is connected by bus 1104;It is understood that client shown in Figure 11 it is corresponding can also be performed it is above-mentioned Step performed by client, is no longer described in detail herein in embodiment shown in Fig. 4, Fig. 6, Fig. 7.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.
The computer program product includes one or more computer instructions.Load and execute on computers the meter When calculation machine program instruction, entirely or partly generate according to process or function described in the embodiment of the present application.The computer can To be general purpose computer, special purpose computer, computer network or other programmable devices.The computer instruction can be deposited Storage in a computer-readable storage medium, or from a computer readable storage medium to another computer readable storage medium Transmission, for example, the computer instruction can pass through wired (example from a web-site, computer, server or data center Such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave) mode to another website Website, computer, server or data center are transmitted.The computer readable storage medium can be computer and can deposit Any usable medium of storage either includes that the data storages such as one or more usable mediums integrated server, data center are set It is standby.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or partly lead Body medium (such as solid state hard disk Solid State Disk (SSD)) etc..
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a storage medium, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey The medium of sequence code.
The above, above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although referring to before Embodiment is stated the application is described in detail, those skilled in the art should understand that: it still can be to preceding Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features;And these It modifies or replaces, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution.

Claims (24)

1. a kind of method of masking-out barrage interaction, which is characterized in that the method be applied to be including server and client side System, which comprises
The server obtains video data, configuration data and barrage data;
The server analyzes the video data, obtains different type according to preset different type partitioning algorithm Masking-out data;
The server determines first object type masking-out number according to the different types of masking-out data and the configuration data According to;
The server sends the first object type masking-out data, the video data and the barrage number to client According to;
The client receives first object type masking-out data, video data and the barrage data that server is sent;
The client shows according to the first object type masking-out data, the video data and the barrage data and corresponds to The page, the corresponding page include the first barrage page and the first masking-out page.
2. a kind of method of masking-out barrage interaction characterized by comprising
Server obtains video data, configuration data and barrage data;
The server analyzes the video data, obtains different type according to preset different type partitioning algorithm Masking-out data;
The server determines first object type masking-out number according to the different types of masking-out data and the configuration data According to;
The server sends the first object type masking-out data, the video data and the barrage number to client According to the first object type masking-out data, the video data and the barrage data are corresponded to for client display The page, the corresponding page include the first barrage page and the first masking-out barrage page.
3. according to the method described in claim 2, it is characterized in that, the configuration data includes the first user configuration data and fortune Seek at least one of configuration data;
The server obtains configuration data, comprising:
The server receives the first user configuration data that the client is sent;
Alternatively,
The input operation of the server response operation personnel, generates the operation configuration data.
4. according to the method described in claim 3, it is characterized in that, the priority of the operation configuration data is higher than described first The priority of user configuration data.
5. the method according to any one of claim 2-4, which is characterized in that the server is according to the different type Masking-out data and the configuration data, determine first object type masking-out data, comprising:
The server is obtained according to the different types of masking-out data and preset object recognition algorithm comprising object identity Masking-out data;
The server obtains first object object illiteracy according to the masking-out data and the configuration data comprising object identity Version data;
The server sends the first object type masking-out data to client, comprising:
The server sends the first object object masking-out data to client.
6. according to the method described in claim 5, it is characterized in that, the server divides calculation according to preset different type Method analyzes the video data, obtains different types of masking-out data, including following one or more:
The server obtains the masking-out comprising human body type identification according to preset human body segmentation's algorithm and the video data Data;
The server obtains the masking-out comprising logo type identification according to preset logo partitioning algorithm and the video data Data;
The server obtains the masking-out comprising sphere type identification according to preset segmentation of spheres algorithm and the video data Data;
The server obtains the masking-out comprising type of animal mark according to preset animal partitioning algorithm and the video data Data;
The server obtains the masking-out comprising vegetation type mark according to preset plant partitioning algorithm and the video data Data;
The server obtains the masking-out comprising advertisement type mark according to preset advertisement partitioning algorithm and the video data Data.
7. according to the method described in claim 6, it is characterized in that, the server is according to the different types of masking-out data With preset object recognition algorithm, the masking-out data comprising object identity are obtained;The server is according to described comprising object mark The masking-out data and the configuration data of knowledge obtain first object object masking-out data, comprising:
When the different types of masking-out data include the masking-out data of the human body type identification,
Masking-out data and preset human bioequivalence algorithm of the server according to the human body type identification are obtained comprising human body The masking-out data of mark;
The server obtains first object human body illiteracy according to the masking-out data and the configuration data comprising human identification Version data;
Alternatively,
When the different types of masking-out data include the masking-out data of the logo type identification,
Masking-out data and preset TV station symbol recognition algorithm of the server according to the logo type identification are obtained comprising logo The masking-out data of mark;
The server obtains first object logo illiteracy according to the masking-out data and the configuration data comprising logo mark Version data;
Alternatively,
When the different types of masking-out data include the masking-out data of the sphere type identification,
The server is obtained according to the masking-out data and preset sphere recognizer of the sphere type identification comprising sphere The masking-out data of mark;
The server obtains first object sphere illiteracy according to the masking-out data and the configuration data comprising sphere mark Version data;
Alternatively,
When the different types of masking-out data include the masking-out data of the type of animal mark,
The masking-out data and preset animal identification algorithm that the server is identified according to the type of animal, obtain comprising animal The masking-out data of mark;
The server obtains first object animal illiteracy according to the masking-out data and the configuration data comprising animal identification Version data;
Alternatively,
When the different types of masking-out data include the masking-out data of the vegetation type mark,
The masking-out data and preset plants identification algorithm that the server is identified according to the vegetation type, obtain comprising plant The masking-out data of mark;
The server obtains first object plant illiteracy according to the masking-out data and the configuration data comprising plant mark Version data;
Alternatively,
When the different types of masking-out data include the masking-out data of the advertisement type mark,
The masking-out data and preset advertisement recognizer that the server is identified according to the advertisement type are obtained comprising advertisement The masking-out data of mark;
The server obtains first object advertisement illiteracy according to the masking-out data and the configuration data comprising advertising logo Version data.
8. the method according to any one of claim 2-4, which is characterized in that the method also includes:
The server receives the second user configuration data that the client is sent;
The server determines the second target class according to the second user configuration data and the different types of masking-out data Type masking-out data;
The server sends the second target type masking-out data, the second target type masking-out number to the client The second masking-out barrage page is shown according to for the client.
9. a kind of method of masking-out barrage interaction characterized by comprising
Client receives first object type masking-out data, video data and the barrage data that server is sent;
The client shows according to the first object type masking-out data, the video data and the barrage data and corresponds to The page, the corresponding page include the first barrage page and the first masking-out page.
10. according to the method described in claim 9, it is characterized in that, the client receives the first object that server is sent Before type masking-out data, the method also includes:
The input of the client end response user operates, and generates the first user configuration data;
The client sends the first user configuration data to the server, and the first user configuration data are used for institute It states server and determines the first object type masking-out data.
11. method according to claim 9 or 10, which is characterized in that the client is according to the first object type After masking-out data show the corresponding page, the method also includes:
The input of the client end response user operates, and generates second user configuration data;
The client sends the second user configuration data to the server, and the second user configuration data is used for institute It states server and determines the second target type masking-out data;
The client receives the second target type masking-out data that the server is sent;
The client is according to the second target type masking-out data, the video data and the barrage data, display the The two masking-out barrage pages.
12. a kind of live streaming interactive system, which is characterized in that the system comprises: server and client side;
The server, for obtaining video data, configuration data and barrage data;
The server, for analyzing the video data, obtaining difference according to preset different type partitioning algorithm The masking-out data of type;
The server, for determining first object type according to the different types of masking-out data and the configuration data Masking-out data;
The server, for sending the first object type masking-out data, the video data and institute to the client State barrage data;
The client, first object type masking-out data, video data and the barrage number sent for receiving the server According to;
The client, for aobvious according to the first object type masking-out data, the video data and the barrage data Show that the corresponding page, the corresponding page include the first barrage page and the first masking-out page.
13. a kind of server characterized by comprising
Receiving module, for obtaining video data, configuration data and barrage data;
Processing module, for analyzing the video data, obtaining inhomogeneity according to preset different type partitioning algorithm The masking-out data of type;According to the different types of masking-out data and the configuration data, first object type masking-out number is determined According to;
Sending module, for sending the first object type masking-out data, the video data and the barrage to client Data, the first object type masking-out data, the video data and the barrage data are shown pair for the client The page answered, the corresponding page include the first barrage page and the first masking-out barrage page.
14. server according to claim 13, which is characterized in that the configuration data includes the first user configuration data With operation at least one of configuration data;
The receiving module, the first user configuration data sent specifically for receiving the client;
Alternatively,
The receiving module, the input specifically for responding operation personnel operate, and generate the operation configuration data.
15. server according to claim 14, which is characterized in that the priority of the operation configuration data is higher than described The priority of first user configuration data.
16. server described in any one of 3-15 according to claim 1, which is characterized in that
The processing module, specifically for obtaining according to the different types of masking-out data and preset object recognition algorithm Masking-out data comprising object identity;According to the masking-out data and the configuration data comprising object identity, first is obtained Target object masking-out data;
The sending module is specifically used for sending the first object object masking-out data to client.
17. server according to claim 16, which is characterized in that the processing module be specifically used for following one kind or It is several:
According to preset human body segmentation's algorithm and the video data, the masking-out data comprising human body type identification are obtained;
According to preset logo partitioning algorithm and the video data, the masking-out data comprising logo type identification are obtained;
According to preset segmentation of spheres algorithm and the video data, the masking-out data comprising sphere type identification are obtained;
According to preset animal partitioning algorithm and the video data, the masking-out data comprising type of animal mark are obtained;
According to preset plant partitioning algorithm and the video data, the masking-out data comprising vegetation type mark are obtained;
According to preset advertisement partitioning algorithm and the video data, the masking-out data comprising advertisement type mark are obtained.
18. server according to claim 17, which is characterized in that
The processing module, specifically for including the masking-out number of the human body type identification when the different types of masking-out data According to when, according to the masking-out data of the human body type identification and preset human bioequivalence algorithm, obtain the illiteracy comprising human identification Version data;According to the masking-out data and the configuration data comprising human identification, first object human body masking-out data are obtained;
Alternatively,
The processing module, specifically for including the masking-out number of the logo type identification when the different types of masking-out data According to when, according to the masking-out data of the logo type identification and preset TV station symbol recognition algorithm, obtain comprising logo mark illiteracy Version data;According to the masking-out data and the configuration data comprising logo mark, first object logo masking-out data are obtained;
Alternatively,
The processing module, specifically for including the masking-out number of the sphere type identification when the different types of masking-out data According to when, according to the masking-out data of the sphere type identification and preset sphere recognizer, obtain comprising sphere mark illiteracy Version data;According to the masking-out data and the configuration data comprising sphere mark, first object sphere masking-out data are obtained;
Alternatively,
The processing module, specifically for including the masking-out number of the type of animal mark when the different types of masking-out data According to when, according to the type of animal mark masking-out data and preset animal identification algorithm, obtain the illiteracy comprising animal identification Version data;According to the masking-out data and the configuration data comprising animal identification, first object animal masking-out data are obtained;
Alternatively,
The processing module, specifically for including the masking-out number of the vegetation type mark when the different types of masking-out data According to when, according to the vegetation type mark masking-out data and preset plants identification algorithm, obtain comprising plant mark illiteracy Version data;According to the masking-out data and the configuration data comprising plant mark, first object plant masking-out data are obtained;
Alternatively,
The processing module, specifically for including the masking-out number of the advertisement type mark when the different types of masking-out data According to when, according to the advertisement type identify masking-out data and preset advertisement recognizer, obtain the illiteracy comprising advertising logo Version data;According to the masking-out data and the configuration data comprising advertising logo, first object advertisement masking-out data are obtained.
19. server described in any one of 3-15 according to claim 1, which is characterized in that
The receiving module, the second user configuration data sent specifically for receiving the client;It is sent out to the client The second target type masking-out data are sent, the second target type masking-out data show the second masking-out for the client The barrage page;
The processing module is specifically used for according to the second user configuration data and the different types of masking-out data, really Fixed second target type masking-out data.
20. a kind of client characterized by comprising
Receiving module, for receiving first object type masking-out data, video data and the barrage data of server transmission;
Display module, for being shown according to the first object type masking-out data, the video data and the barrage data The corresponding page, the corresponding page include the first barrage page and the first masking-out page.
21. client according to claim 20, which is characterized in that the client further include:
Processing module, the input for responding user operate, and generate the first user configuration data;
Sending module, for sending the first user configuration data to the server, the first user configuration data are used The first object type masking-out data are determined in the server.
22. the client according to claim 20 or 21, which is characterized in that the client further include:
Processing module, the input for responding user operate, and generate second user configuration data;
Sending module, for sending the second user configuration data to the server, the second user configuration data is used The second target type masking-out data are determined in the server;
The receiving module is also used to receive the second target type masking-out data that the server is sent;
The display module is also used to according to the second target type masking-out data, the video data and the barrage number According to the second masking-out barrage page of display.
23. a kind of server characterized by comprising
Transceiver, memory and processor, the transceiver, the memory and the processor are connected by bus;
The memory, for storing operational order;
The transceiver, for obtaining video data, configuration data and barrage data;
The processor, for analyzing the video data, obtaining difference according to preset different type partitioning algorithm The masking-out data of type;According to the different types of masking-out data and the configuration data, first object type masking-out is determined Data;
The transceiver is also used to send the first object type masking-out data, the video data and described to client Barrage data, the first object type masking-out data, the video data and the barrage data are aobvious for the client Show that the corresponding page, the corresponding page include the first barrage page and the first masking-out barrage page.
24. a kind of client characterized by comprising
Transceiver, memory and processor, the transceiver, the memory and the processor are connected by bus;
The memory, for storing operational order;
The transceiver, for receiving first object type masking-out data, video data and the barrage data of server transmission;
The processor, for aobvious according to the first object type masking-out data, the video data and the barrage data Show that the corresponding page, the corresponding page include the first barrage page and the first masking-out page.
CN201910330879.9A 2019-04-23 2019-04-23 A kind of method, server and the client of the interaction of masking-out barrage Pending CN110225365A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910330879.9A CN110225365A (en) 2019-04-23 2019-04-23 A kind of method, server and the client of the interaction of masking-out barrage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910330879.9A CN110225365A (en) 2019-04-23 2019-04-23 A kind of method, server and the client of the interaction of masking-out barrage

Publications (1)

Publication Number Publication Date
CN110225365A true CN110225365A (en) 2019-09-10

Family

ID=67820095

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910330879.9A Pending CN110225365A (en) 2019-04-23 2019-04-23 A kind of method, server and the client of the interaction of masking-out barrage

Country Status (1)

Country Link
CN (1) CN110225365A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112492324A (en) * 2019-09-12 2021-03-12 上海哔哩哔哩科技有限公司 Data processing method and system
CN112492347A (en) * 2019-09-12 2021-03-12 上海哔哩哔哩科技有限公司 Method for processing information flow and displaying bullet screen information and information flow processing system
CN113271502A (en) * 2020-02-17 2021-08-17 上海哔哩哔哩科技有限公司 Data display method and device based on video barrage and computer equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303731A (en) * 2016-08-01 2017-01-04 北京奇虎科技有限公司 The display packing of barrage and device
US20170366715A1 (en) * 2013-07-01 2017-12-21 Qualcomm Incorporated Display device configured as an illumination source
CN108881995A (en) * 2018-07-17 2018-11-23 上海哔哩哔哩科技有限公司 Video barrage masking-out method for drafting, barrage playback method, device and medium
CN109302619A (en) * 2018-09-18 2019-02-01 北京奇艺世纪科技有限公司 A kind of information processing method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170366715A1 (en) * 2013-07-01 2017-12-21 Qualcomm Incorporated Display device configured as an illumination source
CN106303731A (en) * 2016-08-01 2017-01-04 北京奇虎科技有限公司 The display packing of barrage and device
CN108881995A (en) * 2018-07-17 2018-11-23 上海哔哩哔哩科技有限公司 Video barrage masking-out method for drafting, barrage playback method, device and medium
CN109302619A (en) * 2018-09-18 2019-02-01 北京奇艺世纪科技有限公司 A kind of information processing method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112492324A (en) * 2019-09-12 2021-03-12 上海哔哩哔哩科技有限公司 Data processing method and system
CN112492347A (en) * 2019-09-12 2021-03-12 上海哔哩哔哩科技有限公司 Method for processing information flow and displaying bullet screen information and information flow processing system
CN113271502A (en) * 2020-02-17 2021-08-17 上海哔哩哔哩科技有限公司 Data display method and device based on video barrage and computer equipment

Similar Documents

Publication Publication Date Title
CN109145784B (en) Method and apparatus for processing video
US10158827B2 (en) System and method for providing a shared canvas for chat participant
US11745104B2 (en) Method and system for providing interactive content delivery and audience engagement
US10157638B2 (en) Collage of interesting moments in a video
CN107371042A (en) Advertisement placement method, device, equipment and storage medium
CN110430461A (en) A kind of method, apparatus and video playback apparatus controlling video playing
CN107750460A (en) The automatic identification of entity in media capture event
CN110225365A (en) A kind of method, server and the client of the interaction of masking-out barrage
CN106303354B (en) Face special effect recommendation method and electronic equipment
US8869199B2 (en) Media content transmission method and apparatus, and reception method and apparatus for providing augmenting media content using graphic object
US20220130077A1 (en) Content modification in a shared session among multiple head-mounted display devices
US10363488B1 (en) Determining highlights in a game spectating system
CN105872786B (en) A kind of method and device for launching advertisement by barrage in a program
CN108712674A (en) Video playing control method, playback equipment and storage medium
CN108133385A (en) A kind of advertisement placement method and device
CN113422988B (en) Live broadcast cover generation method and device, electronic equipment and storage medium
US11663725B2 (en) Selecting viewpoints for rendering in volumetric video presentations
Boyle et al. Sport, the media and strategic communications management
López-González et al. Broadcasting sport: Analogue markets and digital rights
CN112492347A (en) Method for processing information flow and displaying bullet screen information and information flow processing system
CN107801061A (en) Ad data matching process, apparatus and system
US20090150939A1 (en) Spanning multiple mediums
US11696001B2 (en) Enhanced immersive digital media
US9678960B2 (en) Methods and systems of dynamic content analysis
CN112492324A (en) Data processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190910