WO2016095602A1

WO2016095602A1 - Method and apparatus for generating live comments overlaid on playing object

Info

Publication number: WO2016095602A1
Application number: PCT/CN2015/091926
Authority: WO
Inventors: 宋鳌; 陈国庆; 张健; 杜曲生; 胡侨鑫; 褚静波; 郏夹; 李凡; 娄同兵
Original assignee: 百度时代网络技术（北京）有限公司
Priority date: 2014-12-19
Filing date: 2015-10-14
Publication date: 2016-06-23
Also published as: CN104575553B; CN104575553A

Abstract

Provided are a method and apparatus for generating live comments overlaid on a playing object. The method comprises: receiving live comment texts published by another user apart from a current user; according to friend information in login account information about the current user, judging whether the other user is a friend of the current user; and playing the live comment texts on a playing object, wherein if the other user is not a friend of the current user, the live comment texts are played on the playing object in a first playing track shape; and if the other user is a friend of the current user, the live comment texts are played on the playing object in a second playing track shape which is different from the first playing track shape. The present invention improves the pertinence of live comment playing for a user, such that the user can more quickly acquire useful information from the great number of live comments being played.

Description

Method and apparatus for generating a barrage superimposed on a playback object

Cross-reference to related applications

The present application claims the priority of the Chinese Patent Application No. 201410804346.7 filed on Dec. 19, 2014, the content of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of image processing, and more particularly to a method and apparatus for generating a barrage superimposed on a playback object.

Background technique

Barrage is a short comment sent by a person watching a picture or video in real time. The short comment will be played with the picture or video in real time as the picture or video is played, so that the barrage text that the user publishes when viewing the picture or video will be Other users who also watch the picture or video will see it and see it themselves. The prior art barrage playback often uses the same form of play for all published barrage information, such as scrolling from the right side of the screen to the left side.

Summary of the invention

One of the technical problems solved by the present invention is to improve the pertinence of the barrage playback to the user, so that the user can obtain useful information more quickly from the playback of a large number of barrage.

According to an embodiment of the present invention, a method for generating a barrage superimposed on a play object is provided, comprising: receiving a barrage text published by a user other than the current user; and the friend information in the login account information according to the current user Determining whether the other user is a friend of the current user; playing the barrage text on the play object, wherein if the other user is not the current user's friend, playing the barrage text on the play object in the shape of the first play track; The other user is a friend of the current user, and the barrage text is played on the play object in a shape of the second play track different from the shape of the first play track.

According to an embodiment of the present invention, there is provided a method for generating an overlay on a playback object The device of the barrage comprises: a unit for receiving a barrage text published by a user other than the current user; determining, according to the friend information in the login account information of the current user, whether the other user is a unit of a friend of the current user; The unit for playing the barrage text is configured to: if the other user is not a friend of the current user, play the barrage text on the play object in the shape of the first play track; if the other user is a friend of the current user, the difference is The shape of the second play track in the shape of the first play track plays the barrage text on the play object.

In the embodiment of the present invention, when the barrage text that is not published by the user's friend is received, the barrage text is played on the play object in the shape of the first play track, and when the barrage text published by the user friend is received, The second play track shape different from the shape of the first play track plays the barrage text on the play object, and the barrage text published by the user friend may be more important, so that the user can quickly get from a large amount of barrage information. Get information that is useful to the user.

Those skilled in the art will appreciate that although the following detailed description is made with reference to the illustrated embodiments and drawings, the invention is not limited to these embodiments. Rather, the scope of the invention is intended to be limited the scope of the invention

DRAWINGS

Other features, objects, and advantages of the present invention will become more apparent from the Detailed Description of Description

1 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with one embodiment of the present invention.

2 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

3 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

4 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

FIG. 5 is a diagram showing generation of superimposed on a playback object according to another embodiment of the present invention. Flow chart of the method of barrage.

6 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

7 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

8 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with another embodiment of the present invention.

9 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

10 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with another embodiment of the present invention.

11 is a block diagram of an apparatus for generating a barrage superimposed on a playback object, in accordance with one embodiment of the present invention.

Figure 12 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

Figure 13 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

Figure 14 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

Figure 15 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

Figure 16 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

Figure 17 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

Figure 18 is a block diagram of an apparatus for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention.

19 is a block diagram of an apparatus for generating a barrage superimposed on a play object, in accordance with another embodiment of the present invention.

20 is a block diagram of an apparatus for generating a barrage superimposed on a playback object, in accordance with another embodiment of the present invention.

The same or similar reference numerals in the drawings denote the same or similar components.

detailed description

The invention is further described in detail below with reference to the accompanying drawings.

1 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with one embodiment of the present invention. The method of the present invention is primarily accomplished by an operating system or processing controller in a computer device. The operating system or processing controller is referred to as a device that generates a barrage superimposed on a playback object, hereinafter referred to as a generating device. The computer device includes but is not limited to a single network server, a server group composed of a plurality of network servers, or a cloud-based cloud composed of a large number of computers or network servers, wherein the cloud computing is a kind of distributed computing, which is loosely coupled by a group of Computer set consisting of a super virtual computer.

The playback object refers to the played pictures, videos, TV programs, and the like. A barrage is a short comment sent by a user watching a playback object in real time, which plays in real time as the playback object plays. The general process of barrage playback is when a user visits a web page with a picture or video. The website of this website has established a partnership with the barrage website. Thus, when the user browses the web page, the website of the web page knows the terminal ID of the user, and sends the terminal ID along with the web page address, the picture or video name to the server of the barrage website. If the user is logged in to browse the webpage, the webpage of the webpage will also send the login account name of the user to the server of the barrage website. The server of the barrage website will make the barrage text that is published when other users watch the picture or video into a web server that will be superimposed on the played picture or video and sent back to the webpage of the webpage. The web server of the web page adds the overlay to the picture or video for viewing by the user. If the user wants to post a barrage text, for example, select the "Publishing Barrage" option that appears next to the picture or video. At this point, the web server of the web page sends the user's barrage text to the server of the barrage website, and the server of the barrage website creates a layer with a barrage superimposed on the picture or video. The server of the barrage website creates a layer with a barrage superimposed on the picture or video and sends the layer back to the web server of the web page, which is added to the picture or video by the web server of the web page for viewing by the user. Implemented in accordance with the present invention The method of generating a barrage superimposed on a play object is a method in which a barrage web server creates a layer with a barrage to superimpose the object on the play object.

At step 110, a barrage text published by a user other than the current user is received.

The current user refers to a user who currently browses a server with a playback object (such as a web server with video) and sends its terminal ID to the server of the barrage website by the server with the playback object. At present, the current user does not publish the barrage text, so the server of the barrage website only receives its terminal ID, the server address and the name of the playback object through the server with the playback object. For other users (ie, other users) who have published the barrage text for the playback object of the server, the server of the barrage website receives its terminal ID and the published barrage text.

In step 120, according to the friend information in the login account information of the current user, it is determined whether the other user is a friend of the current user.

In this embodiment, the current user needs to log in to browse a server with a playback object (such as a web server with video) instead of an anonymous login, and a server with a playback object on the login (such as a web server with video) After that, the displayed page has similar friend information on the Weibo website, such as "Follow", "Fans" and so on. The current user can find other users through this page, and “follow” other users, and other users can also “follow” the current user through the page, thereby becoming a fan of the current user. In this way, after the current user needs to log in to browse the server with the playback object (such as a web server with video), the server with the playback object will put the terminal ID, the user login account name, and the user login account name. The friend information (for example, "attention", "fan") is sent to the barrage server along with the server address and the play object name. The barrage server can determine whether the other user is a friend of the current user according to the friend information in the login account information of the current user.

In one case, as long as the other user belongs to the user of the current user or the user who is concerned with the current user (ie, the fan of the current user), the other user is considered to be the friend of the current user.

In another case, the other user is considered to be the current user's friend only when the other user belongs to the current user's attention.

It should be understood that the above two ways of determining whether the other user is a friend of the current user are only examples, and other ways of determining whether the other user is a friend of the current user according to the friend information in the login account information of the current user (for example, The users concerned are classified into "close friends", "general attention", "celebrity stars", etc., and only other users belonging to "close friends" are considered to be friends of the current user) also fall within the protection scope of the present invention.

In step 130, the barrage text is played on the play object, wherein if the other user is not the current user's friend, the barrage text is played on the play object in the shape of the first play track; if the other user is the current user The friend plays the barrage text on the play object in a shape of the second play track different from the shape of the first play track.

The play track shape refers to the shape of the track that the barrage text passes when it is played on the screen. For example, when the barrage text scrolls from right to left in the lower position on the screen or the playback object (it appears from the right end of the screen or the lower position of the playback object, scrolls to the left, disappears to the left of the screen or the playback object) The playback track shape is the line from the right to the left of the screen or the lower part of the playback object. In the present embodiment, for example, an elongated background area is provided at a lower position of the screen or the playback object, and the first play track shape may be a line from right to left in the background area. The background area can accommodate several such lines from top to bottom. The shape of the second play track may be that the barrage text appears from the screen or the center of the play object to scatter to the surrounding diffused shape and disappears on the screen or the edge of the play object. The shape of the second play track may also be that the barrage text appears from the top of the screen or the play object, and falls to the screen or the center of the play object disappears. Alternatively, a background area such as a strip shape is set at a lower position of the screen or the playback object, and the shape of the second play track is that the barrage text appears from the center of the screen or the play object, falls in a parabolic shape, and is inserted into the barrage background. Scrolls from right to left with other barrage text in the barrage background.

Of course, the specific shapes of the first and second play track shapes described above are merely examples, and those skilled in the art can conceive the shapes of other play specifications, which fall within the protection scope of the present invention.

The effect achieved by the embodiment of FIG. 1 is that since the pop-up text of the current user's non-friend user and the current user's friend user follows the different play track shapes in the current user, the current user can see at a glance To the friend’s barrage, this These barrages may be more of a concern for current users.

2 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with one embodiment of the present invention.

Compared with FIG. 1, the embodiment of FIG. 2 further adds step 121 to determine whether the barrage texts published by the other users are related to Internet emergent topics or popular events.

The Internet's sudden topic refers to topics that have been hotly debated on the Internet recently, such as the price increase of the subway or the purchase restriction of the house. Hot events refer to recent events on the Internet that are of concern to everyone, such as the Xiamen bombings. If the barred texts published by the other users are related to the reasons and latest developments of the Xiamen bombings, the barred texts published by the other users are considered to be related to Internet emergent topics or popular events.

It can be determined in various ways whether it is determined whether the barred texts published by other users are related to Internet emergent topics or hot events.

In one mode, the barred texts published by the other users are searched on the Internet. If some recent news or a large number of recent comments by netizens are searched, the barred texts published by the other users are considered to be in the Internet. Related topics or hot events. For example, if there are more than 5 comments in the week of the searched news or more than 20 comments in the searched week, the barred texts published by the other users are considered to be related to Internet emergent topics or popular events.

In another way, the headlines of news appearing on various Internet sites are periodically crawled and maintained in a database on the barrage web server. Comparing the barrage texts published by the other users with the titles in the database, and if the similarity is greater than the predetermined similarity threshold by more than a predetermined number, the other user's published barrage text and the Internet sudden topic or Popular events related. The similarity is defined, for example, as the ratio of the number of words commonly contained in the title of the barrage text published by the other user to the title in the database to the number of words of the barrage text published by the other user. For example, it may be provided that if the similarity of the title text published by the other user is greater than 80% in the six titles in the database, the similarity threshold is specified as 75%, and the predetermined number is specified as five, the other users are considered The published barrage text is related to sudden or hot events on the Internet.

Of course, there are other judgments as to whether the other users’ barred texts are related to the Internet. The manner in which a sudden topic or a hot event is related is included in the scope of protection of the present invention.

In addition, step 130 includes: if the barred text published by the other user is related to an internet burst topic or a popular event, playing the barrage text on the play object in a shape different from the third play track shape of the first play track shape.

The third play track shape may be the same shape as the second play track. For example, the barrage text appears from the screen or the center of the playback object, scatters to the surrounding diffused shape, and disappears on the screen or the edge of the playback object, or the barrage text appears from the top of the screen or the playback object, and drops to the screen or the center of the playback object. The location disappears.

The shape of the third play track may also be different from the shapes of the first and second play tracks. For example, it may be provided that the shape of the third play track is such that it appears from the edge of the screen or the playback object, and the center position of the playback object or the playback object disappears.

If the barrage text published by the other user is not related to the Internet sudden topic or the popular event, the barrage text published by the other user is played according to the playing rule in step 130. That is, if the other user is not the friend of the current user, the barrage text is played on the play object in the shape of the first play track; if the other user is the friend of the current user, the second play track is different from the shape of the first play track. The shape plays the barrage text on the playback object.

The effect of the embodiment of FIG. 2 is to enable the current user's attention to quickly lock the barrage text associated with the Internet sudden topic or hot event on the screen or the playback object, so that the current user can quickly obtain the most useful information.

3 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with one embodiment of the present invention. Compared with FIG. 1, FIG. 3 adds

steps

102 and 103.

In step 102, a live screenshot of the play object is performed.

For images, since the image is static, you may only need to take a screenshot. For video or television programs, since it is dynamic, for example, a real-time screenshot of the playback object is periodically performed, for example, every 0.5 s.

In addition to the periodic screenshots, other methods such as adjusting the frequency of the screenshot according to the screen change speed of the playback object may be adopted, and they all fall within the protection scope of the present invention.

In step 103, the primary color in the picture captured by the real-time screenshot is analyzed.

It can be considered that the color of each pixel in the picture is composed of three color elements of red (R), green (G), and blue (B), and the color value can be represented by three values of (R, G, B). R represents the red color value of the pixel, G represents the green color value of the pixel, and B represents the blue color value of the pixel. The range of R, G, and B is a positive integer between 0 and 255. When R, G, and B are both 0, the color of the pixel is pure white. R, G, and B are both 255, and the color of the pixel is pure black.

In one way, the (R, G, B) values of all pixels in the picture are counted. Which (R, G, B) value appears most in all pixels, the value of (R, G, B) is considered to be the dominant color in the picture.

In another way, considering that it is meaningless to distinguish between two very similar (R, G, B) values, for example (45, 136, 37) and (46, 137, 37) colors may be similar, so first all The R, G, and B values of the (R, G, B) values of the pixels are rounded to the tenth position. Then, it is considered that the (R, G, B) value is the dominant color in the picture, whichever (R, G, B) value is rounded up in all pixels.

Those skilled in the art will also be able to devise other ways of analyzing the dominant colors in the pictures captured by the real-time screenshots, all of which fall within the scope of the present invention.

In addition, the step 130 includes playing the barrage text in the background area of the barrage superimposed on the playing object, wherein the color of the background area of the barrage is set to the first color obtained based on the main color, and the color of the barrage text is set to be based on the main color. The second color.

In the prior art, the play barrage text is not played in a fixed area of the screen or the playback object. It is very likely that a barrage text published by another user has just flew over the screen or the top of the object, and then another barrage text published by another user flies over the screen or at the bottom of the object. In this way, it will affect the main picture of the current user watching the playback object. Therefore, the present invention sets a special area on the playback object as the background area of the barrage, unless it is a barrage published by a friend of the current user or a barrage text related to a sudden topic or a popular event on the Internet, and other barrage text. They are played in the background area of the barrage, which increases the comfort of the user.

The first color obtained based on the main color is, for example, a color obtained by increasing or decreasing n values on the basis of R, G, and B of the main color. For example, the main color is (145, 18, 78), in the main The color R, G, and B are subtracted by 10 values to obtain the first color (135, 8, 68) as the color of the background area of the barrage. Generally, n should not be too big or too small. Due to the visual characteristics of the human eye, when the superimposed background area of the barrage is substantially the same as the main color of the picture, the comfort of the human eye is the highest, so n should not be too large. In addition, if n is too small, the background area and the main color of the picture are indistinguishable. In practice, n is 10 is a more preferable way to ensure the comfort of the human eye and avoid confusion with the picture content.

The second color obtained based on the dominant color is, for example, the contrast color of the main color. The contrast color is the relative color in the color wheel, ie (255, 255, 255) minus the main color. For example, if the primary color is (125, 115, 105), the contrast color is (130, 140, 150). The color of the barrage text is set to be larger than the color of the background area of the barrage, so that the user can clearly see the barrage text more clearly.

The first color and the second color obtained based on the main color described above are merely examples. In fact, the first color and the second color can also be obtained based on the main colors in other ways. For example, the second color based on the main color is not necessarily the contrast color of the main color, and may be a color near the contrast color or the like. These other methods are all within the scope of the present invention.

The effect of the embodiment of Fig. 3 is that it makes the playback of the barrage better adapted to the user's viewing habits, improving the friendliness of play and the comfort of the user.

4 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with one embodiment of the present invention. Compared to Figure 1, Figure 4 adds

steps

102, 104, 105, 106, 107.

Step 102 in FIG. 4 is the same as step 102 in FIG.

In step 104, the elements in the picture captured by the live screenshot are identified.

An element refers to a complete object represented in the picture. For example, an apple, a school bag.

In one way, you can first find the color patches in the picture. A color block is a block in which pixels of an approximate color in a picture are aggregated. It can compare whether the (R, G, B) value of the pixel and surrounding pixels is less than a threshold, for example (10, 10, 10), for example for any pixel in the picture. If less than the threshold, the surrounding pixels are aggregated with the pixel. Then, whether the (R, G, B) values of the surrounding pixels and surrounding pixels of the surrounding pixels are compared is less than a threshold. By analogy, the entire picture is divided into color blocks. Then, take the picture The graphics formed by the boundaries of the various color blocks are matched with the graphics in a preset graphics library. The graphics library stores various pre-set graphics and corresponding element names, such as Apple's image and Apple's name. In this way, by matching the graphics composed of the boundaries of the color patches in the picture with the graphics in the graphics library, the elements in the picture intercepted by the real-time screenshot are identified. The graphics of the graphics library may be pre-stored by an expert, or may be adaptively obtained by training a model using a large number of image samples by a self-learning method.

If two elements in the image that have an inclusion relationship with each other can find a match in the graphics library, the larger one is used as the identified element. For example, for a hat with a moon, both the moon and the hat with the moon can find a match in the graphics library, then the hat with the moon should be considered an element.

It should be understood that the elements in the picture captured by the real-time screenshot may also be identified by other means, which fall within the scope of the present invention.

In step 105, based on the identified elements, a picture with the identified elements and related comments are searched on the Internet.

For example, identify a hat with a moon and then search the Internet for pictures and related comments with a hat with a moon.

In step 106, a correspondence of the related comment to the identified element is determined.

For example, identify a hat with a moon. I searched the Internet for a picture with a hat with a moon, but there is a child on the picture, and some of the comments in the picture are about children (currently, semantic analysis techniques can be used to identify which part of the picture the comment is about. The comments are considered to correspond to the identified elements.

In step 107, elements that search for the most relevant related comments on the Internet are highlighted on the playback object.

For example, in the picture, the hat and the table with the moon are identified. On the Internet, there are 108 corresponding related comments on the hat with the moon. The table has 16 corresponding related comments, which are highlighted on the playback object. Show the hat with the moon.

The manner in which the elements of the related comment that are most searched for on the Internet are highlighted on the playback object may be a frame superimposed on the element, or a layer of light may be superimposed on the element, or a person skilled in the art may think of Other highlighted parties They all fall within the scope of the present invention.

The effect of the embodiment of FIG. 4 is that it can combine the degree of discussion on the elements of the screenshot of the playback object on the Internet, find out the hottest elements and highlight them, thereby concentrating the user's limited energy on the entire picture. Elements that allow users to get more information when watching.

FIG. 5 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared to Figure 1, Figure 5 adds

steps

102, 104, 108, 109.

Steps

102, 104 in Figure 5 are the same as

steps

102, 104 in Figure 4.

In step 108, the emotional color of the picture is determined based on the identified elements.

For example, when a hi word is recognized, the emotional color represented is cheerful. When the identification is a hospital ward, the emotional color of the representative is sad.

In one mode, an emotional color score database can be set up on the server of the barrage website to pre-store various possible identified elements and corresponding emotional color scores. The emotional color represented by the elements is cheerful, and the emotional color score is positive. The more cheerful the emotional color, the more positive the emotional color score. The emotional color represented by the element is sad, and the emotional color score is negative. The more sad the emotional color, the more negative the emotional color score. When an element does not represent cheerfulness or grief, the corresponding emotional color score cannot be found in the emotional color score database. If there is only one element in the picture that has a corresponding emotional color score in the emotional color score database, the emotional color score is used as the emotional color score of the entire picture. If there are multiple elements in the picture that have corresponding emotional color scores in the emotional color score database, the average of the emotional color scores corresponding to the multiple elements is taken as the emotional color score of the picture.

It should be understood that there may be other ways of determining the emotional color of the picture based on the identified elements, all of which fall within the scope of the present invention.

In step 109, based on the determined emotional color of the picture, the playback speed of the barrage text is determined.

For example, in the server of the barrage website, a correspondence table of the emotional color score of the picture and the playback speed of the barrage text is stored. In this way, it can be judged by means of table lookup The emotional color of the picture is determined, and the playing speed of the barrage text is determined.

It should be understood that there may be other ways of determining the playback speed of the barrage text based on the determined emotional color of the picture, which are all within the scope of the present invention.

In addition, step 130 includes: determining the playing speed and playing the barrage text.

The effect of the embodiment of Fig. 5 is to play the barrage text at a playback speed corresponding to the emotional color of the picture. When the whole picture is more cheerful, the faster the barrage text is played. When the whole picture is sad, the playback speed of the barrage text is slower. This is very consistent with the look and feel of the user when viewing the object, which can greatly improve the user's viewing comfort.

6 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared to Figure 1, Figure 6 adds steps 140,150.

In step 140, in response to the first operation of the played barrage text, the playback of the barrage text is stopped, displaying a functional area containing at least one of the following functions: like, comment, forward.

When the user views the playback object on the desktop computer, the first operation, for example, hovering over the played barrage text with the mouse. When the user views the play object on the mobile phone, the first operation such as the user's gesture hovering over the played barrage text. When the user watches the television program on the television, the first operation, such as the user's gesture, hovers over the barrage text played on the mobile phone bound to the television.

Of course, there are other ways of the first operation, for example, the first operation may be a barrage text that is clicked with a mouse, double-clicked, or right-clicked.

The meaning of stopping the play of the barrage text is that the other barrage text being played disappears on the screen or the playback object, and the barrage text for the first operation is still. For the barrage text that disappears on the screen or the playback object, the current user can resume playing on the screen or the playback object after the current user completes the like, comment or forwarding, or can no longer play.

The function of stopping the playing of the barrage text is to make the user feel like a like, comment or forward operation, and improve the user's experience of like, comment or forward.

A function area including at least one of a favorite, a comment, and a forwarding function may be displayed next to the barrage text for which the first operation is directed, or may be displayed at a specified position of the screen or the playback object.

At step 150, processing corresponding to the function is performed in response to a second operation on the function in the functional area.

When the user views the play object on the desktop computer, the second operation is, for example, clicking with a mouse, double clicking, or right clicking on the position of the corresponding function in the function area. When the user views the play object on the mobile phone, the second operation, such as the user touching the location of the corresponding function in the functional area. When the user watches the television program on the television, a second operation, such as the user touching the location of the corresponding function in the functional area on the handset bound to the television.

The second operation may also be other specified operations than those described above, and they all fall within the scope of the present invention.

When the function for the second operation is a compliment, the processing corresponding to the function is to praise the barrage text. That is, add 1 to the number of likes displayed next to the Like feature. If the user wants to see which users have liked the barrage text and triggered (such as click, double click, right click) to display the number of likes, the user name that is praised for the barrage text is displayed on the screen. And / or avatar.

When the function for the second operation is a comment, the processing corresponding to the function is to display a comment input box on the screen. After receiving the comment entered by the user in the comment input box, add 1 to the number of comments next to the comment function. If the user wants to view the specific content of the comment or who has added a comment to the barrage text, triggering (eg, clicking, double clicking, right clicking) the number of comments displayed, then displaying the comment on the screen text on the screen User name and/or avatar, and user's comments.

When the function for the second operation is forwarding, the corresponding processing is to generate a new barrage text for the current user, the content of which is the barrage text for the second operation plus a forwarding tag. Of course, you can also display a prompt box to prompt the user to enter a comment while forwarding. If the user chooses to enter a comment while forwarding, a new barrage text is generated for the current user, the content of which is the comment entered by the user plus the barrage text targeted for forwarding.

When playing the barrage text, the user name and/or avatar of the barrage text is displayed in front of the barrage text. The user can also trigger (eg, click, double-click, right-click) the username and/or avatar, and then display to the user an interface that privately chats with the user of the username and/or avatar, through This interface can be private chat.

The effect of the embodiment of FIG. 6 is that the embodiment provides a pair of barrage text compared to the prior art barrage video which can only publish the barrage text itself or view the barrage text and cannot complete the barrage interaction. The possibility of interaction increases the incentives for users.

7 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared to Figure 6, Figure 7 adds step 151.

In step 151, after the processing corresponding to the function is performed, the display style of the barrage text for which the first operation is directed is changed.

The display style of the barrage text for which the first operation is changed may be to increase the font of the barrage text for which the first operation is directed. Thus, when more and more people like, praise, or forward a certain barrage text, the font of the barrage text becomes larger and larger, making it easier for users to notice the barrage text.

The display style of the barrage text for which the first operation is changed may also be to increase the brightness of the barrage text for the first operation. In this way, when more and more people praise, comment or forward a certain barrage text, the barrage text becomes more and more bright, and it can also achieve the effect of attracting users to pay attention to the barrage text.

The effect of the embodiment of FIG. 7 is that when the number of people who like, comment, or forward a certain barrage text is increasing, the font of the barrage text is getting larger or larger, and thus the user can Pay more attention to the barrage text that other people are more concerned about. These barrage words are often more valuable, making it easier for users to get the most effective information in a short period of time.

8 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with another embodiment of the present invention. Compared to Figure 1, Figure 8 adds

steps

102, 104, 160, 170, 180.

In step 102, a real-time screenshot of the object is performed.

Steps

102, 104 in Figure 8 are identical to

steps

102, 104 in Figure 5.

In step 160, the barrage text published by the current user is received.

For example, a barred text publishing area is provided on the lower portion of the screen or the playback object (for example, below the background area of the barrage). The user can post a barrage in the bulletin text publishing area. Text.

The bullet text publishing area can also be set on the screen or other location of the playback object, such as the upper part of the screen or the playback object.

In step 170, an element in the picture related to the barrage text published by the current user is identified.

Use the existing word segmentation technology to segment the user's published barrage text. Since each element and element name in the picture has been identified in step 104, the divided words are respectively matched with the element names of the respective elements in the recognized picture. If it matches, the element corresponding to the element name is considered to be related to the barrage text published by the current user.

In step 180, the barrage text published by the current user is played on the play object, wherein the barrage text published by the current user appears from the position of the element related to the barrage text published by the current user, and enters the play along a specific track. The background area of the barrage superimposed on the object is played.

The specific trajectory is, for example, a serpentine shape, a star-shaped trajectory This particular trajectory can be implemented by the user.

For example, the current user's barrage text is "This bear is so cute!". In the picture obtained from the screenshot, the bear is identified, and the barrage text "This bear is so cute!" appears from the bear on the playback object, along a serpentine track into the bar-shaped background area of the bar at the bottom of the object. Medium, then play from right to left in the background area of the barrage.

The effect of the embodiment of FIG. 8 is that the barrage text published by the current user appears from the element to which the barrage text is directed, and enters the background area of the barrage superimposed on the object to be played along a specific track, so that the current user's bullet is played. The corresponding relationship between the screen text and the elements it targets on the screen is clearly displayed, enhancing the user experience. In addition, the shape of the play track of the current user's own published barrage text is distinguished from the track play shape of the barrage text published by other users, so that the current user can clearly distinguish which are the published barrage texts and which are other users. Published barrage text.

9 is a flow chart of a method of generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared to Figure 1, Figure 9 adds

steps

102, 104, 105, 106, 156, 158.

Steps

102, 104, 105, 106 in Figure 9 are identical to

steps

102, 104, 105, 106 in Figure 4.

In step 156, in response to the current user's third operation of the particular location of the playback object, the element to which the particular location belongs is determined.

When the foregoing first operation is, for example, hovering over the played barr text with the mouse, the user's gesture hovering over the played barrage text, etc., the third operation may be a mouse click, a double click, or a right click play. The specific location of the object. When the foregoing first operation is, for example, a mouse click, a double tap, or a right click on a specific position of the playback object, the third operation may be, for example, hovering over the played barr text with the mouse, and the user's gesture hovering over the play. The barrage text is equal. The third operation generally adopts a different method from the first operation, because if the same method is used, it is difficult to recognize whether the user wants to like, comment or forward the played barrage text, or want to see about the What are the relevant comments on the elemental internet.

Since the boundaries of the elements and elements have been identified in step 104, it can be determined which element the particular location for which the third operation is directed belongs. When the specific location falls within the boundary of the plurality of elements, the element having the largest area of the specific location within the boundary of the plurality of elements may be determined as the element to which the specific location belongs.

In step 158, based on the determined element, the related user corresponding to the element searched on the Internet is displayed to the current user.

These related comments are displayed, for example, in a prompt box that appears on the screen or on the playback object. The prompt box may also prompt the user to enter a comment to be published, that is, a barrage text. In this way, users can be able to publish the words of the barrage while watching the comments on the Internet that have been published on an element.

That is to say, the publication of the barrage text can be performed either through the bullet-screen text publishing area of the screen or the playback object, or by the third operation of the specific position of the playback object, and the latter can be seen on the Internet for a certain The elements have been published in the comments, and the published barrage text is more targeted.

The effect of the embodiment of Fig. 9 is to enable the user to publish the barrage text while looking at the comments on the Internet that have been published for an element, and to more specifically publish the barrage text to improve user friendliness.

10 is a flow chart of a method of generating a barrage superimposed on a play object, in accordance with another embodiment of the present invention. Compared to Figure 1, Figure 10 adds

steps

1001, 1002.

Prior art barrage can only be published for pictures or videos. The user visits a web page with a picture or video, and the web server of the web page sends the terminal ID (and possibly the login account name) along with the web page address, the picture or video name to the server of the barrage website for the barrage website. The server that makes the layer with the barrage and sends it back to the webpage server superimposes the layer on the image or video for the user to watch. The prior art barrage cannot be directed to a television program because the user lacks an operational interface to the television set and does not know the address of the television station server.

The present invention can be used to publish a barrage for a television program.

In step 1001, a server address or a two-dimensional code of the television program is displayed in the television program, and the two-dimensional code includes a server address where the television program is located and a television program name.

The server address is displayed, for example, at the top of the television program, and the two-dimensional code is displayed, for example, in the lower right corner of the television program, but may be other locations.

In step 1002, receiving a server address and a television program name of the television program transmitted by the user through the mobile device, or sending the scanned two-dimensional code, binding the identification number of the mobile device to the television program of the server address, thereby The barrage-related operations for the television program are performed by the mobile device.

In one approach, after the user sees the server address displayed on the television program, the user can access the server address on their mobile device and enter the television program name they are watching. Since the mobile device accesses the server of the television station, the server of the television station knows the ID of the mobile device. The television station's server will bind the mobile device's ID to the television program on the television station server. The meaning of the binding is that the barrage-related operations for the television program are performed by the mobile device. For example, the first operation and the second operation used for the praise, comment, and forwarding of the barrage texts published by other users, and the third operation used when the barrage text is published for a specific element, the default is Performed by the mobile device. At this time, when the user performs the third operation on the specific location, for example, on the mobile device, the television station server reports the third operation of the specific location to the server of the barrage website. Moreover, since the mobile device accesses the server of the television station, the server of the television station The mobile device ID (and possibly the login account name), the TV station server address it visits, and the TV program name are also sent to the server of the barrage website. After the current user has published the barrage text, the barrage web server will know which mobile device ID user (which user who logged in to the account name) has published a barrage, and the user's mobile device ID (or login account name) together Published.

In another mode, after the user sees the two-dimensional code displayed on the television program, the user can scan the two-dimensional code with his mobile device. Since the two-dimensional code includes the server address and the TV program name where the television program is located, the result of scanning the two-dimensional code is that the user automatically logs in to the server of the television station. In this way, the server of the television station will know the ID of the mobile device. The television station's server will bind the ID of the mobile device to the television program being played on the television station server.

The effect of the embodiment of Fig. 10 is to enable the mobile device to be bound to the television program of the television station server by transmitting the server address or the two-dimensional code of the television program, thereby realizing the television program with the barrage.

Figure 11 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object, in accordance with one embodiment of the present invention. The device 2 includes: a unit 210 for receiving a barrage text published by a user other than the current user (hereinafter referred to as a “first receiving unit”); and determining, according to the friend information in the login account information of the current user, whether the other user is the current user. a unit 220 of a friend (hereinafter referred to as "first judgment unit"); a unit 230 (hereinafter referred to as "first play unit") that plays the barred text on the play object is configured to: if the other user is not the current user a friend playing the barrage text on the play object in the shape of the first play track; if the other user is a friend of the current user, playing the barrage text on the play object in a shape different from the shape of the second play track of the first play track shape .

The first receiving unit 210 receives the barrage texts published by other users than the current user.

The current user refers to a user who currently browses a server with a playback object (such as a web server with video) and sends its terminal ID to the server of the barrage website by the server with the playback object. At present, the current user does not publish the barrage text, so the server of the barrage website only receives its terminal ID through the server with the playback object, And the server address and play object name that it browses. For other users (ie, other users) who have published the barrage text for the playback object of the server, the server of the barrage website receives its terminal ID and the published barrage text.

The first determining unit 220 determines, according to the friend information in the login account information of the current user, whether the other user is a friend of the current user.

The first playing unit 230 plays the barrage text on the playing object, wherein if the other user is not the current user's friend, the first playing track shape is broadcasted on the playing object. The screen text is played; if the other user is a friend of the current user, the barrage text is played on the play object in a shape of the second play track different from the shape of the first play track.

The effect achieved by the embodiment of FIG. 11 is that since the pop-up text published by the non-friend user of the current user and the friend user of the current user follows the shape of different play tracks in the current user, the current user can see at a glance To the barrage published by friends, these barrages may be more of a concern for current users.

Figure 12 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object, in accordance with one embodiment of the present invention.

Compared with FIG. 11, the embodiment of FIG. 12 further adds a unit 221 (hereinafter referred to as "second judging unit") for judging whether the barrage text published by the other user is related to an Internet burst topic or a hot event.

Internet emergent topics refer to topics that have been hotly debated on the Internet recently, such as subway price increases. Or the house is restricted to release. Hot events refer to recent events on the Internet that are of concern to everyone, such as the Xiamen bombings. If the barred texts published by the other users are related to the reasons and latest developments of the Xiamen bombings, the barred texts published by the other users are considered to be related to Internet emergent topics or popular events.

Of course, there are other ways to judge whether the barred texts published by other users are related to Internet emergent topics or hot events, and they are all included in the scope of protection of the present invention.

In addition, the first playing unit 230 is configured to play on the playing object with the third playing track shape different from the shape of the first playing track if the barrage text published by the other user is related to the Internet sudden topic or the popular event. Barrage text.

The third play track shape may be the same shape as the second play track. Such as barrage text Appears from the center of the screen or the playback object, scatters to the surrounding diffused shape, and disappears on the screen or the edge of the playback object, or the barrage text appears from the top of the screen or the playback object, and drops to the screen or the center of the playback object disappears.

If the barrage text published by the other user is not related to the Internet sudden topic or the popular event, if the other user is not the current user's friend, the barrage text is played on the playing object in the shape of the first playing track, if the other The user is a friend of the current user, and the barrage text is played on the play object in a shape of the second play track different from the shape of the first play track.

The effect of the embodiment of FIG. 12 is to enable the current user's attention to quickly lock the barrage text associated with the Internet sudden topic or the hot event on the screen or the playback object, so that the current user can quickly obtain the most useful information.

Figure 13 is a flow diagram of an apparatus 2 for generating a barrage superimposed on a playback object, in accordance with one embodiment of the present invention. Compared with FIG. 11 , FIG. 13 adds a unit 202 (hereinafter referred to as “screening unit”) that performs real-time screenshot of the object, and a unit 203 that analyzes the main color in the picture captured by the real-time screenshot (hereinafter referred to as “analysis unit”). ).

The screenshot unit 202 performs a real-time screenshot of the playback object.

The analyzing unit 203 analyzes the main colors in the pictures cut in the real-time screenshot.

It can be considered that the color of each pixel in the picture is composed of three color elements of red (R), green (G), and blue (B), and the color value can be represented by three values of (R, G, B). R represents the red color value of the pixel, G represents the green color value of the pixel, and B represents the blue color value of the pixel. The range of R, G, and B is a positive integer between 0 and 255. R, G, B are all 0, then The color of the pixel is pure white. R, G, and B are both 255, and the color of the pixel is pure black.

In another way, considering that it is meaningless to distinguish between two very similar (R, G, B) values, for example (45, 136, 37) and (46, 137, 37) colors may be similar, so first all The R, G, and B values of the (R, G, B) values of the pixels are rounded to the tenth position. Then, which of the (R, G, B) values after rounding is the most common in all pixels, the (R, G, B) value is considered to be the dominant color in the picture.

In addition, the first playing unit 230 is configured to play the barrage text in the background area of the barrage superimposed on the playing object, wherein the color of the background area of the barrage is set to the first color obtained based on the main color, and the color setting of the barrage text The second color is based on the dominant color.

The first color obtained based on the main color is, for example, a color obtained by increasing or decreasing n values on the basis of R, G, and B of the main color. For example, the main color is (145, 18, 78), and 10 values are subtracted from the R, G, and B of the main color to obtain the first color (135, 8, 68) as the background area of the barrage. colour. Generally, n should not be too big or too small. Due to the visual characteristics of the human eye, when the superimposed background area of the barrage is substantially the same as the main color of the picture, the comfort of the human eye is the highest, so n should not be too large. In addition, if n is too small, the background area and the main color of the picture are indistinguishable. In practice, n is 10 is preferred. The way to ensure the comfort of the human eye is to avoid confusion with the content of the picture.

The effect of the embodiment of Fig. 13 is that it makes the playback of the barrage better adapted to the viewing habits of the user, improving the friendliness of play and the comfort of the user.

Figure 14 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object, in accordance with one embodiment of the present invention. Compared with FIG. 11 , FIG. 14 adds a unit 202 (hereinafter referred to as “screening unit”) that performs real-time screenshots on the object, and a unit 204 that identifies elements in the picture captured by the real-time screenshot (hereinafter referred to as “the first identification unit”. a unit 205 (hereinafter referred to as "search unit") that searches for pictures and related comments having the identified elements on the Internet based on the identified elements, and determines correspondence between the related comments and the identified elements. The unit 206 (hereinafter referred to as "third judgment unit") highlights a unit 207 (hereinafter referred to as "highlighting unit") that searches for an element of the most relevant related comment on the Internet on the playback object.

The screenshot unit 202 in FIG. 14 is the same as the screenshot unit 202 in FIG.

The first identification unit 204 identifies the elements in the picture intercepted by the live screenshot.

In one way, you can first find the color patches in the picture. A color block is a block in which pixels of an approximate color in a picture are aggregated. It can compare whether the (R, G, B) value of the pixel and surrounding pixels is less than a threshold, for example (10, 10, 10), for example for any pixel in the picture. If less than the threshold, the surrounding pixels are aggregated with the pixel. Then compare the surrounding pixels with the surrounding pixels of the surrounding pixels (R, G, B) Whether the value is less than the threshold. By analogy, the entire picture is divided into color blocks. Then, the graphics composed of the boundaries of the patches in the picture are matched with the graphics in a preset graphics library. The graphics library stores various pre-set graphics and corresponding element names, such as Apple's image and Apple's name. In this way, by matching the graphics composed of the boundaries of the color patches in the picture with the graphics in the graphics library, the elements in the picture intercepted by the real-time screenshot are identified. The graphics of the graphics library may be pre-stored by an expert, or may be adaptively obtained by training a model using a large number of image samples by a self-learning method.

The search unit 205 searches the Internet for pictures and related comments having the identified elements based on the identified elements.

The third determining unit 206 determines the correspondence between the related comment and the identified element.

The highlighting unit 207 highlights an element on the play object that searches for the most relevant related comment on the Internet.

Highlight the most relevant comments found on the Internet on the playback object The elements may be arranged by superimposing a frame around the elements, or by superimposing a layer of light on the elements, or other highlighting methods that can be conceived by those skilled in the art, which fall within the scope of the present invention. within.

The effect of the embodiment of FIG. 14 is that it can combine the degree of discussion on the elements of the screenshot of the playback object on the Internet, find the hottest elements and highlight them, thereby concentrating the user's limited energy on the entire picture. Elements that allow users to get more information when watching.

Figure 15 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared with FIG. 11 , FIG. 15 adds a unit 202 (hereinafter referred to as “screening unit”) that performs real-time screenshots on the object, and a unit 204 that identifies elements in the picture captured by the real-time screenshot (hereinafter referred to as “the first identification unit”. a unit 208 (hereinafter referred to as a "fourth determining unit") that determines the emotional color of the picture based on the identified element, and a unit 209 that determines the playing speed of the barrage text based on the determined emotional color of the picture ( Hereinafter referred to as "first determining unit").

The screenshot unit 202 and the first identification unit 204 in FIG. 15 are the same as the screenshot unit 202 and the first identification unit 204 in FIG.

The fourth determining unit 208 determines the emotional color of the picture based on the identified element.

In one mode, an emotional color score database can be set up on the server of the barrage website to pre-store various possible identified elements and corresponding emotional color scores. The emotional color represented by the elements is cheerful, and the emotional color score is positive. The more cheerful the emotional color, the more positive the emotional color score. The emotional color represented by the element is sad, and the emotional color score is negative. The more sad the emotional color, the more negative the emotional color score. When an element does not represent cheerfulness or grief, the corresponding emotional color score cannot be found in the emotional color score database. If there is only one element in the picture that has a corresponding emotional color score in the emotional color score database, the emotional color score is used as the emotional color score of the entire picture. If there are multiple elements in the image that have corresponding emotional color scores in the emotional color score database, the average of the emotional color scores corresponding to the multiple elements is taken as the emotional relationship of the image. Color score.

The first determining unit 209 determines the playback speed of the barrage text based on the determined emotional color of the picture.

For example, in the server of the barrage website, a correspondence table of the emotional color score of the picture and the playback speed of the barrage text is stored. In this way, the playback speed of the barrage text can be determined based on the determined emotional color of the picture by means of a table lookup.

In addition, the first playing unit 230 is configured to: play the barrage text at the determined playing speed.

The effect of the embodiment of Fig. 15 is to play the barrage text at a playback speed corresponding to the emotional color of the picture. When the whole picture is more cheerful, the faster the barrage text is played. When the whole picture is sad, the playback speed of the barrage text is slower. This is very consistent with the look and feel of the user when viewing the object, which can greatly improve the user's viewing comfort.

Figure 16 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared with FIG. 11, FIG. 16 adds a unit 240 for stopping the playing of the barrage text in response to the first operation of the played barrage text, displaying a functional area containing at least one of the like, comment, and forwarding functions ( Hereinafter, the "first display unit" and a unit 250 (hereinafter referred to as "execution unit") that performs processing corresponding to the function in response to the second operation of the function in the function area.

The first display unit 240 stops playing the barrage text in response to the first operation of the played barrage text, and displays a functional area including at least one of the following functions: like, comment, and forward.

When the user views the playback object on the desktop computer, the first operation, for example, hovering over the played barrage text with the mouse. When the user views the play object on the mobile phone, the first operation such as the user's gesture hovering over the played barrage text. When the user watches the television program on the television, the first operation, such as the user's gesture hovering on the mobile phone bound to the television, is played. On the screen text.

The execution unit 250 performs processing corresponding to the function in response to the second operation of the function in the function area.

When the function for the second operation is a comment, the processing corresponding to the function is to display a comment input box on the screen. After receiving the comment entered by the user in the comment input box, add 1 to the number of comments next to the comment function. If the user wants to see the specific content of the comment or who Adding a comment to the barrage text, triggering (for example, clicking, double-clicking, right-clicking) the number of comments displayed, then displaying the user name and/or avatar for the title of the barrage text, and the user's comment on the screen. .

When playing the barrage text, the user name and/or avatar of the barrage text is displayed in front of the barrage text. The user can also trigger (eg, click, double click, right click) the username and/or avatar, and then display to the user an interface that is privately chatted with the user of the username and/or avatar through which the private chat can be made.

The effect of the embodiment of FIG. 16 is that the embodiment provides a pair of barrage text compared to the prior art barrage video which can only publish the barrage text itself or view the barrage text and cannot complete the barrage interaction. The possibility of interaction increases the incentives for users.

Figure 17 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared with FIG. 16, FIG. 17 adds a unit 251 (hereinafter referred to as "change unit") which changes the display style of the barrage text for the first operation after the processing corresponding to the function is executed.

The effect of the embodiment of Figure 17 is that when a certain barrage text is liked, commented or forwarded When the number of people is increasing, the font of the barrage text is getting bigger or brighter, so that users can pay more attention to the barrage words that other people are more concerned about. These barrage words are often more valuable. To make it easier for users to get the most effective information in a short time.

Figure 18 is a flow diagram of an apparatus 2 for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared with FIG. 11 , FIG. 18 adds a unit 202 (hereinafter referred to as “screening unit”) that performs real-time screenshots on the object, and a unit 204 that identifies elements in the picture captured by the real-time screenshot (hereinafter referred to as “the first identification unit”. ”, a unit 260 (hereinafter referred to as “second receiving unit”) that receives the barrage text published by the current user, and a unit 270 that identifies an element related to the barrage text published by the current user in the picture (hereinafter referred to as “the second”) The identification unit "), the unit 280 (hereinafter referred to as "second playback unit") that plays the barred text of the current user on the playback object

The screenshot unit 202 and the first identification unit 204 in FIG. 18 are consistent with the screenshot unit 202 and the first identification unit 204 in FIG.

The second receiving unit 260 receives the barrage text published by the current user.

For example, a barred text publishing area is provided on the lower portion of the screen or the playback object (for example, below the background area of the barrage). The user can post the barrage text in the bulletin text publishing area.

The second identification unit 270 identifies an element in the picture that is related to the barrage text published by the current user.

The second playing unit 280 plays the barrage text published by the current user on the playing object, wherein the barrage text published by the current user appears from the position of the element related to the barrage text published by the current user, and enters the playing along the specific track. The background area of the barrage superimposed on the object is played.

The effect of the embodiment of FIG. 18 is that the current user-published barrage text appears from the element to which the barrage text is directed, and enters the background area of the barrage superimposed on the object to be played along a specific track, so that the current user's bullet is played. The corresponding relationship between the screen text and the elements it targets on the screen is clearly displayed, enhancing the user experience. In addition, the shape of the play track of the current user's own published barrage text is distinguished from the track play shape of the barrage text published by other users, so that the current user can clearly distinguish which are the published barrage texts and which are other users. Published barrage text.

Figure 19 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared with FIG. 11 , FIG. 19 adds a unit 202 (hereinafter referred to as “screening unit”) that performs real-time screenshots on the object, and a unit 204 that identifies elements in the picture captured by the real-time screenshot (hereinafter referred to as “the first identification unit”. a unit 205 (hereinafter referred to as "search unit") that searches for pictures and related comments having the identified elements on the Internet, and determines the correspondence between the related comments and the identified elements. The unit 206 (hereinafter referred to as "the third determining unit"), in response to the current user's third operation on the specific position of the playing object, finds the unit 256 of the element to which the specific position belongs (hereinafter referred to as "the second determining unit") And displaying, by the found element, the unit 258 (hereinafter referred to as “second display unit”) of the related comment corresponding to the element searched on the Internet to the current user.

The screenshot unit 202, the first identification unit 204, the search unit 205, and the third determination unit 206 in FIG. 19 are consistent with the screenshot unit 202, the first identification unit 204, the search unit 205, and the third determination unit 206 in FIG. .

The second determining unit 256 determines an element to which the specific location belongs in response to the current user's third operation on the specific location of the playback object.

Since the boundaries of the elements and elements have been identified, it is possible to determine which element the particular location for which the third operation is directed belongs. When the specific location falls within the boundary of the plurality of elements, the element having the largest area of the specific location within the boundary of the plurality of elements may be determined as the element to which the specific location belongs.

The second display unit 258 displays the related comment corresponding to the element searched on the Internet to the current user according to the determined element.

The effect of the embodiment of Fig. 19 is to enable the user to publish the barrage text while looking at the comments on the Internet that have been published for an element, and to more specifically publish the barrage text to improve user friendliness.

Figure 20 is a block diagram of an apparatus 2 for generating a barrage superimposed on a playback object in accordance with another embodiment of the present invention. Compared with FIG. 11, FIG. 20 adds a unit 2001 (hereinafter referred to as "third display unit") for displaying a server address or a two-dimensional code of a television program in a television program, and a server address of a television program transmitted by a user through a mobile device. And electricity A unit 2002 (hereinafter referred to as "third receiving unit") that views the program name or the scanned two-dimensional code.

The third display unit 2001 displays the server address or the two-dimensional code of the television program in the television program, and the two-dimensional code includes the server address where the television program is located and the television program name.

The third receiving unit 2002 receives the server address and the TV program name of the television program transmitted by the user through the mobile device, or the scanned two-dimensional code, and binds the identification number of the mobile device to the television program of the server address, thereby The barrage-related operations for the television program are performed by the mobile device.

The effect of the embodiment of Fig. 20 is to enable the mobile device to be bound to the television program of the television station server by transmitting the server address or the two-dimensional code of the television program, thereby realizing the television program with the barrage.

Those skilled in the art will recognize that the present invention can be implemented as a device, apparatus, method, or computer program product. Therefore, the present disclosure may be embodied in the following forms, that is, it may be complete hardware, full software, or a combination of hardware and software.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the invention. In this regard, each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or operation. Or it can be implemented by a combination of dedicated hardware and computer instructions.

It is apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, and the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the invention is defined by the appended claims instead All changes in the meaning and scope of equivalent elements are included in the present invention. Any reference signs in the claims should not be construed as limiting the claim.

While the invention has been shown and described with reference to the embodiments of the embodiments of the invention The protection sought herein is set forth in the appended claims. These and other aspects of various embodiments are set forth in the following numbering clauses:

A method (1) for generating a barrage superimposed on a playback object, comprising:

Receiving a barrage text (110) issued by a user other than the current user;

Determining, according to the friend information in the login account information of the current user, whether the other user is a friend of the current user (120);

Playing the barrage text (130) on the play object, wherein if the other user is not the current user's friend, playing the barrage text on the play object in the shape of the first play track; if the other user is the current user's friend, The barrage text is played on the playback object in a second play track shape different from the shape of the first play track.

2. According to the method (1) of Clause 1, further comprising:

Determining whether the barrage text published by the other user is related to an Internet sudden topic or a hot event (121), and

The step of playing the barrage text (130) on the play object includes: if the barrage text published by the other user is related to an Internet burst topic or a popular event, the shape of the third play track different from the shape of the first play track is Play the barrage text on the playback object.

3. According to the method (1) of Clause 1, further comprising:

Performing a real-time screenshot of the object (102);

Analyze the primary color (103) in the captured image of the live screenshot, and

The step of playing the barrage text (130) on the playing object includes playing the barrage text in the background area of the barrage superimposed on the playing object, wherein the color of the background area of the barrage is set to the first color obtained based on the main color, the barrage The color of the text is set to the second color based on the main color.

4. According to the method (1) of Clause 1, further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Searching for pictures and related comments having the identified elements on the Internet based on the identified elements (105);

Determining a correspondence of the related comment to the identified element (106);

An element (107) that searches for the most relevant related comment on the Internet is highlighted on the play object.

5. According to the method (1) of Clause 1, further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Determining the emotional color of the picture according to the identified element (108);

Determining the playing speed of the barrage text based on the determined emotional color of the picture (109), and

The step of playing the barrage text (130) on the playback object includes: determining the playback speed and playing the barrage text.

6. According to the method (1) of clause 1, further comprising:

In response to the first operation of the played barrage text, the playback of the barrage text is stopped, displaying a functional area containing at least one of the following functions: like, comment, forward (140).

In response to the second operation of the function in the functional area, processing corresponding to the function is performed (150).

7. The method (1) according to clause 6, further comprising:

After the processing corresponding to the function is performed, the display style of the barrage text for the first operation is changed (151).

8. According to the method (1) of clause 1, further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Receiving the barrage text (160) published by the current user;

Identifying an element (170) in the picture related to the barrage text published by the current user;

Playing the barrage text (180) published by the current user on the playing object, wherein the barrage text published by the current user appears from the position of the element related to the barrage text published by the current user, and enters the playing object along a specific track. The superimposed barrage background area is played.

9. According to the method (1) of clause 1, further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Determining an element to which the specific location belongs in response to the current user's third operation on the specific location of the playback object (156);

Based on the determined element, the relevant user is searched for the relevant comment (158) corresponding to the element searched on the Internet.

10. The method (1) of clause 1, wherein the play object comprises a television program, and if the play object is a television program, the method further comprises:

Displaying, in the television program, a server address or a two-dimensional code of the television program, where the two-dimensional code includes a server address where the television program is located and a television program name (1001);

Receiving a server address and a television program name of the television program sent by the user through the mobile device, or sending the scanned two-dimensional code, binding the identification number of the mobile device to the television program of the server address, thereby targeting the television program The operation related to the barrage is performed by the mobile device (1002).

11. A device (2) for generating a barrage superimposed on a playback object, comprising:

Receiving a unit (210) of the barrage text published by a user other than the current user;

Determining, according to the friend information in the login account information of the current user, whether the other user is a friend of the current user (220);

The unit (230) for playing the barr text on the play object is configured to: if the other user is not the current user's friend, play the barrage text on the play object in the shape of the first play track; if the other user is The current user's friend plays the barrage text on the play object in a shape of the second play track different from the shape of the first play track.

12. The device (2) according to clause 11, further comprising:

Determining whether the barred text published by the other user is related to an Internet sudden topic or a hot event (221), and

The unit (230) for playing the barrage text on the play object is configured to: if the barrage text published by the other user is related to an Internet burst topic or a popular event, a third play track different from the shape of the first play track The shape plays the barrage text on the playback object.

13. The device (2) according to clause 11, further comprising:

a unit for real-time screenshot of the object (202);

A unit (203) of the dominant color in the picture captured in the real-time screenshot is analyzed, and

The unit (230) for playing the barrage text on the playback object is configured to: play the barrage text in the background area of the barrage superimposed on the playback object, wherein the color of the background area of the barrage is set to the first color obtained based on the main color The color of the barrage text is set to a second color based on the main color.

14. The device (2) according to clause 11, further comprising:

a unit for real-time screenshot of the object (202);

Identifying elements of elements in the picture captured by the real-time screenshot (204);

Searching for a unit having a picture of the identified element and related comments on the Internet based on the identified element (205);

a unit (206) for determining a correspondence of the related comment to the identified element;

A unit (207) that searches for elements of the most relevant related comment on the Internet is highlighted on the play object.

15. Apparatus (2) according to clause 11, further comprising:

a unit for real-time screenshot of the object (202);

Determining a unit of emotional color of the picture based on the identified element (208);

Determining a unit (209) of the playing speed of the barrage text based on the determined emotional color of the picture, and

The unit (230) for playing the barrage text on the playback object is configured to: determine the playback speed, and play the barrage text.

16. The device (2) according to clause 11, further comprising:

In response to the first operation of the played barrage text, the playback of the barrage text is stopped, displaying a unit (240) of the functional area containing at least one of the following functions: like, comment, forward.

In response to a second operation on a function in the functional area, a unit (250) that performs processing corresponding to the function is performed.

17. The device (2) according to clause 16, further comprising:

After the processing corresponding to the function is performed, the unit (251) of the display style of the barrage text for the first operation is changed.

18. The device (2) according to clause 11, further comprising:

a unit for real-time screenshot of the object (202);

Receiving a unit (260) of the barrage text published by the current user;

Identifying, in the picture, a unit (270) of an element related to the barrage text published by the current user;

Playing a unit (280) of the barrage text published by the current user on the playback object, wherein the barrage text published by the current user appears from the position of the element related to the barrage text published by the current user, and enters the playback along a specific track. The background area of the barrage superimposed on the object is played.

19. Apparatus (2) according to clause 11, further comprising:

a unit for real-time screenshot of the object (202);

Searching for a map with the identified elements on the Internet based on the identified elements The unit of the piece and related comments (205);

Responding to a third operation of the current user's specific location of the playback object, determining a unit of the element to which the particular location belongs (256);

Based on the determined element, a unit of the related comment corresponding to the element searched on the Internet is displayed to the current user (258).

20. The device (2) according to clause 11, wherein the play object comprises a television program, and if the play object is a television program, the device further comprises:

a unit (2001) for displaying a server address or a two-dimensional code of a television program in a television program, the two-dimensional code including a server address and a television program name where the television program is located;

Receiving a server address and a television program name of the television program sent by the user through the mobile device, or sending the scanned two-dimensional code, binding the identification number of the mobile device to the television program of the server address, thereby targeting the television program The unit associated with the barrage operation is performed by the mobile device (2002).

21. A computer apparatus comprising means (2) for generating a barrage superimposed on a play object according to any one of clauses 11-20.

A computer readable storage medium, comprising computer instructions, when the computer instructions are executed, the method of any one of clauses 1 to 10 being performed.

23. A computer program product, when the computer program product is executed, the method of any one of clauses 1 to 10 being performed.

24. A computer device comprising a memory and a processor, the memory storing computer instructions, the processor being configured to perform any of the clauses 1 to 10 by executing the computer instructions Said method.

Claims

A method (1) for generating a barrage superimposed on a playback object, comprising:

Receiving a barrage text (110) issued by a user other than the current user;

Determining, according to the friend information in the login account information of the current user, whether the other user is a friend of the current user (120);

Playing the barrage text (130) on the play object, wherein if the other user is not the current user's friend, playing the barrage text on the play object in the shape of the first play track; if the other user is the current user's friend, The barrage text is played on the playback object in a second play track shape different from the shape of the first play track.
The method (1) of claim 1 further comprising:

Determining whether the barrage text published by the other user is related to an Internet sudden topic or a hot event (121), and

The step of playing the barrage text (130) on the play object includes: if the barrage text published by the other user is related to an Internet burst topic or a popular event, the shape of the third play track different from the shape of the first play track is Play the barrage text on the playback object.
The method (1) of claim 1 further comprising:

Performing a real-time screenshot of the object (102);

Analyze the primary color (103) in the captured image of the live screenshot, and

The step of playing the barrage text (130) on the playing object includes playing the barrage text in the background area of the barrage superimposed on the playing object, wherein the color of the background area of the barrage is set to the first color obtained based on the main color, the barrage The color of the text is set to the second color based on the main color.
The method (1) of claim 1 further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Searching for pictures and related comments having the identified elements on the Internet based on the identified elements (105);

Determining a correspondence of the related comment to the identified element (106);

An element (107) that searches for the most relevant related comment on the Internet is highlighted on the play object.
The method (1) of claim 1 further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Determining the emotional color of the picture according to the identified element (108);

Determining the playing speed of the barrage text based on the determined emotional color of the picture (109), and

The step of playing the barrage text (130) on the playback object includes: determining the playback speed and playing the barrage text.
The method (1) of claim 1 further comprising:

In response to the first operation of the played barrage text, the playback of the barrage text is stopped, displaying a functional area containing at least one of the following functions: like, comment, forward (140).

In response to the second operation of the function in the functional area, processing corresponding to the function is performed (150).
The method (1) of claim 6 further comprising:

After the processing corresponding to the function is performed, the display style of the barrage text for the first operation is changed (151).
The method (1) of claim 1 further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Receiving the barrage text (160) published by the current user;

Identifying an element (170) in the picture related to the barrage text published by the current user;

Playing the barrage text (180) published by the current user on the playing object, wherein the barrage text published by the current user appears from the position of the element related to the barrage text published by the current user, and enters the playing object along a specific track. The superimposed barrage background area is played.
The method (1) of claim 1 further comprising:

Performing a real-time screenshot of the object (102);

Identifying elements in the picture captured by the real-time screenshot (104);

Searching for pictures and related comments having the identified elements on the Internet based on the identified elements (105);

Determining a correspondence of the related comment to the identified element (106);

Determining an element to which the specific location belongs in response to the current user's third operation on the specific location of the playback object (156);

Based on the determined element, the relevant user is searched for the relevant comment (158) corresponding to the element searched on the Internet.
The method (1) according to claim 1, wherein the object to be played comprises a television program, and if the object to be played is a television program, the method further comprises:

Displaying, in the television program, a server address or a two-dimensional code of the television program, where the two-dimensional code includes a server address where the television program is located and a television program name (1001);

Receiving a server address and a television program name of the television program sent by the user through the mobile device, or sending the scanned two-dimensional code, binding the identification number of the mobile device to the television program of the server address, thereby targeting the television program The operation related to the barrage is performed by the mobile device (1002).
A device (2) for generating a barrage superimposed on a playback object, comprising:

Receiving a unit (210) of the barrage text published by a user other than the current user;

Determining, according to the friend information in the login account information of the current user, whether the other user is a friend of the current user (220);

The unit (230) for playing the barr text on the play object is configured to: if the other user is not the current user's friend, play the barrage text on the play object in the shape of the first play track; if the other user is The current user's friend plays the barrage text on the play object in a shape of the second play track different from the shape of the first play track.
The device (2) according to claim 11, further comprising:

Determining whether the barred text published by the other user is related to an Internet sudden topic or a hot event (221), and

The unit (230) for playing the barrage text on the playback object is configured to: if the barrage text published by the other user is related to an Internet sudden topic or a popular event, different from the The third play track shape of the play track shape plays the barrage text on the play object.
The device (2) according to claim 11, further comprising:

a unit for real-time screenshot of the object (202);

A unit (203) of the dominant color in the picture captured in the real-time screenshot is analyzed, and

The unit (230) for playing the barrage text on the playback object is configured to: play the barrage text in the background area of the barrage superimposed on the playback object, wherein the color of the background area of the barrage is set to the first color obtained based on the main color The color of the barrage text is set to a second color based on the main color.
The device (2) according to claim 11, further comprising:

a unit for real-time screenshot of the object (202);

Identifying elements of elements in the picture captured by the real-time screenshot (204);

Searching for a unit having a picture of the identified element and related comments on the Internet based on the identified element (205);

a unit (206) for determining a correspondence of the related comment to the identified element;

A unit (207) that searches for elements of the most relevant related comment on the Internet is highlighted on the play object.
The device (2) according to claim 11, further comprising:

a unit for real-time screenshot of the object (202);

Identifying elements of elements in the picture captured by the real-time screenshot (204);

Determining a unit of emotional color of the picture based on the identified element (208);

Determining a unit (209) of the playing speed of the barrage text based on the determined emotional color of the picture, and

The unit (230) for playing the barrage text on the playback object is configured to: determine the playback speed, and play the barrage text.
The device (2) according to claim 11, further comprising:

In response to the first operation of the played barrage text, the playback of the barrage text is stopped, displaying a unit (240) of the functional area containing at least one of the following functions: like, comment, forward.

Responding to the second operation of the function in the functional area, performing a function corresponding to the function Processed unit (250).
The device (2) according to claim 16, further comprising:

After the processing corresponding to the function is performed, the unit (251) of the display style of the barrage text for the first operation is changed.
The device (2) according to claim 11, further comprising:

a unit for real-time screenshot of the object (202);

Identifying elements of elements in the picture captured by the real-time screenshot (204);

Receiving a unit (260) of the barrage text published by the current user;

Identifying, in the picture, a unit (270) of an element related to the barrage text published by the current user;

Playing a unit (280) of the barrage text published by the current user on the playback object, wherein the barrage text published by the current user appears from the position of the element related to the barrage text published by the current user, and enters the playback along a specific track. The background area of the barrage superimposed on the object is played.
The device (2) according to claim 11, further comprising:

a unit for real-time screenshot of the object (202);

Identifying elements of elements in the picture captured by the real-time screenshot (204);

Searching for a unit having a picture of the identified element and related comments on the Internet based on the identified element (205);

a unit (206) for determining a correspondence of the related comment to the identified element;

Responding to a third operation of the current user's specific location of the playback object, determining a unit of the element to which the particular location belongs (256);

Based on the determined element, a unit of the related comment corresponding to the element searched on the Internet is displayed to the current user (258).
The device (2) according to claim 11, wherein the object to be played comprises a television program, and if the object to be played is a television program, the device further comprises:

a unit (2001) for displaying a server address or a two-dimensional code of a television program in a television program, the two-dimensional code including a server address and a television program name where the television program is located;

Receiving the server address and TV of the TV program sent by the user through the mobile device a program name, or a scanned two-dimensional code, that binds the identification number of the mobile device to the television program of the server address, thereby performing a unit for the barrage-related operation of the television program through the mobile device ( 2002).
A computer apparatus comprising the apparatus (2) for generating a barrage superimposed on a playback object according to any one of claims 11-20.
A computer readable storage medium comprising computer instructions, the method of any one of claims 1 to 10 being executed when the computer instructions are executed.
A computer program product, the method of any one of claims 1 to 10 being executed when the computer program product is executed.
A computer device comprising a memory and a processor, wherein the memory stores computer instructions, the processor being configured to perform the computer instructions to perform any of claims 1 to 10 The method described.