CN115297355A

CN115297355A - Bullet screen display method, bullet screen generation device, electronic equipment and storage medium

Info

Publication number: CN115297355A
Application number: CN202210920222.XA
Authority: CN
Inventors: 左建春
Original assignee: Beijing QIYI Century Science and Technology Co Ltd
Current assignee: Beijing QIYI Century Science and Technology Co Ltd
Priority date: 2022-08-02
Filing date: 2022-08-02
Publication date: 2022-11-04
Anticipated expiration: 2042-08-02
Also published as: CN115297355B

Abstract

The embodiment of the invention provides a bullet screen display method, a bullet screen generation device, electronic equipment and a storage medium. Therefore, the terminal can adopt the special effect display barrage corresponding to the multimedia fragments, the display form of the barrage is increased, the barrage is linked with the audio content and/or the picture content of the multimedia content, and the user experience is improved.

Description

Bullet screen display method, bullet screen generation device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of multimedia display technologies, and in particular, to a bullet screen display method, a bullet screen generation device, an electronic device, and a storage medium.

Background

The barrage is an interactive form of video, and is a commentary character displayed when multimedia content such as video and audio is played, and is generally displayed in a moving manner from one side of a playing picture to the other side.

The bullet screen is the text content aligned according to the video time axis. And when the user sends the bullet screen, the current multimedia content progress time is the timestamp of the bullet screen. When the user consumes the barrage, all the displayable barrages with the corresponding timestamp time being the playing progress time of the current multimedia content are displayed in the picture. However, the currently displayed bullet screen is single in display form, and the user experience is poor.

Disclosure of Invention

The embodiment of the invention aims to provide a bullet screen display method, a bullet screen generation device, electronic equipment and a storage medium, so as to increase the display form of a bullet screen and improve the experience of a user. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a bullet screen display method, where the method is applicable to a bullet screen display terminal, and includes:

acquiring target linkage information corresponding to a playing time point based on the playing time point of the currently played multimedia content, wherein the target linkage information is predetermined description information used for identifying a video clip meeting a preset special effect display condition in the currently played multimedia content, and the target linkage information comprises target picture information and/or target audio information;

determining a target special effect corresponding to the target linkage information according to the target linkage information and a corresponding relation between preset linkage information and the special effect;

and displaying the bullet screen corresponding to the playing time point by adopting the target special effect.

Optionally, the step of obtaining the target linkage information corresponding to the playing time point based on the playing time point of the currently played multimedia content includes:

determining whether target linkage information corresponding to the playing time point exists in a pre-acquired bullet screen package, wherein the bullet screen package is a pre-generated bullet screen and linkage information file package including a target time period of the currently played multimedia content, and the target time period includes the playing time point;

and if so, acquiring target linkage information corresponding to the playing time point.

Optionally, before the step of determining whether the target motion information corresponding to the playing time point exists in the pre-acquired bullet screen package, the method further includes:

sending a barrage request to a server, wherein the barrage request comprises the playing progress of the currently played multimedia content;

and receiving the bullet screen packet returned by the server based on the playing progress.

Optionally, the method further includes:

in the playing process of the multimedia content, acquiring a bullet screen to be processed;

and sending the bullet screen to be processed and the generation time of the bullet screen to be processed to a server.

In a second aspect, an embodiment of the present invention provides a bullet screen generating method, where the method is applied to a bullet screen generating server, and includes:

acquiring a bullet screen corresponding to the multimedia content and bullet screen generation time;

dividing each bullet screen into a plurality of bullet screen packages according to the bullet screen generation time and the preset time length of each bullet screen;

determining whether predetermined linkage information exists in a duration corresponding to each bullet screen package, wherein the linkage information is used for identifying description information of a multimedia segment which accords with a preset special effect display condition in the multimedia content, and the linkage information comprises picture information and/or audio information;

if yes, generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information.

Optionally, the method further includes:

receiving a barrage request sent by a terminal, wherein the barrage request comprises the playing progress of the multimedia content currently played by the terminal;

and determining the bullet screen package corresponding to the currently played multimedia content according to the current playing progress, and sending the bullet screen package to the terminal.

Optionally, the method further includes:

receiving a bullet screen to be processed sent by a terminal, wherein the bullet screen to be processed is obtained in the playing process of the multimedia content played by the terminal;

and storing the bullet screen to be processed to a bullet screen package corresponding to the generation time based on the generation time. .

In a third aspect, an embodiment of the present invention provides a bullet screen display device, where the device is applied to a bullet screen display terminal, and includes:

the device comprises a first acquisition module, a second acquisition module and a display module, wherein the first acquisition module is used for acquiring target linkage information corresponding to a playing time point based on the playing time point of currently played multimedia content, the target linkage information is predetermined description information used for identifying a multimedia segment meeting a preset special effect display condition in the currently played multimedia content, and the target linkage information comprises target picture information and/or target audio information;

the determining module is used for determining a target special effect corresponding to the target linkage information according to the target linkage information and a corresponding relation between preset linkage information and the special effect;

and the display module is used for displaying the bullet screen corresponding to the playing time point by adopting the target special effect.

In a fourth aspect, an embodiment of the present invention provides a bullet screen generating device, where the device is applied to a bullet screen generating server, and includes:

the bullet screen information acquisition module is used for acquiring a bullet screen corresponding to the multimedia content and bullet screen generation time;

the bullet screen dividing module is used for dividing each bullet screen into a plurality of bullet screen packages according to the bullet screen generation time and the preset time length of each bullet screen;

the system comprises a linkage information determining module, a display module and a display module, wherein the linkage information determining module is used for determining whether predetermined linkage information exists in a time length corresponding to each bullet screen package, the linkage information is used for identifying description information of a multimedia fragment which accords with a preset special effect display condition in the multimedia content, and the linkage information comprises picture information and/or audio information;

and the bullet screen package generating module is used for generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information if the predetermined linkage information exists.

In a fifth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;

a memory for storing a computer program;

a processor configured to implement the method steps of any one of the first or second aspects when executing a program stored in the memory.

In a sixth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method steps of any one of the first aspect or the second aspect.

In the scheme provided by the embodiment of the invention, the bullet screen display terminal can acquire target linkage information corresponding to the playing time point based on the playing time point of the currently played multimedia content, wherein the target linkage information is predetermined description information used for identifying a multimedia segment in the currently played multimedia content, which meets a preset special effect display condition, and the target linkage information comprises target picture information and/or target audio information, and further, the terminal can determine a target special effect corresponding to the target linkage information according to the target linkage information and the corresponding relationship between the preset linkage information and the special effect, and display the bullet screen corresponding to the playing time point by adopting the target special effect. According to the scheme, when the bullet screen corresponding to the playing time point of the currently played multimedia content is displayed, the corresponding target linkage information can be determined based on the playing time point, the target special effect is determined according to the target linkage information and the corresponding relation between the preset linkage information and the special effect, and then the bullet screen corresponding to the playing time point is displayed by adopting the target special effect. Therefore, the terminal can adopt the special effect display barrage corresponding to the multimedia clip, the display form of the barrage is increased, the barrage is linked with the audio content and/or the picture content of the currently played multimedia content, and the user experience is improved. Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is a flowchart of a bullet screen display method according to an embodiment of the present invention;

FIG. 2 is a detailed flowchart of step S101 in the embodiment shown in FIG. 1;

FIG. 3 is a flow chart of the processing of the bullet screen to be processed according to the embodiment shown in FIG. 1;

fig. 4 is a flowchart of a bullet screen generating method according to an embodiment of the present invention;

fig. 5 is a flowchart of the bullet screen package determination method according to the embodiment shown in fig. 4;

FIG. 6 is a flow chart of the processing of the bullet screen to be processed according to the embodiment shown in FIG. 4;

fig. 7 is a schematic structural diagram of a bullet screen display device according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a bullet screen generating device according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.

In order to increase the display form of a bullet screen and thus improve the experience of a user, embodiments of the present invention provide a bullet screen display method and apparatus, a bullet screen generation method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product. First, a bullet screen display method provided in an embodiment of the present invention is described below.

The bullet screen display method provided by the embodiment of the invention can be applied to any terminal needing bullet screen display, for example, the terminal can be a mobile phone, a computer, a tablet computer and the like, and is not specifically limited herein. For clarity of description, it is subsequently referred to as a terminal.

As shown in fig. 1, a bullet screen display method, which is suitable for a bullet screen display terminal, includes:

s101, acquiring target linkage information corresponding to a playing time point based on the playing time point of the currently played multimedia content;

the target linkage information is predetermined description information used for identifying a multimedia segment which meets a preset special effect display condition in the currently played multimedia content, and the target linkage information comprises target picture information and/or target audio information.

S102, determining a target special effect corresponding to the target linkage information according to the target linkage information and a corresponding relation between preset linkage information and the special effect;

and S103, displaying the bullet screen corresponding to the playing time point by adopting the target special effect.

As can be seen, in the scheme provided by the embodiment of the present invention, the bullet screen display terminal may obtain target linkage information corresponding to the play time point based on the play time point of the currently played multimedia content, where the target linkage information is predetermined description information for identifying a multimedia segment in the currently played multimedia content that meets a preset special effect display condition, and the target linkage information includes target picture information and/or target audio information, and further, the terminal may determine a target special effect corresponding to the target linkage information according to the target linkage information and a corresponding relationship between the preset linkage information and the special effect, and display the bullet screen corresponding to the play time point by using the target special effect. According to the scheme, when the bullet screen corresponding to the playing time point of the currently played multimedia content is displayed, the corresponding target linkage information can be determined based on the playing time point, the target special effect is determined according to the target linkage information and the corresponding relation between the preset linkage information and the special effect, and then the bullet screen corresponding to the playing time point is displayed by adopting the target special effect. Therefore, the terminal can adopt the special effect display barrage corresponding to the multimedia clip, the display form of the barrage is increased, the barrage is linked with the audio content and/or the picture content of the currently played multimedia content, and the user experience is improved.

When a user wants to watch multimedia content, a multimedia content playing instruction can be sent out in a terminal display interface used by the user, and when the terminal acquires the multimedia content playing instruction, the terminal can play the multimedia content indicated by the multimedia content playing instruction, wherein the multimedia content is the currently played multimedia content. It is reasonable that the multimedia content may include silent video, audio, and audio-video, among others. For example, the multimedia content may be music having only audio, video having only pictures, audio having both audio and pictures, and the like, and is not particularly limited herein.

In the process of playing the currently played multimedia content, the user may select to open or close the bullet screen, for example, the user may click a bullet screen opening button in a playing interface of the multimedia content to send a bullet screen opening instruction, and the terminal may display the bullet screen in the multimedia content picture of the currently played multimedia content after receiving the bullet screen opening instruction. The bullet screen is the text content aligned with the time axis of the multimedia content, and the terminal can display the bullet screen corresponding to the playing time point of the currently played multimedia content.

The playing time point is a time point that identifies a playing progress of the currently playing multimedia content, for example, when the duration of the currently playing multimedia content a is 10 minutes, and the playing progress of the currently playing multimedia content a is 1 minute 30 seconds, the playing time point may be 1 minute 30 seconds, and certainly may also be a time point that can identify the playing progress of the currently playing multimedia content, such as 90 seconds.

In order to display the barrage by adopting the special effect, a multimedia segment meeting a preset special effect display condition in the currently played multimedia content can be determined in advance, and when the multimedia segment meets the preset special effect display condition, the barrage corresponding to the multimedia segment can be displayed by adopting the special effect mode.

The preset special effect showing condition may be that the multimedia clip includes preset specific audio information and/or includes a specific picture scene. For example, the preset special effect showing condition may be that the multimedia segment includes drum dots with a preset specific rule. For another example, the preset special effect presentation condition may be that the multimedia segment includes a picture corresponding to a preset explosion scene. For another example, the preset special effect showing condition may include preset specific music and a star scene in the multimedia clip.

In order to determine whether the bullet screen corresponding to the playing time point needs to be displayed in a special effect manner, the terminal may determine whether the playing time point has corresponding target linkage information. The target linkage information is predetermined description information used for identifying a multimedia clip meeting a preset special effect display condition in the currently played multimedia content, and may include target picture information and/or target audio information.

In an embodiment, when the terminal acquires the bullet screen corresponding to the currently played multimedia content, the terminal may acquire the linkage information corresponding to the currently played multimedia content, and then the terminal may determine whether the target linkage information corresponding to the play time point exists in the linkage information corresponding to the currently played multimedia content.

When the corresponding target linkage information does not exist at the playing time point, it is indicated that the picture and/or the audio corresponding to the playing time point do not meet the preset special effect display condition, and the terminal can display the bullet screen corresponding to the playing time point in a conventional mode.

When the corresponding target linkage information exists at the playing time point, the picture and/or the audio corresponding to the playing time point are/is shown to meet the preset special effect display condition, and the terminal can acquire the target linkage information.

After the target linkage information corresponding to the playing time point is acquired, the terminal may execute the step S102, that is, the target special effect corresponding to the target linkage information is determined according to the target linkage information and the preset corresponding relationship between the linkage information and the special effect.

In order to facilitate the terminal to quickly determine the target special effect, a corresponding relationship between the linkage information and the special effect may be preset, for example, the preset corresponding relationship between the linkage information and the special effect may be recorded in a table manner, and for example, the table may be as follows:

serial number	Linkage information	Specific effects
			1	Linkage information 1	Special effects 1
2	Linkage information 2	Special effects 2
			…	…	…
n	Linkage information n	Special effect n

Furthermore, the terminal can determine the target special effect corresponding to the target linkage information from the preset corresponding relation between the linkage information and the special effect according to the target linkage information. For example, the target linkage information is linkage information 2, and the terminal may determine that the target special effect corresponding to the linkage information 2 is special effect 2 from the correspondence between the preset linkage information and the special effect shown in the above table.

After determining the target special effect corresponding to the target linkage information, the terminal may execute step S103, that is, display the bullet screen corresponding to the playing time point by using the target special effect. For example, the special effect 2 is a ripple, and the terminal may display the bullet screen corresponding to the playing time point in the form of the ripple.

Through the mode, the terminal can adopt the special effect display barrage corresponding to the multimedia segment, so that a user can see the effect that the barrage is displayed through the target special effect associated with the audio content and/or the picture content of the multimedia content, and the effect of linkage of the barrage and the sound and the picture is realized.

For example, the music corresponding to the multimedia segment 1 is rhythmic music, and the corresponding special effect of the music can be preset to display the pop-up screen in a ripple manner, so that the terminal can display the pop-up screen in the ripple manner when playing the multimedia segment 1, and thus, a user can see that the pop-up screen is displayed in the ripple manner when hearing the rhythmic music corresponding to the multimedia segment 1, and the effect of linking the pop-up screen with the audio content is realized.

As an implementation manner, when the terminal displays the barrage corresponding to the playing time point by using the target special effect, each barrage may be displayed by using the target special effect, for example, the target special effect is that the barrage shakes along with the rhythm of the audio, and the terminal may respectively display each barrage by using the target special effect of the rhythm shake.

As another embodiment, when the terminal displays the bullet screens corresponding to the playing time points by using the target special effect, all the bullet screens corresponding to the current playing time points can be displayed by using the target special effect as a whole. For example, the target special effect is that the bullet screens shake along with the rhythm of the audio, and the terminal can display all the bullet screens as a whole by adopting the target special effect of the rhythm shake, that is, all the bullet screens shake along with the rhythm of the audio as a whole.

Therefore, in this embodiment, the terminal can adopt the special effect display barrage corresponding to the multimedia clip, the display form of the barrage is increased, the barrage is linked with the audio content and/or the picture content of the currently played multimedia content, the display effect of the barrage is improved, and better interactive experience is brought to the user.

As an implementation manner of the embodiment of the present invention, as shown in fig. 2, the step of acquiring the target linkage information corresponding to the playing time point based on the playing time point of the currently played multimedia content may include:

s201, determining whether target linkage information corresponding to the playing time point exists in a pre-acquired bullet screen package or not; if yes, go to step S202; if the bullet screen does not exist, displaying the bullet screen in a conventional display mode;

in order to determine the corresponding linkage information in the playing process of the multimedia content, the bullet screen corresponding to the multimedia content and the linkage information may be generated into a bullet screen package in advance. In an embodiment, a bullet screen packet may be generated by using the bullet screen corresponding to each multimedia segment of the multimedia content with a preset duration and the linkage information. Therefore, the terminal can obtain the corresponding bullet screen package according to the playing duration of the currently played multimedia content in the playing process of the currently played multimedia content.

Aiming at the bullet screen package corresponding to the playing time point, the terminal can acquire the bullet screen package in advance according to the playing duration of the currently played multimedia content, the bullet screen package is a pre-generated file package which comprises a bullet screen of a target time period of the currently played multimedia content and linkage information, and the target time period comprises the playing time point. The time duration corresponding to the target time period is the preset time duration, and may be 1 minute, 2 minutes, 5 minutes, and the like, which is not specifically limited herein.

Further, the terminal may determine whether target linkage information corresponding to the playing time point exists in the pre-acquired bullet screen package based on the playing time point of the currently played multimedia content. If so, step S202 may continue. And if the bullet screen does not exist, displaying the bullet screen in a conventional display mode.

For example, the playing time point is 1 minute and 45 seconds, the bullet screen package 1 is a bullet screen which is generated in advance and includes a target time period of the currently played multimedia content and a file package of linkage information, the target time period is 1 minute and 30 seconds to 2 minutes and 30 seconds, and then the terminal can acquire the bullet screen package 1 corresponding to the target time period before the currently played multimedia content is played for 1 minute and 30 seconds, that is, the bullet screen package is acquired in advance. Furthermore, when the multimedia content currently played is played for 1 minute 45 seconds, the terminal can determine whether the target linkage information corresponding to 1 minute 45 seconds exists in the bullet screen package 1.

And S202, acquiring target linkage information corresponding to the playing time point.

If target linkage information corresponding to the playing time point exists in the pre-acquired bullet screen package, the terminal can acquire the target linkage information corresponding to the playing time point, further can acquire a target special effect based on the target linkage information, and displays the bullet screen corresponding to the playing time point by adopting the target special effect, so that the display effect of the bullet screen display and the linkage of the audio content and/or the picture content of the multimedia content is realized.

Therefore, in this embodiment, the terminal may determine whether target linkage information corresponding to the play time point exists in the pre-acquired bullet screen package, and if so, acquire the target linkage information corresponding to the play time point, and the terminal may accurately acquire the target linkage information corresponding to the play time point.

As an implementation manner of the embodiment of the present invention, before the step of determining whether the target linkage information corresponding to the play time point exists in the pre-acquired bullet screen package, the method may further include:

and sending a bullet screen request to a server, and receiving a bullet screen package returned by the server based on the playing progress.

When the bullet screen package is stored in the server, because different bullet screen packages include bullet screens and linkage information corresponding to different time periods of the multimedia content, therefore, in order to obtain the bullet screen package corresponding to the playing progress of the currently played multimedia content, the terminal can send a bullet screen request to the server, wherein the bullet screen request includes the playing progress of the currently played multimedia content.

When receiving the bullet screen request, the server can determine the bullet screen package corresponding to the play progress from the multiple bullet screen packages according to the play progress included in the bullet screen request, namely the bullet screen package corresponding to the target time period corresponding to the currently played multimedia content, and then the server can send the bullet screen package to the terminal, so that the terminal can acquire the bullet screen package.

Therefore, in this embodiment, the terminal may send the bullet screen request to the server, so that the server determines the bullet screen package corresponding to the target time period according to the playing progress of the currently played multimedia content, and sends the bullet screen package to the terminal, so that the terminal may obtain the bullet screen package sent by the server, and it is ensured that whether the target linkage information corresponding to the playing time point exists in the bullet screen package which is obtained in advance can be successfully determined subsequently.

As an implementation manner of the embodiment of the present invention, as shown in fig. 3, the method may further include:

s301, acquiring a bullet screen to be processed in the playing process of the multimedia content;

in the process of playing the multimedia content, the user can input the bullet screen which the user wants to send in the bullet screen input box in the playing interface of the multimedia content, and the terminal can acquire the bullet screen input by the user, namely the bullet screen to be processed.

S302, the bullet screen to be processed and the generation time of the bullet screen to be processed are sent to a server.

After the to-be-processed bullet screen is acquired, the terminal can send the to-be-processed bullet screen and the to-be-processed bullet screen generation time to the server, and the server can store the to-be-processed bullet screen to a bullet screen package corresponding to the generation time based on the to-be-processed bullet screen generation time after receiving the to-be-processed bullet screen and the generation time sent by the terminal. And the generation time of the bullet screen to be processed is the time for sending the bullet screen by the user.

For example, the time period of the currently played multimedia content corresponding to the bullet screen package 1 is 0-2 minutes 30 seconds, the time period of the currently played multimedia content corresponding to the bullet screen package 2 is 2 minutes 30 seconds-5 minutes, and the user sends a bullet screen when the currently played multimedia content is played for 2 minutes 50 seconds: "A came from! ", the bullet screen is the bullet screen to be processed, and the generation time is 2 minutes and 50 seconds. Furthermore, the terminal may send the to-be-processed barrage and the generation time to the server, and after receiving the to-be-processed barrage and the generation time of the to-be-processed barrage, the server may send the to-be-processed barrage "a to the terminal within a time period corresponding to the barrage package 2, because 2 minutes and 50 seconds are located within the time period corresponding to the barrage package 2! "store to the bullet screen package 2.

In an implementation manner, the terminal may send the bullet screen to be processed, the user identifier of the user who sends the bullet screen to be processed, and the generation time to the server, so that the server may further store the user identifier of the user who sends the bullet screen to be processed to the bullet screen package corresponding to the generation time, and when the multimedia content that is currently played is played by each subsequent terminal to the generation time, not only the bullet screen may be displayed, but also the user identifier that sends the bullet screen may be displayed.

As can be seen, in this embodiment, in the playing process of the multimedia content, the terminal may obtain the bullet screen to be processed, and send the bullet screen to be processed and the generation time of the bullet screen to be processed to the server, and the server may store the bullet screen to be processed to the bullet screen package corresponding to the generation time based on the generation time. Therefore, in the playing process of the currently played multimedia content, the bullet screen to be processed can be stored in the bullet screen packet corresponding to the generation time, and the bullet screen packet corresponding to the currently played multimedia content is perfected, so that a user who subsequently watches the currently played multimedia content can view all the bullet screens.

Corresponding to the bullet screen display method, the embodiment of the invention also provides a bullet screen generation method. The following describes a bullet screen generating method provided by an embodiment of the present invention. The bullet screen generation method provided by the embodiment of the present invention may be applied to any server that needs bullet screen generation, for example, a video website server, an audio website server, and the like, and is not limited specifically herein. For clarity of description, it will be referred to as a server hereinafter.

As shown in fig. 4, a bullet screen generating method, which is applicable to a bullet screen generating server, includes:

s401, acquiring a bullet screen corresponding to multimedia content and bullet screen generation time;

s402, dividing each bullet screen into a plurality of bullet screen packages according to bullet screen generation time and preset time length of each bullet screen;

s403, determining whether the preset linkage information exists in the duration corresponding to each bullet screen package, and if so, executing S404; if the bullet screen does not exist, generating a bullet screen package based on the bullet screen corresponding to the duration;

the linkage information is used for identifying description information of a multimedia clip which accords with a preset special effect display condition in the multimedia content, and the linkage information comprises picture information and/or audio information.

And S404, generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information.

As can be seen, in the scheme provided by the embodiment of the present invention, the bullet screen generation server may obtain the bullet screens corresponding to the multimedia content and the bullet screen generation time, divide each bullet screen into a plurality of bullet screen packages according to the bullet screen generation time and the preset duration of each bullet screen, and determine whether predetermined linkage information exists in the duration corresponding to each bullet screen package, where the linkage information is used to identify description information of a multimedia segment that meets a preset special effect display condition in the multimedia content, and the linkage information includes picture information and/or audio information. And if so, generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information. Therefore, when the subsequent terminal plays the multimedia content, the target linkage information corresponding to the playing time point can be quickly and accurately acquired, and then the bullet screen is displayed by adopting the special effect corresponding to the multimedia segment, so that the display form of the bullet screen is increased, the linkage of the bullet screen and the audio content and/or the picture content of the currently played multimedia content is realized, and the user experience is improved.

In order to display the bullet screen in the multimedia content playing process conveniently, the bullet screen is the text content aligned according to the time axis of the multimedia content, so that the server can obtain the bullet screen corresponding to the media content and the bullet screen generation time. For example, the multimedia content is multimedia content 1, the duration of the multimedia content 1 is 5 minutes, and the bullet screen corresponding to the multimedia content 1 and the bullet screen generation time can be shown in the following table:

after acquiring the bullet screens corresponding to the multimedia content and the bullet screen generation time, the server can divide each bullet screen into a plurality of bullet screen packages according to the bullet screen generation time and the preset time of each bullet screen, wherein the preset time is the preset time of the multimedia content corresponding to the bullet screen packages. For example, the preset time period may be 1 minute, 3 minutes, 5 minutes, etc., and is not particularly limited herein.

In an implementation manner, the server may divide each bullet screen into a plurality of bullet screen packages based on the bullet screen generation time of each bullet screen by using the bullet screen generation time of the first bullet screen as a starting point and using a preset time duration as a time interval. For example, the preset time duration is 1 minute, and the server may divide each bullet screen into 5 bullet screen packages by taking the bullet screen generation time of the bullet screen 1, that is, 3 seconds, as a starting point and 1 minute as a time interval.

In another embodiment, the server may calculate the number of bullet screen packages based on a preset duration and a duration of the multimedia content, divide a time axis of the multimedia content into a plurality of intervals, and further divide each bullet screen into a plurality of bullet screen packages according to a correspondence between a bullet screen generation time of each bullet screen and each interval.

For example, in the example of receiving step S401, the time length of the multimedia content 1 is 5 minutes, the preset time length is 1 minute, the server may calculate the number of the bullet screen packs to be 5, and divide the time axis of the multimedia content into 5 sections of [0,1 ], [1,2), [2,3 ], [3,4 ], and [4,5 ]. Furthermore, according to the correspondence between the bullet screen generation time of each bullet screen and 5 intervals, each bullet screen is divided into 5 bullet screen packages, as shown in the following table:

after dividing each bullet screen into a plurality of bullet screen packages, the server can determine whether predetermined linkage information exists in the duration corresponding to each bullet screen package. The linkage information is used for identifying description information of a multimedia segment which accords with a preset special effect display condition in the multimedia content, and the linkage information can comprise picture information and/or audio information.

In one embodiment, the linkage information may include a time period corresponding to the multimedia content segment and a type of the audio/video content. For example, if the audio of 53 seconds to 1 minute and 12 seconds of the multimedia content 1 is a kind of drumbeat music, the audio of 1 minute and 30 seconds to 2 minutes is another kind of drumbeat music, the picture of 3 minutes to 3 minutes and 30 seconds is a specific picture, and the picture of 4 minutes and 45 seconds to 5 minutes is another specific picture, the linkage information corresponding to the multimedia content 1 can be shown in the following table:

linkage information	Type (B)	Time period
			Linkage information 1	Drum point 1	53 seconds-1 minute 12 seconds
Linkage information 2	Drum point 2	1 minute, 30 seconds to 2 minutes
			Linkage information 3	Specific picture 1	3 min-3 min 30 s
Linkage information 4	Specific picture 2	4 minutes, 45 seconds to 5 minutes

In one embodiment, the server may determine whether a time period overlapping with a predetermined time period corresponding to the multimedia segment in each linkage information exists in the time period corresponding to each bullet screen package, and if so, determine that the predetermined linkage information exists in the time period corresponding to the bullet screen package.

If the predetermined linkage information exists in the duration corresponding to the bullet screen package, the server can generate the bullet screen package based on the bullet screen corresponding to the duration and the linkage information. If the bullet screen does not exist, the bullet screen package can be generated based on the bullet screen corresponding to the duration.

For example, as shown in the above table, the linkage information of the multimedia content 1 includes two bullet screen packages, the duration corresponding to the bullet screen package 1 is 0-1 minute, the duration corresponding to the bullet screen package 3 is 2-3 minutes, and the server can determine whether there is a time period in which time periods corresponding to the multimedia fragments in the linkage information overlap within the durations corresponding to the bullet screen package 1 and the bullet screen package 2. Since the multimedia segment corresponding to the existence of the drum point 1 overlaps for a time period of 53 seconds to 1 minute and 12 seconds within 0 to 1 minute, the server can generate the bullet screen package 1 based on the bullet screen corresponding to 0 to 1 minute and the linkage information 1. Since there is no time period in which the time periods corresponding to the multimedia segments in the linkage information overlap within 2 minutes to 3 minutes, the server may generate the bullet screen package 2 based on the bullet screen corresponding to 2 minutes to 3 minutes.

After the server generates the bullet screen package, the generated bullet screen package may be sent to the terminal, or the terminal may obtain the corresponding bullet screen package from the server according to the playing progress of the multimedia content, which is reasonable and not specifically limited herein.

In this embodiment, the server may obtain the bullet screens corresponding to the multimedia content and the bullet screen generation time, divide each bullet screen into a plurality of bullet screen packages according to the bullet screen generation time and the preset duration of each bullet screen, determine whether predetermined linkage information exists in the duration corresponding to each bullet screen package, and if so, generate the bullet screen package based on the bullet screen corresponding to the duration and the linkage information. Therefore, when the subsequent terminal plays the multimedia content, the target linkage information corresponding to the playing time point can be quickly and accurately acquired, and then the bullet screen is displayed by adopting the special effect corresponding to the multimedia segment, so that the display form of the bullet screen is increased, the linkage of the bullet screen and the audio content and/or the picture content of the currently played multimedia content is realized, and the user experience is improved.

As an implementation manner of the embodiment of the present invention, as shown in fig. 5, the method may further include:

s501, receiving a bullet screen request sent by a terminal;

when the bullet screen package is stored in the server, because different bullet screen packages include bullet screens and linkage information corresponding to different time periods of the multimedia content, therefore, in order to obtain the bullet screen package corresponding to the playing progress of the currently played multimedia content, the terminal can send a bullet screen request to the server, wherein the bullet screen request includes the playing progress of the currently played multimedia content of the terminal.

S502, determining the bullet screen package corresponding to the currently played multimedia content according to the current playing progress, and sending the bullet screen package to the terminal.

Therefore, in this embodiment, after receiving the bullet screen request sent by the terminal, the server can determine the bullet screen package corresponding to the target time period according to the playing progress of the currently played multimedia content, and send the bullet screen package to the terminal, so that the terminal can acquire the bullet screen package sent by the server, and it is ensured that whether the target linkage information corresponding to the playing time point exists in the bullet screen package which is obtained in advance can be successfully determined subsequently.

As an implementation manner of the embodiment of the present invention, as shown in fig. 6, the method may further include:

s601, receiving a bullet screen to be processed sent by a terminal;

in the process of playing the multimedia content, the user can input the bullet screen which the user wants to send in the bullet screen input box in the playing interface of the multimedia content, and the terminal can acquire the bullet screen input by the user, namely the bullet screen to be processed. After the to-be-processed bullet screen is acquired, the terminal can send the to-be-processed bullet screen and the to-be-processed bullet screen generation time to the server, and then the server can receive the to-be-processed bullet screen.

And S602, storing the bullet screen to be processed to the bullet screen package corresponding to the generation time based on the generation time.

After receiving the bullet screen to be processed and the generation time sent by the terminal, the server may store the bullet screen to be processed to the bullet screen package corresponding to the generation time based on the generation time of the bullet screen to be processed. And the generation time of the bullet screen to be processed is the time for sending the bullet screen by the user.

For example, the time period of the multimedia content P corresponding to the bullet screen package 1 is 0-2 min 30 s, the time period of the multimedia content P corresponding to the bullet screen package 2 is 2 min 30 s-5 min, and the user sends a bullet screen when the multimedia content P is played for 2 min 50 s: "true not wrong! ", the bullet screen is the bullet screen to be processed, and the generation time is 2 minutes and 50 seconds. Furthermore, the terminal can send the bullet screen to be processed and the generation time to the server, and after receiving the bullet screen to be processed and the generation time of the bullet screen to be processed, the server can send the bullet screen to be processed "true good |" because 2 minutes and 50 seconds are within the time period corresponding to the bullet screen package 2! "store to the bullet screen package 2.

As can be seen, in this embodiment, in the playing process of the multimedia content, the terminal may obtain the bullet screen to be processed, and send the bullet screen to be processed and the generation time of the bullet screen to be processed to the server, and the server may store the bullet screen to be processed to the bullet screen package corresponding to the generation time based on the generation time. Therefore, in the playing process of the currently played multimedia content, the bullet screen to be processed can be stored into the bullet screen package corresponding to the generation time, and the bullet screen package corresponding to the currently played multimedia content is perfected, so that a user who subsequently watches the currently played multimedia content can check all the bullet screens.

As an implementation manner of the embodiment of the present invention, the determining manner of the linkage information may include:

and inputting the multimedia content into a pre-trained linkage information identification model, and identifying to obtain linkage information based on the picture and/or audio of the multimedia content.

As an implementation manner, the linkage information may be predetermined in an offline preprocessing manner, and the linkage information may be detected in an Artificial Intelligence (AI) manner or an end-side AI + manual operation manner. Specifically, the terminal can input the multimedia content into a linkage information recognition model trained in advance, and the linkage information recognition model can recognize the multimedia content based on the model parameters to obtain linkage information. Wherein the multimedia content on which the identification is based may comprise pictures and/or audio.

The linkage information identification model is obtained by pre-training based on the multimedia sample and the linkage information label. In one embodiment, the training mode of the linkage information recognition model may include: the method comprises the steps of obtaining multimedia samples and an initial model, and calibrating linkage information tags corresponding to the multimedia samples, wherein the linkage information tags can be specific picture and/or audio identification and corresponding time periods in the corresponding multimedia samples. Furthermore, each multimedia sample may be input to the initial model, and the initial model may identify the multimedia sample based on the current model parameter to obtain a prediction result, where the prediction result is the identifier of the specific picture and/or audio in the multimedia sample predicted by the initial model and the corresponding time period. And adjusting model parameters of the initial model based on the prediction result and the difference between the linkage information labels until the initial model converges to obtain the linkage information identification model. The model parameters of the initial model may be adjusted by using a gradient descent algorithm or a random gradient descent algorithm, which is not specifically limited herein.

As an embodiment, the above-mentioned linkage information may also be determined by the terminal in the above-mentioned manner, which is reasonable and not specifically limited herein.

Therefore, in this embodiment, the currently played multimedia content may be input into a pre-trained linkage information recognition model, and linkage information is obtained through recognition based on the picture of the multimedia content, the audio of the multimedia content, or the picture and the audio of the multimedia content. The multimedia content can be preprocessed in an off-line mode through the linkage information recognition model, linkage information corresponding to the currently played multimedia content is obtained, and the linkage information corresponding to the multimedia content can be accurately determined.

As an implementation manner of the embodiment of the present invention, after obtaining the plurality of linkage information of the multimedia content, the plurality of linkage information may be structured and stored. In one embodiment, the linkage information may be sorted according to a time sequence of the corresponding playing time point, and the sorted linkage information is stored to obtain the linkage information corresponding to the multimedia content. Therefore, the linkage information can be conveniently acquired when the bullet screen package is generated, and certainly, the terminal can also quickly find the target linkage information corresponding to the playing time point from the linkage information stored in a structuralized mode.

Corresponding to the bullet screen display method, the embodiment of the invention also provides a bullet screen display device, and the bullet screen display device provided by the embodiment of the invention is introduced below.

As shown in fig. 7, a bullet screen display device, which is suitable for a bullet screen display terminal, may include:

a first obtaining module 710, configured to obtain target linkage information corresponding to a playing time point based on the playing time point of a currently played multimedia content;

A determining module 720, configured to determine a target special effect corresponding to the target linkage information according to the target linkage information and a corresponding relationship between preset linkage information and the special effect;

and the display module 730 is configured to display the bullet screen corresponding to the playing time point by using the target special effect.

As an implementation manner of the embodiment of the present invention, the first obtaining module 710 may include:

the first determining unit is used for determining whether target linkage information corresponding to the playing time point exists in a pre-acquired bullet screen package or not;

the bullet screen package is a pre-generated bullet screen including a target time period of the currently played multimedia content and a file package of linkage information, and the target time period includes the playing time point.

And the first acquisition unit is used for acquiring the target linkage information corresponding to the playing time point if the target linkage information corresponding to the playing time point exists in the pre-acquired bullet screen package.

As an implementation manner of the embodiment of the present invention, the apparatus may further include:

and the first sending module is used for sending a bullet screen request to a server before determining whether the target linkage information corresponding to the playing time point exists in the pre-acquired bullet screen package.

Wherein the barrage request comprises the playing progress of the currently played multimedia content.

And the receiving module is used for receiving the bullet screen package returned by the server based on the playing progress.

the second acquisition module is used for acquiring the bullet screen to be processed in the playing process of the multimedia content;

and the second sending module is used for sending the bullet screen to be processed and the generation time of the bullet screen to be processed to a server.

Corresponding to the bullet screen generating method, an embodiment of the present invention further provides a bullet screen generating device, and a description is provided below for the bullet screen generating device provided in the embodiment of the present invention.

As shown in fig. 8, a bullet screen generating apparatus, which is suitable for a bullet screen generating server, may include:

the bullet screen dividing module 810 is configured to divide each bullet screen into a plurality of bullet screen packages according to bullet screen generation time and preset duration of each bullet screen;

a linkage information determining module 820, configured to determine whether predetermined linkage information exists in a duration corresponding to each bullet screen package;

the description information of the multimedia clip which is used for identifying the preset special effect display condition in the multimedia content comprises picture information and/or audio information.

And a bullet screen package generating module 830, configured to generate a bullet screen package based on the bullet screen corresponding to the duration and the linkage information if there is predetermined linkage information.

As can be seen, in the scheme provided by the embodiment of the present invention, the bullet screen generating server may obtain the bullet screens corresponding to the multimedia content and the bullet screen generating time, divide each bullet screen into a plurality of bullet screen packages according to the bullet screen generating time and the preset duration of each bullet screen, and determine whether predetermined linkage information exists in the duration corresponding to each bullet screen package, where the linkage information is used to identify description information of a multimedia segment that meets a preset special effect display condition in the multimedia content, and the linkage information includes picture information and/or audio information. And if so, generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information. Therefore, when the subsequent terminal plays the multimedia content, the target linkage information corresponding to the playing time point can be quickly and accurately acquired, and then the bullet screen is displayed by adopting the special effect corresponding to the multimedia segment, so that the display form of the bullet screen is increased, the linkage of the bullet screen and the audio content and/or the picture content of the currently played multimedia content is realized, and the user experience is improved.

the request receiving module is used for receiving a barrage request sent by a terminal;

and the barrage request comprises the playing progress of the multimedia content currently played by the terminal.

And the bullet screen package determining module is used for determining the bullet screen package corresponding to the currently played multimedia content according to the current playing progress and sending the bullet screen package to the terminal.

the bullet screen receiving module is used for receiving the bullet screen to be processed sent by the terminal;

and the bullet screen to be processed is obtained in the playing process of the multimedia content played by the terminal.

And the generation module is used for storing the bullet screen to be processed to the bullet screen package corresponding to the generation time based on the generation time.

As an implementation manner of the embodiment of the present invention, the linkage information is determined by an information determining module, and the information determining module may include:

and the identification unit is used for inputting the multimedia content into a pre-trained linkage information identification model and identifying and obtaining linkage information based on the picture and/or audio of the multimedia content.

The linkage information identification model is obtained by pre-training based on the multimedia sample and the linkage information label.

An embodiment of the present invention further provides an electronic device, as shown in fig. 9, which includes a processor 901, a communication interface 902, a memory 903, and a communication bus 904, where the processor 901, the communication interface 902, and the memory 903 complete mutual communication through the communication bus 904,

a memory 903 for storing computer programs;

the processor 901 is configured to implement the method steps of any of the above embodiments when executing the program stored in the memory 903.

When the electronic device is a terminal, the processor 901 is configured to implement the steps of the bullet screen display method according to any of the embodiments when executing the program stored in the memory 903; when the electronic device is a server, the processor 901 is configured to implement the steps of the bullet screen generating method according to any of the embodiments when executing the program stored in the memory 903.

As can be seen, in the scheme provided in the embodiment of the present invention, when the electronic device is a terminal, target linkage information corresponding to a playing time point is obtained based on the playing time point of a currently played multimedia content, where the target linkage information is predetermined description information for identifying a multimedia segment in the currently played multimedia content that meets a preset special effect display condition, and the target linkage information includes target picture information and/or target audio information, and further, the terminal can determine a target special effect corresponding to the target linkage information according to the target linkage information and a corresponding relationship between the preset linkage information and the special effect, and display a bullet screen corresponding to the playing time point by using the target special effect. According to the scheme, when the bullet screen corresponding to the playing time point of the currently played multimedia content is displayed, the corresponding target linkage information can be determined based on the playing time point, the target special effect is determined according to the target linkage information and the corresponding relation between the preset linkage information and the special effect, and then the bullet screen corresponding to the playing time point is displayed by adopting the target special effect. Therefore, the terminal can adopt the special effect display barrage corresponding to the multimedia clip, the display form of the barrage is increased, the barrage is linked with the audio content and/or the picture content of the currently played multimedia content, and the user experience is improved.

The method comprises the steps that under the condition that the electronic equipment is a server, bullet screens corresponding to multimedia content and bullet screen generation time can be obtained, each bullet screen is divided into a plurality of bullet screen packages according to the bullet screen generation time and preset duration of each bullet screen, whether predetermined linkage information exists in the duration corresponding to each bullet screen package is determined, wherein the linkage information is used for identifying description information of multimedia fragments meeting preset special effect display conditions in the multimedia content, and the linkage information comprises picture information and/or audio information. And if so, generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information. Therefore, when the subsequent terminal plays the multimedia content, the target linkage information corresponding to the playing time point can be quickly and accurately acquired, and then the bullet screen is displayed by adopting the special effect corresponding to the multimedia segment, so that the display form of the bullet screen is increased, the linkage of the bullet screen and the audio content and/or the picture content of the currently played multimedia content is realized, and the user experience is improved.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In a further embodiment provided by the present invention, a computer-readable storage medium is also provided, in which a computer program is stored, which, when being executed by a processor, realizes the method steps of any one of the above-mentioned embodiments.

In a further embodiment provided by the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the methods of the above embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus, the terminal, the computer-readable storage medium and the computer program product, since they are substantially similar to the method embodiments, the description is relatively simple, and in relation to the description, reference may be made to part of the description of the method embodiments.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A bullet screen display method is characterized in that the method is suitable for a bullet screen display terminal and comprises the following steps:

acquiring target linkage information corresponding to a playing time point based on the playing time point of the currently played multimedia content, wherein the target linkage information is predetermined description information used for identifying a multimedia segment which accords with a preset special effect display condition in the currently played multimedia content, and the target linkage information comprises target picture information and/or target audio information;

2. The method according to claim 1, wherein the step of obtaining the target linkage information corresponding to the playing time point based on the playing time point of the currently played multimedia content comprises:

3. The method according to claim 2, wherein before the step of determining whether the target motion information corresponding to the playing time point exists in the pre-acquired barrage package, the method further comprises:

and receiving the bullet screen package returned by the server based on the playing progress.

4. The method according to any one of claims 1-3, further comprising:

5. A bullet screen generation method is applicable to a bullet screen generation server and comprises the following steps:

and if so, generating a bullet screen package based on the bullet screen corresponding to the duration and the linkage information.

6. The method of claim 5, further comprising:

7. The method of claim 5, further comprising:

and storing the bullet screen to be processed to a bullet screen package corresponding to the generation time based on the generation time.

8. The method according to any one of claims 5 to 7, wherein the linkage information is determined in a manner including:

and inputting the multimedia content into a pre-trained linkage information identification model, and identifying to obtain linkage information based on the picture and/or audio of the multimedia content, wherein the linkage information identification model is obtained by pre-training based on a multimedia sample and a linkage information label.

9. The utility model provides a bullet curtain display device which characterized in that, the device is applicable to bullet curtain display terminal, includes:

10. A bullet screen generating device, wherein the device is suitable for a bullet screen generating server, comprising:

the system comprises a linkage information determining module, a display module and a display module, wherein the linkage information determining module is used for determining whether predetermined linkage information exists in a duration corresponding to each bullet screen package, the linkage information is used for identifying the description information of the multimedia fragments meeting the preset special effect display conditions in the multimedia contents, and the linkage information comprises picture information and/or audio information;

11. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any one of claims 1 to 4 or 5 to 8 when executing a program stored in the memory.

12. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 4 or 5 to 8.