CN116484031A

CN116484031A - Multimedia interaction method, device, storage medium and equipment

Info

Publication number: CN116484031A
Application number: CN202210058849.9A
Authority: CN
Inventors: 杨光; 张蕊; 文小飞; 卢晨阳
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2022-01-17
Filing date: 2022-01-17
Publication date: 2023-07-25

Abstract

The embodiment of the invention discloses a multimedia interaction method, a device, a storage medium and equipment, and can be applied to vehicle-mounted scenes. The method comprises the following steps: displaying target multimedia in a presentation area of a multimedia display interface; generating and publishing associated multimedia in response to the participation operation for the target multimedia; and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface, wherein the associated multimedia and the target multimedia form a first associated multimedia group. By the method and the device, the interactivity between the watching object and the release object of the target multimedia can be enhanced.

Description

Multimedia interaction method, device, storage medium and equipment

Technical Field

The present disclosure relates to the field of video technologies, and in particular, to a method, an apparatus, a storage medium, and a device for multimedia interaction.

Background

With the continuous development of networks, viewing multimedia (such as video, image, text) through networks is becoming an indispensable way to acquire information or entertainment in people's life. At present, a template corresponding to the multimedia needs to be generated to realize interaction with the multimedia release object, the interaction mode is fixed, and the interaction is relatively poor. For example, when the publishing object publishes the original video, a template of the original video needs to be generated, the viewing object needs to generate an updated video according to the template of the original video, and attribute information (such as background music and playing length) of the updated video must be the same as that of the original video, so that the flexibility of interaction is low, and further, the interactivity is poor.

Disclosure of Invention

The technical problem to be solved by the embodiments of the present application is to provide a data processing method, apparatus, storage medium and device, which enhance interactivity between a viewing object and a publishing object of a target multimedia.

An aspect of an embodiment of the present application provides a multimedia interaction method, including:

displaying target multimedia in a presentation area of a multimedia display interface;

generating and publishing associated multimedia in response to the participation operation for the target multimedia;

and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface, wherein the associated multimedia and the target multimedia form a first associated multimedia group.

An aspect of an embodiment of the present application provides a multimedia interaction device, including:

the first display module is used for displaying target multimedia in a presentation area of the multimedia display interface;

the generation module is used for responding to the participation operation aiming at the target multimedia, generating and publishing the associated multimedia;

and the second display module is used for displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface, and the associated multimedia and the target multimedia form a first associated multimedia group.

In one aspect, a computer device is provided, including: a processor and a memory;

the processor is connected to the memory, wherein the memory is configured to store a computer program, and when the computer program is executed by the processor, the computer device is caused to execute the method provided in the embodiment of the application.

In one aspect, the present application provides a computer readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having the processor performs the method provided in the embodiments of the present application.

In one aspect, the present application provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the method provided in the embodiments of the present application.

In the embodiment of the application, by displaying the target multimedia in the presentation area of the multimedia display interface, when the participation object (i.e. the viewing object) interacts with the target multimedia, the computer device may generate and issue the associated multimedia in response to the participation operation for the target multimedia, where the associated multimedia may include one or more of video, text, image data, voice data, and special effects. Further, the associated multimedia associated with the target multimedia may be displayed in the presentation area of the multimedia display interface, the associated multimedia and the target multimedia form a first associated multimedia group, and interaction between objects corresponding to multimedia in the associated multimedia group may be achieved. The format and the content of the associated multimedia are not limited, so that the flexibility of interaction can be improved, and the interactivity and interestingness between the watched object and the released object of the target multimedia are enhanced.

Drawings

In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic architecture diagram of a multimedia interaction system according to an embodiment of the present application;

fig. 2 is a schematic application scenario diagram of a multimedia interaction according to an embodiment of the present application;

fig. 3 is a flow chart of a multimedia interaction method according to an embodiment of the present application;

FIG. 4 is a schematic diagram of displaying target multimedia in a multimedia display interface according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a media interactive interface according to an embodiment of the present application;

FIG. 6 is a schematic diagram of generating associated multimedia provided by an embodiment of the present application;

FIG. 7 is a schematic diagram showing associated multimedia according to an embodiment of the present application;

FIG. 8 is a schematic diagram showing associated multimedia according to an embodiment of the present application;

FIG. 9 is a schematic diagram showing associated multimedia provided in an embodiment of the present application;

fig. 10 is a flow chart of a multimedia interaction method according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a comment detail information interface provided by an embodiment of the present application;

FIG. 12 is a schematic diagram of a multimedia interaction provided by an embodiment of the present application;

fig. 13 is a schematic structural diagram of a multimedia interaction device according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a multimedia interaction system according to an embodiment of the present application. As shown in fig. 1, the multimedia interaction system may comprise a server 10 and a cluster of user terminals. The cluster of user terminals may comprise one or more user terminals, the number of which will not be limited here. As shown in fig. 1, the user terminals 100a, 100b, 100c, …, and 100n may be specifically included. As shown in fig. 1, the user terminals 100a, 100b, 100c, …, 100n may respectively perform network connection with the server 10, so that each user terminal may perform data interaction with the server 10 through the network connection.

Wherein each user terminal in the user terminal cluster may include: smart phones, tablet computers, notebook computers, desktop computers, wearable devices, smart home, head-mounted devices, vehicle-mounted terminals and other intelligent terminals with multimedia interaction. It should be appreciated that each user terminal in the cluster of user terminals shown in fig. 1 may be provided with a target application (i.e. application client) that, when running in each user terminal, may interact with the server 10 shown in fig. 1, respectively, as described above.

As shown in fig. 1, the server 10 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, basic cloud computing services such as big data and artificial intelligence platforms, and the like.

For easy understanding, in the embodiment of the present application, one user terminal may be selected from the plurality of user terminals shown in fig. 1 as a target user terminal, where the target user terminal may include: smart terminals carrying multimedia interaction functions, such as smart phones, tablet computers, notebook computers, desktop computers, smart televisions, and the like. For example, for ease of understanding, the embodiment of the present application may use the user terminal 100a shown in fig. 1 as a target user terminal, where the user terminal 100a may obtain the target multimedia pulled in the server 10, where the target multimedia may refer to any multimedia such as text, image, audio, and video related to life, hobbies, publicity, and the like uploaded by a participating object. The user terminal 100a may display (e.g., play) the target multimedia in a presentation area of a multimedia display interface of the user terminal 100a so that the held object or other participating objects of the user terminal 100a are viewed. Further, in the process of watching the target multimedia, the participating object can implement the participating operation for the target multimedia, publish the interactive data for the target multimedia, and then interact with the publishing object of the target multimedia.

Further, the user terminal 100a may obtain, in response to the participation of the participation object in the target multimedia, interaction data obtained by the participation of the participation object, and create the associated multimedia according to the interaction data. Wherein, the participation operation may refer to a comment operation, a modification content operation, an addition content operation, an update content operation, and the like. After the user terminal 100a creates the associated multimedia associated with the target multimedia, the associated multimedia may be distributed and transmitted to the server 10. The server 10 may audit and store the associated multimedia, generate an access interface corresponding to the associated multimedia, and transmit the access interface to the user terminal 100a. The user terminal 100a may display the associated multimedia associated with the target multimedia on the multimedia display interface through the access interface of the associated multimedia, the associated multimedia and the target multimedia forming a first associated multimedia group. In this way, the publishing object of the target multimedia and other participating objects view the multimedia in the first associated multimedia for consumption (e.g. viewing), i.e. the participating objects may consume the associated multimedia associated with the target multimedia in the first associated multimedia group when consuming the target multimedia, from single multimedia consumption to multiple multimedia consumption in the conventional art. Therefore, the display effect of the multimedia can be increased, the interaction effect between the target multimedia and the associated multimedia is also enhanced, and the interaction between the participation object and the release object of the target multimedia is further improved.

For easy understanding, further, please refer to fig. 2, fig. 2 is a schematic view of an application scenario of multimedia interaction provided in an embodiment of the present application. The target multimedia may be a target video sent by a participating user, the associated multimedia may be a comment video for comment on the target video, and the participating operation may be a comment operation. The server 20c shown in fig. 2 may be the server 10 described above. As shown in fig. 2, the participating object a may view, on the multimedia display interface 20a displayed on the target user terminal held by the participating object a, the target video published by the object 1 (the nickname of the object 1 is "nickname"). The target user terminal held by the participating object a may be any one of the user terminals in the user terminal cluster illustrated in fig. 1, for example, the target user terminal held by the participating object a may be the user terminal 100b. As shown in fig. 2, a comment control is displayed in the multimedia display interface, and when the participation object a wants to interact with the target video published by the object 1, the comment control in the multimedia display interface can be clicked, so as to trigger the participation operation on the target video. The target user terminal may display the media interactive interface 20b in response to a participation operation of the participation object a with respect to the target video in the multimedia display interface. One or at least two comment data acquisition controls, which are controls for acquiring comment data, may be included in the media interactive interface 20b. The comment data acquisition control can be displayed in the form of buttons, icons and the like in the media interactive interface, and the comment data acquisition control can comprise one or more of a voice control, a text control, a shooting control and a local media data selection control. If the participant a needs to input comment data of a video type, a selection operation can be performed on a shooting control in the media interaction interface, and accordingly, the target user terminal can respond to the selection operation of the participant a on the shooting control, acquire shooting videos acquired based on the shooting control, and determine the shooting videos acquired through shooting as comment data acquired through clicking operation of the participant a on the comment control in the multimedia display interface. The target user terminal may send the comment data to the server 20c, and the server 20c may perform video conversion on the comment data to obtain a comment video (i.e., associated multimedia) associated with the target video (i.e., target multimedia), and return the associated multimedia to the target user terminal. The target user terminal may display object information of the participation object a, such as a head portrait icon 20e of the participation object a, on the multimedia display interface 20 d. When the head portrait icon 20e of the participation object a is clicked, the comment video posted by the participation object a is displayed. It can be seen that by generating associated multimedia (i.e., comment video) in response to a participation operation for a target multimedia, and displaying the associated multimedia associated with the target multimedia in a multimedia display interface. Therefore, the video mode is adopted to comment on the target video, the picture sense of video display is strong, more information can be displayed, the display effect of comment data aiming at the target multimedia can be improved, and the interactivity of participation objects aiming at the target multimedia is further improved, namely the interactivity and interestingness between watching objects and release objects of the target multimedia are enhanced.

Referring to fig. 3, fig. 3 is a flowchart of a multimedia interaction method according to an embodiment of the present application. The multimedia interaction method can be executed by any user terminal in fig. 1, can be executed by a server in fig. 1, and can also be executed by any user terminal and server in fig. 1 together, and the devices for executing the method in this application can be collectively called as computer devices. As shown in fig. 3, the multimedia interaction method may include, but is not limited to, the following steps:

s101, displaying target multimedia in a presentation area of a multimedia display interface.

Specifically, the computer device may display the target multimedia in a presentation area of a multimedia display interface of the multimedia application; the multimedia application may refer to a voice multimedia play application, a multimedia live application, a short multimedia application, a social application, a content sharing application, and so on. The target multimedia may be edited by the publishing object for the movie data, or the target multimedia may be downloaded by the publishing object from the network; alternatively, the target multimedia may be captured by the publishing object, for example, the target multimedia is multimedia data for recording information of daily life, travel track, food course, daily wearing, etc. of the publishing object. By displaying the target multimedia in the multimedia display interface, the participant corresponding to the computer device can view the target multimedia and comment on the target multimedia. The multimedia display interface comprises a presentation area, a participation object area, an editing control area associated with the target multimedia and the like.

Alternatively, the computer device may carry the original multimedia and associated multimedia related to the original multimedia in the manner of an associated multimedia group, that is, multimedia located within the same associated multimedia group in a first direction of the page view and multimedia located within a different associated multimedia group in a second direction of the page view. An associated multimedia group includes an original multimedia and associated multimedia with the original multimedia, where the original multimedia may refer to multimedia data uploaded to a multimedia application by a publishing object, and the associated multimedia associated with the original multimedia refers to multimedia data obtained by a participation operation of a participation object on the original multimedia, where the target multimedia belongs to the original multimedia in any associated multimedia group. The first direction may refer to a transverse direction or a longitudinal direction, and the second direction is perpendicular to the first direction, e.g., when the first direction is transverse, the second direction is longitudinal; when the first direction is longitudinal, the second direction is transverse. The computer device may display the target multimedia in a presentation area of the multimedia display interface in a manner that associates the multimedia groups; specifically, the target multimedia belongs to the first multimedia group, and the computer device may display the target multimedia in any one of the following three modes or in a combination mode of at least two of the three modes:

In the first display mode, the computer equipment displays the target multimedia in the first associated multimedia group in the presentation area of the multimedia display interface, plays the target multimedia, and circularly plays the target multimedia when the target multimedia is played.

And displaying the target multimedia in the first associated multimedia group in a presentation area of the multimedia display interface by the computer equipment in a second display mode, playing the target multimedia, and when the target multimedia is played, sequentially displaying and playing the associated multimedia in the first associated multimedia group according to the multimedia attribute information of the associated multimedia, and when the associated multimedia in the first associated multimedia group is played, circularly displaying and playing the target multimedia.

And displaying, by the computer device, the multimedia in the second associated multimedia group in the page view on the presentation area of the multimedia display interface, and displaying the target multimedia in the first associated multimedia group on the multimedia display interface in response to a triggering operation on the multimedia in the second associated multimedia group in the second direction. The first associated multimedia group refers to an associated multimedia group whose display order is located after the display order of the second associated multimedia group in the page view, and the display order of the associated multimedia group may be determined according to one or more of a generation time of original multimedia in the associated multimedia group, a generation time of associated multimedia, and a degree of association of a participation object corresponding to the computer device.

The computer device may further display object information of a post object of the target multimedia and multimedia attribute information of the target multimedia on a presentation area of the multimedia display interface, where the object information of the post object includes an avatar, a name, and the like of the post object, and the multimedia attribute information of the target multimedia includes a post time of the target multimedia, an operation control of the target multimedia, and the operation control includes a comment control, a collection control, a praise control, and the like. When the target multimedia has associated multimedia, the computer device may further display object information of a target participation object, which is an object of the associated multimedia that triggers a participation operation for the target multimedia and is associated with the target multimedia, including an avatar of the target participation object and a name of the target participation object, and the like, on the multimedia display interface.

Fig. 4 is a schematic diagram of displaying target multimedia in a multimedia display interface according to an embodiment of the present application, where, as shown in fig. 4, the target multimedia may refer to a target video published by an object 1, and the associated multimedia associated with the target multimedia may refer to a comment video for comment on the target video. When the participating object triggers a play operation for the target multimedia, the computer device may display a target video 40a in a presentation area of the multimedia display interface, the target video 40a being a video in which the object 1 publishes information about life, publicity, and the like. The computer device may display the object information corresponding to the object 1 in a multimedia display interface, as shown in fig. 4, in which the object avatar of the object 1 and the object nickname 40b are displayed. As shown in fig. 4, a participation object region 40c including a posting object 1 of the posting target video 40a and target participation objects, that is, an object 2 and an object 3, which implement participation operations with respect to the target video 40a, whose display order of object information can be determined by the posting time of the corresponding comment video are also displayed in the multimedia display interface. As shown in fig. 4, the participation operation for the target video may refer to a comment operation, and a comment control 40d may also be displayed in the multimedia display interface, where when the participation object may implement the triggering operation for the comment control 40d (such as clicking on the comment control), a comment video for comment on the target video is posted. As shown in fig. 4, a "dislike" control may also be displayed in the multimedia display interface, and when the participant clicks on the "dislike" control, the computer device will not recommend the target video to the participant and will not recommend the same type of video to the participant. As shown in fig. 4, a "heart" control is also displayed in the multimedia display interface, and when the participant clicks the "heart" control, the computer device may add the corresponding target video to the cardiac video set of the participant, and recommend the same type of video to the participant. The multimedia display interface also displays a collection control, and when the participation object clicks the collection control, the computer equipment can add the corresponding target video to the video collection set of the participation object. The multimedia display interface displays a first page control, and when the participation object clicks the first page control, the computer equipment can perform page jump to the first page interface. Also displayed in the multimedia display interface is a "My" control, which when clicked by the participant object, the computer device may page switch to the "My" interface.

S102, generating and publishing the associated multimedia in response to the participation operation for the target multimedia.

Specifically, when the participating object browses the target multimedia on the multimedia display interface, the participating operation for the target multimedia can be implemented, the multimedia data can be input, and the participating object interacts with the publishing object of the target multimedia. The computer device may obtain multimedia data input by the participation object in response to the participation operation of the participation object on the target multimedia, and generate the associated multimedia according to the multimedia data. In addition, the publishing object of the target multimedia may also implement a participation operation for the target multimedia, generate an associated multimedia associated with the target multimedia, and when the publishing object implements the participation operation for the target multimedia, use the publishing object as a target participation object, that is, after uploading the target multimedia, implement the participation operation (such as comment operation) for the target multimedia uploaded by the publishing object.

The target multimedia may refer to target voice data, and the generated associated multimedia may refer to associated voice data, so that the computer device obtains the participation operation of the target participation object on the target multimedia, and after the input multimedia data, the multimedia data may be converted into the associated voice data. The first voice association group is formed according to the target voice data and the associated voice data, so that single voice consumption is changed into multiple voice consumption, information interaction between the participating object and the publishing object is facilitated, and the interactivity between the participating object and the publishing object is improved. The generated associated multimedia can refer to an associated video, so that after the computer equipment obtains the participation operation of the target participation object on the target multimedia, the input multimedia data can be converted into the associated video, a new interaction mode adopting a video reply video is formed, the characteristics of strong video picture sense and capability of displaying more information are utilized, the display effect of the associated multimedia of the target multimedia can be improved, the information interaction between the participation object and the release object is facilitated, and the interaction between the participation object and the release object is further improved.

Optionally, the above participation operation for the target multimedia may refer to: the participation operation directed to the target multimedia or the participation operation directed to the history associated multimedia of the target multimedia may refer to the associated multimedia before the target multimedia is displayed by the computer device. For example, the publishing object of the target multimedia is an object a, the target participation object corresponding to the history associated multimedia of the target multimedia is an object B, the participation object corresponding to the computer device is an object C, when the object C may perform the participation operation on the history associated multimedia, the participation operation performed by the object C on the history associated multimedia may be referred to as the participation operation on the target multimedia, and further, comment data obtained by the participation operation performed by the object C on the history associated multimedia may be referred to as comment data on the target multimedia.

Optionally, the participation operation for the target multimedia may refer to a comment operation, and the multimedia display interface may include a comment control, where when the participation object needs to comment on the target multimedia, the participation object may trigger the comment control in the multimedia display interface to implement the participation operation for the target multimedia. Optionally, when the participant needs to comment on the target multimedia, the participant may implement the participation operation for the target multimedia by using a voice call mode of a specific sentence. Of course, the participation object triggers the participation operation for the target multimedia in other manners, and the embodiment of the present application is not limited herein.

Optionally, after the target participation object triggers the participation operation for the target multimedia, comment data of the associated multimedia can be generated through forms of video, local media data, voice, text and the like. When the participation object triggers the participation operation for the target multimedia, the participation object triggering the participation operation can be taken as the target participation object.

Alternatively, the target participant may generate the associated multimedia in the form of a captured video. The specific manner in which the computer device makes and publishes the associated multimedia in response to the participation operation for the target multimedia may include: responding to the participation operation aiming at the target multimedia, and displaying a shooting control on a media interaction interface; and responding to the selection operation of the shooting control, and acquiring shooting multimedia shot based on the shooting control. And generating the associated multimedia comprising the shot video, and publishing the associated multimedia comprising the shot video.

Specifically, when the participation object triggers the participation operation for the target multimedia, the computer device may respond to the participation operation for the target multimedia, display the shooting control on the media interaction interface, and also display other acquisition controls (such as a voice control, a text control, etc.) in the media interaction interface. The target participant may perform a selection operation for the shooting control, e.g., the participant may click on the shooting control on the media interactive interface, triggering a shooting operation for comment data. The computer equipment can respond to the selection operation of the target participation object for the shooting control, display a data acquisition interface corresponding to the shooting control, acquire shooting videos shot by the shooting control, and display the shooting videos in the data acquisition interface corresponding to the shooting control. When the computer equipment detects that shooting is finished, generating associated multimedia comprising the shooting video, for example, determining the shooting video obtained by shooting as the associated multimedia, and distributing the associated multimedia comprising the shooting video. When the target participation object selects the shooting control, the computer equipment defaults to start the front camera, and displays the face-based face shielding prop to protect the privacy of the target participation object. Of course, the target participant may trigger an operation to close the face mask prop, closing the face mask prop. In addition, when the target participation object shoots, the functions of beautifying, adjusting focal length, brightness and the like can be selected to be started, and the convenience and experience of recording comment data of a user can be improved.

Optionally, the specific manner of generating the associated multimedia including the captured video by the computer device may include: and acquiring video description information matched with the shot video, and adding the video description information into the shot video to obtain associated multimedia comprising the shot video.

Specifically, the computer device may obtain video description information matched with the shot video, where the video description information refers to multimedia theme text, background music, and the like. The computer equipment can perform image recognition on the shot video to obtain a video theme corresponding to the shot video. Further, according to the video theme, the computer equipment can acquire target video theme characters corresponding to the shot video from a theme character library, and acquire background music corresponding to the target of the spliced image data from a background music library. Further, video description information (namely target video theme text and target background music) is added into the shooting video to obtain associated multimedia comprising the shooting video.

Optionally, when the computer device detects that the target participating object is continuously pressed against the shooting control, shooting is started, and shooting video obtained through shooting is displayed in a data acquisition area corresponding to the shooting control. When the computer equipment detects the loosening operation of the target participation object on the shooting control, shooting is stopped, and the shot video obtained through shooting is determined to be associated with the multimedia.

Optionally, the shooting control may include an opening shooting control and an ending shooting control, and when the target participant performs a triggering operation for starting the shooting control, the computer device may respond to the opening operation of the target participant for starting the shooting control, and display a shot video obtained by shooting in a data acquisition interface corresponding to the shooting control. When the target participant performs the triggering operation for the end shooting control, the computer device may acquire the shooting video obtained based on the shooting control in response to the triggering operation for the end shooting control of the target participant, and determine the shooting video obtained based on the shooting control as the associated multimedia.

Alternatively, the target participant may generate the associated multimedia in the form of speech. The specific manner in which the computer device makes and publishes the associated multimedia in response to the participation operation for the target multimedia may include: responding to the participation operation aiming at the target multimedia, and displaying a voice control on a media interaction interface; and responding to the selection operation of the voice control, acquiring input voice data input based on the voice control, generating associated multimedia comprising the input voice data, and publishing the associated multimedia comprising the input voice data.

Specifically, the computer device may respond to the participation operation for the target multimedia, display a voice control on the media interaction interface, and may also display other collection controls (such as shooting controls), where the target participation object may select to collect comment data for the target multimedia using the voice control. The computer device may respond to the selection operation for the voice control, display a data acquisition interface corresponding to the voice control, and start a recording function, acquire input voice data input by the target participant object, and generate associated multimedia including the input voice data, e.g., determine the input voice data input based on the voice control as associated multimedia, and issue associated multimedia including the input voice data.

Optionally, when the computer device detects that the target participation object continuously presses the voice control, input voice data input by the target participation object is continuously collected. When the computer equipment detects that the target participation object presses against the end of the voice control, the input voice data input by the target participation object is collected, and the input voice data input based on the voice control is determined to be associated with the multimedia.

Optionally, the voice control may also include a voice start control and a voice end control, where when the target participant object triggers the voice start control, the collection of input voice data input by the target participant object is started. When the target participation object triggers the voice ending control, the collection of the input voice data input by the target participation object is stopped, and the collected input voice data is determined to be associated with the multimedia.

Optionally, the specific manner in which the computer device generates the associated multimedia including the input voice data may include: performing text conversion processing on input voice data to obtain converted text data; generating a first text background image according to the converted text data; and synthesizing the input voice data and the first text background image to obtain the associated multimedia for commenting on the target multimedia.

Specifically, after the computer device obtains the input voice data input by the target participant, text conversion processing may be performed on the input voice data, so as to obtain corresponding converted text data in the input voice data. Further, the computer device may add the converted text data to an initial image, to obtain a first text background image corresponding to the converted text data, where the initial image may refer to a blank image or an image to which a background color or pattern is added. Further, the computer device may synthesize the first text background image as a background image with the input voice data to obtain an initial associated multimedia, and generate an associated multimedia including the input voice data according to the initial associated multimedia.

Alternatively, the target participant object may generate the associated multimedia in the form of a local media data selection. The specific manner in which the computer device makes and publishes the associated multimedia in response to the participation operation for the target multimedia may include: responding to the participation operation aiming at the target multimedia, and displaying a local media data selection control on a media interaction interface; and responding to the selection operation of the local media data selection control, acquiring the local media data selected based on the local media data selection control, generating associated multimedia comprising the local media data, and publishing the associated multimedia comprising the local media data.

Specifically, the computer device may display a local media data selection control on the media interactive interface in response to the participation operation for the target multimedia, and may also display other acquisition controls (e.g., a shooting control, a voice control, etc.). Further, the target participant object may select any one of the collection controls displayed in the media interactive interface to collect comment data. When the target participant object selects the local media data selection control, the computer device may output the local media data stored in the user terminal held by the target participant object in response to a selection operation of the target participant object for the local media data selection control. The target participating object may select local media data for interaction with the target multimedia from among the local media data stored in the user terminal held by the target participating object. The computer device may obtain local media data obtained by multi-selection based on the local media data selection control in response to a selection operation of the target participation object for the local media data, generate associated multimedia including the local media data according to the local media data, e.g., determine the local media data obtained based on the local media data selection control as associated multimedia including the local media data, and issue associated multimedia including the local media data.

Optionally, the local media data includes at least two pieces of image data, generating the associated multimedia including the local media data may refer to associating a video, and after the computer device obtains the at least two pieces of image data selected by the target participation object, the at least two pieces of image data may be subjected to stitching processing, so as to obtain stitched image data. Further, the computer device may obtain image description information matched with the stitched image data, where the image description information refers to image subject text, background music, and the like. The computer equipment can perform image recognition on the spliced image data to obtain a target theme corresponding to the spliced image data. Further, according to the target theme, the computer device may obtain target theme words corresponding to the stitched image data from a theme word library, and obtain target background music corresponding to the stitched image data from a background music library. Further, the computer device may perform video conversion on the stitched image data to obtain a stitched video, add the target theme text and the target background music to the stitched video, generate an initial associated video, and determine, according to the initial associated video, to generate an associated video including the local media data. Optionally, in order to ensure the quality of the generated associated video, the number of at least two pieces of image data may be limited to be less than or equal to a target number threshold, where the target number threshold may be determined according to device attribute information of the terminal device or video viewing effect, or may be set according to a specific situation, and the application is not limited. For example, if the video watching effect is better when the duration of the associated video does not exceed 30s, the video duration of each image data may be determined according to the duration of 30s, and the target number threshold may be determined according to the video duration of each image data.

Optionally, the local media data includes at least two pieces of image data, generating the associated multimedia including the local media data may refer to associating a video, and after the computer device obtains the at least two pieces of image data selected by the target participation object, each piece of image data in the at least two pieces of image data may be converted into a video with a duration of a target second (for example, 3 seconds). And the computer equipment splices videos corresponding to each piece of image data to obtain an initial associated video, and determines the initial associated video to generate the associated video comprising the local media data.

Optionally, the local media data comprises local multimedia data, and when the target participant object selects the local multimedia data, the computer device may detect whether the local multimedia data selected by the target participant object satisfies the target condition. If the computer equipment detects that the local multimedia data does not meet the target condition, the local multimedia data is adjusted according to the target condition, the local multimedia data is adjusted to be standard multimedia meeting the target condition, the standard multimedia is determined to be initial associated multimedia, and the initial associated multimedia is determined to be associated multimedia.

Specifically, when the associated multimedia is video or audio, the target condition may be to satisfy the target duration. The computer equipment can detect whether the multimedia duration of the local multimedia data selected by the target participation object meets the target duration, if the local multimedia data selected by the target participation object does not meet the target duration, the local multimedia data selected by the target participation object is adjusted, and the local multimedia is adjusted to be the initial associated multimedia meeting the target duration. For example, when the associated multimedia is video and the target duration is 3 seconds to 30 seconds, if the local multimedia data selected by the target participant is 40 seconds, a prompt message is output to prompt adjustment of the local multimedia data, and the adjusted local multimedia data is obtained. Alternatively, the computer device may detect the multimedia quality of multimedia frames of the local multimedia data, delete multimedia frames whose multimedia quality does not meet the criteria, and adjust the local multimedia data to an initial associated multimedia that meets the target duration.

Specifically, when the associated multimedia is video, the target condition may be to satisfy the target resolution. The computer device may detect whether the multimedia resolution of the local multimedia data selected by the target participant object meets the target resolution, and if the multimedia resolution of the local multimedia data selected by the target participant object does not meet the target resolution, adjust the local multimedia data to an initial associated multimedia meeting the target resolution. For example, the target resolution is 1080p x 1080p, if the multimedia resolution of the local multimedia data selected by the target participant does not meet the target resolution (e.g., is greater than or less than the target resolution), the multimedia resolution of the local multimedia data is adjusted, and the local multimedia data is adjusted to an initial associated video that meets the target resolution.

Specifically, when the associated multimedia is video, the target condition may be to satisfy the target multimedia frame rate. The computer device may detect whether the multimedia resolution of the local multimedia data selected by the target participant object meets the target multimedia frame rate, and if the multimedia frame rate of the local multimedia data selected by the target participant object does not meet the target multimedia frame rate, adjust the local multimedia data to an initial associated multimedia meeting the target multimedia frame rate. For example, the target resolution is 30 frames, if the multimedia frame rate of the local multimedia data selected by the target participant does not meet the target multimedia frame rate (e.g., is greater than or less than the target multimedia frame rate), the multimedia frame rate of the local multimedia data is adjusted, and the local multimedia data is adjusted to be associated multimedia.

Alternatively, the target participant object may generate the associated multimedia in the form of text input. The specific manner in which the computer device may make and distribute the associated multimedia in response to the participation operation for the target multimedia may include: responding to the participation operation aiming at the target multimedia, and displaying a text input control on a media interaction interface; and responding to the selection operation of the text input control, acquiring input text data input based on the text input control, generating associated multimedia comprising the input text data, and publishing the associated multimedia comprising the input text data.

Specifically, the computer device may display text input controls on the media interactive interface in response to the participation operation for the target multimedia, and may also display other acquisition controls. When the target participant object selects a text input control in the media interactive interface, the computer device may input a text input box in response to a selection operation for the text input control. The target participation object may input text data in the text input box, and when the target participation object input is completed, the computer device may acquire the input text data input based on the text input control, determine the input text data as associated multimedia including the input text data, and issue associated multimedia including the input text data.

Optionally, after obtaining the input text data input by the target participation object, the specific manner of generating the associated multimedia including the input text data may include: performing voice conversion processing on the input text data to obtain converted voice data, and generating a second text background image according to the input text data; and synthesizing the converted voice data and the second text background image to obtain the associated multimedia comprising the input text data.

Specifically, the computer device may perform a voice conversion process on the input text data to obtain converted voice data corresponding to the input text data, and add the input text data to an initial image to obtain a second text background image corresponding to the input text data, where the initial image may refer to a blank image or an image added with a background color and a pattern. Further, the computer device may determine the second text background image as a background image, and synthesize the second text background image with the converted speech data to obtain an initial associated multimedia, and generate an associated multimedia including the input text data according to the initial associated multimedia.

Optionally, the computer device may respond to the participation operation for the target multimedia by pulling the media interaction interface, covering the media interaction interface on the multimedia display interface for displaying the target multimedia currently, and displaying one or more acquisition controls of the shooting control, the voice control, the text control, the local media data selection control, and the like on the media interaction interface. The target participation object can select one target acquisition control (any one of a plurality of acquisition controls such as a shooting control and a voice control) from the one or more acquisition controls, the computer equipment can respond to the selection operation for the target acquisition control, output a data acquisition area corresponding to the target acquisition control selected by the selection operation, display acquired multimedia data in the data acquisition area corresponding to the target acquisition control, and generate associated multimedia according to the multimedia data acquired in the data acquisition area corresponding to the target acquisition control when the acquisition is finished.

Optionally, the computer device may respond to the participation operation for the target multimedia, quickly pull up the comment distribution interface, and switch the page of the multimedia display interface currently displaying the target multimedia, so as to display the media interaction interface. The computer device may capture one or more capture controls in the media interactive interface, such as a control, a voice control, a text control, and a local media data selection control. The target participation object can select one target acquisition control (any one of a plurality of acquisition controls such as a shooting control and a voice control) from the plurality of acquisition controls, and the computer equipment can respond to the selection operation for the target acquisition control, display a data acquisition area corresponding to the target acquisition control and display comment data acquired by acquisition in the data acquisition area corresponding to the target acquisition control. And when the acquisition is finished, generating associated multimedia according to the multimedia data acquired in the data acquisition area corresponding to the target acquisition control.

Optionally, the specific manner in which the computer device generates the associated multimedia from the initial associated multimedia may include: displaying initial multimedia data in a media interactive interface, responding to editing operation for initial associated multimedia, and displaying editing associated multimedia obtained based on the editing operation; and responding to the triggering operation of the release control in the media interaction interface, and determining the editing associated multimedia displayed in the media interaction interface as the associated multimedia.

Specifically, the computer device may display the initial associated multimedia in the media interactive interface, and the target participant object may edit the initial associated multimedia, such as adding text to the initial associated multimedia, adding a pattern to the initial associated multimedia, adding background music to the initial associated multimedia, and zooming the initial associated multimedia. The computer device may respond to an editing operation of the target participation object for the initial associated multimedia, update the initial associated multimedia based on the editing operation, and display the editing associated multimedia obtained based on the editing operation. If the target participation object adds the target text in the initial associated multimedia, the computer equipment can display the edited associated multimedia after adding the target text. Therefore, the target participation object can customize the initial associated multimedia, and meanwhile, the display effect of the associated multimedia can be increased, so that the interactivity of the associated multimedia is improved. When the target participation object finishes editing, the publishing control in the media interaction interface can be triggered, and the computer equipment can respond to the triggering operation of the target participation object on the publishing control to determine editing associated multimedia currently displayed in the media interaction interface as associated multimedia.

As shown in fig. 5, fig. 5 is a schematic diagram of a media interaction interface provided in an embodiment of the present application, where, as shown in fig. 5, target multimedia may refer to a target video, associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and a participation operation for the target multimedia may refer to a comment operation. As shown in fig. 5, when a participant wants to comment on comment data for a target video 50b when viewing the target video 50b in the multimedia display interface 50a, a participation operation for the target video 50b can be implemented. As shown in fig. 5, the participant object may click on the comment control 50c in the multimedia display interface 50a, and the computer device may determine, as a target participant object, a participant object that transmits a participant operation for the target video in response to a trigger operation of the participant object for the comment control 50, and switch the multimedia display interface 50a to the media interaction interface 50d. As shown in fig. 5, an album control, a shooting control, a voice control and a word control are displayed in the media interactive interface, and when the participant clicks the shooting control, the computer device may display a data acquisition interface corresponding to the shooting control. As shown in fig. 5, when the computer device detects that the target participant object performs continuous pressing on the video capturing control 50e, video capturing is performed, and the captured video data is displayed on the data acquisition interface corresponding to the "capturing" control. When the computer room device detects that the target participant releases the video capturing control 50e, capturing is stopped, and the captured video obtained by capturing is determined as comment video for comment on the target video 50 b.

Fig. 6 is a schematic diagram of generating associated multimedia according to an embodiment of the present application, where, as shown in fig. 6, the target multimedia may refer to a target video, the associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and a participation operation for the target multimedia may refer to a comment operation. When the participation object triggers a participation operation for the target multimedia, the computer device may determine the participation object triggering the participation operation as the target participation object in response to the participation operation triggered by the participation object, and display a media interactive interface. The media interactive interface may include text controls (i.e., text controls), album controls (i.e., local media data selection controls), shooting controls, and voice controls. The target participation object can select the text control, and the computer equipment can respond to the selection operation of the target participation object on the text control to acquire the input text data acquired based on the text control. Further, the computer device may perform video conversion on the input text data to obtain an initial comment video.

Optionally, the target participation object may also select an album control, and the computer device may acquire the local media data acquired based on the album control in response to a selection operation of the target participation object for the album control. Further, the computer device may perform video conversion on the local media data to obtain an initial comment video. Optionally, the target participant may also select a shooting control, and the computer device may obtain a shooting video obtained based on shooting of the shooting control in response to a selection operation of the target participant on the shooting control, and determine the shooting video obtained as an initial comment video. Optionally, the target participation object may also select a voice control, and the computer device may obtain input voice data obtained based on the voice control in response to a selection operation of the target participation object for the voice control. Further, the computer device may perform video conversion on the input voice data to obtain an initial comment video. The target participation object can edit the initial comment video, the computer device can respond to the editing operation of the target participation object on the initial comment video, obtain the edited initial comment video, and determine the edited initial comment video as the comment video for comment on the target video.

And S103, displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface.

In particular, the computer device may display associated multimedia associated with the target multimedia on a presentation area of the multimedia display interface. Wherein the computer device may display associated multimedia associated with the target multimedia on a presentation area of a multimedia display interface comprising the target multimedia. That is, the target multimedia and the associated multimedia of the target multimedia are simultaneously displayed on the presentation area of the multimedia display interface, which is advantageous for the target participant to compare the target multimedia with the associated multimedia. Alternatively, the computer device may display the target multimedia update displayed on the presentation area of the multimedia display interface as associated multimedia, that is, only the associated multimedia of the target multimedia is displayed on the multimedia display interface, which is advantageous for the target participant to view the interactive effect for the target multimedia.

Alternatively, when the number of associated multimedia associated with the target multimedia is at least two, the computer device may display the associated multimedia belonging to the target participant on the multimedia display interface, or the computer device may display at least two associated multimedia of the target multimedia in a scrolling manner, such as P first associated multimedia of the target multimedia at a first time, P second associated multimedia of the target multimedia at a second time, P being a positive integer greater than or equal to 1, the associated multimedia belonging to the target object belonging to the first associated multimedia or the second associated multimedia. Alternatively, the computer device may simultaneously display the associated multimedia of the target multimedia (i.e., the thumbnail multimedia obtained by performing the zoom-out process on the associated multimedia) on the multimedia display interface.

Specifically, when the target participation object implements the triggering operation for the publishing control in the media interaction interface, the computer device may acquire the editing associated multimedia currently displayed in the media interaction interface, determine the editing associated multimedia currently displayed as the associated multimedia, and publish the associated multimedia. Further, the computer device may perform a page switch, switch the media interactive interface to a multimedia display interface, and display associated multimedia in the multimedia display interface, the associated multimedia being generated based on multimedia data input by a participation operation of the target participation object. When watching the target multimedia released by the release object, the participation object can generate multimedia data in the forms of video, image, text, voice and the like, and the computer equipment can generate associated multimedia according to the multimedia data, form a multimedia group with the target multimedia and send the multimedia group to the recommendation stream in a combined form. Thus, when the participant object views the target multimedia, the participant object can slide the target multimedia in the first direction to view the associated multimedia corresponding to the target multimedia, so that the interactivity between the participant object and the release object can be improved. Meanwhile, the participant can watch from single target multimedia to multiple multimedia groups (namely, the combination of the target multimedia and the corresponding associated multimedia), so that the experience of watching the multimedia by the participant can be improved. The first direction may refer to the first direction of the page view.

Alternatively, the computer device may display the associated multimedia by responding to a triggering operation for the object information. The specific manner in which the computer device displays the associated multimedia for commenting on the target multimedia in the multimedia display interface may include: displaying object information of a target participation object corresponding to the participation operation in a multimedia display interface; in response to a first operation of object information for a target participant, displaying a target multimedia update on a multimedia display interface as associated multimedia belonging to the target participant; the associated multimedia belonging to the target participation object is produced according to the participation operation of the target participation object on the target multimedia.

Specifically, the computer device may display, in the multimedia display interface, object information of a target participation object corresponding to the participation operation, where the object information may refer to any one or more of information such as a user avatar, a user ID, a user nickname, and a user identifier. When the target participation object, the release object or other participation object clicks on the object information of the target participation object, the computer device may update the currently displayed target multimedia on the multimedia display interface to the associated multimedia belonging to the target participation object in response to the first operation of the object information of the target participation object, that is, the associated multimedia belonging to the target participation object is made according to the participation operation of the target participation object on the target multimedia. The multimedia display interface comprises a participation object area, wherein the participation object area comprises object information arranged according to the distribution time sequence. The object information of the object identification of the first object arranged in the participation object area is the object information of the release object of the release target multimedia, the rest object information is arranged according to the participation time sequence, and meanwhile, the arrangement sequence of the object information can be the automatic play sequence of the associated multimedia released by the corresponding target participation object. It can be understood that the participation object and the release object can click the object information in the participation object area at will, and the computer device can respond to the triggering operation of the participation object and display the associated multimedia corresponding to the object information clicked by the participation object. Thus, the participant can click the object information in the participant area at will to view the associated multimedia of the corresponding object information, and the flexibility of viewing the multimedia by the participant can be improved, so that the experience of viewing the associated multimedia by the participant is improved.

Optionally, the specific manner in which the computer device displays the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface may include: responsive to a second operation in a first direction for the target multimedia in the presentation area, displaying the target multimedia update presented by the presentation area as associated multimedia associated with the target multimedia; or after the target multimedia is played, displaying the associated multimedia associated with the target multimedia in the presentation area.

In particular, the computer device may display the target multimedia update presented by the presentation area as associated multimedia associated with the target multimedia in response to a second operation in a first direction with respect to the target multimedia in the presentation area. Wherein the first direction may refer to a portrait or landscape direction, and the second operation may refer to a sliding operation or a clicking operation, etc. For example, a computer device may display the target multimedia update presented by a presentation area as associated multimedia associated with the target multimedia in response to a left-slide operation in a lateral direction for the target multimedia in the presentation area. Alternatively, the computer device may display the associated multimedia associated with the target multimedia in the presentation area after the target multimedia is played.

Optionally, the specific manner in which the computer device displays the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface may include: and displaying the identification information of the target multimedia and the associated multimedia in a presentation area of the multimedia display interface according to a preset sequence.

Specifically, the computer device may obtain the multimedia attribute information corresponding to the target multimedia and the associated multimedia, where the multimedia attribute information may refer to generation time or release time, or may include a management sequence set by the release object, for example, the associated multimedia corresponding to a certain target participation object is set on top (i.e. arranged in the first) and the preset sequence of the target multimedia and the associated multimedia is determined according to the multimedia attribute information. And displaying the identification information of the target multimedia and the associated multimedia in a presentation area of the multimedia display interface according to a preset sequence.

Optionally, the specific manner that the computer device displays the identification information of the target multimedia and the associated multimedia in the presentation area of the multimedia display interface according to the preset sequence may include: and sequentially arranging and displaying the identification information of the target multimedia and the associated multimedia in the presentation area of the multimedia interface according to the generated time sequence.

Optionally, the number of the associated multimedia is M, M is a positive integer greater than or equal to 2, and the M associated multimedia includes associated multimedia belonging to the target participation object. The computer equipment displays object information of a target participation object corresponding to the participation operation in a multimedia display interface, wherein the object information comprises the following components: determining the display sequence of M associated multimedia according to the multimedia attribute information of the M associated multimedia; according to the display sequence of the M associated multimedia, arranging and displaying object information of target participation objects of the M associated multimedia in a multimedia display interface; the M associated multimedia corresponding objects comprise target participation objects.

Specifically, the number of the associated multimedia is M, the M associated multimedia includes associated multimedia belonging to a target participation object, that is, the number of the associated multimedia for commenting on the target multimedia is multiple, the computer device may obtain multimedia attribute information corresponding to each of the M associated multimedia, where the multimedia attribute information may include generation time or release time of the associated multimedia, or may include management sequence corresponding to each of the M associated multimedia by the release object, for example, the associated multimedia corresponding to a certain target participation object is arranged on top (i.e. arranged in the first state), and so on. Further, the computer device may determine, according to the multimedia attribute information corresponding to each of the M associated multimedia, a display order corresponding to each of the M associated multimedia. The computer device may determine the sequence of the generation time of each associated multimedia as the display sequence corresponding to each associated multimedia. The computer device may determine the sequence of the release time of each associated multimedia as the display sequence corresponding to each associated multimedia. Wherein the computer device may determine a display order of each associated multimedia in combination with a distribution time and a management order of each associated multimedia. Further, the computer device may display, in the multimedia display interface, object information of the target participation objects corresponding to the M associated multimedia respectively in an order of display corresponding to the M associated multimedia respectively. Wherein, the M associated multimedia corresponding objects comprise target participation objects.

Fig. 7 is a schematic diagram of displaying associated multimedia according to an embodiment of the present application, and as shown in fig. 7, when a participating object views a target multimedia 70b in a multimedia display interface 70a, and wants to target associated multimedia of the target multimedia 70b by using an object 4, the user may click on an avatar of the object 4 in a region of the participating object in the multimedia display interface 70 a. The computer device may respond to the clicking operation of the participation object on the head portrait of the object 4 in the participation object area in the multimedia display interface 70a, obtain the associated multimedia of the object 4 for the target multimedia, switch the multimedia display interface 70a to the multimedia display interface 70c, and update and display the target multimedia 70b in the multimedia display interface 70a as the associated multimedia corresponding to the object 4. The display order of the avatar icons corresponding to the object 1, the object 2, the object 3 and the object 4 in the multimedia display interface 70a may be determined by the order of the release time of the corresponding associated multimedia. Therefore, the participant can arbitrarily select comment data of the target participant which the participant wants to view, and the convenience and experience of the participant in viewing the multimedia can be improved.

Alternatively, the computer device may display the associated multimedia by responding to a second trigger operation in the first direction for the target multimedia. The specific manner in which the computer device displays the associated multimedia for commenting on the target multimedia in the multimedia display interface may include: in response to a second operation in the first direction for the target multimedia in the multimedia display interface, the target multimedia update on the multimedia display interface is displayed as associated multimedia for commenting on the target multimedia.

Specifically, when the target participant object, the release object or other participant objects browse the multimedia group corresponding to the target multimedia on the multimedia display interface, by implementing a second operation on the target multimedia in the first direction, for example, when the target multimedia can be slid rightward, leftward, downward or upward, the computer device can display the target multimedia update displayed on the multimedia display interface as the associated multimedia for commenting on the target multimedia. For example, when a target participant object, a published object, or other participant object slides a target multimedia to the left on a multimedia display interface, the computer device may obtain an associated multimedia corresponding to the target multimedia, and display the associated multimedia of the target multimedia. Thus, the participant can slide the target multimedia and the associated multimedia of the target multimedia in the first direction to view the multimedia which the participant wants to view, and the experience of the participant for viewing the multimedia can be improved.

Optionally, the number of associated multimedia is M, M being a positive integer greater than or equal to 2. The specific manner in which the computer device displays the target multimedia update on the multimedia display interface as associated multimedia for commenting on the target multimedia in response to the second operation in the first direction for the target multimedia in the multimedia display interface may include: and determining the display sequence of the M associated multimedia according to the multimedia attribute information of the M associated multimedia. And determining the target associated multimedia with the earliest display sequence from the M associated multimedia. And in response to a second trigger operation in the first direction for the target multimedia in the multimedia display interface, displaying the target multimedia update on the multimedia display interface as target associated multimedia.

Specifically, when the number of associated multimedia corresponding to the target multimedia is M, the M associated multimedia includes associated multimedia belonging to the target participant, and when the computer device detects a second operation on the target multimedia in the first direction, multimedia attribute information of the M associated multimedia is acquired, where the multimedia attribute information may include generation time or release time of the associated multimedia, and may also include a management sequence corresponding to each of the M associated multimedia by the release object. Further, the computer device may determine M determining display orders of the M associated multimedia according to the multimedia attribute information of the M associated multimedia, and determine a target associated multimedia with an earliest display order from the M associated multimedia. Further, the computer device may display the target multimedia update on the multimedia display interface as the target associated multimedia in response to a second trigger operation in the first direction for the target multimedia in the multimedia display interface.

Optionally, the associated multimedia is automatically displayed. The specific manner in which the computer device displays the associated multimedia for commenting on the target multimedia in the multimedia display interface may include: and playing the target multimedia in the multimedia display interface in response to the playing operation for the target multimedia. And when the target multimedia playing is completed, displaying the playing associated multimedia in the multimedia display interface.

Specifically, when the participation object or the release object plays the target multimedia, the computer device may play the target multimedia in the multimedia display interface in response to a play operation for the target multimedia. When the computer equipment detects that the target multimedia playing is finished, the relevant multimedia is displayed and played in the multimedia display interface. It will be appreciated that the computer device may automatically play the associated multimedia when the target multimedia play is completed. Therefore, the associated multimedia corresponding to the target multimedia can be played without manual triggering of the participation object, the display effect of the associated multimedia of the target multimedia can be improved, and the experience of the participation object is improved.

Optionally, when the number of the associated multimedia is M, the M associated multimedia includes associated multimedia belonging to the target participant, and when the playing of the target multimedia is completed, the specific manner of displaying the played associated multimedia in the multimedia display interface by the computer device may include: and determining the playing sequence of the M associated multimedia according to the multimedia attribute information of the M associated multimedia. And when the playing of the target multimedia is completed, displaying and playing M associated multimedia in sequence in a multimedia display interface according to the playing sequence of the M associated multimedia.

Specifically, the computer device may obtain multimedia attribute information corresponding to each of the M associated multimedia, where the multimedia attribute information may include generation time or release time of the associated multimedia, or may include a management sequence corresponding to each of the M associated multimedia by the release object. Further, the computer device may determine a play order of the M associated multimedia according to the multimedia attribute information of the M associated multimedia. When the playing of the target multimedia is completed, the computer equipment can sequentially display and play the associated multimedia in the multimedia display interface according to the playing sequence of the M associated multimedia.

Fig. 8 is a schematic diagram showing an associated multimedia according to an embodiment of the present application, where, as shown in fig. 8, the target multimedia may refer to a target video, the associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and a participation operation for the target multimedia may refer to a comment operation. When a participant is viewing a target video in video display interface 80a, the target video in video display interface 80a may be slid to the left when it is desired to post comment videos for the target video. The computer device may obtain all comment videos corresponding to the target video in response to a sliding operation of the participation object with respect to the target video in the video display interface 80a, and obtain a display order of all comment videos. The computer device may determine to display the first comment video, that is, the comment video corresponding to the object 2, according to the display order of the so comment videos. The computer device may update and display the target video in the video display interface as the comment video corresponding to the object 2, and switch the video display interface 80a to the video display interface 80b. Thus, the participant can slide laterally to watch comment data about the target video, and the experience of watching the video by the participant can be improved.

Optionally, the specific manner of displaying the associated multimedia for commenting on the target multimedia in the multimedia display interface by the computer device may include: device attribute information of a terminal device for responding to the participation operation for the target multimedia is acquired. Determining associated multimedia matched with the equipment attribute information from a set of associated multimedia; the set of associated multimedia includes at least two associated multimedia having different display qualities. And displaying the determined associated multimedia in a presentation area of the multimedia display interface.

Specifically, after obtaining the associated multimedia, the computer device may obtain device attribute information of a terminal device used for responding to the participation operation for the target multimedia, where the terminal device may refer to a terminal device held by the target participation object, that is, a terminal device that responds to the target participation object to implement the participation operation for the target multimedia. The device attribute information may include, among other things, a device display size, a device network status, a resolution of a current multimedia play of the device, and the like. Further, the computer device may determine, from a set of associated multimedia including at least two associated multimedia having different playing qualities, an associated multimedia matching the device attribute information. Further, the computer device may display the determined associated multimedia in a multimedia display interface. Since in the case of some conventional multimedia players and weak networks, directly playing the associated multimedia may cause a situation that the multimedia playing is stuck or cannot be played, thereby affecting the viewing effect and experience of the participant in viewing the multimedia. Therefore, by displaying the associated multimedia with different sizes, different resolutions and different sizes according to the equipment attribute information of the terminal equipment so as to select the appropriate associated multimedia to play under the condition of weak network or other conditions, namely, playing the associated multimedia with different qualities according to the different equipment attribute information, the viewing effect and experience of the participant to watch the multimedia can be improved.

When playing the associated multimedia, the terminal device may acquire device attribute information of the terminal device, send the device attribute information to the server, and the server may transcode the associated multimedia for commenting on the target multimedia according to the device attribute information, transcode the associated multimedia into a plurality of transcoded associated multimedia with different resolutions, different sizes and different sizes, add the transcoded associated multimedia with different resolutions, different sizes and different sizes to a set of associated multimedia, further, the computer device may return the set of associated multimedia to the terminal device, and the terminal device may acquire, in real time, the associated multimedia matched with the current device attribute information from the set of associated multimedia according to the device attribute information of the terminal device, and display the determined associated multimedia.

The terminal equipment can also send the current equipment attribute information of the terminal equipment to the server in real time, and the server transcodes the associated multimedia for commenting on the target multimedia according to the current equipment attribute information to obtain the transcoded associated multimedia. The server may return the transcoded associated multimedia to the terminal device, and the terminal device may display the transcoded associated multimedia.

After the target participation object issues the associated multimedia for the target multimedia, the computer device may generate a notification message according to the object information of the target participation object and the associated multimedia corresponding to the target participation object, and send the notification message to the terminal device of the object associated with the target multimedia. The terminal device of the object associated with the target multimedia can display the notification message in the corresponding comment detail information interface, so that the object associated with the target multimedia can view the associated multimedia corresponding to the target participation object, and the interactivity between the participation object and the release object can be improved. In addition, the object associated with the target multimedia can be quickly positioned to the target participation object through the notification message, and the contact can be quickly established with the target participation object through the communication functions of a small paper slip, IM chat (i.e. chat room) and the like.

Fig. 9 is a schematic diagram showing an associated multimedia according to an embodiment of the present application, where, as shown in fig. 9, the target multimedia may refer to a target video, the associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and a participation operation for the target multimedia may refer to a comment operation. After the participant performs the participation operation for the target multimedia in the multimedia display interface 90a, the computer device may determine the participant object triggering the participation operation as the target participant object in response to the participation operation, and switch the multimedia display interface 90a to the media interaction interface 90b. When the target participation object selects the shooting control to collect comment data, the computer equipment can respond to the selection operation of the target participation object on the shooting control, acquire shooting multimedia shot based on the shooting control, and determine the shooting video as comment data obtained by the participation operation. Further, the computer device may perform video conversion on the comment data corresponding to the target participant object to obtain an initial comment video 90d, and display the initial comment video 90d in the media interactive interface 90 c. Further, the target participant may edit the initial comment video 90d, as shown in the media interactive interface 90c in fig. 9, and the target participant may click on the "add background music" control to add background music to the initial comment video 90d. The target participant may click on the "add text" control to add text to the initial comment video 90d, the target participant may click on the "zoom video" control to zoom the size of the initial comment video 90d, and the target participant may click on the "beautify to beautify the initial comment video 90d. Wherein, while editing the initial comment video 90d, the computer device may display the edited initial comment video in the media interactive interface 90c in response to the editing operation of the target participation object.

Further, after the editing of the initial comment video 90d by the target participant object is completed, the publishing control 90e in the media interactive interface 90c may be clicked. The computer device may determine, in response to a triggering operation of the target participant object for the release control 90e, the edited initial associated multimedia as a comment video for comment on the target video, and switch the media interaction interface 90c to the multimedia display interface 90f. As shown in the multimedia display interface 90f, the computer device may obtain an object avatar of the target participant object, display the object avatar of the target participant object, i.e., object 490g, in the participant object area in the multimedia display interface 90f while displaying the target video on the multimedia display interface. Further, the participating object may click on the object avatar of the object 4 in the participating object area, and the computer device may display the comment video corresponding to the object 4 in response to the click operation of the participating object on the object avatar of the object 4. In addition, the participation object may play the comment videos corresponding to the object 2, the object 3 and the object 4 by sliding the target video to the left. In addition, after the computer device detects that the playing of the target video is completed and does not detect the triggering operation of the participation object on the target video, comment videos corresponding to the playing object 2, the object 3 and the object 4 are sequentially displayed.

In the embodiment of the application, by displaying the target multimedia in the presentation area of the multimedia display interface, when the participation object (i.e. the viewing object) interacts with the target multimedia, the computer device may generate and issue the associated multimedia in response to the participation operation for the target multimedia, where the associated multimedia may include one or more of video, text, image data, voice data, and special effects. Further, the associated multimedia associated with the target multimedia may be displayed in the presentation area of the multimedia display interface, the associated multimedia and the target multimedia form a first associated multimedia group, and interaction between objects corresponding to multimedia in the associated multimedia group may be achieved. The format and the content of the associated multimedia are not limited, so that the flexibility of interaction can be improved, and the interactivity and interestingness between the watched object and the released object of the target multimedia are enhanced. The multimedia data obtained by the participation operation can be converted into initial associated multimedia, and the target participation object can perform personalized editing on the initial associated multimedia to increase the individuation of the associated multimedia. In addition, when the associated multimedia is displayed in the multimedia display interface, the associated multimedia corresponding to the target participation object may be displayed by clicking the object information of the target participation object, or the associated multimedia may be displayed by a sliding operation on the target multimedia in the first direction, or the associated multimedia may be automatically played when the playing of the target multimedia is completed.

Fig. 10 is a schematic flow chart of a multimedia interaction method according to an embodiment of the present application. The multimedia interaction method can be executed by any user terminal in fig. 1, can be executed by a server in fig. 1, and can also be executed by any user terminal and server in fig. 1 together, and the devices for executing the method in this application can be collectively called as computer devices. As shown in fig. 10, the multimedia interaction method may include, but is not limited to, the following steps:

s201, displaying the target multimedia in the presentation area of the multimedia display interface.

Optionally, displaying, in the presentation area in the multimedia display interface, the associated multimedia associated with the target multimedia, including: uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia; acquiring the associated multimedia associated with the target multimedia from a local database in the process of compressing the associated multimedia by the media service equipment, and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface; after the media service device compresses the associated multimedia, deleting the associated multimedia associated with the target multimedia in the local database, acquiring the compressed associated multimedia from the first associated multimedia group in the media service device, and displaying the associated multimedia associated with the target multimedia in a presentation area of the media display interface according to the compressed associated multimedia.

Specifically, in the process that the media service device compresses the associated multimedia, that is, when the media service device does not compress the associated multimedia, the associated multimedia associated with the target multimedia is obtained from a local database of the computer device, and the associated multimedia associated with the target multimedia is displayed in a presentation area of the multimedia display interface. After the media service device compresses the associated multimedia, deleting the associated multimedia associated with the target multimedia in the local database, acquiring the compressed associated multimedia from the first associated multimedia group in the media service device, acquiring the associated multimedia associated with the target multimedia from the compressed associated multimedia, and displaying the associated multimedia associated with the target multimedia in a display area of the media display interface. Therefore, the multimedia experience can be improved, and the multimedia is prevented from occupying excessive memory space of the computer equipment.

Optionally, displaying, in the presentation area in the multimedia display interface, the associated multimedia associated with the target multimedia, including: uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia; when the associated multimedia associated with the target multimedia is not uploaded to the media service equipment, displaying identification information of the associated multimedia associated with the target multimedia in a presentation area of the media display interface; and responding to the playing operation of the identification information of the associated multimedia associated with the target multimedia, and playing the associated multimedia associated with the target multimedia in a local database in a presentation area of the media display interface.

Specifically, when the associated multimedia associated with the target multimedia is not uploaded to the media service device, the computer device displays the identification information of the associated multimedia associated with the target multimedia in the presentation area of the media display interface. If the target object needs to play the associated multimedia associated with the target multimedia, a play operation can be performed on the identification information of the associated multimedia associated with the target multimedia; accordingly, the computer device may play the associated multimedia associated with the target multimedia in the local database in the presentation area of the media display interface in response to a play operation for the identification information of the associated multimedia associated with the target multimedia, so that a play experience may be improved.

Optionally, displaying, in the presentation area in the multimedia display interface, the associated multimedia associated with the target multimedia, including: uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia; and deleting the associated multimedia associated with the target multimedia in the local database after the associated multimedia associated with the target multimedia is uploaded to the media service equipment, and displaying the identification information of the multimedia in the first associated multimedia group in the display area of the media display interface.

Specifically, after the related multimedia associated with the target multimedia is uploaded to the media service device, the computer device may delete the related multimedia associated with the target multimedia in the local database, and display the identification information of the multimedia in the first related multimedia group in the presentation area of the media display interface, so that the related multimedia may be prevented from occupying a memory space.

And S202, generating and publishing the associated multimedia in response to the participation operation for the target multimedia.

And S203, displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface.

In particular, the specific content of steps S201 to S203 in the embodiment of the present application may be referred to the specific content of steps S101 to S103 in fig. 3, and the embodiment of the present application is not repeated here.

S204, in response to the view operation of the interaction detail information of the target multimedia, displaying object information of a participation object for executing the participation operation on the target multimedia and interaction statistical information of the target multimedia in an interaction detail information interface.

Specifically, when the computer device obtains the associated multimedia that the target participant subjects comment on the target multimedia, and displays the associated multimedia in the multimedia display interface, a notification message corresponding to the associated multimedia may be generated, and the notification message is displayed in the interactive detail information interface of the subject associated with the target multimedia (such as the publishing subject or the participant subject). If the number of associated multimedia used for commenting on the target multimedia is M, the computer device may obtain multimedia attribute information corresponding to the M associated multimedia respectively, where the multimedia attribute information may be a release time, a generation time, and the like of the associated multimedia. Further, the computer device may determine a notification order of the M associated multimedia according to the multimedia attribute information of the M associated multimedia, and generate notification messages of the M associated multimedia according to the notification order. Specifically, the computer device may arrange object information of the participation objects corresponding to the M associated multimedia respectively according to the notification sequence, so as to obtain notification messages of the M associated multimedia, for example, the notification messages are displayed in a row in a lateral arrangement. When other target participation objects or release objects trigger viewing operations of comment detail information of the target multimedia, such as when the participation objects or release objects open a multimedia comment detail page, the computer device may display object information of the target participation objects performing the participation operations on the target multimedia and interactive statistical information of the target multimedia in an interactive detail information interface in response to the viewing operations of the interactive detail information of the target multimedia. The interactive statistical information may include the number of objects of the participation object performing the participation operation on the target multimedia, multimedia cover information of the target multimedia, and the like. The object information of the target participation object corresponding to the associated multimedia with the earliest notification sequence can be displayed in an enlarged mode, and cover information of the target multimedia can be displayed, wherein the cover information can refer to any frame of image in the target multimedia. For example, the publishing object of the target multimedia is object D, the target participation objects of the history associated multimedia of the target multimedia are object E and object F, and when the target participation object H reviews the target multimedia and generates the associated multimedia corresponding to the target participation object H, the computer device may generate a notification message of the associated multimedia corresponding to the target participation object H, and display the notification message in the interactive detail information interfaces of the terminal devices respectively held by the object D, the object E and the object F.

Fig. 11 is a schematic diagram of an interactive detail information interface provided in an embodiment of the present application, where, as shown in fig. 11, a target multimedia may refer to a target video, an associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and a participation operation for the target multimedia may refer to a comment operation. When object 1 wants to view the interaction details about the target multimedia, the "interaction" control can be clicked. The computer device may display object attribute information of a participation object performing a participation operation on the target multimedia and interactive statistical information of the target multimedia in the interactive detail information interface in response to a click operation of the object 1 on the "interactive" control. As shown in fig. 11, when the objects 2, 3, 4, 5, 6, 7, and 8 respectively perform the participation operation with respect to the target multimedia 1, and generate the associated multimedia respectively corresponding thereto, the computer device may display notification messages corresponding to the objects 2, 3, 4, 5, 6, 7, and 8 in the interactive detail information interface. Wherein the target multimedia 1 is a target multimedia published by the object 1. As shown in fig. 11, the computer device may obtain object information of a target participation object corresponding to the associated multimedia generated first, display an object avatar of the target participation object of the first comment on the first, and display an object ID (e.g., an object nickname ") of the target participation object of the first comment. As shown in fig. 10, the computer device may also count the attributes of other target participating objects and display the text "6 people replied to your multimedia", i.e., object 3, object 4, object 5, object 6, object 7, and object 8, and the time the object displaying the last comment commented on, such as "3:20 pm".

As shown in fig. 11, when there is a new trigger for the target participation object of the target multimedia 2 issued for the object 6 after the object 1 performs the participation operation for the target multimedia 2 issued for the object 6, a notification message is also generated to notify the object 1. As shown in fig. 11, the computer device may display the avatar of the object 6 in the interactive detail information interface, and display the object ID (e.g., object nickname) of the object 6. The computer device may also display statistical information of the new target participation object, that is, display video [ × ] (i.e. name of target multimedia 2) with 2 new replies, and display object head images of the target participation object corresponding to the 2 new replies, and display comment time of the target participation object of the last comment, such as "11:20 a.m..

Specifically, when the participant object views the target multimedia, if the participant wants to comment on the target multimedia, a comment control for the target multimedia can be triggered, and comment data is input in a comment publisher. The terminal equipment held by the target participation object triggering the participation operation can perform multimedia conversion on the associated multimedia to obtain the associated multimedia, and the associated multimedia and the object information of the target participation object triggering the participation operation are uploaded to the server. After the terminal equipment is successfully uploaded, the server can audit the validity of the associated multimedia, and after the audit is passed, the object of the target participation object is issued to the terminal equipment of each participation object. The terminal devices of the participating objects can splice the associated multimedia corresponding to the target participating objects behind the target multimedia, and splice the object information of the target participating objects behind the object information in the multimedia group corresponding to the target multimedia, namely, the object information of the target participating objects is displayed in the multimedia display interface of the terminal devices of the participating objects. Other participating objects can play the associated multimedia corresponding to the target participating object, and can also carry out new comments (namely, generate new associated multimedia) after the associated multimedia of the target participating object.

The display sequence of the associated multimedia corresponding to each target participation object corresponding to the target multimedia may be determined according to the release time of each associated multimedia, and after the playing of the associated multimedia arranged in advance is finished, the subsequent associated multimedia may be sequentially played according to the display sequence. In the process of playing the target multimedia or the associated multimedia, the participating object can click to pause the multimedia playing, and can click the object information of each target participating object, skip playing the associated multimedia corresponding to the corresponding target participating object. In addition, the participating object can also slide object information of a plurality of target participating objects corresponding to the target multimedia so as to view object information of more target participating objects, and when clicking the object information of the target participating object, the participating object can also view associated multimedia corresponding to the target participating object.

Specifically, a longitudinal page view (i.e., page view) is included in the multimedia display interface, for carrying a plurality of associated multimedia groups (an associated multimedia group includes a target multimedia and associated multimedia corresponding to the target multimedia). When the participation object performs a sliding operation in a switching direction (e.g., a longitudinal sliding) with respect to the target multimedia, different associated multimedia groups may be switched. For example, the participant may slide the target multimedia up and down to view different associated multimedia groups, and actively pull more associated multimedia groups to the background when sliding down. A plurality of transverse pageviews are nested in the longitudinal pageviews of the multimedia display interface, and each transverse pageview comprises an associated multimedia group. When the participating object performs a triggering operation in a first direction for a target multimedia, then a different associated multimedia of the target multimedia is switched. For example, a participant pair may perform a multimedia switch in an associated multimedia group in the form of a left-right swipe or click on object information of other participant objects at the bottom. Meanwhile, the computer equipment can detect the playing completion event of each multimedia, and if the current multimedia is completely played and the participating object does not actively perform the playing adjustment operation, the computer equipment automatically switches to the next multimedia of the current multimedia group. If the last multimedia of the current multimedia group is played, the first multimedia of the current multimedia group is played. Furthermore, the participant object may load more multimedia of the current multimedia group by sliding the bottom participant list left and right.

In the management of multimedia instances, we also adopt a unique technical scheme, in the traditional multimedia playing technology, the multimedia stream is longitudinally unidirectional one-dimensional rolling, and the multimedia cannot be jumped (i.e. the next played multimedia must be longitudinally upward or longitudinally downward multimedia, and cannot span multiple multimedia jumpers), so that a better multimedia playing experience is achieved, and only the upper and lower multimedia instances need to be preloaded. In this scheme, the multimedia stream has both horizontal and vertical directions, and for the multimedia of the same multimedia group (the multimedia appears as horizontal multimedia on the user interface), the user can click on the object information of the bottom participant to skip across multiple multimedia. Based on this state of the art, in the lateral direction, only the currently displayed multimedia and, if any, the left multimedia adjacent to the currently displayed multimedia and, if any, the right multimedia adjacent to the currently displayed multimedia are retained. In the longitudinal direction, only the lower multimedia adjacent to the currently displayed multimedia and the upper multimedia adjacent to the currently displayed multimedia are reserved. Therefore, the scheme can simultaneously have 5 pieces of multimedia at most, and achieves a balance in two aspects of user experience and client performance.

After the terminal device corresponding to the target participation object acquires the associated multimedia of the target participation object aiming at the target multimedia, the terminal device corresponding to the target participation object can perform two-part processing on the associated multimedia. Firstly, the associated multimedia is stored locally to the terminal equipment and a local access address is generated, and secondly, the associated multimedia is uploaded to cos (namely object storage) in a server and corresponding online access addresses are generated. Further, the terminal device may send the local access address, the online access address, the object information of the target participation object, the associated multimedia, and the related information of the video group corresponding to the target multimedia to the server. After uploading to the server, the server can compress the associated multimedia and splice the necessary data of the associated multimedia (splice the object information of the target participation object, the associated multimedia and the related information of the video group corresponding to the target multimedia to obtain splicing information).

Further, after the terminal device successfully uploads the local access address, the online access address, the object information of the target participation object, the associated multimedia and the related information of the video group corresponding to the target multimedia to the server, the terminal device of the target participation object automatically performs a data request, pulls the spliced information spliced by the server, and splices the comment to the first associated multimedia group in the multimedia display interface of the target participation object. For the target participation object of the associated multimedia, the server returns the local link of the associated multimedia before the video compression processing of the associated multimedia is completed, so that the target participation object can directly play the associated multimedia stored locally before the associated multimedia is not released, and the playing experience can be improved. After the video processing of the associated multimedia is completed by the server, the online access link stored on the cos is issued to the object associated with the target multimedia, and the associated multimedia stored locally at the terminal device of the target participation object is actively deleted, so that the storage space of the terminal device of the target participation object is prevented from being occupied. For non-target participating objects, before the server performs video compression processing on the associated multimedia, the online access link of the associated multimedia is not issued, so that the situation that the video cannot be played is avoided.

Specifically, after the computer equipment acquires the associated multimedia of the target participation object aiming at the target multimedia, the functions of uploading, auditing, storing, comment notification and the like of the associated multimedia can be completed.

In particular, the computer device may convert the uploaded associated multimedia into a resource for storage in an underlying storage component, such component commonly referred to as OSS (Object Storage Service, i.e., object storage service). The OSS component is characterized by mass, safety, low cost and high reliability, is suitable for storing any type of files, flexibly expands the capacity and processing capacity, selects various storage types and comprehensively optimizes the storage cost. After the transmission is performed, an online access link corresponding to the associated multimedia can be generated, and the associated multimedia can be accessed through the online access link.

Further, the computer device may check the validity of the uploaded associated multimedia, for example, check whether the uploaded associated multimedia meets legal rules, and if the associated multimedia meets legal rules, determine that the associated multimedia has validity, store the associated multimedia, and display the associated multimedia in a presentation area of the multimedia display interface. If the associated multimedia does not meet legal requirements, outputting prompt information in a multimedia display interface of the terminal equipment of the target participation object so as to prompt that the associated multimedia released by the target participation object does not meet the requirements, and the associated multimedia fails to release.

Further, the computer device may store the uploaded related information of the associated multimedia. The data stored in the associated multimedia of different multimedia release types are different, and one of the data is that a release object actively releases video, which is called a building; the other is a video which is interactively released by other participating objects to the building, and is called a layer. The differences in stored information between the building and the floor, respectively, are described below. When the object to be released releases the target multimedia, the computer device stores the target multimedia, and mainly records the object information of the object to be released and when the video is released, and the target multimedia is generated in what form (such as shooting, forwarding, etc.). When the computer equipment stores the associated multimedia after the target participation object generates the associated multimedia aiming at the participation operation of the target multimedia, the object information of the target participation object is mainly recorded, and the time of replying to the building video of the target participation object is recorded.

Wherein stored information between the building video and the floor video is maintained separately by supporting the components that are stored in a sequential manner. When the target participating object is watching the first associated media group corresponding to the target multimedia, the building video (i.e. the target multimedia) and the layer videos (i.e. the associated multimedia) of all the target participating objects are presented to the participating objects according to a certain display sequence. The display order may be the distribution time order of each multimedia, or may be an order after the distribution object is managed. The computer device may also issue which building videos (stored according to the issue schedule), which building videos to participate in the interaction (stored according to the issue schedule), which building videos to collect (stored according to the issue schedule), and so on for each object. Wherein, the interaction of the objects is realized mainly by a video mode. For example, the three users are user a, user B and user C, and when the user a replies to a target multimedia of the user B, a notification message is stored for the user B. In addition, after the C user replies to the target multimedia of the B user, a notification message is stored for the A user and the B user. The notification information is also required to be stored orderly according to the corresponding distribution time sequence of the associated multimedia.

After the associated multimedia corresponding to the target participation object is displayed on the display interface, the computer device may generate a notification message about the associated multimedia, and send the notification message to the object associated with the target multimedia. Wherein the objects associated with the target multimedia include a published object of the target multimedia, and other target participant objects that send notification messages to the target multimedia (i.e., target participant objects that historically trigger a participant operation for the target multimedia). In this way, by sending the notification message to the object associated with the target multimedia, the object associated with the target multimedia (such as the release object of the target multimedia and other target participation objects) can be notified in time to view the associated multimedia in time, so that the target participation object and the object associated with the target multimedia interact with each other, connection is established, and the interactivity between the objects is improved.

Fig. 12 is a schematic diagram of a multimedia interaction provided in an embodiment of the present application, where, as shown in fig. 12, a target multimedia may refer to a target video, an associated multimedia associated with the target multimedia may refer to a comment video for commenting on the target video, and a participation operation for the target multimedia may refer to a comment operation. The terminal device may display the target multimedia 120a in a multimedia display interface where the participant may browse the target multimedia. When the participating object wants to post the associated multimedia for the target multimedia, a comment control in the multimedia display interface may be triggered, and the terminal device may display the media interaction interface 120b in response to the triggering operation of the participating user for the comment control. The terminal equipment can determine the participation object triggering the participation operation as a target participation object, acquire comment data acquired by the target participation object on the media interaction interface, and generate associated multimedia for interaction with the target multimedia. The terminal device can upload the associated multimedia and the object information of the target participation object to the server 120c, and after receiving the associated multimedia uploaded by the terminal device, the server can audit 120d the validity of the associated multimedia to obtain an audit result. Further, if the server determines that the auditing result indicates that the associated multimedia has validity, the associated multimedia is stored 120e, and a notification message corresponding to the associated multimedia is associated. The server may issue a notification message corresponding to the associated multimedia to the terminal device of the object associated with the target multimedia, and the terminal device of the object associated with the target multimedia may update and display the participation object list 120f in the multimedia display interface according to the notification message.

The target multimedia data in the scheme may also refer to target image data, the associated multimedia data associated with the target multimedia may refer to added image data, and the participation operation for the target multimedia data may refer to a content adding operation. In this way, the participation object may trigger a content addition operation for the target image data, input the addition data, and the computer device generates the addition image data from the addition data input by the target participation object in response to the addition operation of the participation object. Further, the computer device may display the added image data on the multimedia display interface such that the participant may view the added image data associated with the target image data while viewing the target image data. Therefore, the method can realize the change from single image data consumption to multiple image data consumption, can improve the interactivity between multimedia data, can also improve the flexibility of interaction, and can enhance the interactivity and interestingness between the watched object and the released object of the target multimedia.

When the above embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and collection, use and processing of information such as object information of an object, object information of a participating object, object information of a target participating object, and device attribute information of terminal devices held by the target participating object need to comply with relevant laws and regulations and standards of relevant countries and regions. That is, the computer device may acquire the information such as the object information of the release object, the object information of the participation object, the object information of the target participation object, and the device attribute information of the terminal device held by the target participation object, when the computer device acquires the authorization information of the user for the above information.

Referring to fig. 13, fig. 13 is a schematic structural diagram of a multimedia interaction device according to an embodiment of the present application. The multimedia interaction device may be a computer program (including program code) running in a computer apparatus, for example the multimedia interaction device is an application software; the multimedia interaction device can be used for executing corresponding steps in the multimedia interaction method provided by the embodiment of the application. As shown in fig. 13, the multimedia interaction device may include: a first display module 11, a generation module 12, a second display module 13, and a third display module 14, and a fourth display module.

Optionally, the second display module displays, in a presentation area of the multimedia display interface, associated multimedia associated with the target multimedia, including:

displaying object information of a target participation object corresponding to the participation operation in the presentation area;

in response to a first operation of object information for the target participant object, displaying a target multimedia update of the presentation area as associated multimedia belonging to the target participant object; the associated multimedia belonging to the target participation object is produced according to the participation operation of the target participation object on the target multimedia.

Responsive to a second operation in a first direction for the target multimedia in the presentation area, displaying the target multimedia update presented by the presentation area as associated multimedia associated with the target multimedia; or alternatively

And after the target multimedia is played, displaying the associated multimedia associated with the target multimedia in the presentation area.

and displaying the identification information of the target multimedia and the associated multimedia in a presentation area of the multimedia display interface according to a preset sequence.

Optionally, the second display module displays the identification information of the target multimedia and the associated multimedia in a presentation area of the multimedia display interface according to a preset sequence, including:

and sequentially arranging and displaying the identification information of the target multimedia and the associated multimedia in the presentation area of the multimedia interface according to the generated time sequence.

Optionally, the third display module is configured to display the first multimedia group update on the multimedia display interface as a second associated multimedia group in response to a third operation on the multimedia display interface in a second direction.

acquiring device attribute information of a terminal device for responding to the participation operation for the target multimedia;

determining associated multimedia matched with the equipment attribute information from a set of associated multimedia; the set of associated multimedia comprises at least two associated multimedia with different display quality;

and displaying the determined associated multimedia in a presentation area of the multimedia display interface.

Optionally, the second display module displays, in a presentation area in the multimedia display interface, associated multimedia associated with the target multimedia, including:

uploading associated multimedia associated with the target multimedia to media service equipment, wherein the associated multimedia is used for indicating the media service equipment to compress the associated multimedia to obtain compressed associated multimedia, and generating a first associated multimedia group according to the compressed associated multimedia and the target multimedia;

Acquiring the associated multimedia associated with the target multimedia from a local database in the process of compressing the associated multimedia by the media service equipment, and displaying the associated multimedia associated with the target multimedia in a presentation area of the multimedia display interface;

after the media service device compresses the associated multimedia, deleting the associated multimedia associated with the target multimedia in the local database, acquiring the compressed associated multimedia from the first associated multimedia group in the media service device, and displaying the associated multimedia associated with the target multimedia in a presentation area of the media display interface according to the compressed associated multimedia.

When the associated multimedia associated with the target multimedia is not uploaded to the media service equipment, displaying identification information of the associated multimedia associated with the target multimedia in a presentation area of the media display interface;

and responding to the playing operation of the identification information of the associated multimedia associated with the target multimedia, and playing the associated multimedia associated with the target multimedia in a local database in a presentation area of the media display interface.

and deleting the associated multimedia associated with the target multimedia in the local database after the associated multimedia associated with the target multimedia is uploaded to the media service equipment, and displaying the identification information of the multimedia in the first associated multimedia group in the display area of the media display interface.

Optionally, the making module makes and publishes the associated multimedia in response to the participation operation for the target multimedia, including:

responding to the participation operation aiming at the target multimedia, and displaying a shooting control on a media interaction interface;

responding to the selection operation of the shooting control, and acquiring shooting video shot based on the shooting control;

and generating the associated multimedia comprising the shot video, and publishing the associated multimedia comprising the shot video.

Optionally, the generating module generates the associated multimedia including the captured video, including:

acquiring video description information matched with the shot video;

and adding the video description information into the shot video to obtain associated multimedia comprising the shot video.

responding to the participation operation aiming at the target multimedia, and displaying a voice control on a media interaction interface;

responding to the selection operation of the voice control, and acquiring input voice data input based on the voice control;

Generating associated multimedia including the input voice data, and publishing the associated multimedia including the input voice data.

Optionally, the making module generates the associated multimedia including the input voice data, including:

performing text conversion processing on the input voice data to obtain converted text data;

generating a first text background image according to the converted text data;

and synthesizing the input voice data and the first text background image to obtain the associated multimedia comprising the input voice data.

responsive to a participation operation for the target multimedia, displaying a local media data selection control on a media interactive interface;

responding to the selection operation of the local media data selection control, and acquiring the local media data selected based on the local media data selection control;

generating associated multimedia including the local media data, and publishing the associated multimedia including the local media data.

Optionally, the local media data includes at least two pieces of image data, and the making module generates the associated multimedia including the local media data, including:

Performing stitching processing on the at least two pieces of image data to obtain stitched image data;

determining image description information matched with the spliced image data;

and generating associated multimedia comprising the local media data according to the spliced image data and the image description information.

responsive to a participation operation for the target multimedia, displaying a text input control on a media interactive interface;

responding to the triggering operation of the text input control, and acquiring input text data obtained based on the text input control;

generating associated multimedia including the input text data, and publishing the associated multimedia including the input text data.

Optionally, the making module generates the associated multimedia including the input text data, including:

performing voice conversion processing on the input text data to obtain converted voice data;

generating a second text background image according to the input text data;

and synthesizing the converted voice data and the second text background image to obtain the associated multimedia comprising the input text data.

Optionally, the fourth display module is configured to display, in response to a viewing operation of the interaction details information of the target multimedia, object information of a participation object that performs a participation operation on the target multimedia, and interaction statistics information of the target multimedia in an interaction details information interface.

According to an embodiment of the present application, each module in the multimedia interaction device shown in fig. 13 may be separately or completely combined into one or several units to form a structure, or some (some) of the units may be further split into multiple sub-units with smaller functions, so that the same operation may be implemented without affecting the implementation of the technical effects of the embodiments of the present application. The above modules are divided based on logic functions, and in practical applications, the functions of one module may be implemented by a plurality of units, or the functions of a plurality of modules may be implemented by one unit. In other embodiments of the present application, the test device may also include other units, and in practical applications, these functions may also be implemented with assistance from other units, and may be implemented by cooperation of multiple units.

Referring to fig. 14, fig. 14 is a schematic structural diagram of a computer device according to an embodiment of the present application. As shown in fig. 14, the above-mentioned computer device 1000 may include: processor 1001, network interface 1004, and memory 1005, and in addition, the above-described computer device 1000 may further include: a user interface 1003, and at least one communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display (Display), a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface, among others. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a nonvolatile memory (non-volatile memory), such as at least one magnetic disk memory. The memory 1005 may also optionally be at least one storage device located remotely from the processor 1001. As shown in fig. 14, an operating system, a network communication module, a user interface module, and a device control application program may be included in the memory 1005, which is one type of computer-readable storage medium.

In the computer device 1000 shown in fig. 14, the network interface 1004 may provide network communication functions; while user interface 1003 is primarily an interface for providing input to a target user; and the processor 1001 may be used to invoke a device control application stored in the memory 1005 to implement:

It should be understood that the computer device 1000 described in the embodiments of the present application may perform the description of the multimedia interaction method in the embodiment corresponding to fig. 3 or fig. 10, and may also perform the description of the multimedia interaction device in the embodiment corresponding to fig. 12, which is not repeated herein. In addition, the description of the beneficial effects of the same method is omitted.

Furthermore, it should be noted here that: the embodiment of the present application further provides a computer readable storage medium, where a computer program executed by the aforementioned multimedia interaction device is stored, and the computer program includes program instructions, when executed by a processor, can execute the description of the multimedia interaction method in the embodiment corresponding to fig. 3 and fig. 10, and therefore, a detailed description will not be given here.

In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer-readable storage medium according to the present application, please refer to the description of the method embodiments of the present application. As an example, program instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or, alternatively, across multiple computing devices distributed across multiple sites and interconnected by a communication network, where the multiple computing devices distributed across multiple sites and interconnected by the communication network may constitute a blockchain system.

In addition, it should be noted that: embodiments of the present application also provide a computer program product or computer program that may include computer instructions that may be stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor may execute the computer instructions, so that the computer device performs the description of the multimedia interaction method in the embodiment corresponding to fig. 3 and fig. 10, which will not be described in detail herein. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the computer program product or the computer program embodiments related to the present application, please refer to the description of the method embodiments of the present application.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the described order of action, as some steps may take other order or be performed simultaneously according to the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

The modules in the device of the embodiment of the application can be combined, divided and deleted according to actual needs.

Those of ordinary skill in the art will appreciate that implementing all or part of the processes in the methods of the embodiments described above,

those skilled in the art will appreciate that the processes implementing all or part of the methods of the above embodiments may be implemented by a computer program for instructing relevant hardware, and the program may be stored in a computer readable storage medium, and the program may include the processes of the embodiments of the methods as above when executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random-access Memory (Random Access Memory, RAM), or the like.

The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.

Claims

1. A method of multimedia interaction, comprising:

2. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface comprises:

3. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface comprises:

4. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in the presentation area of the multimedia display interface comprises:

5. The method according to claim 4, wherein displaying the identification information of the target multimedia and the associated multimedia in the presentation area of the multimedia display interface in a preset order includes:

6. The method according to claim 1, wherein the method further comprises:

in response to a third operation in a second direction for the multimedia display interface, the first multimedia group update on the multimedia display interface is displayed as a second associated multimedia group.

7. The method of claim 1, the displaying, in a presentation area of the multimedia display interface, associated multimedia associated with the target multimedia, comprising:

8. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in a presentation area in the multimedia display interface comprises:

9. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in a presentation area in the multimedia display interface comprises:

10. The method of claim 1, wherein displaying the associated multimedia associated with the target multimedia in a presentation area in the multimedia display interface comprises:

11. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

12. The method of claim 11, wherein the generating the associated multimedia comprising the captured video comprises:

acquiring video description information matched with the shot video;

13. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

14. The method of claim 13, wherein the generating associated multimedia comprising the input voice data comprises:

generating a first text background image according to the converted text data;

15. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

16. The method of claim 15, wherein the local media data comprises at least two pieces of image data, the generating associated multimedia comprising the local media data comprising:

determining image description information matched with the spliced image data;

17. The method of claim 1, wherein the creating and publishing associated multimedia in response to the participation operation for the target multimedia comprises:

18. The method of claim 17, wherein the generating associated multimedia including the input text data comprises:

generating a second text background image according to the input text data;

19. The method according to claim 1, wherein the method further comprises:

and in response to the view operation of the interaction detail information of the target multimedia, displaying object information of a participation object for executing the participation operation on the target multimedia and interaction statistical information of the target multimedia in an interaction detail information interface.

20. A multimedia interaction device, comprising:

The first display module is used for displaying target multimedia in the multimedia display interface;

the making module is used for responding to the participation operation aiming at the target multimedia, making and publishing the associated multimedia;

and the second display module is used for displaying the associated multimedia associated with the target multimedia in the multimedia display interface, and the associated multimedia and the target multimedia form a first associated multimedia group.

21. A computer device, comprising: a processor and a memory;

the processor is connected to a memory, wherein the memory is configured to store a computer program, and the processor is configured to invoke the computer program to cause the computer device to perform the method of any of claims 1-19.

22. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any of claims 1-19.

23. A computer program product or computer program, characterized in that it comprises computer instructions stored in a computer-readable storage medium, which are adapted to be read and executed by a processor to cause a computer device with the processor to perform the method of any of claims 1-19.