CN114827701A

CN114827701A - Multimedia information interaction method and device, electronic equipment and storage medium

Info

Publication number: CN114827701A
Application number: CN202110065111.0A
Authority: CN
Inventors: 张华薇; 张鹏元
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-01-18
Filing date: 2021-01-18
Publication date: 2022-07-29

Abstract

The embodiment of the application discloses a multimedia information interaction method, a multimedia information interaction device, electronic equipment and a storage medium, wherein the multimedia information interaction method comprises the following steps: displaying an audio playing page corresponding to the target audio playing request in the target client; acquiring real-time interaction information corresponding to the target audio at the current moment, and displaying the real-time interaction information in the audio playing page; and responding to an interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content corresponding to the interactive information input operation.

Description

Multimedia information interaction method and device, electronic equipment and storage medium

Technical Field

The application relates to the technical field of computers, in particular to a multimedia information interaction method, a multimedia information interaction device, electronic equipment and a storage medium.

Background

With the rapid development of technology, various applications (apps) have been developed in an explosive manner, and people can perform instant messaging, watch videos, listen to music, and the like through the applications.

In some scenarios, a user may share a certain music with other users through an application, however, a music player in the current application has a single function and can only play the music on a player interface or jump to a music application page for playing.

Disclosure of Invention

The embodiment of the invention provides a multimedia information interaction method, a multimedia information interaction device, electronic equipment and a storage medium, which can realize interaction feedback between a user and multimedia information, thereby greatly enhancing the experience of the user on the multimedia information and providing more choices for the user to perform a multimedia interaction feedback mode.

The embodiment of the invention provides a multimedia information interaction method, which comprises the following steps:

displaying an audio playing page corresponding to a target audio playing request in a target client, wherein the audio playing page displays video content of a video corresponding to the target audio;

acquiring real-time interaction information corresponding to the target audio at the current moment, and displaying the real-time interaction information in the audio playing page, wherein the real-time interaction information is issued by an audio client currently playing the target audio;

and responding to an interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content corresponding to the interactive information input operation.

Correspondingly, the embodiment of the present application further provides a multimedia information interaction device, including:

the display module is used for displaying an audio playing page corresponding to the target audio playing request in the target client, wherein the audio playing page displays video content of a video corresponding to the target audio;

the acquisition module is used for acquiring real-time interaction information corresponding to the target audio at the current moment and displaying the real-time interaction information in the audio playing page, wherein the real-time interaction information is issued by an audio client currently playing the target audio;

and the updating module is used for responding to the interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content corresponding to the interactive information input operation.

Optionally, in some embodiments of the present application, the apparatus further includes a detection module, where the detection module is specifically configured to:

when the video corresponding to the target audio is detected to be a video issued by a video making account, determining the video corresponding to the target audio as an associated video;

the update module is specifically configured to: and responding to an interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content and the associated video corresponding to the interactive information input operation.

Optionally, in some embodiments of the present application, the update module includes:

the display sub-module is used for responding to an interactive information input operation triggered by the target client aiming at the interactive information editing area and displaying the input interactive content in the interactive information editing area;

and the updating submodule is used for responding to the interactive information sending operation triggered by the target client aiming at the interactive content sending control and updating the interactive information displayed in the interactive information display area according to the interactive content and the associated video.

Optionally, in some embodiments of the present application, the update sub-module includes:

the acquisition unit is used for acquiring a timestamp of the interactive information sending operation;

the first determining unit is used for determining a video corresponding to the interactive information input operation from the associated video based on the timestamp to obtain a target video;

and the updating unit is used for updating the interactive information displayed in the interactive information display area according to the interactive content and the target video.

Optionally, in some embodiments of the present application, the updating unit includes:

the construction subunit is used for constructing the interaction information corresponding to the target client according to the interaction content and the target video to obtain target interaction information;

and the updating subunit is used for updating the interactive information displayed in the interactive information display area by using the target interactive information.

Optionally, in some embodiments of the present application, the update subunit is specifically configured to:

arranging the real-time interaction information according to the interaction time of the real-time interaction information;

and when target interactive information is acquired every time, rendering and displaying the interactive information display area according to the arrangement sequence of the real-time interactive information and the timestamp of the interactive information sending operation.

Optionally, in some embodiments of the present application, the mobile terminal further includes a hiding subunit, where the hiding subunit is specifically configured to:

and hiding the real-time interaction information, the interaction content editing area and the interaction content sending control in response to a real-time interaction information closing operation triggered by aiming at the interaction information display area.

Optionally, in some embodiments of the present application, the apparatus further includes a first switching unit, where the first switching unit is specifically configured to:

responding to interactive information viewing operation triggered by the real-time interactive information, and determining an audio client corresponding to the target real-time interactive information as a client to be viewed;

acquiring a video played when the client to be checked sends the target real-time interaction information;

and switching the video played in the audio playing page to the video played when the client to be checked sends the target real-time interaction information.

Optionally, in some embodiments of the present application, the apparatus further includes a playing unit, where the playing unit is specifically configured to:

in response to the click operation triggered by the like control, updating the style of the like control, and/or;

responding to video praise operation triggered by the associated video, and playing animation corresponding to the video praise operation on the audio playing page.

Optionally, in some embodiments of the present application, the mobile terminal further includes a second switching unit, where the second switching unit is specifically configured to:

displaying a video switching control in the audio playing page;

in response to the clicking operation of the video switching control, displaying a video list containing the associated video in the audio playing page;

responding to the selection operation of the associated video in the video list, and determining the selected associated video as the video to be switched;

and switching the currently played associated video into the video to be switched, and displaying the animation in the video play list during video switching.

Optionally, in some embodiments of the present application, the apparatus further includes a playing module, where the playing module is specifically configured to:

acquiring audio dividing information of the target audio;

segmenting the target audio based on the audio dividing information to obtain at least one audio slice;

and determining the associated videos corresponding to the divided audios, and sequentially playing the associated videos corresponding to the divided audios according to the playing time of each divided audio.

Optionally, in some embodiments of the present application, the audio playing page further includes a client-side association control, and further includes a switching module, where the switching module is specifically configured to:

and responding to the click operation triggered by the client-side association control, determining an associated client side associated with the target client side, and switching the audio playing page to the page of the associated client side.

Optionally, in some embodiments of the present application, the audio playing page further includes a state setting control, and further includes a setting module, where the setting module is specifically configured to:

and setting the account state of the user account in the target client to be an audio playing state in response to the state setting operation triggered by the state setting control.

Optionally, in some embodiments of the present application, the detection module is further specifically configured to:

and when the video corresponding to the target audio is not detected, playing a preset video in the audio playing page.

Optionally, in some embodiments of the present application, the detection module includes:

the first display unit is used for displaying a video production control in the audio playing page when detecting that the video corresponding to the target audio is the video released by the video production account;

the second display unit is used for displaying a video production prompt control in the audio playing page when the video corresponding to the target audio is not detected;

the third switching unit is used for responding to click operation triggered by the video production control or the video production prompt control and switching the audio playing page into a video production page, wherein the video production page comprises a video material adding area and a video material area, and the video material adding area comprises at least one video material;

a second determination unit configured to determine the selected video material as a target video material in response to a selection operation for the video material;

and the adding unit is used for responding to the material adding operation aiming at the target video material, adding the target video material into the video material adding area, and playing animation when the video material is added.

Optionally, in some embodiments of the present application, the adding unit is specifically configured to:

according to a preset time interval and the audio content of the target audio, segmenting the target audio to obtain a plurality of audio slices corresponding to the target audio;

switching the currently processed audio to the next audio slice each time the target video material is added to an audio slice.

In the embodiment of the application, after an audio playing page corresponding to a target audio playing request is displayed in a target client, the target audio playing request is generated by the target client, the audio playing page displays audio of a target audio and video content of a video corresponding to the target audio, whether the video corresponding to the target audio is a video published by a video production account is detected, when the video corresponding to the target audio is detected to be the video published by the video production account, the video corresponding to the target audio is determined to be a related video, then real-time interaction information corresponding to the target audio at the current moment is acquired, the real-time interaction information is displayed in the audio playing page, the real-time interaction information is published by the audio client corresponding to the currently played target audio, and finally, the target client responds to an interaction information input operation triggered by the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content corresponding to the interactive information input operation and the associated video. Therefore, the scheme can realize interactive feedback between the user and the multimedia information, thereby greatly enhancing the experience of the user on the multimedia information and providing more choices for the mode of the user for multimedia interactive feedback.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1a is a schematic view of a scene of a multimedia information interaction method according to an embodiment of the present application;

FIG. 1b is a flowchart illustrating a multimedia information interaction method according to an embodiment of the present disclosure;

fig. 1c to fig. 1t are schematic diagrams of audio playing pages according to an embodiment of the present application;

fig. 2 is another schematic flow chart of a multimedia information interaction method according to an embodiment of the present disclosure;

fig. 3a is a schematic structural diagram of a first implementation manner of a multimedia information interaction device according to an embodiment of the present application;

fig. 3b is a schematic structural diagram of a second implementation manner of a multimedia information interaction device according to an embodiment of the present application;

fig. 3c is a schematic structural diagram of a third implementation manner of a multimedia information interaction apparatus according to an embodiment of the present application;

fig. 3d is a schematic structural diagram of a fourth implementation manner of a multimedia information interaction apparatus according to an embodiment of the present application;

fig. 3e is a schematic structural diagram of a fifth implementation manner of a multimedia information interaction device according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a multimedia information interaction method and device, electronic equipment and a storage medium.

The multimedia information interaction device can be integrated in a terminal. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through a wired or wireless communication manner, the server may be an independent physical server, may also be a server cluster or a distributed system formed by a plurality of physical servers, and may also be a cloud server that provides basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, middleware service, a domain name service, a security service, a CDN, and a big data and artificial intelligence platform, which is not limited herein.

For example, referring to fig. 1a, the present application provides a multimedia information interaction system, which includes a first terminal 10, a second terminal 20, a user a, and a user b, when the user a opens an audio connection shared by the user b through the terminal 20 through the first terminal 10, the first terminal 10 generates a target audio playing request according to the audio connection, then the first terminal 10 displays an audio playing page corresponding to the target audio playing request, the target audio playing request is generated by a target client, the audio playing page displays audio of a target audio and video content of a video corresponding to the target audio, the target client may be a client of an instant messaging application, the first terminal 10 detects whether the video corresponding to the target audio is a video issued by a video making account, when the first terminal 10 detects that the video corresponding to the target audio is a video issued by the video making account, determining the video corresponding to the target audio as the associated video, then, the first terminal 10 obtains the real-time interaction information corresponding to the target audio at the current moment, and displays the real-time interaction information in the audio playing page, the real-time interactive information is issued by the audio client corresponding to the currently played target audio, for example, at the current time, a user issues interactive information for the target audio information through the audio client in the second terminal 20, and at this time, the first terminal 10 can display the interactive information in the interactive information display area, the user may be the user b, or other users, and finally, the first terminal 10 responds to the interactive information input operation triggered by the target client for the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content and the associated video corresponding to the interactive information input operation.

According to the multimedia information interaction scheme, the audio of the target audio and the video content of the video corresponding to the target audio are displayed on the audio playing page, the functions of a player integrated in an application are enriched, when the video corresponding to the target audio is the video published by the video production account, the interactive content and the associated video corresponding to the interactive information input operation can be obtained, the interactive information displayed on the audio playing page is updated, interactive feedback between a user and multimedia information is achieved, the experience of the user on the multimedia information is greatly enhanced, and more choices are provided for the mode of the user for multimedia interactive feedback.

The following are detailed below. It should be noted that the description sequence of the following embodiments is not intended to limit the priority sequence of the embodiments.

A multimedia information interaction method comprises the following steps: displaying an audio playing page corresponding to the target audio playing request in the target client, acquiring real-time interaction information corresponding to the target audio at the current moment, displaying the real-time interaction information in the audio playing page, responding to interaction information input operation triggered by the target client aiming at the audio playing page, and updating the interaction information displayed on the audio playing page according to interaction content corresponding to the interaction information input operation.

Referring to fig. 1b, fig. 1b is a schematic flowchart illustrating a multimedia information interaction method according to an embodiment of the present disclosure. The specific flow of the multimedia information interaction method can be as follows:

101. and displaying an audio playing page corresponding to the target audio playing request in the target client.

The target audio playing request is generated by a target client, an audio playing page displays audio information of a target audio and video content of a video corresponding to the target audio, the target audio playing request can be generated by the target client after a user clicks an audio link in the target client, the audio connection can be shared by the user a through an instant messaging application to a client (target client) of an instant messaging application of the user B, for example, the user a sends the user a to the user B in a session form, of course, the audio connection can also be triggered by the user B for the audio connection shared by the user a in an information sharing platform, and the target client generates the target audio playing request for the target audio according to the clicking operation.

Further, referring to fig. 1c, the audio playing page includes an audio information display area, a video information display area, and an interactive operation area, as shown in the figure, the audio information display area is located in a top area of the audio playing page, the video information display area is located in a middle area of the audio playing page, and the interactive operation area is located in a bottom area of the audio playing page, where the interactive operation area may include a sharing control, a comment control, and a like control, a user may share an audio link containing the target audio and its corresponding video to other users by clicking the sharing control, and a user may like the audio and/or video by clicking the like control to represent the user's liking of the audio and/or video or liking of the content of the audio and/or video, a user can display a history comment information window on an audio playing page by clicking a comment control, the history comment information window displays comments issued by all users for the video in a history time period, as shown in fig. 1d, the history time period can be a preset time interval, or can be set according to specific conditions from the initial issuance of the audio to the current time, and details are not repeated here.

It should be noted that, in this application, a target video may include at least one audio slice, and each audio slice may correspond to one video, that is, optionally, in some embodiments, specifically, the method may further include: acquiring audio dividing information of a target audio; segmenting the target audio based on the audio dividing information to obtain at least one audio slice; and determining the associated videos corresponding to the divided audios, and sequentially playing the associated videos corresponding to the divided audios according to the playing time of each divided audio.

Optionally, in some embodiments, in order to facilitate the user to switch the application player to the associated client corresponding to the target audio, the audio playing page may further include a client associated control, and the user may switch the audio playing page to a page of the associated client by clicking the client associated control, that is, the method may further include: and responding to the click operation triggered by the client-side association control, determining an associated client side associated with the target client side, and switching the audio playing page into the page of the associated client side.

For example, as shown in fig. 1e, the user opens the target audio through the client of the instant messaging application, and the audio link of the target audio is sent to the user by the friend of the user through the client of the target audio (i.e., the associated client), so that the user can switch the audio playing page to the page of the associated client by clicking the "return to associated application" control.

In addition, the audio playing page further includes a state setting control, as shown in fig. 1f, where the state setting control is an icon of "i listen to song", and the user may click on the icon, so as to set the account state of the user account in the target client as "i listen to song", that is, optionally, in some embodiments, the method may further include: and setting the account state of the user account number in the client side to be an audio playing state in response to the state setting operation triggered by the state setting control.

102. And acquiring real-time interaction information corresponding to the target audio at the current moment, and displaying the real-time interaction information in an audio playing page.

The real-time interactive information is published by an audio client corresponding to a currently played target audio, specifically, the real-time interactive information may be sorted according to the publishing time of the real-time interactive information, as shown in fig. 1q, a style displayed by the real-time interactive information may be a "bubble" style, and of course, other styles may also be displayed, which are specifically set according to actual situations.

103. And responding to the interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content corresponding to the interactive information input operation.

In order to realize the interactivity between the user and the multimedia information, the interactive information displayed on the audio playing page can be updated according to the interactive content corresponding to the interactive information input operation and the video corresponding to the target audio. It should be noted that, because some audios may have no video associated therewith, for example, audios created by a user, for this reason, in the present application, it may be detected whether a video corresponding to a target audio is a video published by a video production account, and when it is detected that the video corresponding to the target audio is a video published by the video production account, the video corresponding to the target audio is determined as an associated video.

It should be noted that, the step of detecting whether the video corresponding to the target audio is the video published by the video production account may be performed before step 103, or before step 102, and is specifically selected according to the actual situation, which is not limited herein.

Wherein, the video corresponding to the target audio can be a video issued by a video production account, in the application, in order to realize the interaction between the user and the multimedia information, the video published by the video production account is associated with the video production account, that is, when the user plays the target audio, if the video Q made by the video making account G is the video corresponding to the target video, and the user approves the video, the video making account G may receive the approval information of the user for the video Q, please continue to refer to fig. 1G, in some embodiments, the user may like the video by clicking on a like control, indicating the user's liking of the video, or like the content of the video, the user may click on a comment control, and displaying a history comment information window on the audio playing page, and enabling a user to check all history comment information by sliding up and down.

Optionally, in some embodiments, when it is detected that the video corresponding to the target audio is a video published by a video production account, the video corresponding to the target audio is determined as an associated video; and when the video corresponding to the target audio is not detected, playing a preset video in the audio playing page.

The preset video is preset, and may be a video installed together with the target client when the target client is installed, or may be a default video selected by a user, specifically according to actual conditions.

Further, in order to realize the interactive feedback between the user and the multimedia information, the user may make the associated video corresponding to the target audio, which may be implemented as follows:

the first condition is as follows: a video corresponding to a target audio is a video released by a video production account, please refer to fig. 1h, a video production control s can be displayed in an audio playing page, then, in response to a click operation triggered by the video production control s, the audio playing page is switched to a video production page, in response to a selection operation for a video material, the selected video material is determined as the target video material, in response to a material addition operation for the target video material, the target video material is added to the video material addition area, and an animation when the video material is added is played.

Referring to fig. 1i, the video production page includes a video material adding area a and a video material area b, the video material adding area includes at least one video material, the user can browse the video material in the video material area by sliding the video material area, and when the user determines the video material that needs to be selected, the target video material can be added to the video material adding area by dragging, as shown in fig. 1 j.

Case two: referring to fig. 1k, a video production control may be displayed in an audio playing page, then, in response to a click operation triggered by the video production prompt control, the audio playing page is switched to a video production page, in response to a selection operation for a video material, the selected video material is determined as a target video material, in response to a material addition operation for the target video material, the target video material is added to the video material addition area, and an animation when the video material is added is played, the video production prompt control may display corresponding prompt information to prompt a user to produce an associated video corresponding to the target audio, for example, the video production prompt control may display "please add video", when the user clicks an icon corresponding to "please add video", the audio playback page is switched to the video production page.

Further, different video materials may be added to different audio slices of the target audio, that is, optionally, in some embodiments, the step "in response to a material adding operation for the target video material, adding the target video material to the video material adding area, and playing an animation when the video material is added" may specifically include:

(11) according to a preset time interval and the audio content of the target audio, dividing the target audio to obtain a plurality of audio slices corresponding to the target audio;

(12) each time the target video material is added to one audio slice, the currently processed audio is switched to the next audio slice.

Referring to fig. 1l, in some embodiments, the target audio may be segmented according to a preset time interval and the audio content of the target audio, so as to obtain a plurality of audio slices corresponding to the target audio, when the audio slices are displayed, a playing duration corresponding to each audio slice may be displayed, so that a user may add a corresponding video material, and when the target video material is added to one audio slice, a next audio slice is automatically switched to.

It should be noted that, after the video corresponding to the target audio is manufactured, the user may select to publish or store the video, and when the user needs to publish the video, the video needs to be published through a corresponding video account, that is, in some embodiments, before the manufactured video is published, the video account of the user needs to be logged in, when the user does not register the video account, the user needs to create a video number, after the user finishes manufacturing the video, the user may click a video publishing control in a video manufacturing page, and then switch the video manufacturing page to a video publishing page, as shown in fig. 1m, where the video publishing page includes a publishing control and an audio link including the target audio and the video manufactured by the user, where a cover f of the link may be set by the user or generated by the system according to the audio information of the target audio, the user can click the publication control to publish the audio link. It should be noted that, when publishing a video, if the user logs in the corresponding video production account, the user can directly publish the audio link; if the user does not log in the corresponding video production account or the user does not have the video production account, the video publishing page can be switched to an account login page, the account login page comprises an account information input area A, an account login control B and an account registration control C, as shown in fig. 1n, if the user does not log in the corresponding video production account, the user can input an account password in the account information input area A, after the input is finished, the user clicks the account login control B to log in the video production account, and after the login is successful, the account login page is switched to the video publishing page to publish the audio connection; if the user does not have a video production account, the user can switch the video release page to an account registration page by clicking the account registration control C, as shown in fig. 1o, then the corresponding video production account can be generated by one key based on the account information of the user at the target client, and after the registration is successful, the account registration page is switched to the video release page to release the audio link.

Optionally, in some embodiments, after logging in the corresponding video production account, the user may view approval information, comment information, and attention information for the video production account, which are acquired by a video issued by the video production account, as shown in fig. 1 n.

Further, the user may also view pure videos, Music videos, and contents in a draft box issued by the Video production account, as shown in fig. 1p, where Music Videos (MVs) are associated videos of target audio in the present application, which refer to short films collocated with Music (usually, mostly songs), modern Music Video tapes are mainly produced for propaganda Music records, and after a new MV is issued by the user, a Music Video issuance list corresponding to a Music Video may be updated.

For example, specifically, a user may input an interactive content through a target client, then, corresponding interactive information may be generated according to the interactive content and an associated video, and the interactive information is added to an audio playing page to update the interactive information displayed on the audio playing page, optionally, in some embodiments, in order to avoid user misoperation and poor efficiency of issuing the interactive content, therefore, the audio playing page may be divided into regions, that is, the audio playing page includes an interactive information displaying region, an interactive content editing region, and an interactive content sending control, "respond to an interactive information input operation triggered by the target client for the audio playing page, update the interactive information displayed on the audio playing page according to the interactive content and the associated video corresponding to the interactive information input operation", the method specifically comprises the following steps:

(21) responding to an interactive information input operation triggered by a target client aiming at an interactive information editing area, and displaying input interactive contents in the interactive information editing area;

(22) and responding to the interactive information sending operation triggered by the target client aiming at the interactive content sending control, and updating the interactive information displayed in the interactive information display area according to the interactive content and the associated video.

Referring to fig. 1r, a user may input corresponding interactive content in an interactive information editing area, then the user may publish the interactive content by clicking an interactive content sending control, and then update the interactive information displayed in the interactive information display area based on the interactive content and associated video.

Further, in some embodiments, the target audio may include a plurality of audio slices, and therefore, in order to improve accuracy of the interactive information issued by the user, a corresponding target video is determined from the associated video based on a timestamp of an interactive information sending operation, that is, a video corresponding to the current audio slice is determined, and then, based on the interactive content and the target video, the interactive information displayed in the interactive information display area is updated, that is, the step "responding to an interactive information sending operation triggered by the target client for the interactive content sending control, and updating the interactive information displayed in the interactive information display area according to the interactive content and the associated video" may specifically include:

(31) acquiring a timestamp of interactive information sending operation;

(32) determining a video corresponding to the interactive information input operation from the associated video based on the timestamp to obtain a target video;

(33) and updating the interactive information displayed in the interactive information display area according to the interactive content and the target video.

The target interactive information may be obtained by constructing interactive information corresponding to a target client based on interactive content and a target video, where a style of the target interactive information may be set in advance by an operation and maintenance worker or the client, for example, information displayed by the target interactive information, a size in an interactive information display area, an interval between the target interactive information and other interactive information, and the like are set.

Further, there are two ways to update the interactive information displayed in the interactive information display area, 1) to hide the real-time interactive information in the interactive information display area and only display the target interactive information; 2) when the target interaction information is acquired each time, rendering and displaying the interaction information display area according to the release time of the real-time interaction information and the release time of the target interaction information, that is, optionally, in some embodiments, the step "updating the interaction information displayed in the interaction information display area by using the target interaction information" may specifically include:

(41) arranging the real-time interaction information according to the interaction time of the real-time interaction information;

(42) and when the target interactive information is acquired every time, rendering and displaying the interactive information display area according to the arrangement sequence of the real-time interactive information and the timestamp of the interactive information sending operation.

Optionally, in some embodiments, in order to facilitate viewing of a video, all real-time interactive information in the interactive information display area, the interactive content editing area, and the interactive content sending control may be hidden, where a hidden instruction for the real-time interactive information may be generated by the server, and when the hidden instruction is received, all real-time interactive information in the interactive information display area is hidden. Of course, hidden operations may also be performed by the user, for example, the audio playing page further includes a real-time interactive closing control, and the user may hide all of the real-time interactive information, the interactive content editing area, and the interactive content sending control by clicking the interactive closing control, that is, optionally, in some embodiments, the method may further include: and hiding the real-time interaction information, the interaction content editing area and the interaction content sending control in response to the real-time interaction information closing operation triggered by the interaction information display area.

In addition, referring to fig. 1s, a user may click on real-time interaction information published by other users to view a video watched by the clicked user when publishing the interaction information, that is, optionally, in some embodiments, the method may further include:

(51) in response to interactive information viewing operation triggered by the real-time interactive information, determining an audio client corresponding to the target real-time interactive information as a client to be viewed;

(52) determining a video played when a client to be checked sends target real-time interaction information;

(53) and switching the video played in the audio playing page to the video played when the client to be checked sends the target real-time interaction information.

Optionally, in some embodiments, in order to improve interactivity between the user and the video creator, a like control may be set in the audio playing page, and the user may click the like control to implement like of the video, and of course, the user may also implement like of the video by double-clicking the video, that is, the audio playing page includes the video like control, and the method may further include:

(61) updating the style of the compliment control and/or responding to the click operation triggered by the compliment control;

(62) responding to video praise operation triggered by the associated video, and playing animation corresponding to the video praise operation on the audio playing page.

When the target audio is played, the associated video is played at the same time, a user can click an audio playing page to pause the target audio, and when the target audio is paused, the associated video is also paused; the user can play the associated video in the page by double clicking the audio to realize the praise on the video, and in this way, play the animation of praise, further, the user can continuously double click the praise, play the animation corresponding to the continuous double click the praise at this time, it needs to be stated that, when continuously double click the praise, only play the animation corresponding to the continuous double click the praise, but not increase the number of praise, that is, the number of praise is 1; certainly, clicking the style of the praise control can also realize the praise of the video, and in this way, no animation is played, and only the style of the praise control informs the user that the video is praise, for example, the initial style of the praise control is hollow, and after the user clicks the praise control, the style of the praise control is adjusted to be solid.

It should be further noted that one or more associated videos corresponding to the target audio may be displayed, when there are a plurality of associated videos corresponding to the target audio, a video switching control may be displayed in an audio playing page, then, in response to a click operation on the video switching control, a video list including the associated videos is displayed in the audio playing page, then, in response to a selection operation on the associated videos in the video list, the selected associated videos are determined to be videos to be switched, finally, the currently played associated videos are switched to be switched, and animations during video switching are displayed in the video playing list, for example, the currently played video is video a, the user selects video B in the video list as a video to be switched, and then, the user clicks the video switching control to perform video switching, at this time, the process of switching from video a to video B may be exhibited with the effect of flipping the video.

Optionally, in some embodiments, the user may click on the lyrics to enter the full screen page of lyrics, as shown in fig. 1t, and then the user may swipe left the full screen page of lyrics, swipe right the full screen page of lyrics, or click on the arrow of the full screen page of lyrics to exit the full screen page of lyrics.

According to the method and the device, after the audio playing page corresponding to the target audio playing request is displayed, whether the video corresponding to the target audio is the video published by the video making account is detected, then the real-time interaction information corresponding to the target audio at the current moment is obtained, the real-time interaction information is displayed in the audio playing page, and finally the interaction information displayed on the audio playing page is updated according to the interaction content corresponding to the interaction information input operation in response to the interaction information input operation triggered by the target client aiming at the audio playing page. According to the multimedia information interaction scheme, the audio of the target audio and the video content of the video corresponding to the target audio are displayed on the audio playing page, the functions of a player integrated in an application are enriched, when the video corresponding to the target audio is the video published by the video production account, the interaction information displayed on the audio playing page can be updated according to the interaction content corresponding to the interaction information input operation, so that the interaction feedback between a user and multimedia information is realized, the experience of the user on the multimedia information is greatly enhanced, and more choices are provided for the user in a multimedia interaction feedback mode.

The method according to the examples is further described in detail below by way of example.

In this embodiment, the multimedia information interaction device is specifically integrated in a terminal as an example.

Referring to fig. 2, a multimedia information interaction method may specifically include the following processes:

201. and the terminal displays an audio playing page corresponding to the target audio playing request in the target client.

The target audio playing request is generated by a target client, an audio playing page displays audio of a target audio and video content of a video corresponding to the target audio, and the target audio playing request can be generated by the target client after a user clicks an audio link in the target client.

202. The terminal detects whether the video corresponding to the target audio is the video released by the video making account.

203. And when the terminal detects that the video corresponding to the target audio is the video released by the video making account, determining the video corresponding to the target audio as the associated video.

When the terminal detects that the video corresponding to the target audio is the video released by the video making account, the terminal can display a video making control in an audio playing page, then, the terminal responds to click operation triggered by the video making control and switches the audio playing page to the video making page, responds to selection operation aiming at the video material and determines the selected video material as the target video material, and the terminal responds to material adding operation aiming at the target video material, adds the target video material into the video material adding area and plays animation when the video material is added.

204. The terminal obtains real-time interaction information corresponding to the target audio at the current moment and displays the real-time interaction information in an audio playing page.

The real-time interactive information is issued by an audio client corresponding to the currently played target audio, and specifically, the terminal can sort the real-time interactive information according to the issuing time of the real-time interactive information.

205. And the terminal responds to the interactive information input operation triggered by the target client aiming at the audio playing page, and updates the interactive information displayed on the audio playing page according to the interactive content and the associated video corresponding to the interactive information input operation.

For example, specifically, a user may input interactive content through a target client, and then, a terminal may generate corresponding interactive information according to the interactive content and an associated video, and add the interactive information to an audio playing page, so as to update the interactive information displayed on the audio playing page.

The terminal detects whether a video corresponding to a target audio is a video published by a video production account or not after displaying an audio playing page corresponding to a target audio playing request, determines the video corresponding to the target audio as an associated video when detecting that the video corresponding to the target audio is the video published by the video production account, then acquires real-time interaction information corresponding to the target audio at the current moment and displays the real-time interaction information in the audio playing page, and finally responds to interaction information input operation triggered by a target client aiming at the audio playing page and updates the interaction information displayed by the audio playing page according to interaction content and the associated video corresponding to the interaction information input operation. According to the multimedia information interaction scheme, the audio of the target audio and the video content of the video corresponding to the target audio are displayed on the audio playing page, the functions of a player integrated in an application are enriched, when the video corresponding to the target audio is the video published by the video production account, the corresponding interaction content and the associated video can be input and operated according to the interaction information, and the interaction information displayed on the audio playing page is updated, so that the interaction feedback between a user and multimedia information is realized, the experience of the user on the multimedia information is greatly enhanced, and more choices are provided for the user in a multimedia interaction feedback mode.

In order to better implement the multimedia information interaction method according to the embodiment of the present application, an embodiment of the present application further provides a multimedia information interaction device (referred to as an interaction device for short) based on the foregoing multimedia information interaction method. The meaning of the noun is the same as that in the above multimedia information interaction method, and specific implementation details can refer to the description in the method embodiment.

Referring to fig. 3a, fig. 3a is a schematic structural diagram of a multimedia information interaction device according to an embodiment of the present application, where the interaction device may include a display module 301, an obtaining module 302, and an updating module 303, which may specifically be as follows:

the display module 301 is configured to display an audio playing page corresponding to the target audio playing request in the target client.

The target audio playing request is generated by a target client, an audio playing page displays audio of a target audio and video content of a video corresponding to the target audio, the target audio playing request may be generated by the target client after a user clicks an audio link in the target client, and the display module 301 may display audio information including the target audio and video content of the video corresponding to the target audio.

The obtaining module 302 is configured to obtain real-time interaction information corresponding to a target audio at a current time, and display the real-time interaction information in an audio playing page.

Specifically, the obtaining module 302 may obtain the real-time interaction information corresponding to the target audio at the current moment, and sequence the real-time interaction information according to the release time of the real-time interaction information.

The updating module 303 is configured to respond to an interaction information input operation triggered by the target client for the audio playing page, and update the interaction information displayed on the audio playing page according to the interaction content and the associated video corresponding to the interaction information input operation.

For example, specifically, the user may input the interactive content through the target client, and then the updating module 303 may generate corresponding interactive information according to the interactive content and the associated video, and add the interactive information to the audio playing page, so as to update the interactive information displayed on the audio playing page.

Optionally, in some embodiments, referring to fig. 3b, the interaction apparatus may further include a detection module 304, and the detection module 304 may be specifically configured to: and when the video corresponding to the target audio is detected to be the video issued by the video making account, determining the video corresponding to the target audio as the associated video.

It is understood that, in some embodiments, the updating module 303 may be specifically configured to: and responding to an interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content and the associated video corresponding to the interactive information input operation.

Optionally, in some embodiments, the updating module 303 may specifically include

The display sub-module is used for responding to the interactive information input operation triggered by the target client aiming at the interactive information editing area and displaying the input interactive content in the interactive information editing area;

Optionally, in some embodiments, the updating sub-module may specifically include:

the first determining unit is used for determining videos corresponding to interactive information input operation from the associated videos based on the timestamps to obtain target videos;

Optionally, in some embodiments, the updating unit may include:

the construction subunit is used for constructing interaction information corresponding to the target client according to the interaction content and the target video to obtain target interaction information;

Optionally, in some embodiments, the update subunit may specifically be configured to: arranging the real-time interactive information according to the interactive time of the real-time interactive information; and when the target interactive information is acquired every time, rendering and displaying the interactive information display area according to the arrangement sequence of the real-time interactive information and the timestamp of the interactive information sending operation.

Optionally, in some embodiments, the mobile terminal may further include a hiding subunit, and the hiding subunit may be specifically configured to: and hiding the real-time interaction information, the interaction content editing area and the interaction content sending control in response to the real-time interaction information closing operation triggered by aiming at the interaction information display area.

Optionally, in some embodiments, the mobile terminal further includes a first switching unit, and the first switching unit may specifically be configured to: and responding to interactive information viewing operation triggered by the real-time interactive information, determining an audio client corresponding to the target real-time interactive information as a client to be viewed, acquiring a video played when the client to be viewed sends the target real-time interactive information, and switching the video played in an audio playing page to the video played when the client to be viewed sends the target real-time interactive information.

Optionally, in some embodiments, the apparatus further includes a playing unit, and the playing unit may specifically be configured to: updating the style of the compliment control and/or responding to the click operation triggered by the compliment control; responding to video praise operation triggered by the associated video, and playing animation corresponding to the video praise operation on the audio playing page.

Optionally, in some embodiments, the mobile terminal further includes a second switching unit, and the second switching unit may specifically be configured to: displaying a video switching control in an audio playing page; in response to the clicking operation of the video switching control, displaying a video list containing the associated video in the audio playing page; responding to the selection operation of the associated video in the video list, and determining the selected associated video as the video to be switched; and switching the currently played associated video into a video to be switched, and displaying the animation during video switching in the video playlist.

Optionally, in some embodiments, the detection module 304 may specifically include:

the first display unit is used for displaying a video production control in an audio playing page when detecting that a video corresponding to a target audio is a video issued by a video production account;

the third switching unit is used for responding to the click operation triggered by the video production control or the video production prompt control, switching the audio playing page into the video production page, and responding to the selection operation of the video material to determine the selected video material as the target video material;

and an adding unit configured to add the target video material to the video material addition area in response to a material addition operation for the target video material, and play animation at the time of video material addition.

The video making page comprises a video material adding area and a video material area, the video material adding area comprises at least one video material, a user can browse the video material in the video material area by sliding the video material area, and when the user determines the video material required to be selected, the target video material can be added into the video material adding area in a dragging mode.

Optionally, in some embodiments, the adding unit may specifically be configured to: according to a preset time interval and the audio content of the target audio, segmenting the target audio to obtain a plurality of audio slices corresponding to the target audio; each time the target video material is added to one audio slice, the currently processed audio is switched to the next audio slice.

Optionally, in some embodiments, the detection module 304 may be further configured to: and when the video corresponding to the target audio is not detected, playing a preset video in the audio playing page.

Optionally, in some embodiments, referring to fig. 3c, the interaction device may further include a playing module 305, where the playing module 305 may be specifically configured to: acquiring audio dividing information of a target audio; dividing the target audio based on the audio dividing information to obtain at least one audio slice; and determining the associated videos corresponding to the divided audios, and sequentially playing the associated videos corresponding to the divided audios according to the playing time of each divided audio.

Optionally, in some embodiments, the audio playing page may further include a client-side association control, please refer to fig. 3d, the interaction apparatus may further include a switching module 306, and the switching module 306 may be specifically configured to: and responding to the click operation triggered by the client-side association control, determining an associated client side associated with the target client side, and switching the audio playing page into the page of the associated client side.

Optionally, in some embodiments, the audio playing page further includes a state setting control, please refer to fig. 3e, the interaction apparatus may further include a setting module 307, and the setting module 307 may be specifically configured to: and setting the account state of the user account in the target client to be an audio playing state in response to the state setting operation triggered by the state setting control.

After the display module 301 displays the audio playing page corresponding to the target audio playing request, the obtaining module 302 obtains real-time interaction information corresponding to the target audio at the current moment, and displays the real-time interaction information in the audio playing page, and finally, the updating module 303 responds to an interaction information input operation triggered by the target client for the audio playing page, and updates the interaction information displayed on the audio playing page according to interaction content and associated video corresponding to the interaction information input operation. According to the multimedia information interaction scheme, the audio of the target audio and the video content of the video corresponding to the target audio are displayed on the audio playing page, the functions of a player integrated in an application are enriched, when the video corresponding to the target audio is the video published by the video production account, the interaction information displayed on the audio playing page can be updated according to the interaction content corresponding to the interaction information input operation, so that the interaction feedback between a user and multimedia information is realized, the experience of the user on the multimedia information is greatly enhanced, and more choices are provided for the user in a multimedia interaction feedback mode.

In addition, an electronic device according to an embodiment of the present application is further provided, as shown in fig. 4, which shows a schematic structural diagram of the electronic device according to an embodiment of the present application, and specifically:

the electronic device may include components such as a processor 401 of one or more processing cores, memory 402 of one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 4 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the processor 401 is a control center of the electronic device, connects various parts of the whole electronic device by various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by operating the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the electronic device, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 access to the memory 402.

The electronic device further comprises a power supply 403 for supplying power to the various components, and preferably, the power supply 403 is logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are realized through the power management system. The power supply 403 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

The electronic device may further include an input unit 404, and the input unit 404 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the electronic device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable file corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 401 runs the application program stored in the memory 402, thereby implementing various functions as follows:

displaying an audio playing page corresponding to the target audio playing request, acquiring real-time interaction information corresponding to the target audio at the current moment, displaying the real-time interaction information in the audio playing page, responding to interaction information input operation triggered by the target client aiming at the audio playing page, and updating the interaction information displayed on the audio playing page according to interaction content corresponding to the interaction information input operation.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

According to the embodiment of the application, after the audio playing page corresponding to the target audio playing request is displayed, the real-time interaction information corresponding to the target audio at the current moment is obtained, the real-time interaction information is displayed in the audio playing page, and finally, the interaction information displayed on the audio playing page is updated according to the interaction content and the associated video corresponding to the interaction information input operation in response to the interaction information input operation triggered by the target client aiming at the audio playing page. According to the multimedia information interaction scheme, the audio of the target audio and the video content of the video corresponding to the target audio are displayed on the audio playing page, the functions of a player integrated in an application are enriched, when the video corresponding to the target audio is the video published by the video production account, the interaction information displayed on the audio playing page can be updated according to the interaction content corresponding to the interaction information input operation, so that the interaction feedback between a user and multimedia information is realized, the experience of the user on the multimedia information is greatly enhanced, and more choices are provided for the user in a multimedia interaction feedback mode.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the present application provides a storage medium, in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any one of the multimedia information interaction methods provided in the present application. For example, the instructions may perform the steps of:

displaying an audio playing page corresponding to the target audio playing request, detecting whether a video corresponding to the target audio is a video published by a video production account, when the video corresponding to the target audio is detected to be the video published by the video production account, determining the video corresponding to the target audio as an associated video, acquiring real-time interaction information corresponding to the target audio at the current moment, displaying the real-time interaction information in the audio playing page, responding to interaction information input operation triggered by a target client aiming at the audio playing page, and updating the interaction information displayed by the audio playing page according to interaction content and the associated video corresponding to the interaction information input operation.

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium can execute the steps in any multimedia information interaction method provided in the embodiments of the present application, beneficial effects that can be achieved by any multimedia information interaction method provided in the embodiments of the present application can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.

The foregoing describes in detail a multimedia information interaction method, apparatus, electronic device, and storage medium provided in the embodiments of the present application, and specific examples are applied herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method for multimedia information interaction, comprising:

2. The method according to claim 1, wherein before the responding to the interaction information input operation triggered by the target client for the audio playing page and according to the interaction content corresponding to the interaction information input operation, updating the interaction information displayed on the audio playing page, the method further comprises:

the updating the interactive information displayed on the audio playing page according to the interactive content corresponding to the interactive information input operation in response to the interactive information input operation triggered by the target client for the audio playing page comprises: and responding to an interactive information input operation triggered by the target client aiming at the audio playing page, and updating the interactive information displayed on the audio playing page according to the interactive content and the associated video corresponding to the interactive information input operation.

3. The method according to claim 2, wherein the audio playback page includes an interactive information display area, an interactive content editing area, and an interactive content sending control, and the updating the interactive information displayed on the audio playback page according to the interactive content corresponding to the interactive information input operation and the associated video in response to the interactive information input operation triggered by the target client for the audio playback page includes:

responding to an interactive information input operation triggered by the target client aiming at the interactive information editing area, and displaying input interactive contents in the interactive information editing area;

and responding to an interactive information sending operation triggered by the target client aiming at the interactive content sending control, and updating the interactive information displayed in the interactive information display area according to the interactive content and the associated video.

4. The method according to claim 3, wherein the updating the interactive information displayed in the interactive information display area according to the interactive content and the associated video in response to the interactive information transmission operation triggered by the target client for the interactive content transmission control comprises:

acquiring a timestamp of the interactive information sending operation;

determining a video corresponding to the interactive information input operation from the associated video based on the timestamp to obtain a target video;

and updating the interactive information displayed in the interactive information display area according to the interactive content and the target video.

5. The method of claim 4, wherein the updating the interactive information displayed in the interactive information display area according to the interactive content and the target video comprises:

constructing interaction information corresponding to the target client according to the interaction content and the target video to obtain target interaction information;

and updating the interactive information displayed in the interactive information display area by using the target interactive information.

6. The method according to claim 5, wherein the updating the interactive information displayed in the interactive information display area by using the target interactive information comprises:

7. The method of claim 5, further comprising:

8. The method of claim 4, further comprising:

9. The method of claim 4, wherein the audio playback page comprises video thumbs up controls, and further comprising:

10. The method of claim 4, wherein after determining the video corresponding to the target audio as the associated video, further comprising:

displaying a video switching control in the audio playing page;

11. The method of any one of claims 1 to 10, further comprising:

acquiring audio dividing information of the target audio;

segmenting the target audio based on the audio segmentation information to obtain at least one audio slice;

12. The method of any of claims 1 to 10, wherein the audio playback page further comprises a client-associated control, further comprising:

13. A multimedia information interaction apparatus, comprising:

the display module is used for displaying an audio playing page corresponding to the target audio playing request in the target client, and the audio playing page displays video content of a video corresponding to the target audio;

14. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the multimedia information interaction method according to any one of claims 1 to 12 when executing the program.

15. A storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements the steps of the multimedia information interaction method according to any of claims 1-12.