CN115643241A - Multimedia resource editing method and device, electronic equipment and storage medium - Google Patents

Multimedia resource editing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN115643241A
CN115643241A CN202211083993.4A CN202211083993A CN115643241A CN 115643241 A CN115643241 A CN 115643241A CN 202211083993 A CN202211083993 A CN 202211083993A CN 115643241 A CN115643241 A CN 115643241A
Authority
CN
China
Prior art keywords
editing
client
multimedia resource
edited
multimedia
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211083993.4A
Other languages
Chinese (zh)
Inventor
王凯文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN202211083993.4A priority Critical patent/CN115643241A/en
Publication of CN115643241A publication Critical patent/CN115643241A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Television Signal Processing For Recording (AREA)

Abstract

The disclosure relates to a multimedia resource editing method, a multimedia resource editing device, electronic equipment and a storage medium, and relates to the technical field of data processing. The method and the device at least solve the problem that resource creation time required for resource creation of multimedia resources is long in the related art. The method comprises the following steps: in the process of communication with a second client, displaying the multimedia resource to be edited on the first editing interface, and synchronizing the multimedia resource to be edited to the second client; responding to the first operation, and displaying first result information on a first editing interface; sending the first result information to a second client; and under the condition of receiving second result information sent by the second client, displaying the second result information on the first editing interface. Therefore, the resource authoring time required by a plurality of clients for authoring the same multimedia resource can be reduced.

Description

Multimedia resource editing method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a method and an apparatus for editing a multimedia resource, an electronic device, and a storage medium.
Background
With the popularization of intelligent terminals and the development of network technologies, users can transmit messages or express emotions by watching and publishing multimedia resources. Before the multimedia resource is released, the initial multimedia resource can be subjected to resource creation, and the resource creation process can adopt editing operations of adding subtitles, shielding sensitive information, adjusting the tone of an image frame, adding a sticker and the like.
However, once the initial multimedia resources increase in volume, it takes a lot of time to complete the resource creation, and many editing operations need to be continuously input during the resource creation process, which reduces the creation efficiency and further increases the resource creation time.
Disclosure of Invention
The present disclosure provides a multimedia asset editing method, apparatus, electronic device and storage medium, to at least solve the problem in the related art that a resource creation time required for creating a multimedia asset is long. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a multimedia asset editing method, applied to a first client, including: in the process of communication with a second client, displaying the multimedia resource to be edited on a first editing interface, and synchronizing the multimedia resource to be edited to the second client, wherein the first editing interface is used for editing the multimedia resource to be edited; responding to a first operation aiming at the multimedia resource to be edited, and displaying first result information corresponding to the first operation on the first editing interface based on the multimedia resource to be edited, wherein the first result information comprises first effect editing information and first material expansion information; sending the first result information to the second client so as to display the first result information on a second editing interface of the second client; under the condition of receiving second result information sent by a second client, displaying the second result information on the first editing interface based on the multimedia resource to be edited, wherein the second result information is as follows: and the second client responds to result information obtained by the second operation, and the second result information comprises second effect editing information and second element expansion information.
Optionally, the displaying the multimedia resource to be edited on the first editing interface in the process of the call with the second client includes: displaying a resource editing control on a preset interface in the process of communicating with a second client; responding to a third operation aiming at the resource editing control, and displaying a first editing interface, wherein the first editing interface comprises a resource import control; in response to a fourth operation on the resource import control, displaying a multimedia resource list on the first editing interface, wherein editable multimedia resources in the multimedia resource list comprise any one or a combination of any of the following: the method comprises the steps of recording multimedia resources, authorized multimedia resources, first real-time multimedia resources shot by a camera of a first client, second real-time multimedia resources shot by a camera of a second client, and splicing multimedia resources, wherein the splicing multimedia resources comprise the first real-time multimedia resources and the second real-time multimedia resources; and in response to a fifth operation aiming at the at least one editable multimedia resource, determining a multimedia resource to be edited in the editable multimedia resource, and displaying the multimedia resource to be edited on the first editing interface.
Optionally, the method for editing a multimedia resource further includes: under the condition that the preset interface is an instant messaging interface, responding to a third operation aiming at the resource editing control, and displaying a first editing interface; the instant messaging interface is used for indicating that the first client and the second client are in a conversation; and under the condition that the preset interface is a resource browsing interface, responding to a third operation aiming at the resource editing control, under the condition that the currently browsed multimedia resource displayed on the resource browsing interface belongs to the editable multimedia resource, determining that the currently browsed multimedia resource is the multimedia resource to be edited, and displaying the multimedia resource to be edited on the first editing interface.
Optionally, the method for editing multimedia resources further includes: storing a first real-time multimedia resource and a second real-time multimedia resource in the process of communication with a second client; acquiring a first image sequence of a first real-time multimedia resource and a second image sequence of a second real-time multimedia resource; combining the images in the first image sequence and the second image sequence according to a preset combining mode to generate a third image sequence; and generating the spliced multimedia resource according to the preset frame rate according to the third image sequence.
Optionally, in the multimedia resource editing method, the first editing interface includes an effect editing control and a material expansion control; the above displaying, in response to the first operation on the first editing interface, the first result information based on the multimedia resource to be edited on the first editing interface includes: under the condition that the first operation is an effect editing operation, responding to the first operation aiming at the effect editing control, and displaying first effect editing information on the first editing interface based on the multimedia resource to be edited, wherein the first effect editing information comprises special effect element adding information, video clipping information and image beautifying information; under the condition that the first operation is a material expansion editing operation, responding to the first operation aiming at the material expansion control, and displaying a multimedia resource list on a first editing interface; responding to a second multimedia resource selection operation aiming at least one editable multimedia resource, and determining a multimedia resource to be expanded in the editable multimedia resource; the multimedia resource to be expanded is spliced to the multimedia resource to be edited, the multimedia resource to be edited is displayed on a first editing interface, and the first material expansion information comprises the multimedia resource to be expanded.
Optionally, the method for editing multimedia resources further includes: under the condition that preset conditions are met, a sharing request is generated and used for requesting a second client to edit the multimedia resources together; sending the sharing request to a second client through a communication channel established in the conversation process with the second client; under the condition of receiving a response message sent by the second client, synchronizing the multimedia resource to be edited to the second client; wherein the preset condition includes any one of: and receiving a third operation aiming at the resource editing control, and displaying the multimedia resource to be edited on the first editing interface.
Optionally, the method for editing a multimedia resource further includes: in the process of communication with a second client, after a multimedia resource to be edited is displayed on a first editing interface, a first special effect element is displayed on the first editing interface, wherein the first special effect element comprises: searching an editing element corresponding to a first target semantic in a preset special effect database, wherein the first target semantic is used for expressing: in the conversation process, voice semantic recognition is carried out on the voice information received by a microphone of the first client; in a case where the first operation is a special effect application operation for a first special effect element, in response to the first operation for a first editing interface, displaying first effect editing information based on a multimedia resource to be edited on the first editing interface, where the first effect editing information is: and adding effect information of the first special effect element based on the multimedia resource to be edited.
Optionally, the method for editing multimedia resources further includes: in the process of communication with the second client, after the multimedia resource to be edited is displayed on the first editing interface, under the condition that the number of the first special effect elements is equal to 1, first effect editing information is displayed on the first editing interface based on the multimedia resource to be edited.
Optionally, the method for editing multimedia resources further includes: under the condition that the first special effect element is displayed on the first editing interface, sending a first special effect identifier corresponding to the first special effect element to the second client so as to display the first special effect element on the second editing interface of the second client; or after the first special effect element is displayed on the first editing interface, the first special effect identifier corresponding to the first special effect element is sent to the second client, so that the first special effect element is displayed on the second editing interface of the second client conveniently.
Optionally, the method for editing a multimedia resource further includes: in the process of communication with a second client, after a multimedia resource to be edited is displayed on a first editing interface, under the condition of receiving a second special effect identifier sent by the second client, displaying a second special effect element corresponding to the second special effect identifier on the first editing interface, wherein the second special effect element comprises: searching an editing element corresponding to a second target semantic in a preset special effect database, wherein the second target semantic is used for expressing: and in the conversation process, performing voice semantic recognition on the voice information received by the microphone of the second client.
Optionally, the method for editing a multimedia resource further includes: after the multimedia resource to be edited is displayed on the first editing interface, in response to a sixth operation on the multimedia resource to be edited, determining a work release attribute of the multimedia resource to be edited, wherein the work release attribute comprises at least one of the following items: signing and recommending friend evaluations; and responding to the seventh operation aiming at the multimedia resource to be edited, and publishing the multimedia resource to be edited displayed by the first editing interface according to the work publishing attribute.
Optionally, the method for editing multimedia resources further includes: and in response to the seventh operation aiming at the multimedia resource to be edited, after the multimedia resource to be edited displayed on the first editing interface is published according to the release attribute of the work, in response to the eighth operation aiming at the multimedia resource to be edited, authorization prompt information is sent to the target user account, so that the target user account can continuously edit the multimedia resource to be edited displayed on the first editing interface.
According to a second aspect of the embodiments of the present disclosure, there is provided a multimedia asset editing method, applied to a second client, including: in the process of communication with a first client, under the condition that a multimedia resource to be edited displayed on a first editing interface sent by the first client is received, displaying the multimedia resource to be edited on a second editing interface, wherein the second editing interface is used for editing the multimedia resource to be edited; under the condition of receiving first result information sent by a first client, displaying the first result information on a second editing interface based on a multimedia resource to be edited, wherein the first result information is as follows: the first client responds to result information obtained by the first operation, wherein the first result information comprises first effect editing information and first material extension information; responding to a second operation aiming at the multimedia resource to be edited, and displaying second result information corresponding to the second operation on the second editing interface based on the multimedia resource to be edited, wherein the second result information comprises second effect editing information and second element expansion information; and sending the second result information to the first client so as to display the second result information on a first editing interface of the first client.
Optionally, the method for editing a multimedia resource further includes: the second editing interface comprises an effect editing control and a material adding control; responding to a second operation aiming at the multimedia resource to be edited, and displaying second result information corresponding to the second operation on the second editing interface based on the multimedia resource to be edited, wherein the second result information comprises: under the condition that the second operation is an effect editing operation, responding to the second operation aiming at the effect editing control, and displaying second effect editing information on a second editing interface based on the multimedia resource to be edited, wherein the second effect editing information comprises special effect element adding information, video clipping information and image beautifying information;
under the condition that the second operation is the material expansion editing operation, responding to the second operation aiming at the material expansion operation control, displaying a multimedia resource list on a second editing interface, and displaying a plurality of editable multimedia resources in the multimedia resource list; responding to a second multimedia resource selection operation aiming at least one editable multimedia resource, and determining a multimedia resource to be expanded in the editable multimedia resource; and splicing the multimedia resource to be expanded to the multimedia resource to be edited, and displaying the multimedia resource to be edited on a second editing interface, wherein the first material expansion information comprises the multimedia resource to be expanded.
Optionally, the method for editing a multimedia resource further includes: under the condition of receiving a sharing request sent by a first client, responding to a request reply operation aiming at the sharing request, and generating a response message; and sending the response message to the first client through a communication channel established in the conversation process with the first client.
Optionally, the method for editing a multimedia resource further includes: after a multimedia resource to be edited is displayed on a second editing interface, under the condition that a first special effect identifier sent by a first client is received, a first special effect element corresponding to the first special effect identifier is displayed on the second editing interface, wherein the first special effect element comprises: searching an editing element corresponding to a first target semantic in a preset special effect database, wherein the first target semantic is used for expressing: and in the conversation process, performing voice semantic recognition on the voice information received by the microphone of the first client.
Optionally, the method for editing multimedia resources further includes: after the multimedia resource to be edited is displayed on the second editing interface, displaying a second special effect element on the second editing interface, wherein the second special effect element comprises: searching an editing element corresponding to a second target semantic in a preset special effect database, wherein the second target semantic is used for expressing: in the conversation process, voice semantic recognition is carried out on the voice information received by the microphone of the second client; and under the condition that the second operation is a special effect application operation of a second special effect element, responding to the second operation aiming at the multimedia resource to be edited, and displaying second editing effect information on the second editing interface based on the multimedia resource to be edited, wherein the second editing effect information is effect information which is displayed on the basis of the multimedia resource to be edited and added with the second special effect element.
Optionally, the method for editing multimedia resources further includes: and after the multimedia resource to be edited is displayed on the second editing interface, under the condition that the number of the second special effect elements is equal to 1, displaying second editing effect information corresponding to the second operation on the second editing interface based on the multimedia resource to be edited.
Optionally, the method for editing a multimedia resource further includes: under the condition that a second special effect element is displayed on a second editing interface, sending a second special effect identifier corresponding to the second special effect element to the first client so as to display the second special effect element on the first editing interface of the first client conveniently; or after the second special effect element is displayed on the second editing interface, sending the second special effect identifier corresponding to the second special effect element to the first client, so that the second special effect element is displayed on the first editing interface of the first client.
Optionally, the method for editing a multimedia resource further includes: after the multimedia resource to be edited is displayed on the second editing interface, in response to the operation aiming at the multimedia resource to be edited, determining the work release attribute of the multimedia resource to be edited, wherein the work release attribute comprises at least one of the following items: signing and recommending friend evaluations; and responding to the operation aiming at the multimedia resource to be edited, and publishing the multimedia resource to be edited displayed on the second editing interface according to the work publishing attribute.
Optionally, the method for editing multimedia resources further includes: and after the multimedia resource to be edited displayed on the second editing interface is released according to the work release attribute in response to the operation on the multimedia resource to be edited, authorization prompt information is sent to the target user account in response to the operation on the multimedia resource to be edited, so that the target user account can continuously edit the multimedia resource to be edited displayed on the second editing interface.
According to a third aspect of the embodiments of the present disclosure, there is provided a multimedia asset editing apparatus, applied to a first client, including a first processing unit, a first display unit, and a first sending unit; the first processing unit is used for displaying the multimedia resource to be edited on a first editing interface in the process of communicating with the second client side and synchronizing the multimedia resource to be edited to the second client side, and the first editing interface is used for editing the multimedia resource to be edited; the first display unit is used for responding to a first operation aiming at a first editing interface, and displaying first result information corresponding to the first operation on the first editing interface based on the multimedia resource to be edited, wherein the first result information comprises first effect editing information and first material extension information; the first sending unit is used for sending the first result information to the second client so as to display the first result information on a second editing interface of the second client; the first display unit is further configured to display, on the first editing interface, second result information based on the multimedia resource to be edited in the case that the second result information sent by the second client is received, where the second result information is: and the second client responds to result information obtained by the second operation, and the second result information comprises second effect editing information and second element extension information.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a multimedia asset editing apparatus, applied to a second client, including a second processing unit, a second display unit, and a second sending unit; the second processing unit is used for displaying the multimedia resource to be edited on a second editing interface under the condition that the multimedia resource to be edited displayed on the first editing interface sent by the first client is received in the process of communicating with the first client, and the second editing interface is used for editing the multimedia resource to be edited; the second display unit is used for displaying the first result information on the basis of the multimedia resource to be edited on a second editing interface under the condition that the first result information sent by the first client is received, wherein the first result information is as follows: the first client responds to result information obtained by the first operation, wherein the first result information comprises first effect editing information and first material expansion information; the second display unit is also used for responding to a second operation aiming at the multimedia resource to be edited and displaying second result information corresponding to the second operation on the second editing interface based on the multimedia resource to be edited; and the second sending unit is used for sending the second result information to the first client so as to display the second result information on the first editing interface of the first client, wherein the second result information comprises second result editing information and second element extension information.
According to a fifth aspect of embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the above instructions to implement the multimedia asset editing method as provided in the first aspect and any one of its possible designs, or in the second aspect and any one of its possible designs.
According to a sixth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions of the computer-readable storage medium, when executed by a processor, can implement the multimedia asset editing method as provided in the first aspect and any one of the possible design manners thereof, or as provided in the second aspect and any one of the possible design manners thereof.
According to a seventh aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program/instructions which, when executed by a processor, implements the multimedia asset editing method as provided by the first aspect and any one of its possible designs.
The technical scheme provided by the disclosure at least brings the following beneficial effects: by the technical scheme, the first client and the second client can realize the common editing of the multimedia resource to be edited in the conversation process, application scenes in the conversation process can be enriched, and the transmission message or expression emotion of the multimedia resource to be edited is consistent by means of the conversation process and the mutual transmission of the editing effect information of the multimedia resource, so that the transferability of the multimedia resource to be edited can be improved. In addition, the first client and the second client can be in communication to realize the common editing of the multimedia resources to be edited, the resource creation time required for resource creation of the multimedia resources can be reduced, the geographic positions of the first client and the second client are not limited, the practicality of the common editing is improved, meanwhile, the interestingness can be increased through the common editing, furthermore, the participation of users can be increased, and the quantity and the quality of the multimedia resources obtained through the common editing are improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
FIG. 1 is a schematic diagram illustrating the architecture of a multimedia asset editing system, according to an exemplary embodiment;
FIG. 2 is one of the flow diagrams of a method for editing a multimedia asset shown in accordance with an exemplary embodiment;
FIG. 3 is a second flowchart illustrating a method for editing a multimedia asset according to an exemplary embodiment;
FIG. 4 is one of the schematic diagrams of a resource editing control shown in accordance with an exemplary embodiment;
FIG. 5 is a second schematic diagram illustrating a resource editing control in accordance with an illustrative embodiment;
FIG. 6 is a third schematic diagram illustrating a resource editing control in accordance with an illustrative embodiment;
fig. 7 is a third flowchart illustrating a method for editing a multimedia asset according to an exemplary embodiment;
FIG. 8 is a fourth flowchart illustrating a method for multimedia asset editing, according to an exemplary embodiment;
FIG. 9 is a fifth flowchart illustrating a method for multimedia asset editing, according to an exemplary embodiment;
FIG. 10 is one of the intents of an editing interface shown in accordance with an exemplary embodiment;
FIG. 11 is a second schematic diagram of an editing interface, shown in accordance with an exemplary embodiment;
FIG. 12 is a sixth flowchart illustrating a method for multimedia asset editing, according to an exemplary embodiment;
FIG. 13 is a diagram illustrating a first effect element, according to an example embodiment;
fig. 14 is a diagram illustrating first effect edit information according to an exemplary embodiment;
FIG. 15 is one of the block diagrams of a multimedia asset editing apparatus shown in accordance with an exemplary embodiment;
FIG. 16 is a second block diagram illustrating a multimedia asset editing apparatus in accordance with an exemplary embodiment;
fig. 17 is a schematic diagram of a structure of an electronic device shown in accordance with an exemplary embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in other sequences than those illustrated or described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In addition, in the description of the embodiments of the present disclosure, "/" indicates an OR meaning, for example, A/B may indicate A or B, unless otherwise specified. "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present disclosure, "a plurality" means two or more than two.
It should be noted that, the result information (including but not limited to the first result information and the second result information) and the multimedia assets (including but not limited to the multimedia assets used for recording, the authorized multimedia assets, the first real-time multimedia assets shot by the camera of the first client, the second real-time multimedia assets shot by the camera of the second client, and the like) related to the embodiment of the disclosure are result information and multimedia assets that are authorized by the user or sufficiently authorized by each party, where the first result information includes the first effect editing information and the first material extension information, and the second result information includes the second effect editing information and the second material extension information.
Because multimedia resources may involve more information, have a longer duration, or have more shooting materials, multimedia resources may take a lot of time to edit before being released, such as deleting partial images, adjusting image sequence, adding subtitles, blocking sensitive information, adjusting the color of image frames, adding stickers, and the like. In order to obtain coherent and smooth multimedia resources with clear meanings and vivid themes, a plurality of participants can cooperate to jointly perform multimedia resource creation on the multimedia resources to be edited. In the process of creating the resources, the design materials (used for editing the multimedia resources to be edited) can be classified, the editing permission of the design materials is configured for the multiple participants according to the classification result, and when an editing request (including the design materials) of any participant is received, the editing operation corresponding to the editing request is executed according to the editing permission of any participant, so that the edited multimedia resources corresponding to the multimedia resources to be edited are obtained. However, the independent editing of the multimedia resource by the multiple participants leads to the mutual independence of the time slots in the target multimedia resource, or the mutual independence of the design elements in the target video, and further leads to the consistency of the transmission message or the expression emotion of the time slots in the target multimedia resource, which requires a lot of resource creation time for creating the multimedia resource.
In view of the above problems, the present disclosure provides a multimedia asset editing system. Fig. 1 shows a schematic structural diagram of the multimedia asset editing system. As shown in fig. 1, the multimedia asset editing system is used for solving the problem in the related art that a plurality of participants for multimedia asset production independently perform multimedia asset editing, so that more resource creation time is required for creating resources for multimedia assets in order to unify the communication messages or expression emotions of each time period in a target multimedia asset. The multimedia asset editing system comprises: a first client 11, a second client 12 and a server 13. The first client 11 and the second client 12 are connected through a server 13.
The first client 11 may be used for a call with the second client 12, for example, a video call or a voice call. The first client 11 may execute the multimedia resource editing method in the embodiment of the present disclosure, for example, during a call with the second client, the multimedia resource to be edited is displayed on the first editing interface, and the multimedia resource to be edited is synchronized to the second client; responding to a first operation aiming at the multimedia resource to be edited, and displaying first result information corresponding to the first operation on the basis of the multimedia resource to be edited on a first editing interface; sending the first result information to a second client; and under the condition of receiving second result information sent by the second client, displaying the second result information on the basis of the multimedia resource to be edited on the first editing interface.
In the embodiment of the present disclosure, the first client 11 may further include or be connected to a database, and the multimedia resource to be edited may be stored in the database. In the embodiment of the present disclosure, the first client 11 may be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like, and the device form of the first client 11 is not limited herein.
The second client 12 may also execute the multimedia resource editing method in the embodiment of the present disclosure, for example, in a call process with the first client, in a case of receiving the multimedia resource to be edited displayed on the first editing interface sent by the first client, displaying the multimedia resource to be edited on the second editing interface; under the condition that first result information sent by a first client side is received, displaying the first result information on the basis of a multimedia resource to be edited on a second editing interface; responding to a second operation aiming at the multimedia resource to be edited, and displaying second result information corresponding to the second operation on the second editing interface based on the multimedia resource to be edited; and sending the second result information to the first client.
In the embodiment of the present disclosure, the second client 12 may be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like, and the device form of the second client 12 is not limited herein. In the embodiment of the present disclosure, the device modalities of the first client 11 and the second client 12 may be the same. For example, the first client 11 and the second client 12 may both be mobile phones, or both be tablet computers. In other embodiments, the device modalities of the first client 11 and the second client 12 may be different.
The server 13 is used for providing the first client 11 and the second client 12 with the functions of transferring and implementing the first operation, the second operation, the first result information and the second result information. The first client 11 and the second client 12 may be connected by a server 13 in a wired or wireless manner. For example, the wireless communication protocol used between the first client 11 and the second client 12 may be a wireless fidelity (Wi-Fi) protocol, a bluetooth (bluetooth) protocol, a ZigBee protocol, a Near Field Communication (NFC) protocol, various cellular network protocols, and the like, without limitation.
In practical applications, the multimedia asset editing method provided by the embodiment of the present disclosure is applied to the first client 11 and the second client 12, and the following describes the multimedia asset editing method provided by the embodiment of the present disclosure with reference to the drawings.
Fig. 2 shows one of the flow diagrams of the multimedia asset editing method provided in the embodiment of the present disclosure. As shown in fig. 2, the multimedia asset editing method provided by the embodiment of the present disclosure includes the following steps 201 to 208.
Step 201, in the process of the first client communicating with the second client, the multimedia resource to be edited is displayed on the first editing interface, and the multimedia resource to be edited is synchronized to the second client.
In the embodiment of the present disclosure, the first editing interface is used for editing a multimedia resource to be edited. For example, the multimedia resource to be edited may be a video, a picture, a text, an audio, a motion picture, an interactive media, a game, a web page, a virtual reality, and the like, which is not limited in the embodiment of the present disclosure.
In the embodiment of the present disclosure, a call between the first client and the second client may be a video call or an audio call, that is, a continuous communication channel is established between the first client and the second client, so as to ensure that the first client and the second client can perform real-time data transmission. It should be noted that, with the development of network technology, the speed of transmitting data in the communication channel is faster and faster in the communication process of the first client at the second client, so that the communication channel can be used to transmit multimedia resource editing data, which can improve the utilization rate of the communication channel on one hand, and can realize synchronous communication and multimedia resource editing on the other hand, thereby improving the efficiency of collaborative editing. It is to be understood that the number of the second clients may be one or more, which is not limited in the embodiment of the present disclosure.
Optionally, in this embodiment of the present disclosure, as shown in fig. 3, step 201 may be implemented by steps 301 to 304.
Step 301, displaying a resource editing control on a preset interface during a call between a first client and a second client.
In the embodiment of the present disclosure, the preset interface may be an instant messaging interface, and may also be a resource browsing interface. Under the condition that the preset interfaces are different, the first client can display the resource editing control in the same display mode or can display the resource editing control in different display modes. The instant messaging interface is used for indicating that the first client and the second client are in a conversation.
For example, assuming that the preset interface is an instant messaging interface and the call type between the first client and the second client is a video call type, the resource editing control displayed on the instant messaging interface of the first client is shown in (a) in fig. 4, and the resource editing control displayed on the instant messaging interface of the second client is shown in (b) in fig. 4.
Exemplarily, it is assumed that the preset interface is a resource browsing interface, and the resource editing control is displayed on the resource browsing interface of the first client in a floating control display manner as shown in fig. 5, or is displayed on the resource browsing interface of the first client in an embedded functional area display manner as shown in fig. 6.
For example, it is assumed that the preset interface is a resource browsing interface, and the display modes of the resource editing control displayed on the resource browsing interface of the second client and the resource browsing interface of the first client are not limited.
In this embodiment of the present disclosure, the first client may be an initiator of a call process or a receiver of the call process, which is not limited in this embodiment of the present disclosure. It can be understood that the instant messaging interfaces corresponding to the initiator and the receiver participating in the call process can both display the resource editing control.
Step 302, the first client displays the first editing interface in response to the third operation for the resource editing control.
In an embodiment of the present disclosure, the first editing interface includes a resource import control. The first editing interface is used for displaying editing operation controls related to the editing of the multimedia resources, such as a resource import control, a multimedia resource editing control, a multimedia resource saving control and the like. The third operation may be triggered by clicking a resource editing control, long-pressing the resource editing control, screen gestures, and other screen recognition modes, may also be triggered by receiving voice information, and may also be triggered by acquiring a preset gesture image through a camera of the first client.
Optionally, in this embodiment of the present disclosure, in a case that the preset interface is an instant messaging interface, in response to a third operation for the resource editing control, displaying the first editing interface; the instant messaging interface is used for indicating that the first client and the second client are in a conversation; and under the condition that the preset interface is a resource browsing interface, responding to a third operation aiming at the resource editing control, under the condition that the currently browsed multimedia resource displayed on the resource browsing interface belongs to the editable multimedia resource, determining that the currently browsed multimedia resource is the multimedia resource to be edited, and displaying the multimedia resource to be edited on the first editing interface.
It can be understood that, for a currently browsed multimedia resource displayed on the resource browsing interface of the first client, the first client may have a certain editing right for the currently browsed multimedia resource, and in a subsequent resource creation process for the currently browsed multimedia resource, first result information beyond the editing right cannot be stored or issued.
Therefore, in the conversation process of the first client and the second client, no matter the displayed instant messaging interface or the resource browsing interface, the first editing interface can be started to be displayed, the multimedia resource to be edited is led into the first editing interface or indicated to be displayed, the first editing interface is started through a plurality of paths, and the multimedia resource can be edited in the conversation process of the first client and the second client.
And step 303, the first client displays the multimedia resource list on the first editing interface in response to the fourth operation aiming at the resource import control.
In the embodiment of the present disclosure, the editable multimedia assets in the multimedia asset list include any one or a combination of any two of the following: the method comprises the steps of recording the multimedia resources, authorized multimedia resources, first real-time multimedia resources shot by a camera of a first client, second real-time multimedia resources shot by a camera of a second client, and splicing the multimedia resources, wherein the splicing multimedia resources comprise the first real-time multimedia resources and the second real-time multimedia resources. It will be appreciated that each of the editable multimedia assets in the list of multimedia assets may include a plurality of multimedia assets, for example, a plurality of recorded multimedia assets.
In the embodiment of the present disclosure, if the number of editable multimedia resources in the multimedia resource list is large and the editable multimedia resources cannot be displayed on the current page, a side scroll bar may be further provided, so that all the editable multimedia resources can be displayed.
In the embodiment of the present disclosure, the editable multimedia resource may be identified in the multimedia resource list by using a file name, an icon, a thumbnail, a cover picture, and the like.
In the embodiment of the present disclosure, any combination of multiple items may be performed on the recorded multimedia resource, the authorized multimedia resource, the first real-time multimedia resource shot by the camera of the first client, the second real-time multimedia resource shot by the camera of the second client, and the spliced multimedia resource of the first real-time multimedia resource and the second real-time multimedia resource. Wherein the recorded multimedia asset and the authorized multimedia asset have been stored at the first client, such that the first client responds to editing operations for the recorded multimedia asset and the authorized multimedia asset prior to displaying the list of multimedia assets, wherein the editing operations may comprise at least one of: editing, splicing, adding subtitles, adding special effect elements, modifying hues and the like to generate an editable multimedia resource based on any one or more items of the recorded multimedia resource and the authorized multimedia resource.
It can be understood that, since the first real-time multimedia resource shot by the camera of the first client and the second real-time multimedia resource shot by the camera of the second client are updated in real time during the call, the first real-time multimedia resource cannot be edited in advance. Based on this, the spliced multimedia asset of the first real-time multimedia asset and the second real-time multimedia asset cannot be edited in advance.
In the embodiment of the present disclosure, the fourth operation is similar to the third operation, and may be triggered by a screen recognition manner such as clicking a resource import control, long-pressing the resource import control, and a screen gesture, or may be triggered by receiving voice information, or may be triggered by a manner of acquiring a preset gesture image by a camera of the first client, where the fourth triggering manner is not limited in the embodiment of the present disclosure.
And step 304, the first client determines a multimedia resource to be edited in the editable multimedia resources in response to a fifth operation on the at least one editable multimedia resource, and displays the multimedia resource to be edited on the first editing interface.
In the embodiment of the present disclosure, after the first editing interface displays the multimedia resource to be edited, a fallback operation may be received, so as to re-input the fifth operation. The fifth operation may be one or more of the same operations, thereby selecting one or more editable multimedia assets as multimedia assets to be edited. It can be understood that, in the case of selecting a plurality of editable multimedia resources as the multimedia resources to be edited, each selected editable multimedia resource can be respectively used as the multimedia resources to be edited, and the selected plurality of editable multimedia resources can be combined according to a preset mode, and the combined multimedia resources can be used as the multimedia resources to be edited.
In this way, the resource editing control is displayed on the preset interface, the first editing interface is displayed in response to the third operation aiming at the resource editing control, the multimedia resource list is displayed on the first editing interface in response to the fourth operation aiming at the resource importing control, and the multimedia resource to be edited is displayed on the first editing interface in response to the fifth operation aiming at the at least one editable multimedia resource. All editable multimedia resources which can be used as multimedia resources to be edited can be displayed through the multimedia resource list, the possibility that the multimedia resources to be edited meet the requirements of users can be improved, and the efficiency of editing the multimedia resources to be edited is further improved.
Optionally, in this embodiment of the present disclosure, as shown in fig. 7, in order to obtain the spliced multimedia asset, the multimedia asset editing method provided in the present disclosure may further be implemented through the following steps 701 to 704.
Step 701, the first client stores the first real-time multimedia resource and the second real-time multimedia resource in the process of communicating with the second client.
In the embodiment of the present disclosure, the first real-time multimedia resource refers to a multimedia resource shot by a camera of a first client during a call between the first client and a second client. And under the condition that the call between the first client and the second client is a video call, the first real-time multimedia resource starts to be stored from the start of the video call, and the stored first real-time multimedia resource is updated in real time in the video call process. And under the condition that the call between the first client and the second client is a voice call, the first real-time multimedia resource starts to store the first real-time multimedia resource from the camera which is started in response to the input of the user and the video recording operation which is input by the user, and updates the stored first real-time multimedia resource in real time.
In the embodiment of the present disclosure, the second real-time multimedia resource is similar to the first real-time multimedia resource, and the second real-time multimedia resource is shot by a camera of the second client. The second client side starts a camera in the process of video call or voice call to acquire a second real-time multimedia resource, and sends the second real-time multimedia resource through a communication channel established in the process of call between the first client side and the second client side, and the first client side stores the second real-time multimedia resource after receiving the second real-time multimedia resource.
Step 702, a first client obtains a first image sequence of a first real-time multimedia resource and a second image sequence of a second real-time multimedia resource.
In the embodiment of the present disclosure, the first real-time multimedia resource is composed of a plurality of images at fixed time intervals, and the images in the first real-time multimedia resource are sequentially acquired according to the fixed time intervals, so as to obtain the first image sequence. Similarly, the second real-time multimedia resource is also composed of a plurality of images at fixed time intervals, and the images in the second real-time multimedia resource are sequentially acquired according to the fixed time intervals, so that a second image sequence can be obtained. The fixed time intervals adopted in the first real-time multimedia resource and the second real-time multimedia resource may be the same or different, such as 0.04 second.
And 703, merging the images in the first image sequence and the second image sequence by the first client according to a preset merging mode to generate a third image sequence.
In this embodiment of the present disclosure, it is assumed that the first real-time multimedia resource and the second real-time multimedia resource are obtained during a video call between the first client and the second client, the playing durations of the first real-time multimedia resource and the second real-time multimedia resource are the same, the images in the first image sequence and the second image sequence are in one-to-one correspondence, and when the images in the first image sequence and the second image sequence are combined, the two one-to-one correspondence images may be combined in a picture-in-picture manner to generate a third image sequence.
In the embodiment of the present disclosure, it is assumed that the first real-time multimedia resource and the second real-time multimedia resource are photographed in response to respective user operations during a voice call between the first client and the second client, and then the playing durations of the first real-time multimedia resource and the second real-time multimedia resource may be the same or different, and the association between the first real-time multimedia resource and the second real-time multimedia resource is weak, so that images in the first image sequence and the second image sequence may be cross-cut and combined. Firstly, taking two images with obvious areas in a first image sequence as segmentation positions, and segmenting the first image sequence; then taking two images with obvious areas in the second image sequence as segmentation positions, and segmenting the second image sequence; and finally, performing cross combination on the segmented images according to the image content to generate a third image sequence. Wherein generating the third image sequence may take the form of a picture-in-picture.
Illustratively, the first image sequence includes sky, buildings and plants, and if the first image does not include sky and the second image includes sky, the position between the first image and the second image may be taken as a section position.
And 704, the first client generates the spliced multimedia resource according to the third image sequence and the preset frame rate.
In the embodiment of the present disclosure, the third image sequence is a sequence of a plurality of images arranged in a specific order. The preset frame rate is the number of images switched per second and may be 24 frames, 25 frames or 30 frames.
Therefore, the first real-time multimedia resource and the second real-time multimedia resource are split into the image sequences, the image sequences are combined, and the spliced multimedia resource is generated finally, so that the first real-time multimedia resource and the second real-time multimedia resource can be finely adjusted, and the consistency degree of the spliced multimedia resource, the first real-time multimedia resource and the second real-time multimedia resource expressing emotion or transmitting messages is improved.
Further optionally, in this embodiment of the present disclosure, in order to obtain the spliced multimedia resource, the multimedia resource editing method provided by the present disclosure may further cut and combine the first real-time multimedia resource and the second real-time multimedia resource according to a fixed time period, that is, sequentially cut at least one first sub-multimedia resource of the fixed time period from the first real-time multimedia resource, then sequentially cut at least one second sub-multimedia resource of the fixed time period from the second real-time multimedia resource, and then cross-combine the first sub-multimedia resource and the second sub-multimedia resource according to the cutting sequence, so as to generate the spliced multimedia resource.
Optionally, in this embodiment of the present disclosure, as shown in fig. 8, the multimedia asset editing method may further be implemented through the following steps 801 to 803.
Step 801, the first client generates a sharing request under the condition that a preset condition is met.
Step 802, the first client sends the sharing request to the second client through a communication channel established in the communication process with the second client.
And step 803, the first client synchronizes the multimedia resource to be edited to the second client under the condition that the first client receives the response message sent by the second client.
In the embodiment of the disclosure, the sharing request is used for requesting the second client to jointly edit the multimedia resource. The preset condition includes any one of: and receiving a third operation aiming at the resource editing control, and displaying the multimedia resource to be edited on the first editing interface. That is, the sharing request is generated while the initial editing interface is displayed or after the multimedia asset to be edited is displayed on the first editing interface.
Therefore, through the sharing request and the response message, on one hand, whether the communication channel is unblocked can be confirmed, and on the other hand, the second client can be prompted to start to jointly edit the multimedia resource to be edited, so that the first client is prevented from explaining the edition again, and the efficiency of editing the multimedia resource to be edited can be improved.
In the embodiment of the present disclosure, the multimedia resource to be edited is synchronized to the second client, specifically, the multimedia resource to be edited is sent to the second client through the communication channel.
Step 202, in the process of a call between the second client and the first client, the second client displays the multimedia resource to be edited on the second editing interface under the condition of receiving the multimedia resource to be edited, which is displayed on the first editing interface and sent by the first client.
In the embodiment of the present disclosure, the second editing interface is used for performing editing processing on the multimedia resource to be edited. It can be understood that, in the case that the second client receives the multimedia asset to be edited, the received multimedia asset to be edited is displayed on the second multimedia asset boundary surface.
Optionally, in this embodiment of the present disclosure, as shown in fig. 9, the multimedia asset editing method may further be implemented by the following steps 901 and 902.
Step 901, the second client generates a response message in response to a request reply operation for the sharing request when receiving the sharing request sent by the first client.
And step 902, the second client sends the response message to the first client through a communication channel established in the conversation process with the first client.
In the embodiment of the disclosure, the sharing request is used for requesting the second client to jointly edit the multimedia resource. In the case where the second client receives the sharing request, it can be confirmed that the communication channel between the first client and the second client is clear. The second client replies to the operation in response to the request for the sharing request, i.e. instructs the second client to approve the co-editing of the multimedia asset with the first client, i.e. to perform the co-authoring of the multimedia asset.
In the embodiment of the present disclosure, since the communication channel is a long connection communication link that is established during the communication between the first client and the second client and through which the user transmits the message, the response message is sent to the first client through the communication channel, which can save communication resources.
Therefore, through the sharing request and the response message, on one hand, whether the communication channel is unblocked can be confirmed, and on the other hand, the first client can be prompted to start to jointly edit the multimedia resource to be edited, so that the second client is prevented from explaining the joint editing, and the efficiency of editing the multimedia resource to be edited can be improved.
In a first example, as shown in fig. 10 (a), the first client displays an instant messaging interface, which includes a resource editing control. In a case where the preset interface is an instant messaging interface, in response to a click operation for the resource editing control, as shown in (b) in fig. 10, a first editing interface is displayed, where the first editing interface includes a resource import control. In response to the click operation for the resource import control, as shown in fig. 10 (c), a multimedia resource list is displayed on the first editing interface. In response to a click operation for at least one editable multimedia asset in the multimedia asset list, as shown in (d) of fig. 10, the multimedia asset to be edited is displayed on the first editing interface. The first client synchronizes the video to be edited to the second client, so that the second client jumps from the instant messaging interface shown in (e) in fig. 10 to the second editing interface shown in (f) in fig. 10, and the second editing interface also displays the video to be edited.
In a second example, as shown in fig. 11 (a), the first client displays a resource browsing interface, where a resource editing control is included. In the case that the preset interface is the resource browsing interface, in response to the click operation for the resource editing control, assuming that the currently browsed multimedia resource displayed on the resource browsing interface belongs to an editable multimedia resource, determining that the currently browsed multimedia resource is a multimedia resource to be edited, as shown in (b) in fig. 11, displaying the multimedia resource to be edited on the first editing interface. The first client synchronizes the video to be edited to the second client, so that the second client jumps from the instant messaging interface shown in (c) of fig. 11 to the second client at the second editing interface shown in (d) of fig. 11, and the second editing interface also displays the video to be edited.
Optionally, in this embodiment of the disclosure, as shown in (d) in fig. 10 or (b) in fig. 11, in a case that the first editing interface of the first client displays the multimedia resource to be edited, in order to increase a display space of the first editing interface, the instant call interface may be reduced to an upper left corner at the first client for display, and meanwhile, the instant call interface may be dragged to any position in the screen by a long press. In the case that the second editing interface of the second client displays the multimedia resource to be edited, as shown in (f) of fig. 10 or (d) of fig. 11, in order to increase the display space of the second editing interface, the instant call interface may be reduced to the upper left corner at the second client for display, and may be dragged to any position in the screen by long pressing.
Optionally, in this embodiment of the present disclosure, the instant call interface may be hidden by the first client when the first editing interface is displayed. Similarly, the second client may hide the instant call interface when displaying the second editing interface.
Step 203, the first client responds to the first operation aiming at the multimedia resource to be edited, and displays first result information corresponding to the first operation on the first editing interface based on the multimedia resource to be edited.
In the embodiment of the present disclosure, the first result information includes first effect edit information and first material extension information.
In the embodiment of the present disclosure, the first operation is used to edit the multimedia resource to be edited displayed on the first editing interface. Illustratively, the first operation may add editing elements (including special effects elements), clipping, image beautification, or adding multimedia resources to any of the following. The first result information corresponding to the first operation means that the multimedia resource to be edited responds to the first operation to present a corresponding editing effect, and the corresponding editing effect includes an image effect, an image sequence and an image quantity of the multimedia resource to be edited, which are changed according to the first operation, and other multimedia resources except the multimedia resource to be edited, which can be displayed, are added to the first editing interface. If the first operation is to add an occlusion flag to an image of the multimedia asset to be edited, the whole image with the occlusion flag added is taken as the first result information.
In this disclosure, the first operation refers to all editing operations, which are input by the first client side to the multimedia resource to be edited and displayed on the first editing interface, received by the first client side.
Optionally, in this embodiment of the present disclosure, in order to increase editing diversity, the first editing interface includes an effect editing control and a material expansion control, and step 203 specifically includes: under the condition that the first operation is an effect editing operation, responding to the first operation aiming at the effect editing control, and displaying first result information on a first editing interface based on a multimedia resource to be edited, wherein the first result information comprises special effect element adding information, video clipping information and image beautifying information; under the condition that the first operation is a material expansion editing operation, responding to the first operation aiming at the material expansion control by the first client, and displaying a multimedia resource list on a first editing interface; responding to a second multimedia resource selection operation aiming at least one editable multimedia resource, and determining a multimedia resource to be expanded in the editable multimedia resource; and splicing the multimedia resource to be expanded to the multimedia resource to be edited, and displaying the multimedia resource to be edited on the first editing interface.
In the embodiment of the present disclosure, after the first editing interface displays the multimedia asset to be edited, with or without editing started, it may be found that the asset materials included in the multimedia asset to be edited are insufficient to achieve the intended editing effect. In this case, an extension trigger operation input for the material extension control included on the first editing interface may be performed, so that the first client displays the multimedia resource list again on the first editing interface in response to the extension trigger operation for the material extension control, and determines a multimedia resource to be extended in response to a second multimedia resource selecting operation for an editable multimedia resource in the multimedia resource list.
It should be noted that the editable multimedia resources in the multimedia resource list displayed again are the same as the editable multimedia resources in the multimedia resource list displayed for the first time, wherein the selected editable multimedia resources may be marked by grey shading, and in addition, the first real-time multimedia resource, the second real-time multimedia resource, and the spliced multimedia resource may change according to the corresponding shooting time.
In the embodiment of the present disclosure, the multimedia resource displayed on the first editing interface is referred to as a multimedia resource to be edited, and after the multimedia resource to be edited is determined for the first time, the multimedia resource to be edited is continuously changed along with selection of the multimedia resource to be expanded and response to the editing operation of the first client and the second client.
Therefore, after the multimedia resource to be edited is displayed on the first editing interface, under the condition that editing is started or not started, once the resource materials in the multimedia resource to be edited are found to be insufficient to achieve the expected editing effect, the extended multimedia resource can be added under the condition that the edited part is reserved, the step of selecting the multimedia resource to be edited for the first time is not needed to be returned to increase the extended multimedia resource, and the editing efficiency of the multimedia resource can be improved.
Optionally, in the embodiment of the present disclosure, in order to better implement the coauthoring of the multimedia resource, during the communication between the first client and the second client, the multimedia resource to be edited is edited while discussing the idea, the effect to be presented, the editing mode, and the like that the multimedia resource to be edited is desired to be expressed. Based on this, as shown in fig. 12, after the above step 201, the multimedia asset editing method provided by the present disclosure can also be implemented by the following steps 1201 and 1202.
Step 1201, the first client displays the first special effect element on the first editing interface.
In an embodiment of the disclosure, the first special effect element includes: searching an editing element corresponding to a first target semantic in a preset special effect database, wherein the first target semantic is used for expressing: and in the conversation process, the voice semantic recognition is carried out on the voice information received by the microphone of the first client.
Note that the edit element refers to an image that cannot be captured or is difficult to capture in an image or video captured by a camera. Often used to enrich the picture in an image or video, with exaggerated display so that the image and video can convey accurate messages.
In the embodiment of the disclosure, in the process of a call between a first client and a second client, a microphone of the first client receives voice information sent by using a user account of the first client, and then the first client sends the voice information to the second client, and the first client further performs voice semantic recognition on the voice information to obtain a first target semantic. According to the first target semantic, searching a first special effect element corresponding to the first target semantic in a preset special effect database, if the first client stores the first special effect element, displaying the first special effect element on a first editing interface, and if the first client does not store the first special effect element, loading the first special effect element, and then displaying the first special effect element on the first editing interface.
For example, assuming that the voice information is "what is love is added between two people", the first target semantic is "love", and the corresponding first special effect element is a "heart-shaped" special effect, on the basis of (d) in fig. 10, as shown in (a) in fig. 13, a plurality of heart-shaped "special effects are displayed on the first editing interface of the first client, and as shown in (b) in fig. 13, the first special effect element is not displayed on the second editing interface of the second client. It should be noted that the heart-shaped "special effect may be a static special effect or a dynamic special effect.
In the embodiment of the present disclosure, the first special effect element displayed on the first editing interface may be set as an applicable special effect element that is temporarily displayed, for example, in a display time of 5 seconds, in a manner of highlighting, and in a display position that is a highlight display position of the first editing interface (for example, an operation area of the first operation, a center position of the first editing interface).
In the embodiment of the present disclosure, the first special effect element displayed on the first editing interface may further be configured to be added to an applicable special effect element list, so that the first special effect element may be used at any time of this editing or re-editing.
Step 1202, the first client displays, in response to a first operation on the multimedia resource to be edited, first effect editing information corresponding to the first operation on the basis of the multimedia resource to be edited on the first editing interface, in the case that the first operation is a special effect application operation of a first special effect element.
In this embodiment of the present disclosure, the first effect editing information is: and adding effect information of the first special effect element based on the multimedia resource to be edited.
In the embodiment of the present disclosure, applying a special effect operation means adding a first special effect element to a multimedia resource to be edited. In the case where the multimedia asset to be edited is a video, as shown in (a) in fig. 14, on the basis of (d) in fig. 10, a first special effect element is added to a certain image of the video to be edited, which is displayed on the first editing interface, to generate first effect editing information, and the first effect editing information is displayed on the first editing interface of the first client based on the video to be edited. As shown in (b) in fig. 14, the first effect edit information is displayed based on the video to be edited at the second edit interface of the second client.
Of course, in order to perfect the editing of the multimedia resource to be edited, the first special effect element may also be added to the consecutive plurality of images.
Therefore, in the process that the first client side is in the second client side communication process, the first special effect element can be searched and displayed through voice recognition and semantic analysis by utilizing ideas, presented effects, editing modes and the like which are required to be expressed by the first client side and the second client side, the time for searching the required editing element can be reduced through the mode of highlighting the first special effect element, and the efficiency of co-creation of multimedia resources can be improved.
Further optionally, in an embodiment of the present disclosure, after the step 201, the method for editing a multimedia resource provided by the present disclosure further includes: under the condition that the number of the first special effect elements is equal to 1, displaying first effect editing information corresponding to a first operation on the basis of the multimedia resource to be edited on a first editing interface, wherein the first effect editing information comprises: and adding effect information of the first special effect element based on the multimedia resource to be edited.
Therefore, in the process that the first client side is in the second client side communication process, the first special effect elements can be searched and displayed through voice recognition and semantic analysis by utilizing ideas, presented effects, editing modes and the like which are required to be expressed by the first client side and the second client side, and when the number of the first special effect elements is equal to 1, the first operation (the first operation is the special effect application operation of the first special effect elements) is responded in a default mode, so that the time for searching the required editing elements can be shortened, and further the efficiency of the co-creation of multimedia resources can be improved.
Further optionally, in an embodiment of the present disclosure, the method for editing a multimedia resource provided in the embodiment of the present disclosure further includes: under the condition that the first special effect element is displayed on the first editing interface, sending a first special effect identifier corresponding to the first special effect element to the second client so as to display the first special effect element on a second editing interface of the second client; or after the first special effect element is displayed on the first editing interface, the first special effect identifier corresponding to the first special effect element is sent to the second client, so that the first special effect element can be displayed on a second editing interface of the second client. Because the multimedia resources can be edited by both the first client and the second client, the first special effect identifier is sent to the second client, and the second client can obtain the first special effect element corresponding to the first special effect identifier from the cache of the second client or from the server corresponding to the second client, and display the first special effect identifier on the second editing interface. If the first special effect identification is a code such as a serial number and a character string, the data volume of the first special effect identification is small, and the transmission speed can be improved by transmitting the first special effect identification.
In an example, after a first client performs voice semantic recognition according to voice information received by a microphone for the first client, and then searches a preset special effect database for a first special effect element corresponding to a first target semantic, the first client receives indication information (used for indicating that the first special effect element is displayed on a first editing interface), and simultaneously sends a first special effect identifier corresponding to the first special effect element to a second client. Under the condition that the first special effect element is loaded in the first client storage, due to the existence of time delay of network transmission, after the first client displays the first special effect element on the first editing interface, the second client displays the first special effect element on the second editing interface. In a case where the first client stores the unloaded first special effect element, because the network environments of the first client and the second client in the actual application environment are different, although the first client preferentially receives the indication information for displaying the first special effect element on the first editing interface and the second client receives the indication information for displaying the first special effect element on the first editing interface after delay, in practice, the second client may display the first special effect element before the first client.
In another example, the first client receives indication information (indicating that the first special effect element is displayed on the first editing interface), and after the first special effect element is displayed on the first editing interface, the first client sends the first special effect identifier corresponding to the first special effect element to the second client.
Therefore, the first special effect elements are displayed on the first client and the second client, and the voice information and the image information (the first special effect elements) in the conversation process can be received by the first client and the second client, so that the joint creation of the multimedia resources is facilitated.
Further optionally, in this embodiment of the present disclosure, the first client sends the first special effect element to the second client, and then can also receive the second special effect element sent by the second client. Specifically, the multimedia resource editing method provided by the embodiment of the present disclosure further includes: in the process of communication with a second client, after a multimedia resource to be edited is displayed on a first editing interface, under the condition of receiving a second special effect identifier sent by the second client, displaying a second special effect element corresponding to the second special effect identifier on the first editing interface, wherein the second special effect element comprises: searching an editing element corresponding to a second target semantic in a preset special effect database, wherein the second target semantic is used for expressing: and in the conversation process, the voice semantic recognition is carried out on the voice information received by the microphone of the second client.
It is understood that the second special effect element is similar to the first special effect element, and the description of the second special effect element is omitted. The first client can respond to a first operation (including a special effect application operation aiming at a first special effect element and a second special effect element) and display first editing effect information of the multimedia resource to be edited on a first editing interface.
Therefore, the second special effect elements are displayed on the first client and the second client, and the voice information and the image information (the second special effect elements) in the conversation process can be received by the first client and the second client, so that the co-creation of the multimedia resources is facilitated.
And step 204, the first client sends the first result information to the second client, so that the first result information can be conveniently displayed on a second editing interface of the second client.
In the embodiment of the present disclosure, the first result information is sent to the second client through a communication channel between the first client and the second client.
In the embodiment of the present disclosure, the first result information may be difference information of the multimedia resource to be edited before and after responding to the first operation, or may be the multimedia resource to be edited after responding to the first operation. In the embodiment of the present application, any one of the above manners may be selected to obtain the first result information.
It is to be understood that, the first client may further select, as the final first result information, a mode with a smaller information data amount according to the information data amount of the first result information obtained in the above two modes.
In step 205, the second client displays the first result information based on the multimedia resource to be edited on the second editing interface when receiving the first result information sent by the first client.
In the embodiment of the present disclosure, the first result information is: and the first client responds to the result information obtained by the first operation. The first result information includes first effect edit information and first material extension information.
In the embodiment of the present disclosure, if the first result information is difference information of the multimedia resource to be edited before and after responding to the first operation, the second client receives the first result information, extracts the difference information in the first result information, then updates the multimedia resource to be edited displayed on the second editing interface according to the difference information, and finally displays the first result information on the second editing interface based on the multimedia resource to be edited.
In this embodiment of the present disclosure, if the first result information is the multimedia resource to be edited after responding to the first operation, the second client may directly display the first result information on the second editing interface.
And step 206, the second client responds to the second operation aiming at the multimedia resource to be edited, and second result information corresponding to the second operation is displayed on the second editing interface based on the multimedia resource to be edited.
In the embodiment of the present disclosure, the second result information is: and the second client responds to the result information obtained by the second operation. The second result information includes second effect edit information and second material extension information.
In the embodiment of the present disclosure, the second operation is used to edit the multimedia resource to be edited displayed on the second editing interface. Illustratively, the second operation may add editing elements (including special effects elements), clipping, image beautification, or adding multimedia resources to any of the following. The second result information corresponding to the second operation means that the multimedia resource to be edited responds to the second operation to present a corresponding editing effect, including an image effect, an image sequence and an image quantity of the multimedia resource to be edited, which are changed according to the second operation, and other multimedia resources except the multimedia resource to be edited, which can be displayed, are added on the second editing interface. If the second operation is to add an occlusion flag to a certain image of the multimedia asset to be edited, the whole image with the occlusion flag added is taken as the second result information. If the second operation is to add a stealth effect on a certain second image of the multimedia resource to be edited, the whole of the image added with the stealth effect is taken as second result information.
In this embodiment of the present disclosure, the second operation refers to all editing operations, which are input by the second client side in the user account and are directed to the multimedia resource to be edited displayed on the second editing interface.
Optionally, in this embodiment of the present disclosure, in order to increase editing diversity, the second editing interface includes an effect editing control and a material adding control, where step 206 specifically includes: under the condition that the second operation is an effect editing operation, responding to the second operation aiming at the effect editing control, and displaying second result information on a second editing interface based on the multimedia resource to be edited, wherein the second result information comprises special effect element adding information, video clipping information and image beautifying information; under the condition that the second operation is a material expansion editing operation, responding to the second operation aiming at the material expansion operation control, displaying a multimedia resource list on a second editing interface, and displaying a plurality of editable multimedia resources in the multimedia resource list; responding to a second multimedia resource selection operation aiming at least one editable multimedia resource, and determining a multimedia resource to be expanded in the editable multimedia resource; and splicing the multimedia resource to be expanded to the multimedia resource to be edited, and displaying the multimedia resource to be edited on the second editing interface.
In the embodiment of the present disclosure, after the second editing interface displays the multimedia asset to be edited, in the case where editing is started or not started, it may be found that the asset materials included in the multimedia asset to be edited are insufficient to achieve the intended editing effect. In this case, an extension trigger operation input for a material extension control included on the second editing interface may be performed, so that the second client displays the multimedia asset list again on the second editing interface in response to the extension trigger operation for the material extension control, and determines a multimedia asset to be extended in response to a second multimedia asset selection operation for an editable multimedia asset in the multimedia asset list.
In the embodiment of the present disclosure, the editable multimedia assets in the multimedia asset list include any one or a combination of any two of the following: recorded multimedia assets and authorized multimedia assets. For the first client to save the first real-time multimedia resource and the second real-time multimedia resource and generate the spliced multimedia resource, the second client may also save and generate, but in order to reduce the communication resource overhead of the communication channel and reduce the storage burden of the second client, the second client does not repeatedly save the first real-time multimedia resource and the second real-time multimedia resource and does not repeatedly generate the spliced multimedia resource.
It should be noted that the editable multimedia resources in the multimedia resource list displayed again are the same as the editable multimedia resources in the multimedia resource list displayed for the first time, wherein the selected editable multimedia resources may be marked by grey shading, and in addition, the first real-time multimedia resource, the second real-time multimedia resource, and the spliced multimedia resource may change according to the corresponding shooting time.
In the embodiment of the present disclosure, the multimedia resource displayed on the second editing interface is referred to as a multimedia resource to be edited, and after the multimedia resource to be edited is determined for the first time, the multimedia resource to be edited is continuously changed along with selection of the multimedia resource to be extended and response to the editing operation of the first client and the second client.
Therefore, after the multimedia resource to be edited is displayed on the second editing interface, under the condition of starting editing or not starting editing, once the resource materials in the multimedia resource to be edited are found to be insufficient to realize the expected editing effect, the extended multimedia resource can be added under the condition of reserving the edited part, the step of selecting the multimedia resource to be edited for the first time is not required to be returned to, the extended multimedia resource is added, and the editing efficiency of the multimedia resource can be improved.
Optionally, in this embodiment of the present disclosure, when receiving the first special effect identifier sent by the first client, the second client displays, on the second editing interface, a first special effect element corresponding to the first special effect identifier, where the first special effect element includes: searching an editing element corresponding to a first target semantic in a preset special effect database, wherein the first target semantic is used for expressing: and in the conversation process, performing voice semantic recognition on the voice information received by the microphone of the first client.
Therefore, the second special effect elements are displayed on the first client and the second client, and the voice information and the image information (the second special effect elements) in the conversation process can be received by the first client and the second client, so that the joint creation of the multimedia resources is facilitated.
Optionally, in the embodiment of the present disclosure, in order to better implement coauthoring on a multimedia resource, during a call between a first client and a second client, a thought, a presentation effect, an editing mode, and the like that a multimedia resource to be edited is desired to be discussed. Based on this, after the step 202, the multimedia asset editing method provided by the present disclosure further includes: the second client displays a second special effect element on a second editing interface, wherein the second special effect element comprises: searching an editing element corresponding to a second target semantic in a preset special effect database, wherein the second target semantic is used for expressing: in the conversation process, voice semantic recognition is carried out on the voice information received by the microphone of the second client; under the condition that the second operation is the special effect application operation of the second special effect element, the second client responds to the second operation aiming at the multimedia resource to be edited, and second result information corresponding to the second operation is displayed on the second editing interface based on the multimedia resource to be edited, wherein the second result information comprises: and displaying the multimedia resource added with the second special effect element on the basis of the multimedia resource to be edited in the second editing interface.
It is understood that the second special effect element on the second client is similar to the first special effect element of the first client, and is not described herein again. The first special effect element and the second special effect element can be applied to the multimedia resource to be edited displayed on the second editing interface in response to the second operation at the second client.
Therefore, in the process that the second client side is in the first client side communication process, the second special effect element can be searched and displayed through voice recognition and semantic analysis by utilizing ideas, presented effects, editing modes and the like which are required to be expressed by the first client side and the second client side, the time for searching the required editing element can be reduced through the mode of highlighting the second special effect element, and the efficiency of co-creation of multimedia resources can be improved.
Further optionally, in an embodiment of the present disclosure, after step 202, the method for editing a multimedia asset provided by the present disclosure further includes: under the condition that the number of the second special effect elements is equal to 1, displaying first result information corresponding to the first operation on the basis of the multimedia resource to be edited in the first editing interface, wherein the second result information comprises: and displaying the multimedia resource added with the second special effect element on the basis of the multimedia resource to be edited in the second editing interface.
In this way, in the process that the first client is in the conversation with the second client, the second special effect element can be searched and displayed through voice recognition and semantic analysis by utilizing ideas, presented effects, editing modes and the like which are required to be expressed by the first client and the second client, and when the number of the second special effect elements is equal to 1, the second operation (the second operation is the special effect application operation of the second special effect element) is responded by default, so that the time for searching the required editing elements can be shortened, and the efficiency of the co-creation of multimedia resources can be improved.
Further optionally, in an embodiment of the present disclosure, the method for editing a multimedia resource provided in the embodiment of the present disclosure further includes: under the condition that a second special effect element is displayed on a second editing interface, sending a second special effect identifier corresponding to the second special effect element to the first client so as to display the second special effect element on the first editing interface of the first client conveniently; or after the second special effect element is displayed on the second editing interface, sending the second special effect identifier corresponding to the second special effect element to the first client, so that the second special effect element is displayed on the first editing interface of the first client.
It should be noted that, while the second special effect element is displayed on the second editing interface, or after the second special effect element is displayed on the second editing interface, the second special effect identifier corresponding to the second special effect element is sent to the first client. Since the multimedia resource can be edited by both the first client and the second client, the second special effect identifier is sent to the first client, and the first client can display the second special effect element according to the second special effect identifier. If the second special effect identification is a code such as a serial number and a character string, the data volume of the second special effect identification is small, and the transmission speed can be improved by transmitting the second special effect identification.
It should be further noted that, because the network environments of the first client and the second client in the actual application environment are different, although the second special effect identifier corresponding to the second special effect element is sent to the first client only when the second editing interface displays the second special effect element, actually, the first client may display the second special effect element before the second client.
Therefore, the second special effect elements are displayed on the first client and the second client, and the voice information and the image information (the second special effect elements) in the conversation process can be received by the first client and the second client, so that the joint creation of the multimedia resources is facilitated.
Further optionally, in an embodiment of the present disclosure, the method for editing a multimedia resource provided by the embodiment of the present disclosure further includes: under the condition that a second special effect element is displayed on a second editing interface, sending a second special effect identifier corresponding to the second special effect element to the first client so as to display the second special effect element on the first editing interface of the first client conveniently; or after the second special effect element is displayed on the second editing interface, sending the second special effect identifier corresponding to the second special effect element to the first client, so that the second special effect element is displayed on the first editing interface of the first client. Because the multimedia resource can be edited at both the first client and the second client, the second special effect identifier is sent to the first client, and the first client can obtain the second special effect element corresponding to the second special effect identifier from the first client cache or the server corresponding to the first client, and display the second special effect identifier on the first editing interface. If the second special effect identification is a code such as a serial number and a character string, the data volume of the second special effect identification is small, and the transmission speed can be improved by transmitting the second special effect identification.
In an example, after a second client performs voice semantic recognition according to voice information received by a microphone for the second client, and then searches a preset special effect database for a first special effect element corresponding to a first target semantic, the second client receives obtained indication information (used for indicating that a second special effect element is displayed on a first editing interface), and simultaneously sends a second special effect identifier corresponding to the second special effect element to the first client. Under the condition that the second client stores the loaded first special effect element, due to the existence of time delay of network transmission, after the second client displays the first special effect element on the first editing interface, the first client displays the first special effect element on the second editing interface. In a case where the second client stores the unloaded second special effect element, because network environments of the first client and the second client in the actual application environment are different, although the second client preferentially receives the indication information for displaying the second special effect element on the second editing interface, the first client delays receiving the indication information for displaying the second special effect element on the second editing interface, but actually, the first client may display the second special effect element before the second client.
In another example, the second client receives the obtained indication information (for indicating that the second special effect element is displayed on the first editing interface), and after the second special effect element is displayed on the second editing interface, the second client sends the second special effect identifier corresponding to the second special effect element to the first client.
And step 207, the second client sends the second result information to the first client, so that the second result information is conveniently displayed on the first editing interface of the first client.
In the embodiment of the disclosure, the second result information is sent to the first client through a communication channel between the first client and the second client.
In this embodiment of the present disclosure, the second result information may be difference information of the multimedia resource to be edited before and after responding to the second operation, or may be the edited multimedia resource to be edited after responding to the second operation. In the embodiment of the present application, any one of the above manners may be selected to obtain the second result information.
It can be understood that the second client may further select, as the final second result information, a mode with a smaller information data amount according to the information data amount size of the second result information obtained in the above two modes.
And step 208, the first client displays the second result information based on the multimedia resource to be edited on the first editing interface under the condition that the first client receives the second result information sent by the second client.
In the embodiment of the present disclosure, the above processes are the editing processes of the multimedia resource to be edited by the first client and the second client, which are instantly transmitted to the client of the other party, so that the client of the other party can instantly check the editing effect, so as to confirm, modify or discuss again according to the editing effect, and a scene of face-to-face communication editing can be simulated in a remote environment, so that the first client and the second client can reach an agreement as soon as possible for the transmission message or expression emotion of the multimedia resource to be edited, thereby improving the resource creation time of the multimedia resource to be edited.
The technical scheme provided by the disclosure at least brings the following beneficial effects: by the technical scheme, the first client and the second client can realize the common editing of the multimedia resource to be edited in the conversation process, application scenes in the conversation process can be enriched, and the transmission message or expression emotion of the multimedia resource to be edited is consistent by means of the conversation process and the mutual transmission of the editing effect information of the multimedia resource, so that the transferability of the multimedia resource to be edited can be improved. In addition, the first client and the second client can be in communication to realize the common editing of the multimedia resources to be edited, the resource creation time required for resource creation of the multimedia resources can be reduced, the geographic positions of the first client and the second client are not limited, the practicality of the common editing is improved, meanwhile, the interestingness can be increased through the common editing, furthermore, the participation of users can be increased, and the quantity and the quality of the multimedia resources obtained through the common editing are improved.
Optionally, in this embodiment of the present disclosure, after the multimedia asset to be edited is displayed on the first editing interface in step 201, the method for editing a multimedia asset provided in this embodiment of the present disclosure further includes: the first client side responds to a sixth operation aiming at the multimedia resource to be edited, and determines a work release attribute of the multimedia resource to be edited, wherein the work release attribute comprises at least one of the following items: signing and recommending friend evaluations; and the first client responds to the seventh operation aiming at the multimedia resource to be edited and publishes the multimedia resource to be edited displayed on the first editing interface according to the release attribute of the work.
In this disclosure, after all the first operations are completed and before the first client issues the work, the first editing interface is the displayed multimedia resource to be edited and serves as the combined creative work, the user account corresponding to the first client is issued as the author, and the user account corresponding to the first client has the right of the combined creative work. Of course, if the multimedia resource to be edited initially displayed on the second editing interface by the second client is also authorized to the second client, the user account corresponding to the second client is also an author of the combined creative work, and the user account corresponding to the second client owns a right of the combined creative work.
In the embodiment of the disclosure, in the case that the first client issues the combined creative work, the first client may be signed, and whether to recommend the friend evaluation may also be set. The recommended friend rating may be a friend-before-visit rating of all the signers recommending the combined creative work, and may also be a friend-before-visit rating of a specific friend of all the signers recommending the combined creative work.
In this way, the multimedia resource to be edited displayed on the first editing interface is released according to the release attribute of the work, and the participation of the user is further improved and the propagatability of the released work is further improved in a manner of signing and recommending friend evaluations.
Further optionally, in this embodiment of the present disclosure, after the foregoing step responds to the seventh operation on the multimedia resource to be edited and issues the multimedia resource to be edited displayed on the first editing interface according to the work issue attribute, the method for editing a multimedia resource provided in this embodiment of the present disclosure further includes: and the first client side responds to the eighth operations aiming at the multimedia resource to be edited and sends authorization prompt information to the target user account so that the target user account can continuously edit the multimedia resource to be edited displayed on the first editing interface.
Therefore, the authorization prompt information is sent to the target user account to prompt the target user account to edit the multimedia resource to be edited displayed on the first editing interface, so that under the condition that the target user account edits the published works, the propagatability of the published works can be further improved, the participation of users can be further improved, and the quantity and the quality of the multimedia resource obtained through common editing can be improved.
Similarly, optionally, in this embodiment of the present disclosure, after the multimedia asset to be edited is displayed on the first editing interface in step 201, the method for editing a multimedia asset provided in this embodiment of the present disclosure further includes: the second client side responds to the operation aiming at the multimedia resource to be edited, and determines the work release attribute of the multimedia resource to be edited, wherein the work release attribute comprises at least one of the following items: signing and recommending friend evaluations; and the second client responds to the operation aiming at the multimedia resource to be edited and publishes the multimedia resource to be edited displayed by the second editing interface according to the release attribute of the work.
In this way, the multimedia resource to be edited displayed on the second editing interface is released according to the release attribute of the work, and the participation of the user is further improved in a manner of signing and recommending friend evaluation, so that the propagatability of the released work is further improved.
Further optionally, in this embodiment of the present disclosure, after the foregoing step responds to the operation on the multimedia resource to be edited and issues the multimedia resource to be edited displayed on the second editing interface according to the release attribute of the work, the method for editing a multimedia resource provided in this embodiment of the present disclosure further includes: and responding to the operation aiming at the multimedia resource to be edited, and sending authorization prompt information to the target user account so that the target user account can edit the multimedia resource to be edited displayed on the second editing interface.
Therefore, the authorization prompt information is sent to the target user account to prompt the target user account to edit the multimedia resource to be edited displayed on the second editing interface, so that under the condition that the target user account edits the published works, the propagability of the published works can be further improved, the participation of users can be further improved, and the quantity and the quality of the multimedia resources obtained through common editing are improved.
The foregoing has described aspects of embodiments of the present disclosure primarily from a methodological perspective. It is to be understood that the multimedia asset editing apparatus comprises at least one of a hardware structure and a software module corresponding to each function in order to implement the above-described functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed in hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
The embodiment of the present disclosure may perform the division of the functional units for the multimedia asset editing apparatus according to the method example described above, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the units in the embodiments of the present disclosure is schematic, and is only one logical function division, and there may be another division manner in actual implementation.
Fig. 15 is a schematic diagram illustrating a structure of a multimedia asset editing apparatus according to an exemplary embodiment. Referring to fig. 15, a multimedia asset editing apparatus provided in an embodiment of the present disclosure is applied to a first client, and includes: a first processing unit 1501, a first display unit 1502, and a first transmission unit 1503;
the first processing unit 1501 is configured to display, in a call process with a second client, a multimedia resource to be edited on a first editing interface, and synchronize the multimedia resource to be edited to the second client, where the first editing interface is configured to perform editing processing on the multimedia resource to be edited;
a first display unit 1502 configured to, in response to a first operation on a first editing interface, display first result information corresponding to the first operation on the first editing interface based on a multimedia asset to be edited, the first result information including first effect editing information and first material extension information;
a first sending unit 1503, configured to send the first result information to the second client, so that the first result information is displayed on a second editing interface of the second client;
the first display unit 1502 is further configured to, in a case that second result information sent by the second client is received, display, on the first editing interface, the second result information based on the multimedia resource to be edited, where the second result information is: and the second client responds to result information obtained by the second operation, and the second result information comprises second effect editing information and second element expansion information.
Fig. 16 is a schematic structural diagram illustrating a multimedia asset editing apparatus according to an exemplary embodiment. Referring to fig. 16, the multimedia asset editing apparatus provided in the embodiment of the present disclosure, applied to a second client, includes a second processing unit 1601, a second display unit 1602, and a second sending unit 1603;
the second processing unit 1601 is configured to, in a call process with the first client, display the to-be-edited multimedia resource on a second editing interface when receiving the to-be-edited multimedia resource displayed on the first editing interface sent by the first client, where the second editing interface is used for performing editing processing on the to-be-edited multimedia resource;
a second displaying unit 1602, configured to, in a case that first result information sent by the first client is received, display, on a second editing interface, the first result information based on a multimedia resource to be edited, where the first result information is: the first client responds to result information obtained by the first operation, wherein the first result information comprises first effect editing information and first material expansion information;
a second display unit 1602, further configured to, in response to a second operation on the multimedia resource to be edited, display, in a second editing interface, second result information corresponding to the second operation based on the multimedia resource to be edited;
the second sending unit 1603 is configured to send the second result information to the first client, so that the second result information is displayed on the first editing interface of the first client, where the second result information includes the second result editing information and the second element extension information.
The apparatus in the above embodiment further includes units corresponding to the method in the above disclosed embodiment, where the specific manner in which each unit performs operations has been described in detail in the embodiment related to the method, and will not be described in detail here.
Fig. 17 is a schematic structural diagram of an electronic device provided in the present disclosure. As shown in fig. 17, the electronic device may include a processor 1701, a memory 1702 for storing instructions executable by the processor 1701; the processor 1701 is configured to execute the instructions to implement the multimedia asset editing method in the above embodiments. Additionally, the electronic device may include a communication bus 1703 and at least one communication interface 1704.
The processor 1701 may be a Central Processing Unit (CPU), a micro-processing unit, an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to control the execution of programs according to the disclosed aspects. Communication bus 1703 is a signal path used to transfer information between the above components. Communication interface 1704, which may be implemented using any transceiver or the like, may be used for communicating with other devices or communication networks, such as an ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), etc.
The memory 1702 may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disk read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory 1702 may be self-contained and coupled to the processor 1701 via a communication bus 1703. The memory 1702 may also be integrated with the processor 1701. The memory 1702 is used to store instructions for performing the disclosed aspects and is controlled for execution by the processor 1701. The processor 1701 is configured to execute programs or instructions stored in the memory 1702 to implement the functions in the disclosed methods.
As an example, in connection with fig. 15, the first processing unit 1501, the first display unit 1502, and the first transmission unit 1503 in the multimedia asset editing apparatus implement the same functions as the processor 1701 in fig. 17.
As another example, with reference to fig. 15, the second processing unit 1601, the second display unit 1602, and the second transmitting unit 1603 in the multimedia asset editing apparatus implement the same functions as those of the processor 1701 in fig. 17.
In particular implementations, processor 1701 may include one or more CPUs, such as CPU0 and CPU1 in fig. 17, as one embodiment.
In particular implementations, an electronic device may include multiple processors 1701, as one example, and each of the processors 1701 may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. The processor 1701 here may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).
In particular implementations, electronic device may also include an output device 1705 and an input device 1706, as an embodiment. The output device 1705 is in communication with the processor 1701 and may display information in a variety of ways. For example, the output device 1705 may be a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display device, a Cathode Ray Tube (CRT) display device, a projector (projector), or the like. The input device 1706 is in communication with the processor 1701 and can accept input from a user in a variety of ways. For example, the input device 1706 may be a mouse, keyboard, touch screen device, or sensing device, among others.
Those skilled in the art will appreciate that the configuration shown in fig. 17 does not constitute a limitation of the electronic device, and may include more or fewer components than those shown, or combine certain components, or employ a different arrangement of components. The electronic device in fig. 17 may be a server, a client, or other devices.
In addition, the present disclosure also provides a computer readable storage medium, on which a program or instructions are stored, which when executed by a processor, enable an electronic device to execute the multimedia asset editing method provided by the above embodiment. Alternatively, the readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In addition, the present disclosure also provides a computer program product comprising computer programs/instructions, the computer program product being stored in a non-volatile readable storage medium, the computer program product, when executed by at least one processor, causing an electronic device to perform the multimedia asset editing method as provided in the above embodiments.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (15)

1. A multimedia resource editing method applied to a first client side comprises the following steps:
displaying a multimedia resource to be edited on a first editing interface in the process of communicating with a second client, and synchronizing the multimedia resource to be edited to the second client, wherein the first editing interface is used for editing the multimedia resource to be edited;
responding to a first operation aiming at the first editing interface, and displaying first result information corresponding to the first operation on the first editing interface based on the multimedia resource to be edited, wherein the first result information comprises first effect editing information and first material extension information;
sending the first result information to the second client so as to display the first result information on a second editing interface of the second client;
under the condition that second result information sent by the second client is received, displaying the second result information on the first editing interface based on the multimedia resource to be edited, wherein the second result information is: and the second client responds to result information obtained by a second operation, wherein the second result information comprises second effect editing information and second material expansion information.
2. The method for editing a multimedia resource according to claim 1, wherein displaying the multimedia resource to be edited on the first editing interface during a call with the second client comprises:
displaying a resource editing control on a preset interface in the process of communicating with the second client;
in response to a third operation on the resource editing control, displaying the first editing interface, wherein the first editing interface comprises a resource import control;
in response to a fourth operation on the resource import control, displaying a multimedia resource list on the first editing interface, wherein editable multimedia resources in the multimedia resource list comprise any one or any combination of the following: the method comprises the steps of recording a multimedia resource, an authorized multimedia resource, a first real-time multimedia resource shot by a camera of a first client, a second real-time multimedia resource shot by a camera of a second client, and a splicing multimedia resource, wherein the splicing multimedia resource comprises the first real-time multimedia resource and the second real-time multimedia resource;
in response to a fifth operation on at least one editable multimedia resource, determining the multimedia resource to be edited in the editable multimedia resource, and displaying the multimedia resource to be edited on the first editing interface.
3. The method for editing a multimedia asset as claimed in claim 2, further comprising:
under the condition that the preset interface is an instant messaging interface, responding to a third operation aiming at the resource editing control, and displaying the first editing interface; the instant messaging interface is used for indicating that the first client and the second client are in a conversation;
and under the condition that the preset interface is a resource browsing interface, responding to a third operation aiming at the resource editing control, under the condition that the currently browsed multimedia resource displayed on the resource browsing interface belongs to the editable multimedia resource, determining that the currently browsed multimedia resource is the multimedia resource to be edited, and displaying the multimedia resource to be edited on the first editing interface.
4. The method for editing a multimedia asset as claimed in claim 2, further comprising:
storing the first real-time multimedia resource and the second real-time multimedia resource in the process of communication with the second client;
acquiring a first image sequence of the first real-time multimedia resource and a second image sequence of the second real-time multimedia resource;
combining the images in the first image sequence and the second image sequence according to a preset combining mode to generate a third image sequence;
and generating the spliced multimedia resource according to the third image sequence and a preset frame rate.
5. The method of multimedia asset editing of claim 2, wherein the first editing interface comprises an effect editing control and a material expansion control;
the responding to the first operation aiming at the first editing interface, and displaying first result information based on the multimedia resource to be edited on the first editing interface, wherein the displaying comprises:
under the condition that the first operation is an effect editing operation, responding to the first operation aiming at the effect editing control, and displaying first effect editing information on the first editing interface based on the multimedia resource to be edited, wherein the first effect editing information comprises special effect element adding information, video clipping information and image beautifying information;
under the condition that the first operation is a material expansion editing operation, responding to the first operation aiming at the material expansion control, and displaying the multimedia resource list on the first editing interface; responding to a second multimedia resource selection operation aiming at least one editable multimedia resource, and determining a multimedia resource to be expanded in the editable multimedia resource; and splicing the multimedia resource to be expanded to the multimedia resource to be edited, and displaying the multimedia resource to be edited on the first editing interface, wherein the first material expansion information comprises the multimedia resource to be expanded.
6. The method for editing a multimedia asset as claimed in claim 2, further comprising:
under the condition that preset conditions are met, a sharing request is generated and used for requesting the second client side to jointly edit the multimedia resources;
sending the sharing request to the second client through a communication channel established in the communication process with the second client;
under the condition of receiving a response message sent by the second client, synchronizing the multimedia resource to be edited to the second client;
wherein the preset condition includes any one of: receiving a third operation aiming at the resource editing control, and displaying the multimedia resource to be edited on the first editing interface.
7. The method for editing a multimedia asset according to claim 1, wherein after the multimedia asset to be edited is displayed on the first editing interface during the session with the second client, the method further comprises:
displaying a first special effect element on the first editing interface, wherein the first special effect element comprises: searching an editing element corresponding to a first target semantic in a preset special effect database, wherein the first target semantic is used for expressing: in the conversation process, voice semantic recognition is carried out on the voice information received by the microphone of the first client;
if the first operation is a special effect application operation for the first special effect element, in response to the first operation for the first editing interface, displaying, on the first editing interface, the first effect editing information based on the multimedia resource to be edited, where the first effect editing information is: and adding the effect information of the first special effect element based on the multimedia resource to be edited.
8. The method for editing a multimedia asset according to claim 7, wherein after the multimedia asset to be edited is displayed on the first editing interface during the session with the second client, the method further comprises:
and under the condition that the number of the first special effect elements is equal to 1, displaying the first effect editing information on the basis of the multimedia resource to be edited on the first editing interface.
9. The method of editing a multimedia asset as claimed in claim 7, further comprising:
under the condition that the first special effect element is displayed on the first editing interface, sending a first special effect identifier corresponding to the first special effect element to the second client, so that the first special effect element can be displayed on a second editing interface of the second client conveniently; alternatively, the first and second electrodes may be,
after the first special effect element is displayed on the first editing interface, sending a first special effect identifier corresponding to the first special effect element to the second client, so that the first special effect element can be displayed on a second editing interface of the second client.
10. The method for editing a multimedia asset according to claim 1, wherein after the multimedia asset to be edited is displayed on the first editing interface during the session with the second client, the method further comprises:
under the condition that a second special effect identifier sent by a second client is received, displaying a second special effect element corresponding to the second special effect identifier on the first editing interface, wherein the second special effect element comprises: searching an editing element corresponding to a second target semantic in a preset special effect database, wherein the second target semantic is used for expressing: and in the conversation process, performing voice semantic recognition on the voice information received by the microphone of the second client.
11. A multimedia resource editing method applied to a second client side comprises the following steps:
in the process of communication with a first client, under the condition of receiving a multimedia resource to be edited, which is displayed on a first editing interface and sent by the first client, displaying the multimedia resource to be edited on a second editing interface, wherein the second editing interface is used for editing the multimedia resource to be edited;
under the condition of receiving first result information sent by the first client, displaying the first result information on the second editing interface based on the multimedia resource to be edited, wherein the first result information is: the first client responds to result information obtained by a first operation, wherein the first result information comprises first effect editing information and first material extension information;
responding to a second operation aiming at the multimedia resource to be edited, and displaying second result information corresponding to the second operation on the second editing interface based on the multimedia resource to be edited, wherein the second result information comprises second effect editing information and second element expansion information;
and sending the second result information to the first client so as to display the second result information on a first editing interface of the first client.
12. A multimedia resource editing device is applied to a first client and comprises a first processing unit, a first display unit and a first sending unit;
the first processing unit is used for displaying a multimedia resource to be edited on a first editing interface in the process of communicating with a second client, and synchronizing the multimedia resource to be edited to the second client, wherein the first editing interface is used for editing the multimedia resource to be edited;
the first display unit is used for responding to a first operation aiming at the first editing interface, and displaying first result information corresponding to the first operation on the first editing interface based on the multimedia resource to be edited, wherein the first result information comprises first effect editing information and first material extension information;
the first sending unit is configured to send the first result information to the second client, so that the first result information is displayed on a second editing interface of the second client;
the first display unit is further configured to display, on the first editing interface, second result information based on the multimedia resource to be edited in the case that the second result information sent by the second client is received, where the second result information is: and the second client responds to result information obtained by a second operation, wherein the second result information comprises second effect editing information and second element expansion information.
13. The multimedia resource editing device is applied to a second client and comprises a second processing unit, a second display unit and a second sending unit;
the second processing unit is used for displaying the multimedia resource to be edited on a second editing interface under the condition that the multimedia resource to be edited displayed on the first editing interface sent by the first client is received in the process of communicating with the first client, and the second editing interface is used for editing the multimedia resource to be edited;
the second display unit is configured to, when first result information sent by the first client is received, display, on the second editing interface, the first result information based on the multimedia resource to be edited, where the first result information is: the first client responds to result information obtained by a first operation, wherein the first result information comprises first effect editing information and first material extension information;
the second display unit is further configured to, in response to a second operation on the multimedia resource to be edited, display, on the second editing interface, second result information corresponding to the second operation based on the multimedia resource to be edited;
the second sending unit is configured to send the second result information to the first client, so that the second result information is displayed on a first editing interface of the first client, where the second result information includes second result editing information and second material extension information.
14. An electronic device, comprising: a processor; a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the multimedia asset editing method of any of claims 1-10 or 11.
15. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor, implement the multimedia asset editing method of any of claims 1-10 or 11.
CN202211083993.4A 2022-09-06 2022-09-06 Multimedia resource editing method and device, electronic equipment and storage medium Pending CN115643241A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211083993.4A CN115643241A (en) 2022-09-06 2022-09-06 Multimedia resource editing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211083993.4A CN115643241A (en) 2022-09-06 2022-09-06 Multimedia resource editing method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115643241A true CN115643241A (en) 2023-01-24

Family

ID=84939517

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211083993.4A Pending CN115643241A (en) 2022-09-06 2022-09-06 Multimedia resource editing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115643241A (en)

Similar Documents

Publication Publication Date Title
CN110597774B (en) File sharing method, system, device, computing equipment and terminal equipment
KR101983523B1 (en) Gallery of messages with a shared interest
US10567480B2 (en) Remote control of a shared application
US11589091B2 (en) Video information processing method, computer equipment and storage medium
CN104244075B (en) A kind of sharing media information method and system
CN112039929B (en) File editing method and device and electronic equipment
US11968427B2 (en) Video message generation method and apparatus, electronic device, and storage medium
CN110634220B (en) Information processing method and device
JP7490124B2 (en) INTERACTION METHOD, DEVICE AND ELECTRONIC DEVICE
KR20150068509A (en) Method for communicating using image in messenger, apparatus and system for the same
CN109905629A (en) Method, apparatus, medium and the equipment of document sharing are realized when audio/video conference
CN113988021A (en) Content interaction method and device, electronic equipment and storage medium
CN116758201B (en) Rendering processing method, device and system of three-dimensional scene and computer storage medium
WO2023020092A1 (en) Multi-person collaboration-based resource processing method, apparatus and system
KR20190092354A (en) Method for communicating using image in messenger, apparatus and system for the same
CN115643241A (en) Multimedia resource editing method and device, electronic equipment and storage medium
US20230403245A1 (en) Message processing method and apparatus, device, and medium
KR102462808B1 (en) Server for generating 3d motion web contents that can determine object information for each situation
US20230156062A1 (en) Dynamic syncing of content within a communication interface
US20240187360A1 (en) Communication system using user interfaces for dynamic modification of chat communication elements of instant messenger
WO2024087533A1 (en) Expression image sharing method and apparatus, computer device, and storage medium
KR101983837B1 (en) A method and system for producing an image based on a user-feedbackable bots, and a non-transient computer-readable recording medium
EP3424212A1 (en) Joining executable component to online conference
CN115941841A (en) Associated information display method, device, equipment, storage medium and program product
JP2024513640A (en) Virtual object action processing method, device, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination