WO2025051169A1 - 用于图像编辑的方法、装置、设备和存储介质 - Google Patents

用于图像编辑的方法、装置、设备和存储介质 Download PDF

Info

Publication number
WO2025051169A1
WO2025051169A1 PCT/CN2024/116982 CN2024116982W WO2025051169A1 WO 2025051169 A1 WO2025051169 A1 WO 2025051169A1 CN 2024116982 W CN2024116982 W CN 2024116982W WO 2025051169 A1 WO2025051169 A1 WO 2025051169A1
Authority
WO
WIPO (PCT)
Prior art keywords
layer
special effect
target image
subject
effect object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/116982
Other languages
English (en)
French (fr)
Inventor
岳靖翔
陈晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Publication of WO2025051169A1 publication Critical patent/WO2025051169A1/zh
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Definitions

  • Example embodiments of the present disclosure relate generally to information processing, and more particularly, to methods, apparatuses, devices, and computer-readable storage media for image editing.
  • more and more applications are designed to provide users with various services. For example, users can create, browse, comment on, and forward various types of content in the application, including various media content such as videos, images, image collections, and audio.
  • these applications also support interaction with users to facilitate users to shoot and create content.
  • Special effects functions can also be provided to users when creating content. For example, users can add some special effects elements, such as animals, scenery, and objects, to the content they create.
  • a method for image editing comprises: receiving a user's selection operation of a predetermined type of first special effect object in an editing interface of a target image, rendering a second layer corresponding to the first special effect object on a first layer corresponding to the target image in response to the selection operation of the first special effect object, and rendering a third layer corresponding to at least one main object in the target image on the second layer; and determining the edited or confirmed first special effect object in the second layer based on the user's editing operation or confirmation operation on the first special effect object, and obtaining an edited target image, wherein the edited target image comprises the first layer, the second layer, and the third layer.
  • a device for image editing includes: a selection receiving module configured to receive a user's selection operation of a predetermined type of first special effect object in an editing interface of a target image; a rendering module configured to render a second layer corresponding to the first special effect object on a first layer corresponding to the target image in response to the selection operation of the first special effect object, and render a third layer corresponding to at least one main object in the target image on the second layer; and an image determination module configured to determine the edited or confirmed first special effect object in the second layer based on the user's editing operation or confirmation operation on the first special effect object, and obtain an edited target image, wherein the edited target image includes the first layer, the second layer, and the third layer.
  • an electronic device in a third aspect of the present disclosure, includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit.
  • the electronic device executes the method according to the first aspect of the present disclosure.
  • a computer-readable storage medium wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to perform the method according to the first aspect of the present disclosure.
  • FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented
  • FIG2 shows a flow chart of a process of image editing according to some embodiments of the present disclosure
  • 3A to 3D show schematic diagrams of example editing interfaces according to some embodiments of the present disclosure
  • FIGS. 4A and 4B are schematic diagrams showing example editing interfaces in which a target image includes multiple subject objects according to some embodiments of the present disclosure
  • 5A to 5C are schematic diagrams showing example editing interfaces in which a target image includes a plurality of special effect objects according to some embodiments of the present disclosure
  • FIG6 is a schematic diagram showing a process of rendering a layer according to some embodiments of the present disclosure.
  • FIGS. 7A to 7C are schematic diagrams showing example images for subject segmentation according to some embodiments of the present disclosure.
  • FIG8 shows a schematic structural block diagram of an apparatus for image editing according to some embodiments of the present disclosure.
  • FIG. 9 shows a block diagram of an electronic device that can be used to implement some embodiments of the present disclosure.
  • the term "in response to” means that the corresponding event occurs or the condition is satisfied. It will be understood that the timing of the execution of the subsequent action executed in response to the event or condition is not necessarily strongly related to the time when the event occurs or the condition is satisfied. In some cases, the subsequent action may be executed immediately when the event occurs or the condition is satisfied; in other cases, the subsequent action may be executed some time after the event occurs or the condition is satisfied.
  • a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to software or hardware such as electronic devices, applications, servers or storage media that execute operations of the technical solution of the present disclosure based on the prompt message.
  • the prompt information in response to receiving an active request from the user, is sent to the user in a manner such as a pop-up window, in which the prompt information can be presented in text form.
  • the pop-up window can also carry a selection control for the user to choose "agree” or “disagree” to provide personal information to the electronic device.
  • FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented.
  • an application 120 is installed in a terminal device 110.
  • a user 140 can interact with the application 120 via the terminal device 110 and/or an attached device of the terminal device 110.
  • application 120 may be a content sharing application that can provide various services related to media content items to user 140, including browsing, commenting, forwarding, creating (e.g., shooting and/or editing), publishing, etc.
  • application 120 may be a content editing application, such as an image and/or video editing application.
  • the terminal device 110 may present an interface 150 of the application 120.
  • the interface 150 may include various pages that the application 120 may provide, such as a content presentation page, a content creation page, a content publishing page, a message page, a personal homepage, and the like.
  • the application 120 may provide content creation functions, including shooting, uploading, editing, and/or publishing media content items.
  • the application 120 may provide a content browsing function to browse various types of content published in the application 120.
  • the application 120 may also provide interactive functions, including interacting with other users (e.g., adding friends) and interacting with various types of content (including liking, collecting, commenting on content, etc.).
  • the terminal device 110 communicates with the server 130 to realize the supply of services for the application 120.
  • the terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio/video players, digital cameras/camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof.
  • the terminal device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.).
  • the server 130 can be various types of computing systems/servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.
  • users may want to add some elements to the content they create, such as text, various graphics, etc.
  • the user can edit the image, and the user can use text props to add text information to the image or use other sticker-type special effects to add image elements to the image.
  • text or image elements are directly superimposed on the top layer of the user's image for presentation.
  • image editing effects are single and may block key areas of the image (such as the main object of the image). In some editing scenarios, it is expected to obtain more presentation methods of sticker-type special effects.
  • an embodiment of the present disclosure proposes an improved image editing solution.
  • a user's selection operation for a predetermined type of special effect object is received in an image editing interface.
  • a layer corresponding to the special effect object is rendered on a layer corresponding to the image, and a layer corresponding to at least one main object in the image is rendered on the layer corresponding to the special effect object.
  • the special effect object is determined to obtain an edited image.
  • the edited image includes a layer corresponding to the image, a layer corresponding to the special effect object, and a layer corresponding to at least one main object.
  • image editing scheme disclosed in the present invention when adding special effect objects to the edited image, such an image editing process can realize the sandwich presentation of special effect objects and obtain various rich visual effects with three-dimensional sense. In addition, it also allows users to freely edit the special effect objects of the sandwich layer to meet the diverse special effect editing needs of users.
  • FIG2 shows a flow chart of a process 200 of image editing according to some embodiments of the present disclosure.
  • the process 200 may be implemented at the terminal device 110.
  • the process 200 will be described with reference to the environment 100 of FIG1. It should be noted that the operations performed by the aforementioned terminal device 110 and the operations performed by the terminal device 110 described later may be performed by related applications installed on the terminal device 110.
  • the terminal device 110 receives a user's selection operation of a first special effect object of a predetermined type in an editing interface of a target image.
  • “Special effects object” refers to a selectable visual object under the special effects editing function provided in image editing.
  • the special effects editing function also known as the template function or the prop function, refers to a function that can at least add a specific visual effect to the image, such as adding static or dynamic objects to the picture, providing interactive effects, changing the color contrast of the picture, character makeup, and so on.
  • the special effects object may include a dynamic special effects object, such as a dynamic object with animation effects.
  • the special effects object may include a static special effects object, such as the addition of a static object.
  • the special effects object may include an augmented reality (AR) special effect to provide an AR effect.
  • AR augmented reality
  • the target image to be edited may be a single image or a video image in a video.
  • the user may be supported to edit one or more video images in a video.
  • the user may be allowed to request the use of a specific special effect object or prop object.
  • a user is provided with a selection of a predetermined type of special effect object during the image editing process.
  • the predetermined type of special effect object is sandwiched and added between the main object and the background of the target image.
  • This type of special effect object is sometimes also referred to as a sandwich special effect.
  • the terminal device 110 may present an operation control associated with selecting a special effect object in the editing interface of the image.
  • Figures 3A to 3D show schematic diagrams of example editing interfaces according to some embodiments of the present disclosure. As shown in Figure 3A, at least a special effect selection control 301 is presented in the editing interface 300A of the target image 310. In response to detecting a selection operation on the special effect selection control 301, the terminal device 110 may present at least one type of special effect object.
  • At least one type of special effect object may include, for example, but is not limited to, a special effect object that can be presented at the top layer of the target image, a special effect object that can be presented at the bottom layer of the target image, a special effect object that can be presented between the bottom layer of the target image and the top layer of the main object, and the like.
  • the first special effect object can be, for example, any appropriate object such as text, image, icon, animated image, etc., and the present disclosure does not limit this. It should be understood that other types of special effect objects can also be configured in the image editing interface according to editing needs, such as special effect objects rendered on the top layer.
  • the terminal device 110 can then present the first special effects object in association with the target image in response to the selection operation of the first special effects object of the predetermined type. Specifically, referring to Figure 2, in box 220, the terminal device 110 renders the second layer corresponding to the first special effects object on the first layer corresponding to the target image in response to the selection operation of the first special effects object of the predetermined type, and renders the third layer corresponding to at least one main object in the target image on the second layer.
  • the first special effects object selected by the user is rendered in the middle layer, on which the layer corresponding to the main object of the target image is also rendered.
  • the added special effects object can automatically avoid blocking the main body of a specific image during sandwich presentation, and can also present a sandwich and three-dimensional special effects effect that is different from the "sticker" presented on the general top layer, making the special effects object and the image appear more integrated.
  • the terminal device 110 in response to the user selecting the special effect object 320, the terminal device 110 renders the layer (i.e., the second layer) corresponding to the special effect object 320 (i.e., the first special effect object) on the layer (i.e., the first layer) corresponding to the target image 310.
  • the visual effect of the editing interface 300B is that the special effect object 320 is superimposed on the target image 310.
  • the terminal device 110 may also determine at least one main object in the target image.
  • the at least one main object here may be at least one object in the foreground area of the target image.
  • the terminal device 110 may determine the layer corresponding to the at least one main object as the third layer.
  • the terminal device 110 may render the third layer on the second layer corresponding to the first special effect object to achieve sandwich presentation of the special effect object.
  • the terminal device 110 may also render the layer corresponding to the main object 315 (e.g., the water cup shown in the figure) in the target image 310 on the layer corresponding to the special effect object 320 (i.e., the third layer).
  • the main object 315 e.g., the water cup shown in the figure
  • the position, size, outline, etc. of at least one main object in the third layer is rendered to be exactly the same as the position, size, outline, etc. of at least one main object in the first layer. That is, after the third layer is rendered on the second layer, at least one main object in the third layer completely overlaps with at least one main object in the first layer.
  • the process of rendering the second layer on the first layer and rendering the third layer on the second layer is invisible to the user. That is, after the rendering is completed, the editing interface 300C is presented to the user without presenting the editing interface 300B to the user. From the user's perspective, after initiating the selection of the first special effect object of the predetermined type, the editing interface 300C as shown in Figure 3C is directly seen, that is, the sandwich effect of the special effect object is directly presented. In some embodiments, depending on the application, the rendering process of each layer can also be presented to the user.
  • the at least one main object corresponding to the third layer may be, for example, all main objects in the target image.
  • the at least one main object may be one or more main objects automatically identified from the target image.
  • At least one subject object corresponding to the third layer may be at least part of the multiple subject objects in the target image. Specifically, what is rendered on the top layer may be one or more subject objects selected by the user from the subject recognition results.
  • the terminal device 110 may present subject identifiers corresponding to each of the multiple candidate subject objects in the editing interface.
  • the subject identifier corresponding to each subject object includes at least one of the following: contour identification information for defining the subject object from the target image, or an object indicator presented at a position corresponding to the subject object in the target image.
  • the terminal device 110 may receive a user's selection of a subject identifier of at least one subject object among a plurality of candidate subject objects, and render a third layer corresponding to the selected at least one subject object on the second layer. For example, the terminal device 110 may determine that a selection of the corresponding subject object is detected in response to detecting a selection operation of the subject identifier and/or a selection operation of the subject object. The terminal device 110 further determines the layer corresponding to the selected at least one subject object as the third layer, and renders the third layer on the second layer.
  • FIG. 4A and 4B show schematic diagrams of example editing interfaces in which a target image includes multiple subject objects according to some embodiments of the present disclosure.
  • the terminal device 110 may present subject identifications corresponding to each of the multiple candidate subject objects in the editing interface 400A. Specifically, the terminal device 110 may present contour identification information 413 and object indicator 414 of the subject object 411 in association with the subject object 411 in the editing interface 400A. The terminal device 110 may present contour identification information 415 and object indicator 416 of the subject object 412 in association with the subject object 412 in the editing interface 400A.
  • the contour identification information may be used to finely represent the contour of the corresponding subject object, or, for example, to define each subject object from the target image using a bounding box.
  • the object indicator 414 and the object indicator 416 may include, for example, respective anchor points and labels (e.g., the label "subject 1" and the label "subject 2" shown in the figure).
  • the terminal device 110 displays only the contour identification information corresponding to the subject object, only displays the object indicator corresponding to the subject object, or displays both the contour identification information and the object indicator.
  • the terminal device 110 determines that a selection operation on the main object 412 is received.
  • the terminal device 110 may determine the layer corresponding to the main object 412 as the third layer.
  • the layer corresponding to the target image 410 is the first layer
  • the layer corresponding to the first special effect object (such as the multiple clouds shown in FIG. 4B ) is the second layer
  • the layer corresponding to the main object 412 is the third layer.
  • the terminal device 110 renders the second layer on the first layer, and then renders the third layer on the second layer.
  • the main object 412 will be rendered on the top layer, so that it will not be blocked by the first special effect object, while the main object 411 may be blocked by the first special effect object (depending on the placement position of the first special effect object).
  • the user can choose which main objects to present on the top layer of the target image (that is, which main objects can be selected not to be blocked by the first special effect object, and which main objects can be selected to be blocked by the first special effect). While being able to realize the sandwich presentation of the special effect object, the user is allowed to select the main object presented on the top layer of the image, which meets the user's diverse special effect editing needs and can further improve the user's experience of using special effects. It should be understood that when selecting the main object, the user can be allowed to select only a single main object placed on the top layer, or the user can be allowed to select multiple main objects.
  • the terminal device 110 can sort different special effect objects from top to bottom or from bottom to top according to the order of the user's selection of the special effect objects.
  • the first selected special effect object can be at the bottom or top of the special effect object layer. It should be noted that no matter how the order of the layers corresponding to the special effect objects is arranged, all special effect objects of the predetermined type are always sandwiched between the first layer and the third layer.
  • the terminal device 110 determines the edited or confirmed first special effect object in the second layer based on the user's editing operation or confirmation operation on the first special effect object, and obtains an edited target image, where the edited target image includes the first layer, the second layer, and the third layer.
  • the editing operation here may include, for example, at least one of a position moving operation, a direction moving operation, and a scaling operation.
  • the terminal device 110 can generate a target image including a sandwich special effect.
  • the terminal device 110 can also adjust the first special effect object in the second layer based on the user's editing operation on the first special effect object. Specifically, the terminal device 110 can adjust the display position of the first special effect object in the second layer in response to receiving the user's position movement operation on the first special effect object.
  • the terminal device 110 can adjust the display direction of the first special effect object in the second layer in response to receiving the user's direction movement operation on the first special effect object.
  • the terminal device 110 can adjust the display size of the first special effect object in the second layer in response to receiving the user's zoom operation on the first special effect object. As shown in Figure 3D, the terminal device 110 adjusts the display position, display direction and display size of the special effect object 320 in its corresponding layer in response to receiving the editing operation on the special effect object 320.
  • the terminal device 110 can determine the edited or confirmed special effect objects in the layers corresponding to the multiple special effect objects based on the user's editing operations or confirmation operations on the multiple special effect objects.
  • the edited target image includes multiple layers corresponding to multiple feature objects.
  • the terminal device 110 can also determine the edited or confirmed second special effect object in the fourth layer based on the user's editing operation or confirmation operation on the second special effect object.
  • the edited target image also includes a fourth layer. It should be noted that in some embodiments, the editing operation on the second special effect object is independent of the editing operation on the first special effect object, that is, the editing operations on different special effect objects are independent of each other and do not affect each other.
  • 5A to 5C show schematic diagrams of example editing interfaces in which a target image includes multiple special effect objects according to some embodiments of the present disclosure.
  • the target image 510 in the editing interface 500A includes a first layer where the target image 510 is located, a second layer corresponding to the special effect object 520, and a third layer corresponding to the main object 515.
  • FIG. 5A shows schematic diagrams of example editing interfaces in which a target image includes multiple special effect objects according to some embodiments of the present disclosure.
  • the target image 510 in the editing interface 500A includes a first layer where the target image 510 is located, a second layer corresponding to the special effect object 520, and a third layer corresponding to the main object 515.
  • the terminal device 110 in response to receiving a user's selection operation on the special effect object 530 (i.e., the second special effect object), the terminal device 110 can also render a fourth layer corresponding to the special effect object 530 between the first layer and the third layer to present the target image 510 shown in the editing interface 500B. As shown in FIG. 5C , the terminal device 110 can further adjust the special effect object 520 in the second layer and the special effect object 530 in the fourth layer in response to the respective editing operations on the special effect object 520 and the special effect object 530 to present the target image 510 shown in the editing interface 500C.
  • the terminal device 110 in response to a confirmation operation on at least one special effect object, can generate a target image including a first layer, at least one layer of objects of at least one feature object, and a third layer.
  • the user can be allowed to freely edit the special effect objects in the sandwich layer, which can make the display of the special effect objects more flexible.
  • the terminal device 110 in order to render the layer corresponding to the main object, the terminal device 110 obtains the main segmentation information of the target image, and the main segmentation information at least indicates the position of at least one main object in the target image.
  • the terminal device 110 can extract at least one main object from the target image based on the main segmentation information, and then render a third layer corresponding to at least one main object on the second layer (and possibly the fourth layer).
  • the main segmentation information can be obtained by the terminal device 110 after processing the target image through a main segmentation algorithm.
  • the terminal device 110 can upload the target image to other devices, such as a remote server 130 to determine the main segmentation object, and receive the main segmentation information from the server 130.
  • the interaction process between the terminal device 110 and the server 130 is described below in conjunction with FIG. 6 .
  • FIG. 6 shows a schematic diagram of a process 600 of rendering a layer according to some embodiments of the present disclosure.
  • the terminal device 110 in response to receiving a user's selection of a special effect object of a predetermined type, the terminal device 110 generates an algorithm request 615 for requesting an algorithm corresponding to the special effect object of the predetermined type.
  • the special effect object of the predetermined type may also be referred to as a sandwich template, for example.
  • the algorithm corresponding to the algorithm request 615 may be, for example, a body segmentation algorithm.
  • the terminal device 110 may send the generated algorithm request 615 to the server 130 (also referred to as a service device), and obtain the algorithm corresponding to the special effect object of the predetermined type from the server 130.
  • the terminal device 110 may perform image processing on the target image based on the algorithm to obtain the final target image including the sandwich special effect.
  • the terminal device 110 may send the target image together with the algorithm request 615 to the server 130 so that the server 130 processes the target image.
  • the terminal device 110 may send the target image to the server 130 for processing after obtaining user authorization.
  • the terminal device 110 renders a second layer corresponding to the selected special effect object on the first layer corresponding to the target image.
  • the second layer may also be referred to as an intermediate layer.
  • server 130 receives algorithm request 615 and the target image.
  • Server 130 may perform corresponding image processing on the target image based on the algorithm corresponding to algorithm request 615. For example, server 130 may identify the subject in the target image based on a subject segmentation algorithm.
  • the server 130 may call a subject segmentation task to segment the subject in the target image to determine subject segmentation information of the target image.
  • the subject segmentation information may include, for example, a location that may identify each subject object in the target image.
  • the target image 700A includes a subject object 701 (i.e., the water cup in the figure).
  • the terminal device 110 provides the target image 700A to the server 130, and the server 130 can call the subject segmentation task and use the subject segmentation algorithm to identify the subject segmentation information corresponding to the target image 700A.
  • the subject segmentation information can be, for example, as shown in FIG. 7B .
  • the subject segmentation information can, for example, include a subject segmentation map 700B corresponding to the size of the target image.
  • Each subject object has a subject segmentation map, and the pixel value in the subject segmentation map is 0 or 1, 1 indicates that the corresponding pixel position in the target object belongs to the corresponding subject object, and 0 indicates that it does not belong.
  • the server 130 can send the subject segmentation map 700B shown in FIG. 7B to the terminal device 110.
  • the terminal device 110 receives the subject segmentation information sent by the server 130, and renders the third layer corresponding to the subject object of the target image on the second layer (which can also be called the subject information restoration process).
  • the terminal device 110 obtains the subject segmentation map 700B shown in FIG. 7B from the server 130, and determines the width, height, starting point information, etc. of the subject object based on the outline information 702 of the subject object indicated by the subject segmentation map 700B.
  • the terminal device 110 can generate a third layer 700C corresponding to the subject object as shown in FIG. 7C based on the subject segmentation map 700B and the target image 700A.
  • the third layer 700C only includes the image corresponding to the subject object 701.
  • the terminal device 110 can then render the third layer 700C to the second layer corresponding to the special effect object.
  • the sandwich presentation of special effect objects can be realized, and the user is allowed to freely edit the special effect objects of the sandwich layer, meeting the user's diverse special effect editing needs.
  • the added special effect objects can automatically avoid blocking the main information of the image.
  • FIG. 8 shows a schematic structural block diagram of an apparatus 800 for image editing according to some embodiments of the present disclosure.
  • the apparatus 800 may be implemented as or included in the terminal device 110.
  • Each module/component in the apparatus 800 may be implemented by hardware, software, firmware or any combination thereof.
  • the device 800 includes an operation receiving module 810, which is configured to receive a user's selection operation on a predetermined type of first special effect object in the editing interface of the target image.
  • the device 800 also includes a rendering module 820, which is configured to render a second layer corresponding to the first special effect object on a first layer corresponding to the target image in response to the selection operation on the first special effect object, and render a third layer corresponding to at least one main object in the target image on the second layer.
  • the device 800 also includes an image determination module 830, which is configured to determine the edited or confirmed first special effect object in the second layer based on the user's editing operation or confirmation operation on the first special effect object, and obtain an edited target image, wherein the edited target image includes the first layer, the second layer, and the third layer.
  • an image determination module 830 is configured to determine the edited or confirmed first special effect object in the second layer based on the user's editing operation or confirmation operation on the first special effect object, and obtain an edited target image, wherein the edited target image includes the first layer, the second layer, and the third layer.
  • the rendering module 820 includes: an identification presentation module, configured to present subject identifications corresponding to each of the multiple candidate subject objects in the editing interface if multiple candidate subject objects are identified from the target image; a selection receiving module, configured to receive a user's selection of a subject identification of at least one subject object among the multiple candidate subject objects; and a first rendering module, configured to render a third layer corresponding to the selected at least one subject object on the second layer.
  • the subject identification corresponding to each subject object includes at least one of the following: contour identification information used to define the subject object from the target image, or an object indicator presented at a position corresponding to the subject object in the target image.
  • the rendering module 820 includes: a segmentation information acquisition module, configured to acquire subject segmentation information of the target image, the subject segmentation information at least indicating the position of at least one subject object in the target image; and a subject object extraction module, configured to extract at least one subject object from the target image based on the subject segmentation information; and a second rendering module, configured to render a third layer corresponding to at least one subject object on the second layer.
  • the segmentation information acquisition module includes: a sending module configured to send the target image to the service device; and a receiving module configured to receive the subject segmentation information from the service device.
  • the device 800 also includes: a second operation receiving module, configured to receive a user's selection operation on a second special effects object of a predetermined type; a third rendering module, configured to render a fourth layer corresponding to the second special effects object on the first layer corresponding to the target image in response to the selection operation on the second special effects object, the fourth layer being below the third layer; and a second object determination module, configured to determine the edited or confirmed second special effects object in the fourth layer based on the user's editing operation or confirmation operation on the second special effects object, wherein the edited target image also includes the fourth layer.
  • a second operation receiving module configured to receive a user's selection operation on a second special effects object of a predetermined type
  • a third rendering module configured to render a fourth layer corresponding to the second special effects object on the first layer corresponding to the target image in response to the selection operation on the second special effects object, the fourth layer being below the third layer
  • a second object determination module configured to determine the edited or confirmed second special effects object in the fourth layer based on
  • the editing operation of the second special effect object is independent of the editing operation of the first special effect object.
  • the editing operation on the first special effect object or the second special effect object includes at least one of the following: a position moving operation, a direction moving operation, and a scaling operation.
  • the modules and/or units included in the device 800 can be implemented in various ways, including software, hardware, firmware, or any combination thereof.
  • one or more modules and/or units can be implemented using software and/or firmware, such as machine executable instructions stored on a storage medium.
  • some or all of the modules and/or units in the device 800 can be implemented at least in part by one or more hardware logic components.
  • exemplary types of hardware logic components include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
  • FIG9 shows a block diagram of an electronic device 900 that can implement one or more embodiments of the present disclosure. It should be understood that the electronic device 900 shown in FIG9 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 900 shown in FIG9 can be used to implement the terminal device 110 of FIG1 or the apparatus 800 of FIG8.
  • the electronic device 900 is in the form of a general electronic device.
  • the components of the electronic device 900 may include, but are not limited to, one or more processors or processing units 910, a memory 920, a storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960.
  • the processing unit 910 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 920. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 900.
  • the electronic device 900 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 900, including but not limited to volatile and non-volatile media, removable and non-removable media.
  • the memory 920 can be a volatile memory (e.g., register, cache, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof.
  • the storage device 930 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and/or data and can be accessed within the electronic device 900.
  • a machine-readable medium such as a flash drive, a disk, or any other medium, which can be used to store information and/or data and can be accessed within the electronic device 900.
  • the electronic device 900 may further include additional removable/non-removable, volatile/non-volatile storage media.
  • a disk drive for reading or writing from a removable, non-volatile disk e.g., a “floppy disk”
  • an optical drive for reading or writing from a removable, non-volatile optical disk may be provided.
  • each drive may be connected to a bus (not shown) by one or more data media interfaces.
  • the memory 920 may include a computer program product 925 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
  • the communication unit 940 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 900 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 900 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
  • PC network personal computer
  • the input device 950 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc.
  • the output device 960 may be one or more output devices, such as a display, a speaker, a printer, etc.
  • the electronic device 900 may also communicate with one or more external devices (not shown) through the communication unit 940 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 900, or communicate with any device that allows the electronic device 900 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input/output (I/O) interface (not shown).
  • I/O input/output
  • a computer-readable storage medium on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.
  • These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions/actions specified in one or more boxes in the flowchart and/or block diagram is generated.
  • These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and/or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions/actions specified in one or more boxes in the flowchart and/or block diagram.
  • Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions/actions specified in one or more boxes in the flowchart and/or block diagram.
  • each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification.
  • the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved.
  • each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

根据本公开的实施例，提供了用于图像编辑的方法、装置、设备和存储介质。该方法包括：在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作；响应于对第一特效对象的选择操作，在目标图像对应的第一图层上渲染第一特效对象对应的第二图层，并且在第二图层上渲染目标图像中的至少一个主体对象对应的第三图层；以及基于用户对第一特效对象的编辑操作或确认操作，在第二图层中确定经编辑或经确认的第一特效对象，得到编辑后的目标图像，编辑后的目标图像包括第一图层、第二图层和第三图层。以此方式，能够实现特效对象的夹心呈现，允许用户对夹心层的特效对象自由编辑，满足用户多样化的特效编辑需求。

Description

用于图像编辑的方法、装置、设备和存储介质
本申请要求2023年09月08日递交的，标题为“用于图像编辑的方法、装置、设备和存储介质”、申请号为202311161804.5的中国发明专利申请的优先权，该申请的全部内容通过引用结合在本申请中。
技术领域
本公开的示例实施例总体涉及信息处理，并且更具体地，涉及用于图像编辑的方法、装置、设备和计算机可读存储介质。
 背景技术
当前越来越多应用被设计来向用户提供各种服务。例如，用户可以在应用中创作、浏览、评论、转发各类内容，包括诸如视频、图像、图像集、音频等各种媒体内容。此外，这些应用还支持与用户的交互，以便于用户进行内容拍摄和内容创作。在内容创作时还可以为用户提供特效功能。例如，用户可以在所创作的内容中添加一些特效元素，例如动物、景色、物品等。
发明内容
在本公开的第一方面，提供一种图像编辑的方法。该方法包括：在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作，响应于对第一特效对象的选择操作，在目标图像对应的第一图层上渲染第一特效对象对应的第二图层，并且在第二图层上渲染目标图像中的至少一个主体对象对应的第三图层；以及基于用户对第一特效对象的编辑操作或确认操作，在第二图层中确定经编辑或经确认的第一特效对象，得到编辑后的目标图像，编辑后的目标图像包括第一图层、第二图层和第三图层。
在本公开的第二方面，提供一种用于图像编辑的装置。该装置包括：选择接收模块，被配置为在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作；渲染模块，被配置为响应于对第一特效对象的选择操作，在目标图像对应的第一图层上渲染第一特效对象对应的第二图层，并且在第二图层上渲染目标图像中的至少一个主体对象对应的第三图层；以及图像确定模块，被配置为基于用户对第一特效对象的编辑操作或确认操作，在第二图层中确定经编辑或经确认的第一特效对象，得到编辑后的目标图像，编辑后的目标图像包括第一图层、第二图层和第三图层。
在本公开的第三方面，提供了一种电子设备。该电子设备包括至少一个处理单元；以及至少一个存储器，至少一个存储器被耦合到至少一个处理单元并且存储用于由至少一个处理单元执行的指令。指令在由至少一个处理单元执行时使电子设备执行根据本公开的第一方面的方法。
在本公开的第四方面，提供了一种计算机可读存储介质。该计算机可读存储介质上存储有计算机程序，计算机程序可由处理器执行以执行根据本公开的第一方面的方法。
应当理解，此部分中所描述的内容并非旨在限定本公开的实施例的关键特征或重要特征，也不用于限制本公开的范围。本公开的其它特征将通过以下的描述而变得容易理解。
 附图说明
在下文中，结合附图并参考以下详细说明，本公开各实现方式的上述和其他特征、优点及方面将变得更加明显。在附图中，相同或相似的附图标记表示相同或相似的元素，其中：
图1示出了本公开的实施例能够在其中实现的示例环境的示意图；
图2示出了根据本公开的一些实施例的图像编辑的过程的流程图；
图3A至图3D示出了根据本公开的一些实施例的示例编辑界面的示意图；
图4A和图4B示出了根据本公开的一些实施例的目标图像包括多个主体对象的示例编辑界面的示意图；
[根据细则91更正 09.10.2024]
图5A至图5C示出了根据本公开的一些实施例的目标图像包括多个特效对象的示例编辑界面的示意图；
图6示出了根据本公开的一些实施例的渲染图层的过程的示意图；
图7A至图7C示出了根据本公开的一些实施例的用于主体分割的示例图像的示意图；
图8示出了根据本公开的一些实施例的用于图像编辑的装置的示意性结构框图；以及
图9示出了能够被用来实现本公开一些实施例的电子设备的框图。
 具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中示出了本公开的一些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反，提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
在本公开的实施例的描述中，术语“包括”及其类似用语应当理解为开放性包含，即“包括但不限于”。术语“基于”应当理解为“至少部分地基于”。术语“一个实施例”或“该实施例”应当理解为“至少一个实施例”。术语“一些实施例”应当理解为“至少一些实施例”。下文还可能包括其它明确的和隐含的定义。
术语“响应于”表示相应的事件发生或者条件得以满足。将会理解，响应于该事件或者条件而被执行的后续动作的执行时机，与事件发生或者条件满足的时间，这二者不一定是强关联的。在某些情况下，后续动作可在事件发生或者条件成立时立即被执行；在另一些情况下，后续动作也可在事件发生或者条件成立后经过一段时间才被执行。
可以理解的是，本技术方案所涉及的数据(包括但不限于数据本身、数据的获得或使用)应当遵循相应法律法规及相关规定的要求。
可以理解的是，在使用本公开各实施例公开的技术方案之前，均应当根据相关法律法规通过适当的方式对本公开所涉及个人信息的类型、使用范围、使用场景等告知用户并获得用户的授权。
例如，在响应于接收到用户的主动请求时，向用户发送提示信息，以明确地提示用户，其请求执行的操作将需要获得和使用到用户的个人信息，从而使得用户可以根据提示信息来自主地选择是否向执行本公开技术方案的操作的电子设备、应用程序、服务器或存储介质等软件或硬件提供个人信息。
作为一种可选的但非限制性的实现方式，响应于接收到用户的主动请求，向用户发送提示信息的方式，例如可以是弹出窗口的方式，弹出窗口中可以以文字的方式呈现提示信息。此外，弹出窗口中还可以承载供用户选择“同意”或“不同意”向电子设备提供个人信息的选择控件。
可以理解的是，上述通知和获得用户授权过程仅是示意性的，不对本公开的实现方式构成限定，其它满足相关法律法规的方式也可应用于本公开的实现方式中。
图1示出了本公开的实施例能够在其中实现的示例环境100的示意图。在该示例环境100中，终端设备110中安装有应用120。用户140可以经由终端设备110和/或终端设备110的附接设备来与应用120进行交互。
在一些实施例中，应用120可以是内容分享应用，能够向用户140提供与媒体内容项相关的各类服务，包括内容的浏览、评论、转发、创作(例如，拍摄和/或编辑)、发布等等。在一些实施例中，应用120可以是内容编辑应用，例如图像和/或视频编辑应用。
在图1的环境100中，如果应用120处于活动状态，终端设备110可以呈现应用120的界面150。界面150可以包括应用120所能提供的各类页面，诸如内容呈现页面、内容创作页面、内容发布页面、消息页面、个人主页，等等。应用120可以提供内容创作功能，包括拍摄、上传、编辑和/或发布媒体内容项。在一些实现中，应用120可以提供内容浏览功能，以浏览在应用120中发布的各类内容。在一些实现中，应用120还可以提供互动功能，包括与其他用户进行互动(例如添加好友)和与各类内容进行互动(包括对内容进行点赞、收藏、评论等)。
在一些实施例中，终端设备110与服务器130通信，以实现对应用120的服务的供应。终端设备110可以是任意类型的移动终端、固定终端或便携式终端，包括移动手机、台式计算机、膝上型计算机、笔记本计算机、上网本计算机、平板计算机、媒体计算机、多媒体平板、个人通信系统(PCS)设备、个人导航设备、个人数字助理(PDA)、音频/视频播放器、数码相机/摄像机、定位设备、电视接收器、无线电广播接收器、电子书设备、游戏设备或者前述各项的任意组合，包括这些设备的配件和外设或者其任意组合。在一些实施例中，终端设备110也能够支持任意类型的针对用户的接口(诸如“可佩戴”电路等)。服务器130可以是能够提供计算能力的各种类型的计算系统/服务器，包括但不限于大型机、边缘计算节点、云环境中的计算设备，等等。
应当理解，仅出于示例性的目的描述环境100中各个元素的结构和功能，而不暗示对于本公开的范围的任何限制。
如前文所提及的，用户可能期望在所创作的内容中添加一些元素，例如文字、各类图形等。示例性的，用户可以对图像进行图像编辑，用户可以使用文字道具在图像中添加文字信息或者使用其他贴纸类特效在图像中添加图像元素。通常，这类文字或者图像元素被直接叠加在用户图像的顶层进行呈现。这样的图像编辑效果单一、且可能会遮挡住图像的关键区域(例如图像的主体对象)。在一些编辑场景中，期望获得贴纸类特效的更多呈现方式。
为此，本公开的实施例提出了一种改进的图像编辑方案。根据该方案，在图像的编辑界面中接收用户对预定类型的特效对象的选择操作。响应于该选择操作，在图像对应的图层上渲染特效对象对应的图层，并且，在特效对象对应的图层上渲染图像中至少一个主体对象对应的图层。基于用户对特效对象的编辑操作或确认操作，确定特效对象以得到编辑后的图像。编辑后的图像包括图像对应的图层、特效对象对应的图层以及至少一个主体对象对应的图层。
根据本公开的图像编辑方案，在向所编辑的图像添加特效对象时，这样的图像编辑过程能够实现特效对象的夹心呈现，获得具有立体感的各类丰富视觉效果。此外，还允许用户对夹心层的特效对象自由编辑，满足用户多样化的特效编辑需求。
以下将继续参考附图描述本公开的一些示例实施例。
图2示出了根据本公开的一些实施例的图像编辑的过程200的流程图。过程200可以在终端设备110处实现。为便于讨论，将参考图1的环境100来描述过程200。需要说明的是，前述终端设备110所执行的操作以及后续表述的终端设备110所执行的操作，具体可以是安装在终端设备110上的相关应用执行的。
在框210，终端设备110在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作。
“特效对象”指的是在图像编辑中所提供的特效编辑功能下的可选择的视觉对象。在本文中，特效编辑功能，也称为模板功能或道具功能，指的是至少能够向图像添加特定视觉效果的功能，例如在画面中添加静态或动态物体、提供互动效果、改变画面的颜色对比度、人物妆容，等等。在一些示例中，特效对象可以包括动态特效对象，例如具有动画效果的动态对象。特效对象可以包括静态特效对象，例如静态对象的添加。在一些实施例中，特效对象可以包括增强现实(AR)特效，以提供AR效果。
在一些实施例中，要编辑的目标图像可以是单张图像，也可以是视频中的视频图像。例如，在视频编辑过程中可支持用户对视频中的一个或多个视频图像进行编辑。在图像编辑过程中，可以允许用户请求对特定特效对象或道具对象的使用。
在本公开的实施例中，在图像编辑过程中向用户提供预定类型的特效对象的选择。如下文将详细描述的，该预定类型的特效对象会被夹心添加在目标图像的主体对象与背景之间。该类型的特效对象有时也称为夹心特效。
在一些实施例中，终端设备110可以在图像的编辑界面中呈现与选择特效对象相关联的操作控件。图3A至图3D示出了根据本公开的一些实施例的示例编辑界面的示意图。如图3A所示，在目标图像310的编辑界面300A中至少呈现有特效选择控件301。响应于检测到对特效选择控件301的选择操作，终端设备110可以呈现至少一个类型的特效对象。示例性的，至少一个类型的特效对象例如可以包括但不限于可以在目标图像的顶层呈现的特效对象、可以在目标图像底层呈现的特效对象、可以在目标图像的底层与主体对象的顶层之间呈现的特效对象等等。
在本公开的实施例的讨论中，假设用户选择向目标图像添加预定类型的特效对象，即可以在目标图像的底层与主体对象的顶层之间呈现的特效对象。第一特效对象例如可以为文本、图像、图标、动图等等任意适当的对象，本公开对此不作限定。应当理解，根据编辑需要，在图像编辑界面中还可以配置其他类型的特效对象，例如被渲染在顶层的特效对象。
终端设备110进而可以响应于对预定类型的第一特效对象的选择操作，与目标图像相关联的呈现第一特效对象。具体地，参考图2，在框220，终端设备110响应于对预定类型的第一特效对象的选择操作，在目标图像对应的第一图层上渲染第一特效对象对应的第二图层，并且在第二图层上渲染目标图像中的至少一个主体对象对应的第三图层。也就是说，用户选择的第一特效对象被渲染在中间图层，其上还渲染有目标图像的主体对象对应的图层。这样，在夹心呈现时可以自动避免所添加的特效对象对特定图像主体的遮挡，而且还能呈现出不同于一般顶层呈现的“贴纸”的夹心、立体特效效果，使特效对象与图像显得更为融合。
如图3B所示，在编辑界面300B中，响应于用户选择特效对象320，终端设备110在目标图像310对应的图层(也即第一图层)上渲染特效对象320(也即第一特效对象)对应的图层(也即第二图层)。编辑界面300B的视觉效果即为在目标图像310上叠加了特效对象320。
进一步地，终端设备110还可以确定目标图像中的至少一个主体对象。这里的至少一个主体对象可以在目标图像的前景区域中的至少一个对象。终端设备110可以将至少一个主体对象对应的图层确定为第三图层。终端设备110可以通过在第一特效对象对应的第二图层上渲染第三图层，以实现特效对象的夹心呈现。如图3C所示，在编辑界面300C中，终端设备110在目标图像310对应的图层上渲染特效对象320对应的图层后，还可以在特效对象320对应的图层上渲染目标图像310中的主体对象315(例如图中所示的水杯)对应的图层(也即第三图层)。
需要注意的是，第三图层中至少一个主体对象的位置、尺寸、轮廓等被渲染为与第一图层中至少一个主体对象的位置、尺寸、轮廓等是完全相同的。也即，在第三图层被渲染在第二图层上后，第三图层中的至少一个主体对象与第一图层中的至少一个主体对象完全重合。
在一些实施例中，为保证用户的图片编辑体验，在第一图层上渲染第二图层和在第二图层上渲染第三图层的过程对用户不可见。也即，在完成渲染后向用户呈现编辑界面300C而不将编辑界面300B呈现给用户。从用户的角度看，在发起对预定类型的第一特效对象的选择后，直接看到如图3C所示的编辑界面300C，也即直接呈现特效对象的夹心效果。在一些实施例中，根据应用，也可以向用户呈现逐个图层的渲染过程。
在一些实施例中，与第三图层对应的至少一个主体对象例如可以是目标图像中的全部主体对象。具体地，至少一个主体对象可以是从目标图像中自动识别出的一个或多个主体对象。
在一些实施例中，与第三图层对应的至少一个主体对象可以是目标图像中的多个主体对象中的至少部分主体对象。具体地，被渲染在顶层的可以是由用户从主体识别结果中选择的一个户或多个主体对象。在一些实施例中，如果从目标图像识别出多个候选主体对象，则终端设备110可以在编辑界面呈现多个候选主体对象各自对应的主体标识。每个主体对象对应的主体标识包括用于从目标图像中界定该主体对象的轮廓标识信息，或在目标图像中该主体对象对应的位置呈现的对象指示符中的以下至少一项。
终端设被110可以接收用户对多个候选主体对象中的至少一个主体对象的主体标识的选择，并在第二图层上渲染所选择的至少一个主体对象对应的第三图层。终端设备110例如可以响应于检测到对主题标识的选择操作，和/或，对主体对象的选择操作，确定检测到对相应主体对象的选择。终端设备110进而将被选择的至少一个主体对象对应的图层确定为第三图层，并在第二图层上渲染该第三图层。
图4A和图4B示出了根据本公开的一些实施例的目标图像包括多个主体对象的示例编辑界面的示意图。如图4A所示，在目标图像410包括多个候选主体对象(主体对象411和主体对象412)的情况下，终端设备110可以在编辑界面400A中呈现多个候选主体对象各自对应的主体标识。具体地，终端设备110可以在编辑界面400A与主体对象411相关联对呈现主体对象411的轮廓标识信息413和对象指示符414。终端设备110可以在编辑界面400A与主体对象412相关联对呈现主体对象412的轮廓标识信息415和对象指示符416。轮廓标识信息(包括轮廓标识信息413和轮廓标识信息414)可以用于精细表示对应主体对象的轮廓，或者，用诸如边界框(bounding box)来从目标图像中界定各个主体对象。对象指示符414和对象指示符416例如可以包括各自相应的锚点以及标签(例如图中所示的标签“主体1”和标签“主体2”)。在一些实施例中，终端设备110仅显示主体对象对应的轮廓标识信息，仅显示主体对象对应的对象指示符，或者同时显示轮廓标识信息以及对象指示符。
进一步的，响应于接收到对主体对象412的选择操作，对轮廓表示信息415的选择操作，和/或，对对象指示符416的选择操作，终端设备110确定接收到对主体对象412的选择操作。终端设备110可以将主体对象412对应的图层确定为第三图层。
如图4B所示，在编辑界面400B中，目标图像410对应的图层为第一图层，第一特效对象(例如图4B中所示的多个云朵)对应的图层为第二图层，主体对象412对应的图层为第三图层。终端设备110将第二图层渲染在第一图层上，再将第三图层渲染至第二图层上。由此，主体对象412会被渲染在顶层，从而不会被第一特效对象所遮挡，而主体对象411可能会被第一特效对象遮挡(取决于第一特效对象的放置位置)。以此方式，用户可以自行选择在目标图像的顶层呈现哪些主体对象(也即可以选择让哪些主体对象不被第一特效对象遮挡，选择让哪些主体对象被第一特效遮挡)。能够实现特效对象的夹心呈现的同时，允许用户自行选择呈现在图像顶层的主体对象，满足用户多样化的特效编辑需求，能够进一步提高用户对特效的使用体验。应当理解，在选择主体对象时，可以允许用户仅选择置于顶层的单个主体对象，或者允许用户选择多个主体对象。
上面描述了用户选择预定类型的一个特效对象的示例，在一些实施例中，用户还可以选择预定类型的多个特效对象。具体地，终端设备110还可以接收用户对预定类型的第二特效对象的选择操作。终端设备110可以响应于对第二特效对象的选择操作，在目标图像对应的第一图层上渲染第二特效对象对应的第四图层。第四图层在第三图层之下。第二特效对象对应的第四图层可以在第一特效对象对应的第二图层之上或之下，但第四图层总是在目标图像对应的第一图层和主体对象对应的第三图层之间。在一些实施例中，终端设备110可以根据用户对特效对象的选择顺序，对不同特效对象按照用户选择的先后顺序，从上到下或从下到上排序。最先被选择的特效对象可以在特效对象图层的最下方或最上方。需要注意的是，无论特效对象对应的图层的顺序如何排列，预定类型的所有特效对象总是被夹在第一图层与第三图层之间。
在框230，终端设备110基于用户对第一特效对象的编辑操作或确认操作，在第二图层中确定经编辑或经确认的第一特效对象，得到编辑后的目标图像，编辑后的目标图像包括第一图层、第二图层和第三图层。这里的编辑操作例如可以包括位置移动操作、方向移动操作、缩放操作中的至少一项。
在一些实施例中，终端设备110在第一图层上渲染第二图层，再在二图层上渲染第三图层后，终端设备110可以生成一个包括夹心特效的目标图像。终端设备110还可以基于用户对第一特效对象的编辑操作，调整第二图层中的第一特效对象。具体地，终端设备110可以响应于接收到用户对第一特效对象的位置移动操作，调整第一特效对象在第二图层中的显示位置。终端设备110可以响应于接收到用户对第一特效对象的方向移动操作，调整第一特效对象在第二图层中的显示方向。终端设备110可以响应于接收到用户对第一特效对象的缩放操作，调整第一特效对象在第二图层中的显示尺寸。如图3D所示，终端设备110响应于接收到对特效对象320的编辑操作，调整了特效对象320在其对应的图层中的显示位置、显示方向以及显示尺寸。
同样地，在用户选择了预定类型的多个特效对象的情况下，终端设备110可以基于用户对多个特效对象各自的编辑操作或确认操作，在多个特效对象各自对应的图层中确定经编辑或经确认的特效对象。编辑后的目标图像包括多个特征对象对应的多个图层。示例性的，若用户还选择了第二特效对象，则终端设备110还可以基于用户对第二特效对象的编辑操作或确认操作，在第四图层中确定经编辑或经确认的第二特效对象。编辑后的目标图像还包括第四图层。需要注意的是，在一些实施例中，针对第二特效对象的编辑操作独立于针对第一特效对象的编辑操作，也即针对不同特效对象的编辑操作彼此独立，互不影响。
[根据细则91更正 09.10.2024]
图5A至图5C示出了根据本公开的一些实施例的目标图像包括多个特效对象的示例编辑界面的示意图。如图5A所示，编辑界面500A中的目标图像510包括目标图像510所在的第一图层、特效对象520对应的第二图层以及主体对象515对应的第三图层。如图5B所示，响应于接收到用户对特效对象530(也即第二特效对象)的选择操作，终端设备110还可以在第一图层和第三图层中间渲染特效对象530对应的第四图层以呈现编辑界面500B所示的目标图像510。如图5C所示，终端设备110进而可以响应于对特效对象520和特效对象530各自的编辑操作，分别调整第二图层中的特效对象520以及第四图层中的特效对象530以呈现编辑界面500C所示的目标图像510。
应当理解，虽然上文讨论了第一特效对象和第二特效对象，在实际编辑过程中用户可以根据需要向目标图像添加预定类型的更多特效对象，并根据需要灵活编辑这些特效对象。在一些实施例中，响应于对至少一个特效对象的确认操作，终端设备110可以生成包括第一图层、至少一个特征对象各自对象的至少一个图层以及第三图层的目标图像。
以此方式，可以在实现特效对象的夹心呈现的同时，允许用户对夹心层的特效对象自由编辑，可以使得特效对象的显示更加灵活。
上面结合图2至图5C描述了终端设备110处的用户交互。在一些实施例中，为了渲染主体对象对应的图层，终端设备110获取目标图像的主体分割信息，主体分割信息至少指示至少一个主体对象各自在目标图像中的位置。终端设备110可以基于主体分割信息，从目标图像提取至少一个主体对象，然后在第二图层(以及可能第四图层)上渲染至少一个主体对象对应的第三图层。在一些实施例中，主体分割信息可以由终端设备110通过主体分割算法来处理目标图像后得到。在一些实施例中，终端设备110可以将目标图像上传到其他设备，例如远程的服务器130来确定主体分割对象，并从服务器130接收到主体分割信息。
下面结合图6来描述终端设备110与服务器130的交互过程。
图6示出了根据本公开的一些实施例的渲染图层的过程600的示意图。
在框610，终端设备110响应于接收到用户对预定类型的特效对象的选择，生成用于请求与该预定类型的特效对象对应的算法的算法请求615。这里的预定类型的特效对象例如也可以被称之为夹心模板。算法请求615所对应的算法例如可以为主体分割算法。
在一些实施例中，终端设备110可以将生成的算法请求615发送至服务器130(也可称为服务设备)，并从服务器130处获取与该预定类型的特效对象对应的算法。终端设备110可以基于该算法自行对目标图像执行图像处理以得到最终的包括夹心特效的目标图像。
终端设备110可以将目标图像与算法请求615一同发送给服务器130，以便由服务器130对目标图像进行处理。在一些实施例中，终端设备110可以在获得用户授权后将目标图像发送给服务器130进行处理。
在框620，终端设备110在目标图像对应的第一图层上渲染所选择的特效对象对应的第二图层，第二图层也可以被称之为中间层。
在框630，服务器130接收算法请求615以及目标图像。服务器130可以基于算法请求615对应的算法对目标图像执行相应的图像处理。例如，服务器130可以基于主体分割算法识别目标图像中的主体。
在框640，服务器130可以调用主体分割任务来分割目标图像中的主体，以确定目标图像的主体分割信息。主体分割信息例如可以包括可以标识目标图像中每个主体对象的位置。
图7A至图7C示出了根据本公开的一些实施例的用于主体分割的示例图像的示意图。如图7A所示，目标图像700A包括主体对象701(也即图中水杯)。终端设备110将目标图像700A提供给服务器130，服务器130可以调用主体分割任务，利用主体分割算法识别目标图像700A对应的主体分割信息。主体分割信息例如可以如图7B所示。主体分割信息例如可以包括与目标图像的尺寸对应的主体分割图700B。每个主体对象具有一个主体分割图，该主体分割图中的像素值是0或1，1表示目标对象中对应的像素位置属于对应的主体对象，0表示不属于。服务器130可以将如图7B所示的主体分割图700B发送给终端设备110。
在框650，终端设备110接收服务器130发送的主体分割信息，并在第二图层上渲染目标图像的主体对象对应的第三图层(也可以称为主体信息还原过程)。示例性的，终端设备110从服务器130处获取如图7B所示的主体分割图700B，并基于主体分割图700B所指示的主体对象的轮廓信息702，确定主体对象的宽、高、起始点信息等。终端设备110可以基于主体分割图700B以及目标图像700A生成如图7C所示的主体对象对应的第三图层700C。在第三图层700C中仅包括主体对象701对应的图像。终端设备110进而可以将第三图层700C渲染至特效对象对应的第二图层上。
可以理解，在图6中关于服务器描述的主体分割过程也同样可以被实现在终端设备110本地。
综上所述，根据本公开的图像编辑方案，能够实现特效对象的夹心呈现，且允许用户对夹心层的特效对象自由编辑，满足用户多样化的特效编辑需求。此外，向图像添加特效对象时，可以自动避免所添加的特效对象对图像主体信息的遮挡。
图8示出了根据本公开的某些实施例的用于图像编辑的装置800的示意性结构框图。装置800可以被实现为或者被包括在终端设备110中。装置800中的各个模块/组件可以由硬件、软件、固件或者它们的任意组合来实现。
如图8所示，装置800包括操作接收模块810，被配置为在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作。装置800还包括渲染模块820，被配置为响应于对第一特效对象的选择操作，在目标图像对应的第一图层上渲染第一特效对象对应的第二图层，并且在第二图层上渲染目标图像中的至少一个主体对象对应的第三图层。装置800还包括图像确定模块830，被配置为基于用户对第一特效对象的编辑操作或确认操作，在第二图层中确定经编辑或经确认的第一特效对象，得到编辑后的目标图像，编辑后的目标图像包括第一图层、第二图层和第三图层。
在一些实施例中，渲染模块820包括：标识呈现模块，被配置为如果从目标图像识别出多个候选主体对象，则在编辑界面呈现多个候选主体对象各自对应的主体标识；选择接收模块，被配置为接收用户对多个候选主体对象中的至少一个主体对象的主体标识的选择；以及第一渲染模块，被配置为在第二图层上渲染所选择的至少一个主体对象对应的第三图层。
在一些实施例中，每个主体对象对应的主体标识包括以下至少一项：轮廓标识信息，用于从目标图像中界定该主体对象，或在目标图像中该主体对象对应的位置呈现的对象指示符。
在一些实施例中，渲染模块820包括：分割信息获取模块，被配置为获取目标图像的主体分割信息，主体分割信息至少指示至少一个主体对象各自在目标图像中的位置；以及主体对象提取模块，被配置为基于主体分割信息，从目标图像提取至少一个主体对象；以及第二渲染模块，被配置为在第二图层上渲染至少一个主体对象对应的第三图层。
在一些实施例中，分割信息获取模块包括：发送模块，被配置为将目标图像发送给服务设备；以及接收模块，被配置为从服务设备接收主体分割信息。
在一些实施例中，装置800还包括：第二操作接收模块，被配置为接收用户对预定类型的第二特效对象的选择操作；第三渲染模块，被配置为响应于对第二特效对象的选择操作，在目标图像对应的第一图层上渲染第二特效对象对应的第四图层，第四图层在第三图层之下；以及第二对象确定模块，被配置为基于用户对第二特效对象的编辑操作或确认操作，在第四图层中确定经编辑或经确认的第二特效对象，其中编辑后的目标图像还包括第四图层。
在一些实施例中，第二特效对象的编辑操作独立于第一特效对象的编辑操作。
在一些实施例中，对第一特效对象或第二特效对象的编辑操作包括以下至少一项：位置移动操作、方向移动操作、缩放操作。
装置800中所包括的模块和/或单元可以利用各种方式来实现，包括软件、硬件、固件或其任意组合。在一些实施例中，一个或多个模块和/或单元可以使用软件和/或固件来实现，例如存储在存储介质上的机器可执行指令。除了机器可执行指令之外或者作为替代，装置800中的部分或者全部模块和/或单元可以至少部分地由一个或多个硬件逻辑组件来实现。作为示例而非限制，可以使用的示范类型的硬件逻辑组件包括现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准品(ASSP)、片上系统(SOC)、复杂可编程逻辑器件(CPLD)，等等。
图9示出了可以实施本公开的一个或多个实施例的电子设备900的框图。应当理解，图9所示出的电子设备900仅仅是示例性的，而不应当构成对本文所描述的实施例的功能和范围的任何限制。图9所示出的电子设备900可以用于实现图1的终端设备110或图8的装置800。
如图9所示，电子设备900是通用电子设备的形式。电子设备900的组件可以包括但不限于一个或多个处理器或处理单元910、存储器920、存储设备930、一个或多个通信单元940、一个或多个输入设备950以及一个或多个输出设备960。处理单元910可以是实际或虚拟处理器并且能够根据存储器920中存储的程序来执行各种处理。在多处理器系统中，多个处理单元并行执行计算机可执行指令，以提高电子设备900的并行处理能力。
电子设备900通常包括多个计算机存储介质。这样的介质可以是电子设备900可访问的任何可以获得的介质，包括但不限于易失性和非易失性介质、可拆卸和不可拆卸介质。存储器920可以是易失性存储器(例如寄存器、高速缓存、随机访问存储器(RAM))、非易失性存储器(例如，只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、闪存)或它们的某种组合。存储设备930可以是可拆卸或不可拆卸的介质，并且可以包括机器可读介质，诸如闪存驱动、磁盘或者任何其他介质，其可以能够用于存储信息和/或数据并且可以在电子设备900内被访问。
电子设备900可以进一步包括另外的可拆卸/不可拆卸、易失性/非易失性存储介质。尽管未在图9中示出，可以提供用于从可拆卸、非易失性磁盘(例如“软盘”)进行读取或写入的磁盘驱动和用于从可拆卸、非易失性光盘进行读取或写入的光盘驱动。在这些情况中，每个驱动可以由一个或多个数据介质接口被连接至总线(未示出)。存储器920可以包括计算机程序产品925，其具有一个或多个程序模块，这些程序模块被配置为执行本公开的各种实施例的各种方法或动作。
通信单元940实现通过通信介质与其他电子设备进行通信。附加地，电子设备900的组件的功能可以以单个计算集群或多个计算机器来实现，这些计算机器能够通过通信连接进行通信。因此，电子设备900可以使用与一个或多个其他服务器、网络个人计算机(PC)或者另一个网络节点的逻辑连接来在联网环境中进行操作。
输入设备950可以是一个或多个输入设备，例如鼠标、键盘、追踪球等。输出设备960可以是一个或多个输出设备，例如显示器、扬声器、打印机等。电子设备900还可以根据需要通过通信单元940与一个或多个外部设备(未示出)进行通信，外部设备诸如存储设备、显示设备等，与一个或多个使得用户与电子设备900交互的设备进行通信，或者与使得电子设备900与一个或多个其他电子设备通信的任何设备(例如，网卡、调制解调器等)进行通信。这样的通信可以经由输入/输出(I/O)接口(未示出)来执行。
根据本公开的示例性实现方式，提供了一种计算机可读存储介质，其上存储有一条或多条计算机指令，其中一条或多条计算机指令被处理器执行以实现上文描述的方法。
这里参照根据本公开实现的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本公开的各个方面。应当理解，流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合，都可以由计算机可读程序指令实现。
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理单元，从而生产出一种机器，使得这些指令在通过计算机或其他可编程数据处理装置的处理单元执行时，产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中，这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作，从而，存储有指令的计算机可读介质则包括一个制造品，其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。
也可以把计算机可读程序指令加载到计算机、其他可编程数据处理装置、或其他设备上，使得在计算机、其他可编程数据处理装置或其他设备上执行一系列操作步骤，以产生计算机实现的过程，从而使得在计算机、其他可编程数据处理装置、或其他设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。
附图中的流程图和框图显示了根据本公开的多个实现的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分，模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个连续的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或动作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
以上已经描述了本公开的各实现，上述说明是示例性的，并非穷尽性的，并且也不限于所公开的各实现。在不偏离所说明的各实现的范围和精神的情况下，对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择，旨在最好地解释各实现的原理、实际应用或对市场中的技术的改进，或者使本技术领域的其他普通技术人员能理解本文公开的各实现。

Claims (11)

  1. 一种图像编辑的方法，包括：
    在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作；
    响应于对所述第一特效对象的所述选择操作，
    在所述目标图像对应的第一图层上渲染所述第一特效对象对应的第二图层，并且
    在所述第二图层上渲染所述目标图像中的至少一个主体对象对应的第三图层；以及
    基于所述用户对所述第一特效对象的编辑操作或确认操作，在所述第二图层中确定经编辑或经确认的所述第一特效对象，得到编辑后的目标图像，所述编辑后的目标图像包括所述第一图层、所述第二图层和所述第三图层。
  2. 根据权利要求1所述的方法，其中在所述第二图层上渲染所述目标图像中的至少一个主体对象对应的第三图层包括：
    如果从所述目标图像识别出多个候选主体对象，则在所述编辑界面呈现所述多个候选主体对象各自对应的主体标识；
    接收所述用户对所述多个候选主体对象中的所述至少一个主体对象的主体标识的选择；以及
    在所述第二图层上渲染所选择的所述至少一个主体对象对应的第三图层。
  3. 根据权利要求2所述的方法，其中每个主体对象对应的主体标识包括以下至少一项：
    轮廓标识信息，用于从所述目标图像中界定该主体对象，或
    在所述目标图像中该主体对象对应的位置呈现的对象指示符。
  4. 根据权利要求1所述的方法，其中在所述第二图层上渲染所述目标图像中的至少一个主体对象对应的第三图层包括：
    获取所述目标图像的主体分割信息，所述主体分割信息至少指示所述至少一个主体对象各自在所述目标图像中的位置；以及
    基于所述主体分割信息，从所述目标图像提取所述至少一个主体对象；以及
    在所述第二图层上渲染所述至少一个主体对象对应的第三图层。
  5. 根据权利要求4所述的方法，其中获取所述目标图像的主体分割信息包括：
    将所述目标图像发送给服务设备；以及
    从所述服务设备接收所述主体分割信息。
  6. 根据权利要求1所述的方法，还包括：
    接收用户对所述预定类型的第二特效对象的选择操作，
    响应于对所述第二特效对象的所述选择操作，
    在所述目标图像对应的第一图层上渲染所述第二特效对象对应的第四图层，所述第四图层在所述第三图层之下；以及
    基于所述用户对所述第二特效对象的编辑操作或确认操作，在所述第四图层中确定经编辑或经确认的所述第二特效对象，
    其中所述编辑后的目标图像还包括所述第四图层。
  7. 根据权利要求6所述的方法，其中所述第二特效对象的编辑操作独立于所述第一特效对象的编辑操作。
  8. 根据权利要求1至7中任一项所述的方法，其中对所述第一特效对象或所述第二特效对象的编辑操作包括以下至少一项：位置移动操作、方向移动操作、缩放操作。
  9. 一种用于图像编辑的装置，包括：
    选择接收模块，被配置为在目标图像的编辑界面中，接收用户对预定类型的第一特效对象的选择操作；
    渲染模块，被配置为响应于对所述第一特效对象的所述选择操作，在所述目标图像对应的第一图层上渲染所述第一特效对象对应的第二图层，并且在所述第二图层上渲染所述目标图像中的至少一个主体对象对应的第三图层；以及
    图像确定模块，被配置为基于所述用户对所述第一特效对象的编辑操作或确认操作，在所述第二图层中确定经编辑或经确认的所述第一特效对象，得到编辑后的目标图像，所述编辑后的目标图像包括所述第一图层、所述第二图层和所述第三图层。
  10. 一种电子设备，包括：
    至少一个处理单元；以及
    至少一个存储器，所述至少一个存储器被耦合到所述至少一个处理单元并且存储用于由所述至少一个处理单元执行的指令，所述指令在由所述至少一个处理单元执行时使所述设备执行根据权利要求1至8中任一项所述的方法。
  11. 一种计算机可读存储介质，其上存储有计算机程序，所述程序被处理器执行时实现根据权利要求1至8中任一项所述的方法。
PCT/CN2024/116982 2023-09-08 2024-09-04 用于图像编辑的方法、装置、设备和存储介质 Pending WO2025051169A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202311161804.5 2023-09-08
CN202311161804.5A CN117201883A (zh) 2023-09-08 2023-09-08 用于图像编辑的方法、装置、设备和存储介质

Publications (1)

Publication Number Publication Date
WO2025051169A1 true WO2025051169A1 (zh) 2025-03-13

Family

ID=88983002

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/116982 Pending WO2025051169A1 (zh) 2023-09-08 2024-09-04 用于图像编辑的方法、装置、设备和存储介质

Country Status (2)

Country Link
CN (1) CN117201883A (zh)
WO (1) WO2025051169A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117201883A (zh) * 2023-09-08 2023-12-08 北京字跳网络技术有限公司 用于图像编辑的方法、装置、设备和存储介质
CN120358370A (zh) * 2024-01-19 2025-07-22 北京字跳网络技术有限公司 媒体数据生成方法、装置、设备和存储介质
CN118012319B (zh) * 2024-04-08 2024-10-25 荣耀终端有限公司 一种图像处理方法、电子设备及计算机可读存储介质
CN121166245A (zh) * 2024-06-19 2025-12-19 北京字跳网络技术有限公司 用于显示对象标识的方法、装置、设备、介质和程序产品
CN121284343A (zh) * 2024-07-01 2026-01-06 北京字跳网络技术有限公司 多媒体处理方法、装置、设备及介质
CN119094671A (zh) * 2024-11-07 2024-12-06 杭州宇神五号科技有限公司 基于pag的动态环绕特效开发方法、装置、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113438412A (zh) * 2021-05-26 2021-09-24 维沃移动通信有限公司 图像处理方法和电子设备
WO2022228362A1 (zh) * 2021-04-25 2022-11-03 北京字跳网络技术有限公司 一种特效配置文件的生成方法、装置、设备及介质
CN115937379A (zh) * 2021-08-16 2023-04-07 北京字跳网络技术有限公司 一种特效生成方法、装置、电子设备及存储介质
CN115953493A (zh) * 2022-12-29 2023-04-11 北京字跳网络技术有限公司 特效图层的编辑方法、装置、电子设备及存储介质
CN117201883A (zh) * 2023-09-08 2023-12-08 北京字跳网络技术有限公司 用于图像编辑的方法、装置、设备和存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106231415A (zh) * 2016-08-18 2016-12-14 北京奇虎科技有限公司 一种在视频直播中互动添加脸部特效的方法及装置
CN110536151B (zh) * 2019-09-11 2021-11-19 广州方硅信息技术有限公司 虚拟礼物特效的合成方法和装置、直播系统
CN111010585B (zh) * 2019-12-06 2021-10-22 广州方硅信息技术有限公司 虚拟礼物的发送方法、装置、设备及存储介质
CN112565806B (zh) * 2020-12-02 2023-08-29 广州繁星互娱信息科技有限公司 虚拟礼物赠送方法、装置、计算机设备及介质
CN115908642A (zh) * 2021-09-30 2023-04-04 北京字跳网络技术有限公司 一种图像编辑方法及装置
CN116459508A (zh) * 2022-01-11 2023-07-21 脸萌有限公司 特效道具的生成方法、画面的处理方法、装置和电子设备
CN116126182A (zh) * 2022-09-08 2023-05-16 北京字跳网络技术有限公司 特效处理方法、装置、电子设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022228362A1 (zh) * 2021-04-25 2022-11-03 北京字跳网络技术有限公司 一种特效配置文件的生成方法、装置、设备及介质
CN113438412A (zh) * 2021-05-26 2021-09-24 维沃移动通信有限公司 图像处理方法和电子设备
CN115937379A (zh) * 2021-08-16 2023-04-07 北京字跳网络技术有限公司 一种特效生成方法、装置、电子设备及存储介质
CN115953493A (zh) * 2022-12-29 2023-04-11 北京字跳网络技术有限公司 特效图层的编辑方法、装置、电子设备及存储介质
CN117201883A (zh) * 2023-09-08 2023-12-08 北京字跳网络技术有限公司 用于图像编辑的方法、装置、设备和存储介质

Also Published As

Publication number Publication date
CN117201883A (zh) 2023-12-08

Similar Documents

Publication Publication Date Title
WO2025051169A1 (zh) 用于图像编辑的方法、装置、设备和存储介质
US12175576B2 (en) Method, apparatus, device and media for publishing video
WO2020001234A1 (zh) 文件夹图标显示方法、系统、可读存储介质及终端
KR20170026274A (ko) 콘텐츠 편집 장치 및 편집 방법
WO2025092766A1 (zh) 用于显示作品的方法、装置、设备和存储介质
CN118172236A (zh) 用于图像处理的方法、装置、设备和存储介质
WO2025168082A9 (zh) 内容展示方法、作品发布方法、装置、设备和存储介质
CN116471366A (zh) 一种特效生成方法、装置、计算机设备及存储介质
WO2025218756A1 (zh) 视图切换的方法、装置、设备和存储介质
WO2026040862A1 (zh) 创建模板的方法、装置、设备和存储介质
US20260112128A1 (en) Method for augmented reality, apparatus, device and storage medium
CN115421631B (zh) 界面显示方法和装置
CN118210414A (zh) 用于页面交互的方法、装置、设备和存储介质
JP2025522655A (ja) ビデオ推奨のための方法、装置、デバイス、及び記憶媒体
US20250271981A1 (en) Method, apparatus, device, and storage medium for media item input
CN115311397A (zh) 用于图像渲染的方法、装置、设备和存储介质
WO2025256532A1 (zh) 发布内容的方法、装置、设备和存储介质
CN118673245A (zh) 管理应用页面的方法、装置、设备、介质和和程序产品
CN118590701A (zh) 用于视频交互的方法、装置、设备和存储介质
CN112116719A (zh) 三维场景中对象的确定方法、装置、存储介质和电子设备
CN118245158A (zh) 用于在应用中呈现动画的方法、装置、设备和介质
WO2024131577A1 (zh) 用于创建特效的方法、装置、设备和介质
CN117827068A (zh) 交互控制方法、装置、设备和存储介质
CN119583874A (zh) 视频内容替换方法、程序产品、电子设备和芯片系统
CN115202792A (zh) 用于场景切换的方法、装置、设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24862009

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024862009

Country of ref document: EP