WO2023030550A1 - Data generation method, image processing method, apparatuses, device, and storage medium - Google Patents

Data generation method, image processing method, apparatuses, device, and storage medium Download PDF

Info

Publication number
WO2023030550A1
WO2023030550A1 PCT/CN2022/127583 CN2022127583W WO2023030550A1 WO 2023030550 A1 WO2023030550 A1 WO 2023030550A1 CN 2022127583 W CN2022127583 W CN 2022127583W WO 2023030550 A1 WO2023030550 A1 WO 2023030550A1
Authority
WO
WIPO (PCT)
Prior art keywords
special effect
image
effect material
display parameter
display
Prior art date
Application number
PCT/CN2022/127583
Other languages
French (fr)
Chinese (zh)
Inventor
李圆圆
许亲亲
Original Assignee
上海商汤智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海商汤智能科技有限公司 filed Critical 上海商汤智能科技有限公司
Publication of WO2023030550A1 publication Critical patent/WO2023030550A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2213/00Indexing scheme for animation
    • G06T2213/08Animation software package

Definitions

  • the present disclosure relates to but is not limited to the technical field of image processing, and in particular, relates to a data generation method, an image processing method, a device, equipment, a storage medium, and a program product.
  • image processing technology With the development of image processing technology, the application of image processing technology in daily life is becoming more and more extensive. Among them, using image processing technology to process images or videos with special effects to present different special effects is becoming more and more popular. attract attention. For example, in application scenarios such as live broadcast or short video, it is possible to perform special effect processing on the image or video to present corresponding special effects, so as to enhance the performance of the image or video and improve the user's visual experience.
  • special effects that can be supported in application platforms such as live broadcast or short video in related technologies are usually relatively simple, and the diversity is insufficient, which cannot well meet user experience requirements.
  • the embodiments of the present disclosure provide a data generation and image processing method, device, device, storage medium, and program product.
  • an embodiment of the present disclosure provides a data generation method, the method comprising: acquiring a first part image, and based on the first part image, displaying at least one first part special effect to be edited on the first image Material; in response to the first special effect editing operation on the at least one first part special effect material, at least one first special effect display parameter is acquired; based on the at least one first special effect display parameter, a special effect data packet is generated; wherein , the special effect data package is used to present at least one corresponding to the at least one first part special effect material on the second image based on the at least one first special effect display parameter and the second part image under running conditions A second part special effect material; wherein, the second part image and the first part image include the same type of part.
  • an embodiment of the present disclosure provides an image processing method, the method comprising: acquiring a second image to be processed; in response to a special effect selection operation performed on the second image, based on the running special effect data package, determining At least one first special effect display parameter and a part to be identified; based on the part to be identified, a second part image is obtained from a fifth image; wherein the fifth image is the same as or related to the second image; Presenting at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
  • an embodiment of the present disclosure provides a data generation device, including: a first display module, configured to acquire a first part image, and display at least one to-be-edited part image on the first image based on the first part image First part special effect material; a first editing module, configured to acquire at least one first special effect display parameter in response to a first special effect editing operation performed on the at least one first part special effect material; a generating module, configured to obtain at least one first special effect display parameter based on the At least one first special effect display parameter to generate a special effect data package; wherein, the special effect data package is used to present on the second image based on the at least one first special effect display parameter and the second part image during operation At least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
  • an embodiment of the present disclosure provides an image processing device, including: a fourth acquisition module, configured to acquire a second image to be processed; a fifth acquisition module, configured to respond to the special effect performed on the second image
  • the selection operation is to determine at least one first special effect display parameter and the part to be identified based on the running special effect data package; the sixth acquisition module is used to acquire the image of the second part from the fifth image based on the part to be identified;
  • the fifth image is the same as or related to the second image;
  • the eighth display module is configured to display parameters based on the at least one first special effect and the second part image, in the second At least one second part special effect material is presented on the image.
  • an embodiment of the present disclosure provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the above method when executing the program .
  • the embodiments of the present disclosure provide a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are implemented.
  • an embodiment of the present disclosure provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, the above method is implemented in the steps.
  • the image of the first part is acquired, and based on the image of the first part, at least one special effect material of the first part to be edited is displayed on the first image.
  • Edit at least one first part special effect material on the first image and generate a special effect data package based on the acquired first special effect display parameters, so that when the special effect data package is running, based on the first special effect display parameters and the second part image, At least one second part special effect material corresponding to the first part special effect material is presented on the second image, so that the interest and diversity of the special effect effect can be improved, and the personalized customization of the special effect effect based on the part can be realized, thereby making it better Fully meet the user's special effects editing needs.
  • FIG. 1 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure
  • FIG. 4 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure
  • FIG. 5 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of an implementation flow of an image processing method provided by an embodiment of the present disclosure.
  • FIG. 7A is a schematic diagram of a presentation effect of a head special effect material provided by an embodiment of the present disclosure.
  • FIG. 7B is a schematic diagram of a presentation effect of a head special effect material provided by an embodiment of the present disclosure.
  • FIG. 7C is a schematic diagram of the presentation effect of a head special effect material provided by an embodiment of the present disclosure.
  • FIG. 7D is a schematic diagram of a special effect editing interface of a special effect editing tool provided by an embodiment of the present disclosure.
  • FIG. 8 is a schematic diagram of the composition and structure of a data generation device provided by an embodiment of the present disclosure.
  • FIG. 9 is a schematic diagram of the composition and structure of an image processing device provided by an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram of a hardware entity of a computer device provided by an embodiment of the present disclosure.
  • first”, “second” and so on are only used to distinguish similar objects, and do not represent a specific ordering of objects. It is understandable that “first”, “second” and so on are used in Where permitted, the specific order or sequence may be interchanged such that the disclosed embodiments can be practiced in other sequences than illustrated or described herein.
  • An embodiment of the present disclosure provides a method for generating data, which can be executed by a computer device, where the computer device can be, for example, a server, an intelligent traffic device, a camera, a network camera, a notebook computer, a tablet computer, a desktop computer, a smart TV, Set-top boxes, mobile devices (such as mobile phones, portable video players, personal digital assistants, dedicated messaging devices, portable game devices) and other suitable devices with data processing capabilities.
  • the method includes the following steps S101 to S103:
  • Step S101 acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image.
  • the first image is any suitable image for assisting in editing special effects, and may include a single image frame, or may include multiple image frames that are sequential in time sequence, and is not limited here.
  • those skilled in the art may select an appropriate image as the first image according to actual needs.
  • the first image may be defaulted by the system, imported by the user, or collected by the user in real time.
  • the first part image is any suitable image containing a specific part, and may include a single image frame, or may include a plurality of sequential image frames, which is not limited here.
  • the parts contained in the first part image can be human body parts, such as human head, hands, feet, arms, waist, etc., or body parts of other objects, such as cat's head, cat paws, cat tail , dog's head, dog's paw, dog's tail, etc.
  • the first part image can be a system default image containing a specific part (such as a system default human head image, a cat head image, a cat paw image or a dog tail image, etc.), or it can be a user-imported image from the Internet or in advance.
  • the image including the specific part acquired by the database may also be a sub-image including the specific part obtained by segmenting the first image or other images different from the first image in real time by the user.
  • the first part special effect material to be edited may be a special effect material generated based on the first part image and presenting parts included in the first part image.
  • the first part special effect material to be edited may be the head special effect material to be edited to present the head;
  • the first part of the special effect material to be edited may be a cat's paw special effect material to be edited to present the cat's paw;
  • the first part of the special effect material to be edited may be the dog tail special effect material to be edited to present the dog's tail.
  • one or more first part special effect materials to be edited can be displayed at any suitable position of the first image.
  • the way of displaying the first part special effect material to be edited on the first image may be the system default or the user's setting, which is not limited here.
  • step S102 at least one first special effect display parameter is acquired in response to a first special effect editing operation performed on at least one first part special effect material.
  • the first special effect editing operation may be an operation performed by the user to complete editing of the display effect of at least one first part special effect material according to actual needs, and may be a single operation or an operation group composed of a series of operations. Embodiments of the present disclosure do not limit this.
  • the user can edit the display effect for the at least one first part special effect material.
  • the first special effect display parameter is a display parameter corresponding to the display effect of at least one first part special effect material edited by the first special effect editing operation
  • at least one first special effect display parameter includes but not limited to at least one of the following: first part special effect material The number of each setting, the display position, display size, rotation angle, display state, trigger event, cycle display mode, etc. of each of at least one first part special effect material.
  • the obtained first special effect display parameter may include the set display position of the human head special effect material.
  • the obtained first special effect display parameter may include the set trigger event of the cat's paw special effect material.
  • At least one first part special effect material may be presented on the first image based on the first special effect display parameter.
  • at least one first part special effect material edited by the special effect editing operation may be presented on the first image.
  • the first special effect display parameters include the set display position and display size of the head special effect material of at least one person, the corresponding head special effects material.
  • Step S103 generating a special effect data package based on the at least one first special effect display parameter; wherein, the special effect data package is used to, in the case of running, based on the at least one first special effect display parameter and the second part image, At least one second part special effect material corresponding to the at least one first part special effect material is presented on the second image; wherein the second part image and the first part image contain the same type of parts.
  • the second image may be any suitable image to be subjected to special effect processing, may be a pre-collected offline image frame or video, or may be a real-time collected image frame or video, which is not limited here.
  • the second part image is any suitable image containing a specific part, and the specific part is of the same type as the part contained in the first part image.
  • the part contained in the first part image is a human head
  • the second part image The specific part included in the second part image is also a human head; in the case that the part included in the first part image is a cat's paw, the specific part included in the second part image is also a cat's paw.
  • the second part image may include a single image frame, or may include a plurality of sequential image frames, which is not limited here.
  • the parts contained in the second part image can be human body parts, such as human head, hands, feet, arms, waist, etc., or body parts of other objects, such as cat's head, cat paws, cat tail , dog's head, dog's paw, dog's tail, etc.
  • the second part image can be the system default image containing the specific part (such as the system default human head image, cat head image, cat paw image or dog tail image, etc.), and can also be a user-imported image from the Internet in advance.
  • the image including the specific part acquired by the database may also be a sub-image including the specific part that is segmented by the user from the second image or other images different from the second image in real time.
  • the second part special effect material may be a special effect material that presents parts contained in the second part image generated based on the second part image.
  • the second part special effect material presented on the second image corresponds to the first part special effect material, and the presentation effect of the second part special effect material on the second image is determined based on the first special effect display parameter.
  • the first part special effect material can be a head special effect material that presents the head, and the second part image is also a human head image.
  • the second part special effect material corresponding to the first part special effect material is the special effect material generated based on the second part image to present the human head included in the second part image;
  • the first part of the special effect material may be a cat's paw special effect material for presenting the cat's paw
  • the second part of the image is also an image containing a cat's paw, then the first part of the special effect material corresponding to the first part
  • the second part special effect material is a special effect material generated based on the second part image to present the cat's paw contained in the second part image.
  • the special effect data package may be a data package for rendering at least one part special effect material, and may include at least one first special effect display parameter and a part to be identified corresponding to the at least one part special effect material.
  • the special effect data package can be used in any suitable application platform, such as live broadcast platform, short video platform, camera application, etc.
  • the second part image can be obtained from the second image or other images different from the second image based on the corresponding part to be recognized, and the second part image includes the part corresponding to the part to be recognized part, and based on the corresponding first special effect display parameters and the acquired second part image, present at least one second part special effect material corresponding to the edited first part special effect material on the second image.
  • those skilled in the art may determine an appropriate special effect data package according to actual conditions and generate a special effect data package based on the first special effect display parameter in an appropriate manner, which is not limited here.
  • the special effect data package may be an executable file, including instructions for obtaining at least one first special effect display parameter included in the special effect data package and the part to be identified corresponding to the at least one first part special effect material,
  • the special effect data package is executed, at least one first special effect display parameter included in the special effect data package and a part to be identified corresponding to at least one first part special effect material can be obtained, and based on the acquired part to be recognized from
  • the second part image is acquired from the second image or other images different from the second image, and based on the acquired first special effect display parameters and the second part image, at least one corresponding to at least one first part special effect material is presented on the second image.
  • a second part special effects asset is provided.
  • the special effect data package may be a data resource package including at least one first special effect display parameter and a part to be identified corresponding to at least one first part special effect material
  • the application platform may use a specific software development kit ( Software Development Kit, SDK) or a specific program instruction to load the special effect data package, and analyze the special effect data package to obtain the corresponding first special effect display parameters and the part to be identified corresponding to at least one first part special effect material, Further, based on the obtained part to be recognized, the second part image is obtained from the second image or other images different from the second image, and based on the obtained first special effect display parameters and the second part image, the second part image is presented on the second image. At least one second part special effect material corresponding to the first part special effect material.
  • the image of the first part is obtained, and based on the image of the first part, at least one special effect material of the first part to be edited is displayed on the first image.
  • Edit at least one first part special effect material on an image and generate a special effect data package based on the acquired first special effect display parameters, so that when the special effect data package is running, based on the first special effect display parameters and the second part image, in At least one second part special effect material corresponding to the first part special effect material is presented on the second image, so that the interest and diversity of special effects can be improved, and the personalized customization of special effects based on parts can be realized, thereby better Meet the user's special effects editing needs.
  • the special effect editing interface for operations related to special effect editing and information display can be displayed on any suitable electronic device with interface interaction functions, such as a notebook computer, a mobile phone, a tablet computer, a handheld computer, A special effect editing interface is displayed on a personal digital assistant, a digital television, or a desktop computer, etc.
  • the electronic device displaying the special effect editing interface may be the same as or different from the computer device executing the data generation method, which is not limited here.
  • the computer device that executes the data generating method can be a notebook computer
  • the electronic device that displays the special effect editing interface can also be the notebook computer
  • the special effect editing interface can be an interactive interface of the client running on the notebook computer, or it can be the notebook computer.
  • a web page displayed in a browser running on a computer can be a server
  • the electronic device that displays the special effect editing interface can be a notebook computer
  • the special effect editing interface can be an interactive interface of a client running on the notebook computer, or it can be an interactive interface on the notebook computer.
  • the webpage displayed in the running browser, the laptop can access the server through the client or the browser.
  • the first image is a reference template image
  • displaying at least one first part special effect material to be edited on the first image based on the first part image in the above step S101 may include:
  • Step S111 based on the image of the first part, determine at least one special effect material of the first part to be edited;
  • At least one first part special effect material to be edited for presenting the parts contained in the first part image may be generated based on the first part image.
  • those skilled in the art may generate at least one first part special effect material to be edited based on the first part image in an appropriate manner according to actual special effect requirements, which is not limited here.
  • Step S112 displaying the reference template image and at least one first part special effect material in the editing operation area.
  • the editing operation area may be an area on the special effect editing interface for performing editing operations related to special effect editing.
  • the editing operation area may include an area for displaying and editing the reference template image and the first part special effect material.
  • the reference template image can be any suitable image used as a reference in the process of performing special effects editing related operations in the editing operation area, which can include but not limited to preset human face template images, cat face template images, dog face template images images or human body template images, etc.
  • a preset standard face template can be used as a reference template image, so that the user can refer to the standard face template to perform the first special effect editing operation on the face special effect material .
  • a preset standard human body template can be used as a reference template image, so that the user can refer to the standard human body template to perform the first special effect editing operation on the human body special effect material.
  • any suitable manner may be used to display the reference template image and at least one first part special effect material in the editing operation area according to the actual situation, which is not limited here.
  • the above step S102 may include: in response to the first special effect editing operation performed on the at least one first part special effect material on the parameter setting panel in the editing operation area and/or the reference template image, obtaining the first Effect display parameters.
  • the editing operation area may include a parameter setting panel for setting the display parameters of at least one first part special effect material, and/or a visual editing area for displaying and editing the reference template image and the first part special effect material .
  • the first special effect editing operation may include setting the display parameters of at least one first part special effect material on the parameter setting panel, and may also include performing operations on the first part special effect material to be edited on the reference template image. Position dragging, rotation, size scaling, click and other editing operations.
  • the first special effect display parameters include cycle display parameters of each of the first part special effect materials; the above method further includes: Step S104a, for each first part special effect material in at least one of the first part special effect materials, based on the cycle display parameters of the first part special effect material, cycle display on the preview image corresponding to the first part special effect material The third part of the special effects material.
  • the cycle display parameter of the first part special effect material is a parameter defining the cycle display process of the first part special effect material, which may include but not limited to one of the cycle display mode, cycle times, and cycle interval length of the first part special effect material. one or more species.
  • the first part special effect material may include at least one special effect animation frame
  • the cycle display parameters of the first part special effect material are parameters that define the cycle display process of each special effect animation frame in the first part special effect material, which may include but It is not limited to at least one special effect animation frame to be displayed in a loop, and one or more of the loop display mode, the number of loops, and the duration of the loop interval of the at least one special effect animation frame.
  • the cycle display setting operation may be an operation performed by the user to complete the setting of the cycle display parameters of the first part special effect material, and may be a single operation or an operation group composed of a series of operations.
  • the user may set appropriate cycle display parameters for at least one first part special effect material or at least one special effect animation frame of at least one first part special effect material according to actual conditions, which is not limited in this embodiment of the present disclosure.
  • the cycle display parameters of each first part special effect material may be acquired in response to an operation of setting a cycle display parameter of at least one first part special effect material on the parameter setting panel of the editing operation area and/or the reference template image.
  • the preview image is a single-frame image or a video composed of multiple-frame images for previewing the rendering effect of the edited first part special effect material.
  • the preview image can be displayed on the special effect editing interface.
  • the user may select an appropriate preview image according to actual conditions, which is not limited here.
  • the user can obtain a pre-captured preview image from a local, server, or cloud, or obtain a real-time captured preview image through a camera or network camera.
  • the third part special effect material corresponding to the first part special effect material may be displayed in a loop on the preview image.
  • the user can set the cycle display parameters for at least one first part special effect material according to the editing requirements, so that the first part special effect material can be displayed on the first image based on the cycle display parameters of the first part special effect material.
  • Circular display so that the diversity and interest of the special effects edited by the user can be further improved, so as to better meet the special effect editing needs of the user.
  • the first special effect display parameter includes a trigger event of each of the first part special effect materials.
  • the above method may further include: step S104b, for each first part special effect material in at least one of the first part special effect materials, based on a trigger event of the first part special effect material, presenting on the preview image The third part special effect material corresponding to one part special effect material.
  • the triggering event of the first part special effect material may be any suitable event for triggering the start or stop of presentation of the first part special effect material, which may include but not limited to based on time, number of image frames, image content of the image, and An event that is triggered by one or more types of information in relation to other special effects.
  • the trigger event may include at least one of the following: a time trigger event, an image frame trigger event, a screen trigger event, and an associated special effect trigger event.
  • the time trigger event may include, but not limited to, the current time, the presentation time of the first image, the presentation time of the first part special effect material, etc. when a set time condition is reached. For example, when the current time reaches the preset time, the first part of the special effect material is triggered to start presenting, the first part of the special effect material is triggered to start presenting after the first image is displayed for 5 seconds, and the first part of the special effect material is triggered to stop presenting after the first image is displayed for 10 seconds. After the first part of the special effect material is displayed for 8 seconds, the first part of the special effect material is triggered to stop presenting, etc.
  • the image frame trigger event may include but not limited to the current image frame of the first image, the number of times of loop playback of the first image, the current image frame of the first part special effect material, the number of loop playback of the first part special effect material, etc. meet the set conditions.
  • the first part special effect material when the current image frame of the first image is the second frame, the first part special effect material is triggered to start presenting, and when the current image frame of the first image is the last frame, the first part special effect material is triggered to stop presenting; the loop playback of the first image
  • the number of times is the 1st
  • the first part of the special effect material is triggered to start presenting
  • the number of loop playback of the first image is the 2nd time
  • the first part of the special effect material is triggered to stop
  • the current image frame of the first part of the special effect material is the last frame Trigger the first part of the special effect material to stop presenting
  • trigger the first part of the special effect material to stop presenting when the loop playback times of the first part of the special effect material reaches the 6th time, etc.
  • the screen trigger event may include, but not limited to, a screen content existence setting event of the first image.
  • a screen content existence setting event of the first image For example, when there is a human face in the screen content of the first image, it triggers the presentation of the first part special effect material; When there is a person or other animal shutting up in the content of the screen, the first part of the special effect material is triggered to stop presenting; when the content of the first image is blinking, the first part of the special effect material is triggered to start presenting; the screen content of the first image exists in the second In the case of 2 blinks, the first part of the special effect material is triggered to stop presenting, etc.
  • the associated special effect trigger event may include, but is not limited to, that in the first image, presentation of other special effects associated with the first part special effect material satisfies a set condition.
  • you can set the first part special effect material to be associated with the face deformation effect trigger the first part special effect material to start rendering when the face deformation effect starts to appear, and trigger the first part special effect material to stop rendering when the face deformation special effect stops rendering .
  • a trigger event can be set for the first part of the special effect material according to the actual editing requirements, so that the diversity and interest of the special effects edited by the user can be further improved, and the user's special effect editing requirements can be better met.
  • the at least one first part special effect material includes at least two first part special effect materials, and the above step S102 may include:
  • Step S121 obtaining at least one first special effect material combination in response to the combination operation on the at least two first part special effect materials;
  • Step S122 for each first special effect in the at least one first special effect material combination A material combination, in response to a combined special effect editing operation performed on the first special effect material combination, to obtain a third special effect display parameter of the first special effect material combination.
  • at least two first part special effect materials can be combined to obtain at least one first special effect material combination, and through combined special effect editing operations, multiple first part special effect materials in each first special effect material combination can be taken as a whole Perform special effect editing to obtain the third special effect display parameters of each first special effect material combination.
  • the third special effect display parameter of the first special effect material combination is a display parameter for presenting multiple first part special effect materials in the first special effect material combination as a whole, which may include but not limited to the overall display position of the first special effect material combination One or more of , rotation angle, display size, trigger event, cycle display mode, etc.
  • the above method may further include: step S105, for each first special effect material combination in the at least one first special effect material combination, based on the third special effect display parameter of the first special effect material combination, presenting on the preview image a A third special effect material combination corresponding to the first special effect material combination; the third special effect material combination includes at least two third part special effect materials corresponding to the first special effect material combination.
  • the third special effect material combination may be presented as a whole, so as to present a special effect preview effect corresponding to the edited first special effect material combination on the preview image .
  • the user can perform combined special effect editing operations on at least one first special effect material combination, so that the special effect effect edited by the user can be further improved.
  • the diversity and interest of the user can better meet the user's special effect editing needs, and can further improve the user's operation experience when editing special effects.
  • the above step S121 may include: step S131, in response to the special effect material selection operation performed in the editing operation area, selecting at least two first part special effect materials to be combined; step S132, in response to the Combining the selected at least two first part special effect materials to be combined to obtain at least one combined first special effect material combination.
  • the user can perform a special effect material selection operation on the parameter setting panel in the editing operation area and/or a reference template image, and perform a combination operation on at least two selected first part special effect materials to be combined to obtain at least one first part special effect material.
  • a combination of special effect materials may include: step S131, in response to the special effect material selection operation performed in the editing operation area, selecting at least two first part special effect materials to be combined; step S132, in response to the Combining the selected at least two first part special effect materials to be combined to obtain at least one combined first special effect material combination.
  • At least two first part special effect materials to be combined can be set on the parameter setting panel, and at least two first part special effect materials to be combined can be combined into at least one first special effect material combination; Select at least two first part special effect materials to be combined, and combine at least two first part special effect materials to be combined by clicking or dragging the position of the selected at least two first part special effect materials to be combined Combining at least one first special effect material.
  • at least one first combination of special effect materials can be acquired conveniently and quickly, thereby further improving the user's operating experience when editing special effects.
  • each of the at least one first part special effect material includes at least one key frame;
  • the first special effect editing operation includes a special effect material quantity setting operation and/or a frame parameter setting operation, and the at least one
  • the first special effect display parameter includes the quantity of the first part special effect material in the at least one first part special effect material and/or the key frame display parameter of each of the at least one first part special effect material.
  • Step S141 in response to the quantity setting operation performed on the first part special effect material in the at least one first part special effect material, acquire the quantity of the first part special effect material in the at least one first part special effect material;
  • the quantity setting operation may be an operation of inputting or selecting a quantity for each first part special effect material in the parameter setting panel, and the obtained input or selected quantity is the corresponding quantity of the first part special effect material;
  • the obtained copied quantity of each first part special effect material is the quantity of each first part special effect material.
  • Step S142 for each of the at least one first part special effect material, in response to the frame parameter setting operation performed on at least one key frame of the first part special effect material, acquire the key frame display of the first part special effect material parameter.
  • each first part special effect material has at least one key frame, and each key frame may correspond to a key frame time in the animation of the first part special effect material.
  • one or more special effect animation frames may be selected as key frames of the first part special effect material from at least one special effect animation frame of the first part special effect material in an appropriate manner according to the actual situation, which is not limited here.
  • the frame parameter setting operation may be an operation performed by the user to complete the display parameter setting of at least one key frame of the first part special effect material, and may be a single operation or an operation group composed of a series of operations.
  • the display parameters that can be set for key frames in the frame parameter setting operation can be determined according to actual conditions, which is not limited in this embodiment of the present disclosure.
  • the user can set the number of special effect materials and/or set the frame parameters for the key frame of at least one first part special effect material according to the editing requirements, so that the diversity and interest of the special effects edited by the user can be further improved It can better meet the user's special effects editing needs.
  • the key frame display parameters of the first part special effect material include display parameters of at least one key frame of the first part special effect material, and the display parameters of each key frame include at least one of the following: Visible state, display position, display size, rotation angle.
  • the user can flexibly set the display effect of each key frame of the first part special effect material based on different display parameters according to editing requirements, thereby further improving the diversity and interest of the special effect effect edited by the user. In order to better meet the user's special effect editing needs.
  • An embodiment of the present disclosure provides a method for generating data, and the method can be executed by a computer device. As shown in Figure 2, the method includes the following steps S201 to S204:
  • Step S201 in response to the part special effect addition operation performed on the first image in the editing operation area, the first part image is acquired from a third image; the third image is the same as or related to the first image .
  • any suitable special effect editing operation can be performed on the first image in the editing operation area, including but not limited to one or more of operations such as adding, editing, deleting, and display parameter setting of the first part special effect material.
  • the part special effect adding operation may be an operation performed by the user to add at least one first part special effect material to the first image, and may be a single operation or an operation group composed of a series of operations. limited.
  • the part special effect adding operation may be a click operation performed by the user in the editing operation area, or an operation instruction input by the user in the editing operation area, which is not limited in this embodiment of the present disclosure.
  • the third image is the same as or related to the first image, and the third image may include the first part image.
  • the user can determine the appropriate third image according to actual needs.
  • the third image can be the first image, or other images related to the first image, or superimposed special effects on the first image. effect image.
  • the third image related to the first image may be determined by the user according to the actual application scenario.
  • the "correlation" relationship between the two images may be preset, including but not limited to the following At least one aspect of association relationship: image content, image transmission path or transmission method, image processing method, and image processing result presentation method. This "related" relationship can be triggered or pre-established by user operations.
  • the first image can be the image frame of the current user's live video
  • the third image can be other users who interact with the current user through mic.
  • the first part image (such as head sub-image, hand sub-image, etc.) can be obtained from the other user's live video image frame, and based on the obtained first part image in the current user's At least one first part special effect material (such as head special effect material, hand special effect material, etc.) is presented in the live video (that is, the first image).
  • the first part image can be obtained from the third image, and at least one first part special effect material can be added to the first image based on the first part image.
  • any suitable manner may be used to obtain the first part image from the third image, which is not limited in this embodiment of the present disclosure.
  • the specific part in the third image can be segmented by an image segmentation algorithm to obtain the image of the first part; the third image can also be displayed in the image display area in the special effect editing interface, in response to the user's image processing of the third image
  • the image area selected by the user is acquired from the third image as the first part image.
  • Step S202 based on the first part image, display at least one first part special effect material to be edited on the first image.
  • Step S203 in response to a first special effect editing operation performed on at least one of the first part special effect materials, acquiring first special effect display parameters.
  • Step S204 based on the first special effect display parameters, generate a special effect data package; wherein, the special effect data package is used to, in the case of running, based on the first special effect display parameters and the second part image, in the second image Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
  • steps S202 to S204 correspond to the above-mentioned steps S101 to S103 respectively, and for implementation, reference may be made to the specific implementation manners of the above-mentioned steps S101 to S103.
  • the operation of adding a special effect to a part can be performed in a visual special effect editing interface, which is convenient for the user to operate, thereby improving the user's operation and use experience when editing the special effect.
  • the second part special effect material corresponding to the part in the third image can be presented on the second image, so that the diversity of special effects edited by the user can be further improved, and further Better meet the user's special effects editing needs.
  • the third image includes at least one image frame; the first part special effect material includes at least one special effect animation frame.
  • the acquisition of the first part image from the third image in the above step S201 may include: Step S211, acquiring the first part image from the current image frame of the third image.
  • the above step S202 may include: Step S212, based on the first part image, displaying on the first image at least one special effect animation frame of the first part special effect material to be edited.
  • the corresponding special effect animation frame can be displayed on the first image in real time, thereby further improving the diversity and variety of special effects edited by the user. interesting, so as to better meet the user's special effects editing needs.
  • An embodiment of the present disclosure provides a method for generating data, and the method can be executed by a computer device. As shown in Figure 3, the method includes the following steps S301 to S304:
  • Step S301 acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image.
  • step S302 at least one first special effect display parameter is acquired in response to a first special effect editing operation performed on at least one first part special effect material.
  • steps S301 to S302 correspond to the above-mentioned steps S101 to S102 respectively, and for implementation, reference may be made to the specific implementation manners of the above-mentioned steps S101 to S102.
  • Step S303 Present at least one third part special effect material corresponding to the at least one first part special effect material on the preview image based on the at least one first special effect display parameter.
  • the preview image is a single-frame image or a video composed of multiple frames for previewing the rendering effect of the edited first part special effect material.
  • the user can select an appropriate preview image according to the actual situation, which is not limited here.
  • a special effect preview area may be set in the special effect editing interface for displaying the preview image and the preview effect of the edited first part special effect material.
  • the user can obtain the pre-captured preview image from the local, the server, or the cloud, or obtain the preview image collected in real time through a camera or network camera, etc., which is not limited here.
  • At least one third part special effect material corresponding to the first part special effect material may be presented on the preview image.
  • Step S304 generating a special effect data package based on the first special effect display parameters; wherein, the special effect data package is used to, in the case of running, based on the first special effect display parameters and the second part image, in the second image Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
  • step S304 corresponds to the above-mentioned step S103, and for implementation, reference may be made to the specific implementation manner of the above-mentioned step S103.
  • the preview image may include one of the following: an imported single-frame image, an imported continuous image of at least two frames, a single-frame image collected in real time, or a continuous image of at least two frames collected in real time.
  • the imported single-frame image can be a pre-collected picture imported from the local, server, or cloud, etc.
  • the imported continuous at least two frames of images can be pre-collected images imported from the local, server, or cloud.
  • a single frame image or at least two consecutive frames of images collected in real time may be collected in real time by an image acquisition component.
  • the data generation method provided by the embodiments of the present disclosure can present the edited special effect in the preview image in real time during the process of the user editing the special effect, thereby effectively improving the user's operation experience when editing the special effect, and the user can based on
  • the real-time presentation of special effects adjusts and optimizes the special effect display parameters in real time, so as to better meet the user's special effect editing needs.
  • the above step S303 may include:
  • Step S311 in response to the special effect preview operation performed in the special effect preview area, obtain a third part image from the fourth image; wherein, the fourth image is the same as or related to the preview image, and the third part image is the same as said first part images contain parts of the same type;
  • the special effect preview operation can be performed in the special effect preview area.
  • the special effect preview operation can be any suitable operation to preview the rendering effect of the edited first part of the special effect material, such as clicking the preview button in the special effect preview area, expanding the special effect preview area, and opening the camera in the special effect preview area. One or more of operations, etc.
  • the third part image is any suitable image that contains the same type of part in the first part image.
  • the specific part contained in the third part image is also a person's head. head; in the case that the part contained in the first part image is a cat's paw, the specific part contained in the third part image is also a cat's paw.
  • the third part image may include a single image frame, or may include multiple image frames that are sequential in time sequence, which is not limited here.
  • the image of the third part can be the default image of the system (such as the default human head image, cat head image, cat paw image or dog tail image, etc.) etc., may also be a sub-image segmented by the user from the preview image or other images related to the preview image in real time.
  • the default image of the system such as the default human head image, cat head image, cat paw image or dog tail image, etc.
  • the image of the third part may also be a sub-image segmented by the user from the preview image or other images related to the preview image in real time.
  • the fourth image is the same as or related to the preview image, and the fourth image may include the third part image.
  • the user may determine an appropriate fourth image according to actual needs.
  • the fourth image may be a preview image, other images related to the preview image, or a preview image presenting a special effect.
  • the fourth image related to the preview image may be determined by the user according to an actual application scenario, which is not limited here.
  • any suitable manner may be used to acquire the third part image from the fourth image, which is not limited in this embodiment of the present disclosure.
  • the specific part in the fourth image can be segmented by an image segmentation algorithm to obtain the image of the third part; the fourth image can also be displayed in the special effect preview area, and in response to the user's image area selection operation on the fourth image, from The image area selected by the user is acquired in the fourth image as the third part image.
  • Step S312 based on the third part image and the at least one first special effect display parameter, present at least one third part special effect material corresponding to the at least one first part special effect material in the preview image in real time.
  • the third part special effect material may be a special effect material that presents parts included in the third part image and is generated based on the third part image.
  • the third part special effect material presented on the preview image corresponds to the first part special effect material, and the presentation effect of the third part special effect material on the preview image is determined based on the first special effect display parameter.
  • the first part special effect material can be a head special effect material that presents the head, and the third part image is also a human head image.
  • the third part special effect material corresponding to the first part special effect material is the special effect material generated based on the third part image to present the head of the person contained in the third part image;
  • the first part of the special effect material may be a cat's paw special effect material for presenting the cat's paw
  • the third part of the image is also an image containing a cat's paw, then the first part of the special effect material corresponding to the first part
  • the three-part special effect material is generated based on the third part image and presents the special effect material contained in the third part image.
  • the third part image can be obtained from the fourth image that is the same as or related to the preview image during the special effect preview, and can be presented on the preview image based on the third part image and the first special effect display parameters
  • the third part is the special effect material, so that the effect preview of the special effect editing operation can be realized quickly and accurately, and the user experience can be further improved.
  • An embodiment of the present disclosure provides a method for generating data, which can be executed by a computer device, as shown in FIG. 4 , including the following steps S401 to S406:
  • Step S401 acquiring at least one second special effect display parameter in response to a second special effect editing operation performed on the first image.
  • the second special effect editing operation may be any suitable special effect editing operation performed by the user on the first image according to actual needs, and may include but not limited to one of operations such as adding, editing, deleting, and display parameter setting of special effects.
  • One or more which is not limited in the embodiments of the present disclosure.
  • the first image is a human face image
  • one or more of a sticker adding operation, a sticker editing operation, a sticker deleting operation, a beauty makeup editing operation, a beauty setting operation, etc. may be performed on the human face image
  • the first image is a cat image
  • one or more of a sticker adding operation, a sticker editing operation, a sticker deleting operation, a filter setting operation, a background setting operation, etc. may be performed on the cat image
  • one or more of sticker addition operations, filter setting operations, background setting operations, foreground setting operations, and lens special effect setting operations can be performed on the building image.
  • the second special effect display parameter is the display parameter corresponding to the special effect edited by the second special effect editing operation, which may include but not limited to the special effect material in the special effect effect, the display parameters set for each special effect material, the trigger event of the special effect, etc. one or more of.
  • the obtained second special effect display parameter may be determined according to an actual special effect editing operation, which is not limited here.
  • the special effect editing operation is a beauty makeup editing operation on a face image
  • the obtained second special effect display parameters may include the set beauty makeup material and the display position, effect strength, material frame set for the beauty makeup material Rate, etc., based on the second special effect display parameter, the beauty makeup effect edited by the beauty makeup editing operation can be presented on the face image.
  • the obtained second special effect display parameters may include the added sticker material and the display position, display size, transparency, etc. set for the sticker material, based on the The second special effect display parameter can present the sticker effect added by the sticker adding operation on the cat image.
  • Step S402 Present a first special effect on the first image based on the at least one second special effect display parameter.
  • the first special effect edited by the special effect editing operation may be presented on the first image.
  • the first special effect may include at least one of the following: sticker special effects, beautification special effects, makeup special effects, background special effects, foreground special effects, and lens special effects.
  • Step S403 in response to the part special effect adding operation on the first image presenting the first special effect, acquiring a first part image from the first image presenting the first special effect.
  • the first part special effect material may be added to the first image presenting the first special effect.
  • the first part image can be obtained from the first image presenting the first special effect, and based on the first part image, at least A first part special effects material.
  • the first part image may be acquired from the first image presenting the first special effect in any suitable manner, which is not limited in this embodiment of the present disclosure.
  • an image segmentation algorithm may be used to segment a specific part in the first image presenting the first special effect to obtain an image of the first part; in response to the user's image region selection operation on the first image presenting the first special effect, The image area selected by the user is acquired from the first image presenting the first special effect as the first part image.
  • Step S404 based on the first part image, display at least one first part special effect material to be edited on the first image.
  • Step S405 acquiring a first special effect display parameter in response to a first special effect editing operation performed on at least one first part special effect material.
  • Step S406 based on the first special effect display parameters, generate a special effect data package; wherein, the special effect data package is used to, in the case of running, based on the first special effect display parameters and the second part image, in the second image Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
  • steps S404 to S406 respectively correspond to the above steps S101 to S103, and for implementation, reference may be made to the specific implementation manners of the above steps S101 to S103.
  • the data generation method provided by the embodiment of the present disclosure can add part special effect material to the first image on the basis of the first special effect, and obtain the first part image from the first image presenting the first special effect, so as to obtain the first part image in the first special effect
  • the first special effect material added to the image can be combined with the first special effect to further increase the variety and interest of the special effects edited by the user, and further satisfy the special effect editing needs of the user.
  • the part included in the first part image is a head
  • the at least one first part special effect material includes a head special effect material
  • the operation of adding a special effect to a part includes an operation of adding a special effect on a head.
  • a special effect includes a face beautification special effect.
  • Step S411 based on the first part image, display at least one head special effect material to be edited on the first image presenting the face beautification special effect; wherein, the at least one head special effect material to be edited The human face in each of them presents the human face beautification special effect.
  • the head special effect material is a special effect material generated based on a human head image.
  • Face beautification special effects are any suitable special effects for beautifying human faces, which may include but not limited to one or more of face sticker special effects, beautifying special effects, and cosmetic special effects.
  • the head special effect adding operation may be performed on the first image presenting the face beautification special effect, the first part image is obtained from the first image presenting the face beautification special effect, and based on the acquired first part image, the presenting At least one head special effect material to be edited is displayed on the first image of the face beautification special effect. Since the face beautification special effect will appear in the acquired first part image, the face beautification special effect may also be present in at least one head special effect material to be edited displayed on the first image.
  • the user can add at least one head special effect material on the first image, and the human face in each head special effect material can present the edited human face beautification special effect in the first image, so that in the first
  • the head special effect material added in the image can be combined with the edited face beautification special effect in the first image to further improve the diversity and interest of the special effects edited by the user, thereby better satisfying the special effect editing needs of the user.
  • An embodiment of the present disclosure provides a method for generating data, which can be executed by a computer device, as shown in FIG. 5 , including the following steps S501 to S505:
  • Step S501 acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image.
  • Step S502 in response to a first special effect editing operation performed on the at least one first part special effect material, to obtain a first special effect display parameter.
  • steps S501 to S502 correspond to the above-mentioned steps S101 to S102 respectively, and for implementation, reference may be made to the specific implementation manners of the above-mentioned steps S101 to S102.
  • Step S503 updating the at least one first special effect display parameter in response to the background setting operation on the at least one first part special effect material.
  • any suitable background special effect can be set for the at least one first part special effect material through the background setting operation performed on the at least one first part special effect material.
  • the set background display parameters of at least one first part special effect material may be added to the first special effect display parameters to obtain the updated first part special effect material.
  • a special effect display parameter may be added to the first special effect display parameters to obtain the updated first part special effect material.
  • Step S504 based on the updated at least one first special effect display parameter, display the set background on the preview image, and present on the preview image with the background the image corresponding to the at least one first part special effect material. At least one third-part special effects material.
  • Step S505 generating a special effect data package based on the first special effect display parameters; wherein, the special effect data package is used to display the first special effect parameters and the second part image in the second image during operation.
  • step S505 corresponds to the above-mentioned step S103, and during implementation, reference may be made to the specific implementation manner of the above-mentioned step S103.
  • the background setting operation may be performed on at least one first part special effect material, so as to display the set background on the preview image, and present at least one third part special effect material on the preview image with the background set, Therefore, the diversity and interest of the special effects edited by the user can be further improved, thereby better satisfying the special effect editing needs of the user.
  • An embodiment of the present disclosure provides an image processing method, which can be executed by a computer device, as shown in FIG. 6 , including the following steps S601 to S604:
  • Step S601 acquiring a second image to be processed.
  • the second image may be any suitable image to be subjected to special effect processing, may be a pre-collected offline image frame or video, or may be a real-time collected image frame or video, which is not limited here.
  • the second image can be a single image frame to be subjected to special effects processing or multiple image frames that are sequential in time sequence that are pre-shot, imported or collected by the user in any suitable application platform such as live broadcast or short video.
  • Step S602 in response to the special effect selection operation performed on the second image, based on the running special effect data package, determine at least one first special effect display parameter and a part to be recognized.
  • the special effect selection operation may be an operation for selecting a special effect data package for performing special effect processing on the second image, and may be a single operation or an operation group composed of a series of operations, which is not limited in this embodiment of the present disclosure.
  • the user can select a to-be-run special effect data package from a plurality of preset special effect data packages to perform special effect processing on the second image to be processed.
  • the special effect data package for performing special effect processing on the second image may be pre-generated by using any of the above-mentioned data generation methods, and the user may select an appropriate special effect data package to perform special effect processing on the second image through special effect selection operations according to actual needs .
  • the first special effect display parameters for presenting the part special effect material and the part to be identified corresponding to at least one part special effect material can be acquired.
  • the special effect data package may be an executable file, including instructions for obtaining the first special effect display parameters corresponding to the special effect data package and the position to be identified.
  • the instruction acquisition may be executed.
  • the special effect data package may be a data resource package containing first special effect display parameters and a part to be identified corresponding to at least one first part special effect material
  • the application platform may use a specific software development kit SDK or a specific
  • the program instruction loads the special effect data package, and analyzes the special effect data package to obtain the corresponding first special effect display parameters and the part to be identified corresponding to at least one first part special effect material.
  • Step S603 based on the part to be identified, acquire a second part image from a fifth image; wherein the fifth image is the same as or related to the second image.
  • the second part image may be any suitable image containing the part to be identified
  • the fifth image may be the same as or related to the second image
  • the fifth image may include the second part image.
  • the user may determine an appropriate fifth image according to actual needs.
  • the fifth image may be the second image, or other images related to the second image, or a second image that presents a special effect.
  • the fifth image related to the second image may be determined by the user according to the actual application scenario.
  • the second image may be the live video of the current user
  • the fifth image may be the live video of the current user.
  • the live video of other users of Lianmai Interactive can obtain the second part image (such as head sub-image, hand sub-image, etc.) from the other user's live video image frame, and based on the obtained second part image in the current At least one first part special effect material (such as head special effect material, hand special effect material, etc.) is presented in the user's live video (that is, the second image).
  • the second part image such as head sub-image, hand sub-image, etc.
  • At least one first part special effect material such as head special effect material, hand special effect material, etc.
  • a second part image By performing image segmentation processing on the part to be recognized in the fifth image, a second part image can be obtained, and at least one second part special effect material is added to the second image based on the second part image.
  • any suitable manner may be used to obtain the second part image from the fifth image, which is not limited in this embodiment of the present disclosure.
  • Step S604 Present at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
  • At least one second part special effect material corresponding to the second part image may be presented on the second image based on the acquired first special effect display parameter and the second part image. At least one second part special effect material presented on the second image is generated based on the second part image.
  • the second image to be processed is obtained; secondly, in response to the special effect selection operation performed on the second image, based on the running special effect data package, the first special effect display parameters and the to-be-processed display parameters are determined. Identify the part, and based on the part to be recognized, obtain the second part image from the fifth image, and finally, based on the first special effect display parameters and the second part image, present at least one second part special effect material on the second image .
  • special effect processing can be performed on the second image to be processed based on the obtained special effect data packet, so as to present at least one second part special effect material corresponding to the second part image on the second image, thereby improving the interestingness and performance of the special effect.
  • Diversity which can better meet the needs of users for special effects.
  • the embodiment of the present disclosure provides a special effect editing tool based on the data generation method provided above, which can realize the customized design of the part special effect material (which can be the aforementioned first part special effect material), and generate corresponding special effects Data package to realize custom part special effect materials.
  • Users of application platforms such as live broadcast, short video or camera can edit the parameter information of custom part special effect materials based on the special effect editing tool by using the obtained part images containing specific parts, and then generate corresponding special effects based on the edited parameter information Data package, special effect data package can be run in application platforms such as live broadcast, short video or camera, so as to provide users of the corresponding application platform with custom part special effect materials.
  • the special effect editing tool provided by the embodiment of the present disclosure can at least realize the following functions:
  • the key frame animation of the head special effect material can be defined, wherein, the same head special effect material can be used at different key frame times.
  • the display state of the corresponding key frame including defining whether the key frame is visible, defining the display position, display size, rotation angle, etc. of the key frame, and defining the cycle times of the key frame animation, etc.
  • a head special effect material 110 can be added to the image 100 , and the display size of the key frame in the head special effect material 110 is set to be larger than the size of the original head in the image 100 .
  • FIG. 7A a head special effect material 110 can be added to the image 100 , and the display size of the key frame in the head special effect material 110 is set to be larger than the size of the original head in the image 100 .
  • multiple head effect materials 120 can be added to the image 100, and different rotation angles and display positions can be set for each key frame of each head effect material, so that each head effect material can When the corresponding animation is played, a special effect in which multiple head special effect materials 120 move along multiple set display positions is presented on the image 100 .
  • each special effect combination can contain multiple head special effect materials, wherein, for each special effect combination, the head special effect materials contained in the special effect combination can be defined, and the special effect combination Define the display state of the keyframe corresponding to different keyframe times, including defining whether the keyframe is visible, defining the display position, display size, rotation angle, etc. of the keyframe, and defining the cycle times of the keyframe animation, etc.
  • the head special effects material with sticker special effects, makeup special effects, beauty special effects, etc., extracting head segmentation results from images with sticker special effects, makeup special effects or beauty special effects, etc., and based on the head
  • the segmentation results are used to edit the head special effect material.
  • the face sticker special effects, makeup special effects or beauty special effects set on the head in the original image will be presented synchronously in each head special effect material.
  • the head segmentation result can be extracted from the image 100 with the face sticker special effect 130 set, then based on the head segmentation result, it will also appear in the plurality of head special effect materials 120 added to the image 100
  • the face sticker has 130 special effects.
  • the hierarchical relationship between the sticker 140 and the head special effect material 150 can be defined, and the sticker 140 is set on the next layer of the head special effect material 150, As the background of the head segmentation result, the combination of the head segmentation result and the background sticker can be realized.
  • the special effect editing interface of the special effect editing tool includes a layer panel 10, a canvas panel 20, a parameter setting panel 30 and Special effect preview area 40 .
  • the layer panel 10 each layer in the special effect can be moved up and down, and the editing page of the head special effect material can be a layer; in the canvas panel 20, it can be displayed for assisting the editing of the head special effect material.
  • the template image, and the relevant materials of the edited head special effect material and can adjust the display state, display size, display position, etc.
  • the edited head effects material can be previewed in real time in the area.
  • the process of editing special effects may include the following steps S701 to S702:
  • Step S701 click Add head special effect material in the parameter setting panel to add a head special effect material to be edited in the canvas panel; wherein, at least one added head special effect material can be deleted by clicking the delete button.
  • Step S702 changing the display position, rotation angle, and display size of each key frame in the head effect material in the canvas panel.
  • the time when the head special effect material arrives at a specific position during presentation can be set by defining the display positions of key frames of different key frame times in the part special effect material.
  • triggering events such as opening mouth, blinking, shaking head, etc.
  • the image including the head collected in real time may correspond to the first image or the third image in the foregoing embodiment, and the foregoing head segmentation result may correspond to the first part image in the foregoing embodiment.
  • the embodiments of the present disclosure provide a data generating device, which includes each unit included, and each module included in each unit, which can be implemented by a processor in a computer device; of course, it can also be implemented by Concrete logic circuit implementation; in the process of implementation, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA).
  • the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA).
  • FIG. 8 is a schematic diagram of the composition and structure of a data generating device provided by an embodiment of the present disclosure.
  • the data generating device 800 includes: a first display module 810, a first editing module 820, and a generating module 830, wherein:
  • the first display module 810 is configured to acquire a first part image, and based on the first part image, display at least one first part special effect material to be edited on the first image;
  • the first editing module 820 is configured to acquire at least one first special effect display parameter in response to a first special effect editing operation performed on the at least one first part special effect material;
  • the generating module 830 is configured to generate a special effect data packet based on the at least one first special effect display parameter; wherein, the special effect data packet is used to generate a special effect data packet based on the at least one first special effect display parameter and the second A part image, presenting at least one second part special effect material corresponding to the at least one first part special effect material on the second image; wherein, the second part image and the first part image include the same type of part.
  • the first image is a reference template image; the first display module is further configured to: determine the at least one first part special effect material to be edited based on the first part image; The operation area displays the reference template image and the at least one first part special effect material.
  • the device further includes: a second display module, configured to present at least one first part special effect material corresponding to the at least one first part special effect material on the preview image based on the at least one first special effect display parameter.
  • a second display module configured to present at least one first part special effect material corresponding to the at least one first part special effect material on the preview image based on the at least one first special effect display parameter.
  • Three-part special effect material configured to present at least one first part special effect material corresponding to the at least one first part special effect material on the preview image based on the at least one first special effect display parameter.
  • the second display module is further configured to: acquire a third part image from a fourth image in response to a special effect preview operation performed in the special effect preview area; wherein, the fourth image is the same as the An image that is the same as or related to the preview image, the third part image contains the same type of part as the first part image; based on the third part image and the at least one first special effect display parameter, in the preview image present at least one third part special effect material corresponding to the at least one first part special effect material in real time.
  • the first display module is further configured to: acquire the first part image from a third image in response to a part special effect addition operation performed on the first image in the editing operation area; wherein, The third image is an image that is the same as or related to the first image.
  • the third image includes at least one image frame; the at least one first part special effect material includes at least one special effect animation frame; the first display module is further configured to: from the third image The image of the first part is acquired in the current image frame; the first display module is further configured to: based on the image of the first part, display a special effect animation of at least one special effect material of the first part to be edited on the first image frame.
  • each of the at least one first part special effect material includes at least one key frame;
  • the first special effect editing operation includes a special effect material quantity setting operation and/or a frame parameter setting operation, and the at least one The first special effect display parameters include the number of first part special effect materials in the at least one first part special effect material and/or the key frame display parameters of each of the at least one first part special effect materials;
  • the first The editing module is further configured to: acquire the quantity of the first part special effect material in the at least one first part special effect material in response to the quantity setting operation performed on the at least one first part special effect material; and/or, For each of the at least one first part special effect material, in response to the frame parameter setting operation performed on at least one key frame of the first part special effect material, acquiring key frame display parameters of the first part special effect material ;
  • the key frame display parameters of the first part special effect material include the display parameters of at least one key frame of the first part special effect material, and the display parameters of each key frame in the at least one key frame of the first part
  • the at least one first special effect display parameter includes a cycle display parameter of each of the at least one first part special effect material
  • the device also includes: a third display module, for each first part special effect material in the at least one first part special effect material, based on the cycle display parameters of the first part special effect material to cycle on the preview image The third part special effect material corresponding to the first part special effect material is displayed.
  • the at least one first special effect display parameter includes a trigger event for each of the at least one first part special effect material;
  • the device further includes: a fourth display module, for each first part special effect material in the at least one first part special effect material, based on a trigger event of the first part special effect material, presenting on the preview image the same The third part special effect material corresponding to the first part special effect material.
  • the at least one first part special effect material includes at least two first part special effect materials
  • the first editing module is further configured to: respond to the at least two first part special effect materials
  • the combination operation is to acquire at least one first special effect material combination; for each first special effect material combination in the at least one first special effect material combination, in response to the combined special effect editing operation performed on the first special effect material combination, acquire the The third special effect display parameter of the first special effect material combination;
  • the device further includes: a fifth display module, for each first special effect material combination in the at least one first special effect material combination, based on the first special effect
  • the third special effect display parameter of the material combination is to present a third special effect material combination corresponding to the first special effect material combination on the preview image; the third special effect material combination includes at least two second special effect material combinations corresponding to the first special effect material combination Three-part special effect material.
  • the first editing module is further configured to: select at least two of the at least two first part special effect materials in response to a special effect material selection operation performed in the editing operation area; The combination operation performed on the selected first part special effect material obtains at least one first special effect material combination.
  • the device further includes: a second acquisition module, configured to acquire at least one second special effect display parameter in response to a second special effect editing operation performed on the first image; a sixth display module, configured to Presenting a first special effect on the first image based on the at least one second special effect display parameter; the first display module is further configured to: respond to the first request for presenting the first special effect The part special effect adding operation performed on the image is to obtain the first part image from the first image presenting the first special effect.
  • the part included in the first part image is a head
  • the at least one first part special effect material includes a head special effect material
  • the operation of adding a special effect to a part includes an operation of adding a special effect on a head.
  • a special effect includes a human face beautification special effect;
  • the first display module is further configured to: based on the first part image, display at least one head to be edited on the first image presenting the human face beautification special effect Special effect material; wherein, the human face in each of the at least one head special effect material to be edited presents the human face beautification special effect.
  • the device further includes: an update module, configured to update the at least one first special effect display parameter in response to the background setting operation performed on the at least one first part special effect material; a seventh display module , for displaying the set background on the preview image based on the updated at least one first special effect display parameter, and presenting the at least one first part special effect material corresponding to the preview image on which the background is set. At least one third-part special effects material.
  • An embodiment of the present disclosure provides an image processing device, which includes each unit included and each module included in each unit, which can be realized by a processor in a computer device; of course, it can also be realized by a specific logic circuit;
  • the processor may be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA).
  • FIG. 9 is a schematic structural diagram of an image processing device provided by an embodiment of the present disclosure.
  • the image processing device 900 includes: a third acquisition module 910, a fourth acquisition module 920, a fifth acquisition module 930 and The eighth display module 940, wherein:
  • a third acquiring module 910 configured to acquire a second image to be processed
  • the fourth acquiring module 920 is configured to determine at least one first special effect display parameter and a part to be identified based on the running special effect data package in response to the special effect selection operation performed on the second image;
  • the fifth acquisition module 930 is configured to acquire a second part image from a fifth image based on the part to be identified; wherein the fifth image is an image that is the same as or related to the second image;
  • the eighth display module 940 is configured to present at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
  • This disclosure relates to the field of Augmented Reality (AR).
  • AR Augmented Reality
  • the target object may involve faces, limbs, gestures, actions, etc. related to the human body, or markers and markers related to objects, or sand tables, display areas or display items related to venues or places.
  • Vision-related algorithms can involve visual positioning, simultaneous localization and mapping (SLAM), 3D reconstruction, image registration, background segmentation, key point extraction and tracking of objects, object pose or depth detection, etc.
  • Specific applications can not only involve interactive scenes such as guided tours, navigation, explanations, reconstructions, virtual effect overlays and display related to real scenes or objects, but also special effects processing related to people, such as makeup beautification, body beautification, special effect display, virtual Interactive scenarios such as model display.
  • the relevant features, states and attributes of the target object can be detected or identified through the convolutional neural network.
  • the above-mentioned convolutional neural network is a network model obtained by performing model training based on a deep learning framework.
  • the above data generating method is implemented in the form of software function modules and sold or used as an independent product, it can also be stored in a computer-readable storage medium.
  • the essence of the technical solution of the embodiments of the present disclosure or the part that contributes to the related technology can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to make a
  • An electronic device (which may be a personal computer, a server, or a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure.
  • the aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read-only memory (Read Only Memory, ROM), magnetic disk or optical disk.
  • embodiments of the present disclosure are not limited to any specific combination of hardware and software.
  • an embodiment of the present disclosure provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the above method when executing the program.
  • an embodiment of the present disclosure provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are implemented.
  • an embodiment of the present disclosure provides a computer program product
  • the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, the above method can be implemented. A step of.
  • FIG. 10 is a schematic diagram of a hardware entity of a computer device in an embodiment of the present disclosure.
  • the hardware entity of the computer device 1000 includes: a processor 1001, a communication interface 1002, and a memory 1003, wherein,
  • Processor 1001 generally controls the overall operation of computer device 1000 .
  • the communication interface 1002 enables the computer device to communicate with other terminals or servers through the network.
  • the memory 1003 is configured to store instructions and applications executable by the processor 1001, and can also cache data to be processed or processed by the processor 1001 and various modules in the computer device 1000 (for example, image data, audio data, voice communication data and Video communication data) can be realized by flash memory (FLASH) or random access memory (Random Access Memory, RAM).
  • the disclosed devices and methods may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division.
  • the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed to multiple network units; Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may be used as a single unit, or two or more units may be integrated into one unit; the above-mentioned integration
  • the unit can be realized in the form of hardware or in the form of hardware plus software functional unit.
  • the above-mentioned integrated units of the present disclosure are realized in the form of software function modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.
  • the computer software products are stored in a storage medium, and include several instructions to make a
  • An electronic device which may be a personal computer, a server, or a network device, etc.
  • the aforementioned storage medium includes various media capable of storing program codes such as removable storage devices, ROMs, magnetic disks or optical disks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Disclosed in the present disclosure are a data generation method, an image processing method, apparatuses, a device, a storage medium, and a program product. The method comprises: acquiring a first part image, and on the basis of the first part image, displaying on a first image at least one first part special effect material to be edited; in response to a first special effect editing operation performed on at least one of the first part special effect material, acquiring a first special effect display parameter; on the basis of the first special effect display parameter, generating a special effect data packet; wherein the special effect data packet is used for, when operating, on the basis of the first special effect display parameter and a second part image, presenting on a second image at least one second part special effect material corresponding to the first part special effect material; wherein the second part image and the first part image comprise a same type part.

Description

数据生成方法、图像处理方法、装置、设备及存储介质Data generation method, image processing method, device, equipment and storage medium
相关申请的交叉引用Cross References to Related Applications
本申请要求在2021年8月31日提交至中国专利局、申请号为202111016566X的中国专利申请的优先权,其全部内容通过引用结合在本公开中。This application claims priority to a Chinese patent application with application number 202111016566X filed with the China Patent Office on August 31, 2021, the entire contents of which are hereby incorporated by reference into this disclosure.
技术领域technical field
本公开涉及但不限于图像处理技术领域,尤其涉及一种数据生成方法、图像处理方法、装置、设备、存储介质及程序产品。The present disclosure relates to but is not limited to the technical field of image processing, and in particular, relates to a data generation method, an image processing method, a device, equipment, a storage medium, and a program product.
背景技术Background technique
随着图像处理技术的发展,在日常生活中对图像处理技术的应用也越来越广泛,其中,利用图像处理技术对图像或视频进行特效处理,以呈现不同的特效效果,更是越来越引人关注。例如,在直播或短视频等应用场景下,可以通过对图像或视频进行特效处理以呈现相应的特效效果,来增强图像或视频的表现效果,提高用户的视觉体验。但是,相关技术中直播或短视频等应用平台中能够支持的特效效果通常较为简单,且多样性不足,无法很好地满足用户的体验需求。With the development of image processing technology, the application of image processing technology in daily life is becoming more and more extensive. Among them, using image processing technology to process images or videos with special effects to present different special effects is becoming more and more popular. attract attention. For example, in application scenarios such as live broadcast or short video, it is possible to perform special effect processing on the image or video to present corresponding special effects, so as to enhance the performance of the image or video and improve the user's visual experience. However, the special effects that can be supported in application platforms such as live broadcast or short video in related technologies are usually relatively simple, and the diversity is insufficient, which cannot well meet user experience requirements.
发明内容Contents of the invention
有鉴于此,本公开实施例提供一种数据生成和图像处理的方法、装置、设备、存储介质及程序产品。In view of this, the embodiments of the present disclosure provide a data generation and image processing method, device, device, storage medium, and program product.
第一方面,本公开实施例提供一种数据生成方法,所述方法包括:获取第一部位图像,并基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材;响应于对所述至少一个所述第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数;基于所述至少一个第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述至少一个第一特效显示参数和第二部位图像,在第二图像上呈现与所述至少一个第一部位特效素材对应的至少一个第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。In a first aspect, an embodiment of the present disclosure provides a data generation method, the method comprising: acquiring a first part image, and based on the first part image, displaying at least one first part special effect to be edited on the first image Material; in response to the first special effect editing operation on the at least one first part special effect material, at least one first special effect display parameter is acquired; based on the at least one first special effect display parameter, a special effect data packet is generated; wherein , the special effect data package is used to present at least one corresponding to the at least one first part special effect material on the second image based on the at least one first special effect display parameter and the second part image under running conditions A second part special effect material; wherein, the second part image and the first part image include the same type of part.
第二方面,本公开实施例提供一种图像处理方法,所述方法包括:获取待处理的第二图像;响应于对所述第二图像进行的特效选择操作,基于运行的特效数据包,确定至少一个第一特效显示参数和待识别的部位;基于所述待识别的部位,从第五图像中获取第二部位图像;其中,所述第五图像是与第二图像相同或相关的图像;基于所述至少一个第一特效显示参数和所述第二部位图像,在所述第二图像上呈现至少一个第二部位特效素材。In a second aspect, an embodiment of the present disclosure provides an image processing method, the method comprising: acquiring a second image to be processed; in response to a special effect selection operation performed on the second image, based on the running special effect data package, determining At least one first special effect display parameter and a part to be identified; based on the part to be identified, a second part image is obtained from a fifth image; wherein the fifth image is the same as or related to the second image; Presenting at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
第三方面,本公开实施例提供一种数据生成装置,包括:第一显示模块,用于获取第一部位图像,并基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材;第一编辑模块,用于响应于对所述至少一个第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数;生成模块,用于基于所述至少一个第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述至少一个第一特效显示参数和第二部位图像,在第二图像上呈现与所述第一部位特效素材对应的至少一个第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。In a third aspect, an embodiment of the present disclosure provides a data generation device, including: a first display module, configured to acquire a first part image, and display at least one to-be-edited part image on the first image based on the first part image First part special effect material; a first editing module, configured to acquire at least one first special effect display parameter in response to a first special effect editing operation performed on the at least one first part special effect material; a generating module, configured to obtain at least one first special effect display parameter based on the At least one first special effect display parameter to generate a special effect data package; wherein, the special effect data package is used to present on the second image based on the at least one first special effect display parameter and the second part image during operation At least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
第四方面,本公开实施例提供一种图像处理装置,包括:第四获取模块,用于获取待处理的第二图像;第五获取模块,用于响应于对所述第二图像进行的特效选择操作,基于运行的特效数据包,确定至少一个第一特效显示参数和待识别的部位;第六获取模块,用于基于所述待识别的部位,从第五图像中获取第二部位图像;其中,所述第五图像是与所述第二图像相同或相关的图像;第八显示模块,用于基于所述至少一个第一特效显示参数和所述第二部位图像,在所述第二图像上呈现至少一个第二部位特效素材。In a fourth aspect, an embodiment of the present disclosure provides an image processing device, including: a fourth acquisition module, configured to acquire a second image to be processed; a fifth acquisition module, configured to respond to the special effect performed on the second image The selection operation is to determine at least one first special effect display parameter and the part to be identified based on the running special effect data package; the sixth acquisition module is used to acquire the image of the second part from the fifth image based on the part to be identified; Wherein, the fifth image is the same as or related to the second image; the eighth display module is configured to display parameters based on the at least one first special effect and the second part image, in the second At least one second part special effect material is presented on the image.
第五方面,本公开实施例提供一种计算机设备,包括存储器和处理器,所述存储器存储有可在处理器上运行的计算机程序,所述处理器执行所述程序时实现上述方法中的步骤。In a fifth aspect, an embodiment of the present disclosure provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the above method when executing the program .
第六方面,本公开实施例提供一种计算机存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述方法中的步骤。In a sixth aspect, the embodiments of the present disclosure provide a computer storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are implemented.
第七方面,本公开实施例提供一种计算机程序产品,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,所述计算机程序被计算机读取并执行时,实现上述方法中的步骤。In a seventh aspect, an embodiment of the present disclosure provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, the above method is implemented in the steps.
本公开实施例中,首先,获取第一部位图像,并基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材,这样,可以由用户根据实际特效编辑需求,在第一图像上编辑至少一个第一部位特效素材,并基于获取的第一特效显示参数生成特效数据包,以在该特效数据包运行的情况下,基于第一特效显示参数和第二部位图像,在第二图像上呈现至少一个与第一部位特效素材对应的第二部位特效素材,从而可以提高特效效果的趣味性和多样性,并能实现基于部位的 特效效果的个性化定制,进而更好地满足用户的特效编辑需求。In the embodiment of the present disclosure, firstly, the image of the first part is acquired, and based on the image of the first part, at least one special effect material of the first part to be edited is displayed on the first image. Edit at least one first part special effect material on the first image, and generate a special effect data package based on the acquired first special effect display parameters, so that when the special effect data package is running, based on the first special effect display parameters and the second part image, At least one second part special effect material corresponding to the first part special effect material is presented on the second image, so that the interest and diversity of the special effect effect can be improved, and the personalized customization of the special effect effect based on the part can be realized, thereby making it better Fully meet the user's special effects editing needs.
附图说明Description of drawings
图1为本公开实施例提供的一种数据生成方法的实现流程示意图;FIG. 1 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure;
图2为本公开实施例提供的一种数据生成方法的实现流程示意图;FIG. 2 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure;
图3为本公开实施例提供的一种数据生成方法的实现流程示意图;FIG. 3 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure;
图4为本公开实施例提供的一种数据生成方法的实现流程示意图;FIG. 4 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure;
图5为本公开实施例提供的一种数据生成方法的实现流程示意图;FIG. 5 is a schematic diagram of an implementation flow of a data generation method provided by an embodiment of the present disclosure;
图6为本公开实施例提供的一种图像处理方法的实现流程示意图;FIG. 6 is a schematic diagram of an implementation flow of an image processing method provided by an embodiment of the present disclosure;
图7A为本公开实施例提供的一种头部特效素材的呈现效果示意图;FIG. 7A is a schematic diagram of a presentation effect of a head special effect material provided by an embodiment of the present disclosure;
图7B为本公开实施例提供的一种头部特效素材的呈现效果示意图;FIG. 7B is a schematic diagram of a presentation effect of a head special effect material provided by an embodiment of the present disclosure;
图7C为本公开实施例提供的一种头部特效素材的呈现效果示意图;FIG. 7C is a schematic diagram of the presentation effect of a head special effect material provided by an embodiment of the present disclosure;
图7D为本公开实施例提供的一种特效编辑工具的特效编辑界面的示意图;FIG. 7D is a schematic diagram of a special effect editing interface of a special effect editing tool provided by an embodiment of the present disclosure;
图8为本公开实施例提供的一种数据生成装置的组成结构示意图;FIG. 8 is a schematic diagram of the composition and structure of a data generation device provided by an embodiment of the present disclosure;
图9为本公开实施例提供的一种图像处理装置的组成结构示意图;FIG. 9 is a schematic diagram of the composition and structure of an image processing device provided by an embodiment of the present disclosure;
图10为本公开实施例提供的一种计算机设备的硬件实体示意图。FIG. 10 is a schematic diagram of a hardware entity of a computer device provided by an embodiment of the present disclosure.
具体实施方式Detailed ways
为了使本公开的目的、技术方案和优点更加清楚,下面结合附图和实施例对本公开的技术方案进一步详细阐述,所描述的实施例不应视为对本公开的限制,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本公开保护的范围。In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the technical solutions of the present disclosure will be further elaborated below in conjunction with the accompanying drawings and embodiments, and the described embodiments should not be regarded as limiting the present disclosure. All other embodiments obtained under the premise of no creative work belong to the protection scope of the present disclosure.
在以下的描述中,涉及到“一些实施例”,其描述了所有可能实施例的子集,但是可以理解,“一些实施例”可以是所有可能实施例的相同子集或不同子集,并且可以在不冲突的情况下相互结合。In the following description, references to "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.
在以下的描述中,所涉及的术语“第一”、“第二”等仅仅是区别类似的对象,不代表针对对象的特定排序,可以理解地,“第一”、“第二”等在允许的情况下可以互换特定的顺序或先后次序,以使本公开实施例能够以除了在这里图示或描述的以外的顺序实施。In the following description, the terms "first", "second" and so on are only used to distinguish similar objects, and do not represent a specific ordering of objects. It is understandable that "first", "second" and so on are used in Where permitted, the specific order or sequence may be interchanged such that the disclosed embodiments can be practiced in other sequences than illustrated or described herein.
除非另有定义,本文所使用的所有的技术和科学术语与本领域技术人员通常理解的含义相同。本文中所使用的术语只是为了描述本公开的目的,不是旨在限制本公开。Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terms used herein are for the purpose of describing the present disclosure only, and are not intended to limit the present disclosure.
本公开实施例提供一种数据生成方法,该方法可以由计算机设备执行,其中,计算机设备可以为如服务器、智能通行设备、抓拍机、网络摄像机、笔记本电脑、平板电脑、台式计算机、智能电视、机顶盒、移动设备(例如移动电话、便携式视频播放器、个人数字助理、专用消息设备、便携式游戏设备)等任意合适的具备数据处理能力的设备。如图1所示,该方法包括如下步骤S101至步骤S103:An embodiment of the present disclosure provides a method for generating data, which can be executed by a computer device, where the computer device can be, for example, a server, an intelligent traffic device, a camera, a network camera, a notebook computer, a tablet computer, a desktop computer, a smart TV, Set-top boxes, mobile devices (such as mobile phones, portable video players, personal digital assistants, dedicated messaging devices, portable game devices) and other suitable devices with data processing capabilities. As shown in Figure 1, the method includes the following steps S101 to S103:
步骤S101,获取第一部位图像,并基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材。Step S101, acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image.
这里,第一图像为用于辅助进行特效效果编辑的任意合适的图像,可以包括单个图像帧,也可以包括时序上连续的多个图像帧,这里并不限定。在实施时,本领域技术人员可以根据实际需求选择合适的图像作为第一图像。例如,第一图像可以是系统默认的,也可以是用户导入的,还可以是用户实时采集的。Here, the first image is any suitable image for assisting in editing special effects, and may include a single image frame, or may include multiple image frames that are sequential in time sequence, and is not limited here. During implementation, those skilled in the art may select an appropriate image as the first image according to actual needs. For example, the first image may be defaulted by the system, imported by the user, or collected by the user in real time.
第一部位图像为任意合适的包含特定部位的图像,可以包括单个图像帧,也可以包括时序上连续的多个图像帧,这里并不限定。第一部位图像中包含的部位可以是人体部位,如人的头部、手部、脚部、胳膊、腰部等,也可以是其他对象的身体部位,如猫的头部、猫爪、猫尾巴、狗的头部、狗爪、狗尾巴等。在实施时,第一部位图像可以是系统默认的包含特定部位的图像(如系统默认的人头图像、猫头图像、猫爪图像或狗尾巴图像等),也可以是用户导入的预先从互联网或数据库获取的包含特定部位的图像等,还可以是用户实时从第一图像或与第一图像不同的其他图像中分割得到的包含特定部位的子图像等。The first part image is any suitable image containing a specific part, and may include a single image frame, or may include a plurality of sequential image frames, which is not limited here. The parts contained in the first part image can be human body parts, such as human head, hands, feet, arms, waist, etc., or body parts of other objects, such as cat's head, cat paws, cat tail , dog's head, dog's paw, dog's tail, etc. During implementation, the first part image can be a system default image containing a specific part (such as a system default human head image, a cat head image, a cat paw image or a dog tail image, etc.), or it can be a user-imported image from the Internet or in advance. The image including the specific part acquired by the database may also be a sub-image including the specific part obtained by segmenting the first image or other images different from the first image in real time by the user.
待编辑的第一部位特效素材可以为基于第一部位图像生成的,对第一部位图像中包含的部位进行呈现的特效素材。例如,在第一部位图像为包含人的头部的图像的情况下,待编辑的第一部位特效素材可以为待进行编辑的对该头部进行呈现的头部特效素材;在第一部位图像为包含猫爪的图像的情况下,待编辑的第一部位特效素材可以为待进行编辑的对该猫爪进行呈现的猫爪特效素材;在第一部位图像为包含狗尾巴的图像的情况下,待编辑的第一部位特效素材可以为待进行编辑的对该狗尾巴进行呈现的狗尾巴特效素材。The first part special effect material to be edited may be a special effect material generated based on the first part image and presenting parts included in the first part image. For example, when the first part image is an image containing a human head, the first part special effect material to be edited may be the head special effect material to be edited to present the head; In the case of an image containing a cat's paw, the first part of the special effect material to be edited may be a cat's paw special effect material to be edited to present the cat's paw; in the case of an image containing a dog's tail in the first part of the image , the first part of the special effect material to be edited may be the dog tail special effect material to be edited to present the dog's tail.
基于第一部位图像,可以在第一图像的任意合适的位置处显示一个或多个待编辑的第一部位特效素材。在第一图像上对待编辑的第一部位特效素材进行显示的方式可以是系统默认的,也可 以是用户设定的,这里并不限定。Based on the first part image, one or more first part special effect materials to be edited can be displayed at any suitable position of the first image. The way of displaying the first part special effect material to be edited on the first image may be the system default or the user's setting, which is not limited here.
步骤S102,响应于对至少一个所述第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数。In step S102, at least one first special effect display parameter is acquired in response to a first special effect editing operation performed on at least one first part special effect material.
这里,第一特效编辑操作可以是用户根据实际需求,为完成对至少一个第一部位特效素材的显示效果的编辑而进行的操作,可以是单个操作也可以是一系列操作共同组成的操作组,本公开实施例对此并不限定。通过对至少一个第一部位特效第一进行第一特效编辑操作,用户可以为该至少一个第一部位特效素材进行显示效果的编辑。Here, the first special effect editing operation may be an operation performed by the user to complete editing of the display effect of at least one first part special effect material according to actual needs, and may be a single operation or an operation group composed of a series of operations. Embodiments of the present disclosure do not limit this. By performing the first special effect editing operation on the at least one first part special effect first, the user can edit the display effect for the at least one first part special effect material.
第一特效显示参数为第一特效编辑操作所编辑的至少一个第一部位特效素材的显示效果对应的显示参数,至少一个第一特效显示参数包括但不限于以下至少一种:第一部位特效素材的数量、至少一个第一部位特效素材中的每一个设置的显示位置、显示大小、旋转角度、显示状态、触发事件、循环显示方式等。通过对至少一个第一部位特效素材进行第一特效编辑操作,用户可以为该至少一个第一部位特效素材进行显示效果的编辑,从而确定第一特效显示参数。在实施时,获取的第一特效显示参数可以根据实际进行的第一特效编辑操作来确定,这里并不限定。例如,在第一特效编辑操作为对人的头部特效素材的显示位置进行设置的操作的情况下,获取的第一特效显示参数可以包括设置的人的头部特效素材的显示位置。又如,在第一特效编辑操作为对猫爪特效素材的触发事件进行设置的操作的情况下,获取的第一特效显示参数可以包括设置的猫爪特效素材的触发事件。The first special effect display parameter is a display parameter corresponding to the display effect of at least one first part special effect material edited by the first special effect editing operation, and at least one first special effect display parameter includes but not limited to at least one of the following: first part special effect material The number of each setting, the display position, display size, rotation angle, display state, trigger event, cycle display mode, etc. of each of at least one first part special effect material. By performing the first special effect editing operation on the at least one first part special effect material, the user can edit the display effect for the at least one first part special effect material, so as to determine the first special effect display parameter. During implementation, the acquired first special effect display parameters may be determined according to the actual editing operation of the first special effect, which is not limited here. For example, when the first special effect editing operation is an operation of setting the display position of the human head special effect material, the obtained first special effect display parameter may include the set display position of the human head special effect material. For another example, when the first special effect editing operation is an operation of setting a trigger event of a cat's paw special effect material, the obtained first special effect display parameter may include the set trigger event of the cat's paw special effect material.
在一些实施例中,在获取第一特效显示参数后,可以基于第一特效显示参数,在第一图像上呈现至少一个第一部位特效素材。这里,基于获取的第一特效显示参数,可以在第一图像上呈现特效编辑操作所编辑的至少一个第一部位特效素材。例如,在第一特效显示参数包括设置的至少一个人的头部特效素材的显示位置和显示大小的情况下,可以按照每一头部特效素材的显示位置和显示大小在第一图像上呈现相应的头部特效素材。In some embodiments, after the first special effect display parameter is acquired, at least one first part special effect material may be presented on the first image based on the first special effect display parameter. Here, based on the acquired first special effect display parameters, at least one first part special effect material edited by the special effect editing operation may be presented on the first image. For example, when the first special effect display parameters include the set display position and display size of the head special effect material of at least one person, the corresponding head special effects material.
步骤S103,基于所述至少一个第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述至少一个第一特效显示参数和第二部位图像,在第二图像上呈现与所述至少一个第一部位特效素材对应的至少一个第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。Step S103, generating a special effect data package based on the at least one first special effect display parameter; wherein, the special effect data package is used to, in the case of running, based on the at least one first special effect display parameter and the second part image, At least one second part special effect material corresponding to the at least one first part special effect material is presented on the second image; wherein the second part image and the first part image contain the same type of parts.
这里,第二图像可以是任意合适的待进行特效处理的图像,可以是预先采集的离线图像帧或视频,也可以是实时采集的图像帧或视频,这里并不限定。Here, the second image may be any suitable image to be subjected to special effect processing, may be a pre-collected offline image frame or video, or may be a real-time collected image frame or video, which is not limited here.
第二部位图像为任意合适的包含特定部位的图像,该特定部位与第一部位图像所包含的部位的类型相同,例如,在第一部位图像所包含的部位为人的头部的情况下,第二部位图像包含的特定部位也为人的头部;在第一部位图像所包含的部位为猫爪的情况下,第二部位图像包含的特定部位也为猫爪。第二部位图像可以包括单个图像帧,也可以包括时序上连续的多个图像帧,这里并不限定。第二部位图像中包含的部位可以是人体部位,如人的头部、手部、脚部、胳膊、腰部等,也可以是其他对象的身体部位,如猫的头部、猫爪、猫尾巴、狗的头部、狗爪、狗尾巴等。在实施时,第二部位图像可以是系统默认的包含该特定部位的图像(如系统默认的人头图像、猫头图像、猫爪图像或狗尾巴图像等),也可以是用户导入的预先从互联网或数据库获取的包含该特定部位的图像等,还可以是用户实时从第二图像或与第二图像不同的其他图像中分割得到的包含该特定部位的子图像等。The second part image is any suitable image containing a specific part, and the specific part is of the same type as the part contained in the first part image. For example, when the part contained in the first part image is a human head, the second part image The specific part included in the second part image is also a human head; in the case that the part included in the first part image is a cat's paw, the specific part included in the second part image is also a cat's paw. The second part image may include a single image frame, or may include a plurality of sequential image frames, which is not limited here. The parts contained in the second part image can be human body parts, such as human head, hands, feet, arms, waist, etc., or body parts of other objects, such as cat's head, cat paws, cat tail , dog's head, dog's paw, dog's tail, etc. During implementation, the second part image can be the system default image containing the specific part (such as the system default human head image, cat head image, cat paw image or dog tail image, etc.), and can also be a user-imported image from the Internet in advance. Or the image including the specific part acquired by the database may also be a sub-image including the specific part that is segmented by the user from the second image or other images different from the second image in real time.
第二部位特效素材可以是基于第二部位图像生成的对第二部位图像中包含的部位进行呈现的特效素材。第二图像上呈现的第二部位特效素材与第一部位特效素材是对应的,且该第二部位特效素材在第二图像上的呈现效果是基于第一特效显示参数确定的。例如,在第一部位图像为包含人的头部的图像的情况下,第一部位特效素材可以为对该头部进行呈现的头部特效素材,第二部位图像也为包含人的头部的图像,则与该第一部位特效素材对应的第二部位特效素材为基于第二部位图像生成的对第二部位图像中包含的人的头部进行呈现的特效素材;在第一部位图像为包含猫爪的图像的情况下,第一部位特效素材可以为对该猫爪进行呈现的猫爪特效素材,第二部位图像也为包含猫爪的图像,则与该第一部位特效素材对应的第二部位特效素材为基于第二部位图像生成的对第二部位图像中包含的猫爪进行呈现的特效素材。The second part special effect material may be a special effect material that presents parts contained in the second part image generated based on the second part image. The second part special effect material presented on the second image corresponds to the first part special effect material, and the presentation effect of the second part special effect material on the second image is determined based on the first special effect display parameter. For example, when the first part image is an image containing a human head, the first part special effect material can be a head special effect material that presents the head, and the second part image is also a human head image. image, the second part special effect material corresponding to the first part special effect material is the special effect material generated based on the second part image to present the human head included in the second part image; In the case of an image of a cat's paw, the first part of the special effect material may be a cat's paw special effect material for presenting the cat's paw, and the second part of the image is also an image containing a cat's paw, then the first part of the special effect material corresponding to the first part The second part special effect material is a special effect material generated based on the second part image to present the cat's paw contained in the second part image.
特效数据包可以是用于渲染至少一个部位特效素材的数据包,可以包括至少一个第一特效显示参数以及与至少一个部位特效素材对应的待识别的部位。特效数据包可以用于任意合适的应用平台中,如直播平台、短视频平台、相机应用等。特效数据包在运行的情况下,可以基于相应的待识别的部位从第二图像或与第二图像不同的其他图像中获取第二部位图像,该第二部位图像包括与待识别的部位对应的部位,并基于相应的第一特效显示参数和获取的第二部位图像,在第二图像上呈现至少一个与编辑的第一部位特效素材对应的第二部位特效素材。在实施时,本领域技术人员可以根据实际情况确定合适的特效数据包并采用合适的方式基于第一特效显示参数生成特效数据包, 这里并不限定。The special effect data package may be a data package for rendering at least one part special effect material, and may include at least one first special effect display parameter and a part to be identified corresponding to the at least one part special effect material. The special effect data package can be used in any suitable application platform, such as live broadcast platform, short video platform, camera application, etc. When the special effect data package is running, the second part image can be obtained from the second image or other images different from the second image based on the corresponding part to be recognized, and the second part image includes the part corresponding to the part to be recognized part, and based on the corresponding first special effect display parameters and the acquired second part image, present at least one second part special effect material corresponding to the edited first part special effect material on the second image. During implementation, those skilled in the art may determine an appropriate special effect data package according to actual conditions and generate a special effect data package based on the first special effect display parameter in an appropriate manner, which is not limited here.
在一些实施例中,特效数据包可以是可执行文件,包括用于获取特效数据包中包括的至少一个第一特效显示参数以及与至少一个第一部位特效素材对应的待识别的部位的指令,在特效数据包被执行的情况下,可以获取特效数据包中包括的至少一个第一特效显示参数以及与至少一个第一部位特效素材对应的待识别的部位,并基于获取的待识别的部位从第二图像或与第二图像不同的其他图像中获取第二部位图像,基于获取的第一特效显示参数和第二部位图像,在第二图像上呈现与至少一个第一部位特效素材对应的至少一个第二部位特效素材。In some embodiments, the special effect data package may be an executable file, including instructions for obtaining at least one first special effect display parameter included in the special effect data package and the part to be identified corresponding to the at least one first part special effect material, When the special effect data package is executed, at least one first special effect display parameter included in the special effect data package and a part to be identified corresponding to at least one first part special effect material can be obtained, and based on the acquired part to be recognized from The second part image is acquired from the second image or other images different from the second image, and based on the acquired first special effect display parameters and the second part image, at least one corresponding to at least one first part special effect material is presented on the second image. A second part special effects asset.
在一些实施例中,特效数据包可以是包含至少一个第一特效显示参数和与至少一个第一部位特效素材对应的待识别的部位的数据资源包,应用平台可以通过特定的软件开发工具包(Software Development Kit,SDK)或特定的程序指令加载该特效数据包,并对该特效数据包进行解析,得到相应的第一特效显示参数以及与至少一个第一部位特效素材对应的待识别的部位,进而基于得到的待识别的部位从第二图像或与第二图像不同的其他图像中获取第二部位图像,并基于获取的第一特效显示参数和第二部位图像,在第二图像上呈现与第一部位特效素材对应的至少一个第二部位特效素材。In some embodiments, the special effect data package may be a data resource package including at least one first special effect display parameter and a part to be identified corresponding to at least one first part special effect material, and the application platform may use a specific software development kit ( Software Development Kit, SDK) or a specific program instruction to load the special effect data package, and analyze the special effect data package to obtain the corresponding first special effect display parameters and the part to be identified corresponding to at least one first part special effect material, Further, based on the obtained part to be recognized, the second part image is obtained from the second image or other images different from the second image, and based on the obtained first special effect display parameters and the second part image, the second part image is presented on the second image. At least one second part special effect material corresponding to the first part special effect material.
本公开实施例中,首先,获取第一部位图像,并基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材,这样,用户可以根据实际特效编辑需求,在第一图像上编辑至少一个第一部位特效素材,并基于获取的第一特效显示参数生成特效数据包,以在该特效数据包运行的情况下,基于第一特效显示参数和第二部位图像,在第二图像上呈现至少一个与第一部位特效素材对应的第二部位特效素材,从而可以提高特效效果的趣味性和多样性,并能实现基于部位的特效效果的个性化定制,进而更好地满足用户的特效编辑需求。In the embodiment of the present disclosure, firstly, the image of the first part is obtained, and based on the image of the first part, at least one special effect material of the first part to be edited is displayed on the first image. Edit at least one first part special effect material on an image, and generate a special effect data package based on the acquired first special effect display parameters, so that when the special effect data package is running, based on the first special effect display parameters and the second part image, in At least one second part special effect material corresponding to the first part special effect material is presented on the second image, so that the interest and diversity of special effects can be improved, and the personalized customization of special effects based on parts can be realized, thereby better Meet the user's special effects editing needs.
在一些实施例中,可以在任意合适的具有界面交互功能的电子设备上显示用于进行特效编辑相关的操作及信息展示的特效编辑界面,比如可以在笔记本电脑、手机、平板电脑、掌上电脑、个人数字助理、数字电视或台式计算机等上显示特效编辑界面。在实施时,显示特效编辑界面的电子设备与执行该数据生成方法的计算机设备可以是相同的,也可以是不同的,这里并不限定。例如,执行该数据生成方法的计算机设备可以为笔记本电脑,显示特效编辑界面的电子设备也可以为该笔记本电脑,特效编辑界面可以为该笔记本电脑上运行的客户端的交互界面,也可以是该笔记本电脑上运行的浏览器中显示的网页。又如,执行该数据生成方法的计算机设备可以为服务器,显示特效编辑界面的电子设备可以为笔记本电脑,特效编辑界面可以为该笔记本电脑上运行的客户端的交互界面,也可以是该笔记本电脑上运行的浏览器中显示的网页,该笔记本电脑可以通过该客户端或者浏览器访问该服务器。In some embodiments, the special effect editing interface for operations related to special effect editing and information display can be displayed on any suitable electronic device with interface interaction functions, such as a notebook computer, a mobile phone, a tablet computer, a handheld computer, A special effect editing interface is displayed on a personal digital assistant, a digital television, or a desktop computer, etc. During implementation, the electronic device displaying the special effect editing interface may be the same as or different from the computer device executing the data generation method, which is not limited here. For example, the computer device that executes the data generating method can be a notebook computer, the electronic device that displays the special effect editing interface can also be the notebook computer, and the special effect editing interface can be an interactive interface of the client running on the notebook computer, or it can be the notebook computer. A web page displayed in a browser running on a computer. For another example, the computer device that executes the data generation method can be a server, the electronic device that displays the special effect editing interface can be a notebook computer, and the special effect editing interface can be an interactive interface of a client running on the notebook computer, or it can be an interactive interface on the notebook computer. The webpage displayed in the running browser, the laptop can access the server through the client or the browser.
在一些实施例中,第一图像为参考模板图像;上述步骤S101中所述的基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材,可以包括:In some embodiments, the first image is a reference template image; displaying at least one first part special effect material to be edited on the first image based on the first part image in the above step S101 may include:
步骤S111,基于第一部位图像,确定至少一个待编辑的第一部位特效素材;Step S111, based on the image of the first part, determine at least one special effect material of the first part to be edited;
这里,可以基于第一部位图像生成至少一个用于对第一部位图像中包含的部位进行呈现的待编辑的第一部位特效素材。在实施时,本领域技术人员可以根据实际特效需求采用合适的方式基于第一部位图像生成至少一个待编辑的第一部位特效素材,这里并不限定。Here, at least one first part special effect material to be edited for presenting the parts contained in the first part image may be generated based on the first part image. During implementation, those skilled in the art may generate at least one first part special effect material to be edited based on the first part image in an appropriate manner according to actual special effect requirements, which is not limited here.
步骤S112,在编辑操作区域显示所述参考模板图像和至少一个所述第一部位特效素材。Step S112, displaying the reference template image and at least one first part special effect material in the editing operation area.
这里,编辑操作区域可以为特效编辑界面上用于进行特效编辑相关的编辑操作的区域。编辑操作区域可以包括用于对参考模板图像以及第一部位特效素材进行展示和编辑的区域。Here, the editing operation area may be an area on the special effect editing interface for performing editing operations related to special effect editing. The editing operation area may include an area for displaying and editing the reference template image and the first part special effect material.
参考模板图像可以是用于在编辑操作区域进行特效编辑相关的操作的过程中作为参照的任意合适的图像,可以包括但不限于预先设定的人脸模板图像、猫脸模板图像、狗脸模板图像或人体模板图像等。例如,对于人脸特效素材的第一特效编辑操作,可以采用预先设定的标准人脸模板作为参考模板图像,以便于用户参考该标准人脸模板进行针对人脸特效素材的第一特效编辑操作。又如,对于针对人体特效素材的第一特效编辑操作,可以采用预先设定的标准人体模板作为参考模板图像,以便于用户参考该标准人体模板进行针对人体特效素材的第一特效编辑操作。在实施时,可以根据实际情况采用任意合适的方式在编辑操作区域显示参考模板图像和至少一个第一部位特效素材,这里并不限定。The reference template image can be any suitable image used as a reference in the process of performing special effects editing related operations in the editing operation area, which can include but not limited to preset human face template images, cat face template images, dog face template images images or human body template images, etc. For example, for the first special effect editing operation of the face special effect material, a preset standard face template can be used as a reference template image, so that the user can refer to the standard face template to perform the first special effect editing operation on the face special effect material . For another example, for the first special effect editing operation on the human body special effect material, a preset standard human body template can be used as a reference template image, so that the user can refer to the standard human body template to perform the first special effect editing operation on the human body special effect material. During implementation, any suitable manner may be used to display the reference template image and at least one first part special effect material in the editing operation area according to the actual situation, which is not limited here.
在一些实施例中,上述步骤S102可以包括:响应于在编辑操作区域的参数设置面板和/或参考模板图像上对至少一个所述第一部位特效素材进行的第一特效编辑操作,获取第一特效显示参数。这里,编辑操作区域可以包括用于对至少一个第一部位特效素材的显示参数进行设置的参数设置面板,和/或用于对参考模板图像以及第一部位特效素材进行展示和编辑的可视化编辑区域。在实施时,第一特效编辑操作可以包括在参数设置面板上对至少一个第一部位特效素材的显示参数进行设置的操作,也可以包括在参考模板图像上对待编辑的第一部位特效素材进行的位置拖拉、旋转、 尺寸缩放、点击等编辑操作。In some embodiments, the above step S102 may include: in response to the first special effect editing operation performed on the at least one first part special effect material on the parameter setting panel in the editing operation area and/or the reference template image, obtaining the first Effect display parameters. Here, the editing operation area may include a parameter setting panel for setting the display parameters of at least one first part special effect material, and/or a visual editing area for displaying and editing the reference template image and the first part special effect material . During implementation, the first special effect editing operation may include setting the display parameters of at least one first part special effect material on the parameter setting panel, and may also include performing operations on the first part special effect material to be edited on the reference template image. Position dragging, rotation, size scaling, click and other editing operations.
在一些实施例中,在所述第一特效编辑操作包括循环显示设置操作的情况下,所述第一特效显示参数包括每一所述第一部位特效素材的循环显示参数;上述方法还包括:步骤S104a,针对至少一个所述第一部位特效素材中的每一第一部位特效素材,基于所述第一部位特效素材的循环显示参数在预览图像上循环显示与所述第一部位特效素材对应的第三部位特效素材。In some embodiments, when the first special effect editing operation includes a cycle display setting operation, the first special effect display parameters include cycle display parameters of each of the first part special effect materials; the above method further includes: Step S104a, for each first part special effect material in at least one of the first part special effect materials, based on the cycle display parameters of the first part special effect material, cycle display on the preview image corresponding to the first part special effect material The third part of the special effects material.
这里,第一部位特效素材的循环显示参数为定义第一部位特效素材的循环显示过程的参数,可以包括但不限于第一部位特效素材的循环显示方式、循环次数、循环间隔时长等中的一种或多种。在一些实施方式中,第一部位特效素材可以包括至少一个特效动画帧,第一部位特效素材的循环显示参数为定义第一部位特效素材中各特效动画帧的循环显示过程的参数,可以包括但不限于进行循环显示的至少一个特效动画帧,以及至少一个特效动画帧的循环显示方式、循环次数、循环间隔时长等中的一种或多种。Here, the cycle display parameter of the first part special effect material is a parameter defining the cycle display process of the first part special effect material, which may include but not limited to one of the cycle display mode, cycle times, and cycle interval length of the first part special effect material. one or more species. In some implementations, the first part special effect material may include at least one special effect animation frame, and the cycle display parameters of the first part special effect material are parameters that define the cycle display process of each special effect animation frame in the first part special effect material, which may include but It is not limited to at least one special effect animation frame to be displayed in a loop, and one or more of the loop display mode, the number of loops, and the duration of the loop interval of the at least one special effect animation frame.
循环显示设置操作可以是用户为完成第一部位特效素材的循环显示参数的设置而进行的操作,可以是单个操作也可以是一系列操作共同组成的操作组。在实施时,用户可以根据实际情况为至少一个第一部位特效素材或至少一个第一部位特效素材的至少一个特效动画帧设置合适的循环显示参数,本公开实施例对此并不限定。例如,可以响应于在编辑操作区域的参数设置面板和/或参考模板图像上对至少一个第一部位特效素材的循环显示参数进行设置的操作,获取每一第一部位特效素材的循环显示参数。The cycle display setting operation may be an operation performed by the user to complete the setting of the cycle display parameters of the first part special effect material, and may be a single operation or an operation group composed of a series of operations. During implementation, the user may set appropriate cycle display parameters for at least one first part special effect material or at least one special effect animation frame of at least one first part special effect material according to actual conditions, which is not limited in this embodiment of the present disclosure. For example, the cycle display parameters of each first part special effect material may be acquired in response to an operation of setting a cycle display parameter of at least one first part special effect material on the parameter setting panel of the editing operation area and/or the reference template image.
预览图像为用于对编辑的第一部位特效素材的呈现效果进行预览的单帧图像或者多帧图像组成的视频。预览图像可以在特效编辑界面上进行展示。在实施时,用户可以根据实际情况选择合适的预览图像,这里并不限定。例如,用户可以从本地、服务器或云端等处获取预先采集的预览图像,也可以通过摄像头或网络摄像机等获取实时采集的预览图像。基于获取的第一部位特效素材的循环显示参数,可以在预览图像上循环显示与该第一部位特效素材对应的第三部位特效素材。The preview image is a single-frame image or a video composed of multiple-frame images for previewing the rendering effect of the edited first part special effect material. The preview image can be displayed on the special effect editing interface. During implementation, the user may select an appropriate preview image according to actual conditions, which is not limited here. For example, the user can obtain a pre-captured preview image from a local, server, or cloud, or obtain a real-time captured preview image through a camera or network camera. Based on the acquired circular display parameters of the first part special effect material, the third part special effect material corresponding to the first part special effect material may be displayed in a loop on the preview image.
在上述实施例中,用户可以根据编辑需求,为至少一个第一部位特效素材设置循环显示参数,以在第一图像上基于该第一部位特效素材的循环显示参数对该第一部位特效素材进行循环显示,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above-mentioned embodiment, the user can set the cycle display parameters for at least one first part special effect material according to the editing requirements, so that the first part special effect material can be displayed on the first image based on the cycle display parameters of the first part special effect material. Circular display, so that the diversity and interest of the special effects edited by the user can be further improved, so as to better meet the special effect editing needs of the user.
在一些实施例中,在所述第一特效编辑操作包括触发事件编辑操作的情况下,所述第一特效显示参数包括每一所述第一部位特效素材的触发事件。上述方法还可以包括:步骤S104b,针对至少一个所述第一部位特效素材中的每一第一部位特效素材,基于所述第一部位特效素材的触发事件,在预览图像上呈现与所述第一部位特效素材对应的第三部位特效素材。In some embodiments, when the first special effect editing operation includes a trigger event editing operation, the first special effect display parameter includes a trigger event of each of the first part special effect materials. The above method may further include: step S104b, for each first part special effect material in at least one of the first part special effect materials, based on a trigger event of the first part special effect material, presenting on the preview image The third part special effect material corresponding to one part special effect material.
这里,第一部位特效素材的触发事件可以是任意合适的用于触发该第一部位特效素材开始或停止呈现的事件,可以包括但不限于基于时间、图像帧数、图像的画面内容、以及与其他特效效果的关联性等中的一种或多种信息进行触发的事件。Here, the triggering event of the first part special effect material may be any suitable event for triggering the start or stop of presentation of the first part special effect material, which may include but not limited to based on time, number of image frames, image content of the image, and An event that is triggered by one or more types of information in relation to other special effects.
在一些实施例中,触发事件可以包括以下至少之一:时间触发事件、图像帧触发事件、画面触发事件、关联特效触发事件。In some embodiments, the trigger event may include at least one of the following: a time trigger event, an image frame trigger event, a screen trigger event, and an associated special effect trigger event.
时间触发事件可以包括但不限于当前时间、第一图像的展示时间、第一部位特效素材的呈现时间等达到设定的时间条件。例如,当前时间达到预设时间时触发第一部位特效素材开始呈现,第一图像展示5秒后触发第一部位特效素材开始呈现,第一图像展示10秒后触发第一部位特效素材停止呈现,第一部位特效素材呈现8秒后触发第一部位特效素材停止呈现等。The time trigger event may include, but not limited to, the current time, the presentation time of the first image, the presentation time of the first part special effect material, etc. when a set time condition is reached. For example, when the current time reaches the preset time, the first part of the special effect material is triggered to start presenting, the first part of the special effect material is triggered to start presenting after the first image is displayed for 5 seconds, and the first part of the special effect material is triggered to stop presenting after the first image is displayed for 10 seconds. After the first part of the special effect material is displayed for 8 seconds, the first part of the special effect material is triggered to stop presenting, etc.
图像帧触发事件可以包括但不限于第一图像的当前图像帧、第一图像的循环播放次数、第一部位特效素材的当前图像帧、第一部位特效素材的循环播放次数等达到设定条件。例如,第一图像的当前图像帧为第2帧时触发第一部位特效素材开始呈现,第一图像的当前图像帧为最后一帧时触发第一部位特效素材停止呈现;第一图像的循环播放次数为第1次时触发第一部位特效素材开始呈现,第一图像的循环播放次数为第2次时触发第一部位特效素材停止呈现;第一部位特效素材的当前图像帧为最后一帧时触发第一部位特效素材停止呈现;第一部位特效素材的循环播放次数为第6次时触发第一部位特效素材停止呈现等。The image frame trigger event may include but not limited to the current image frame of the first image, the number of times of loop playback of the first image, the current image frame of the first part special effect material, the number of loop playback of the first part special effect material, etc. meet the set conditions. For example, when the current image frame of the first image is the second frame, the first part special effect material is triggered to start presenting, and when the current image frame of the first image is the last frame, the first part special effect material is triggered to stop presenting; the loop playback of the first image When the number of times is the 1st, the first part of the special effect material is triggered to start presenting; when the number of loop playback of the first image is the 2nd time, the first part of the special effect material is triggered to stop; when the current image frame of the first part of the special effect material is the last frame Trigger the first part of the special effect material to stop presenting; trigger the first part of the special effect material to stop presenting when the loop playback times of the first part of the special effect material reaches the 6th time, etc.
画面触发事件可以包括但不限于第一图像的画面内容存在设定事件。例如,第一图像的画面内容存在人脸的情况下触发第一部位特效素材开始呈现;第一图像的画面内容存在人或其他动物张嘴的情况下触发第一部位特效素材开始呈现,第一图像的画面内容存在人或其他动物闭嘴的情况下触发第一部位特效素材停止呈现;第一图像的画面内容存在眨眼的情况下触发第一部位特效素材开始呈现;第一图像的画面内容存在第2次眨眼的情况下触发第一部位特效素材停止呈现等。The screen trigger event may include, but not limited to, a screen content existence setting event of the first image. For example, when there is a human face in the screen content of the first image, it triggers the presentation of the first part special effect material; When there is a person or other animal shutting up in the content of the screen, the first part of the special effect material is triggered to stop presenting; when the content of the first image is blinking, the first part of the special effect material is triggered to start presenting; the screen content of the first image exists in the second In the case of 2 blinks, the first part of the special effect material is triggered to stop presenting, etc.
关联特效触发事件可以包括但不限于第一图像中,与第一部位特效素材关联的其他特效效果的呈现满足设定条件。例如,可以设置第一部位特效素材与脸部变形特效关联,可以在脸部变形特效开始呈现时触发第一部位特效素材开始呈现,在脸部变形特效停止呈现时触发第一部位特效素 材停止呈现。又如,可以设置第一部位特效素材开始呈现与滤镜特效关联,可以在滤镜特效开始呈现时触发第一部位特效素材开始呈现。The associated special effect trigger event may include, but is not limited to, that in the first image, presentation of other special effects associated with the first part special effect material satisfies a set condition. For example, you can set the first part special effect material to be associated with the face deformation effect, trigger the first part special effect material to start rendering when the face deformation effect starts to appear, and trigger the first part special effect material to stop rendering when the face deformation special effect stops rendering . For another example, it can be set that the first part of the special effect material starts to be presented and associated with the filter special effect, and the first part of the special effect material can be triggered to start to appear when the filter special effect starts to be presented.
在上述实施例中,可以根据实际编辑需求为第一部位特效素材设置触发事件,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above embodiment, a trigger event can be set for the first part of the special effect material according to the actual editing requirements, so that the diversity and interest of the special effects edited by the user can be further improved, and the user's special effect editing requirements can be better met.
在一些实施例中,所述至少一个第一部位特效素材包括至少两个第一部位特效素材,上述步骤S102可以包括:In some embodiments, the at least one first part special effect material includes at least two first part special effect materials, and the above step S102 may include:
步骤S121,响应于对所述至少两个第一部位特效素材进行的组合操作,获取至少一个第一特效素材组合;步骤S122,针对所述至少一个第一特效素材组合中的每一个第一特效素材组合,响应于对该第一特效素材组合进行的组合特效编辑操作,获取该第一特效素材组合的第三特效显示参数。这里,可以对至少两个第一部位特效素材进行组合,得到至少一个第一特效素材组合,并通过组合特效编辑操作,将每一第一特效素材组合中的多个第一部位特效素材作为整体进行特效编辑,得到每一第一特效素材组合的第三特效显示参数。第一特效素材组合的第三特效显示参数为将第一特效素材组合中的多个第一部位特效素材作为整体进行呈现的显示参数,可以包括但不限于该第一特效素材组合整体的显示位置、旋转角度、显示大小、触发事件、循环显示方式等中的一种或多种。Step S121, obtaining at least one first special effect material combination in response to the combination operation on the at least two first part special effect materials; Step S122, for each first special effect in the at least one first special effect material combination A material combination, in response to a combined special effect editing operation performed on the first special effect material combination, to obtain a third special effect display parameter of the first special effect material combination. Here, at least two first part special effect materials can be combined to obtain at least one first special effect material combination, and through combined special effect editing operations, multiple first part special effect materials in each first special effect material combination can be taken as a whole Perform special effect editing to obtain the third special effect display parameters of each first special effect material combination. The third special effect display parameter of the first special effect material combination is a display parameter for presenting multiple first part special effect materials in the first special effect material combination as a whole, which may include but not limited to the overall display position of the first special effect material combination One or more of , rotation angle, display size, trigger event, cycle display mode, etc.
上述方法还可以包括:步骤S105,针对所述至少一个第一特效素材组合中的每一第一特效素材组合,基于该第一特效素材组合的第三特效显示参数,在预览图像上呈现与该第一特效素材组合对应的第三特效素材组合;所述第三特效素材组合包括与该第一特效素材组合对应的至少两个第三部位特效素材。这里,可以基于第三特效显示参数,将第三特效素材组合中的至少两个第三部位特效素材作为整体进行呈现,以在预览图像上呈现与编辑的第一特效素材组合对应的特效预览效果。The above method may further include: step S105, for each first special effect material combination in the at least one first special effect material combination, based on the third special effect display parameter of the first special effect material combination, presenting on the preview image a A third special effect material combination corresponding to the first special effect material combination; the third special effect material combination includes at least two third part special effect materials corresponding to the first special effect material combination. Here, based on the third special effect display parameter, at least two third part special effect materials in the third special effect material combination may be presented as a whole, so as to present a special effect preview effect corresponding to the edited first special effect material combination on the preview image .
在上述实施例中,通过将至少两个第一部位特效素材作为至少一个第一特效素材组合,用户可以对至少一个第一特效素材组合进行组合特效编辑操作,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求,并能进一步提高用户在进行特效编辑时的操作使用体验。In the above embodiment, by using at least two first part special effect materials as at least one first special effect material combination, the user can perform combined special effect editing operations on at least one first special effect material combination, so that the special effect effect edited by the user can be further improved. The diversity and interest of the user can better meet the user's special effect editing needs, and can further improve the user's operation experience when editing special effects.
在一些实施方式中,上述步骤S121可以包括:步骤S131,响应于在编辑操作区域进行的特效素材选择操作,选定至少两个待组合的第一部位特效素材;步骤S132,响应于对所述选定的至少两个待组合的第一部位特效素材进行的组合操作,获取组合后的至少一个第一特效素材组合。这里,用户可以在编辑操作区域的参数设置面板和/或参考模板图像上进行特效素材选择操作,以及对选定的至少两个待组合的第一部位特效素材进行的组合操作,得到至少一个第一特效素材组合。例如,可以在参数设置面板上设置至少两个待组合的第一部位特效素材,并将至少两个待组合的第一部位特效素材组合为至少一个第一特效素材组合;也可以在参考模板图像上选中至少两个待组合的第一部位特效素材,并通过对选中的至少两个待组合的第一部位特效素材的点击或位置拖拉操作,将至少两个待组合的第一部位特效素材组合为至少一个第一特效素材组合。这样,可以方便快速地获取至少一个第一特效素材组合,从而可以进一步提高用户在进行特效编辑时的操作使用体验。In some embodiments, the above step S121 may include: step S131, in response to the special effect material selection operation performed in the editing operation area, selecting at least two first part special effect materials to be combined; step S132, in response to the Combining the selected at least two first part special effect materials to be combined to obtain at least one combined first special effect material combination. Here, the user can perform a special effect material selection operation on the parameter setting panel in the editing operation area and/or a reference template image, and perform a combination operation on at least two selected first part special effect materials to be combined to obtain at least one first part special effect material. A combination of special effect materials. For example, at least two first part special effect materials to be combined can be set on the parameter setting panel, and at least two first part special effect materials to be combined can be combined into at least one first special effect material combination; Select at least two first part special effect materials to be combined, and combine at least two first part special effect materials to be combined by clicking or dragging the position of the selected at least two first part special effect materials to be combined Combining at least one first special effect material. In this way, at least one first combination of special effect materials can be acquired conveniently and quickly, thereby further improving the user's operating experience when editing special effects.
在一些实施例中,所述至少一个第一部位特效素材中的每一个包括至少一个关键帧;所述第一特效编辑操作包括特效素材数量设置操作和/或帧参数设置操作,所述至少一个第一特效显示参数包括所述至少一个第一部位特效素材中的第一部位特效素材的数量和/或所述至少一个第一部位特效素材中的每一个的关键帧显示参数。上述步骤S102可以包括以下步骤S141和步骤S142中的至少之一:In some embodiments, each of the at least one first part special effect material includes at least one key frame; the first special effect editing operation includes a special effect material quantity setting operation and/or a frame parameter setting operation, and the at least one The first special effect display parameter includes the quantity of the first part special effect material in the at least one first part special effect material and/or the key frame display parameter of each of the at least one first part special effect material. The above step S102 may include at least one of the following steps S141 and S142:
步骤S141,响应于对所述至少一个第一部位特效素材中的第一部位特效素材进行的数量设置操作,获取所述至少一个第一部位特效素材中的第一部位特效素材的数量;Step S141, in response to the quantity setting operation performed on the first part special effect material in the at least one first part special effect material, acquire the quantity of the first part special effect material in the at least one first part special effect material;
这里,数量设置操作可以是在参数设置面板为每一第一部位特效素材输入或选择数量的操作,获取的输入或选择的数量即为对应的第一部位特效素材的数量;也可以是在参考模板图像上对每一第一部位特效素材进行的素材复制操作,获取的每一第一部位特效素材复制后的数量即为每一第一部位特效素材的数量。在实施时,本领域技术人员可以根据实际应用场景采用合适的数量设置操作,本公开实施例对此并不限定。Here, the quantity setting operation may be an operation of inputting or selecting a quantity for each first part special effect material in the parameter setting panel, and the obtained input or selected quantity is the corresponding quantity of the first part special effect material; In the material copy operation performed on each first part special effect material on the template image, the obtained copied quantity of each first part special effect material is the quantity of each first part special effect material. During implementation, those skilled in the art may use an appropriate number to set operations according to actual application scenarios, which is not limited in the embodiments of the present disclosure.
步骤S142,针对所述至少一个第一部位特效素材中的每一个,响应于对该第一部位特效素材的至少一个关键帧进行的帧参数设置操作,获取该第一部位特效素材的关键帧显示参数。Step S142, for each of the at least one first part special effect material, in response to the frame parameter setting operation performed on at least one key frame of the first part special effect material, acquire the key frame display of the first part special effect material parameter.
这里,每一第一部位特效素材具有至少一个关键帧,每一关键帧可以对应第一部位特效素材的动画中的一个关键帧时间。在实施时,可以根据实际情况采用合适的方式从第一部位特效素材的至少一个特效动画帧中,选择一个或多个特效动画帧作为该第一部位特效素材的关键帧,这里并不限定。Here, each first part special effect material has at least one key frame, and each key frame may correspond to a key frame time in the animation of the first part special effect material. During implementation, one or more special effect animation frames may be selected as key frames of the first part special effect material from at least one special effect animation frame of the first part special effect material in an appropriate manner according to the actual situation, which is not limited here.
帧参数设置操作可以是用户为完成第一部位特效素材的至少一个关键帧的显示参数的设置而进行的操作,可以是单个操作也可以是一系列操作共同组成的操作组。在实施时,帧参数设置操 作中可以为关键帧设置的显示参数可以根据实际情况确定,本公开实施例对此并不限定。The frame parameter setting operation may be an operation performed by the user to complete the display parameter setting of at least one key frame of the first part special effect material, and may be a single operation or an operation group composed of a series of operations. During implementation, the display parameters that can be set for key frames in the frame parameter setting operation can be determined according to actual conditions, which is not limited in this embodiment of the present disclosure.
在上述实施例中,用户可以根据编辑需求对至少一个第一部位特效素材的关键帧进行特效素材数量设置操作和/或帧参数设置操作,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above embodiment, the user can set the number of special effect materials and/or set the frame parameters for the key frame of at least one first part special effect material according to the editing requirements, so that the diversity and interest of the special effects edited by the user can be further improved It can better meet the user's special effects editing needs.
在一些实施例中,所述第一部位特效素材的关键帧显示参数包括所述第一部位特效素材的至少一个关键帧的显示参数,每一所述关键帧的显示参数包括以下至少之一:可见状态、显示位置、显示大小、旋转角度。In some embodiments, the key frame display parameters of the first part special effect material include display parameters of at least one key frame of the first part special effect material, and the display parameters of each key frame include at least one of the following: Visible state, display position, display size, rotation angle.
在上述实施例中,用户可以根据编辑需求,基于不同的显示参数对第一部位特效素材的各关键帧的显示效果进行灵活设置,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above embodiment, the user can flexibly set the display effect of each key frame of the first part special effect material based on different display parameters according to editing requirements, thereby further improving the diversity and interest of the special effect effect edited by the user. In order to better meet the user's special effect editing needs.
本公开实施例提供一种数据生成方法,该方法可以由计算机设备执行。如图2所示,该方法包括如下步骤S201至步骤S204:An embodiment of the present disclosure provides a method for generating data, and the method can be executed by a computer device. As shown in Figure 2, the method includes the following steps S201 to S204:
步骤S201,响应于在编辑操作区域对所述第一图像进行的部位特效添加操作,从第三图像中获取所述第一部位图像;所述第三图像是与第一图像相同或相关的图像。Step S201, in response to the part special effect addition operation performed on the first image in the editing operation area, the first part image is acquired from a third image; the third image is the same as or related to the first image .
这里,在编辑操作区域可以对第一图像进行任意合适的特效编辑操作,包括但不限于第一部位特效素材的添加、编辑、删除、显示参数设置等操作中的一种或多种。Here, any suitable special effect editing operation can be performed on the first image in the editing operation area, including but not limited to one or more of operations such as adding, editing, deleting, and display parameter setting of the first part special effect material.
部位特效添加操作可以是用户为在第一图像上添加至少一个第一部位特效素材而进行的操作,可以是单个操作也可以是一系列操作共同组成的操作组,本公开实施例对此并不限定。在实施时,部位特效添加操作可以是用户在编辑操作区域进行的点击操作,也可以是用户在编辑操作区域输入的操作指令,本公开实施例对此并不限定。The part special effect adding operation may be an operation performed by the user to add at least one first part special effect material to the first image, and may be a single operation or an operation group composed of a series of operations. limited. During implementation, the part special effect adding operation may be a click operation performed by the user in the editing operation area, or an operation instruction input by the user in the editing operation area, which is not limited in this embodiment of the present disclosure.
第三图像为与第一图像相同或相关的图像,第三图像中可以包括第一部位图像。在实施时,用户可以根据实际需求确定合适的第三图像,例如,第三图像可以是第一图像,也可以是与第一图像相关的其他图像,还可以是在第一图像上叠加了特效效果的图像。与第一图像相关的第三图像可以是用户根据实际应用场景确定的,在本公开的实施例中,两幅图像之间的“相关”的关系可以是预先设定的在包括但不限于以下至少一方面的关联关系:图像内容、图像传输路径或传输方式、图像处理方式、图像处理结果的呈现方式,这种“相关”的关系可以由用户操作来触发或预先建立。例如,在连麦互动直播的场景下,当前用户手动选择连麦互动的其他用户,第一图像可以是当前用户的直播视频的图像帧,第三图像可以是与当前用户进行连麦互动的其他用户的直播视频的图像帧,可以从该其他用户的直播视频图像帧中获取第一部位图像(如头部子图像、手部子图像等),并基于获取的第一部位图像在当前用户的直播视频(即第一图像)中呈现至少一个第一部位特效素材(如头部特效素材、手部特效素材等)。The third image is the same as or related to the first image, and the third image may include the first part image. During implementation, the user can determine the appropriate third image according to actual needs. For example, the third image can be the first image, or other images related to the first image, or superimposed special effects on the first image. effect image. The third image related to the first image may be determined by the user according to the actual application scenario. In the embodiment of the present disclosure, the "correlation" relationship between the two images may be preset, including but not limited to the following At least one aspect of association relationship: image content, image transmission path or transmission method, image processing method, and image processing result presentation method. This "related" relationship can be triggered or pre-established by user operations. For example, in the scenario of mic-connected live broadcast, if the current user manually selects other users for mic-link interaction, the first image can be the image frame of the current user's live video, and the third image can be other users who interact with the current user through mic. For the image frame of the user's live video, the first part image (such as head sub-image, hand sub-image, etc.) can be obtained from the other user's live video image frame, and based on the obtained first part image in the current user's At least one first part special effect material (such as head special effect material, hand special effect material, etc.) is presented in the live video (that is, the first image).
通过对第一图像进行的部位特效添加操作,可以从第三图像中获取第一部位图像,并基于该第一部位图像为该第一图像添加至少一个第一部位特效素材。在实施时,可以采用任意合适的方式从第三图像中获取第一部位图像,本公开实施例对此并不限定。例如,可以通过图像分割算法对第三图像中的特定部位进行分割,得到第一部位图像;也可以在特效编辑界面中的图像展示区域显示第三图像,响应于用户对第三图像进行的图像区域选择操作,从第三图像中获取用户选择的图像区域作为第一部位图像。By performing a part special effect adding operation on the first image, the first part image can be obtained from the third image, and at least one first part special effect material can be added to the first image based on the first part image. During implementation, any suitable manner may be used to obtain the first part image from the third image, which is not limited in this embodiment of the present disclosure. For example, the specific part in the third image can be segmented by an image segmentation algorithm to obtain the image of the first part; the third image can also be displayed in the image display area in the special effect editing interface, in response to the user's image processing of the third image In the area selection operation, the image area selected by the user is acquired from the third image as the first part image.
步骤S202,基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材。Step S202, based on the first part image, display at least one first part special effect material to be edited on the first image.
步骤S203,响应于对至少一个所述第一部位特效素材进行的第一特效编辑操作,获取第一特效显示参数。Step S203, in response to a first special effect editing operation performed on at least one of the first part special effect materials, acquiring first special effect display parameters.
步骤S204,基于所述第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述第一特效显示参数和第二部位图像,在第二图像上呈现至少一个与所述第一部位特效素材对应的第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。Step S204, based on the first special effect display parameters, generate a special effect data package; wherein, the special effect data package is used to, in the case of running, based on the first special effect display parameters and the second part image, in the second image Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
这里,上述步骤S202至步骤S204分别对应前述步骤S101至步骤S103,在实施时,可以参照前述步骤S101至步骤S103的具体实施方式。Here, the above-mentioned steps S202 to S204 correspond to the above-mentioned steps S101 to S103 respectively, and for implementation, reference may be made to the specific implementation manners of the above-mentioned steps S101 to S103.
本公开实施例中,可以在可视化的特效编辑界面中进行部位特效添加操作,便于用户操作,从而能够提高用户在进行特效编辑时的操作使用体验。此外,通过从第三图像中获取第一部位图像,可以在第二图像上呈现与第三图像中的部位对应的第二部位特效素材,从而可以进一步提高用户编辑的特效效果的多样性,进而更好地满足用户的特效编辑需求。In the embodiment of the present disclosure, the operation of adding a special effect to a part can be performed in a visual special effect editing interface, which is convenient for the user to operate, thereby improving the user's operation and use experience when editing the special effect. In addition, by acquiring the first part image from the third image, the second part special effect material corresponding to the part in the third image can be presented on the second image, so that the diversity of special effects edited by the user can be further improved, and further Better meet the user's special effects editing needs.
在一些实施例中,所述第三图像包括至少一个图像帧;所述第一部位特效素材包括至少一个特效动画帧。In some embodiments, the third image includes at least one image frame; the first part special effect material includes at least one special effect animation frame.
上述步骤S201中所述的从第三图像中获取所述第一部位图像,可以包括:步骤S211,从 所述第三图像的当前图像帧中获取所述第一部位图像。The acquisition of the first part image from the third image in the above step S201 may include: Step S211, acquiring the first part image from the current image frame of the third image.
上述步骤S202可以包括:步骤S212,基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材的一个特效动画帧。The above step S202 may include: Step S212, based on the first part image, displaying on the first image at least one special effect animation frame of the first part special effect material to be edited.
在上述实施例中,可以实时基于从第三图像的当前图像帧中获取的第一部位图像,在第一图像上显示对应的特效动画帧,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above embodiment, based on the first part image obtained from the current image frame of the third image, the corresponding special effect animation frame can be displayed on the first image in real time, thereby further improving the diversity and variety of special effects edited by the user. Interesting, so as to better meet the user's special effects editing needs.
本公开实施例提供一种数据生成方法,该方法可以由计算机设备执行。如图3所示,该方法包括如下步骤S301至步骤S304:An embodiment of the present disclosure provides a method for generating data, and the method can be executed by a computer device. As shown in Figure 3, the method includes the following steps S301 to S304:
步骤S301,获取第一部位图像,并基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材。Step S301, acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image.
步骤S302,响应于对至少一个所述第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数。In step S302, at least one first special effect display parameter is acquired in response to a first special effect editing operation performed on at least one first part special effect material.
这里,上述步骤S301至步骤S302分别对应前述步骤S101至步骤S102,在实施时,可以参照前述步骤S101至步骤S102的具体实施方式。Here, the above-mentioned steps S301 to S302 correspond to the above-mentioned steps S101 to S102 respectively, and for implementation, reference may be made to the specific implementation manners of the above-mentioned steps S101 to S102.
步骤S303,基于所述至少一个第一特效显示参数,在预览图像上呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。Step S303: Present at least one third part special effect material corresponding to the at least one first part special effect material on the preview image based on the at least one first special effect display parameter.
这里,预览图像为用于对编辑的第一部位特效素材的呈现效果进行预览的单帧图像或者多帧图像组成的视频,用户可以根据实际情况选择合适的预览图像,这里并不限定。在一些实施方式中,可以在特效编辑界面设置特效预览区域,用于对预览图像以及编辑的第一部位特效素材的预览效果进行展示。Here, the preview image is a single-frame image or a video composed of multiple frames for previewing the rendering effect of the edited first part special effect material. The user can select an appropriate preview image according to the actual situation, which is not limited here. In some implementation manners, a special effect preview area may be set in the special effect editing interface for displaying the preview image and the preview effect of the edited first part special effect material.
用户可以从本地、服务器或云端等处获取预先采集的预览图像,也可以通过摄像头或网络摄像机等获取实时采集的预览图像,这里并不限定。The user can obtain the pre-captured preview image from the local, the server, or the cloud, or obtain the preview image collected in real time through a camera or network camera, etc., which is not limited here.
基于获取的第一特效显示参数,可以在预览图像上呈现至少一个与所述第一部位特效素材对应的第三部位特效素材。Based on the acquired first special effect display parameters, at least one third part special effect material corresponding to the first part special effect material may be presented on the preview image.
步骤S304,基于所述第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述第一特效显示参数和第二部位图像,在第二图像上呈现至少一个与所述第一部位特效素材对应的第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。Step S304, generating a special effect data package based on the first special effect display parameters; wherein, the special effect data package is used to, in the case of running, based on the first special effect display parameters and the second part image, in the second image Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
这里,上述步骤S304对应前述步骤S103,在实施时,可以参照前述步骤S103的具体实施方式。Here, the above-mentioned step S304 corresponds to the above-mentioned step S103, and for implementation, reference may be made to the specific implementation manner of the above-mentioned step S103.
在一些实施例中,所述预览图像可以包括以下之一:导入的单帧图像、导入的连续的至少两帧图像、实时采集的单帧图像、实时采集的连续的至少两帧图像。这里,导入的单帧图像可以是从本地、服务器或云端等处导入的预先已经采集的图片等,导入的连续的至少两帧图像可以是从本地、服务器或云端等处导入的预先已经采集的视频等,实时采集的单帧图像或连续的至少两帧图像可以是通过图像采集组件实时采集等。In some embodiments, the preview image may include one of the following: an imported single-frame image, an imported continuous image of at least two frames, a single-frame image collected in real time, or a continuous image of at least two frames collected in real time. Here, the imported single-frame image can be a pre-collected picture imported from the local, server, or cloud, etc., and the imported continuous at least two frames of images can be pre-collected images imported from the local, server, or cloud. For video, etc., a single frame image or at least two consecutive frames of images collected in real time may be collected in real time by an image acquisition component.
本公开实施例提供的数据生成方法,可以在用户进行特效编辑操作的过程中在预览图像中实时呈现编辑的特效效果,从而能够有效提升用户在进行特效编辑时的操作使用体验,并且用户能够基于实时呈现的特效效果对特效显示参数进行实时调整优化,从而能更好地满足用户的特效编辑需求。The data generation method provided by the embodiments of the present disclosure can present the edited special effect in the preview image in real time during the process of the user editing the special effect, thereby effectively improving the user's operation experience when editing the special effect, and the user can based on The real-time presentation of special effects adjusts and optimizes the special effect display parameters in real time, so as to better meet the user's special effect editing needs.
在一些实施例中,上述步骤S303可以包括:In some embodiments, the above step S303 may include:
步骤S311,响应于在特效预览区域进行的特效预览操作,从第四图像中获取第三部位图像;其中,所述第四图像是与预览图像相同或相关的图像,所述第三部位图像与所述第一部位图像包含相同类型的部位;Step S311, in response to the special effect preview operation performed in the special effect preview area, obtain a third part image from the fourth image; wherein, the fourth image is the same as or related to the preview image, and the third part image is the same as said first part images contain parts of the same type;
这里,可以在特效预览区域进行特效预览操作。特效预览操作可以是任意合适的对编辑的第一部位特效素材的呈现效果进行预览的操作,例如对特效预览区域的预览按钮的点击操作、特效预览区域的展开操作、在特效预览区域打开摄像头的操作等中的一种或多种。Here, the special effect preview operation can be performed in the special effect preview area. The special effect preview operation can be any suitable operation to preview the rendering effect of the edited first part of the special effect material, such as clicking the preview button in the special effect preview area, expanding the special effect preview area, and opening the camera in the special effect preview area. One or more of operations, etc.
第三部位图像为任意合适的第一部位图像包含相同类型的部位的图像,例如,在第一部位图像所包含的部位为人的头部的情况下,第三部位图像包含的特定部位也为人的头部;在第一部位图像所包含的部位为猫爪的情况下,第三部位图像包含的特定部位也为猫爪。第三部位图像可以包括单个图像帧,也可以包括时序上连续的多个图像帧,这里并不限定。在实施时,第三部位图像可以是系统默认的图像(如系统默认的人头图像、猫头图像、猫爪图像或狗尾巴图像等),也可以是用户导入的预先从互联网或数据库获取的图像等,还可以是用户实时从预览图像或与预览图像相关的其他图像中分割得到的子图像等。The third part image is any suitable image that contains the same type of part in the first part image. For example, in the case that the part contained in the first part image is a human head, the specific part contained in the third part image is also a person's head. head; in the case that the part contained in the first part image is a cat's paw, the specific part contained in the third part image is also a cat's paw. The third part image may include a single image frame, or may include multiple image frames that are sequential in time sequence, which is not limited here. During implementation, the image of the third part can be the default image of the system (such as the default human head image, cat head image, cat paw image or dog tail image, etc.) etc., may also be a sub-image segmented by the user from the preview image or other images related to the preview image in real time.
第四图像为与预览图像相同或相关的图像,第四图像中可以包括第三部位图像。在实施时,用户可以根据实际需求确定合适的第四图像,例如,第四图像可以是预览图像,也可以是与预览图像相关的其他图像,还可以是呈现特效效果的预览图像。与预览图像相关的第四图像可以是用户根据实际应用场景确定的,这里并不限定。在实施时,可以采用任意合适的方式从第四图像中获取第三部位图像,本公开实施例对此并不限定。例如,可以通过图像分割算法对第四图像中的特定部位进行分割,得到第三部位图像;也可以在特效预览区域显示第四图像,响应于用户对第四图像进行的图像区域选择操作,从第四图像中获取用户选择的图像区域作为第三部位图像。The fourth image is the same as or related to the preview image, and the fourth image may include the third part image. During implementation, the user may determine an appropriate fourth image according to actual needs. For example, the fourth image may be a preview image, other images related to the preview image, or a preview image presenting a special effect. The fourth image related to the preview image may be determined by the user according to an actual application scenario, which is not limited here. During implementation, any suitable manner may be used to acquire the third part image from the fourth image, which is not limited in this embodiment of the present disclosure. For example, the specific part in the fourth image can be segmented by an image segmentation algorithm to obtain the image of the third part; the fourth image can also be displayed in the special effect preview area, and in response to the user's image area selection operation on the fourth image, from The image area selected by the user is acquired in the fourth image as the third part image.
步骤S312,基于所述第三部位图像和所述至少一个第一特效显示参数,在所述预览图像中实时呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。Step S312, based on the third part image and the at least one first special effect display parameter, present at least one third part special effect material corresponding to the at least one first part special effect material in the preview image in real time.
这里,第三部位特效素材可以是基于第三部位图像生成的对第三部位图像中包含的部位进行呈现的特效素材。预览图像上呈现的第三部位特效素材与第一部位特效素材是对应的,且该第三部位特效素材在预览图像上的呈现效果是基于第一特效显示参数确定的。例如,在第一部位图像为包含人的头部的图像的情况下,第一部位特效素材可以为对该头部进行呈现的头部特效素材,第三部位图像也为包含人的头部的图像,则与该第一部位特效素材对应的第三部位特效素材为基于第三部位图像生成的对第三部位图像中包含的人的头部进行呈现的特效素材;在第一部位图像为包含猫爪的图像的情况下,第一部位特效素材可以为对该猫爪进行呈现的猫爪特效素材,第三部位图像也为包含猫爪的图像,则与该第一部位特效素材对应的第三部位特效素材为基于第三部位图像生成的对第三部位图像中包含的猫爪进行呈现的特效素材。Here, the third part special effect material may be a special effect material that presents parts included in the third part image and is generated based on the third part image. The third part special effect material presented on the preview image corresponds to the first part special effect material, and the presentation effect of the third part special effect material on the preview image is determined based on the first special effect display parameter. For example, when the first part image is an image containing a human head, the first part special effect material can be a head special effect material that presents the head, and the third part image is also a human head image. image, the third part special effect material corresponding to the first part special effect material is the special effect material generated based on the third part image to present the head of the person contained in the third part image; In the case of an image of a cat's paw, the first part of the special effect material may be a cat's paw special effect material for presenting the cat's paw, and the third part of the image is also an image containing a cat's paw, then the first part of the special effect material corresponding to the first part The three-part special effect material is generated based on the third part image and presents the special effect material contained in the third part image.
在上述实施例中,可以在进行特效预览的过程中从与预览图像相同或相关的第四图像中获取第三部位图像,并能基于第三部位图像和第一特效显示参数在预览图像上呈现第三部位特效素材,从而可以快速准确地实现特效编辑操作的效果预览,进而可以进一步提高用户的使用体验。In the above embodiment, the third part image can be obtained from the fourth image that is the same as or related to the preview image during the special effect preview, and can be presented on the preview image based on the third part image and the first special effect display parameters The third part is the special effect material, so that the effect preview of the special effect editing operation can be realized quickly and accurately, and the user experience can be further improved.
本公开实施例提供一种数据生成方法,该方法可以由计算机设备执行,如图4所示,包括如下步骤S401至步骤S406:An embodiment of the present disclosure provides a method for generating data, which can be executed by a computer device, as shown in FIG. 4 , including the following steps S401 to S406:
步骤S401,响应于对所述第一图像进行的第二特效编辑操作,获取至少一个第二特效显示参数。Step S401 , acquiring at least one second special effect display parameter in response to a second special effect editing operation performed on the first image.
这里,第二特效编辑操作可以是用户根据实际需求对第一图像进行的任意合适的特效效果的编辑操作,可以包括但不限于特效效果的添加、编辑、删除、显示参数设置等操作中的一种或多种,本公开实施例对此并不限定。例如,在第一图像为人脸图像的情况下,可以对人脸图像进行贴纸添加操作、贴纸编辑操作、贴纸删除操作、美妆编辑操作、美颜设置操作等中的一种或多种;在第一图像为猫图像的情况下,可以对猫图像进行贴纸添加操作、贴纸编辑操作、贴纸删除操作、滤镜设置操作、背景设置操作等中的一种或多种;在第一图像为建筑物图像的情况下,可以对建筑物图像进行贴纸添加操作、滤镜设置操作、背景设置操作、前景设置操作、镜头特效设置操作等中的一种或多种。Here, the second special effect editing operation may be any suitable special effect editing operation performed by the user on the first image according to actual needs, and may include but not limited to one of operations such as adding, editing, deleting, and display parameter setting of special effects. One or more, which is not limited in the embodiments of the present disclosure. For example, when the first image is a human face image, one or more of a sticker adding operation, a sticker editing operation, a sticker deleting operation, a beauty makeup editing operation, a beauty setting operation, etc. may be performed on the human face image; In the case that the first image is a cat image, one or more of a sticker adding operation, a sticker editing operation, a sticker deleting operation, a filter setting operation, a background setting operation, etc. may be performed on the cat image; In the case of an object image, one or more of sticker addition operations, filter setting operations, background setting operations, foreground setting operations, and lens special effect setting operations can be performed on the building image.
第二特效显示参数为第二特效编辑操作所编辑的特效效果对应的显示参数,可以包括但不限于特效效果中的特效素材、为每一特效素材设置的显示参数、特效效果的触发事件等中的一种或多种。在实施时,获取的第二特效显示参数可以根据实际进行的特效编辑操作来确定,这里并不限定。例如,在特效编辑操作为对人脸图像进行美妆编辑操作的情况下,获取的第二特效显示参数可以包括设置的美妆素材以及为该美妆素材设置的显示位置、效果强度、素材帧率等,基于该第二特效显示参数,可以在人脸图像上呈现该美妆编辑操作所编辑的美妆效果。又如,在特效编辑操作为对猫图像进行贴纸添加操作的情况下,获取的第二特效显示参数可以包括添加的贴纸素材以及为该贴纸素材设置的显示位置、显示大小、透明度等,基于该第二特效显示参数,可以在猫图像上呈现该贴纸添加操作所添加的贴纸效果。The second special effect display parameter is the display parameter corresponding to the special effect edited by the second special effect editing operation, which may include but not limited to the special effect material in the special effect effect, the display parameters set for each special effect material, the trigger event of the special effect, etc. one or more of. During implementation, the obtained second special effect display parameter may be determined according to an actual special effect editing operation, which is not limited here. For example, when the special effect editing operation is a beauty makeup editing operation on a face image, the obtained second special effect display parameters may include the set beauty makeup material and the display position, effect strength, material frame set for the beauty makeup material Rate, etc., based on the second special effect display parameter, the beauty makeup effect edited by the beauty makeup editing operation can be presented on the face image. As another example, when the special effect editing operation is to add a sticker to a cat image, the obtained second special effect display parameters may include the added sticker material and the display position, display size, transparency, etc. set for the sticker material, based on the The second special effect display parameter can present the sticker effect added by the sticker adding operation on the cat image.
步骤S402,基于所述至少一个第二特效显示参数,在所述第一图像上呈现第一特效效果。Step S402: Present a first special effect on the first image based on the at least one second special effect display parameter.
这里,基于获取的第二特效显示参数,可以在第一图像上呈现特效编辑操作所编辑的第一特效效果。在实施时,第一特效效果可以包括以下至少之一:贴纸特效、美颜特效、美妆特效、背景特效、前景特效、镜头特效。Here, based on the obtained second special effect display parameters, the first special effect edited by the special effect editing operation may be presented on the first image. During implementation, the first special effect may include at least one of the following: sticker special effects, beautification special effects, makeup special effects, background special effects, foreground special effects, and lens special effects.
步骤S403,响应于对呈现所述第一特效效果的所述第一图像进行的部位特效添加操作,从呈现所述第一特效效果的所述第一图像中获取第一部位图像。Step S403, in response to the part special effect adding operation on the first image presenting the first special effect, acquiring a first part image from the first image presenting the first special effect.
这里,可以在呈现第一特效效果的第一图像上添加第一部位特效素材。通过对呈现第一特效效果的第一图像进行的部位特效添加操作,可以从呈现第一特效效果的第一图像中获取第一部位图像,并基于该第一部位图像为该第一图像添加至少一个第一部位特效素材。在实施时,可以采用任意合适的方式从呈现第一特效效果的第一图像中获取第一部位图像,本公开实施例对此并不限定。例如,可以通过图像分割算法对呈现第一特效效果的第一图像中的特定部位进行分割,得到第一部 位图像;响应于用户对呈现第一特效效果的第一图像进行的图像区域选择操作,从呈现第一特效效果的第一图像中获取用户选择的图像区域作为第一部位图像。Here, the first part special effect material may be added to the first image presenting the first special effect. Through the part special effect adding operation on the first image presenting the first special effect, the first part image can be obtained from the first image presenting the first special effect, and based on the first part image, at least A first part special effects material. During implementation, the first part image may be acquired from the first image presenting the first special effect in any suitable manner, which is not limited in this embodiment of the present disclosure. For example, an image segmentation algorithm may be used to segment a specific part in the first image presenting the first special effect to obtain an image of the first part; in response to the user's image region selection operation on the first image presenting the first special effect, The image area selected by the user is acquired from the first image presenting the first special effect as the first part image.
步骤S404,基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材。Step S404, based on the first part image, display at least one first part special effect material to be edited on the first image.
步骤S405,响应于对至少一个所述第一部位特效素材进行的第一特效编辑操作,获取第一特效显示参数。Step S405, acquiring a first special effect display parameter in response to a first special effect editing operation performed on at least one first part special effect material.
步骤S406,基于所述第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述第一特效显示参数和第二部位图像,在第二图像上呈现至少一个与所述第一部位特效素材对应的第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。Step S406, based on the first special effect display parameters, generate a special effect data package; wherein, the special effect data package is used to, in the case of running, based on the first special effect display parameters and the second part image, in the second image Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
这里,上述步骤S404至步骤S406分别对应前述步骤S101至步骤S103,在实施时,可以参照前述步骤S101至步骤S103的具体实施方式。Here, the above steps S404 to S406 respectively correspond to the above steps S101 to S103, and for implementation, reference may be made to the specific implementation manners of the above steps S101 to S103.
本公开实施例提供的数据生成方法,可以在第一特效效果的基础上为第一图像添加部位特效素材,并从呈现第一特效效果的第一图像中获取第一部位图像,从而在第一图像中添加的第一部位特效素材可以与第一特效效果相结合,以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。The data generation method provided by the embodiment of the present disclosure can add part special effect material to the first image on the basis of the first special effect, and obtain the first part image from the first image presenting the first special effect, so as to obtain the first part image in the first special effect The first special effect material added to the image can be combined with the first special effect to further increase the variety and interest of the special effects edited by the user, and further satisfy the special effect editing needs of the user.
在一些实施例中,所述第一部位图像包括的部位为头部,所述至少一个第一部位特效素材包括头部特效素材,所述部位特效添加操作包括头部特效添加操作,所述第一特效效果包括人脸美化特效。上述步骤S404可以包括:In some embodiments, the part included in the first part image is a head, the at least one first part special effect material includes a head special effect material, and the operation of adding a special effect to a part includes an operation of adding a special effect on a head. A special effect includes a face beautification special effect. The above step S404 may include:
步骤S411,基于所述第一部位图像,在呈现所述人脸美化特效的所述第一图像上显示至少一个待编辑的头部特效素材;其中,所述至少一个待编辑的头部特效素材中的每一个中的人脸呈现所述人脸美化特效。Step S411, based on the first part image, display at least one head special effect material to be edited on the first image presenting the face beautification special effect; wherein, the at least one head special effect material to be edited The human face in each of them presents the human face beautification special effect.
这里,头部特效素材为基于人的头部图像生成的特效素材。人脸美化特效为对人脸进行美化的任意合适的特效效果,可以包括但不限于人脸贴纸特效、美颜特效、美妆特效等中的一种或多种。在实施时,可以对呈现人脸美化特效的第一图像进行头部特效添加操作,从呈现人脸美化特效的第一图像中获取第一部位图像,并基于获取的第一部位图像,在呈现人脸美化特效的第一图像上显示至少一个待编辑的头部特效素材。由于获取的第一部位图像中会呈现该人脸美化特效,因此在第一图像上显示的至少一个待编辑的头部特效素材中也是可以呈现该人脸美化特效的。Here, the head special effect material is a special effect material generated based on a human head image. Face beautification special effects are any suitable special effects for beautifying human faces, which may include but not limited to one or more of face sticker special effects, beautifying special effects, and cosmetic special effects. During implementation, the head special effect adding operation may be performed on the first image presenting the face beautification special effect, the first part image is obtained from the first image presenting the face beautification special effect, and based on the acquired first part image, the presenting At least one head special effect material to be edited is displayed on the first image of the face beautification special effect. Since the face beautification special effect will appear in the acquired first part image, the face beautification special effect may also be present in at least one head special effect material to be edited displayed on the first image.
在上述实施例中,用户可以在第一图像上添加至少一个头部特效素材,并且每一头部特效素材中的人脸能够呈现第一图像中已编辑的人脸美化特效,从而在第一图像中添加的头部特效素材可以与第一图像中已编辑的人脸美化特效相结合,以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above-mentioned embodiment, the user can add at least one head special effect material on the first image, and the human face in each head special effect material can present the edited human face beautification special effect in the first image, so that in the first The head special effect material added in the image can be combined with the edited face beautification special effect in the first image to further improve the diversity and interest of the special effects edited by the user, thereby better satisfying the special effect editing needs of the user.
本公开实施例提供一种数据生成方法,该方法可以由计算机设备执行,如图5所示,包括如下步骤S501至步骤S505:An embodiment of the present disclosure provides a method for generating data, which can be executed by a computer device, as shown in FIG. 5 , including the following steps S501 to S505:
步骤S501,获取第一部位图像,并基于第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材。Step S501 , acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image.
步骤S502,响应于对所述至少一个第一部位特效素材进行的第一特效编辑操作,获取第一特效显示参数。Step S502, in response to a first special effect editing operation performed on the at least one first part special effect material, to obtain a first special effect display parameter.
这里,上述步骤S501至步骤S502分别对应前述步骤S101至步骤S102,在实施时,可以参照前述步骤S101至步骤S102的具体实施方式。Here, the above-mentioned steps S501 to S502 correspond to the above-mentioned steps S101 to S102 respectively, and for implementation, reference may be made to the specific implementation manners of the above-mentioned steps S101 to S102.
步骤S503,响应于对所述至少一个第一部位特效素材进行的背景设置操作,更新所述至少一个第一特效显示参数。Step S503, updating the at least one first special effect display parameter in response to the background setting operation on the at least one first part special effect material.
这里,可以通过对至少一个第一部位特效素材进行的背景设置操作,为该至少一个第一部位特效素材设置任意合适的背景特效。在实施时,可以响应于对至少一个第一部位特效素材进行的背景设置操作,将设置的至少一个第一部位特效素材的背景显示参数,添加至第一特效显示参数中,得到更新后的第一特效显示参数。Here, any suitable background special effect can be set for the at least one first part special effect material through the background setting operation performed on the at least one first part special effect material. During implementation, in response to the background setting operation on at least one first part special effect material, the set background display parameters of at least one first part special effect material may be added to the first special effect display parameters to obtain the updated first part special effect material. A special effect display parameter.
步骤S504,基于所述更新后的至少一个第一特效显示参数,在预览图像上显示设置的背景,并在设置有所述背景的预览图像上呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。Step S504, based on the updated at least one first special effect display parameter, display the set background on the preview image, and present on the preview image with the background the image corresponding to the at least one first part special effect material. At least one third-part special effects material.
步骤S505,基于所述第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述第一特效显示参数和第二部位图像,在第二图像上呈现至少一个与所述第一部位特效素材对应的第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。Step S505, generating a special effect data package based on the first special effect display parameters; wherein, the special effect data package is used to display the first special effect parameters and the second part image in the second image during operation. Presenting at least one second part special effect material corresponding to the first part special effect material; wherein, the second part image and the first part image include the same type of part.
这里,上述步骤S505与前述步骤S103对应,在实施时,可以参照前述步骤S103的具体实 施方式。Here, the above-mentioned step S505 corresponds to the above-mentioned step S103, and during implementation, reference may be made to the specific implementation manner of the above-mentioned step S103.
在上述实施例中,可以对至少一个第一部位特效素材进行背景设置操作,以在预览图像上显示设置的背景,并在设置有所述背景的预览图像上呈现至少一个第三部位特效素材,从而可以进一步提高用户编辑的特效效果的多样性和趣味性,进而更好地满足用户的特效编辑需求。In the above embodiment, the background setting operation may be performed on at least one first part special effect material, so as to display the set background on the preview image, and present at least one third part special effect material on the preview image with the background set, Therefore, the diversity and interest of the special effects edited by the user can be further improved, thereby better satisfying the special effect editing needs of the user.
本公开实施例提供一种图像处理方法,该方法可以由计算机设备执行,如图6所示,包括如下步骤S601至步骤S604:An embodiment of the present disclosure provides an image processing method, which can be executed by a computer device, as shown in FIG. 6 , including the following steps S601 to S604:
步骤S601,获取待处理的第二图像。Step S601, acquiring a second image to be processed.
这里,第二图像可以是任意合适的待进行特效处理的图像,可以是预先采集的离线图像帧或视频,也可以是实时采集的图像帧或视频,这里并不限定。Here, the second image may be any suitable image to be subjected to special effect processing, may be a pre-collected offline image frame or video, or may be a real-time collected image frame or video, which is not limited here.
在实施时,第二图像可以是直播、短视频等任意合适的应用平台中用户预先拍摄、导入或实时采集的待进行特效处理的单个图像帧或在时序上连续的多个图像帧。During implementation, the second image can be a single image frame to be subjected to special effects processing or multiple image frames that are sequential in time sequence that are pre-shot, imported or collected by the user in any suitable application platform such as live broadcast or short video.
步骤S602,响应于对所述第二图像进行的特效选择操作,基于运行的特效数据包,确定至少一个第一特效显示参数和待识别的部位。Step S602, in response to the special effect selection operation performed on the second image, based on the running special effect data package, determine at least one first special effect display parameter and a part to be recognized.
这里,特效选择操作可以是用于选择对第二图像进行特效处理的特效数据包的操作,可以是单个操作也可以是一系列操作共同组成的操作组,本公开实施例对此并不限定。通过执行特效选择操作,用户可以从预设的多个特效数据包中选择一个待运行的特效数据包,用于对待处理的第二图像进行特效处理。在实施时,对第二图像进行特效处理的特效数据包可以是预先采用上述任一数据生成方法生成的,用户可以根据实际需求通过特效选择操作选择合适的特效数据包对第二图像进行特效处理。Here, the special effect selection operation may be an operation for selecting a special effect data package for performing special effect processing on the second image, and may be a single operation or an operation group composed of a series of operations, which is not limited in this embodiment of the present disclosure. By performing a special effect selection operation, the user can select a to-be-run special effect data package from a plurality of preset special effect data packages to perform special effect processing on the second image to be processed. During implementation, the special effect data package for performing special effect processing on the second image may be pre-generated by using any of the above-mentioned data generation methods, and the user may select an appropriate special effect data package to perform special effect processing on the second image through special effect selection operations according to actual needs .
基于运行的特效数据包,可以获取用于进行部位特效素材呈现的第一特效显示参数以及与至少一个部位特效素材对应的待识别的部位。Based on the running special effect data package, the first special effect display parameters for presenting the part special effect material and the part to be identified corresponding to at least one part special effect material can be acquired.
在一些实施例中,特效数据包可以是可执行文件,包括用于获取与该特效数据包对应的第一特效显示参数以及待识别的部位的指令,通过运行特效数据包,可以执行该指令获取与该特效数据包对应的第一特效显示参数以及待识别的部位。In some embodiments, the special effect data package may be an executable file, including instructions for obtaining the first special effect display parameters corresponding to the special effect data package and the position to be identified. By running the special effect data package, the instruction acquisition may be executed. The first special effect display parameters corresponding to the special effect data packet and the part to be recognized.
在一些实施例中,特效数据包可以是包含第一特效显示参数和与至少一个第一部位特效素材对应的待识别的部位的数据资源包,应用平台可以通过特定的软件开发工具包SDK或特定的程序指令加载该特效数据包,并对该特效数据包进行解析,得到相应的第一特效显示参数以及与至少一个第一部位特效素材对应的待识别的部位。In some embodiments, the special effect data package may be a data resource package containing first special effect display parameters and a part to be identified corresponding to at least one first part special effect material, and the application platform may use a specific software development kit SDK or a specific The program instruction loads the special effect data package, and analyzes the special effect data package to obtain the corresponding first special effect display parameters and the part to be identified corresponding to at least one first part special effect material.
步骤S603,基于所述待识别的部位,从第五图像中获取第二部位图像;其中,所述第五图像是与第二图像相同或相关的图像。Step S603, based on the part to be identified, acquire a second part image from a fifth image; wherein the fifth image is the same as or related to the second image.
这里,第二部位图像可以为任意合适的包含待识别的部位的图像,第五图像可以为与第二图像相同或相关的图像,第五图像中可以包括第二部位图像。在实施时,用户可以根据实际需求确定合适的第五图像,例如,第五图像可以是第二图像,也可以是与第二图像相关的其他图像,还可以是呈现特效效果的第二图像。与第二图像相关的第五图像可以是用户根据实际应用场景确定的,例如,在连麦互动直播的场景下,第二图像可以是当前用户的直播视频,第五图像可以是与当前用户进行连麦互动的其他用户的直播视频,可以从该其他用户的直播视频图像帧中获取第二部位图像(如头部子图像、手部子图像等),并基于获取的第二部位图像在当前用户的直播视频(即第二图像)中呈现至少一个第一部位特效素材(如头部特效素材、手部特效素材等)。Here, the second part image may be any suitable image containing the part to be identified, the fifth image may be the same as or related to the second image, and the fifth image may include the second part image. During implementation, the user may determine an appropriate fifth image according to actual needs. For example, the fifth image may be the second image, or other images related to the second image, or a second image that presents a special effect. The fifth image related to the second image may be determined by the user according to the actual application scenario. For example, in the scenario of interactive live broadcast with microphones, the second image may be the live video of the current user, and the fifth image may be the live video of the current user. The live video of other users of Lianmai Interactive can obtain the second part image (such as head sub-image, hand sub-image, etc.) from the other user's live video image frame, and based on the obtained second part image in the current At least one first part special effect material (such as head special effect material, hand special effect material, etc.) is presented in the user's live video (that is, the second image).
通过对第五图像中的待识别的部位进行图像分割处理,可以得到第二部位图像,并基于该第二部位图像为该第二图像添加至少一个第二部位特效素材。在实施时,可以采用任意合适的方式从第五图像中获取第二部位图像,本公开实施例对此并不限定。By performing image segmentation processing on the part to be recognized in the fifth image, a second part image can be obtained, and at least one second part special effect material is added to the second image based on the second part image. During implementation, any suitable manner may be used to obtain the second part image from the fifth image, which is not limited in this embodiment of the present disclosure.
步骤S604,基于所述至少一个第一特效显示参数和第二部位图像,在所述第二图像上呈现至少一个第二部位特效素材。Step S604: Present at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
这里,可以基于获取的第一特效显示参数和第二部位图像,在第二图像上呈现与该第二部位图像对应的至少一个第二部位特效素材。在第二图像上呈现的至少一个第二部位特效素材是基于该第二部位图像生成的。Here, at least one second part special effect material corresponding to the second part image may be presented on the second image based on the acquired first special effect display parameter and the second part image. At least one second part special effect material presented on the second image is generated based on the second part image.
在本公开实施例提供的图像处理方法,首先获取待处理的第二图像;其次,响应于对该第二图像进行的特效选择操作,基于运行的特效数据包,确定第一特效显示参数和待识别的部位,并基于该待识别的部位,从第五图像中获取第二部位图像,最后,基于第一特效显示参数和第二部位图像,在第二图像上呈现至少一个第二部位特效素材。这样,可以基于获取的特效数据包对待处理的第二图像进行特效处理,以在第二图像上呈现与第二部位图像对应的至少一个第二部位特效素材,从而可以提高特效效果的趣味性和多样性,进而能够更好地满足用户的特效需求。In the image processing method provided by the embodiment of the present disclosure, firstly, the second image to be processed is obtained; secondly, in response to the special effect selection operation performed on the second image, based on the running special effect data package, the first special effect display parameters and the to-be-processed display parameters are determined. Identify the part, and based on the part to be recognized, obtain the second part image from the fifth image, and finally, based on the first special effect display parameters and the second part image, present at least one second part special effect material on the second image . In this way, special effect processing can be performed on the second image to be processed based on the obtained special effect data packet, so as to present at least one second part special effect material corresponding to the second part image on the second image, thereby improving the interestingness and performance of the special effect. Diversity, which can better meet the needs of users for special effects.
下面将说明本公开实施例在实际应用场景中的示例性应用。Exemplary applications of the embodiments of the present disclosure in actual application scenarios will be described below.
随着直播应用和短视频应用的发展,用户逐渐需求各种各样的可应用于图片或视频中的特效效果,而相关技术中缺少基于图像分割后的人的身体部分的图像而衍生的特效效果,如对分割后的头部图像进行的一系列特效效果的设计。With the development of live broadcast applications and short video applications, users gradually demand a variety of special effects that can be applied to pictures or videos, but related technologies lack special effects derived from images of human body parts after image segmentation Effects, such as the design of a series of special effects on the segmented head image.
有鉴于此,本公开实施例基于上述提供的数据生成方法,提供一种特效编辑工具,可以实现对部位特效素材(可以是前述的第一部位特效素材)的定制化设计,并生成相应的特效数据包,实现自定义的部位特效素材。直播、短视频或相机等应用平台的使用者可基于该特效编辑工具,利用获取的包含特定部位的部位图像,编辑自定义的部位特效素材的参数信息,然后基于编辑的参数信息生成对应的特效数据包,特效数据包可在直播、短视频或相机等应用平台中运行,以便为相应的应用平台的使用者提供自定义的部位特效素材。In view of this, the embodiment of the present disclosure provides a special effect editing tool based on the data generation method provided above, which can realize the customized design of the part special effect material (which can be the aforementioned first part special effect material), and generate corresponding special effects Data package to realize custom part special effect materials. Users of application platforms such as live broadcast, short video or camera can edit the parameter information of custom part special effect materials based on the special effect editing tool by using the obtained part images containing specific parts, and then generate corresponding special effects based on the edited parameter information Data package, special effect data package can be run in application platforms such as live broadcast, short video or camera, so as to provide users of the corresponding application platform with custom part special effect materials.
以头部特效素材的自定义编辑为例,本公开实施例提供的特效编辑工具至少可以实现如下功能:Taking the custom editing of the head special effect material as an example, the special effect editing tool provided by the embodiment of the present disclosure can at least realize the following functions:
1)实时采集包含头部的图像,并从采集的图像中提取头部分割结果。1) Collect images containing the head in real time, and extract head segmentation results from the collected images.
2)定义一个或多个头部特效素材,对于每个头部特效素材,可以对该头部特效素材的关键帧动画进行定义,其中,可以对同一个头部特效素材在不同的关键帧时间对应的关键帧的显示状态进行定义,包括定义关键帧是否可见,定义关键帧的显示位置、显示大小、旋转角度等,以及定义关键帧动画的循环次数等。例如,参见图7A,可以在图像100上添加一个头部特效素材110,并将头部特效素材110中关键帧的显示大小设置为大于图像100中原头部的尺寸大小。又如,参见图7B,可以在图像100上添加多个头部特效素材120,并且为每个头部特效素材的各关键帧设置不同的旋转角度以及显示位置,从而可以在各头部特效素材对应的动画进行播放的情况下,在图像100上呈现多个头部特效素材120沿设定的多个显示位置移动的特效效果。2) Define one or more head special effect materials. For each head special effect material, the key frame animation of the head special effect material can be defined, wherein, the same head special effect material can be used at different key frame times Define the display state of the corresponding key frame, including defining whether the key frame is visible, defining the display position, display size, rotation angle, etc. of the key frame, and defining the cycle times of the key frame animation, etc. For example, referring to FIG. 7A , a head special effect material 110 can be added to the image 100 , and the display size of the key frame in the head special effect material 110 is set to be larger than the size of the original head in the image 100 . As another example, referring to FIG. 7B, multiple head effect materials 120 can be added to the image 100, and different rotation angles and display positions can be set for each key frame of each head effect material, so that each head effect material can When the corresponding animation is played, a special effect in which multiple head special effect materials 120 move along multiple set display positions is presented on the image 100 .
3)定义一个或多个特效组合,每个特效组合中可以包含多个头部特效素材,其中,对于每个特效组合,可以定义该特效组合中包含的头部特效素材,并对该特效组合在不同的关键帧时间对应的关键帧的显示状态进行定义,包括定义关键帧是否可见,定义关键帧的显示位置、显示大小、旋转角度等,以及定义关键帧动画的循环次数等。3) Define one or more special effect combinations, each special effect combination can contain multiple head special effect materials, wherein, for each special effect combination, the head special effect materials contained in the special effect combination can be defined, and the special effect combination Define the display state of the keyframe corresponding to different keyframe times, including defining whether the keyframe is visible, defining the display position, display size, rotation angle, etc. of the keyframe, and defining the cycle times of the keyframe animation, etc.
4)将头部特效素材与贴纸特效、美妆特效、美颜特效等进行结合,从设置了贴纸特效、美妆特效或美颜特效等的图像中提取头部分割结果,并基于该头部分割结果进行头部特效素材的编辑,其中,原图像中人头处设置的人脸贴纸特效、美妆特效或美颜特效等会在每一个头部特效素材中同步呈现。例如,继续参见图7B,可以从设置了人脸贴纸特效130的图像100中提取头部分割结果,则基于该头部分割结果在图像100上添加的多个头部特效素材120中也会呈现该人脸贴纸特效130。4) Combining the head special effects material with sticker special effects, makeup special effects, beauty special effects, etc., extracting head segmentation results from images with sticker special effects, makeup special effects or beauty special effects, etc., and based on the head The segmentation results are used to edit the head special effect material. Among them, the face sticker special effects, makeup special effects or beauty special effects set on the head in the original image will be presented synchronously in each head special effect material. For example, continue to refer to FIG. 7B , the head segmentation result can be extracted from the image 100 with the face sticker special effect 130 set, then based on the head segmentation result, it will also appear in the plurality of head special effect materials 120 added to the image 100 The face sticker has 130 special effects.
5)将头部特效素材与背景贴纸进行结合,例如,参见图7C,可以对贴纸140与头部特效素材150的层级关系进行定义,将贴纸140设置于头部特效素材150的下一层,作为头部分割结果的背景,可以实现头部分割结果和背景贴纸的结合。5) Combining the head special effect material with the background sticker, for example, referring to FIG. 7C, the hierarchical relationship between the sticker 140 and the head special effect material 150 can be defined, and the sticker 140 is set on the next layer of the head special effect material 150, As the background of the head segmentation result, the combination of the head segmentation result and the background sticker can be realized.
图7D为本公开实施例提供的一种特效编辑工具的特效编辑界面的示意图,如图7D所示,该特效编辑工具的特效编辑界面包括图层面板10、画布面板20、参数设置面板30和特效预览区域40。其中,图层面板10上可以进行特效效果中各图层的上移和下移,头部特效素材的编辑页面可以为一个图层;画布面板20中可以显示用于辅助头部特效素材编辑的参考模板图像,以及编辑的头部特效素材的相关素材,并能对素材、头部特效素材的关键帧中头部的显示状态、显示大小、显示位置等进行调整;参数设置面板30上可以进行头部特效素材的显示参数的设置,例如,头部特效素材的关键帧中头部的显示状态、显示大小、显示位置,头部特效素材的数量,头部特效素材的触发事件等;特效预览区域可以对编辑的头部特效素材进行实时预览。7D is a schematic diagram of a special effect editing interface of a special effect editing tool provided by an embodiment of the present disclosure. As shown in FIG. 7D , the special effect editing interface of the special effect editing tool includes a layer panel 10, a canvas panel 20, a parameter setting panel 30 and Special effect preview area 40 . Wherein, on the layer panel 10, each layer in the special effect can be moved up and down, and the editing page of the head special effect material can be a layer; in the canvas panel 20, it can be displayed for assisting the editing of the head special effect material. Refer to the template image, and the relevant materials of the edited head special effect material, and can adjust the display state, display size, display position, etc. of the head in the key frame of the material and the head special effect material; Setting of the display parameters of the head special effect material, for example, the display state, display size, and display position of the head in the key frame of the head special effect material, the number of the head special effect material, the trigger event of the head special effect material, etc.; special effect preview The edited head effects material can be previewed in real time in the area.
本公开实施例提供的特效编辑工具中,进行特效效果的编辑的过程可以包括如下步骤S701至步骤S702:In the special effect editing tool provided by the embodiment of the present disclosure, the process of editing special effects may include the following steps S701 to S702:
步骤S701,在参数设置面板中点击新增头部特效素材,以在画布面板中新增一个待编辑的头部特效素材;其中,可以通过点击删除按钮删除已添加的至少一个头部特效素材。Step S701 , click Add head special effect material in the parameter setting panel to add a head special effect material to be edited in the canvas panel; wherein, at least one added head special effect material can be deleted by clicking the delete button.
步骤S702,在画布面板中对头部特效素材中每一关键帧的显示位置、旋转角度、显示大小进行改变。Step S702, changing the display position, rotation angle, and display size of each key frame in the head effect material in the canvas panel.
在一些实施例中,可以通过定义部位特效素材中不同关键帧时间的关键帧的显示位置,来设置头部特效素材在呈现的过程中到达特定位置的时间。In some embodiments, the time when the head special effect material arrives at a specific position during presentation can be set by defining the display positions of key frames of different key frame times in the part special effect material.
在一些实施例中,可以通过对头部特效素材进行事件触发设置操作来为头部特效素材设置触发事件,如张嘴、眨眼、摇头等。In some embodiments, triggering events, such as opening mouth, blinking, shaking head, etc., can be set for the head effect material by performing an event trigger setting operation on the head effect material.
需要说明的是,在实施时,上述实时采集的包含头部的图像可以对应前述实施例中的第一图像或第三图像,上述头部分割结果可以对应前述实施例中的第一部位图像。It should be noted that, during implementation, the image including the head collected in real time may correspond to the first image or the third image in the foregoing embodiment, and the foregoing head segmentation result may correspond to the first part image in the foregoing embodiment.
基于前述的实施例,本公开实施例提供一种数据生成装置,该装置包括所包括的各单元、 以及各单元所包括的各模块,可以通过计算机设备中的处理器来实现;当然也可通过具体的逻辑电路实现;在实施的过程中,处理器可以为中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等。Based on the foregoing embodiments, the embodiments of the present disclosure provide a data generating device, which includes each unit included, and each module included in each unit, which can be implemented by a processor in a computer device; of course, it can also be implemented by Concrete logic circuit implementation; in the process of implementation, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA).
图8为本公开实施例提供的一种数据生成装置的组成结构示意图,如图8所示,该数据生成装置800包括:第一显示模块810、第一编辑模块820和生成模块830,其中:FIG. 8 is a schematic diagram of the composition and structure of a data generating device provided by an embodiment of the present disclosure. As shown in FIG. 8, the data generating device 800 includes: a first display module 810, a first editing module 820, and a generating module 830, wherein:
第一显示模块810,用于获取第一部位图像,并基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材;The first display module 810 is configured to acquire a first part image, and based on the first part image, display at least one first part special effect material to be edited on the first image;
第一编辑模块820,用于响应于对所述至少一个第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数;The first editing module 820 is configured to acquire at least one first special effect display parameter in response to a first special effect editing operation performed on the at least one first part special effect material;
生成模块830,用于基于所述至少一个第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述至少一个第一特效显示参数和第二部位图像,在第二图像上呈现与所述至少一个第一部位特效素材对应的至少一个第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。The generating module 830 is configured to generate a special effect data packet based on the at least one first special effect display parameter; wherein, the special effect data packet is used to generate a special effect data packet based on the at least one first special effect display parameter and the second A part image, presenting at least one second part special effect material corresponding to the at least one first part special effect material on the second image; wherein, the second part image and the first part image include the same type of part.
在一些实施例中,所述第一图像为参考模板图像;所述第一显示模块还用于:基于所述第一部位图像,确定所述至少一个待编辑的第一部位特效素材;在编辑操作区域显示所述参考模板图像和所述至少一个第一部位特效素材。In some embodiments, the first image is a reference template image; the first display module is further configured to: determine the at least one first part special effect material to be edited based on the first part image; The operation area displays the reference template image and the at least one first part special effect material.
在一些实施例中,所述装置还包括:第二显示模块,用于基于所述至少一个第一特效显示参数,在预览图像上呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。In some embodiments, the device further includes: a second display module, configured to present at least one first part special effect material corresponding to the at least one first part special effect material on the preview image based on the at least one first special effect display parameter. Three-part special effect material.
在一些实施例中,所述第二显示模块还用于:响应于在特效预览区域进行的特效预览操作,从第四图像中获取第三部位图像;其中,所述第四图像是与所述预览图像相同或相关的图像,所述第三部位图像与所述第一部位图像包含相同类型的部位;基于所述第三部位图像和所述至少一个第一特效显示参数,在所述预览图像中实时呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。In some embodiments, the second display module is further configured to: acquire a third part image from a fourth image in response to a special effect preview operation performed in the special effect preview area; wherein, the fourth image is the same as the An image that is the same as or related to the preview image, the third part image contains the same type of part as the first part image; based on the third part image and the at least one first special effect display parameter, in the preview image present at least one third part special effect material corresponding to the at least one first part special effect material in real time.
在一些实施例中,所述第一显示模块还用于:响应于在编辑操作区域对所述第一图像进行的部位特效添加操作,从第三图像中获取所述第一部位图像;其中,所述第三图像是与第一图像相同或相关的图像。In some embodiments, the first display module is further configured to: acquire the first part image from a third image in response to a part special effect addition operation performed on the first image in the editing operation area; wherein, The third image is an image that is the same as or related to the first image.
在一些实施例中,所述第三图像包括至少一个图像帧;所述至少一个第一部位特效素材包括至少一个特效动画帧;所述第一显示模块还用于:从所述第三图像的当前图像帧中获取所述第一部位图像;所述第一显示模块还用于:基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材的一个特效动画帧。In some embodiments, the third image includes at least one image frame; the at least one first part special effect material includes at least one special effect animation frame; the first display module is further configured to: from the third image The image of the first part is acquired in the current image frame; the first display module is further configured to: based on the image of the first part, display a special effect animation of at least one special effect material of the first part to be edited on the first image frame.
在一些实施例中,所述至少一个第一部位特效素材中的每一个包括至少一个关键帧;所述第一特效编辑操作包括特效素材数量设置操作和/或帧参数设置操作,所述至少一个第一特效显示参数包括所述至少一个第一部位特效素材中的第一部位特效素材的数量和/或所述至少一个第一部位特效素材中的每一个的关键帧显示参数;所述第一编辑模块还用于:响应于对所述至少一个第一部位特效素材进行的所述数量设置操作,获取所述至少一个第一部位特效素材中的第一部位特效素材的数量;和/或,针对所述至少一个第一部位特效素材中的每一个,响应于对该第一部位特效素材的至少一个关键帧进行的所述帧参数设置操作,获取该第一部位特效素材的关键帧显示参数;其中,该第一部位特效素材的关键帧显示参数包括该第一部位特效素材的至少一个关键帧的显示参数,该第一部位特效素材的至少一个关键帧中的每一个关键帧的显示参数包括以下至少之一:可见状态、显示位置、显示大小、旋转角度。In some embodiments, each of the at least one first part special effect material includes at least one key frame; the first special effect editing operation includes a special effect material quantity setting operation and/or a frame parameter setting operation, and the at least one The first special effect display parameters include the number of first part special effect materials in the at least one first part special effect material and/or the key frame display parameters of each of the at least one first part special effect materials; the first The editing module is further configured to: acquire the quantity of the first part special effect material in the at least one first part special effect material in response to the quantity setting operation performed on the at least one first part special effect material; and/or, For each of the at least one first part special effect material, in response to the frame parameter setting operation performed on at least one key frame of the first part special effect material, acquiring key frame display parameters of the first part special effect material ; Wherein, the key frame display parameters of the first part special effect material include the display parameters of at least one key frame of the first part special effect material, and the display parameters of each key frame in the at least one key frame of the first part special effect material Including at least one of the following: visible state, display position, display size, and rotation angle.
在一些实施例中,在所述第一特效编辑操作包括循环显示设置操作的情况下,所述至少一个第一特效显示参数包括所述至少一个第一部位特效素材中的每一个的循环显示参数;所述装置还包括:第三显示模块,用于针对所述至少一个第一部位特效素材中的每一第一部位特效素材,基于该第一部位特效素材的循环显示参数在预览图像上循环显示与该第一部位特效素材对应的第三部位特效素材。In some embodiments, when the first special effect editing operation includes a cycle display setting operation, the at least one first special effect display parameter includes a cycle display parameter of each of the at least one first part special effect material The device also includes: a third display module, for each first part special effect material in the at least one first part special effect material, based on the cycle display parameters of the first part special effect material to cycle on the preview image The third part special effect material corresponding to the first part special effect material is displayed.
在一些实施例中,在所述第一特效编辑操作包括触发事件编辑操作的情况下,所述至少一个第一特效显示参数包括所述至少一个第一部位特效素材中的每一个的触发事件;所述装置还包括:第四显示模块,用于针对所述至少一个第一部位特效素材中的每一第一部位特效素材,基于该第一部位特效素材的触发事件,在预览图像上呈现与该第一部位特效素材对应的第三部位特效素材。In some embodiments, when the first special effect editing operation includes a trigger event editing operation, the at least one first special effect display parameter includes a trigger event for each of the at least one first part special effect material; The device further includes: a fourth display module, for each first part special effect material in the at least one first part special effect material, based on a trigger event of the first part special effect material, presenting on the preview image the same The third part special effect material corresponding to the first part special effect material.
在一些实施例中,所述至少一个第一部位特效素材包括至少两个第一部位特效素材,所述第一编辑模块还用于:响应于对所述至少两个第一部位特效素材进行的组合操作,获取至少一个第一特效素材组合;针对所述至少一个第一特效素材组合中的每一个第一特效素材组合,响应于对该第一特效素材组合进行的组合特效编辑操作,获取该第一特效素材组合的第三特效显示参数;所述 装置还包括:第五显示模块,用于针对所述至少一个第一特效素材组合中的每一第一特效素材组合,基于该第一特效素材组合的第三特效显示参数,在预览图像上呈现与该第一特效素材组合对应的第三特效素材组合;所述第三特效素材组合包括与该第一特效素材组合对应的至少两个第三部位特效素材。In some embodiments, the at least one first part special effect material includes at least two first part special effect materials, and the first editing module is further configured to: respond to the at least two first part special effect materials The combination operation is to acquire at least one first special effect material combination; for each first special effect material combination in the at least one first special effect material combination, in response to the combined special effect editing operation performed on the first special effect material combination, acquire the The third special effect display parameter of the first special effect material combination; the device further includes: a fifth display module, for each first special effect material combination in the at least one first special effect material combination, based on the first special effect The third special effect display parameter of the material combination is to present a third special effect material combination corresponding to the first special effect material combination on the preview image; the third special effect material combination includes at least two second special effect material combinations corresponding to the first special effect material combination Three-part special effect material.
在一些实施例中,所述第一编辑模块还用于:响应于在编辑操作区域进行的特效素材选择操作,选定所述至少两个第一部位特效素材中的至少两者;响应于对所述选定的第一部位特效素材进行的组合操作,获取至少一个第一特效素材组合。In some embodiments, the first editing module is further configured to: select at least two of the at least two first part special effect materials in response to a special effect material selection operation performed in the editing operation area; The combination operation performed on the selected first part special effect material obtains at least one first special effect material combination.
在一些实施例中,所述装置还包括:第二获取模块,用于响应于对所述第一图像进行的第二特效编辑操作,获取至少一个第二特效显示参数;第六显示模块,用于基于所述至少一个第二特效显示参数,在所述第一图像上呈现第一特效效果;所述第一显示模块还用于:响应于对呈现所述第一特效效果的所述第一图像进行的部位特效添加操作,从呈现所述第一特效效果的所述第一图像中获取第一部位图像。In some embodiments, the device further includes: a second acquisition module, configured to acquire at least one second special effect display parameter in response to a second special effect editing operation performed on the first image; a sixth display module, configured to Presenting a first special effect on the first image based on the at least one second special effect display parameter; the first display module is further configured to: respond to the first request for presenting the first special effect The part special effect adding operation performed on the image is to obtain the first part image from the first image presenting the first special effect.
在一些实施例中,所述第一部位图像包括的部位为头部,所述至少一个第一部位特效素材包括头部特效素材,所述部位特效添加操作包括头部特效添加操作,所述第一特效效果包括人脸美化特效;所述第一显示模块还用于:基于所述第一部位图像,在呈现所述人脸美化特效的所述第一图像上显示至少一个待编辑的头部特效素材;其中,所述至少一个待编辑的头部特效素材中的每一个中的人脸呈现所述人脸美化特效。In some embodiments, the part included in the first part image is a head, the at least one first part special effect material includes a head special effect material, and the operation of adding a special effect to a part includes an operation of adding a special effect on a head. A special effect includes a human face beautification special effect; the first display module is further configured to: based on the first part image, display at least one head to be edited on the first image presenting the human face beautification special effect Special effect material; wherein, the human face in each of the at least one head special effect material to be edited presents the human face beautification special effect.
在一些实施例中,所述装置还包括:更新模块,用于响应于对所述至少一个第一部位特效素材进行的背景设置操作,更新所述至少一个第一特效显示参数;第七显示模块,用于基于所述更新后的至少一个第一特效显示参数,在预览图像上显示设置的背景,并在设置有所述背景的预览图像上呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。In some embodiments, the device further includes: an update module, configured to update the at least one first special effect display parameter in response to the background setting operation performed on the at least one first part special effect material; a seventh display module , for displaying the set background on the preview image based on the updated at least one first special effect display parameter, and presenting the at least one first part special effect material corresponding to the preview image on which the background is set. At least one third-part special effects material.
本公开实施例提供一种图像处理装置,该装置包括所包括的各单元、以及各单元所包括的各模块,可以通过计算机设备中的处理器来实现;当然也可通过具体的逻辑电路实现;在实施的过程中,处理器可以为中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)或现场可编程门阵列(FPGA)等。An embodiment of the present disclosure provides an image processing device, which includes each unit included and each module included in each unit, which can be realized by a processor in a computer device; of course, it can also be realized by a specific logic circuit; During implementation, the processor may be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA).
图9为本公开实施例提供的一种图像处理装置的组成结构示意图,如图9所示,该图像处理装置900包括:第三获取模块910、第四获取模块920、第五获取模块930和第八显示模块940,其中:FIG. 9 is a schematic structural diagram of an image processing device provided by an embodiment of the present disclosure. As shown in FIG. 9 , the image processing device 900 includes: a third acquisition module 910, a fourth acquisition module 920, a fifth acquisition module 930 and The eighth display module 940, wherein:
第三获取模块910,用于获取待处理的第二图像;A third acquiring module 910, configured to acquire a second image to be processed;
第四获取模块920,用于响应于对所述第二图像进行的特效选择操作,基于运行的特效数据包,确定至少一个第一特效显示参数和待识别的部位;The fourth acquiring module 920 is configured to determine at least one first special effect display parameter and a part to be identified based on the running special effect data package in response to the special effect selection operation performed on the second image;
第五获取模块930,用于基于所述待识别的部位,从第五图像中获取第二部位图像;其中,所述第五图像是与第二图像相同或相关的图像;The fifth acquisition module 930 is configured to acquire a second part image from a fifth image based on the part to be identified; wherein the fifth image is an image that is the same as or related to the second image;
第八显示模块940,用于基于所述至少一个第一特效显示参数和所述第二部位图像,在所述第二图像上呈现至少一个第二部位特效素材。The eighth display module 940 is configured to present at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
以上装置实施例的描述,与上述方法实施例的描述是类似的,具有同方法实施例相似的有益效果。对于本公开装置实施例中未披露的技术细节,请参照本公开方法实施例的描述而理解。The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiments of the present disclosure, please refer to the description of the method embodiments of the present disclosure for understanding.
本公开涉及增强现实(Augmented Real ity,AR)领域,通过获取现实环境中的目标对象的图像信息,进而借助各类视觉相关算法实现对目标对象的相关特征、状态及属性进行检测或识别处理,从而得到与具体应用匹配的虚拟与现实相结合的AR效果。示例性的,目标对象可涉及与人体相关的脸部、肢体、手势、动作等,或者与物体相关的标识物、标志物,或者与场馆或场所相关的沙盘、展示区域或展示物品等。视觉相关算法可涉及视觉定位、即时定位与地图构建(simultaneous localization and mapping,SLAM)、三维重建、图像注册、背景分割、对象的关键点提取及跟踪、对象的位姿或深度检测等。具体应用不仅可以涉及跟真实场景或物品相关的导览、导航、讲解、重建、虚拟效果叠加展示等交互场景,还可以涉及与人相关的特效处理,比如妆容美化、肢体美化、特效展示、虚拟模型展示等交互场景。可通过卷积神经网络,实现对目标对象的相关特征、状态及属性进行检测或识别处理。上述卷积神经网络是基于深度学习框架进行模型训练而得到的网络模型。This disclosure relates to the field of Augmented Reality (AR). By acquiring the image information of the target object in the real environment, and then using various visual related algorithms to detect or identify the relevant features, states and attributes of the target object, In this way, the AR effect combining virtual and reality matching the specific application can be obtained. Exemplarily, the target object may involve faces, limbs, gestures, actions, etc. related to the human body, or markers and markers related to objects, or sand tables, display areas or display items related to venues or places. Vision-related algorithms can involve visual positioning, simultaneous localization and mapping (SLAM), 3D reconstruction, image registration, background segmentation, key point extraction and tracking of objects, object pose or depth detection, etc. Specific applications can not only involve interactive scenes such as guided tours, navigation, explanations, reconstructions, virtual effect overlays and display related to real scenes or objects, but also special effects processing related to people, such as makeup beautification, body beautification, special effect display, virtual Interactive scenarios such as model display. The relevant features, states and attributes of the target object can be detected or identified through the convolutional neural network. The above-mentioned convolutional neural network is a network model obtained by performing model training based on a deep learning framework.
需要说明的是,本公开实施例中,如果以软件功能模块的形式实现上述的数据生成方法,并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本公开实施例的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一台电子设备(可以是个人计算机、服务器、或者网络设备等)执行本公开各个实施例所述方法的全部或部分。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read Only Memory,ROM)、磁碟或者光盘等各种可以存储程序代码的 介质。这样,本公开实施例不限制于任何特定的硬件和软件结合。It should be noted that, in the embodiments of the present disclosure, if the above data generating method is implemented in the form of software function modules and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the embodiments of the present disclosure or the part that contributes to the related technology can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to make a An electronic device (which may be a personal computer, a server, or a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure. The aforementioned storage medium includes: various media that can store program codes such as U disk, mobile hard disk, read-only memory (Read Only Memory, ROM), magnetic disk or optical disk. As such, embodiments of the present disclosure are not limited to any specific combination of hardware and software.
对应地,本公开实施例提供一种计算机设备,包括存储器和处理器,所述存储器存储有可在处理器上运行的计算机程序,所述处理器执行所述程序时实现上述方法中的步骤。Correspondingly, an embodiment of the present disclosure provides a computer device, including a memory and a processor, the memory stores a computer program that can run on the processor, and the processor implements the steps in the above method when executing the program.
对应地,本公开实施例提供一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现上述方法中的步骤。Correspondingly, an embodiment of the present disclosure provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above method are implemented.
对应地,本公开实施例提供一种计算机程序产品,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,所述计算机程序被计算机读取并执行时,实现上述方法中的步骤。Correspondingly, an embodiment of the present disclosure provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, the above method can be implemented. A step of.
这里需要指出的是:以上存储介质、设备和计算机程序产品实施例的描述,与上述方法实施例的描述是类似的,具有同方法实施例相似的有益效果。对于本公开存储介质、设备和计算机程序产品实施例中未披露的技术细节,请参照本公开方法实施例的描述而理解。It should be noted here that: the above descriptions of the storage medium, device, and computer program product embodiments are similar to the descriptions of the above method embodiments, and have similar beneficial effects to those of the method embodiments. For technical details not disclosed in the storage medium, device and computer program product embodiments of the present disclosure, please refer to the description of the method embodiments of the present disclosure for understanding.
需要说明的是,图10为本公开实施例中计算机设备的一种硬件实体示意图,如图10所示,该计算机设备1000的硬件实体包括:处理器1001、通信接口1002和存储器1003,其中,It should be noted that FIG. 10 is a schematic diagram of a hardware entity of a computer device in an embodiment of the present disclosure. As shown in FIG. 10 , the hardware entity of the computer device 1000 includes: a processor 1001, a communication interface 1002, and a memory 1003, wherein,
处理器1001通常控制计算机设备1000的总体操作。 Processor 1001 generally controls the overall operation of computer device 1000 .
通信接口1002可以使计算机设备通过网络与其他终端或服务器通信。The communication interface 1002 enables the computer device to communicate with other terminals or servers through the network.
存储器1003配置为存储由处理器1001可执行的指令和应用,还可以缓存待处理器1001以及计算机设备1000中各模块待处理或已经处理的数据(例如,图像数据、音频数据、语音通信数据和视频通信数据),可以通过闪存(FLASH)或随机访问存储器(Random Access Memory,RAM)实现。The memory 1003 is configured to store instructions and applications executable by the processor 1001, and can also cache data to be processed or processed by the processor 1001 and various modules in the computer device 1000 (for example, image data, audio data, voice communication data and Video communication data) can be realized by flash memory (FLASH) or random access memory (Random Access Memory, RAM).
应理解,说明书通篇中提到的“一个实施例”或“一实施例”意味着与实施例有关的特定特征、结构或特性包括在本公开的至少一个实施例中。因此,在整个说明书各处出现的“在一个实施例中”或“在一实施例中”未必一定指相同的实施例。此外,这些特定的特征、结构或特性可以任意适合的方式结合在一个或多个实施例中。应理解,在本公开的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本公开实施例的实施过程构成任何限定。上述本公开实施例序号仅仅为了描述,不代表实施例的优劣。It should be understood that reference throughout the specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic related to the embodiment is included in at least one embodiment of the present disclosure. Thus, appearances of "in one embodiment" or "in an embodiment" in various places throughout the specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that in various embodiments of the present disclosure, the sequence numbers of the above-mentioned processes do not mean the order of execution, and the execution order of the processes should be determined by their functions and internal logic, rather than by the embodiments of the present disclosure. The implementation process constitutes any limitation. The serial numbers of the above-mentioned embodiments of the present disclosure are for description only, and do not represent the advantages and disadvantages of the embodiments.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
在本公开所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。In the several embodiments provided in the present disclosure, it should be understood that the disclosed devices and methods may be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or May be integrated into another system, or some features may be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms of.
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元;既可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed to multiple network units; Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本公开各实施例中的各功能单元可以全部集成在一个处理单元中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may be used as a single unit, or two or more units may be integrated into one unit; the above-mentioned integration The unit can be realized in the form of hardware or in the form of hardware plus software functional unit.
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、只读存储器(Read Only Memory,ROM)、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps to realize the above method embodiments can be completed by hardware related to program instructions, and the aforementioned programs can be stored in computer-readable storage media. When the program is executed, the execution includes The steps of the foregoing method embodiments; and the foregoing storage media include: removable storage devices, read-only memory (Read Only Memory, ROM), magnetic disks or optical disks and other media that can store program codes.
或者,本公开上述集成的单元如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本公开的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台电子设备(可以是个人计算机、服务器、或者网络设备等)执行本公开各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、ROM、磁碟或者光盘等各种可以存储程序代码的介质。Alternatively, if the above-mentioned integrated units of the present disclosure are realized in the form of software function modules and sold or used as independent products, they may also be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present disclosure or the part that contributes to related technologies can be embodied in the form of software products, the computer software products are stored in a storage medium, and include several instructions to make a An electronic device (which may be a personal computer, a server, or a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure. The aforementioned storage medium includes various media capable of storing program codes such as removable storage devices, ROMs, magnetic disks or optical disks.
以上所述,仅为本公开的实施方式,但本公开的保护范围并不局限于此,任何熟悉本技术 领域的技术人员在本公开揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本公开的保护范围之内。The above is only the embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope of the present disclosure, and should within the protection scope of the present disclosure.

Claims (19)

  1. 一种数据生成方法,其特征在于,所述方法包括:A method for generating data, characterized in that the method comprises:
    获取第一部位图像,并基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材;Acquiring a first part image, and based on the first part image, displaying at least one first part special effect material to be edited on the first image;
    响应于对所述至少一个第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数;Acquire at least one first special effect display parameter in response to a first special effect editing operation performed on the at least one first part special effect material;
    基于所述至少一个第一特效显示参数,生成特效数据包;其中,所述特效数据包用于在运行的情况下,基于所述至少一个第一特效显示参数和第二部位图像,在第二图像上呈现与所述至少一个第一部位特效素材对应的至少一个第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。Generate a special effect data package based on the at least one first special effect display parameter; wherein the special effect data package is used to, in the second At least one second part special effect material corresponding to the at least one first part special effect material is presented on the image; wherein, the second part image and the first part image include the same type of part.
  2. 根据权利要求1所述的方法,其特征在于,所述第一图像为参考模板图像;基于所述第一部位图像,在所述第一图像上显示所述至少一个待编辑的第一部位特效素材,包括:The method according to claim 1, wherein the first image is a reference template image; based on the first part image, displaying the at least one first part special effect to be edited on the first image material, including:
    基于所述第一部位图像,确定所述至少一个待编辑的第一部位特效素材;determining the at least one first part special effect material to be edited based on the first part image;
    在编辑操作区域显示所述参考模板图像和所述至少一个第一部位特效素材。The reference template image and the at least one first part special effect material are displayed in an editing operation area.
  3. 根据权利要求1或2所述的方法,其特征在于,所述方法还包括:The method according to claim 1 or 2, characterized in that the method further comprises:
    基于所述至少一个第一特效显示参数,在预览图像上呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。Based on the at least one first special effect display parameter, at least one third part special effect material corresponding to the at least one first part special effect material is presented on the preview image.
  4. 根据权利要求3所述的方法,其特征在于,基于所述至少一个第一特效显示参数,在所述预览图像上呈现与所述至少一个第一部位特效素材对应的所述至少一个第三部位特效素材,包括:The method according to claim 3, characterized in that, based on the at least one first special effect display parameter, the at least one third part corresponding to the at least one first part special effect material is presented on the preview image Special effects materials, including:
    响应于在特效预览区域进行的特效预览操作,从第四图像中获取第三部位图像;其中,所述第四图像是与所述预览图像相同或相关的图像,所述第三部位图像与所述第一部位图像包含相同类型的部位;In response to a special effect preview operation performed in the special effect preview area, a third part image is obtained from the fourth image; wherein, the fourth image is an image that is the same as or related to the preview image, and the third part image is identical to the preview image. The first part image contains parts of the same type;
    基于所述第三部位图像和所述至少一个第一特效显示参数,在所述预览图像中实时呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。Based on the third part image and the at least one first special effect display parameter, at least one third part special effect material corresponding to the at least one first part special effect material is presented in real time in the preview image.
  5. 根据权利要求1至4中任一项所述的方法,其特征在于,获取所述第一部位图像,包括:The method according to any one of claims 1 to 4, wherein acquiring the image of the first part comprises:
    响应于在编辑操作区域对所述第一图像进行的部位特效添加操作,从第三图像中获取所述第一部位图像;其中,所述第三图像是与第一图像相同或相关的图像。The first part image is obtained from a third image in response to a part special effect addition operation performed on the first image in the editing operation area; wherein the third image is an image identical to or related to the first image.
  6. 根据权利要求5所述的方法,其特征在于,所述第三图像包括至少一个图像帧;所述至少一个第一部位特效素材包括至少一个特效动画帧;The method according to claim 5, wherein the third image comprises at least one image frame; the at least one first part special effect material comprises at least one special effect animation frame;
    从所述第三图像中获取所述第一部位图像,包括:从所述第三图像的当前图像帧中获取所述第一部位图像;Acquiring the first part image from the third image includes: obtaining the first part image from a current image frame of the third image;
    基于所述第一部位图像,在所述第一图像上显示所述至少一个待编辑的第一部位特效素材,包括:基于所述第一部位图像,在所述第一图像上显示所述至少一个待编辑的第一部位特效素材的一个特效动画帧。Based on the first part image, displaying the at least one first part special effect material to be edited on the first image includes: displaying the at least one to-be-edited first part special effect material on the first image based on the first part image A special effect animation frame of the first part special effect material to be edited.
  7. 根据权利要求1至6中任一项所述的方法,其特征在于,所述至少一个第一部位特效素材中的每一个包括至少一个关键帧;所述第一特效编辑操作包括特效素材数量设置操作和/或帧参数设置操作,所述至少一个第一特效显示参数包括所述至少一个第一部位特效素材中的第一部位特效素材的数量和/或所述至少一个第一部位特效素材中的每一个的关键帧显示参数;The method according to any one of claims 1 to 6, wherein each of said at least one first part special effect material includes at least one key frame; said first special effect editing operation includes setting the number of special effect materials Operation and/or frame parameter setting operation, the at least one first special effect display parameter includes the number of first part special effect materials in the at least one first part special effect material and/or the number of first part special effect materials in the at least one first part special effect material Each of the keyframe display parameters;
    响应于对所述至少一个第一部位特效素材进行的所述第一特效编辑操作,获取所述至少一个第一特效显示参数,包括:In response to the first special effect editing operation performed on the at least one first part special effect material, acquiring the at least one first special effect display parameter includes:
    响应于对所述至少一个第一部位特效素材进行的所述数量设置操作,获取所述至少一个第一部位特效素材中的第一部位特效素材的数量;和/或,In response to the quantity setting operation performed on the at least one first part special effect material, acquire the quantity of the first part special effect material in the at least one first part special effect material; and/or,
    针对所述至少一个第一部位特效素材中的每一个,响应于对该第一部位特效素材的至少一个关键帧进行的所述帧参数设置操作,获取该第一部位特效素材的关键帧显示参数;其中,该第一部位特效素材的关键帧显示参数包括该第一部位特效素材的至少一个关键帧的显示参数,该第一部位特效素材的至少一个关键帧中的每一个关键帧的显示参数包括以下至少之一:可见状态、显示位置、显示大小、旋转角度。For each of the at least one first part special effect material, in response to the frame parameter setting operation performed on at least one key frame of the first part special effect material, acquiring key frame display parameters of the first part special effect material ; Wherein, the key frame display parameters of the first part special effect material include the display parameters of at least one key frame of the first part special effect material, and the display parameters of each key frame in the at least one key frame of the first part special effect material Including at least one of the following: visible state, display position, display size, and rotation angle.
  8. 根据权利要求1至7中任一所述的方法,其特征在于,A method according to any one of claims 1 to 7, characterized in that,
    在所述第一特效编辑操作包括循环显示设置操作的情况下,所述至少一个第一特效显示参数包括所述至少一个第一部位特效素材中的每一个的循环显示参数;所述方法还包括:针对所述至少一个第一部位特效素材中的每一第一部位特效素材,基于该第一部位特效素材的循环显示参数在预览图像上循环显示与该第一部位特效素材对应的第三部位特效素材;In the case where the first special effect editing operation includes a cycle display setting operation, the at least one first special effect display parameter includes a cycle display parameter for each of the at least one first part special effect material; the method further includes : For each first part special effect material in the at least one first part special effect material, based on the cycle display parameters of the first part special effect material, the third part corresponding to the first part special effect material is cyclically displayed on the preview image special effects material;
    在所述第一特效编辑操作包括触发事件编辑操作的情况下,所述至少一个第一特效显示参 数包括所述至少一个第一部位特效素材中的每一个的触发事件;所述方法还包括:针对所述至少一个第一部位特效素材中的每一第一部位特效素材,基于该第一部位特效素材的触发事件,在预览图像上呈现与该第一部位特效素材对应的第三部位特效素材。In the case where the first special effect editing operation includes a trigger event editing operation, the at least one first special effect display parameter includes a trigger event for each of the at least one first part special effect material; the method further includes: For each first part special effect material in the at least one first part special effect material, based on a trigger event of the first part special effect material, present a third part special effect material corresponding to the first part special effect material on the preview image .
  9. 根据权利要求1至8中任一项所述的方法,其特征在于,所述至少一个第一部位特效素材包括至少两个第一部位特效素材,响应于对所述至少一个第一部位特效素材进行的所述第一特效编辑操作,获取所述至少一个第一特效显示参数,包括:The method according to any one of claims 1 to 8, wherein the at least one first part special effect material comprises at least two first part special effect materials, and in response to the at least one first part special effect material The first special effect editing operation performed to obtain the at least one first special effect display parameter includes:
    响应于对所述至少两个第一部位特效素材进行的组合操作,获取至少一个第一特效素材组合;Acquire at least one combination of first special effect materials in response to a combination operation performed on the at least two first part special effect materials;
    针对所述至少一个第一特效素材组合中的每一个第一特效素材组合,响应于对该第一特效素材组合进行的组合特效编辑操作,获取该第一特效素材组合的第三特效显示参数;For each first special effect material combination in the at least one first special effect material combination, in response to a combined special effect editing operation performed on the first special effect material combination, acquire a third special effect display parameter of the first special effect material combination;
    所述方法还包括:针对所述至少一个第一特效素材组合中的每一第一特效素材组合,基于该第一特效素材组合的第三特效显示参数,在预览图像上呈现与该第一特效素材组合对应的第三特效素材组合;所述第三特效素材组合包括与该第一特效素材组合对应的至少两个第三部位特效素材。The method further includes: for each first special effect material combination in the at least one first special effect material combination, based on the third special effect display parameters of the first special effect material combination, presenting on the preview image A third special effect material combination corresponding to the material combination; the third special effect material combination includes at least two third part special effect materials corresponding to the first special effect material combination.
  10. 根据权利要求9所述的方法,其特征在于,响应于对所述至少两个第一部位特效素材进行的所述组合操作,获取所述至少一个第一特效素材组合,包括:The method according to claim 9, wherein, in response to the combination operation performed on the at least two first part special effect materials, obtaining the at least one first special effect material combination includes:
    响应于在编辑操作区域进行的特效素材选择操作,选定所述至少两个第一部位特效素材中的至少两者;Selecting at least two of the at least two first part special effect materials in response to a special effect material selection operation performed in the editing operation area;
    响应于对所述选定的第一部位特效素材进行的组合操作,获取所述至少一个第一特效素材组合。In response to a combination operation performed on the selected first part special effect material, the at least one first special effect material combination is acquired.
  11. 根据权利要求1至10中任一项所述的方法,其特征在于,基于所述第一部位图像,在所述第一图像上显示所述至少一个待编辑的第一部位特效素材之前,所述方法还包括:The method according to any one of claims 1 to 10, wherein, based on the first part image, before displaying the at least one first part special effect material to be edited on the first image, the The method also includes:
    响应于对所述第一图像进行的第二特效编辑操作,获取至少一个第二特效显示参数;Acquiring at least one second special effect display parameter in response to a second special effect editing operation performed on the first image;
    基于所述至少一个第二特效显示参数,在所述第一图像上呈现第一特效效果;presenting a first special effect on the first image based on the at least one second special effect display parameter;
    获取所述第一部位图像,包括:响应于对呈现所述第一特效效果的所述第一图像进行的部位特效添加操作,从呈现所述第一特效效果的所述第一图像中获取所述第一部位图像。Acquiring the first part image includes: in response to a part special effect addition operation performed on the first image presenting the first special effect, acquiring the first part image from the first image presenting the first special effect Describe the image of the first part.
  12. 根据权利要求11所述的方法,其特征在于,所述第一部位图像包括的部位为头部,所述至少一个第一部位特效素材包括头部特效素材,所述部位特效添加操作包括头部特效添加操作,所述第一特效效果包括人脸美化特效;The method according to claim 11, wherein the part included in the first part image is a head, the at least one first part special effect material includes a head special effect material, and the part special effect adding operation includes a head Special effect adding operation, the first special effect effect includes human face beautification special effect;
    基于所述第一部位图像,在所述第一图像上显示所述至少一个待编辑的第一部位特效素材,包括:Based on the first part image, displaying the at least one first part special effect material to be edited on the first image includes:
    基于所述第一部位图像,在呈现所述人脸美化特效的所述第一图像上显示至少一个待编辑的头部特效素材;其中,所述至少一个待编辑的头部特效素材中的每一个中的人脸呈现所述人脸美化特效。Based on the first part image, display at least one head special effect material to be edited on the first image presenting the face beautification special effect; wherein, each of the at least one head special effect material to be edited The human face in one presents the human face beautification special effect.
  13. 根据权利要求1至12中任一项所述的方法,其特征在于,基于所述至少一个第一特效显示参数,生成所述特效数据包之前,所述方法还包括:The method according to any one of claims 1 to 12, wherein, based on the at least one first special effect display parameter, before generating the special effect data package, the method further comprises:
    响应于对所述至少一个第一部位特效素材进行的背景设置操作,更新所述至少一个第一特效显示参数;updating the at least one first special effect display parameter in response to a background setting operation performed on the at least one first part special effect material;
    基于所述更新后的至少一个第一特效显示参数,在预览图像上显示设置的背景,并在设置有所述背景的预览图像上呈现与所述至少一个第一部位特效素材对应的至少一个第三部位特效素材。Based on the updated at least one first special effect display parameter, display the set background on the preview image, and present at least one first part special effect material corresponding to the at least one first part special effect material on the preview image with the background Three-part special effect material.
  14. 一种图像处理方法,其特征在于,所述方法包括:An image processing method, characterized in that the method comprises:
    获取待处理的第二图像;Obtain the second image to be processed;
    响应于对所述第二图像进行的特效选择操作,基于运行的特效数据包,确定至少一个第一特效显示参数和待识别的部位;In response to a special effect selection operation performed on the second image, based on the running special effect data package, determine at least one first special effect display parameter and a part to be recognized;
    基于所述待识别的部位,从第五图像中获取第二部位图像;其中,所述第五图像是与所述第二图像相同或相关的图像;Obtaining a second part image from a fifth image based on the part to be identified; wherein the fifth image is the same as or related to the second image;
    基于所述至少一个第一特效显示参数和所述第二部位图像,在所述第二图像上呈现至少一个第二部位特效素材。Presenting at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
  15. 一种数据生成装置,其特征在于,包括:A data generating device, characterized in that it comprises:
    第一显示模块,用于获取第一部位图像,并基于所述第一部位图像,在第一图像上显示至少一个待编辑的第一部位特效素材;A first display module, configured to acquire a first part image, and based on the first part image, display at least one first part special effect material to be edited on the first image;
    第一编辑模块,用于响应于对所述至少一个第一部位特效素材进行的第一特效编辑操作,获取至少一个第一特效显示参数;A first editing module, configured to acquire at least one first special effect display parameter in response to a first special effect editing operation performed on the at least one first part special effect material;
    生成模块,用于基于所述至少一个第一特效显示参数,生成特效数据包;其中,所述特效 数据包用于在运行的情况下,基于所述至少一个第一特效显示参数和第二部位图像,在第二图像上呈现与所述至少一个第一部位特效素材对应的至少一个第二部位特效素材;其中,所述第二部位图像与所述第一部位图像包含相同类型的部位。A generating module, configured to generate a special effect data package based on the at least one first special effect display parameter; wherein, the special effect data package is used to generate a special effect data package based on the at least one first special effect display parameter and the second part during operation An image, presenting at least one second part special effect material corresponding to the at least one first part special effect material on the second image; wherein, the second part image and the first part image include the same type of part.
  16. 一种图像处理装置,其特征在于,包括:An image processing device, characterized in that it comprises:
    第三获取模块,用于获取待处理的第二图像;A third acquisition module, configured to acquire the second image to be processed;
    第四获取模块,用于响应于对所述第二图像进行的特效选择操作,基于运行的特效数据包,确定至少一个第一特效显示参数和待识别的部位;The fourth acquisition module is configured to determine at least one first special effect display parameter and a part to be recognized based on the running special effect data package in response to the special effect selection operation performed on the second image;
    第五获取模块,用于基于所述待识别的部位,从第五图像中获取第二部位图像;其中,所述第五图像是与所述第二图像相同或相关的图像;A fifth acquisition module, configured to acquire a second part image from a fifth image based on the part to be identified; wherein the fifth image is an image that is the same as or related to the second image;
    第八显示模块,用于基于所述至少一个第一特效显示参数和所述第二部位图像,在所述第二图像上呈现至少一个第二部位特效素材。An eighth display module, configured to present at least one second part special effect material on the second image based on the at least one first special effect display parameter and the second part image.
  17. 一种计算机设备,包括存储器和处理器,所述存储器存储有可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现权利要求1至14任一项所述方法中的步骤。A computer device, comprising a memory and a processor, the memory stores a computer program that can run on the processor, wherein the processor implements any one of claims 1 to 14 when executing the program steps in the method.
  18. 一种计算机存储介质,其上存储有计算机程序,其特征在于,该计算机程序被处理器执行时实现权利要求1至14任一项所述方法中的步骤。A computer storage medium on which a computer program is stored, wherein the computer program implements the steps in the method of any one of claims 1 to 14 when the computer program is executed by a processor.
  19. 一种计算机程序产品,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,所述计算机程序被计算机读取并执行时,实现权利要求1至14中任一项所述方法中的步骤。A computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, it realizes any one of claims 1 to 14 steps in the method.
PCT/CN2022/127583 2021-08-31 2022-10-26 Data generation method, image processing method, apparatuses, device, and storage medium WO2023030550A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111016566.XA CN113760161A (en) 2021-08-31 2021-08-31 Data generation method, data generation device, image processing method, image processing device, equipment and storage medium
CN202111016566.X 2021-08-31

Publications (1)

Publication Number Publication Date
WO2023030550A1 true WO2023030550A1 (en) 2023-03-09

Family

ID=78792291

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/127583 WO2023030550A1 (en) 2021-08-31 2022-10-26 Data generation method, image processing method, apparatuses, device, and storage medium

Country Status (2)

Country Link
CN (1) CN113760161A (en)
WO (1) WO2023030550A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116896649A (en) * 2023-09-11 2023-10-17 北京达佳互联信息技术有限公司 Live interaction method and device, electronic equipment and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760161A (en) * 2021-08-31 2021-12-07 北京市商汤科技开发有限公司 Data generation method, data generation device, image processing method, image processing device, equipment and storage medium
CN116777940B (en) * 2023-08-18 2023-11-21 腾讯科技(深圳)有限公司 Data processing method, device, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108259496A (en) * 2018-01-19 2018-07-06 北京市商汤科技开发有限公司 The generation of special efficacy program file packet and special efficacy generation method and device, electronic equipment
CN108711180A (en) * 2018-05-02 2018-10-26 北京市商汤科技开发有限公司 Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device
CN110287368A (en) * 2019-05-31 2019-09-27 上海萌鱼网络科技有限公司 The generation method of short-sighted frequency stencil design figure generating means and short video template
CN110503724A (en) * 2019-08-19 2019-11-26 北京猫眼视觉科技有限公司 A kind of AR expression resource construction management system and method based on human face characteristic point
CN113055611A (en) * 2019-12-26 2021-06-29 北京字节跳动网络技术有限公司 Image processing method and device
CN113760161A (en) * 2021-08-31 2021-12-07 北京市商汤科技开发有限公司 Data generation method, data generation device, image processing method, image processing device, equipment and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860168B (en) * 2018-02-08 2022-08-02 北京市商汤科技开发有限公司 Method and device for generating special-effect program file package and special effect, and electronic equipment
CN108536790A (en) * 2018-03-30 2018-09-14 北京市商汤科技开发有限公司 The generation of sound special efficacy program file packet and sound special efficacy generation method and device
CN111627086A (en) * 2020-06-03 2020-09-04 上海商汤智能科技有限公司 Head portrait display method and device, computer equipment and storage medium
CN112165632B (en) * 2020-09-27 2022-10-04 北京字跳网络技术有限公司 Video processing method, device and equipment
CN113240777A (en) * 2021-04-25 2021-08-10 北京达佳互联信息技术有限公司 Special effect material processing method and device, electronic equipment and storage medium
CN114432696A (en) * 2021-12-22 2022-05-06 网易(杭州)网络有限公司 Special effect configuration method and device of virtual object, storage medium and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108259496A (en) * 2018-01-19 2018-07-06 北京市商汤科技开发有限公司 The generation of special efficacy program file packet and special efficacy generation method and device, electronic equipment
CN108711180A (en) * 2018-05-02 2018-10-26 北京市商汤科技开发有限公司 Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device
CN110287368A (en) * 2019-05-31 2019-09-27 上海萌鱼网络科技有限公司 The generation method of short-sighted frequency stencil design figure generating means and short video template
CN110503724A (en) * 2019-08-19 2019-11-26 北京猫眼视觉科技有限公司 A kind of AR expression resource construction management system and method based on human face characteristic point
CN113055611A (en) * 2019-12-26 2021-06-29 北京字节跳动网络技术有限公司 Image processing method and device
CN113760161A (en) * 2021-08-31 2021-12-07 北京市商汤科技开发有限公司 Data generation method, data generation device, image processing method, image processing device, equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116896649A (en) * 2023-09-11 2023-10-17 北京达佳互联信息技术有限公司 Live interaction method and device, electronic equipment and storage medium
CN116896649B (en) * 2023-09-11 2024-01-19 北京达佳互联信息技术有限公司 Live interaction method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113760161A (en) 2021-12-07

Similar Documents

Publication Publication Date Title
WO2023030550A1 (en) Data generation method, image processing method, apparatuses, device, and storage medium
WO2022001593A1 (en) Video generation method and apparatus, storage medium and computer device
US9626788B2 (en) Systems and methods for creating animations using human faces
WO2019242454A1 (en) Object modeling movement method, apparatus and device
CN114930399A (en) Image generation using surface-based neurosynthesis
CN113709549A (en) Special effect data packet generation method, special effect data packet generation device, special effect data packet image processing method, special effect data packet image processing device, special effect data packet image processing equipment and storage medium
US20220270265A1 (en) Whole body visual effects
CN113766296A (en) Live broadcast picture display method and device
WO2023185809A1 (en) Video data generation method and apparatus, and electronic device and storage medium
US20230419497A1 (en) Whole body segmentation
CN109074680A (en) Realtime graphic and signal processing method and system in augmented reality based on communication
CN113965773A (en) Live broadcast display method and device, storage medium and electronic equipment
US20210248789A1 (en) Intelligent Real-time Multiple-User Augmented Reality Content Management and Data Analytics System
US20220094653A1 (en) Augmenting image content with sound
JP2017045374A (en) Information processing device and program
KR20240007255A (en) Combining features into shortcuts within a messaging system
EP4285329A1 (en) Automatic creation of a photorealistic customized animated garmented avatar
US20230195856A1 (en) Method for media creation, sharing, and communication and associated system
US20230376179A1 (en) Combining third-party content with user content
US20240069627A1 (en) Contextual memory experience triggers system
US20240069626A1 (en) Timelapse re-experiencing system
US20240071004A1 (en) Social memory re-experiencing system
US20240087266A1 (en) Deforming real-world object using image warping
CN115619901A (en) Material editing method and device, electronic equipment and storage medium
TWM599417U (en) Intelligent image stitching system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22863684

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE