CN108898650B - Human-shaped material creating method and related device - Google Patents
Human-shaped material creating method and related device Download PDFInfo
- Publication number
- CN108898650B CN108898650B CN201810623737.7A CN201810623737A CN108898650B CN 108898650 B CN108898650 B CN 108898650B CN 201810623737 A CN201810623737 A CN 201810623737A CN 108898650 B CN108898650 B CN 108898650B
- Authority
- CN
- China
- Prior art keywords
- target
- image
- target person
- ornament
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
Abstract
The application discloses a humanoid material creating method and a related device, which are applied to electronic equipment and comprise the following steps: acquiring a target image, wherein the target image comprises a video of the head of a target person; when the target image is detected to comprise the image of at least one target ornament, at least one first material of a target person is created according to the image of the at least one target ornament, wherein each first material corresponds to one target ornament; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except for the image of the at least one target ornament; and generating human-shaped materials of the target person according to the at least one first material and the second material, wherein the human-shaped materials support the action following function. The method and the device are beneficial to improving the accuracy and efficiency of the electronic equipment for creating the materials.
Description
Technical Field
The present application relates to the field of electronic technologies, and in particular, to a method and a related apparatus for creating a human-shaped material.
Background
With the rapid development and the increasing popularity of the technology of the intelligent terminal (such as a smart phone), the technology of the intelligent terminal is now an indispensable electronic product in the daily life of users. Some current application programs of the mobile phone can generate cartoon-type emoji expressions, the emoji expressions are generally prestored in the mobile phone as material templates, and a user can use the materials to synthesize pictures and the like after selecting one material.
Disclosure of Invention
The embodiment of the application provides a humanoid material creating method and a related device, provides a method for dynamically creating a complex humanoid material, and improves the accuracy and efficiency of creating the material by electronic equipment.
In a first aspect, an embodiment of the present application provides a method for creating a human-shaped material, which is applied to an electronic device, and the method includes:
acquiring a target image, wherein the target image comprises a video of the head of a target person;
when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament;
creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament;
and generating a human-shaped material of the target person according to the at least one first material and the second material, wherein the human-shaped material supports an action following function.
In a second aspect, embodiments of the present application provide a human-shaped material creation apparatus for use in an electronic device, the human-shaped material creation apparatus comprising a processing unit and a communication unit, wherein,
the processing unit is used for acquiring a target image through the communication unit, wherein the target image comprises a video of the head of a target person; when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament; and generating human-shaped materials of the target person according to the at least one first material and the second material, wherein the human-shaped materials support an action following function.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing steps in any method in the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods of the first aspect of the present application.
It can be seen that, in the embodiment of the present application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally a human-shaped material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the human-shaped material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.
FIG. 1A is a schematic diagram of a program runtime space of a smart phone;
FIG. 1B is a system architecture diagram of an android system;
fig. 2 is a schematic flowchart of a method for creating a human-shaped material according to an embodiment of the present application;
FIG. 3 is a schematic flow chart diagram of another human-shaped material creating method disclosed in the embodiments of the present application;
FIG. 4 is a schematic flow chart diagram of another human-shaped material creating method disclosed in the embodiments of the present application;
fig. 5 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application;
fig. 6 is a block diagram of functional units of a human-shaped material creating apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a graphics processing circuit according to an embodiment of the present disclosure.
Detailed description of the invention
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort shall fall within the protection scope of the present application.
The following are detailed below.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
As shown in fig. 1A, currently, an electronic device such as a smart phone is generally provided with a program running space, where the program running space includes a user space and an operating system space, where the user space runs one or more application programs, and the one or more application programs are third-party application programs installed in the electronic device.
The electronic device can specifically run an Android system, a mobile operating system iOS developed by apple Inc., and the like, and the electronic device is not limited herein. As shown in fig. 1B, for example that the electronic device runs an Android system, the corresponding user space includes an Application layer (Applications) in the Android system, and the operating system space may include an Application Framework layer (Application Framework) in the Android system, a system Runtime library layer (including system Runtime Libraries and Android Runtime runtimes), and a Linux Kernel layer (Linux Kernel). The application layer comprises various application programs which are directly interacted with a user or service programs which are written by Java language and run in a background. For example, programs that implement common basic functions on smartphones, such as Short Messaging Service (SMS) SMS, phone dialing, picture viewer, calendar, games, maps, world Wide Web (Web) browser, and other applications developed by developers. The application framework layer provides a series of class libraries required by Android application development, can be used for reusing components, and can also realize personalized extension through inheritance. The system operation library layer is a support of an application program framework and provides services for all components in the Android system. The system operation library layer is composed of a system class library and Android operation. The Android operation comprises a core library and a Dalvik virtual machine. The Linux kernel layer is used for realizing core functions such as hardware device driving, process and memory management, a network protocol stack, power management, wireless communication and the like.
Electronic devices may include various handheld devices, vehicle-mounted devices, wearable devices (e.g., smartwatches, smartbands, pedometers, etc.), computing devices or other processing devices connected to wireless modems, as well as various forms of User Equipment (UE), mobile Stations (MS), terminal Equipment (terminal device), and so forth, having wireless communication capabilities. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.
The following describes embodiments of the present application in detail.
Referring to fig. 2, fig. 2 is a schematic flowchart of a human-shaped material creating method applied to an electronic device according to an embodiment of the present application, where the human-shaped material creating method includes:
s201, the electronic equipment acquires a target image, wherein the target image comprises a video of the head of a target person;
the image of the head of the target person may include images of partial objects such as a face, hair, and decorations.
S202, when the electronic equipment detects that the target image comprises at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament.
Each first material supports an independent editing function, and the material editing flexibility and intelligence are improved.
Wherein the target ornament comprises at least one of: glasses, hats, headwear, and the like.
In one implementation, after the electronic device creates at least one first material, each first material may be presented in a current display interface of the display screen, where a color and a style of the first material are close to a corresponding target ornament, and if the glasses worn by the target user are black and a circular frame, the first material corresponding to the glasses may also be a cartoon-type glasses, and the color is not black, and the shape is circular, or the color and/or the shape may be changed according to a facial expression of the current user, and if a user color expression is detected, the color of the glasses is updated to black, and a lens portion may also be processed in a sunglasses style, and the like, which are not limited uniquely herein.
In another implementation, after at least one first material is created, the electronic device may present each first material in a current display interface of the display screen, and may display a setting interface of a certain first material when a selection operation for the first material is detected, where a color and a style of the first material may be set by a user.
S203, the electronic equipment creates a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except for the image of the at least one target ornament;
the second pixel may be an emoji head portrait of a 3D animation type, or emoji head portraits of various preset styles such as sketch, sketching and oil painting, which are not limited herein. The face appearance feature of the second material is similar to the face feature of the user, for example, if the user has large eyes and small mouth, the eye and mouth feature of the second material may be large eyes and small mouth.
S204, the electronic equipment generates human-shaped materials of the target person according to the at least one first material and the second material, and the human-shaped materials support an action following function.
The action following function means that a certain part (such as a face, a head, a trunk and the like) of the generated human-shaped material can follow the action of the corresponding part of the user to act, and the emoji expression with a 3D effect is presented. The human-shaped material is a preset type human image with 3D style characteristics.
It can be seen that, in the embodiment of the present application, the electronic device first obtains a target image, where the target image includes an image of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally a human-shaped material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the human-shaped material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
In one possible example, the electronic device creating at least one first material of the target person from imagery of the at least one target ornament includes: the electronic device determining characteristic information for each of the at least one target ornament, the characteristic information including contour information; and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
The electronic device may specifically import characteristic information of the target ornament into a preconfigured material creation engine to create a corresponding first material.
It can be seen that, in the present example, the electronic apparatus is able to create the first material based on the contour information of the target ornament, and since the contour information is an attribute parameter that most directly reflects the appearance feature of the object, employing the contour information to create the first material can improve the accuracy with which the electronic apparatus creates the first material.
In one possible example, the electronic device creates a second pixel of the target person according to other images in the target image, including: the electronic equipment removes the image of the at least one target ornament in the target image to obtain an updated target image; determining facial feature information in the updated target image; and creating a second story of the target person according to the facial feature information.
Wherein the facial feature information includes at least one of: eye size contour, nose contour, cheek contour, forehead, chin, mouth contour, hairstyle contour, etc., and may also include eye color, skin tone, etc.
As can be seen, in this example, since the contour and the color of the organ of the face of the user are the most dominant and intuitive features of the face, the electronic device analyzes the type of features to create the second material, so that a material with a higher similarity to the face of the user can be created, and the accuracy of creating the second material by the electronic device is improved.
In one possible example, the electronic device generating the humanoid material of the target person from the at least one first and second materials includes: the electronic equipment synthesizes the at least one first material and the second material to obtain a head material of the target person; and creating human-shaped materials of the target person according to the head materials.
In this possible example, the electronic device creating humanoid material of the target person from the head material includes: the electronic device selecting body material adapted to the head material; and combining the head material and the body material to obtain the human-shaped material of the target person.
The first material and the second material both support independent editing and are free of constraint.
Therefore, in this example, the electronic device can quickly create the first material and the second material only by acquiring a single target image, and the user does not need to take off glasses to create the second material, so that the method is quick and efficient.
In one possible example, after the electronic device has generated the anthropomorphic material of the target person from the at least one first and second materials, the method further comprises: acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person; and calling the updated human-shaped materials in the process of photographing or recording.
As can be seen, in this example, after the electronic device creates the human-shaped material, the electronic device may further edit the first material and/or the second material to update the human-shaped material, so that the convenience, flexibility, and efficiency of the material are improved.
In one possible example, the electronic device generating the humanoid story of the target person from the at least one first story and the second story includes: acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material; and creating human-shaped materials of the target person according to the head materials.
Therefore, in this example, the electronic device may receive an editing instruction of a user to perform real-time dynamic editing during the process of creating the human-shaped material, specifically, after creating the first material and the second material, and finally, a determined human-shaped material is generated, so that the flexibility of editing the material is improved.
In one possible example, the electronic device acquires a target image, including: when the electronic equipment detects a humanoid material creation request, shooting the target person to obtain a target image; alternatively, the first and second electrodes may be,
the electronic device receives a target image of the target person from a server.
The image data obtained by the electronic device shooting the target person can be YUV data or RGBA data.
Therefore, in the example, the target image is acquired flexibly and efficiently.
Referring to fig. 3, fig. 3 is a schematic flowchart of a method for creating a human-shaped material according to an embodiment of the present application, and is applied to an electronic device. As shown in the figure, the method for creating the morphic plain material comprises the following steps:
s301, the electronic equipment acquires a target image, wherein the target image comprises a video of the head of a target person;
s302, when detecting that the target image includes an image of at least one target ornament, the electronic device determines feature information of each target ornament in the at least one target ornament, wherein the feature information includes contour information;
and S303, the electronic equipment creates corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
S304, the electronic equipment removes the image of the at least one target ornament in the target image to obtain an updated target image;
s305, the electronic equipment determines the facial feature information in the updated target image;
s306, the electronic equipment creates a second material of the target person according to the facial feature information, and the second material corresponds to the facial features of the target person.
S307, the electronic equipment synthesizes the at least one first material and the second material to obtain a head material of the target person;
s308, the electronic equipment creates human-shaped materials of the target person according to the head materials.
S309, the electronic equipment acquires an editing instruction of a user for a target material, updates the target material according to the editing instruction, and obtains an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material;
s310, the electronic equipment synthesizes the updated target material and the non-updated material to obtain the updated human figure material of the target person;
s311, the electronic equipment calls the updated human-shaped material in the process of photographing or video recording.
It can be seen that, in the embodiment of the application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create materials corresponding to the ornament and materials corresponding to the facial data of the user according to the complex figure image wearing the ornament in a hierarchical mode, the function of AR display can be enhanced through the following of facial expression actions, compared with the mode of selecting pre-stored fixed materials or integrally creating the materials, the method is more flexible, the method also meets the personalized requirements of the user, and the accuracy and flexibility of creating the materials by the electronic equipment are improved.
Further, the electronic apparatus can create the first material based on the contour information of the object ornament, and since the contour information is an attribute parameter that most directly reflects the appearance feature of the object, employing the contour information to create the first material can improve the accuracy with which the electronic apparatus creates the first material.
In addition, because the outline and the color of the face organ of the user are the most obvious and intuitive features of the face, the electronic equipment analyzes the type features to create the second material, the material with high similarity to the face of the user can be created, and the accuracy of creating the second material by the electronic equipment is improved.
In addition, the electronic equipment can quickly create the first material and the second material only by acquiring a single target image, a user does not need to take off glasses to create the second material, and the method is quick and efficient.
In addition, after the electronic equipment creates the human-shaped material, the electronic equipment can further edit the first material and/or the second material so as to update the human-shaped material, and the convenience, flexibility and efficiency of the material are improved.
Referring to fig. 4, fig. 4 is a schematic flowchart of a method for creating a human-shaped material according to an embodiment of the present application, and is applied to an electronic device, consistent with the embodiment shown in fig. 2. As shown in the figure, the method for creating the morphic element comprises the following steps:
s401, the electronic equipment acquires a target image, wherein the target image comprises a video of the head of a target person;
s402, when the electronic equipment detects that the target image comprises at least one image of a target ornament, determining characteristic information of each target ornament in the at least one target ornament, wherein the characteristic information comprises contour information;
s403, the electronic equipment creates corresponding first materials according to the characteristic information of each target ornament, and at least one first material of the target person is obtained.
S404, the electronic equipment removes the image of the at least one target ornament in the target image to obtain an updated target image;
s405, the electronic equipment determines the facial feature information in the updated target image;
s406, the electronic equipment creates a second material of the target person according to the facial feature information, wherein the second material corresponds to the facial features of the target person.
S407, the electronic device acquires an editing instruction of a user for a target material, updates the target material according to the editing instruction, and obtains an updated target material, wherein the target material comprises any one or more of the at least one first material and the second material;
s408, the electronic equipment synthesizes the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material;
s409, the electronic equipment creates human-shaped materials of the target person according to the head materials.
It can be seen that, in the embodiment of the application, the electronic device first obtains a target image, where the target image includes an image of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
Further, the electronic apparatus can create the first material based on the contour information of the object ornament, and since the contour information is an attribute parameter that most directly reflects the appearance feature of the object, employing the contour information to create the first material can improve the accuracy with which the electronic apparatus creates the first material.
In addition, because the outline and the color of the face organ of the user are the most obvious and intuitive features of the face, the electronic equipment analyzes the type features to create the second material, the material with high similarity to the face of the user can be created, and the accuracy of creating the second material by the electronic equipment is improved.
In addition, the electronic equipment only needs to acquire a single target image, can quickly create the first material and the second material, does not need a user to take off glasses to create the second material, and is quick and efficient.
In addition, the electronic equipment can receive the editing instruction of a user to carry out real-time dynamic editing in the process of creating the human-shaped material, particularly after the first material and the second material are created, and finally, the determined human-shaped material is generated, so that the editing flexibility of the material is improved.
In accordance with the embodiments shown in fig. 2, fig. 3, and fig. 4, please refer to fig. 5, fig. 5 is a schematic structural diagram of an electronic device 500 provided in this embodiment, where the electronic device 500 runs one or more application programs and an operating system, as shown in the figure, the electronic device 500 includes a processor 510, a memory 520, a communication interface 530, and one or more programs 521, where the one or more programs 521 are stored in the memory 520 and configured to be executed by the processor 510, and the one or more programs 521 include instructions for performing the following steps;
acquiring a target image, wherein the target image comprises a video of the head of a target person;
when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament;
creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament;
and generating a human-shaped material of the target person according to the at least one first material and the at least one second material, wherein the human-shaped material supports an action following function.
It can be seen that, in the embodiment of the present application, the electronic device first obtains a target image, where the target image includes an image of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
In one possible example, in the creating of the at least one first material of the target person from the imagery of the at least one target ornament, the instructions in the program are specifically configured to: determining characteristic information for each of the at least one target ornament, the characteristic information including contour information; and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
In one possible example, in the aspect of creating the second pixel of the target person from the other images in the target image, the instructions in the program are specifically configured to: removing the image of the at least one target ornament in the target image to obtain an updated target image; and determining facial feature information in the updated target image; and creating a second story of the target person based on the facial feature information.
In one possible example, the instructions in the program are specifically configured to, in the generating the anthropomorphic material of the target person from the at least one first and second materials, perform the following: synthesizing the at least one first material and the second material to obtain a head material of the target person; and creating human-shaped materials of the target person according to the head materials.
In one possible example, the program further includes instructions for: after the humanoid materials of the target person are generated according to the at least one first material and the second material, obtaining an editing instruction of a user for the target materials, and updating the target materials according to the editing instruction to obtain updated target materials, wherein the target materials comprise any one or more of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person; and calling the updated human-shaped materials in the process of photographing or video recording.
In one possible example, the instructions in the program are specifically configured to, in the generating the anthropomorphic material of the target person from the at least one first and second materials, perform the following: acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material; and creating human-shaped materials of the target person according to the head materials.
In one possible example, in respect of said acquiring a target image, the instructions in the program are specifically adapted to perform the following operations: when a human-shaped material creating request is detected, shooting the target person to obtain a target image; alternatively, the first and second liquid crystal display panels may be,
receiving a target image of the target person from a server.
The above embodiments mainly introduce the scheme of the embodiments of the present application from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be implemented in the form of hardware, and can also be implemented in the form of a software functional unit. It should be noted that, in the embodiment of the present application, the division of the unit is schematic, and is only one logic function division, and when the actual implementation is realized, another division manner may be provided.
The following is an embodiment of the apparatus of the present invention, which is used to perform the method implemented by the embodiment of the method of the present invention. The human-shaped material creating apparatus 600 shown in fig. 6, which is applied to an electronic device, includes a processing unit 601 and a communication unit 602, wherein,
the processing unit 601 is configured to obtain a target image through the communication unit 602, where the target image includes a video of a head of a target person; when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament; and generating human-shaped materials of the target person according to the at least one first material and the second material, wherein the human-shaped materials support an action following function.
The human-shaped material creating apparatus may further include a storage unit 603 for storing program codes and data of the electronic device. The processing unit 601 may be a processor, the communication unit 602 may be an image capturing device, an input device or a transceiver, and the storage unit 603 may be a memory.
It can be seen that, in the embodiment of the present application, the electronic device first obtains a target image, where the target image includes an image of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally a human-shaped material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the human-shaped material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
In one possible example, in the aspect of the creating at least one first story of the target person based on imagery of the at least one target ornament, the processing unit 601 is specifically configured to: determining characteristic information for each of the at least one target ornament, the characteristic information including contour information; and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
In one possible example, in the aspect of creating the second pixel of the target person according to the other videos in the target image, the processing unit 601 is specifically configured to: removing the image of the at least one target ornament in the target image to obtain an updated target image; and determining facial feature information in the updated target image; and creating a second story of the target person based on the facial feature information.
In one possible example, in the aspect of generating the anthropomorphic material of the target person based on the at least one first and second materials, the processing unit 601 is specifically configured to: synthesizing the at least one first material and the second material to obtain a head material of the target person; and creating human-shaped materials of the target person according to the head materials.
In one possible example, the processing unit 601, after generating the humanoid story of the target person from the at least one first story and the second story, is further configured to: acquiring an editing instruction of a user for a target material through the communication unit 601, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person; and calling the updated human-shaped materials in the process of photographing or video recording.
In one possible example, in the aspect of generating the humanoid story of the target person from the at least one first story and the second story, the processing unit 601 is specifically configured to: acquiring an editing instruction of a user for a target material through the communication unit 602, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material; and creating human-shaped materials of the target person according to the head materials.
In one possible example, in terms of acquiring the target image through the communication unit 602, the processing unit 601 is specifically configured to: when a human-shaped material creating request is detected, shooting the target person to obtain a target image; alternatively, the first and second liquid crystal display panels may be,
receiving a target image of the target person from a server.
The embodiment of the invention also provides another electronic device. The electronic device includes an image processing circuit, which may be implemented by hardware and/or software components, and may specifically include various processing units. Fig. 7 is an exemplary diagram of an image processing circuit. As shown in fig. 7, for convenience of explanation, only relevant processing units related to the image processing aspect related to the embodiment of the present application are shown.
As shown in fig. 7, the Image Processing circuit may include an Image Signal Processing (ISP) processor 740 and control logic 750. The image data captured by imaging device 710 is first processed by ISP processor 740, and ISP processor 740 analyzes the image data to capture image statistics for determining control parameters of imaging device 710. The imaging device 710 may be a camera having a lens 712 and an image sensor 714. The image sensor 714 may include an array of color filters (e.g., bayer filters), each imaging pixel of the image sensor 714 may capture intensity and wavelength information of ambient light, and the image sensor 714 transmits raw image data to the ISP processor 740. The sensor 720 may provide raw image data to the ISP processor 740 based on a preset interface. The default interface includes a Standard Mobile Imaging Architecture (SMIA) interface, other serial or parallel camera interfaces, or a combination thereof.
The ISP processor 740 may perform an image processing operation, such as a filtering process, when receiving raw image data from a preset interface or from the image memory 730. The processed image data may be sent to image memory 730 for further processing prior to display. ISP processor 740 receives processed data from image memory 730 and performs image data processing on the processed data in the raw domain and RGB and YCbCr color spaces. The processed image data may be output to a display 770 for viewing by a user and/or further processed by a Graphics Processing Unit (GPU). Further, the output of ISP processor 740 may also be sent to image memory 730 and display 770 may read image data from image memory 730. In one embodiment, image memory 730 may be configured to implement one or more frame buffers. In addition, the output of ISP processor 740 may be sent to encoder/decoder 760 for encoding/decoding image data. The encoded image data may be saved and decompressed before being displayed on the display 770 device. The encoder/decoder 760 may be implemented by a CPU or GPU or coprocessor.
The statistical data determined by ISP processor 740 may be sent to control logic 750 unit. For example, the statistical data may include image sensor 714 statistics such as auto-exposure, auto-white balance, auto-focus, flicker detection, black level compensation, lens 712 shading correction, and the like. Control logic 750 may be a processor and/or microcontroller and one or more routines may determine control parameters of imaging device 710 based on the received statistical data. For example, the control parameters may include sensor 720 control parameters (e.g., gain, integration time for exposure control), camera flash control parameters, lens 712 control parameters (e.g., focal length for focusing or zooming), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), as well as lens 712 shading correction parameters.
The following is the steps related to the image display in the embodiment of the method implemented by using the image processing technique in fig. 7.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any one of the methods as set out in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be noted that for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the above-described units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some interfaces, indirect coupling or communication connection between devices or units, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps of the methods of the above embodiments may be implemented by a program, which is stored in a computer-readable memory, the memory including: flash Memory disks, read-Only memories (ROMs), random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (8)
1. A human form material creation method applied to an electronic device, the method comprising:
acquiring a target image, wherein the target image comprises an image of the head of a target person, and the image of the head of the target person comprises images of a face, hair and ornaments;
when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament;
when the selection operation aiming at the first material is detected, displaying a setting interface of the first material, wherein the color and the style of the first material support the custom setting;
creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, the other images are images in the target image except for the image of the at least one target ornament, and the second material comprises an emoji head portrait of a 3D animation type and/or an emoji head portrait of a preset style;
generating humanoid material of the target person from the at least one first material and the second material, including: synthesizing the at least one first material and the second material to obtain a head material of the target person; selecting body material that fits the head material; combining the head material and the body material to obtain a human-shaped material of the target person, wherein the human-shaped material supports an action following function;
acquiring an editing instruction of a user for a target material in the humanoid material, and updating the target material according to the editing instruction to obtain an updated target material;
synthesizing the updated target material and the material which is not updated in the human-shaped material to obtain the updated human-shaped material of the target character;
and calling the updated human-shaped materials in the process of photographing or recording.
2. The method of claim 1, wherein said creating at least one first material of the target person from the image of the at least one target ornament comprises:
determining characteristic information for each of the at least one target ornament, the characteristic information including contour information;
and creating a corresponding first material according to the characteristic information of each target ornament to obtain at least one first material of the target person.
3. The method of claim 1 or 2, wherein the creating of the second pixel of the target person from the other images in the target image comprises:
removing the image of the at least one target ornament in the target image to obtain an updated target image;
determining facial feature information in the updated target image;
and creating a second story of the target person according to the facial feature information.
4. The method of any of claims 1-3, wherein the generating the humanoid material of the target person from the at least one first material and the second material comprises:
acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material;
synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material;
and creating human-shaped materials of the target person according to the head materials.
5. The method of any of claims 1-4, wherein the acquiring the target image comprises:
when a human-shaped material creating request is detected, shooting the target person to obtain a target image; alternatively, the first and second electrodes may be,
receiving a target image of the target person from a server.
6. A human-shaped material creating apparatus, applied to an electronic device, comprising a processing unit and a communication unit, wherein,
the processing unit is used for acquiring a target image through the communication unit, wherein the target image comprises an image of the head of a target person, and the image of the head of the target person comprises an image of a face, hair and an ornament; when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament; when the selection operation aiming at the first material is detected, displaying a setting interface of the first material, wherein the color and the style of the first material support the custom setting; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, the other images are images in the target image except for the image of the at least one target ornament, and the second material comprises an emoji head portrait of a 3D animation type and/or an emoji head portrait of a preset style; and generating the humanoid material of the target person from the at least one first material and the second material, including: synthesizing the at least one first material and the second material to obtain a head material of the target person; selecting body material that fits the head material; combining the head material and the body material to obtain a human-shaped material of the target person, wherein the human-shaped material supports an action following function; acquiring an editing instruction of a user for a target material in the humanoid material, and updating the target material according to the editing instruction to obtain an updated target material; synthesizing the updated target material and the material which is not updated in the human-shaped material to obtain the updated human-shaped material of the target character; and calling the updated human-shaped materials in the process of photographing or recording.
7. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-5.
8. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810623737.7A CN108898650B (en) | 2018-06-15 | 2018-06-15 | Human-shaped material creating method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810623737.7A CN108898650B (en) | 2018-06-15 | 2018-06-15 | Human-shaped material creating method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108898650A CN108898650A (en) | 2018-11-27 |
| CN108898650B true CN108898650B (en) | 2022-11-15 |
Family
ID=64344991
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810623737.7A Active CN108898650B (en) | 2018-06-15 | 2018-06-15 | Human-shaped material creating method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108898650B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110909287A (en) * | 2019-10-30 | 2020-03-24 | 广东优世联合控股集团股份有限公司 | Visual processing-based field material loading method and device and storage medium |
| CN116109798B (en) * | 2023-04-04 | 2023-06-09 | 腾讯科技（深圳）有限公司 | Image data processing method, device, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1606347A (en) * | 2004-11-15 | 2005-04-13 | 北京中星微电子有限公司 | A video communication method |
| CN104616331A (en) * | 2015-02-16 | 2015-05-13 | 百度在线网络技术（北京）有限公司 | Image processing method and device on mobile device |
| CN105279186A (en) * | 2014-07-17 | 2016-01-27 | 腾讯科技（深圳）有限公司 | Image processing method and system |
| CN107451950A (en) * | 2016-05-30 | 2017-12-08 | 北京旷视科技有限公司 | Face image synthesis method, human face recognition model training method and related device |
| CN107622522A (en) * | 2017-08-09 | 2018-01-23 | 广东欧珀移动通信有限公司 | The method and device of generation game material |
-
2018
- 2018-06-15 CN CN201810623737.7A patent/CN108898650B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1606347A (en) * | 2004-11-15 | 2005-04-13 | 北京中星微电子有限公司 | A video communication method |
| CN105279186A (en) * | 2014-07-17 | 2016-01-27 | 腾讯科技（深圳）有限公司 | Image processing method and system |
| CN104616331A (en) * | 2015-02-16 | 2015-05-13 | 百度在线网络技术（北京）有限公司 | Image processing method and device on mobile device |
| CN107451950A (en) * | 2016-05-30 | 2017-12-08 | 北京旷视科技有限公司 | Face image synthesis method, human face recognition model training method and related device |
| CN107622522A (en) * | 2017-08-09 | 2018-01-23 | 广东欧珀移动通信有限公司 | The method and device of generation game material |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108898650A (en) | 2018-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11044410B2 (en) | Imaging control method and apparatus, electronic device, and computer readable storage medium | |
| CN109068058B (en) | Shooting control method and device in super night scene mode and electronic equipment | |
| JP2021530911A (en) | Night view photography methods, devices, electronic devices and storage media | |
| CN110191291B (en) | Image processing method and device based on multi-frame images | |
| US11189071B2 (en) | Electronic device for providing avatar animation and method thereof | |
| CN108965692B (en) | Sticker setting method and device | |
| CN108024071B (en) | Video content generation method, video content generation device, and storage medium | |
| CN108810277B (en) | Photographing preview method and device | |
| CN110139028A (en) | A kind of method and head-mounted display apparatus of image procossing | |
| US11094125B2 (en) | Storage medium, and method and system for simulating photography in virtual reality scene | |
| CN107690804B (en) | Image processing method and user terminal | |
| CN107424117B (en) | Image beautifying method and device, computer readable storage medium and computer equipment | |
| CN109035147B (en) | Image processing method and device, electronic device, storage medium and computer equipment | |
| CN111066026A (en) | Techniques for providing virtual light adjustments to image data | |
| CN108898650B (en) | Human-shaped material creating method and related device | |
| CN113850726A (en) | Image transformation method and device | |
| CN108986062A (en) | Image processing method and device, electronic device, storage medium and computer equipment | |
| CN112017137A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| KR102339223B1 (en) | Electronic device and method for providing contents related camera | |
| CN115480719A (en) | Image transmission and display method, related equipment and system | |
| CN113850709A (en) | Image transformation method and device | |
| WO2019238001A1 (en) | Photograph capturing control method and related device | |
| CN108874343B (en) | Preview window sharing method and device | |
| CN112348738A (en) | Image optimization method, image optimization device, storage medium, and electronic apparatus | |
| CN116723416B (en) | Image processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |