CN108898650A - Humanoid material creation method and relevant apparatus - Google Patents

Humanoid material creation method and relevant apparatus Download PDF

Info

Publication number
CN108898650A
CN108898650A CN201810623737.7A CN201810623737A CN108898650A CN 108898650 A CN108898650 A CN 108898650A CN 201810623737 A CN201810623737 A CN 201810623737A CN 108898650 A CN108898650 A CN 108898650A
Authority
CN
China
Prior art keywords
target
image
target person
ornament
creating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810623737.7A
Other languages
Chinese (zh)
Other versions
CN108898650B (en
Inventor
胡孔勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810623737.7A priority Critical patent/CN108898650B/en
Publication of CN108898650A publication Critical patent/CN108898650A/en
Application granted granted Critical
Publication of CN108898650B publication Critical patent/CN108898650B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

This application discloses a kind of humanoid material creation method and relevant apparatus, are applied to electronic equipment, including：Target image is obtained, target image includes the image on the head of target person；When including the image of at least one target ornament in detecting target image, at least one first material of target person is created according to the image of at least one target ornament, wherein the corresponding target ornament of each first material；According to the second material of other images creation target person in target image, the second material corresponds to the facial characteristics of target person, other images are the image in target image in addition to the image of at least one target ornament；According at least one first material and the second material, the humanoid material of target person is generated, and humanoid material support movement follows function.The application is conducive to improve the accuracy and efficiency of electronic equipment creation material.

Description

Human-shaped material creating method and related device
Technical Field
The present application relates to the field of electronic technologies, and in particular, to a method and a related apparatus for creating a human-shaped material.
Background
With the rapid development and the increasing popularity of the technology of the intelligent terminal (such as a smart phone), the technology of the intelligent terminal is now an indispensable electronic product in the daily life of users. Some current application programs of the mobile phone can generate cartoon-type emoji expressions, the emoji expressions are generally pre-stored in the mobile phone as material templates, and after a user selects one material, the material can be used for synthesizing pictures and the like.
Disclosure of Invention
The embodiment of the application provides a humanoid material creating method and a related device, provides a method for dynamically creating a complex humanoid material, and improves the accuracy and efficiency of creating the material by electronic equipment.
In a first aspect, an embodiment of the present application provides a method for creating a human-shaped material, which is applied to an electronic device, and the method includes:
acquiring a target image, wherein the target image comprises a video of the head of a target person;
when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament;
creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament;
and generating a human-shaped material of the target person according to the at least one first material and the second material, wherein the human-shaped material supports an action following function.
In a second aspect, embodiments of the present application provide a human-shaped material creation apparatus for use in an electronic device, the human-shaped material creation apparatus comprising a processing unit and a communication unit, wherein,
the processing unit is used for acquiring a target image through the communication unit, and the target image comprises a video of the head of a target person; when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament; and generating human-shaped materials of the target person according to the at least one first material and the second material, wherein the human-shaped materials support an action following function.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing steps in any method of the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods of the first aspect of the present application.
It can be seen that, in the embodiment of the present application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the embodiments or the background art of the present application will be described below.
FIG. 1A is a schematic diagram of a program runtime space of a smart phone;
FIG. 1B is a system architecture diagram of an android system;
FIG. 2 is a schematic flow chart of a method for creating human-shaped materials according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow chart diagram of another human-shaped material creating method disclosed in the embodiments of the present application;
FIG. 4 is a schematic flow chart diagram of another human-shaped material creating method disclosed in the embodiments of the present application;
fig. 5 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application;
fig. 6 is a block diagram of functional units of a human-shaped material creating apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a graphics processing circuit according to an embodiment of the present disclosure.
Detailed description of the invention
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The following are detailed below.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
As shown in fig. 1A, currently, an electronic device such as a smart phone is generally provided with a program running space, where the program running space includes a user space and an operating system space, where the user space runs one or more application programs, and the one or more application programs are third-party application programs installed in the electronic device.
The electronic device can specifically run an Android system, a mobile operating system iOS developed by apple Inc., and the like, and the electronic device is not limited herein. As shown in fig. 1B, for example that the electronic device runs an Android system, the corresponding user space includes an Application layer (Applications) in the Android system, and the operating system space may include an Application Framework layer (Application Framework) in the Android system, a system Runtime library layer (including system Runtime Libraries and Android Runtime runtimes), and a Linux Kernel layer (Linux Kernel). The application layer comprises various application programs which are directly interacted with the user or service programs which are written by Java language and run in the background. For example, programs that implement common basic functions on smartphones, such as Short Messaging Service (SMS) notes, phone dialing, picture viewer, calendar, games, maps, World Wide Web (Web) browser, and other applications developed by developers. The application framework layer provides a series of class libraries required by Android application development, can be used for reusing components, and can also realize personalized extension through inheritance. And the system operation library layer is a support of an application program framework and provides services for each component in the Android system. The system operation library layer is composed of a system class library and Android operation. The Android runtime comprises two parts, namely a core library and a Dalvik virtual machine. The Linux kernel layer is used for realizing core functions such as hardware device driving, process and memory management, a network protocol stack, power management, wireless communication and the like.
Electronic devices may include various handheld devices, vehicle-mounted devices, wearable devices (e.g., smartwatches, smartbands, pedometers, etc.), computing devices or other processing devices connected to wireless modems, as well as various forms of User Equipment (UE), Mobile Stations (MS), terminal Equipment (terminal device), and so forth, having wireless communication capabilities. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.
The following describes embodiments of the present application in detail.
Referring to fig. 2, fig. 2 is a schematic flowchart of a human-shaped material creating method applied to an electronic device according to an embodiment of the present application, where the human-shaped material creating method includes:
s201, the electronic equipment acquires a target image, wherein the target image comprises a video of the head of a target person;
the image of the head of the target person may include images of a face, hair, and objects such as decorations.
S202, when the electronic equipment detects that the target image comprises at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament.
Each first material supports an independent editing function, and the material editing flexibility and intelligence are improved.
Wherein the object ornamentation comprises at least one of: glasses, hats, headwear, and the like.
In one implementation, after the electronic device creates at least one first material, each first material may be presented in a current display interface of the display screen, where a color and a style of the first material are close to a corresponding target ornament, and if the glasses worn by the target user are black and a circular frame, the first material corresponding to the glasses may also be a cartoon-type glasses, and the color is not black, and the shape is circular, or the color and/or the shape may be changed according to a facial expression of the current user, and if a user color expression is detected, the color of the glasses is updated to black, and a lens portion may also be processed in a sunglasses style, and the like, which are not limited uniquely herein.
In another implementation, after creating at least one first material, the electronic device may present each first material in a current display interface of the display screen, and may display a setting interface of the first material when a selection operation for a certain first material is detected, where a color and a style of the first material may be set by a user.
S203, the electronic equipment creates a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except for the image of the at least one target ornament;
the second pixel may be an emoji head portrait of a 3D animation type, or emoji head portraits of various preset styles such as sketch, sketching and oil painting, which are not limited herein. The face appearance feature of the second material is similar to the face feature of the user, for example, if the user has large eyes and small mouth, the eye and mouth feature of the second material may be large eyes and small mouth.
S204, the electronic equipment generates human-shaped materials of the target person according to the at least one first material and the second material, and the human-shaped materials support an action following function.
The action following function means that a certain part (such as a face, a head, a trunk and the like) of the generated human-shaped material can follow the action of the corresponding part of the user to act, and the emoji expression with a 3D effect is presented. The human-shaped material is a preset type human image with 3D style characteristics.
It can be seen that, in the embodiment of the application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
In one possible example, the electronic device creating at least one first material of the target person from imagery of the at least one target ornament includes: the electronic device determining characteristic information for each of the at least one target ornament, the characteristic information including contour information; and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
The electronic device may specifically import characteristic information of the target ornament into a preconfigured material creation engine to create a corresponding first material.
It can be seen that, in the present example, the electronic apparatus is able to create the first material based on the contour information of the target ornament, and since the contour information is an attribute parameter that most directly reflects the appearance feature of the object, employing the contour information to create the first material can improve the accuracy with which the electronic apparatus creates the first material.
In one possible example, the electronic device creates a second pixel of the target person from other imagery in the target image, including: the electronic equipment removes the image of the at least one target ornament in the target image to obtain an updated target image; determining facial feature information in the updated target image; and creating a second story of the target person according to the facial feature information.
Wherein the facial feature information includes at least one of: eye size contour, nose contour, cheek contour, forehead, chin, mouth contour, hairstyle contour, etc., and may also include eye color, skin tone, etc.
As can be seen, in this example, since the contour and the color of the organ of the face of the user are the most dominant and intuitive features of the face, the electronic device analyzes the type of features to create the second material, so that a material with a higher similarity to the face of the user can be created, and the accuracy of creating the second material by the electronic device is improved.
In one possible example, the electronic device generating the humanoid story of the target person from the at least one first story and the second story includes: the electronic equipment synthesizes the at least one first material and the second material to obtain a head material of the target person; and creating human-shaped materials of the target person according to the head materials.
In this possible example, the electronic device creating humanoid material of the target person from the head material includes: the electronic device selecting body material adapted to the head material; and combining the head material and the body material to obtain the human-shaped material of the target person.
The first material and the second material both support independent editing and are free of constraint.
Therefore, in this example, the electronic device can quickly create the first material and the second material only by acquiring a single target image, and the user does not need to take off glasses to create the second material, so that the method is quick and efficient.
In one possible example, after the electronic device generates the humanoid story of the target person from the at least one first story and the second story, the method further comprises: acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person; and calling the updated human-shaped materials in the process of photographing or recording.
As can be seen, in this example, after the electronic device creates the human-shaped material, the electronic device may further edit the first material and/or the second material to update the human-shaped material, so that the convenience, flexibility, and efficiency of the material are improved.
In one possible example, the electronic device generating the humanoid story of the target person from the at least one first story and the second story includes: acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material; and creating human-shaped materials of the target person according to the head materials.
Therefore, in this example, the electronic device can receive the editing instruction of the user to perform real-time dynamic editing during the process of creating the human-shaped material, specifically after creating the first material and the second material, and finally generate the determined human-shaped material, so that the flexibility of editing the material is improved.
In one possible example, the electronic device acquires a target image, including: when the electronic equipment detects a humanoid material creation request, shooting the target person to obtain a target image; or,
the electronic device receives a target image of the target person from a server.
The image data obtained by the electronic device shooting the target person can be YUV data or RGBA data.
Therefore, in the example, the target image is acquired flexibly and efficiently.
Referring to fig. 3, fig. 3 is a schematic flowchart of a method for creating a human-shaped material according to an embodiment of the present application, and is applied to an electronic device. As shown in the figure, the method for creating the morphic plain material comprises the following steps:
s301, the electronic equipment acquires a target image, wherein the target image comprises a video of the head of a target person;
s302, when detecting that the target image includes an image of at least one target ornament, the electronic device determines feature information of each target ornament in the at least one target ornament, wherein the feature information includes contour information;
s303, the electronic equipment creates corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
S304, the electronic equipment removes the image of the at least one target ornament in the target image to obtain an updated target image;
s305, the electronic equipment determines the facial feature information in the updated target image;
s306, the electronic equipment creates a second material of the target person according to the facial feature information, and the second material corresponds to the facial features of the target person.
S307, the electronic equipment synthesizes the at least one first material and the second material to obtain a head material of the target person;
s308, the electronic equipment creates human-shaped materials of the target person according to the head materials.
S309, the electronic equipment acquires an editing instruction of a user for a target material, updates the target material according to the editing instruction, and obtains an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material;
s310, the electronic equipment synthesizes the updated target material and the non-updated material to obtain the updated human-shaped material of the target person;
s311, the electronic equipment calls the updated human-shaped material in the process of photographing or video recording.
It can be seen that, in the embodiment of the application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
Further, the electronic apparatus can create the first material based on the contour information of the object ornament, and since the contour information is an attribute parameter that most directly reflects the appearance feature of the object, employing the contour information to create the first material can improve the accuracy with which the electronic apparatus creates the first material.
In addition, because the outline and the color of the organ of the face of the user are the most obvious and intuitive features of the face, the electronic equipment analyzes the type features to create the second material, the material with higher similarity to the face of the user can be created, and the accuracy of creating the second material by the electronic equipment is improved.
In addition, the electronic equipment can quickly create the first material and the second material only by acquiring a single target image, a user does not need to take off glasses to create the second material, and the method is quick and efficient.
In addition, after the electronic equipment creates the human-shaped material, the electronic equipment can further edit the first material and/or the second material so as to update the human-shaped material, and the convenience, flexibility and efficiency of the material are improved.
Referring to fig. 4, fig. 4 is a schematic flowchart of a method for creating a human-shaped material according to an embodiment of the present application, and is applied to an electronic device. As shown in the figure, the method for creating the morphic plain material comprises the following steps:
s401, the electronic equipment acquires a target image, wherein the target image comprises a video of the head of a target person;
s402, when the electronic equipment detects that the target image comprises at least one target ornament image, determining characteristic information of each target ornament in the at least one target ornament, wherein the characteristic information comprises contour information;
s403, the electronic equipment creates corresponding first materials according to the characteristic information of each target ornament, and at least one first material of the target person is obtained.
S404, the electronic equipment removes the image of the at least one target ornament in the target image to obtain an updated target image;
s405, the electronic equipment determines the facial feature information in the updated target image;
s406, the electronic equipment creates a second material of the target person according to the facial feature information, wherein the second material corresponds to the facial features of the target person.
S407, the electronic device acquires an editing instruction of a user for a target material, updates the target material according to the editing instruction, and obtains an updated target material, wherein the target material comprises any one or more of the at least one first material and the second material;
s408, the electronic equipment synthesizes the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material;
s409, the electronic equipment creates human-shaped materials of the target person according to the head materials.
It can be seen that, in the embodiment of the application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
Further, the electronic apparatus can create the first material based on the contour information of the object ornament, and since the contour information is an attribute parameter that most directly reflects the appearance feature of the object, employing the contour information to create the first material can improve the accuracy with which the electronic apparatus creates the first material.
In addition, because the outline and the color of the organ of the face of the user are the most obvious and intuitive features of the face, the electronic equipment analyzes the type features to create the second material, the material with higher similarity to the face of the user can be created, and the accuracy of creating the second material by the electronic equipment is improved.
In addition, the electronic equipment can quickly create the first material and the second material only by acquiring a single target image, a user does not need to take off glasses to create the second material, and the method is quick and efficient.
In addition, the electronic equipment can receive the editing instruction of a user to carry out real-time dynamic editing in the process of creating the human-shaped material, particularly after the first material and the second material are created, and finally, the determined human-shaped material is generated, so that the editing flexibility of the material is improved.
Consistent with the embodiments shown in fig. 2, fig. 3, and fig. 4, please refer to fig. 5, fig. 5 is a schematic structural diagram of an electronic device 500 provided in the embodiments of the present application, where the electronic device 500 runs one or more application programs and an operating system, as shown in the figure, the electronic device 500 includes a processor 510, a memory 520, a communication interface 530, and one or more programs 521, where the one or more programs 521 are stored in the memory 520 and configured to be executed by the processor 510, and the one or more programs 521 include instructions for performing the following steps;
acquiring a target image, wherein the target image comprises a video of the head of a target person;
when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament;
creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament;
and generating a human-shaped material of the target person according to the at least one first material and the second material, wherein the human-shaped material supports an action following function.
It can be seen that, in the embodiment of the application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
In one possible example, in the creating of the at least one first material of the target person from the imagery of the at least one target ornament, the instructions in the program are specifically configured to: determining characteristic information for each of the at least one target ornament, the characteristic information including contour information; and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
In one possible example, in the aspect of creating the second pixel of the target person from the other images in the target image, the instructions in the program are specifically configured to: removing the image of the at least one target ornament in the target image to obtain an updated target image; and determining facial feature information in the updated target image; and creating a second story of the target person based on the facial feature information.
In one possible example, in the generating the humanoid story of the target person from the at least one first story and the second story, the instructions in the program are specifically operable to: synthesizing the at least one first material and the second material to obtain a head material of the target person; and creating human-shaped materials of the target person according to the head materials.
In one possible example, the program further includes instructions for: after the humanoid materials of the target person are generated according to the at least one first material and the second material, acquiring an editing instruction of a user for the target materials, and updating the target materials according to the editing instruction to obtain updated target materials, wherein the target materials comprise any one or more of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person; and calling the updated human-shaped materials in the process of photographing or video recording.
In one possible example, in the generating the humanoid story of the target person from the at least one first story and the second story, the instructions in the program are specifically operable to: acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material; and creating human-shaped materials of the target person according to the head materials.
In one possible example, in the aspect of acquiring the target image, the instructions in the program are specifically configured to: when a human-shaped material creating request is detected, shooting the target person to obtain a target image; or,
receiving a target image of the target person from a server.
The above embodiments mainly introduce the scheme of the embodiments of the present application from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
The following is an embodiment of the apparatus of the present invention, which is used to perform the method implemented by the embodiment of the method of the present invention. The human-shaped material creating apparatus 600 shown in fig. 6, which is applied to an electronic device, includes a processing unit 601 and a communication unit 602, wherein,
the processing unit 601 is configured to obtain a target image through the communication unit 602, where the target image includes a video of a head of a target person; when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament; and generating human-shaped materials of the target person according to the at least one first material and the second material, wherein the human-shaped materials support an action following function.
The human-shaped material creating apparatus may further include a storage unit 603 for storing program codes and data of the electronic device. The processing unit 601 may be a processor, the communication unit 602 may be an image acquisition device, an input device or a transceiver, and the storage unit 603 may be a memory.
It can be seen that, in the embodiment of the application, the electronic device first acquires a target image, where the target image includes a video of a head of a target person; secondly, when the target image is detected to comprise the image of at least one target ornament, at least one first material of the target person is created according to the image of the at least one target ornament, then a second material of the target person is created according to other images in the target image, and finally the figure material of the target person is generated according to the at least one first material and the second material, wherein each first material corresponds to one target ornament, the second material corresponds to the facial features of the target person, and the figure material supports the action following function. Therefore, the electronic equipment can create the material corresponding to the ornament and the material corresponding to the face data of the user in a hierarchical mode aiming at the complex figure image wearing the ornament, can enhance the function of displaying the AR through the following of the facial expression action, is more flexible compared with the mode of selecting and using the pre-stored fixed material or integrally creating the material, better meets the personalized requirement of the user, and improves the accuracy and the flexibility of creating the material by the electronic equipment.
In one possible example, in the creating of the at least one first material of the target person from the image of the at least one target ornament, the processing unit 601 is specifically configured to: determining characteristic information for each of the at least one target ornament, the characteristic information including contour information; and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
In one possible example, in the aspect of creating the second pixel of the target person according to the other videos in the target image, the processing unit 601 is specifically configured to: removing the image of the at least one target ornament in the target image to obtain an updated target image; and determining facial feature information in the updated target image; and creating a second story of the target person based on the facial feature information.
In one possible example, in the aspect of generating the humanoid story of the target person from the at least one first story and the second story, the processing unit 601 is specifically configured to: synthesizing the at least one first material and the second material to obtain a head material of the target person; and creating human-shaped materials of the target person according to the head materials.
In one possible example, the processing unit 601, after generating the humanoid story of the target person from the at least one first story and the second story, is further configured to: acquiring an editing instruction of a user for a target material through the communication unit 601, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person; and calling the updated human-shaped materials in the process of photographing or video recording.
In one possible example, in the aspect of generating the humanoid story of the target person from the at least one first story and the second story, the processing unit 601 is specifically configured to: acquiring an editing instruction of a user for a target material through the communication unit 602, and updating the target material according to the editing instruction to obtain an updated target material, where the target material includes any one or more of the at least one first material and the second material; synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material; and creating human-shaped materials of the target person according to the head materials.
In one possible example, in terms of acquiring the target image through the communication unit 602, the processing unit 601 is specifically configured to: when a human-shaped material creating request is detected, shooting the target person to obtain a target image; or,
receiving a target image of the target person from a server.
The embodiment of the invention also provides another electronic device. The electronic device includes an image processing circuit, which may be implemented by hardware and/or software components, and may specifically include various processing units. Fig. 7 is an exemplary diagram of an image processing circuit. As shown in fig. 7, for convenience of explanation, only relevant processing units related to the image processing aspect related to the embodiment of the present application are shown.
As shown in fig. 7, the Image Processing circuit may include an Image Signal Processing (ISP) processor 740 and control logic 750. The image data captured by imaging device 710 is first processed by ISP processor 740, and ISP processor 740 analyzes the image data to capture image statistics for determining control parameters of imaging device 710. The imaging device 710 may be a camera having a lens 712 and an image sensor 714. The image sensor 714 may include an array of color filters (e.g., Bayer filters), each imaging pixel of the image sensor 714 may capture intensity and wavelength information of ambient light, and the image sensor 714 transmits raw image data to the ISP processor 740. The sensor 720 may provide raw image data to the ISP processor 740 based on a preset interface. The default interface includes a Standard Mobile Imaging Architecture (SMIA) interface, other serial or parallel camera interfaces, or a combination thereof.
ISP processor 740 processes the raw image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and ISP processor 740 may perform one or more image processing operations on the raw image data, collecting statistical information about the image data. Wherein the image processing operations may be performed with the same or different bit depth precision.
ISP processor 740 may also receive pixel data from image memory 730. For example, the original pixel data is sent from the predetermined interface to the image memory 730, and the original pixel data in the image memory 730 is provided to the ISP processor 740 for processing. The image Memory 730 may be a part of a Memory space of the Memory, or a separate dedicated Memory, and the type of the Memory may be Direct Memory Access (DMA).
The ISP processor 740 may perform an image processing operation, such as a filtering process, when receiving raw image data from a preset interface or from the image memory 730. The processed image data may be sent to image memory 730 for further processing prior to display. ISP processor 740 receives processed data from image memory 730 and performs image data processing on the processed data in the raw domain and RGB and YCbCr color spaces. The processed image data may be output to a display 770 for viewing by a user and/or further Processing by a Graphics Processing Unit (GPU). Further, the output of ISP processor 740 may also be sent to image memory 730 and display 770 may read image data from image memory 730. In one embodiment, image memory 730 may be configured to implement one or more frame buffers. In addition, the output of ISP processor 740 may be sent to encoder/decoder 760 for encoding/decoding image data. The encoded image data may be saved and decompressed before being displayed on the display 770 device. The encoder/decoder 760 may be implemented by a CPU or GPU or coprocessor.
The statistical data determined by ISP processor 740 may be sent to control logic 750 unit. For example, the statistical data may include image sensor 714 statistics such as auto-exposure, auto-white balance, auto-focus, flicker detection, black level compensation, lens 712 shading correction, and the like. Control logic 750 may be a processor and/or microcontroller and one or more routines may determine control parameters of imaging device 710 based on the received statistical data. For example, the control parameters may include sensor 720 control parameters (e.g., gain, integration time for exposure control), camera flash control parameters, lens 712 control parameters (e.g., focal length for focusing or zooming), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), as well as lens 712 shading correction parameters.
The following is the steps related to the image display in the embodiment of the method using the image processing technique in fig. 7.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (10)

1. A human-shaped material creating method applied to an electronic device, the method comprising:
acquiring a target image, wherein the target image comprises a video of the head of a target person;
when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament;
creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament;
and generating a human-shaped material of the target person according to the at least one first material and the second material, wherein the human-shaped material supports an action following function.
2. The method of claim 1, wherein said creating at least one first material of the target person from the image of the at least one target ornament comprises:
determining characteristic information for each of the at least one target ornament, the characteristic information including contour information;
and creating corresponding first materials according to the characteristic information of each target ornament to obtain at least one first material of the target person.
3. The method according to claim 1 or 2, wherein the creating of the second pixel of the target person from the other images in the target image comprises:
removing the image of the at least one target ornament in the target image to obtain an updated target image;
determining facial feature information in the updated target image;
and creating a second story of the target person according to the facial feature information.
4. The method of any of claims 1-3, wherein generating the humanoid story of the target person from the at least one first story and the second story comprises:
synthesizing the at least one first material and the second material to obtain a head material of the target person;
and creating human-shaped materials of the target person according to the head materials.
5. The method of claim 4, wherein after generating the humanoid story of the target person from the at least one first story and the second story, the method further comprises:
acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material;
synthesizing the updated target material and the non-updated material to obtain an updated human-shaped material of the target person;
and calling the updated human-shaped materials in the process of photographing or recording.
6. The method of any of claims 1-3, wherein generating the humanoid story of the target person from the at least one first story and the second story comprises:
acquiring an editing instruction of a user for a target material, and updating the target material according to the editing instruction to obtain an updated target material, wherein the target material comprises any one or more materials of the at least one first material and the second material;
synthesizing the updated target material and the non-updated material to obtain the head material of the target person, wherein the non-updated material comprises the material except the target material in the at least one first material and the second material;
and creating human-shaped materials of the target person according to the head materials.
7. The method of any of claims 1-6, wherein the acquiring a target image comprises:
when a human-shaped material creating request is detected, shooting the target person to obtain a target image; or,
receiving a target image of the target person from a server.
8. A human-shaped material creating apparatus, applied to an electronic device, comprising a processing unit and a communication unit, wherein,
the processing unit is used for acquiring a target image through the communication unit, and the target image comprises a video of the head of a target person; when the target image is detected to comprise at least one target ornament image, at least one first material of the target person is created according to the at least one target ornament image, wherein each first material corresponds to one target ornament; creating a second material of the target person according to other images in the target image, wherein the second material corresponds to the facial features of the target person, and the other images are images in the target image except the image of the at least one target ornament; and generating human-shaped materials of the target person according to the at least one first material and the second material, wherein the human-shaped materials support an action following function.
9. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-7.
CN201810623737.7A 2018-06-15 2018-06-15 Human-shaped material creating method and related device Active CN108898650B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810623737.7A CN108898650B (en) 2018-06-15 2018-06-15 Human-shaped material creating method and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810623737.7A CN108898650B (en) 2018-06-15 2018-06-15 Human-shaped material creating method and related device

Publications (2)

Publication Number Publication Date
CN108898650A true CN108898650A (en) 2018-11-27
CN108898650B CN108898650B (en) 2022-11-15

Family

ID=64344991

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810623737.7A Active CN108898650B (en) 2018-06-15 2018-06-15 Human-shaped material creating method and related device

Country Status (1)

Country Link
CN (1) CN108898650B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110909287A (en) * 2019-10-30 2020-03-24 广东优世联合控股集团股份有限公司 Visual processing-based field material loading method and device and storage medium
CN111950043A (en) * 2019-04-30 2020-11-17 青岛海尔科技有限公司 Intelligent providing method and device for flower arrangement works
CN116109798A (en) * 2023-04-04 2023-05-12 腾讯科技（深圳）有限公司 Image data processing method, device, equipment and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1606347A (en) * 2004-11-15 2005-04-13 北京中星微电子有限公司 A video communication method
CN104616331A (en) * 2015-02-16 2015-05-13 百度在线网络技术（北京）有限公司 Image processing method and device on mobile device
CN105279186A (en) * 2014-07-17 2016-01-27 腾讯科技（深圳）有限公司 Image processing method and system
CN107451950A (en) * 2016-05-30 2017-12-08 北京旷视科技有限公司 Face image synthesis method, human face recognition model training method and related device
CN107622522A (en) * 2017-08-09 2018-01-23 广东欧珀移动通信有限公司 The method and device of generation game material

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1606347A (en) * 2004-11-15 2005-04-13 北京中星微电子有限公司 A video communication method
CN105279186A (en) * 2014-07-17 2016-01-27 腾讯科技（深圳）有限公司 Image processing method and system
CN104616331A (en) * 2015-02-16 2015-05-13 百度在线网络技术（北京）有限公司 Image processing method and device on mobile device
CN107451950A (en) * 2016-05-30 2017-12-08 北京旷视科技有限公司 Face image synthesis method, human face recognition model training method and related device
CN107622522A (en) * 2017-08-09 2018-01-23 广东欧珀移动通信有限公司 The method and device of generation game material

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111950043A (en) * 2019-04-30 2020-11-17 青岛海尔科技有限公司 Intelligent providing method and device for flower arrangement works
CN110909287A (en) * 2019-10-30 2020-03-24 广东优世联合控股集团股份有限公司 Visual processing-based field material loading method and device and storage medium
CN116109798A (en) * 2023-04-04 2023-05-12 腾讯科技（深圳）有限公司 Image data processing method, device, equipment and medium
CN116109798B (en) * 2023-04-04 2023-06-09 腾讯科技（深圳）有限公司 Image data processing method, device, equipment and medium

Also Published As

Publication number Publication date
CN108898650B (en) 2022-11-15

Similar Documents

Publication Publication Date Title
CN111402135B (en) Image processing method, device, electronic equipment and computer readable storage medium
US11044410B2 (en) Imaging control method and apparatus, electronic device, and computer readable storage medium
CN109068058B (en) Shooting control method and device in super night scene mode and electronic equipment
JP2021530911A (en) Night view photography methods, devices, electronic devices and storage media
US11189071B2 (en) Electronic device for providing avatar animation and method thereof
CN108810277B (en) Photographing preview method and device
CN108024071B (en) Video content generation method, video content generation device, and storage medium
WO2021078001A1 (en) Image enhancement method and apparatus
CN108965692B (en) Sticker setting method and device
CN110139028A (en) A kind of method and head-mounted display apparatus of image procossing
CN108898650B (en) Human-shaped material creating method and related device
CN107424117B (en) Image beautifying method and device, computer readable storage medium and computer equipment
US11094125B2 (en) Storage medium, and method and system for simulating photography in virtual reality scene
CN109040618A (en) Video generation method and device, storage medium, electronic equipment
CN111066026A (en) Techniques for providing virtual light adjustments to image data
CN113298735A (en) Image processing method, image processing device, electronic equipment and storage medium
CN112017137A (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
KR20190021106A (en) Electronic device and method for providing contents related camera
CN112348738A (en) Image optimization method, image optimization device, storage medium, and electronic apparatus
CN113850709A (en) Image transformation method and device
CN116055895B (en) Image processing method and device, chip system and storage medium
WO2019238001A1 (en) Photograph capturing control method and related device
CN108874343B (en) Preview window sharing method and device
CN113298829B (en) Image processing method, device, electronic equipment and computer readable storage medium
CN117440253B (en) Image processing method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant