WO2020019665A1 - 基于人脸的三维特效生成方法、装置和电子设备 - Google Patents
基于人脸的三维特效生成方法、装置和电子设备 Download PDFInfo
- Publication number
- WO2020019665A1 WO2020019665A1 PCT/CN2018/123641 CN2018123641W WO2020019665A1 WO 2020019665 A1 WO2020019665 A1 WO 2020019665A1 CN 2018123641 W CN2018123641 W CN 2018123641W WO 2020019665 A1 WO2020019665 A1 WO 2020019665A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- special effect
- dimensional
- face image
- generating
- parameters
- Prior art date
Links
- 230000000694 effects Effects 0.000 title claims abstract description 246
- 238000000034 method Methods 0.000 title claims abstract description 85
- 239000000463 material Substances 0.000 claims abstract description 31
- 238000003860 storage Methods 0.000 claims abstract description 22
- 238000012360 testing method Methods 0.000 claims description 17
- 238000002156 mixing Methods 0.000 claims description 12
- 238000009877 rendering Methods 0.000 claims description 8
- 230000001815 facial effect Effects 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 6
- 238000004422 calculation algorithm Methods 0.000 abstract description 13
- 239000000872 buffer Substances 0.000 description 21
- 230000006870 function Effects 0.000 description 13
- 238000001514 detection method Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 210000000887 face Anatomy 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 230000008901 benefit Effects 0.000 description 8
- 238000013507 mapping Methods 0.000 description 8
- 230000009471 action Effects 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000000605 extraction Methods 0.000 description 6
- 239000000203 mixture Substances 0.000 description 6
- 238000002310 reflectometry Methods 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000007792 addition Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- 230000000994 depressogenic effect Effects 0.000 description 2
- 210000004709 eyebrow Anatomy 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- MCSXGCZMEPXKIW-UHFFFAOYSA-N 3-hydroxy-4-[(4-methyl-2-nitrophenyl)diazenyl]-N-(3-nitrophenyl)naphthalene-2-carboxamide Chemical compound Cc1ccc(N=Nc2c(O)c(cc3ccccc23)C(=O)Nc2cccc(c2)[N+]([O-])=O)c(c1)[N+]([O-])=O MCSXGCZMEPXKIW-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000011068 loading method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 231100000289 photo-effect Toxicity 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 238000000611 regression analysis Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/141—Control of illumination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes
Definitions
- the present disclosure relates to the field of image technology, and in particular, to a method, an apparatus, a hardware device, and a computer-readable storage medium for generating a three-dimensional special effect based on a human face.
- the application range of smart terminals has been widely expanded, such as listening to music, playing games, chatting on the Internet, and taking photos through smart terminals.
- the camera pixels have reached more than 10 million pixels, which has higher resolution and is comparable to that of professional cameras.
- the current special effect production APPs are pre-made with some special effects and cannot be flexibly edited, and the special effects can only be fixed at a fixed position of the image.
- the present disclosure provides a method for generating a 3D special effect based on a face, including: displaying a standard face image; and creating a 3D special effect, the 3D special effect being created by configuring at least a 3D model and a material of the 3D model.
- the three-dimensional special effect is located on the standard face image; generating special effect parameters according to the three-dimensional special effect; obtaining a first face image identified from an image sensor; and according to the special effect parameter, on the first face image Generating the three-dimensional special effect.
- the configuring the three-dimensional model includes: acquiring the three-dimensional model and displaying it on a standard face image; and configuring a position and a size of the three-dimensional model.
- configuring the material of the three-dimensional model includes: creating the material and adjusting parameters of the material; the parameters of the material include rendering blend mode parameters, whether to enable depth test parameters, whether to enable depth write parameters, Whether to enable one or more of the culling parameters.
- the creating a three-dimensional special effect further includes: configuring a light, the light including one of a point light source, a parallel light source, and a spotlight light source.
- the configuring the light includes: configuring the position, direction, color, and intensity of the light.
- the creating a three-dimensional special effect further includes: configuring a texture of the three-dimensional model, including: obtaining a map of the texture; and configuring a texture wrapping mode.
- the standard face image includes facial feature points
- the method includes: receiving a reference point selection command, selecting at least one feature point as a reference point; and according to the special effect parameter
- generating the three-dimensional special effect on the first face image includes generating the three-dimensional special effect on the first face image according to the special effect parameter and the reference point.
- the present disclosure provides a device for generating a three-dimensional special effect based on a face, including: a display module for displaying a standard face image; and a three-dimensional special effect creation module for creating a three-dimensional special effect. Created by configuring at least a three-dimensional model and the material of the three-dimensional model; a special effect parameter generating module for generating special effect parameters according to the three-dimensional special effect; and a face image acquisition module for acquiring a first human face identified from an image sensor An image; a three-dimensional special effect generating module, configured to generate the three-dimensional special effect on a first face image according to the special effect parameter.
- configuring the three-dimensional model includes: obtaining the three-dimensional model and displaying it on a standard face image; and configuring a position and a size of the three-dimensional model.
- configuring the material of the three-dimensional model includes: creating the material and adjusting parameters of the material; the parameters of the material include a rendering blend mode, whether to enable depth testing, whether to enable depth writing, and whether to enable culling One or more of them.
- the three-dimensional special effect creation module is further configured to configure a light, the light including one of a point light source, a parallel light source, and a spotlight light source.
- the configuring the light includes: configuring the position, direction, color, and intensity of the light.
- the three-dimensional special effect creation module is further configured to: configure a texture of the three-dimensional model, including: obtaining a map of the texture; and configuring a texture wrapping mode.
- the standard face image includes face feature points
- the face-based 3D special effect generating device further includes a reference point selection module for receiving a reference point selection command, and selecting at least one feature point as Reference point; the three-dimensional special effect generating module has: generating the three-dimensional special effect on a first face image according to the special effect parameter and the reference point.
- the present disclosure provides an electronic device including: a memory for storing non-transitory computer-readable instructions; and a processor for running the computer-readable instructions such that the processing The implementation of the processor implements the steps described in any of the above methods.
- the present disclosure provides a computer-readable storage medium for storing non-transitory computer-readable instructions, which when executed by a computer, cause the computer to execute The steps described in any of the above methods.
- Embodiments of the present disclosure provide a method, an apparatus, an electronic device, and a computer-readable storage medium for generating a three-dimensional special effect based on a human face.
- the face-based 3D special effect generating method includes: displaying a standard face image; creating a 3D special effect, the 3D special effect is created by configuring at least a 3D model and a material of the 3D model, and the 3D special effect is located in the standard person On the face image; generating special effect parameters according to the three-dimensional special effect; obtaining a first face image recognized from an image sensor; and generating the three-dimensional special effect on the first face image according to the special effect parameter.
- the user can conveniently configure and edit the 3D special effect, and can generate the 3D special effect parameter so that the 3D special effect generation algorithm can use the 3D special effect parameter on the face image collected in real time.
- FIG. 1 is a schematic flowchart of a face-based 3D special effect generating method according to an embodiment of the present disclosure
- FIG. 2 is a schematic flowchart of a method for generating a 3D special effect based on a human face according to another embodiment of the present disclosure
- FIG. 3 is a schematic structural diagram of a face-based 3D special effect generating device according to an embodiment of the present disclosure
- FIG. 4 is a schematic structural diagram of a face-based 3D special effect generating device according to another embodiment of the present disclosure.
- FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
- FIG. 6 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present disclosure.
- FIG. 7 is a schematic structural diagram of a face-based 3D special effect generating terminal according to an embodiment of the present disclosure.
- an embodiment of the present disclosure provides a method for generating a three-dimensional special effect based on a human face.
- the method for generating a 3D special effect based on a human face mainly includes the following steps S1 to S5. among them:
- Step S1 Display a standard face image.
- a standard face image is displayed on the display device.
- the standard face image is a preset face image.
- the standard face image is a front face image.
- the standard face image may have preset feature points, in which the number of feature points can be set, and the user can freely set the required number of feature points.
- the feature points of an image are points in the image that have distinctive characteristics and can effectively reflect the essential characteristics of the image and can identify the target object in the image. If the target object is a human face, then the key points of the face need to be obtained. If the target image is a house, then the key points of the house need to be obtained. Take the human face as an example to illustrate how to obtain key points.
- the face contour mainly includes 5 parts: eyebrows, eyes, nose, mouth, and cheeks, and sometimes also includes pupils and nostrils. Generally, a complete description of the face contour is achieved.
- the number of key points required is about 60. If only the basic structure is described, the details of each part do not need to be described in detail, or the cheeks need not be described, then the number of key points can be reduced accordingly. If you need to describe the pupils, nostrils, or need More detailed features can increase the number of key points.
- Face keypoint extraction on the image is equivalent to finding the corresponding position coordinates of each face contour keypoint in the face image, that is, keypoint positioning. This process needs to be performed based on the features corresponding to the keypoints.
- a search and comparison is performed in the image based on this feature to accurately locate the positions of the key points on the image.
- the feature points occupy only a very small area in the image (usually only a few to tens of pixels in size)
- the area occupied by the features corresponding to the feature points on the image is also usually very limited and local.
- the features currently used There are two kinds of extraction methods: (1) one-dimensional range image feature extraction along the vertical contour; (2) two-dimensional range image feature extraction of square neighborhood of feature points.
- ASM and AAM methods statistical energy function methods, regression analysis methods, deep learning methods, classifier methods, batch extraction methods, and so on.
- the number of key points, accuracy, and speed used by the above various implementation methods are different, which are suitable for different application scenarios.
- Step S2 Create a three-dimensional special effect, which is created by configuring at least a three-dimensional model and a material of the three-dimensional model, and the three-dimensional special effect is located on the standard face image.
- a three-dimensional special effect to be used is created.
- the three-dimensional special effect is a 3D sticker.
- the 3D models do not carry any color information, depth information, material information, texture information, etc.
- the size of the 3D model can be set by the drag box of the 3D model, or
- the length, width, and height of the drag box are directly input to set, and the rotation angle includes the rotation angles on the x-axis, y-axis, and z-axis, and can be set by dragging the drag box or directly inputting the angle.
- the parameters of the material include one or more of rendering blending mode, whether depth test is enabled, whether depth writing is enabled, whether culling is enabled, and the parameters of the material also include the RGB component of the body surface to the color light that is incident on the surface.
- the reflectivity specifically includes the degree of reflection of ambient light, diffused light, specular light, and self-luminous different rays and different color components.
- the rendering blending refers to mixing two colors together, and specifically to the present disclosure refers to blending a color at a pixel position with a color to be painted to achieve a special effect, and a rendering blending mode Refers to the method used for mixing.
- the mixing method refers to the calculation of the source color and the target color to obtain the mixed color. In actual applications, the result obtained by multiplying the source color by the source factor and the target color is often multiplied. The result obtained by the target factor is used for calculation to obtain the mixed color.
- BLENDcolor SRC_color * SCR_factor + DST_color * DST_factor, where 0 ⁇ SCR_factor ⁇ 1, 0 ⁇ DST_factor ⁇ 1.
- the four components of the source color referring to red, green, blue, and alpha values
- the four components of the target color are (Rd, Gd, Bd, Ad )
- the source factor is (Sr, Sg, Sb, Sa)
- the target factor is (Dr, Dg, Db, Da).
- the new color produced by the blend can be expressed as: (Rs * Sr + Rd * Dr, Gs * Sg + Gd * Dg, Bs * Sb + Bd * Db, As * Sa + Ad * Da), where the alpha value represents transparency, 0 ⁇ alpha ⁇ 1.
- the above mixing method is only an example. In practical applications, the mixing method can be defined or selected by itself. The calculation can be the larger of the addition, the subtraction, the multiplication, the division, the larger one, the smaller of the two, and a logical operation. (And, or, XOR, etc.). The above mixing method is only an example. In practical applications, the mixing method can be defined or selected by itself. The calculation can be the larger of the addition, the subtraction, the multiplication, the division, the larger one, the smaller of the two, and a logical operation. (And, or, XOR, etc.).
- the depth test refers to setting a depth buffer, which corresponds to the color buffer.
- the depth buffer stores the depth information of the pixels, and the color information of the pixels stored in the color buffer is used to determine whether to draw an object.
- the depth value of the corresponding pixel of the surface is first compared with the value stored in the depth buffer. If it is greater than or equal to the value in the depth buffer, this part is discarded; otherwise, the depth value and color value corresponding to this pixel are used, respectively. Update the depth and color buffers. This process is called Depth Testing.
- DF_NEVER always fails the test, at this time the values in the depth buffer and color buffer will always be maintained, that is, no pixel will be drawn to the screen;
- DF_LESS at the current depth value ⁇ Passed when stored depth value;
- DF_LEQUAL passed when current depth value ⁇ stored depth value;
- DF_GREATER passed when current depth value> stored depth value;
- DF_NOTEQUAL passes when the current depth value ⁇ the stored depth value;
- the deep write is associated with the depth test.
- the depth test is enabled and the result of the depth test may update the value of the depth buffer
- the deep write needs to be turned on to update the value of the depth buffer.
- the following example illustrates the image drawing process when the depth test is turned on and the depth is written. Assume that two color blocks, red and yellow, are to be drawn. In the rendering queue, the red block is in front, the yellow block is behind, and the red block has a depth of 0.5. , The depth value of the yellow block is 0.2, and the depth test comparison function used is DF_LEQUAL. At this time, 0.5 is written in the depth buffer, red is written in the color buffer, and then 0.2 is obtained through the comparison function when rendering yellow. ⁇ 0.5, if the test is passed, the value of the depth buffer is updated to 0.2, and the color buffer is updated to yellow, which means that because the depth of yellow is relatively shallow, it is necessary to cover the deep red.
- the culling refers to that in a three-dimensional space, although a polygon has two faces, we cannot see those polygons on the back, and some polygons are obscured by other polygons although they are on the front. Treating invisible polygons with visible polygons will undoubtedly reduce our efficiency in processing graphics. At this time, unnecessary faces can be eliminated.
- culling is turned on, you can set the face to be culled, such as setting the back and / or front to be culled.
- the reflectivity of the material to various light rays is also set, where the color component of each light rays is set to reflectivity, such as for ambient light, whose color components are red, yellow, blue, and red reflection
- the rate is 0.5
- the reflectivity for yellow is 0.1
- the reflectivity for blue is 0.2, so when the ambient light is set, the surface of the 3D model will show a color and gloss, which can show the reflection properties of the material to different light .
- the creating a three-dimensional special effect further includes: configuring a light, the light includes one of a point light source, a parallel light source, and a spotlight light source.
- a light the light includes one of a point light source, a parallel light source, and a spotlight light source.
- different colors can be formed on the surface of the 3D model according to the light reflectance of the 3D material.
- For point and spot light sources you can also set the attenuation radius of the light to simulate real lighting conditions.
- spot light sources you can also set the light's emission angle to attenuate the angle, etc. It is not listed here one by one. It can be understood that the settings of the lights may not be limited to the above types of lights, and all light sources that can be applied to the technical solutions of the present disclosure are introduced into the present disclosure.
- the creating a three-dimensional special effect further comprises: configuring a texture of the three-dimensional model, which specifically includes: obtaining a map of the texture; and configuring a wrapping mode of the texture.
- a texture representing a texture needs to be obtained, and the texture map can usually be imported using an import method; then a texture wrapping mode can be configured, which refers to how to handle textures when the three-dimensional model is larger than the texture mapping.
- the simplest way is the REPEAT mode, which is to repeat the texture mapping until the 3D model is completely covered by the texture mapping. This is also the most commonly used mode.
- CLAMP interception mode which is not covered by the texture mapping. , Will be overwritten with the color of the edge of the texture map.
- Step S3 Generate special effect parameters according to the three-dimensional special effect.
- the special effect parameter refers to the configured special effect parameter after creating the three-dimensional special effect in step S2, and a three-dimensional special effect drawing parameter package can be generated according to the special effect parameter, so as to be used when generating the three-dimensional special effect.
- the purpose of this step is to provide a drawing parameter package for the 3D special effect generation algorithm so as to load the 3D special effect on other face images.
- Step S4 Acquire a first face image identified from the image sensor.
- a face image recognized from a camera is obtained.
- the face image may be a face recognized from a real person, or a face recognized by using a camera to take a picture or video including the face This disclosure does not limit, in short, the face image is different from the standard face image.
- Face detection is any given image or a set of image sequences, and it is searched with a certain strategy to determine the position and area of all faces.
- Common face detection methods can be divided into four categories: (1) knowledge-based methods, which encode typical faces into a rule base to encode faces and locate faces through the relationship between facial features; (2) Feature invariant method. The purpose of this method is to find stable features when the pose, perspective, or lighting conditions are changed, and then use these features to determine the face. (3) Template matching method, which stores several standard face patterns.
- the feature template used for the calculation of general Haar features uses a simple rectangle combination consisting of two or more congruent rectangles, where the feature template has two rectangles, black and white; after that, use
- the AdaBoost algorithm finds a part of the features that play a key role from a large number of Haar features, and uses these features to generate an effective classifier.
- the constructed classifier can detect faces in the image. There may be one or more human faces in the image in this embodiment.
- each face detection algorithm has its own advantages and different adaptation ranges, multiple different detection algorithms can be set to automatically switch different algorithms for different environments, such as in images with relatively simple background environments. , You can use the algorithm with a lower detection rate but faster; in the image with a more complex background environment, you can use the algorithm with a higher detection rate but a slower speed; for the same image, you can use multiple algorithms multiple times Detection to improve detection rate.
- Step S5 Generate the three-dimensional special effect on the first face image according to the special effect parameters.
- the special effect parameters generated in step S4 the same three-dimensional special effect as that on the standard face image is generated on the first face image recognized from the camera, and the three-dimensional special effect is on the first face image.
- the position on is the same as that on the standard face image.
- the special effect parameters may include parameters set when the three-dimensional special effect is created in step S2.
- the position of the three-dimensional special effect on the first face image is determined by the position of the three-dimensional model in the parameters, and the three-dimensional special effect is determined according to other parameters.
- the user can select one face image that needs to be created by 3D special effects, and can also select multiple face images for the same or different processing.
- 3D special effects you can number standard faces, such as ID1 and ID2, and set 3D special effects on the standard face images of ID1 and ID2, respectively.
- the 3D special effects can be the same or different. Recognize multiple face images and add 3D special effects to the multiple face images according to the identified order. For example, if the first face is identified, then the 3D special effect on the standard face image of ID1 is added to the first face. , And then recognize the No. 2 face, add the 3D special effect on the standard face image of ID2 to the No.
- a three-dimensional special effect is created on a standard face image.
- the three-dimensional special effect can be configured to generate three-dimensional special effect parameters, and then the three-dimensional special effect on the actual face image is generated according to the three-dimensional special effect parameter.
- 3D special effects need to be produced by a third-party tool, which lacks flexibility when used, and cannot be configured in real time, and can only be placed in existing images or videos, and cannot be generated on face images collected in real time. 3D special effects.
- the user can conveniently configure and edit the 3D special effect, and can generate the 3D special effect parameter so that the 3D special effect generation algorithm can use the 3D special effect parameter on the face image collected in real time.
- the standard face image includes facial feature points. As shown in FIG. 2, after displaying the standard face image in step S1, the method includes:
- Step S11 Receive a reference point selection command, and select at least one feature point as a reference point.
- the step S5 generates the three-dimensional special effect on the first face image according to the special effect parameter, and specifically includes S12:
- the tracking methods can be divided into fixed 3D special effects and tracking 3D special effects.
- a fixed three-dimensional special effect is used. This three-dimensional special effect is relatively simple. It only needs to set the absolute position of the entire three-dimensional special effect range in the image sensor.
- the implementation method may be to combine the display device with the pixels of the image acquisition window of the image sensor. Point-to-point correspondence, determine the position of the 3D special effect in the display device, and then perform corresponding 3D special effect processing on the corresponding position of the image collected by the image sensor acquisition window.
- the advantage of this 3D special effect processing method is simple and easy to operate.
- the parameters used in the method are relative to the position of the acquisition window.
- when generating a three-dimensional special effect image first obtain the feature points of the standard face image in step S1, and determine the three-dimensional special effect through the feature points. Position in a standard face image; The first face image corresponding to the standard face image is identified in the image collected by the processor; the position determined in the standard face image is mapped to the first face image; and the three-dimensional special effect is performed on the first face image Processing to generate 3D special effects images.
- the relative position of the three-dimensional special effect in the first face image is determined.
- the three-dimensional special effect is always located at the relative position, and the purpose of tracking the three-dimensional special effect is achieved.
- the standard face image is triangulated and has 106 feature points.
- the relative position of the action range in the face image is determined using the 3D special effects and the relative positions of the feature points.
- the face image is subjected to the same triangulation.
- the three-dimensional special effect can be fixed on the relative position of the human face to achieve the effect of tracking the three-dimensional special effect.
- the reference point plays a role of determining the relative position.
- the reference point on the standard face image has corresponding feature points on the first face image. Through the reference points and the corresponding feature points on the first face image, Generate a mapping relationship. Through the mapping relationship, a 3D special effect can be generated to a corresponding position of the first face image.
- the three-dimensional special effect triggers the display only when certain conditions are met, and the triggering conditions may be user actions, expressions, sounds, or parameters of the terminal, and so on.
- the action may be a facial action, such as blinking, mouth opening, shaking his head, nodding, eyebrow provocation.
- a 3D sticker with 3D effects as glasses the trigger condition may be set to blink twice quickly. When the user is detected to blink twice quickly Then, a 3D sticker of glasses is displayed on the user's eyes; the expression can be happy, frustrated, angry, etc.
- a 3D sticker with a three-dimensional special effect as tears a trigger condition can be set to a depressed expression.
- the trigger conditions can be any Suitable for the triggering conditions in the technical solution of the present disclosure.
- the triggering conditions may be one or more.
- the trigger may be the start of the trigger or the disappearance of the trigger.
- the trigger condition may further include a delay after the trigger. Time is how long the 3D special effects appear or disappear after the trigger condition appears.
- the following is a device embodiment of the present disclosure.
- the device embodiment of the present disclosure can be used to perform the steps implemented by the method embodiments of the present disclosure. For convenience of explanation, only parts related to the embodiments of the present disclosure are shown. Reference is made to the method embodiments of the present disclosure.
- An embodiment of the present disclosure provides a three-dimensional special effect generating device based on a human face.
- the device can perform the steps described in the embodiment of the method for generating a 3D special effect based on a face.
- the device mainly includes a display module 31, a three-dimensional special effect creation module 32, a special effect parameter generation module 33, a face image acquisition module 34, and a three-dimensional special effect generation module 35.
- a display module 31 is used to display a standard face image
- a three-dimensional special effect creation module 32 is used to create a three-dimensional special effect.
- the three-dimensional special effect is created by configuring at least a three-dimensional model and a material of the three-dimensional model.
- a special effect parameter generating module 33 is configured to generate special effect parameters according to the three-dimensional special effect
- a face image acquisition module 34 is configured to obtain a first face image recognized from an image sensor
- three-dimensional special effect generation Module 35 is configured to generate the three-dimensional special effect on the first face image according to the special effect parameter.
- the above-mentioned face-based 3D special effect generating device corresponds to the face-based 3D special effect generating method in the embodiment shown in FIG. 1 above.
- the face-based 3D special effect generating method described above please refer to the description of the face-based 3D special effect generating method described above. More details.
- the face-based 3D special effect generating device further includes:
- the reference point selection module 36 is configured to receive a reference point selection command and select at least one feature point as a reference point.
- the three-dimensional special effect generating module 35 is configured to generate the three-dimensional special effect on the first face image according to the special effect parameter and the reference point.
- the above-mentioned face-based 3D special effect generating device corresponds to the face-based 3D special effect generating method in the embodiment shown in FIG. 2 above.
- the face-based 3D special effect generating method For specific details, please refer to the above description of the face-based 3D special effect generating method. More details.
- a three-dimensional special effect is created on a standard face image.
- the three-dimensional special effect can be configured to generate three-dimensional special effect parameters, and then the three-dimensional special effect on the actual face image is generated according to the three-dimensional special effect parameter.
- 3D special effects need to be produced by a third-party tool, which lacks flexibility when used, and cannot be configured in real time, and can only be placed in existing images or videos, and cannot be generated on face images collected in real time. 3D special effects.
- the user can conveniently configure and edit the 3D special effect, and can generate the 3D special effect parameter so that the 3D special effect generation algorithm can use the 3D special effect parameter on the face image collected in real time.
- FIG. 5 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure. As shown in FIG. 5, the electronic device 50 according to an embodiment of the present disclosure includes a memory 51 and a processor 52.
- the memory 51 is configured to store non-transitory computer-readable instructions.
- the memory 51 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory.
- the volatile memory may include, for example, a random access memory (RAM) and / or a cache memory.
- the non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, and the like.
- the processor 52 may be a central processing unit (CPU) or other form of processing unit having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 50 to perform desired functions.
- the processor 52 is configured to run the computer-readable instructions stored in the memory 51 so that the electronic device 50 executes the face-based special effect generating method of the foregoing embodiments of the present disclosure. All or part of the steps.
- this embodiment may also include well-known structures such as a communication bus and an interface. These well-known structures should also be included in the protection scope of the present disclosure. within.
- FIG. 6 is a schematic diagram illustrating a computer-readable storage medium according to an embodiment of the present disclosure.
- a computer-readable storage medium 60 stores non-transitory computer-readable instructions 61 thereon.
- the non-transitory computer-readable instruction 61 is executed by a processor, all or part of the steps of the face-based special effect generating method of the foregoing embodiments of the present disclosure are performed.
- the computer-readable storage medium 60 includes, but is not limited to, optical storage media (for example, CD-ROM and DVD), magneto-optical storage media (for example, MO), magnetic storage media (for example, magnetic tape or mobile hard disk), Non-volatile memory rewritable media (for example: memory card) and media with built-in ROM (for example: ROM box).
- optical storage media for example, CD-ROM and DVD
- magneto-optical storage media for example, MO
- magnetic storage media for example, magnetic tape or mobile hard disk
- Non-volatile memory rewritable media for example: memory card
- media with built-in ROM for example: ROM box
- FIG. 7 is a schematic diagram illustrating a hardware structure of a terminal device according to an embodiment of the present disclosure.
- the face-based 3D special effect generating terminal 70 includes the embodiment of the face-based 3D special effect generating device described above.
- the terminal device may be implemented in various forms, and the terminal device in the present disclosure may include, but is not limited to, such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), Mobile terminal devices such as PMPs (portable multimedia players), navigation devices, vehicle-mounted terminal devices, vehicle-mounted display terminals, vehicle-mounted electronic rear-view mirrors, and the like, and fixed terminal devices such as digital TVs, desktop computers, and the like.
- PMPs portable multimedia players
- navigation devices such as PMPs (portable multimedia players), navigation devices, vehicle-mounted terminal devices, vehicle-mounted display terminals, vehicle-mounted electronic rear-view mirrors, and the like
- fixed terminal devices such as digital TVs, desktop computers, and the like.
- the terminal may further include other components.
- the face-based 3D special effect generating terminal 70 may include a power source unit 71, a wireless communication unit 72, an A / V (audio / video) input unit 73, a user input unit 74, a sensing unit 75, and an interface.
- FIG. 7 illustrates a terminal having various components, but it should be understood that it is not required to implement all the illustrated components, and more or fewer components may be implemented instead.
- the wireless communication unit 72 allows radio communication between the terminal 70 and a wireless communication system or network.
- the A / V input unit 73 is used to receive audio or video signals.
- the user input unit 74 may generate key input data according to a command input by the user to control various operations of the terminal device.
- the sensing unit 75 detects the current state of the terminal 70, the position of the terminal 70, the presence or absence of a user's touch input to the terminal 70, the orientation of the terminal 70, the acceleration or deceleration movement and direction of the terminal 70, and the like, and generates a signal for controlling the terminal 70's operation command or signal.
- the interface unit 76 functions as an interface through which at least one external device can be connected to the terminal 70.
- the output unit 78 is configured to provide an output signal in a visual, audio, and / or tactile manner.
- the storage unit 79 may store software programs and the like for processing and control operations performed by the controller 77, or may temporarily store data that has been output or is to be output.
- the storage unit 79 may include at least one type of storage medium.
- the terminal 70 can cooperate with a network storage device that performs a storage function of the storage unit 79 through a network connection.
- the controller 77 generally controls the overall operation of the terminal device.
- the controller 77 may include a multimedia module for reproducing or playing back multimedia data.
- the controller 77 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as characters or images.
- the power supply unit 71 receives external power or internal power under the control of the controller 77 and provides appropriate power required to operate each element and component.
- Various embodiments of the face-based three-dimensional special effect generation method proposed by the present disclosure may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof.
- various embodiments of the face-based 3D special effect generation method proposed by the present disclosure can be implemented by using an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable At least one of a logic device (PLD), a field programmable gate array (FPGA), a processor, a controller, a microcontroller, a microprocessor, and an electronic unit designed to perform the functions described herein is implemented in some
- ASIC application specific integrated circuit
- DSP digital signal processor
- DSPD digital signal processing device
- FPGA field programmable gate array
- a processor a controller, a microcontroller, a microprocessor, and an electronic unit designed to perform the functions described herein is implemented in some
- various embodiments of the face-based 3D special effect generation method proposed by the present disclosure may be implemented with a separate software module that allows execution of at least one function or operation.
- the software codes may be implemented by a software application program (or program) written in any suitable programming language, and the software codes may be stored in the storage unit 79 and executed by the controller 77.
- an "or” used in an enumeration of items beginning with “at least one” indicates a separate enumeration such that, for example, an "at least one of A, B, or C” enumeration means A or B or C, or AB or AC or BC, or ABC (ie A and B and C).
- the word "exemplary” does not mean that the described example is preferred or better than other examples.
- each component or each step can be disassembled and / or recombined.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Graphics (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Architecture (AREA)
- Processing Or Creating Images (AREA)
- Image Generation (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (10)
- 一种基于人脸的三维特效生成方法,其特征在于,包括:显示标准人脸图像;创建三维特效,所述三维特效至少通过配置三维模型和配置三维模型的材质来创建,所述三维特效位于所述标准人脸图像上;根据所述三维特效生成特效参数;获取从图像传感器中识别出的第一人脸图像;根据所述特效参数,在第一人脸图像上生成所述三维特效。
- 根据权利要求1所述的方法,其特征在于,所述配置三维模型,包括:获取所述三维模型,并将其显示在标准人脸图像上;配置所述三维模型的位置以及尺寸。
- 根据权利要求1所述的方法,其特征在于,所述配置三维模型的材质,包括:创建所述材质,并调节所述材质的参数;所述材质的参数包括渲染混合模式参数、是否启用深度测试参数、是否启用深度写参数、是否开启剔除参数中的一个或多个。
- 根据权利要求1所述的方法,其特征在于,所述创建三维特效,还包括:配置灯光,所述灯光包括点光源、平行光源及聚光灯光源中的一种。
- 根据权利要求4所述的方法,其特征在于,所述配置灯光,包括:配置灯光的位置、方向、颜色以及强度。
- 根据权利要求1所述的方法,其特征在于,所述创建三维特效,还 包括:配置所述三维模型的纹理,包括:获取所述纹理的贴图;配置纹理的环绕模式。
- 根据权利要求1所述的方法,其特征在于:所述标准人脸图像上包括人脸特征点,所述显示标准人脸图像之后,包括:接收参考点选择命令,选择至少一个特征点作为参考点;所述根据所述特效参数,在第一人脸图像上生成所述三维特效,包括:根据所述特效参数以及所述参考点,在第一人脸图像上生成所述三维特效。
- 一种基于人脸的三维特效生成装置,其特征在于,包括:显示模块,用于显示标准人脸图像;三维特效创建模块,用于创建三维特效,所述三维特效至少通过配置三维模型和配置三维模型的材质来创建,所述三维特效位于所述标准人脸图像上;特效参数生成模块,用于根据所述三维特效生成特效参数;人脸图像获取模块,用于获取从图像传感器中识别出的第一人脸图像;三维特效生成模块,用于根据所述特效参数,在第一人脸图像上生成所述三维特效。
- 一种电子设备,其特征在于,所述电子设备包括:至少一个处理器;以及,与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有能被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-7任一所述的基于人脸的三维特效生成方法。
- 一种非暂态计算机可读存储介质,其特征在于,该非暂态计算机可读存储介质存储计算机指令,该计算机指令用于使计算机执行权利要求1-7任一所述的基于人脸的三维特效生成方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB2100222.5A GB2589505B (en) | 2018-07-27 | 2018-12-25 | Method, apparatus and electronic device for generating a three-dimensional effect based on a face |
JP2020571659A JP7168694B2 (ja) | 2018-07-27 | 2018-12-25 | ヒューマンフェースによる3d特殊効果生成方法、装置および電子装置 |
US16/967,962 US11276238B2 (en) | 2018-07-27 | 2018-12-25 | Method, apparatus and electronic device for generating a three-dimensional effect based on a face |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810838414.XA CN109147023A (zh) | 2018-07-27 | 2018-07-27 | 基于人脸的三维特效生成方法、装置和电子设备 |
CN201810838414.X | 2018-07-27 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020019665A1 true WO2020019665A1 (zh) | 2020-01-30 |
Family
ID=64798161
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/123641 WO2020019665A1 (zh) | 2018-07-27 | 2018-12-25 | 基于人脸的三维特效生成方法、装置和电子设备 |
Country Status (5)
Country | Link |
---|---|
US (1) | US11276238B2 (zh) |
JP (1) | JP7168694B2 (zh) |
CN (1) | CN109147023A (zh) |
GB (1) | GB2589505B (zh) |
WO (1) | WO2020019665A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116188640A (zh) * | 2022-12-09 | 2023-05-30 | 北京百度网讯科技有限公司 | 三维虚拟形象的生成方法、装置、设备和介质 |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109903375B (zh) * | 2019-02-21 | 2023-06-06 | Oppo广东移动通信有限公司 | 模型生成方法、装置、存储介质及电子设备 |
CN110401801A (zh) * | 2019-07-22 | 2019-11-01 | 北京达佳互联信息技术有限公司 | 视频生成方法、装置、电子设备及存储介质 |
CN110570505B (zh) * | 2019-09-11 | 2020-11-17 | 腾讯科技(深圳)有限公司 | 一种图像渲染方法、装置、设备及存储介质 |
CN111242881B (zh) * | 2020-01-07 | 2021-01-12 | 北京字节跳动网络技术有限公司 | 显示特效的方法、装置、存储介质及电子设备 |
CN111428665B (zh) * | 2020-03-30 | 2024-04-12 | 咪咕视讯科技有限公司 | 一种信息确定方法、设备及计算机可读存储介质 |
CN111833461B (zh) * | 2020-07-10 | 2022-07-01 | 北京字节跳动网络技术有限公司 | 一种图像特效的实现方法、装置、电子设备及存储介质 |
CN113096225B (zh) * | 2021-03-19 | 2023-11-21 | 北京达佳互联信息技术有限公司 | 一种图像特效的生成方法、装置、电子设备及存储介质 |
CN114494556A (zh) * | 2022-01-30 | 2022-05-13 | 北京大甜绵白糖科技有限公司 | 一种特效渲染方法、装置、设备及存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101452582A (zh) * | 2008-12-18 | 2009-06-10 | 北京中星微电子有限公司 | 一种实现三维视频特效的方法和装置 |
CN102800130A (zh) * | 2012-07-04 | 2012-11-28 | 哈尔滨工程大学 | 一种近水面飞行器机动飞行视景仿真方法 |
CN105354872A (zh) * | 2015-11-04 | 2016-02-24 | 深圳墨麟科技股份有限公司 | 一种基于3d网页游戏的渲染引擎、实现方法及制作工具 |
CN108062791A (zh) * | 2018-01-12 | 2018-05-22 | 北京奇虎科技有限公司 | 一种重建人脸三维模型的方法和装置 |
CN108073669A (zh) * | 2017-01-12 | 2018-05-25 | 北京市商汤科技开发有限公司 | 业务对象展示方法、装置和电子设备 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006507585A (ja) * | 2002-11-15 | 2006-03-02 | ワーナー・ブロス・エンターテイメント・インコーポレーテッド | デジタルモデリング用のリバースレンダリング法 |
US7324117B1 (en) * | 2004-03-29 | 2008-01-29 | Nvidia Corporation | Method and apparatus for using non-power of two dimension texture maps |
JP4865472B2 (ja) * | 2006-09-21 | 2012-02-01 | 株式会社バンダイナムコゲームス | プログラム、情報記憶媒体及び画像生成システム |
KR100873638B1 (ko) * | 2007-01-16 | 2008-12-12 | 삼성전자주식회사 | 영상 처리 방법 및 장치 |
JP2009053981A (ja) * | 2007-08-28 | 2009-03-12 | Kao Corp | 化粧シミュレーション装置 |
EP2845384A1 (en) * | 2012-05-02 | 2015-03-11 | Koninklijke Philips N.V. | Quality metric for processing 3d video |
WO2015144209A1 (en) * | 2014-03-25 | 2015-10-01 | Metaio Gmbh | Method and system for representing a virtual object in a view of a real environment |
US9245358B2 (en) * | 2014-05-30 | 2016-01-26 | Apple Inc. | Systems and methods for generating refined, high fidelity normal maps for 2D and 3D textures |
US9817248B2 (en) * | 2014-12-23 | 2017-11-14 | Multimedia Image Solution Limited | Method of virtually trying on eyeglasses |
CN106341720B (zh) * | 2016-08-18 | 2019-07-26 | 北京奇虎科技有限公司 | 一种在视频直播中添加脸部特效的方法及装置 |
-
2018
- 2018-07-27 CN CN201810838414.XA patent/CN109147023A/zh active Pending
- 2018-12-25 GB GB2100222.5A patent/GB2589505B/en active Active
- 2018-12-25 JP JP2020571659A patent/JP7168694B2/ja active Active
- 2018-12-25 WO PCT/CN2018/123641 patent/WO2020019665A1/zh active Application Filing
- 2018-12-25 US US16/967,962 patent/US11276238B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101452582A (zh) * | 2008-12-18 | 2009-06-10 | 北京中星微电子有限公司 | 一种实现三维视频特效的方法和装置 |
CN102800130A (zh) * | 2012-07-04 | 2012-11-28 | 哈尔滨工程大学 | 一种近水面飞行器机动飞行视景仿真方法 |
CN105354872A (zh) * | 2015-11-04 | 2016-02-24 | 深圳墨麟科技股份有限公司 | 一种基于3d网页游戏的渲染引擎、实现方法及制作工具 |
CN108073669A (zh) * | 2017-01-12 | 2018-05-25 | 北京市商汤科技开发有限公司 | 业务对象展示方法、装置和电子设备 |
CN108062791A (zh) * | 2018-01-12 | 2018-05-22 | 北京奇虎科技有限公司 | 一种重建人脸三维模型的方法和装置 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116188640A (zh) * | 2022-12-09 | 2023-05-30 | 北京百度网讯科技有限公司 | 三维虚拟形象的生成方法、装置、设备和介质 |
CN116188640B (zh) * | 2022-12-09 | 2023-09-08 | 北京百度网讯科技有限公司 | 三维虚拟形象的生成方法、装置、设备和介质 |
Also Published As
Publication number | Publication date |
---|---|
CN109147023A (zh) | 2019-01-04 |
US20210035369A1 (en) | 2021-02-04 |
JP7168694B2 (ja) | 2022-11-09 |
US11276238B2 (en) | 2022-03-15 |
JP2021528770A (ja) | 2021-10-21 |
GB202100222D0 (en) | 2021-02-24 |
GB2589505A (en) | 2021-06-02 |
GB2589505B (en) | 2023-01-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020019665A1 (zh) | 基于人脸的三维特效生成方法、装置和电子设备 | |
US11354825B2 (en) | Method, apparatus for generating special effect based on face, and electronic device | |
US11017580B2 (en) | Face image processing based on key point detection | |
EP3855288B1 (en) | Spatial relationships for integration of visual images of physical environment into virtual reality | |
US20220245906A1 (en) | Location-based virtual element modality in three-dimensional content | |
US20210312695A1 (en) | Hair rendering method, device, electronic apparatus, and storage medium | |
WO2020019664A1 (zh) | 基于人脸的形变图像生成方法和装置 | |
JP7008733B2 (ja) | 挿入される画像コンテンツについての影生成 | |
WO2020024569A1 (zh) | 动态生成人脸三维模型的方法、装置、电子设备 | |
US11176355B2 (en) | Facial image processing method and apparatus, electronic device and computer readable storage medium | |
WO2020019666A1 (zh) | 人脸特效的多人脸跟踪方法、装置和电子设备 | |
WO2020019667A1 (zh) | 三维粒子特效生成方法、装置和电子设备 | |
TWI752419B (zh) | 影像處理方法及裝置、圖像設備及儲存媒介 | |
JP2023541275A (ja) | 環境内のオブジェクトと相互作用する方法 | |
WO2020037923A1 (zh) | 图像合成方法和装置 | |
CN109064387A (zh) | 图像特效生成方法、装置和电子设备 | |
US20210271883A1 (en) | Methods and apparatus for projecting augmented reality enhancements to real objects in response to user gestures detected in a real environment | |
WO2022105677A1 (zh) | 虚拟现实设备的键盘透视方法、装置及虚拟现实设备 | |
WO2020037924A1 (zh) | 动画生成方法和装置 | |
WO2020001015A1 (zh) | 场景操控的方法、装置及电子设备 | |
WO2020001016A1 (zh) | 运动图像生成方法、装置、电子设备及计算机可读存储介质 | |
CN104378620A (zh) | 一种图像处理方法及电子设备 | |
CN109147054A (zh) | Ar的3d模型朝向的设置方法、装置、存储介质及终端 | |
US10825258B1 (en) | Systems and methods for graph-based design of augmented-reality effects | |
Lim et al. | 3D caricature generation system on the mobile handset using a single photograph |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18927605 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020571659 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 202100222 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20181225 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 19.05.2021) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18927605 Country of ref document: EP Kind code of ref document: A1 |