WO2022135518A1 - Procédé et appareil d'enregistrement de globe oculaire basés sur un modèle de dessin animé tridimensionnel, et serveur et support - Google Patents

Procédé et appareil d'enregistrement de globe oculaire basés sur un modèle de dessin animé tridimensionnel, et serveur et support Download PDF

Info

Publication number
WO2022135518A1
WO2022135518A1 PCT/CN2021/140798 CN2021140798W WO2022135518A1 WO 2022135518 A1 WO2022135518 A1 WO 2022135518A1 CN 2021140798 W CN2021140798 W CN 2021140798W WO 2022135518 A1 WO2022135518 A1 WO 2022135518A1
Authority
WO
WIPO (PCT)
Prior art keywords
eyeball
dimensional
template
face
cartoon model
Prior art date
Application number
PCT/CN2021/140798
Other languages
English (en)
Chinese (zh)
Inventor
章菲倩
Original Assignee
百果园技术(新加坡)有限公司
章菲倩
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百果园技术(新加坡)有限公司, 章菲倩 filed Critical 百果园技术(新加坡)有限公司
Publication of WO2022135518A1 publication Critical patent/WO2022135518A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/344—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Definitions

  • the present application relates to the technical field of three-dimensional model reconstruction, for example, to an eye registration method, device, server and medium based on a three-dimensional cartoon model.
  • AR Augmented Reality
  • the present application provides an eyeball registration method, device, server and medium based on a three-dimensional cartoon model, which reduces the computational cost of eyeball registration in the three-dimensional cartoon model, reduces the complexity of eyeball registration in the three-dimensional cartoon model, and improves the three-dimensional cartoon model. Efficiency of mid-eye registration.
  • an eyeball registration method based on a three-dimensional cartoon model comprising:
  • an eyeball registration device based on a three-dimensional cartoon model comprising:
  • the cartoon model customization module is set to deform the 3D cartoon grid template according to the face image to be customized to obtain a customized 3D face cartoon model;
  • the scaling and registration determining module is configured to calculate the scaling and registration parameters of the preset 3D eyeball template in the 3D face cartoon model according to the orbital deformation information in the 3D face cartoon model;
  • the translation registration determination module is set to make the three-dimensional eyeball template scaled according to the scaling and registration parameters, and the eyelid grid in the three-dimensional face cartoon model not interspersed as the target, and calculate the three-dimensional eyeball The translation registration parameters of the template in the three-dimensional face cartoon model.
  • a server that includes:
  • processors one or more processors
  • storage means arranged to store one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors implement the three-dimensional cartoon model-based eye registration method described in any embodiment of the present application.
  • a computer-readable storage medium which stores a computer program, and when the computer program is executed by a processor, implements the three-dimensional cartoon model-based eyeball registration method described in any embodiment of the present application.
  • FIG. 1A is a flowchart of a method for eyeball registration based on a three-dimensional cartoon model provided by Embodiment 1 of the present application;
  • FIG. 1B is a schematic diagram of the principle of an eyeball registration process based on a three-dimensional cartoon model provided in Embodiment 1 of the present application;
  • FIG. 2A is a flowchart of a method for eyeball registration based on a three-dimensional cartoon model according to Embodiment 2 of the present application;
  • FIG. 2B is a schematic diagram of the principle of an eyeball registration process based on a three-dimensional cartoon model according to Embodiment 2 of the present application;
  • Fig. 2C is the schematic diagram of the eyelid edge feature point in the three-dimensional face cartoon model in the method that the second embodiment of the application provides;
  • FIG. 2D is a schematic diagram of multiple feature points in the eyelid grid in the three-dimensional face cartoon model in the method provided in Embodiment 2 of the present application;
  • FIG. 3A is a flowchart of a method for eyeball registration based on a three-dimensional cartoon model provided in Embodiment 3 of the present application;
  • 3B is a schematic diagram of the center point of the pupil in the three-dimensional eyeball template in the method provided in Embodiment 3 of the present application;
  • 3C is a schematic diagram of the closest feature point of the pupil center point in the three-dimensional eyeball template on the three-dimensional cartoon grid template in the method provided by the third embodiment of the present application;
  • 3D is a schematic diagram of the principle of the translation registration process of the three-dimensional eyeball template in the method provided in Embodiment 3 of the present application;
  • FIG. 4 is a schematic structural diagram of an eyeball registration device based on a three-dimensional cartoon model according to Embodiment 4 of the present application;
  • FIG. 5 is a schematic structural diagram of a server according to Embodiment 5 of the present application.
  • FIG. 1A is a flowchart of a method for eyeball registration based on a 3D cartoon model provided in Embodiment 1 of the present application. size and location are registered.
  • the method for eyeball registration based on a 3D cartoon model provided in this embodiment may be performed by the device for eyeball registration based on a 3D cartoon model provided in this embodiment of the present application, which may be implemented by software and/or hardware, and It is integrated in a server that executes the method, and the server can be a background server with the ability of three-dimensional image reconstruction.
  • the method may include the following steps.
  • the present embodiment separates the three-dimensional cartoon image customization process and the eyeball registration process in the face image and implements them in sequence.
  • the three-dimensional cartoon image is reconstructed, and the eyeballs are registered in the reconstructed three-dimensional face cartoon model, so as to obtain the final three-dimensional face cartoon image.
  • the face image is the collected image data including the face image. Since this embodiment is mainly used to customize the 3D cartoon image of the face image collected in the AR product, the camera and the like configured in the AR product can be used. Image collector to collect the current face image. At the same time, in order to ensure the fidelity of the three-dimensional face cartoon image, this embodiment will preset a three-dimensional cartoon grid template with a standard cartoon face image, and the three-dimensional cartoon grid template is pre-created according to the standard face cartoon image 3D cartoon model with grid distribution indication added; during the creation of 3D cartoon grid template, 3D cartoon models with different precisions or different grid shapes can be created according to the pixel resolution of the selected model and the different grid shapes.
  • the grid template means that the density of grid distribution or the grid distribution shape in the created 3D cartoon grid template is different, for example, it can be composed of quadrilateral grids, and it can also be composed of triangular grids.
  • a created 3D cartoon grid template will be pre-stored, and the same 3D cartoon grid template can be subsequently matched with different face images by referring to the same 3D cartoon grid template. , to customize the 3D cartoon image of multiple face images, so as to avoid the restriction of face pose or image in different face images.
  • AR products are used to collect the face images that need to be referenced when customizing the 3D cartoon image, and the pre-stored images that support the accuracy of multiple users are collected.
  • the cartoon pose in the resulting three-dimensional cartoon grid template can be approximately the same as the face pose in the face image, and the deformed three-dimensional cartoon grid template is used as the three-dimensional face customized according to the face image in this embodiment.
  • Cartoon model at this time, for different face images, you can refer to the 3D cartoon grid template for corresponding deformation, so as to obtain a customized 3D face cartoon model under each face image.
  • the customized 3D face cartoon The model and the 3D cartoon mesh template have the same mesh vertices, so that the registration of the eyeball can be accurately analyzed according to the deformation of specific vertices on the eyelid.
  • this embodiment separates the three-dimensional cartoon image customizing process and the eyeball registration process in the face image.
  • this embodiment will preset a three-dimensional eyeball template with standard eyeball specifications, and customize the three-dimensional face according to the face posture in the face image.
  • the three-dimensional eyeball template can be adjusted adaptively, so that the adjusted three-dimensional eyeball template can completely fit the eye region in the customized three-dimensional face cartoon model.
  • the 3D face cartoon model is customized by deforming the 3D cartoon grid template according to the face image
  • the size and depth of the eye sockets in the customized 3D face cartoon model will be changed accordingly, so that the size of the eyeball and the The position will also change accordingly.
  • the change of the eyeball size can be represented by the zoom registration parameter of the eyeball
  • the change of the eyeball position can be represented by the translation registration parameter of the eyeball.
  • the 3D eyeball model after eyeball registration is also required to be completely adapted to the customized 3D eyeball model.
  • the orbit of the 3D face cartoon model as shown in Figure 1B, for the eye registration under either eye of the left eye and the right eye in the 3D cartoon grid template, it can be analyzed by analyzing the 3D cartoon grid template.
  • the difference between the original size of the orbit under the eye and the actual size of the orbit under the eye in the customized 3D face cartoon model after deformation is used to calculate the scaling of the 3D eye template under each eye in the 3D face cartoon model.
  • the depth of the eye socket in the 3D cartoon mesh model may be deformed according to the eye pose of the face image.
  • the scaled 3D eyeball template protrudes from the orbit in the 3D cartoon mesh model. Therefore, in order to ensure the adaptability between the scaled 3D eyeball template and the depth of the orbit in the 3D cartoon mesh model, this embodiment also requires the scaled 3D eyeball template.
  • the position of the 3D eyeball template is translated, so that the eyelids in the customized 3D face cartoon model can completely wrap the 3D eyeball model obtained after registration, so as to ensure the fidelity of eyeball registration in the 3D face cartoon model.
  • the 3D eye template is zoomed according to the scaling and registration parameters of the 3D eye template in the 3D face cartoon model, it can be analyzed by analyzing the scaled Whether there is interspersed between the 3D eyeball template and each eyelid grid in the 3D face cartoon model, and the specific interleaving situation, so as to determine the ability to make the scaled 3D eyeball template and the eyelid grid in the 3D face cartoon model. There are no interspersed translational registration parameters.
  • the scaling registration parameters and translation registration parameters of the 3D eyeball template in the 3D face cartoon model are determined, the scaling registration parameters and the translation registration parameters are also used in the 3D face cartoon model.
  • the three-dimensional eyeball template is registered in sequence; for the eyeball registration under each eye in the three-dimensional face cartoon model, the scaling and registration parameters calculated for the three-dimensional eyeball template under the eye in the three-dimensional face cartoon model are used.
  • the three-dimensional eyeball template is scaled in the eye of the cartoon face model, and the translation registration parameters under the eye are used again to continue to perform corresponding translation on the scaled three-dimensional eyeball template in the eye of the three-dimensional face cartoon model, thereby realizing
  • the eyeballs in each eye of the 3D face cartoon model are accurately registered to avoid the situation of interspersed between the registered 3D eyeball model and the eyelid grid in the 3D face cartoon model.
  • the uniformly set 3D cartoon grid template is deformed according to the face image to be customized to obtain a customized 3D face cartoon model, and according to the orbital deformation information in the 3D face cartoon model,
  • the deformation of a large number of model points in the mesh model greatly reduces the computational overhead of eyeball registration in the 3D cartoon model.
  • the 3D face can be realized directly by scaling and panning the 3D eye template in the 3D face cartoon model.
  • the eyeball registration in the cartoon model reduces the complexity of the eyeball registration in the three-dimensional cartoon model and improves the efficiency of the eyeball registration in the three-dimensional cartoon model.
  • FIG. 2A is a flowchart of a method for eyeball registration based on a 3D cartoon model according to Embodiment 2 of the present application
  • FIG. 2B is a schematic schematic diagram of the principle of an eyeball registration process based on a 3D cartoon model according to Embodiment 2 of the present application.
  • This embodiment is described on the basis of the above-mentioned embodiment.
  • Figure 2A in this embodiment, the deformation process of the three-dimensional cartoon grid template and the calculation process of the registration parameters of the three-dimensional eyeball template in the three-dimensional face cartoon model are mainly explained.
  • this embodiment may include the following steps.
  • the cartoon image of the face shape and the face expression can be matched with the face image.
  • the three-dimensional cartoon mesh template can be processed according to the facial shape and posture by analyzing the postures of multiple feature points representing the shape of the human face and the postures of the multiple feature points representing the facial expression in the face image. Shape deformation to ensure the matching between the cartoon shape in the 3D face cartoon model and the face image, and the deformed 3D cartoon mesh template is adjusted again under the facial expression according to the facial expression posture, so as to obtain a customized 3D model.
  • the face cartoon model ensures the fidelity of the face shape and facial expression in the three-dimensional face cartoon model.
  • the deformation between multiple feature points in the face image can be used to carry out three-dimensional cartoon modeling of the face shape, and in order to ensure the fidelity of the facial expressions in the three-dimensional face cartoon model, a three-dimensional cartoon model can be used.
  • Blend shape model realization including smile blendshape, left eye closed blendshape (eyeblink_L) and right eye closed blendshape (eyeblink), etc.
  • eyeblink_L left eye closed blendshape
  • eyeblink right eye closed blendshape
  • the orbital deformation information referred to when calculating the scaling and registration parameters of the three-dimensional eyeball template in the three-dimensional face cartoon model is mainly used to determine the size of the orbit in each eye of the customized three-dimensional face cartoon model,
  • a plurality of eyelid edge feature points that can accurately represent the position of the orbit can be extracted from the eye region where the left eye or the right eye is located in the three-dimensional face cartoon model, and the three-dimensional cartoon image of each eyelid edge feature point before deformation can be analyzed.
  • the initial position in the grid template and the deformed position in the deformed 3D face cartoon model, and each eyelid edge feature is determined according to the deformation between the initial position of each eyelid edge feature point and the deformed position
  • the deformation information of the point is calculated to calculate the corresponding orbital deformation information.
  • FIG. 2C Exemplarily, as shown in FIG. 2C , if there are four eyelid edge feature points v l,i , v r,i , v u,i and v b,i in an eyelid part of the three-dimensional face cartoon model, and each The position coordinates of the eyelid edge feature points before deformation are represented by P, and the position coordinates after deformation are represented by Q, where i represents the left eye or right eye in the 3D face cartoon model, then the 3D eyeball template is in the 3D face cartoon model.
  • the scaling registration parameters of can be:
  • S240 Determine eyelid grids in different eyelid states in the three-dimensional face cartoon model, and extract feature points in each eyelid grid.
  • the corresponding eyelid mesh will be specially customized for the eyelid states under various eye expressions.
  • a large number of mesh vertices need to be extracted from each eyelid mesh under different eyelid states in the 3D face cartoon model, as the feature points in the eyelid mesh, and then the scaled 3D eyeball template will be analyzed subsequently. Whether there is interspersed with the eyelid mesh in the 3D
  • S250 Calculate the center point of the eyeball and the radius of the eyeball after the three-dimensional eyeball template is scaled according to the scaling and registration parameters.
  • the distance between the feature point and the center point of the eyeball scaled by the 3D eyeball template can be calculated separately. If the distance is smaller than the scaled eyeball radius of the 3D eyeball template, it means that the feature point in the eyelid grid in the 3D face cartoon model is interspersed in the scaled 3D eyeball template, so that the scaled 3D eyeball template is in the 3D face cartoon The eye socket of the model is highlighted. At this time, it is necessary to translate the scaled 3D eyeball template to the inside of the eye frame of the 3D face cartoon model, so that the feature point on the eyelid grid in the 3D face cartoon model will not be interspersed.
  • the corresponding feature point can be calculated when it meets the requirements of not being interspersed in the 3D eyeball model.
  • Sub-translation parameters at this time, according to the above steps, the sub-translation parameters corresponding to each feature point in each eyelid grid can be calculated, and then one can be selected from the sub-translation parameters corresponding to multiple feature points to make all the feature points There are no translational registration parameters interspersed in the 3D eyeball model.
  • each sub-translation parameter represents the translation distance of the 3D eyeball template, it can be compared by comparing each sub-translation parameter.
  • a sub-translation parameter corresponding to a feature point is screened out with the largest sub-translation parameter, so that all the feature points are not interspersed in the three-dimensional eyeball model, and then the screened out maximum sub-translation parameter is used as the three-dimensional eyeball template in this embodiment.
  • Translation registration parameters in the 3D face cartoon model to ensure the fidelity of eyeball registration in the 3D face cartoon model.
  • the technical solution provided by this embodiment uses the distance between each feature point on the eyelid grid in the three-dimensional face cartoon model and the center point of the eyeball after scaling, and the distance difference between the radius of the eyeball after scaling, to calculate each feature point.
  • Sub-translation parameters when a feature point satisfies the requirements of not interspersed in the registered 3D eyeball model compare the sub-translation parameters corresponding to multiple feature points, and determine the translation registration parameters of the 3D eye template in the 3D face cartoon model , to ensure the translation accuracy of the 3D eyeball template in the 3D face cartoon model, and improve the fidelity of eyeball registration in the 3D face cartoon model.
  • FIG. 3A is a flowchart of an eyeball registration method based on a three-dimensional cartoon model according to Embodiment 3 of the present application. This embodiment is described on the basis of the above-mentioned embodiment. As shown in FIG. 3A , in this embodiment, the process of calculating the center point of the eyeball and the radius of the eyeball after the three-dimensional eyeball template is scaled and the process of translation registration are mainly explained.
  • this embodiment may include the following steps.
  • the eyeball radius will also be scaled correspondingly.
  • the corresponding pupil center point can be extracted from the preset 3D eyeball template, as shown in FIG. 3B .
  • the original eyeball radius of the three-dimensional eyeball template can be calculated by analyzing the position of the pupil center point, and the 3D eyeball template is calculated according to the scaling registration parameters.
  • the original eyeball radius is correspondingly scaled, and the eyeball radius after the three-dimensional eyeball template is scaled according to the scaling and registration parameters can be obtained.
  • the eyeball radius after the three-dimensional eyeball template is scaled according to the scaling registration parameter may be: in, is the original eyeball radius of the three-dimensional eyeball template, E i is the coordinate system of the three-dimensional eyeball template, and c i is the pupil center point of the three-dimensional eyeball template.
  • S340 Calculate the center point of the eyeball after the three-dimensional eyeball template is scaled according to the scaling registration parameter according to the position of the nearest feature point in the three-dimensional face cartoon model and the eyeball radius of the pupil center point in the three-dimensional eyeball template.
  • the translation of the 3D eyeball template is set for the 3D face cartoon model
  • this embodiment can be approximated by analyzing the deformation position of the nearest feature point of the pupil center point of the three-dimensional eyeball template in the three-dimensional face cartoon model. Analyze the actual position of the pupil center point relative to the 3D face cartoon model, and then calculate the 3D eyeball template according to the distance difference between the closest feature point position of the pupil center point in the 3D face cartoon model and the radius of the eyeball.
  • the center point of the eyeball relative to the 3D face cartoon model after quasi-parameter scaling.
  • the calculation method for the position of the closest feature point of the pupil center point in the 3D face cartoon model may be: determine the original closest feature point of the pupil center point in the 3D eyeball template in the 3D cartoon mesh template;
  • the deformation position of the nearest feature point in the 3D face cartoon model is to determine the position of the nearest feature point of the pupil center point in the 3D face cartoon model.
  • t.barycentric is the barycentric coordinate of the original closest feature point in the 3D cartoon grid template of the pupil center point before deformation
  • t.triangle is the 3D cartoon grid of the pupil center point before deformation
  • the grid vertex in the grid where the original closest feature point in the template is located, and Q represents the specific deformation coordinates of the three-dimensional cartoon grid template.
  • the closest feature point of the pupil center point in the 3D face cartoon model can be approximated as the pupil center point, and by calculating the distance between the position of the closest feature point and the eyeball radius, the 3D eyeball template can be calculated according to the scaling parameters. After scaling, the center point of the eyeball relative to the 3D face cartoon model. At this time, the center point of the eyeball after the 3D eyeball template is scaled according to the scaling and registration parameters can be
  • the scaled 3D eyeball can be The template is exactly tangent to the feature point, that is, as shown in Figure 3D, the distance between the center point of the eyeball and the feature point obtained by translating the scaled 3D eyeball template by a certain distance is exactly equal to the scaled eyeball radius , at this time, if the sub-translation parameter corresponding to the feature point is set to be x, then the center point of the eyeball after the translation of the scaled 3D eyeball template is At this point it can be determined that is Arrange to get: The sub-translation parameter x corresponding to the feature point can be calculated; the sub-translation parameter corresponding to each feature point can be obtained according to the above steps, and the maximum sub-translation parameter can be obtained by comparing multiple sub-translation parameters Thus, the translation registration parameters of the 3D eyeball template in the
  • the uniformly set 3D cartoon grid template is deformed according to the face image to be customized to obtain a customized 3D face cartoon model, and according to the orbital deformation information in the 3D face cartoon model,
  • the deformation of a large number of model points in the mesh model greatly reduces the computational overhead of eyeball registration in the 3D cartoon model.
  • the 3D face can be realized directly by scaling and panning the 3D eye template in the 3D face cartoon model.
  • the eyeball registration in the cartoon model reduces the complexity of the eyeball registration in the three-dimensional cartoon model and improves the efficiency of the eyeball registration in the three-dimensional cartoon model.
  • FIG. 4 is a schematic structural diagram of an eyeball registration device based on a three-dimensional cartoon model according to Embodiment 4 of the present application. As shown in FIG. 4 , the device may include the following modules.
  • the cartoon model customization module 410 is configured to deform the three-dimensional cartoon grid template according to the face image to be customized to obtain a customized three-dimensional face cartoon model;
  • the scaling and registration determining module 420 is configured to calculate the scaling and registration parameters of the preset 3D eyeball template in the 3D face cartoon model according to the orbital deformation information in the 3D face cartoon model;
  • the translation registration determination module 430 is set to make the three-dimensional eyeball template scaled according to the scaling registration parameters and the eyelid meshes in the three-dimensional face cartoon model not interspersed as the goal, and calculate the three-dimensional The translation registration parameters of the eyeball template in the three-dimensional face cartoon model.
  • the uniformly set 3D cartoon grid template is deformed according to the face image to be customized to obtain a customized 3D face cartoon model, and according to the orbital deformation information in the 3D face cartoon model,
  • the deformation of a large number of model points in the mesh model greatly reduces the computational overhead of eyeball registration in the 3D cartoon model.
  • the 3D face can be realized directly by scaling and panning the 3D eye template in the 3D face cartoon model.
  • the eyeball registration in the cartoon model reduces the complexity of the eyeball registration in the three-dimensional cartoon model and improves the efficiency of the eyeball registration in the three-dimensional cartoon model.
  • the apparatus for eyeball registration based on a 3D cartoon model provided in this embodiment can be adapted to execute the method for eyeball registration based on a 3D cartoon model provided in any of the above embodiments, and has corresponding functions and effects.
  • FIG. 5 is a schematic structural diagram of a server according to Embodiment 5 of the present application.
  • the server includes a processor 50, a storage device 51 and a communication device 52; the number of processors 50 in the server may be one or more One processor 50 is taken as an example in FIG. 5 ; the processor 50 , the storage device 51 and the communication device 52 in the server may be connected through a bus or other means, and the connection through a bus is taken as an example in FIG. 5 .
  • the server provided in this embodiment can be used to execute the eye registration method based on the three-dimensional cartoon model provided by any of the above embodiments, and has corresponding functions and effects.
  • Embodiment 6 of the present application further provides a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the method for eyeball registration based on a three-dimensional cartoon model in any of the foregoing embodiments can be implemented.
  • the method can include:
  • a storage medium containing computer-executable instructions provided by an embodiment of the present application the computer-executable instructions of the computer-executable instructions are not limited to the above-mentioned method operations, and can also perform the eyeball matching provided by any embodiment of the present application based on a three-dimensional cartoon model. related operations in the quasi-method.
  • the present application can be implemented by means of software and general hardware, and can also be implemented by hardware.
  • the present application can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a floppy disk of a computer, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory) , RAM), flash memory (FLASH), hard disk or optical disk, etc., including multiple instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in the various embodiments of the present application.
  • the storage medium may be a non-transitory storage medium.
  • the multiple units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be realized; , the names of multiple functional units are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Architecture (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne un procédé et un appareil d'enregistrement de globe oculaire basés sur un modèle de dessin animé tridimensionnel, et un serveur et un support. Le procédé d'enregistrement de globe oculaire basé sur un modèle de dessin animé tridimensionnel consiste à : exécuter une transformation sur un modèle de grille de dessin animé tridimensionnel selon une image faciale à personnaliser, de façon à obtenir un modèle de dessin animé facial tridimensionnel personnalisé ; calculer un paramètre d'enregistrement de mise à l'échelle d'un modèle de globe oculaire tridimensionnel prédéfini dans le modèle de dessin animé facial tridimensionnel selon des informations de transformation d'orbite dans le modèle de dessin animé facial tridimensionnel ; et, dans le but d'éviter une interpénétration entre un modèle de globe oculaire tridimensionnel mis à l'échelle selon le paramètre d'enregistrement de mise à l'échelle et une grille de paupière dans le modèle de dessin animé facial tridimensionnel, calculer un paramètre d'enregistrement de translation du modèle de globe oculaire tridimensionnel dans le modèle de dessin animé facial tridimensionnel.
PCT/CN2021/140798 2020-12-25 2021-12-23 Procédé et appareil d'enregistrement de globe oculaire basés sur un modèle de dessin animé tridimensionnel, et serveur et support WO2022135518A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011565476.1 2020-12-25
CN202011565476.1A CN112581518A (zh) 2020-12-25 2020-12-25 基于三维卡通模型的眼球配准方法、装置、服务器和介质

Publications (1)

Publication Number Publication Date
WO2022135518A1 true WO2022135518A1 (fr) 2022-06-30

Family

ID=75140730

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/140798 WO2022135518A1 (fr) 2020-12-25 2021-12-23 Procédé et appareil d'enregistrement de globe oculaire basés sur un modèle de dessin animé tridimensionnel, et serveur et support

Country Status (2)

Country Link
CN (1) CN112581518A (fr)
WO (1) WO2022135518A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116188640A (zh) * 2022-12-09 2023-05-30 北京百度网讯科技有限公司 三维虚拟形象的生成方法、装置、设备和介质

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112581518A (zh) * 2020-12-25 2021-03-30 百果园技术(新加坡)有限公司 基于三维卡通模型的眼球配准方法、装置、服务器和介质
CN113516755B (zh) * 2021-04-21 2024-05-17 Oppo广东移动通信有限公司 图像处理方法、图像处理装置、电子设备和存储介质
CN116824036B (zh) * 2023-04-19 2024-05-17 南京医科大学 基于三维成像的眼球立体建模方法、系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090087035A1 (en) * 2007-10-02 2009-04-02 Microsoft Corporation Cartoon Face Generation
CN102157010A (zh) * 2011-05-25 2011-08-17 上海大学 基于分层建模及多体驱动的三维人脸动画实现方法
CN102262788A (zh) * 2010-05-24 2011-11-30 上海一格信息科技有限公司 个人三维形象互动试妆信息数据处理方法及装置
CN104715447A (zh) * 2015-03-02 2015-06-17 百度在线网络技术（北京）有限公司 图像合成方法和装置
CN108717719A (zh) * 2018-05-23 2018-10-30 腾讯科技（深圳）有限公司 卡通人脸图像的生成方法、装置及计算机存储介质
CN112085835A (zh) * 2020-08-31 2020-12-15 腾讯科技（深圳）有限公司 三维卡通人脸生成方法、装置、电子设备及存储介质
CN112581518A (zh) * 2020-12-25 2021-03-30 百果园技术(新加坡)有限公司 基于三维卡通模型的眼球配准方法、装置、服务器和介质

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020014844A (ko) * 2000-07-18 2002-02-27 최창석 3차원 얼굴 모델링 방법
KR101757642B1 (ko) * 2016-07-20 2017-07-13 (주)레벨소프트 3d 얼굴 모델링 장치 및 방법
CN107330371A (zh) * 2017-06-02 2017-11-07 深圳奥比中光科技有限公司 3d脸部模型的脸部表情的获取方法、装置和存储装置
CN109191552A (zh) * 2018-08-16 2019-01-11 Oppo广东移动通信有限公司 三维模型处理方法、装置、电子设备和存储介质
CN109191508A (zh) * 2018-09-29 2019-01-11 深圳阜时科技有限公司 一种模拟整容装置、模拟整容方法及设备
CN111382618B (zh) * 2018-12-28 2021-02-05 广州市百果园信息技术有限公司 一种人脸图像的光照检测方法、装置、设备和存储介质
CN110585592B (zh) * 2019-07-31 2022-11-22 济南瞳星智能科技有限公司 一种个性化电子针灸装置及其生成方法与生成装置
CN111028343B (zh) * 2019-12-16 2020-12-11 腾讯科技（深圳）有限公司 三维人脸模型的生成方法、装置、设备及介质
CN111882627A (zh) * 2020-07-20 2020-11-03 广州市百果园信息技术有限公司 图像处理方法、视频处理方法、装置、设备和存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090087035A1 (en) * 2007-10-02 2009-04-02 Microsoft Corporation Cartoon Face Generation
CN102262788A (zh) * 2010-05-24 2011-11-30 上海一格信息科技有限公司 个人三维形象互动试妆信息数据处理方法及装置
CN102157010A (zh) * 2011-05-25 2011-08-17 上海大学 基于分层建模及多体驱动的三维人脸动画实现方法
CN104715447A (zh) * 2015-03-02 2015-06-17 百度在线网络技术（北京）有限公司 图像合成方法和装置
CN108717719A (zh) * 2018-05-23 2018-10-30 腾讯科技（深圳）有限公司 卡通人脸图像的生成方法、装置及计算机存储介质
CN112085835A (zh) * 2020-08-31 2020-12-15 腾讯科技（深圳）有限公司 三维卡通人脸生成方法、装置、电子设备及存储介质
CN112581518A (zh) * 2020-12-25 2021-03-30 百果园技术(新加坡)有限公司 基于三维卡通模型的眼球配准方法、装置、服务器和介质

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CAO YUZHE: "The Study of Complete Virtual Human Head Modeling and Facial Expression Synthesis", MASTER THESIS, TIANJIN POLYTECHNIC UNIVERSITY, CN, no. 1, 15 January 2017 (2017-01-15), CN , XP055946683, ISSN: 1674-0246 *
LEI TENG: "The Study of Virtual Human's Eye Movement and Facial Expression Synthesis", MASTER THESIS, TIANJIN POLYTECHNIC UNIVERSITY, CN, no. 9, 15 September 2014 (2014-09-15), CN , XP055946687, ISSN: 1674-0246 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116188640A (zh) * 2022-12-09 2023-05-30 北京百度网讯科技有限公司 三维虚拟形象的生成方法、装置、设备和介质
CN116188640B (zh) * 2022-12-09 2023-09-08 北京百度网讯科技有限公司 三维虚拟形象的生成方法、装置、设备和介质

Also Published As

Publication number Publication date
CN112581518A (zh) 2021-03-30

Similar Documents

Publication Publication Date Title
WO2022135518A1 (fr) Procédé et appareil d'enregistrement de globe oculaire basés sur un modèle de dessin animé tridimensionnel, et serveur et support
US11302064B2 (en) Method and apparatus for reconstructing three-dimensional model of human body, and storage medium
CN111598998B (zh) 三维虚拟模型重建方法、装置、计算机设备和存储介质
WO2020207270A1 (fr) Procédé, système et appareil de reconstruction faciale tridimensionnelle et support de stockage
EP3992919B1 (fr) Procédé et appareil de génération de modèle facial tridimensionnel, dispositif et support
WO2022143645A1 (fr) Procédé et appareil de reconstruction de face tridimensionnelle, dispositif, et support de stockage
WO2022095721A1 (fr) Procédé et appareil de formation de modèle d'estimation de paramètre, dispositif, et support de stockage
CN113628327B (zh) 一种头部三维重建方法及设备
AU2018377863B2 (en) Customization method and apparatus
WO2021004257A1 (fr) Procédé et appareil de détection de ligne de visée, procédé et appareil de traitement vidéo, dispositif et support d'informations
WO2021244172A1 (fr) Procédé de traitement d'image et procédé de synthèse d'image, appareil de traitement d'image et appareil de synthèse d'image, et support de stockage
TWI780919B (zh) 人臉影像的處理方法、裝置、電子設備及儲存媒體
CN112102480B (zh) 图像数据处理方法、装置、设备以及介质
TWI750710B (zh) 圖像處理方法及裝置、圖像處理設備及儲存媒體
JP2024004444A (ja) ３次元顔再構成モデルトレーニング、３次元顔イメージ生成方法及び装置
EP3855386B1 (fr) Procédé, appareil, dispositif et support de stockage pour transformation de coiffure et produit programme informatique
WO2024103890A1 (fr) Procédé et appareil de construction de modèle, procédé et appareil de reconstruction, et dispositif électronique et support de stockage lisible non volatil
WO2023185398A1 (fr) Procédé et appareil de traitement facial, dispositif informatique et support de stockage
CN117132711A (zh) 一种数字人像定制方法、装置、设备及存储介质
US20220277586A1 (en) Modeling method, device, and system for three-dimensional head model, and storage medium
CN111429406A (zh) 结合多视图推理的乳腺x射线影像病变检出方法和装置
JP2003030684A (ja) 顔３次元コンピュータグラフィック生成方法及び装置及び顔３次元コンピュータグラフィック生成プログラム及び顔３次元コンピュータグラフィック生成プログラムを格納した記憶媒体
CN111369651A (zh) 三维表情动画生成方法及系统
CN116912433B (zh) 三维模型骨骼绑定方法、装置、设备及存储介质
WO2023169023A1 (fr) Procédé et appareil de génération de modèle d'expression, dispositif et support

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21909513

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21909513

Country of ref document: EP

Kind code of ref document: A1