CN112347911A - Method and device for adding special effects of fingernails, electronic equipment and storage medium - Google Patents
Method and device for adding special effects of fingernails, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112347911A CN112347911A CN202011221931.6A CN202011221931A CN112347911A CN 112347911 A CN112347911 A CN 112347911A CN 202011221931 A CN202011221931 A CN 202011221931A CN 112347911 A CN112347911 A CN 112347911A
- Authority
- CN
- China
- Prior art keywords
- nail
- region
- image
- information
- special effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000694 effects Effects 0.000 title claims abstract description 129
- 238000000034 method Methods 0.000 title claims abstract description 53
- 210000004905 finger nail Anatomy 0.000 title description 37
- 239000000463 material Substances 0.000 claims abstract description 180
- 230000011218 segmentation Effects 0.000 claims description 36
- 238000013145 classification model Methods 0.000 claims description 21
- 230000004044 response Effects 0.000 claims description 10
- 210000000282 nail Anatomy 0.000 description 658
- 210000003811 finger Anatomy 0.000 description 58
- 238000012545 processing Methods 0.000 description 35
- 210000004247 hand Anatomy 0.000 description 17
- 238000004891 communication Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000012549 training Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 210000003813 thumb Anatomy 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 210000004932 little finger Anatomy 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000005111 flow chemistry technique Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Human Computer Interaction (AREA)
- Image Processing (AREA)
Abstract
The disclosure relates to a method and a device for adding a special effect of a nail, an electronic device and a storage medium, wherein the method comprises the following steps: responding to a nail special effect selection instruction, entering a special effect shooting mode and acquiring a figure image; determining a nail region in the person image; the nail region is an unoccluded nail region in the character image; determining nail materials of the nail region from a plurality of nail materials based on the nail special effect selection instruction; adding the nail material to the nail region. By adopting the method, the adding accuracy of the special effect of the nail is improved.
Description
Technical Field
The present disclosure relates to the technical field of special effect adding, and in particular, to a method and an apparatus for adding a nail special effect, an electronic device, and a storage medium.
Background
During the current capture of an image or video, various special effects may be added to the captured image, such as adding a nail special effect to a nail region in the image.
In the related art, the existing nail special effect adding method generally adds nail materials to a nail area determined in an image; however, if the nail region specified in the image is not accurate enough, nail material is added to the non-nail region (for example, finger skin) in the image, and thus the nail region in the image cannot be subjected to accurate nail effect adding processing.
Disclosure of Invention
The present disclosure provides a method and an apparatus for adding a special nail effect, an electronic device, and a storage medium, to solve at least a problem in the related art that a nail special effect adding process cannot be accurately performed on a nail region in an image. The technical scheme of the disclosure is as follows:
according to a first aspect of an embodiment of the present disclosure, there is provided a nail special effect adding method including:
responding to a nail special effect selection instruction, entering a special effect shooting mode and acquiring a figure image;
determining a nail region in the person image; the nail region is an unoccluded nail region in the character image;
determining nail materials of the nail region from a plurality of nail materials based on the nail special effect selection instruction;
adding the nail material to the nail region.
In an exemplary embodiment, the determining the nail region in the human image includes:
determining a hand region image in the person image;
obtaining nail region semantic information, nail key point information and nail visibility information based on the hand region image;
and determining a nail region in the person image according to the nail region semantic information, the nail key point information and the nail visibility information.
In an exemplary embodiment, the obtaining nail region semantic information, nail key point information, and nail visibility information based on the hand region image includes:
inputting the hand region image into a nail semantic segmentation model, a nail key point regression model and a nail visibility classification model respectively;
determining the nail region semantic information, the nail keypoint information, and the nail visibility information based on output results of the nail semantic segmentation model, the nail keypoint regression model, and the nail visibility classification model.
In an exemplary embodiment, the adding the nail material to the nail region includes:
acquiring a nail direction corresponding to the nail area;
adding the nail material to the nail region in accordance with the nail direction.
In an exemplary embodiment, the adding the nail material to the nail region further comprises:
acquiring finger information corresponding to the nail region;
determining a nail material corresponding to the finger information from the nail material according to the finger information;
and adding the nail material corresponding to the finger information to the nail area.
In an exemplary embodiment, the adding the nail material corresponding to the finger information to the nail region includes:
acquiring a nail direction corresponding to the nail area;
and adding the nail material corresponding to the finger information to the nail area according to the nail direction.
In an exemplary embodiment, the nail regions comprise nail regions corresponding to different hands, and the nail material comprises nail material corresponding to different hands;
the adding the nail material to the nail region further comprises:
and adding the nail material corresponding to each hand to the nail area of the corresponding hand.
In an exemplary embodiment, the nail regions include nail regions corresponding to different users, and the nail materials include nail materials corresponding to different users;
the adding the nail material to the nail region further comprises:
and adding the nail material corresponding to each user to the nail area of the corresponding user.
In an exemplary embodiment, before entering a special effect shooting mode and acquiring a person image in response to a nail special effect selection instruction, the method further includes:
collecting received voice information;
and inquiring the corresponding relation between preset voice information and a nail special effect selection instruction, and determining the nail special effect selection instruction.
According to a second aspect of the embodiments of the present disclosure, there is provided a nail effect adding apparatus including:
a person image acquisition unit configured to execute entering a special effect shooting mode and acquiring a person image in response to a nail special effect selection instruction;
a nail region determination unit configured to perform determination of a nail region in the person image; the nail region is an unoccluded nail region in the character image;
a nail material determination unit configured to execute determining a nail material of the nail region from a plurality of nail materials based on the nail special effect selection instruction;
a nail material adding unit configured to perform addition of the nail material to the nail region.
In an exemplary embodiment, the nail region determining unit is further configured to execute the nail region determining unit, and is further configured to execute determining a hand region image in the person image; obtaining nail region semantic information, nail key point information and nail visibility information based on the hand region image; and determining a nail region in the person image according to the nail region semantic information, the nail key point information and the nail visibility information.
In an exemplary embodiment, the nail region determining unit is further configured to perform inputting the hand region image into a nail semantic segmentation model, a nail keypoint regression model, and a nail visibility classification model, respectively; determining the nail region semantic information, the nail keypoint information, and the nail visibility information based on output results of the nail semantic segmentation model, the nail keypoint regression model, and the nail visibility classification model.
In an exemplary embodiment, the nail material adding unit is further configured to perform acquiring a nail direction corresponding to the nail region; adding the nail material to the nail region in accordance with the nail direction.
In an exemplary embodiment, the nail material adding unit is further configured to perform acquiring finger information corresponding to the nail region; determining a nail material corresponding to the finger information from the nail material according to the finger information; and adding the nail material corresponding to the finger information to the nail area.
In an exemplary embodiment, the nail material adding unit is further configured to perform acquiring a nail direction corresponding to the nail region; and adding the nail material corresponding to the finger information to the nail area according to the nail direction.
In an exemplary embodiment, the nail regions comprise nail regions corresponding to different hands, and the nail material comprises nail material corresponding to different hands; the nail material adding unit is further configured to perform adding the nail material corresponding to each hand to the nail region of the corresponding hand.
In an exemplary embodiment, the nail regions include nail regions corresponding to different users, and the nail materials include nail materials corresponding to different users; the nail material adding unit is further configured to perform adding the nail material corresponding to each of the users to the nail region of the corresponding user.
In an exemplary embodiment, the apparatus further comprises an instruction determining unit configured to perform collecting the received voice information; and inquiring the corresponding relation between preset voice information and a nail special effect selection instruction, and determining the nail special effect selection instruction.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the method of adding nail effects as described in any embodiment of the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a storage medium including: the instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of adding nail effects described in any of the embodiments of the first aspect.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program stored in a readable storage medium, from which at least one processor of an electronic device reads and executes the computer program, so that the electronic device performs the method of adding a nail effect described in any one of the first aspect embodiments.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
responding to a nail special effect selection instruction, entering a special effect shooting mode and acquiring a figure image; then determining a nail area in the person image; the nail area is an unoccluded nail area in the object image; then determining nail materials of a nail area from the plurality of nail materials based on the nail special effect selection instruction; finally, adding the nail materials into the nail area; therefore, the unshielded nail area in the character image is used as the nail area needing to be added with the nail materials, the nail materials are added to the nail area, the nail materials are prevented from being added to the non-nail area, accurate nail special effect adding processing is favorably carried out on the nail area in the image, and the adding accuracy rate of the nail special effect is further improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is an application environment diagram illustrating a method of adding a nail effect according to an exemplary embodiment.
Fig. 2 is a flowchart illustrating a method of adding a nail effect according to an exemplary embodiment.
FIG. 3 is a schematic diagram illustrating model training and model post-processing of a nail semantic segmentation model according to an exemplary embodiment.
FIG. 4 is a flow chart illustrating another method of adding nail effects according to one exemplary embodiment.
FIG. 5 is a flow chart illustrating yet another method of adding nail effects according to an exemplary embodiment.
Fig. 6 is a block diagram illustrating a nail effect adding apparatus according to an exemplary embodiment.
Fig. 7 is an internal block diagram of an electronic device shown in accordance with an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The nail special effect adding method provided by the disclosure can be applied to the application environment shown in fig. 1. Referring to fig. 1, the application environment diagram includes an electronic device 110, where the electronic device 110 has an effect adding function, and may specifically be a smart phone, a tablet computer, a notebook computer, a personal computer, or the like. Referring to fig. 1, the electronic device 110 enters a special effect shooting mode and acquires a person image in response to a nail special effect selection instruction; determining a nail region in the person image; the nail area is an unoccluded nail area in the object image; determining nail materials of a nail region from a plurality of nail materials based on the nail special effect selection instruction; nail material is added to the nail area.
Fig. 2 is a flowchart illustrating a method for adding a nail effect according to an exemplary embodiment, where as shown in fig. 2, the method for adding nail art material is used in the electronic device shown in fig. 1, and includes the following steps:
in step S210, in response to a nail special effect selection instruction, a special effect shooting mode is entered and a person image is acquired.
The nail special effect selection instruction is an instruction for triggering the electronic equipment to enter a special effect shooting mode, and can be triggered by clicking, touching or voice. The special effect shooting mode is a mode of adding a nail special effect to a nail region in a shot person image, and the nail region may be a hand nail region of a person or a foot nail region of the person, and is not particularly limited herein.
Wherein, the person image is an image containing a photographed person; the person image may be a still image or a video image; the principle of the nail effect addition processing in the still image is the same as that of the nail effect addition processing in the video image, and the present disclosure will be mainly described by taking the nail effect addition processing in the still image as an example.
Specifically, a shooting page of the electronic equipment provided with the image shooting application program is displayed with a plurality of selection entries of nail materials for a user to select; when a user triggers a selection entry of a certain nail material, triggering a corresponding nail special effect selection instruction; after receiving the nail special effect selection instruction, the electronic equipment responds to the nail special effect selection instruction to enter a special effect shooting mode; when the electronic equipment enters a special-effect shooting mode, an image including a shot person, namely a person image, is obtained. In practical applications, the shot page may refer to a shot page of a short video application.
In step S220, a nail region in the person image is determined; the nail region is an unobstructed nail region in the object image.
The nail region that is not occluded in the person image is a visible nail region in the person image.
Specifically, after a character image is acquired, the electronic equipment performs nail semantic segmentation processing on the character image to determine an initial nail region and other regions in the character image; wherein the initial nail region and the other regions in the person image are represented by different colors, for example, white represents the initial nail region in the person image, and black represents the other regions in the person image; and carrying out visibility classification processing on the initial nail region in the human image, and determining the visible initial nail region as an unblocked nail region in the human image.
It should be noted that, in the prior art, when determining the nail region, the key point information of the hand in the image is generally determined by a key point detection algorithm, and then the top end of the hand is used as the nail region according to the key point information of the hand; through comparison, according to the method and the device, the finger nail semantic segmentation processing is carried out on the human image, then the visibility classification processing is carried out on the determined initial finger nail region, the non-shielded finger nail region in the human image is obtained, the defect that the accuracy of the finger nail region determined through the key point information is low is overcome, and therefore the determination accuracy of the finger nail region is improved.
In step S230, a nail material of the nail region is determined from the plurality of nail materials based on the nail special effect selection instruction. The nail material is a material capable of adding nail special effects to the unoccluded nail area in the human image; the type of the nail material may be a solid color, a pattern, or another type, and the disclosure is not limited in particular.
Specifically, the electronic device determines a nail material corresponding to the nail special effect selection instruction from a plurality of nail materials as a nail material corresponding to the nail region.
If the nail material corresponding to the nail special effect selection instruction is downloaded, acquiring the nail material corresponding to the nail special effect selection instruction from the local database through the electronic equipment; and if the nail material corresponding to the nail special effect selection instruction is not downloaded, sending a request to a corresponding server through the electronic equipment, and receiving the nail material corresponding to the nail special effect selection instruction returned by the server according to the request.
In step S240, nail material is added to the nail region.
Specifically, the electronic equipment adjusts the nail material to obtain a target nail material with the size matched with the nail area; and correspondingly adding the target nail materials into the nail area in the person image to obtain the person image with the target nail materials added into the nail area. Therefore, the selected nail material is added to the unoccluded nail area in the character image, and the adding accuracy rate of the nail special effect is improved.
In the method for adding the nail special effect, a special effect shooting mode is entered and a figure image is obtained in response to a nail special effect selection instruction; then determining a nail area in the person image; the nail area is an unoccluded nail area in the object image; then determining nail materials of a nail area from the plurality of nail materials based on the nail special effect selection instruction; finally, adding the nail materials into the nail area; therefore, the unshielded nail area in the character image is used as the nail area needing to be added with the nail materials, the nail materials are added to the nail area, the nail materials are prevented from being added to the non-nail area, accurate nail special effect adding processing is favorably carried out on the nail area in the image, and the adding accuracy rate of the nail special effect is further improved.
In an exemplary embodiment, in step S220, determining a nail region in the person image includes: determining a hand area image in the person image; obtaining nail region semantic information, nail key point information and nail visibility information based on the hand region image; and determining a nail region in the person image according to the nail region semantic information, the nail key point information and the nail visibility information.
Specifically, obtaining nail region semantic information, nail key point information, and nail visibility information based on the hand region image includes: respectively inputting the hand region image into a nail semantic segmentation model, a nail key point regression model and a nail visibility classification model; and determining the semantic information of the nail region, the information of the nail key points and the information of the nail visibility based on the output results of the nail semantic segmentation model, the nail key point regression model and the nail visibility classification model.
For example, first, the electronic device acquires a character image, and since the nail of the hand occupies a small area in the character image, the character image can be cut to obtain a hand area image with a large nail occupied area; for example, the electronic device identifies a hand image in the person image through an object detection algorithm; a hand image in a human image is cut out, and an image including a hand is obtained as a hand region image. Thus, the area of the nail in the hand region image is much larger than that in the person image, and the accuracy of image processing can be improved.
After obtaining the hand region image, the electronic device may further perform further preprocessing on the hand region image, such as performing denoising processing, contrast enhancement processing, resolution enhancement processing, and the like on the hand region image; specifically, the electronic equipment carries out image super-resolution reconstruction processing on the hand region image to obtain a reconstructed image of the hand region image, wherein the resolution of the reconstructed image is higher than that of the hand region image; the image super-resolution reconstruction processing means that a corresponding high-resolution image is obtained by reconstructing a low-resolution image; the reconstructed image is a high-resolution image corresponding to the hand region image.
Secondly, the electronic equipment inputs the hand region image into a pre-trained nail semantic segmentation model, and performs semantic segmentation processing on the hand region image through the pre-trained nail semantic segmentation model to obtain a semantic segmentation result corresponding to the hand region image, wherein the semantic segmentation result is a mask image corresponding to the hand region image; wherein, the white area in the mask map represents the initial nail area, and the black area represents other areas; and determining an initial nail region and other regions in the hand region image as nail region semantic information according to the semantic segmentation result corresponding to the hand region image.
The pre-trained nail semantic segmentation model can be obtained by training in the following way: the method comprises the steps that the electronic equipment obtains a sample image containing a fingernail and an actual mask image corresponding to the sample image; inputting the sample image into a nail semantic segmentation model to be trained to obtain a prediction mask image corresponding to the sample image; according to the difference value between the prediction mask image corresponding to the sample image and the actual mask image, combining with a loss function to obtain a loss value of the nail semantic segmentation model to be trained; and adjusting the model parameters of the nail semantic segmentation model to be trained according to the loss value of the nail semantic segmentation model to be trained until the loss value is lower than a first preset threshold value, and taking the trained nail semantic segmentation model as a pre-trained nail semantic segmentation model.
For example, referring to fig. 3, in the nail semantic segmentation process, since the nail area is very small (about 1% of the whole hand area), the segmentation difficulty is large, and the edge jitter phenomenon is obvious after segmentation; therefore, in the model training, a multi-scale fusion network is adopted, more abundant data are enhanced (for example, the segmentation effect of the colored fingernails is improved through color amplification), and more reasonable loss design is realized. In the post-model processing, the edge of the nail is corrected by the guide filtering, the entire network output is subjected to the time-series smoothing processing, and the center point of the nail is subjected to the optical flow stabilization processing, such as the KL optical flow processing. Therefore, by the methods, the network output can be stabilized, so that a more stable nail semantic segmentation result is obtained, and a more stable mask image is obtained.
Thirdly, the electronic equipment inputs the hand region image into a pre-trained nail key point regression model, and performs key point regression processing on the hand region image through the pre-trained nail key point regression model to obtain the key point information of the nail in the hand region image, wherein the key point information is used as the nail key point information.
The pre-trained nail key point regression model is obtained by training in the following mode: the method comprises the steps that the electronic equipment obtains a sample image containing the fingernails of the hands and actual fingernail key point information in the sample image; inputting the sample image into a regression model of the key points of the fingernail to be trained to obtain the information of the key points of the predicted fingernail corresponding to the sample image; obtaining a loss value of a regression model of the nail key points to be trained by combining a loss function according to a difference value between the predicted nail key point information corresponding to the sample image and the actual nail key point information; and adjusting the model parameters of the regression model of the key points of the fingernail to be trained according to the loss value of the regression model of the key points of the fingernail to be trained until the loss value is lower than a second preset threshold value, and taking the trained regression model of the key points of the fingernail as the pre-trained regression model of the key points of the fingernail.
Fourthly, the electronic equipment inputs the hand area image into a pre-trained nail visibility classification model, and performs visibility classification processing on the hand area image through the pre-trained nail visibility classification model to obtain nail visibility information of the hand area image; for example, if the nail is visible, 1 is obtained; if the nail is not visible, then-1 is obtained.
Wherein, the pre-trained nail visibility classification model can be obtained by training in the following way: the method comprises the steps that the electronic equipment obtains a sample image containing a fingernail and actual fingernail visibility information corresponding to the sample image; inputting the sample image into a nail visibility classification model to be trained to obtain predicted nail visibility information corresponding to the sample image; according to the difference value between the predicted fingernail visibility information and the actual fingernail visibility information corresponding to the sample image, combining a loss function to obtain a loss value of the fingernail visibility classification model to be trained; and adjusting the model parameters of the nail visibility classification model to be trained according to the loss value of the nail visibility classification model to be trained until the loss value is lower than a third preset threshold value, and taking the trained nail visibility classification model as a pre-trained nail visibility classification model.
Fifthly, the electronic equipment determines a nail area in the person image according to the nail area semantic information, the nail key point information and the nail visibility information; for example, the electronic device determines an initial nail region in the hand region image according to the nail region semantic information, and screens out an unblocked initial nail region (i.e., the initial nail region with nail visibility information of 1) from the initial nail region in the hand region image according to the nail visibility information of the hand region image as a nail region in the person image; and meanwhile, determining the nail key point information of the nail area in the character image according to the nail key point information of the hand area image.
According to the technical scheme provided by the embodiment of the disclosure, the hand area image in the character image is determined firstly; and finally, the nail region semantic information, the nail key point information and the nail visibility information are comprehensively considered to determine the nail region in the figure image, so that the nail region determination accuracy is improved.
In an exemplary embodiment, in step S240, adding nail material to the nail region includes: acquiring a nail direction corresponding to the nail area; nail material is added to the nail area in accordance with the nail direction.
The nail direction corresponding to the nail region refers to a nail direction corresponding to a nail in the nail region.
Specifically, after determining the nail region in the person image according to the nail region semantic information, the nail keypoint information, and the nail visibility information, the electronic device may determine the nail keypoint information of the nail region in the person image according to the nail keypoint information; determining a nail direction corresponding to the nail region in the character image according to the nail key point information of the nail region in the character image; then, the electronic device adds the nail material to the nail area in the person image in the nail direction corresponding to the nail area in the person image, and obtains the person image with the nail material added to the nail area.
For example, the key point information of the nail region is represented by four coordinate information, which respectively represents four vertex information of the key points of the nail region, for example, the key point information of the thumb is [0(168, 40), 1(182, 35), 2(197, 36), 3(187, 50) ], and then the nail direction of the thumb can be determined according to the two coordinate information of 2(197, 36), 0(168, 40); the key point information of the index finger is [4(53, 62), 5(70, 52), 6(84, 63), 7(69, 72) ], so that the nail direction of the index finger can be determined according to the two coordinate information of 6(84, 63) and 4(53, 62); the key point information of the middle finger is [8(38, 87), 9(56, 78), 10(64, 92), 11(51, 101) ], and then the nail direction of the middle finger can be determined according to the two coordinate information of 10(64, 92) and 8(38, 87). In addition, the nail direction of the ring finger is determined by the coordinate information with the serial numbers of 14 and 12; the nail orientation for the little finger is determined by the coordinate information with serial numbers 18 and 16.
According to the technical scheme provided by the embodiment of the disclosure, the nail direction corresponding to the nail area in the character image is determined, and the nail material is added to the nail area in the character image according to the nail direction corresponding to the nail area, so that the added nail material is more natural and vivid, and the adding accuracy of the nail special effect is improved.
In an exemplary embodiment, in step S240, adding nail material to the nail region further includes: acquiring finger information corresponding to the nail region; determining a nail material corresponding to the finger information from the nail material according to the finger information; and adding the nail material corresponding to the finger information to the nail area.
The finger information corresponding to the nail region refers to finger categories corresponding to fingers in the nail region, such as thumb, index finger, middle finger, ring finger, and little finger.
Specifically, after key point regression processing is performed on the hand region image through a pre-trained nail key point regression model to obtain the key point information of the nail in the hand region image, the finger information corresponding to the nail region in the character image is determined according to the coordinate number corresponding to the key point information and the corresponding relationship between the preset coordinate number of the key point information and the finger information.
For example, if the coordinate serial number corresponding to the key point information of the fingernail in the fingernail region in the character image is 0-3, the finger information corresponding to the fingernail region is the thumb; if the coordinate serial number corresponding to the key point information of the fingernail in the fingernail region is 4-7, the finger information corresponding to the fingernail region is the index finger; if the coordinate serial number corresponding to the key point information of the fingernail in the fingernail area is 8-11, the finger information corresponding to the fingernail area is a middle finger; if the coordinate serial number corresponding to the key point information of the fingernail in the fingernail area is 12-15, the finger information corresponding to the fingernail area is a ring finger; and if the coordinate serial number corresponding to the key point information of the fingernail in the fingernail region is 16-19, the finger information corresponding to the target fingernail region is a little finger.
Further, the electronic device may also determine size information of the nail region according to the key point information of the nail in the nail region in the hand region image.
Then, the electronic equipment determines nail materials corresponding to the nail regions from nail materials corresponding to different fingers according to finger information corresponding to the nail regions in the person image; and adding the nail materials corresponding to the nail areas to the corresponding nail areas in the human image to obtain the human image with the nail materials added to the nail areas.
For example, the electronic device adds the nail material of the index finger to the nail area corresponding to the index finger in the person image; and adding the nail material of the middle finger to the nail area corresponding to the middle finger in the person image.
According to the technical scheme provided by the embodiment of the disclosure, the finger information corresponding to the nail area is determined, the nail material corresponding to the nail area is determined from the nail materials according to the finger information corresponding to the nail area, and then the nail material corresponding to the nail area is added to the corresponding nail area in the figure image, so that the added nail material is more natural and vivid, and the adding accuracy of the nail special effect is improved.
In an exemplary embodiment, adding nail material corresponding to finger information to the nail region includes: acquiring a nail direction corresponding to the nail area; and adding the nail material corresponding to the finger information to the nail area according to the nail direction.
Specifically, the electronic equipment determines nail materials corresponding to each nail region from nail materials corresponding to different fingers according to finger information corresponding to each nail region in the person image; and adding the nail materials corresponding to the nail areas to the corresponding nail areas in the human image in the nail direction corresponding to the nail areas to obtain the human image with the nail materials added to the nail areas.
According to the technical scheme provided by the embodiment of the disclosure, the nail direction and the finger information corresponding to the nail area are comprehensively considered, so that the nail materials added to the nail area in the figure image are more natural and vivid, and the adding accuracy rate of the nail special effect is improved.
In an exemplary embodiment, the nail regions include nail regions corresponding to different hands, and the nail material includes nail material corresponding to different hands; then, in step S240, adding nail material to the nail region further includes: and adding the nail materials corresponding to the hands to the corresponding nail areas.
Wherein the nail region may include a nail region of a left hand and a nail region of a right hand of the same person; different hands have different nail materials, for example, the nail material corresponding to the left hand is different from the nail material corresponding to the right hand.
Specifically, the electronic equipment inputs a hand region image into a pre-trained hand recognition model, and performs hand recognition processing on the hand region image through the pre-trained hand recognition model to obtain hand information in the hand region image; hand information corresponding to the nail region in the hand region image is specified from the hand information in the hand region image. Then, the electronic equipment determines nail materials corresponding to the nail regions from nail materials corresponding to different hands according to the hand information corresponding to the nail regions; and adding the nail materials corresponding to the nail areas corresponding to the hands in the human image to obtain the human image with the nail materials added to the nail areas.
According to the technical scheme provided by the embodiment of the disclosure, the nail materials corresponding to different hands are comprehensively considered, and the nail materials corresponding to each hand are added to the nail areas corresponding to different hands in the figure image, so that the nail personalized beauty treatment is favorably realized.
In an exemplary embodiment, the nail regions include nail regions corresponding to different users, and the nail materials include nail materials corresponding to different users; then, the step S240 of adding the nail material to the nail region further includes: and adding the nail material corresponding to each user to the nail area of the corresponding user.
Specifically, the electronic device inputs the hand region image into a pre-trained user recognition model, and performs user recognition processing on the hand region image through the pre-trained user recognition model to obtain user information corresponding to the hand in the hand region image; the user information corresponding to the nail region in the hand region image is determined based on the user information corresponding to the hand in the hand region image. Then, the electronic equipment determines nail materials corresponding to the nail regions from nail materials corresponding to different users according to the user information corresponding to the nail regions; and adding the nail materials corresponding to the nail areas corresponding to the users in the character images to obtain the character images with the nail materials added to the nail areas.
According to the technical scheme provided by the embodiment of the disclosure, the nail materials corresponding to different users are comprehensively considered, and the nail materials corresponding to each user are added to the nail areas corresponding to different users in the figure image, so that the personalized nail art can be realized.
In an exemplary embodiment, in step S210, before entering the special effect shooting mode and acquiring the image of the person in response to the nail special effect selection instruction, the method further includes: collecting received voice information; and inquiring the corresponding relation between the preset voice information and the nail special effect selection instruction, and determining the nail special effect selection instruction.
The received voice information is the voice information sent by the current user; the preset corresponding relation between the voice information and the nail special effect selection instruction refers to different voice information corresponding to different nail special effect selection instructions, for example, if the voice information of 'selecting mahjong and beautifying nail' corresponds to a mahjong nail special effect selection instruction; the sound information of selecting the plum blossom nail is corresponding to the plum blossom nail special effect selection instruction.
Specifically, the electronic device monitors voice information sent by a user in real time, and if the voice information sent by the user is monitored, a nail special effect selection instruction corresponding to the voice information is obtained through a voice recognition technology and by combining a preset corresponding relation between the voice information and the nail special effect selection instruction and serves as the received nail special effect selection instruction.
According to the technical scheme provided by the embodiment of the disclosure, the nail special effect selection instruction is determined through the received voice information, the user does not need to touch the screen of the electronic equipment to select the nail material, the adding process of the nail material is simplified, and the adding efficiency of the nail material is further improved.
Fig. 4 is a flowchart illustrating a method for adding a nail effect according to an exemplary embodiment, where the method for adding a nail effect is used in the electronic device shown in fig. 1, as shown in fig. 4, and includes the following steps:
in step S410, in response to a nail special effect selection instruction, a special effect shooting mode is entered and a person image is acquired.
In step S420, the hand region image in the person image is determined.
In step S430, the hand region image is input into a nail semantic segmentation model, a nail key point regression model, and a nail visibility classification model, respectively; and determining the semantic information of the nail region, the information of the nail key points and the information of the nail visibility based on the output results of the nail semantic segmentation model, the nail key point regression model and the nail visibility classification model.
In step S440, determining a nail region in the person image according to the nail region semantic information, the nail key point information, and the nail visibility information; the nail region is an unobstructed nail region in the object image.
In step S450, a nail material of the nail region is determined from the plurality of nail materials based on the nail special effect selection instruction.
In step S460, nail material is added to the nail region.
According to the method for adding the special nail effect, the semantic information, the key point information and the visibility information of the nail region are comprehensively considered, the nail region which is not shielded in the figure image is used as the nail region needing to be added with the nail material, the nail material is added to the nail region, the nail material is prevented from being added to the non-nail region, the accurate special nail effect adding processing on the nail region in the image is facilitated, and the adding accuracy of the special nail effect is improved.
In an exemplary embodiment, as shown in fig. 5, the present disclosure also provides an application scenario applying the above-described nail effect adding method. Specifically, the application of the nail special effect adding method in the application scene is as follows:
(1) the hand region detection is performed for the input image, and the hand region is cut out.
(2) The cut hand images are sent to a network, the network adopts the same Encoder, but the Decode part adopts three branches, namely a nail semantic segmentation branch, a nail key point regression branch and a nail visibility classification branch. And obtaining the semantic information of the nail region, the key point information of the nail cover and the information whether the nail cover is visible or not through network output.
(3) And determining the visible nail region in the image and the direction information and the finger information corresponding to the visible nail region according to the nail region semantic information, the nail cover key point information and the information whether the nail cover is visible.
(4) And adding the nail material to the visible nail area in the image according to the direction information and the finger information corresponding to the visible nail area to obtain a makeup result of the nail area.
In the nail special effect adding method, through the nail art makeup scheme of semantic segmentation and key points, not only can the semantic segmentation information of the nail cover be obtained, but also the position information of the nail cover can be obtained, and the direction information and the information of which finger the nail cover belongs to can realize more natural and vivid nail art makeup experience, improve the user experience, and enable the user to have more playability in a self-shooting scene.
It should be understood that although the steps in the flowcharts of fig. 2 and 4 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2 and 4 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the other steps or stages.
Fig. 6 is a block diagram illustrating a nail effect adding apparatus according to an exemplary embodiment. Referring to fig. 6, the apparatus includes a person image acquisition unit 610, a nail region determination unit 620, a nail material determination unit 630, and a nail material addition unit 640.
A person image acquisition unit 610 configured to execute entering a special effect shooting mode and acquiring a person image in response to a nail special effect selection instruction.
A nail region determination unit 620 configured to perform determination of a nail region in the person image; the nail region is an unobstructed nail region in the object image.
A nail material determination unit 630 configured to execute determining a nail material of a nail region from among a plurality of nail materials based on the nail special effect selection instruction.
A nail material adding unit 640 configured to perform adding nail material to the nail region.
In an exemplary embodiment, the nail region determining unit 620 is further configured to perform the nail region determining unit, and is further configured to perform determining a hand region image in the person image; obtaining nail region semantic information, nail key point information and nail visibility information based on the hand region image; and determining a nail region in the person image according to the nail region semantic information, the nail key point information and the nail visibility information.
In an exemplary embodiment, the nail region determining unit 620 is further configured to perform inputting the hand region image into a nail semantic segmentation model, a nail keypoint regression model, and a nail visibility classification model, respectively; and determining the semantic information of the nail region, the information of the nail key points and the information of the nail visibility based on the output results of the nail semantic segmentation model, the nail key point regression model and the nail visibility classification model.
In an exemplary embodiment, the nail material adding unit 640 is further configured to perform acquiring a nail direction corresponding to the nail region; nail material is added to the nail area in accordance with the nail direction.
In an exemplary embodiment, the nail material adding unit 640 is further configured to perform acquiring finger information corresponding to the nail region; determining a nail material corresponding to the finger information from the nail material according to the finger information; and adding the nail material corresponding to the finger information to the nail area.
In an exemplary embodiment, the nail material adding unit 640 is further configured to perform acquiring a nail direction corresponding to the nail region; and adding the nail material corresponding to the finger information to the nail area according to the nail direction.
In an exemplary embodiment, the nail regions include nail regions corresponding to different hands, and the nail material includes nail material corresponding to different hands; a nail material adding unit 640 further configured to perform adding nail materials corresponding to the respective hands to nail regions of the corresponding hands.
In an exemplary embodiment, the nail regions include nail regions corresponding to different users, and the nail materials include nail materials corresponding to different users; a nail material adding unit 640 further configured to perform adding the nail material corresponding to each user to the nail region of the corresponding user.
In an exemplary embodiment, the nail special effect adding device provided by the present disclosure further includes an instruction determining unit configured to perform collecting the received voice information; and inquiring the corresponding relation between the preset voice information and the nail special effect selection instruction, and determining the nail special effect selection instruction.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 7 is a block diagram illustrating an electronic device 700 for performing the above-described nail effect addition method according to an exemplary embodiment. For example, the electronic device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, an exercise device, a personal digital assistant, and so forth.
Referring to fig. 7, electronic device 700 may include one or more of the following components: processing component 702, memory 704, power component 706, multimedia component 708, audio component 710, input/output (I/O) interface 712, sensor component 714, and communication component 716.
The processing component 702 generally controls overall operation of the electronic device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.
The memory 704 is configured to store various types of data to support operations at the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile storage devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 706 provides power to the various components of the electronic device 700. The power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 700.
The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.
The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 may detect an open/closed state of the electronic device 700, the relative positioning of components, such as a display and keypad of the electronic device 700, the sensor assembly 714 may also detect a change in position of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, orientation or acceleration/deceleration of the electronic device 700, and a change in temperature of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 may access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the electronic device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, there is also provided a computer program product comprising a computer program stored in a readable storage medium, from which at least one processor of an electronic device reads and executes the computer program, causing the electronic device to perform the nail effect adding method described in any one of the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for adding a special effect of a nail is applied to electronic equipment, and is characterized by comprising the following steps:
responding to a nail special effect selection instruction, entering a special effect shooting mode and acquiring a figure image;
determining a nail region in the person image; the nail region is an unoccluded nail region in the character image;
determining nail materials of the nail region from a plurality of nail materials based on the nail special effect selection instruction;
adding the nail material to the nail region.
2. The method for adding a nail effect according to claim 1, wherein the determining a nail region in the human image includes:
determining a hand region image in the person image;
obtaining nail region semantic information, nail key point information and nail visibility information based on the hand region image;
and determining a nail region in the person image according to the nail region semantic information, the nail key point information and the nail visibility information.
3. The method for adding a nail special effect according to claim 2, wherein the obtaining of nail region semantic information, nail key point information, and nail visibility information based on the hand region image includes:
inputting the hand region image into a nail semantic segmentation model, a nail key point regression model and a nail visibility classification model respectively;
determining the nail region semantic information, the nail keypoint information, and the nail visibility information based on output results of the nail semantic segmentation model, the nail keypoint regression model, and the nail visibility classification model.
4. The nail specific addition method according to claim 1, wherein the adding of the nail material to the nail region includes:
acquiring a nail direction corresponding to the nail area;
adding the nail material to the nail region in accordance with the nail direction.
5. The nail specific addition method according to claim 1, wherein the adding of the nail material to the nail region further comprises:
acquiring finger information corresponding to the nail region;
determining a nail material corresponding to the finger information from the nail material according to the finger information;
and adding the nail material corresponding to the finger information to the nail area.
6. The method for adding the nail special effect according to claim 5, wherein the adding the nail material corresponding to the finger information to the nail region includes:
acquiring a nail direction corresponding to the nail area;
and adding the nail material corresponding to the finger information to the nail area according to the nail direction.
7. The nail special effect adding method according to any one of claims 1 to 6, further comprising, before entering a special effect shooting mode and acquiring a person image in response to a nail special effect selection instruction:
collecting received voice information;
and inquiring the corresponding relation between preset voice information and a nail special effect selection instruction, and determining the nail special effect selection instruction.
8. A nail special effect adding device applied to electronic equipment is characterized by comprising:
a person image acquisition unit configured to execute entering a special effect shooting mode and acquiring a person image in response to a nail special effect selection instruction;
a nail region determination unit configured to perform determination of a nail region in the person image; the nail region is an unoccluded nail region in the character image;
a nail material determination unit configured to execute determining a nail material of the nail region from a plurality of nail materials based on the nail special effect selection instruction;
a nail material adding unit configured to perform addition of the nail material to the nail region.
9. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of adding a nail effect of any of claims 1 to 7.
10. A storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the method of adding nail special effects of any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011221931.6A CN112347911A (en) | 2020-11-05 | 2020-11-05 | Method and device for adding special effects of fingernails, electronic equipment and storage medium |
| PCT/CN2021/128261 WO2022095860A1 (en) | 2020-11-05 | 2021-11-02 | Fingernail special effect adding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011221931.6A CN112347911A (en) | 2020-11-05 | 2020-11-05 | Method and device for adding special effects of fingernails, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112347911A true CN112347911A (en) | 2021-02-09 |
Family
ID=74429369
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011221931.6A Pending CN112347911A (en) | 2020-11-05 | 2020-11-05 | Method and device for adding special effects of fingernails, electronic equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112347911A (en) |
| WO (1) | WO2022095860A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022095860A1 (en) * | 2020-11-05 | 2022-05-12 | 北京达佳互联信息技术有限公司 | Fingernail special effect adding method and device |
| CN114880057A (en) * | 2022-04-22 | 2022-08-09 | 北京三快在线科技有限公司 | Image display method, image display device, terminal, server, and storage medium |
| WO2022227687A1 (en) * | 2021-04-25 | 2022-11-03 | 北京达佳互联信息技术有限公司 | Special effect material processing method and apparatus |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107590807A (en) * | 2017-09-29 | 2018-01-16 | 百度在线网络技术（北京）有限公司 | Method and apparatus for detection image quality |
| CN109376575A (en) * | 2018-08-20 | 2019-02-22 | 奇酷互联网络科技（深圳）有限公司 | Method, mobile terminal and the storage medium that human body in image is beautified |
| CN111047526A (en) * | 2019-11-22 | 2020-04-21 | 北京达佳互联信息技术有限公司 | Image processing method and device, electronic equipment and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2544971B (en) * | 2015-11-27 | 2017-12-27 | Holition Ltd | Locating and tracking fingernails in images |
| CN111091519B (en) * | 2019-12-20 | 2023-04-28 | 维沃移动通信有限公司 | Image processing method and device |
| CN111739028A (en) * | 2020-05-26 | 2020-10-02 | 华南理工大学 | Nail region image acquisition method, system, computing device and storage medium |
| CN112347911A (en) * | 2020-11-05 | 2021-02-09 | 北京达佳互联信息技术有限公司 | Method and device for adding special effects of fingernails, electronic equipment and storage medium |
| CN113284041B (en) * | 2021-05-14 | 2023-04-18 | 北京市商汤科技开发有限公司 | Image processing method, device and equipment and computer storage medium |
-
2020
- 2020-11-05 CN CN202011221931.6A patent/CN112347911A/en active Pending
-
2021
- 2021-11-02 WO PCT/CN2021/128261 patent/WO2022095860A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107590807A (en) * | 2017-09-29 | 2018-01-16 | 百度在线网络技术（北京）有限公司 | Method and apparatus for detection image quality |
| CN109376575A (en) * | 2018-08-20 | 2019-02-22 | 奇酷互联网络科技（深圳）有限公司 | Method, mobile terminal and the storage medium that human body in image is beautified |
| CN111047526A (en) * | 2019-11-22 | 2020-04-21 | 北京达佳互联信息技术有限公司 | Image processing method and device, electronic equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022095860A1 (en) * | 2020-11-05 | 2022-05-12 | 北京达佳互联信息技术有限公司 | Fingernail special effect adding method and device |
| WO2022227687A1 (en) * | 2021-04-25 | 2022-11-03 | 北京达佳互联信息技术有限公司 | Special effect material processing method and apparatus |
| CN114880057A (en) * | 2022-04-22 | 2022-08-09 | 北京三快在线科技有限公司 | Image display method, image display device, terminal, server, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022095860A1 (en) | 2022-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110517185B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN106570110B (en) | Image duplicate removal method and device | |
| CN107945133B (en) | Image processing method and device | |
| CN112347911A (en) | Method and device for adding special effects of fingernails, electronic equipment and storage medium | |
| CN111368796B (en) | Face image processing method and device, electronic equipment and storage medium | |
| CN112330570B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN111047526A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN110580688B (en) | Image processing method and device, electronic equipment and storage medium | |
| CN112188091B (en) | Face information identification method and device, electronic equipment and storage medium | |
| CN113409342A (en) | Training method and device for image style migration model and electronic equipment | |
| CN111526287A (en) | Image shooting method, image shooting device, electronic equipment, server, image shooting system and storage medium | |
| CN113099297A (en) | Method and device for generating click video, electronic equipment and storage medium | |
| CN110929616B (en) | Human hand identification method and device, electronic equipment and storage medium | |
| CN110619325A (en) | Text recognition method and device | |
| CN112948704A (en) | Model training method and device for information recommendation, electronic equipment and medium | |
| CN108470321B (en) | Method and device for beautifying photos and storage medium | |
| CN112184540A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN111340690B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN110502993B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN111373409B (en) | Method and terminal for obtaining color value change | |
| CN112784858B (en) | Image data processing method and device and electronic equipment | |
| US11252341B2 (en) | Method and device for shooting image, and storage medium | |
| US11715234B2 (en) | Image acquisition method, image acquisition device, and storage medium | |
| CN113761275A (en) | Video preview moving picture generation method, device and equipment and readable storage medium | |
| CN110705799A (en) | Method, device and medium for intelligently prompting combing and washing related information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |