CN113505791B - Method and device for attaching nail pieces, computer equipment and storage medium - Google Patents
Method and device for attaching nail pieces, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113505791B CN113505791B CN202111057211.5A CN202111057211A CN113505791B CN 113505791 B CN113505791 B CN 113505791B CN 202111057211 A CN202111057211 A CN 202111057211A CN 113505791 B CN113505791 B CN 113505791B
- Authority
- CN
- China
- Prior art keywords
- nail
- dimensional
- user
- image
- finger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Biomedical Technology (AREA)
- Mathematical Physics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Graphics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The embodiment of the invention provides a method and a device for attaching a nail plate, computer equipment and a storage medium, wherein the method comprises the following steps: acquiring a two-dimensional nail region image of a user nail; calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the spatial attitude parameters of the nail of the user; work as when space gesture parameter is in predetermineeing the within range, the laminating of control nail piece laminating mechanism nail piece to the user nail that three-dimensional size corresponds adopts structured light developments 3D vision imaging sensor, can realize that real-time nail key dimension of high accuracy measures, developments 3D gesture analysis, has guaranteed high efficiency, the accurate of laminating process, and hardware structure is simpler, and the cost is lower.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method for attaching a nail plate, a device for attaching the nail plate, computer equipment and a storage medium.
Background
The manicure is very popular among modern women, and flourishes the manicure industry. The process of sticking the nail plate is very tedious and time-consuming, and the manual nail plate sticking is automatically replaced by a machine, so that the labor cost can be effectively reduced, and the efficiency is improved. However, in an actual scene, the fingers of the user are difficult to place at the corresponding positions according to the optimal postures before the nail sheets are attached, the nails of different users are different, and the position, posture and nail sheet specification selection when the machine automatically attaches the nails have great influence on the final effect.
Therefore, 3D imaging is performed on the fingers through the combination of the mechanical device and the 3D camera, and then full automation is realized in the processes of selecting the nail models, fitting the nails and the like, so that the effects of cost reduction and efficiency improvement can be achieved. Wherein the core portion is 3D imaging of the nail; the existing solution is to use a line laser 3D camera, scan a finger of a user to obtain 3D contour information of the finger, and then calculate the size specification of the fingernail of the user through the contour information and a point cloud model obtained by 3D scanning. In order to fit the fingernail tip of the user at an accurate angle, a multi-axis robot must be used to fit the fingernail tip. The device using the mode is complex, a motion platform of the line laser 3D camera is needed, a multi-axis manipulator with high cost is needed, the equipment cost is high, if the fingers of a user slightly move, the attachment deviation is often caused, rework is needed again, time and labor are wasted, and the user experience is poor.
Disclosure of Invention
In view of the above problems, embodiments of the present invention have been made to provide a method of attaching a nail plate, an apparatus for attaching a nail plate, a computer device, and a storage medium that overcome or at least partially solve the above problems.
In order to solve the above problems, the embodiment of the invention discloses a method for attaching nail plates, which comprises the following steps:
acquiring a two-dimensional nail region image of a user nail;
calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the spatial attitude parameters of the nail of the user;
and when the space posture parameter is within a preset range, controlling the nail attaching mechanism to attach the nail corresponding to the three-dimensional size to the nail of the user.
Preferably, the acquiring a two-dimensional nail region image of a nail of the user includes:
acquiring a finger area image of a user;
and extracting the two-dimensional nail region image from the finger region image through a pre-trained deep neural network model.
Preferably, the obtaining of the three-dimensional size and the spatial posture parameter of the nail of the user through real-time calculation according to the two-dimensional nail region image includes:
acquiring a three-dimensional image of a finger of a user;
acquiring an image cross-sectional line of the two-dimensional nail region image;
identifying a three-dimensional contour line of the three-dimensional image according to the image cross section line;
and determining the boundary of the user nail through the three-dimensional contour line, and calculating the three-dimensional size of the user nail.
Preferably, the spatial attitude parameters include a roll angle and a pitch angle; the three-dimensional size and space posture parameters of the fingernail of the user are obtained through real-time calculation according to the two-dimensional fingernail region image, and the method comprises the following steps:
acquiring a three-dimensional image of a finger of a user;
determining a flat region in the three-dimensional image;
fitting the flat area plane to obtain a fitting result;
and calculating the left-right rolling angle and the front-back pitching angle of the fingernail of the user in real time according to the fitting result.
Preferably, the method further comprises:
and when the space posture parameter is not in the preset range, generating finger posture adjustment information, prompting a user to adjust the finger posture, and calculating the three-dimensional size and the space posture parameter of the fingernail of the user in real time.
Preferably, when the spatial posture parameter is within the preset range, after the step of controlling the nail attaching mechanism to attach the nail with the corresponding three-dimensional size to the nail of the user, the method further includes:
acquiring a pressure value of a finger placing plane of a user;
and when the pressure value is greater than a preset pressure threshold value, controlling the nail plate attaching mechanism to stop attaching operation.
The embodiment of the invention discloses a laminating device of a nail sheet, which comprises:
the two-dimensional nail region image acquisition module is used for acquiring a two-dimensional nail region image of a nail of a user;
the calculation module is used for calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the space posture parameters of the nail of the user;
and the fitting module is used for controlling the nail piece fitting mechanism to fit the nail piece corresponding to the three-dimensional size to the nail of the user when the space attitude parameter is within a preset range.
Preferably, the two-dimensional nail region image acquiring module includes:
the finger area image acquisition sub-module is used for acquiring a finger area image of a user;
and the extraction submodule is used for extracting the two-dimensional nail region image from the finger region image through a pre-trained deep neural network model.
The embodiment of the invention discloses computer equipment which comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the steps of the attaching method of the nail plate when executing the computer program.
The embodiment of the invention discloses a computer readable storage medium, which stores a computer program, wherein the computer program realizes the steps of the attaching method of the nail plate when being executed by a processor.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the fitting method of the nail plate comprises the following steps: acquiring a two-dimensional nail region image of a user nail; calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the spatial attitude parameters of the nail of the user; work as when space gesture parameter is in predetermineeing the within range, the laminating of control nail piece laminating mechanism nail piece to the user nail that three-dimensional size corresponds adopts structured light developments 3D vision imaging sensor, can realize that real-time nail key dimension of high accuracy measures, developments 3D gesture analysis, has guaranteed high efficiency, the accurate of laminating process, and hardware structure is simpler, and the cost is lower.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts
FIG. 1 is a flowchart illustrating steps of an embodiment of a method for applying nail plates according to an embodiment of the present invention;
FIG. 2 is a flow chart of a two-dimensional nail region image acquisition step in accordance with an embodiment of the present invention;
FIG. 3 is a flow chart of a three-dimensional size obtaining step according to an embodiment of the present invention;
FIG. 4 is a flowchart of the steps for real-time calculation of spatial attitude parameters according to an embodiment of the present invention;
FIG. 5 is a flow chart of the operation of a nail plate attaching system according to an embodiment of the present invention;
FIG. 6 is a schematic illustration of the positioning and calculation of 3D contours of a nail according to an embodiment of the present invention;
FIG. 7 is a block diagram of an embodiment of an apparatus for applying nail plates according to an embodiment of the present invention;
FIG. 8 is an internal block diagram of a computer device of an embodiment.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects solved by the embodiments of the present invention more clearly apparent, the embodiments of the present invention are described in further detail below with reference to the accompanying drawings and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
One of the core ideas of the embodiment of the invention is that the real-time calculation and analysis of the key size of the fingernail of the user and the real-time analysis of the gesture of the fingernail region are realized simultaneously through a dynamic 3D imaging technology, the user is prompted to adjust the position and the gesture of the finger in real time according to the 3D gesture analysis result, the best attaching gesture and position are achieved, and then the mechanical device is used for realizing the rapid and accurate attaching operation. By applying the dynamic 3D visual imaging technology and the real-time artificial intelligence analysis method, the interactive operation experience of the user is greatly improved, the complexity of a mechanical device is simplified, and the laminating precision and the success rate are greatly improved.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for attaching a nail plate according to an embodiment of the present invention is shown, which may specifically include the following steps:
step S101, acquiring a two-dimensional nail region image of a user nail;
in the embodiment of the present invention, the attaching method of the nail plate may be applied to a nail plate attaching system, and the system may include a structured light dynamic 3D imaging system, a mechanical attaching device, software, a control system, and the like, and of course, may further include other hardware or software systems, such as a pressure sensing system, and the like, which is not limited in the embodiment of the present invention.
In specific implementation, the structured light dynamic 3D imaging system is used for implementing real-time dynamic 3D imaging of a user's finger, and can generate a three-dimensional image of the user's finger; the mechanical attaching device is mechanical hardware for attaching the nail piece to be attached to the nail of the user, and may include various hardware solutions, such as a screw nut moving mechanism, and the like, which is not limited in the embodiments of the present invention.
Further, the software and the control system may include a control system of the mechanical bonding apparatus, a system of a computer, a control system corresponding to 3D imaging, and the like, which is not limited in the embodiments of the present invention.
Firstly, a two-dimensional nail region image of a user nail can be obtained; for example, when a finger of a user is placed in a designated area, a common camera is controlled to acquire a finger area image of the user, and then a two-dimensional nail area image of the nail of the user is extracted from the finger area image. Referring specifically to fig. 2, a flowchart of a two-dimensional nail region image acquiring step of acquiring a two-dimensional nail region image of a user's nail according to an embodiment of the present invention is shown, including the following sub-steps:
step S11, acquiring a finger area image of a user;
step S12, extracting the two-dimensional nail region image from the finger region image through a pre-trained deep neural network model.
Firstly, obtaining a finger area image of a user through a common camera, and extracting the two-dimensional nail area image from the finger area image through a pre-trained deep neural network model; in practical application to the embodiments of the present invention, the Deep Neural network model may include an unsupervised or supervised Deep Neural network model, specifically, the supervised Deep Neural network model may include a Recurrent Neural network (Recurrent Neural network) and a Recurrent Neural network (Recurrent Neural network), and the unsupervised Deep Neural network model may include Boltzmann Machines (Boltzmann Machines) and Restricted Boltzmann Machines (Restricted Boltzmann Machines), Deep Belief Networks (Deep Belief Networks), and the Deep Neural network models are just some examples of the embodiments of the present invention, and the function of extracting the two-dimensional nail region image of the present invention may be completed through other Deep Neural network models.
Step S102, calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the space posture parameters of the nail of the user;
furthermore, after the two-dimensional nail region of the user is obtained, the three-dimensional size and the spatial posture parameters of the nail of the user can be obtained through real-time calculation according to the two-dimensional nail region image. The method can be used for matching the shape of the nail plate, and can also be used for calculating the space posture parameters, the left-right rolling angle and the front-back pitching angle of the nail of the user, namely the left-right and up-down angles of the finger of the user on a placing plane.
In practical application, referring to fig. 3, a flowchart of a three-dimensional size obtaining step according to an embodiment of the present invention is shown, where the real-time calculation of the three-dimensional size and the spatial posture parameter of the user's nail according to the two-dimensional nail region image includes the following sub-steps:
step S21, acquiring a three-dimensional image of the finger of the user;
step S22, acquiring an image cross-sectional line of the two-dimensional nail region image;
step S23, recognizing the three-dimensional contour line of the three-dimensional image according to the image cross section line;
and step S24, determining the boundary of the user nail through the three-dimensional contour line, and calculating the three-dimensional size of the user nail.
Firstly, acquiring a three-dimensional image of a finger of a user through a structured light dynamic 3D imaging system, on the other hand, extracting an image cross section line of the two-dimensional nail region image, and identifying a three-dimensional contour line of the three-dimensional image through the image cross section line; the left and right boundaries of the fingernail are determined by calculating the maximum curvature points at the two ends of the three-dimensional contour line, so that the space curve length of the three-dimensional contour line of the fingernail is calculated, and the space curve length is the three-dimensional size of the fingernail of the user.
Further applied to the embodiment of the present invention, referring to fig. 4, a flowchart of a real-time calculation procedure of spatial attitude parameters including a roll angle and a pitch angle according to the embodiment of the present invention is shown; the three-dimensional size and space posture parameter of the fingernail of the user is obtained through real-time calculation according to the two-dimensional fingernail region image, and the method comprises the following substeps: step S31, acquiring a three-dimensional image of the finger of the user;
step S32, determining a flat area in the three-dimensional image;
step S33, fitting the flat area plane to obtain a fitting result;
and step S34, calculating the left-right rolling angle and the front-back pitching angle of the user nail in real time according to the fitting result.
On the other hand, the spatial attitude parameters of the user nail can be calculated in a fitting manner, specifically, the nail itself can adopt approximate cylinder fitting, or a relatively flat area in the middle of the nail is taken for plane fitting.
And S103, when the space posture parameter is within a preset range, controlling a nail attaching mechanism to attach the nail corresponding to the three-dimensional size to the nail of the user.
The method is particularly applied to the embodiment of the invention, the space attitude parameter can be judged to be in the preset range, and when the space attitude parameter is in the preset range, the nail attaching mechanism is controlled to attach the nail corresponding to the three-dimensional size to the nail of the user; and when the spatial posture parameter is not in the preset range, prompting the user to adjust the finger posture, namely the method further comprises the following steps: and when the space posture parameter is not in the preset range, generating finger posture adjustment information, prompting a user to adjust the finger posture, and calculating the three-dimensional size and the space posture parameter of the fingernail of the user in real time.
In the embodiment of the present invention, the user may be prompted in various manners, such as screen display, voice prompt, and the like, which is not limited in the embodiment of the present invention.
For example, when the left-right rolling angle and the front-back pitching angle of the fingernail of the user are within the preset range, the gesture is judged to meet the requirement, and the patch operation is executed.
In a preferred embodiment of the present invention, after the step of controlling the nail attaching mechanism to attach the nail with the corresponding three-dimensional size to the nail of the user when the spatial posture parameter is within the preset range, the method further includes: acquiring a pressure value of a finger placing plane of a user; and when the pressure value is greater than a preset pressure threshold value, controlling the nail plate attaching mechanism to stop attaching operation.
This first of the ten heavenly stems laminating system can also be provided with pressure sensor promptly, specifically, can set up in the terminal position that corresponds of user's finger for obtain the pressure value of user's finger, when preventing laminating the first of the ten heavenly stems, mechanical laminating device's power is too big, and as stop signal, control mechanical laminating device release first of the ten heavenly stems, accomplish first of the ten heavenly stems laminating process.
In the embodiment of the invention, the fitting method of the nail plate comprises the following steps: acquiring a two-dimensional nail region image of a user nail; calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the spatial attitude parameters of the nail of the user; work as when space gesture parameter is in predetermineeing the within range, the laminating of control nail piece laminating mechanism nail piece to the user nail that three-dimensional size corresponds adopts structured light developments 3D vision imaging sensor, can realize that real-time nail key dimension of high accuracy measures, developments 3D gesture analysis, has guaranteed high efficiency, the accurate of laminating process, and hardware structure is simpler, and the cost is lower.
In order that those skilled in the art will better understand the embodiments of the present invention, the following description is given by way of a specific example:
the working process (as shown in fig. 5) and the main modules of the nail attaching system of the embodiment of the invention are briefly described as follows:
1. placing fingers to be tested and pasted in the area A;
2. the pressure sensor is arranged below the area A, so that the discomfort of a user caused by overlarge pressure is prevented;
3. a dynamic structured light 3D camera for real-time dynamic 3D imaging of region B;
4. a data processing module:
a, the yellow area is a patch area, a user observes the screen and aligns a finger to a finger contour line displayed on the screen;
b, detecting nail areas: detecting a nail region from the 2D image by adopting a pre-trained deep neural network;
c, calculating nail size and posture: according to the nail region detected by the 2D image, calculating the 3D key size of the nail in real time in 3D vision, such as width and length (for matching the nail plate), and the space attitude parameters (left-right rolling angle beta and front-back pitching angle gamma) of the nail, and if the rolling angle beta and the pitching angle gamma are in a tolerance range, judging that the attitude meets the requirement, and executing the patch operation;
5. the first slice fitting mechanism can adopt the simplest XYZ displacement platform;
6. after the nail piece is pasted and adsorbed by the front end of the nail piece pasting mechanism, the nail piece is perpendicularly pasted on the nail according to the calculated nail root position of 4-b, and the nail piece is released after the preset pressure value is reached.
Specifically, the detailed technical scheme of the invention of the embodiment of the invention is as follows:
(1) placing fingers to be tested and pasted in the area A;
(2) the pressure sensor is arranged below the area A, prevents discomfort of a user caused by overlarge pressure, is connected with a computer, and measures the pressure value of the finger in real time;
(3) dynamic 3D imaging module
The method adopts a structured light 3D imaging technology, a 3D camera is composed of a DLP projection module and a camera module, a high-frequency structured light coding technology is adopted for realizing high-speed real-time 3D imaging, in order to ensure enough measurement accuracy, a higher resolution such as a 5M camera is adopted, the measurement range is about 50 x 40, the measurement range is enough to cover a single finger area, and a 2D texture image and a 3D point image of the measurement area can be simultaneously output. Experimental data show that after the ROI of the finger region is selected, the 3D scanning and imaging speed can reach more than 25 frames/second at most, and the dynamic 3D imaging requirement is completely met.
(4) Data processing module
a, presetting a patch working area, observing a screen by a user, and aligning a finger to a finger contour line displayed on the screen;
b, detecting nail areas: detecting a nail region from a 2D image by adopting a pre-trained deep neural network, wherein the 2D image adopts a first background image in a structured light image;
c, calculating the key size of the nail: mainly 3D width parameters of the nail, a specific calculation method
Based on the detected outline of the nail region in the image in the step b, selecting an outline-intermediate image cross section line;
finding a 3D contour line in the 3D image according to the section line of the image, determining the left and right boundaries of the fingernail by calculating the maximum curvature points at the two ends of the contour line, and then calculating the space curve length of the 3D contour line of the fingernail as a key parameter for subsequent matching of the nail. Through vernier caliper measurement verification, after the 3D vision system is adopted to repeatedly measure for ten times, the error between the measured value and the measured value is within 0.1mm, and the measurement and laminating precision requirements are completely met.
Referring to fig. 6, there is shown a schematic view of the positioning and calculation principle of the 3D contour of the nail according to an embodiment of the present invention,
a) real-time calculation of nail space posture:
the nail itself can adopt approximate cylinder fitting, or a flat area in the middle of the nail is taken for plane fitting (the actual test result shows that the difference between the two approximate fitting methods is not large);
calculating a left-right rolling angle beta and a front-back pitching angle gamma of the nail in real time based on the region fitting result;
if the roll angle beta and the pitch angle gamma are within the tolerance range (the empirical value is acceptable within the error of 1 degree), judging that the posture meets the requirement, and executing the patch operation;
and if the angle deviation is large, prompting the user to perform corresponding posture adjustment by the screen, and repeatedly calculating in real time until the finger placing posture of the user meets the requirement.
(5) The nail piece laminating mechanism: due to the adoption of a dynamic 3D imaging method, the gesture and the position of the finger of a user are guided to be adjusted to be optimal in real time, and the space position of the nail can be accurately obtained in real time, so that the complexity of a mechanical part can be greatly simplified, the simplest XYZ displacement platform (similar to a 3D printer) is adopted, the finger can be moved to a nail area through XY, and the Z-direction attaching action is executed;
(6) after the nail is pasted, after the nail is adsorbed by the front end of the mechanism in the step (5), the nail is vertically pasted on the nail according to the nail root position calculated in the step 4) after the nail is moved in the Z direction, and the whole nail pasting operation process can be completed after the nail is released after the preset pressure value is reached.
The embodiment of the invention provides a novel full-automatic high-precision nail attaching method and a device, the device can realize nail measurement, matching and attaching operation by adopting a set of device, the mechanical structure is simpler, the nail attaching device has higher attaching efficiency, precision and success rate than the existing device and method, and the structure is simpler; by adopting the structured light dynamic 3D vision imaging sensor, the real-time high-precision nail key size measurement and dynamic 3D posture analysis can be realized, and the high efficiency and precision of the laminating process are ensured; by means of a deep learning detection algorithm, a color 2D image does not need to be shot additionally, and a nail region and a nail edge outline can be accurately detected in the image based on a background image in a structured light image sequence; by adopting a 2D mapping 3D method, the 3D contour line detection of the critical dimension of the nail width is obtained in the 3D image through the 2D nail middle cross section, the curved surface width value of the nail can be more accurately calculated, and the curved surface width value is more in line with the actual width than the 2D width value based on the image (because the nail sheet belongs to a flexible curved surface, the closer the 3D contour width value is after pressing, the better the laminating effect is).
The technical scheme of the embodiment of the invention has the advantages of simple system structure, full-automatic operation, high measurement and positioning precision, high bonding precision, high speed, low hardware cost and the like. The structured light system which can be realized at present is used as dynamic 3D imaging sensing equipment to realize the same function, and a 3D imaging sensor with other principles can be adopted on the premise of ensuring the 3D imaging precision and speed; similarly, based on the same working principle, the nail can be replaced by other related objects, so that the dynamic real-time 3D interactive operation functions of a machine and a user, such as spraying and drawing of skin, laser marking and the like, are realized, and the dynamic three-dimensional information of the surface of the skin needs to be acquired in real time; the method can also be used for some surgical operations requiring dynamic 3D on the surface of the skin and the like; the 3D scan field of view can be enlarged to cover the entire palm, e.g., 100 x 50mm, allowing multiple finger nails to be measured simultaneously, even for hand types.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 7, a block diagram of a structure of an embodiment of a nail attaching device according to an embodiment of the present invention is shown, and the nail attaching device may specifically include the following modules:
a two-dimensional nail region image acquisition module 301, configured to acquire a two-dimensional nail region image of a nail of a user;
the calculation module 302 is used for calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the spatial posture parameter of the nail of the user;
and the fitting module 303 is used for controlling the nail fitting mechanism to fit the nail corresponding to the three-dimensional size to the nail of the user when the space posture parameter is within the preset range.
Preferably, the two-dimensional nail region image acquiring module includes:
the finger area image acquisition sub-module is used for acquiring a finger area image of a user;
and the extraction submodule is used for extracting the two-dimensional nail region image from the finger region image through a pre-trained deep neural network model.
Preferably, the calculation module comprises:
the three-dimensional image acquisition sub-module is used for acquiring a three-dimensional image of a finger of a user;
the image cross-sectional line acquisition sub-module is used for acquiring an image cross-sectional line of the two-dimensional nail region image;
the three-dimensional contour line identification submodule is used for identifying the three-dimensional contour line of the three-dimensional image according to the image cross section line;
and the three-dimensional size calculation submodule is used for determining the boundary of the user nail through the three-dimensional contour line and calculating the three-dimensional size of the user nail.
Preferably, the spatial attitude parameters include a roll angle and a pitch angle; the calculation module comprises:
the three-dimensional image acquisition sub-module is used for acquiring a three-dimensional image of a finger of a user;
a determination submodule for determining a flat region in the three-dimensional image;
the fitting result obtaining submodule is used for carrying out plane fitting on the flat area to obtain a fitting result;
and the calculation submodule is used for calculating the left-right rolling angle and the front-back pitching angle of the fingernail of the user in real time according to the fitting result.
Preferably, the apparatus further comprises:
and the prompting module is used for generating finger posture adjustment information when the space posture parameter is not in the preset range, prompting a user to adjust the finger posture, and calculating the three-dimensional size and the space posture parameter of the fingernail of the user in real time.
Preferably, the module connected to the attaching module further includes:
the pressure value acquisition module is used for acquiring a pressure value of a finger placing plane of a user;
and the laminating operation stopping module is used for controlling the laminating mechanism of the nail plate to stop laminating operation when the pressure value is greater than a preset pressure threshold value.
All or part of each module in the attaching device of the nail plate can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
The nail attaching device provided by the embodiment can be used for executing the nail attaching method provided by any embodiment, and has corresponding functions and beneficial effects.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 8. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of fitting a nail plate. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 8 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided comprising a memory having a computer program stored therein and a processor implementing the steps of the embodiments of fig. 1-5 when executing the computer program.
In one embodiment, a computer readable storage medium is provided, having stored thereon a computer program, which when executed by a processor, performs the steps of the embodiments of fig. 1-5 below.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The method for attaching nail tip, the apparatus for attaching nail tip, the computer device and the storage medium provided by the present invention are described in detail above, and specific examples are applied herein to illustrate the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (9)
1. A method for attaching nail plates is characterized by comprising the following steps:
acquiring a two-dimensional nail region image of a user nail;
calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the spatial attitude parameters of the nail of the user;
when the space posture parameter is within a preset range, controlling a nail fitting mechanism to fit the nail corresponding to the three-dimensional size to the nail of the user;
wherein the spatial attitude parameters include a roll angle and a pitch angle; the three-dimensional size and space posture parameters of the fingernail of the user are obtained through real-time calculation according to the two-dimensional fingernail region image, and the method comprises the following steps:
acquiring a three-dimensional image of a finger of a user;
determining a flat region in the three-dimensional image;
fitting the flat area plane to obtain a fitting result;
and calculating the left-right rolling angle and the front-back pitching angle of the fingernail of the user in real time according to the fitting result.
2. The method of applying a nail plate according to claim 1, wherein the obtaining a two-dimensional nail region image of a nail of a user comprises:
acquiring a finger area image of a user;
and extracting the two-dimensional nail region image from the finger region image through a pre-trained deep neural network model.
3. The method for fitting nail plates according to claim 2, wherein the step of calculating in real time the three-dimensional size and spatial posture parameters of the nail of the user according to the two-dimensional nail region image comprises:
acquiring a three-dimensional image of a finger of a user;
acquiring an image cross-sectional line of the two-dimensional nail region image; wherein, the image cross-sectional line is a cross-sectional line from the left side to the right side in the middle of the outline of the nail region;
identifying a three-dimensional contour line of the three-dimensional image according to the image cross section line;
and determining the boundary of the user nail through the three-dimensional contour line, and calculating the three-dimensional size of the user nail.
4. The method of applying nail plates according to claim 1, further comprising:
and when the space posture parameter is not in the preset range, generating finger posture adjustment information, prompting a user to adjust the finger posture, and calculating the three-dimensional size and the space posture parameter of the fingernail of the user in real time.
5. The method for applying a nail plate according to claim 1, wherein after the step of controlling the nail plate applying mechanism to apply the nail plate with the corresponding three-dimensional size to the nail of the user when the spatial posture parameter is within the preset range, the method further comprises: acquiring a pressure value of a finger placing plane of a user;
and when the pressure value is greater than a preset pressure threshold value, controlling the nail plate attaching mechanism to stop attaching operation.
6. The laminating device of a nail piece, its characterized in that includes:
the two-dimensional nail region image acquisition module is used for acquiring a two-dimensional nail region image of a nail of a user;
the calculation module is used for calculating in real time according to the two-dimensional nail region image to obtain the three-dimensional size and the space posture parameters of the nail of the user;
the fitting module is used for controlling the nail fitting mechanism to fit the nail corresponding to the three-dimensional size to the nail of the user when the space posture parameter is within a preset range;
wherein the spatial attitude parameters include a roll angle and a pitch angle; the calculation module comprises:
the three-dimensional image acquisition sub-module is used for acquiring a three-dimensional image of a finger of a user;
a determination submodule for determining a flat region in the three-dimensional image;
the fitting result obtaining submodule is used for carrying out plane fitting on the flat area to obtain a fitting result;
and the calculation submodule is used for calculating the left-right rolling angle and the front-back pitching angle of the fingernail of the user in real time according to the fitting result.
7. The nail plate attaching device according to claim 6, wherein the two-dimensional nail region image acquiring module comprises:
the finger area image acquisition sub-module is used for acquiring a finger area image of a user;
and the extraction submodule is used for extracting the two-dimensional nail region image from the finger region image through a pre-trained deep neural network model.
8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of fitting of nail plates according to any one of claims 1 to 5.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of fitting of nail plates according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111057211.5A CN113505791B (en) | 2021-09-09 | 2021-09-09 | Method and device for attaching nail pieces, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111057211.5A CN113505791B (en) | 2021-09-09 | 2021-09-09 | Method and device for attaching nail pieces, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113505791A CN113505791A (en) | 2021-10-15 |
| CN113505791B true CN113505791B (en) | 2022-02-11 |
Family
ID=78017021
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111057211.5A Active CN113505791B (en) | 2021-09-09 | 2021-09-09 | Method and device for attaching nail pieces, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113505791B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114677429B (en) * | 2022-05-27 | 2022-08-30 | 深圳广成创新技术有限公司 | Positioning method and device of manipulator, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000175732A (en) * | 1998-12-15 | 2000-06-27 | Gerber Scient Prod Inc | Automatic liquid applying device and method thereof |
| CN106539272A (en) * | 2015-09-18 | 2017-03-29 | 卡西欧计算机株式会社 | Nail type acquisition device, plotting unit and its control method |
| CN208080773U (en) * | 2017-12-29 | 2018-11-13 | 深圳市邻友通科技发展有限公司 | Finger fixed structure and nail beauty machine |
| CN109349774A (en) * | 2018-10-29 | 2019-02-19 | 徐悦 | A kind of automatic manicure method and apparatus |
| CN113298956A (en) * | 2020-07-23 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Image processing method, nail beautifying method and device, and terminal equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103617328B (en) * | 2013-12-08 | 2016-10-12 | 中国科学院光电技术研究所 | Aircraft three-dimensional attitude calculation method |
| CN109785341A (en) * | 2019-01-14 | 2019-05-21 | 深圳市邻友通科技发展有限公司 | A kind of manicure device fingernail region image acquiring method, system, nail art device and medium |
| CN111080793B (en) * | 2019-12-05 | 2023-10-03 | 浙江迅实科技有限公司 | Digital nail-beautifying nail sheet manufacturing method and nail sheet manufactured by digital nail-beautifying nail sheet manufacturing method |
-
2021
- 2021-09-09 CN CN202111057211.5A patent/CN113505791B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000175732A (en) * | 1998-12-15 | 2000-06-27 | Gerber Scient Prod Inc | Automatic liquid applying device and method thereof |
| CN106539272A (en) * | 2015-09-18 | 2017-03-29 | 卡西欧计算机株式会社 | Nail type acquisition device, plotting unit and its control method |
| CN208080773U (en) * | 2017-12-29 | 2018-11-13 | 深圳市邻友通科技发展有限公司 | Finger fixed structure and nail beauty machine |
| CN109349774A (en) * | 2018-10-29 | 2019-02-19 | 徐悦 | A kind of automatic manicure method and apparatus |
| CN113298956A (en) * | 2020-07-23 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Image processing method, nail beautifying method and device, and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113505791A (en) | 2021-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3971684A1 (en) | Vision-based tactile measurement method, apparatus, chip and storage medium | |
| CN110014426B (en) | Method for grabbing symmetrically-shaped workpieces at high precision by using low-precision depth camera | |
| CN106767393B (en) | Hand-eye calibration device and method for robot | |
| US9153030B2 (en) | Position and orientation estimation method and apparatus therefor | |
| CN110992777A (en) | Multi-mode fusion teaching method and device, computing equipment and storage medium | |
| CN109598264B (en) | Object grabbing method and device | |
| JP5395470B2 (en) | Shape recognition device | |
| CN105751518B (en) | A kind of FDM3D printer and its automatic leveling Method of printing and system | |
| US20140174463A1 (en) | Method for moving color-makeup tool of automatic color-makeup machine | |
| CN110717984A (en) | Automatic sole gluing method and system based on three-dimensional reconstruction and storage medium | |
| CN104215199A (en) | Wig head capsule production method and system | |
| TWI493153B (en) | Non-contact measurement device and method for object space information and the method thereof for computing the path from capturing the image | |
| CN113310443B (en) | Mechanical arm guided spraying calibration method, device, equipment and storage medium thereof | |
| CN113505791B (en) | Method and device for attaching nail pieces, computer equipment and storage medium | |
| US20190118394A1 (en) | Control apparatus, robot system, method for operating control apparatus, and storage medium | |
| CN113842172B (en) | Pharyngeal rear wall visual touch recognition device based on template matching and arithmetic averaging | |
| CN113362452A (en) | Hand gesture three-dimensional reconstruction method and device and storage medium | |
| CN108466265B (en) | Mechanical arm path planning and operation method, device and computer equipment | |
| JP2018119833A (en) | Information processing device, system, estimation method, computer program, and storage medium | |
| Curiel-Razo et al. | Leap motion controller three dimensional verification and polynomial correction | |
| CN108813899B (en) | Nail beautifying device and method thereof | |
| CN112109069A (en) | Robot teaching device and robot system | |
| CN113427486B (en) | Mechanical arm control method and device, computer equipment, storage medium and mechanical arm | |
| Grieve et al. | Fingernail image registration using active appearance models | |
| JP2019077026A (en) | Control device, robot system, and control device operating method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |