CN112486263A - Eye protection makeup method based on projection and projection makeup dressing wearing equipment - Google Patents

Eye protection makeup method based on projection and projection makeup dressing wearing equipment Download PDF

Info

Publication number
CN112486263A
CN112486263A CN202011377709.5A CN202011377709A CN112486263A CN 112486263 A CN112486263 A CN 112486263A CN 202011377709 A CN202011377709 A CN 202011377709A CN 112486263 A CN112486263 A CN 112486263A
Authority
CN
China
Prior art keywords
eye
eyes
projection
user
makeup
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011377709.5A
Other languages
Chinese (zh)
Inventor
颜寒松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kelong Shijing Biotechnology Shanghai Co ltd
Original Assignee
Kelong Shijing Biotechnology Shanghai Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kelong Shijing Biotechnology Shanghai Co ltd filed Critical Kelong Shijing Biotechnology Shanghai Co ltd
Priority to CN202011377709.5A priority Critical patent/CN112486263A/en
Publication of CN112486263A publication Critical patent/CN112486263A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor

Abstract

The application provides a beautiful method of making up of eyeshield based on projection is applied to the beautiful wearing apparatus of making up of projection, the method includes: acquiring a face area image at least containing eyes of a user in real time; accurately detecting and positioning the eyes according to the face region image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state; and projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect. This application is to utilizing the application scene that the projection made up to user's face, has added the eyeshield and has handled to and can be alone or merge the selection and carry out more abundant beautify the processing to eyes inside, and it is more simple and direct that its implementation is said, and the projection effect is more continuous nature, has corresponding protection to eyes when the projection moreover, and the dazzling or the discomfort such as dizzy that bring when avoiding light to project user's eyes.

Description

Eye protection makeup method based on projection and projection makeup dressing wearing equipment
Technical Field
The application relates to the technical field of projection makeup, in particular to a projection-based eye protection makeup method and projection makeup dressing equipment.
Background
Most of the traditional makeup methods can only carry out makeup treatment on the external parts of eyes, such as eyelids, upper eyelids, eyelashes and the like, but can not carry out makeup on the internal parts of the eyes, such as white eyes (sclera part) and eyeball (iris part); although the color of the eyeball part can be changed by wearing the beauty pupil, the beauty pupil is attached to the eyeball at any time, so that some users have foreign body sensation or allergy, discomfort and the like; in addition, the beautiful pupil often has a service time limit, such as specifications of daily throw, monthly throw and the like.
Wearable equipment of beautiful makeup of projection based on this company has proposed can be with beautiful makeup information, the projection to user's face, can reach required beautiful makeup effect. However, the prior art does not provide a method and a way for projecting light to avoid the pupil, that is, when the light projected to the eyes of the user is not properly projected, discomfort such as dazzling, vertigo and the like is caused, and thus, a corresponding measure for protecting the eyes is also needed. In addition, the original scheme does not provide a specific way for beautifying the interior of the eye, and does not thoroughly improve the problem of how to make up the interior of the eye.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the technical problem to be solved by the present application is to provide a projection-based eye-protecting makeup method and a projection makeup wearing device, which are used for solving at least one existing problem.
In order to achieve the above objects and other related objects, the present application provides a projection-based eye-protecting makeup method applied to a projection makeup wearing device, the method including: acquiring a face area image at least containing eyes of a user in real time; accurately detecting and positioning the eyes according to the face region image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state; and projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
In one embodiment of the present application, the eye protection mode includes: setting all pixels at least corresponding to the pupil range or the corresponding eye range as none to realize blackening treatment and generate eye protection projection information; or reducing the projection intensity parameter at least corresponding to the pupil range or the eye range to realize light weakening treatment and generate eye protection projection information.
In an embodiment of the present application, the eye beautifying mode includes: detecting whether the eyes are in an eye closing state or an eye opening state; if the eyes are detected to be in the eye closing state, beautifying the interior of the eyes; if the eye is detected to be open, the recognized eye white, eye bead, and pupil position area in the eye is beautified or blackened.
In an embodiment of the present application, the beautifying or blackening process of the recognized location areas of the white eyes, the eyeball, and the pupil in the eye portion includes: selecting a makeup effect aiming at pixels at positions covered by the white eyes and the eyeball parts respectively to generate eye beautifying projection information based on the recognized white eyes and eyeball parts in the eyes; wherein the makeup effects include: any one or more of color, pattern, shape, coverage area size and special effect; selecting a makeup effect aiming at pixels of a position covered by a pupil part to generate eye beautifying projection information based on the identified pupil part in the eye; or carrying out blackening treatment in an eye protection mode aiming at pixels at positions covered by pupil parts to generate eye protection projection information; when the makeup effect is selected according to the pixels at the positions covered by the pupil parts, the brightness of the pixels is properly controlled.
In an embodiment of the present application, the eye beautifying mode further includes: when the eyes are detected to be in the eye closing state, corresponding makeup information can be loaded for the parts around the eyes.
In an embodiment of the application, the projecting the projection information to the eyes of the user to map the eye protection effect and/or the eye beautifying effect with the collecting position as a base point includes: calibrating the reference coordinates of the image acquisition unit and the projection unit to accurately position the projection range; projecting the image corresponding to the eye protection projection information and/or the eye beautifying projection information to the face of the user at the frequency of M times per second; and the image projected each time is the latest image obtained by respectively processing each part of the eye based on the latest acquired face area image and based on the eye identification projection information and/or the eye beautifying projection information, and loading the eye protection projection information and/or the eye beautifying projection information.
To achieve the above and other related objects, there is provided a projected makeup wearing device, including: one or more cameras for acquiring in real time an image of a face region of a user containing at least eyes; the processor is used for accurately detecting and positioning the eyes according to the face area image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state; and the one or more projectors are used for projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
In an embodiment of the present application, the apparatus further includes: the memory is used for storing preset multiple groups of makeup effects, or eye protection modes and/or eye beautifying modes, so that the equipment can obtain the makeup effects through a switching key or a selection device; or the communicator is used for being in communication connection with the mobile terminal so as to receive the makeup effect in any combination form selected on the mobile terminal, or the eye protection mode and/or the eye beautifying mode.
In an embodiment of the application, the device is a card, and the card is provided with one or more interaction units which extend to the front of the face of the user when worn by the user; each interaction unit comprises a camera and a projector, and the collection direction and the projection direction face the face of the user.
In an embodiment of the present application, the device is a hat with a front brim, and one or more interaction units facing the face of the user are arranged below the front brim of the hat; each interaction unit comprises a camera and a projector, and the collection direction and the projection direction face the face of the user.
To sum up, the application provides a beautiful dress method of eyeshield based on projection is applied to the beautiful dress wearing apparatus of projection, the method includes: acquiring a face area image at least containing eyes of a user in real time; accurately detecting and positioning the eyes according to the face region image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state; and projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
The following beneficial effects are achieved:
this application is to utilizing the projection to make up the application scene of user's face in, has added the eyeshield and has handled to and carry out more abundant beautification to eyes inside and handle, and it is more simple and direct that its implementation is said, and the projection effect is more continuous nature, has corresponding protection to eyes when the projection moreover, and dazzling or dizzy waiting discomfort that bring when avoiding light to project user's eyes also is applicable to the scene that only carries out the beautiful makeup of projection to eyes.
Drawings
Fig. 1A is a scene schematic diagram of a hair clip of a projection beauty dressing wearing device in the embodiment of the application.
Fig. 1B is a schematic view of a scene in which the projection beauty equipment is a hat in the embodiment of the present application.
Fig. 2 is a schematic flow chart of a projection-based eye-protecting makeup method in an embodiment of the present application.
Fig. 3 is a schematic structural view of a projection beauty dressing wearing device in the embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings so that those skilled in the art to which the present application pertains can easily carry out the present application. The present application may be embodied in many different forms and is not limited to the embodiments described herein.
In order to clearly explain the present application, components that are not related to the description are omitted, and the same reference numerals are given to the same or similar components throughout the specification.
Throughout the specification, when a component is referred to as being "connected" to another component, this includes not only the case of being "directly connected" but also the case of being "indirectly connected" with another element interposed therebetween. In addition, when a component is referred to as "including" a certain constituent element, unless otherwise stated, it means that the component may include other constituent elements, without excluding other constituent elements.
Although the terms first, second, etc. may be used herein to describe various elements in some instances, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first interface and the second interface, etc. are described. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the singular forms "a", "an" and "the" include plural forms as long as the words do not expressly indicate a contrary meaning. The term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, regions, integers, steps, operations, elements, and/or components, but does not exclude the presence or addition of other features, regions, integers, steps, operations, elements, and/or components.
Terms indicating "lower", "upper", and the like relative to space may be used to more easily describe a relationship of one component with respect to another component illustrated in the drawings. Such terms are intended to include not only the meanings indicated in the drawings, but also other meanings or operations of the device in use. For example, if the device in the figures is turned over, elements described as "below" other elements would then be oriented "above" the other elements. Thus, the exemplary terms "under" and "beneath" all include above and below. The device may be rotated 90 or other angles and the terminology representing relative space is also to be interpreted accordingly.
The application relate to a beautiful dress up method of eyeshield based on projection and beautiful dress up wearing apparatus of projection, the beautiful dress up wearing apparatus of projection mainly through the ornaments of wearing, like hairpin or peaked cap, inlay camera and projection arrangement on the ornaments, utilize this kind of technique to realize the projection and make up, need not manual actual makeup promptly, can possess the effect that multiple pattern was made up entirely. In short, the face is used as a curtain to receive the makeup projection in a projection mode, so that the effect of makeup is achieved.
The present application is an improvement based on patent numbers 2020100712660 or 202010646810X, but the present application is substantially different from the aforementioned patent numbers in that: this application is on projection beautiful dress wearing apparatus's basis to not to the collection and the projection interaction process of basis, but the protection that how to realize eyeshield and the inside beautiful dress of eyes and go on is emphated to the side. The application provides a method for protecting eyes in projection makeup and also provides a method for making up some parts in the eyes. The two methods can be implemented independently or in combination, and can be combined with other makeup methods based on the equipment or embedded into other makeup methods for implementation.
First embodiment
As shown in fig. 1A, a scene diagram of a hair clip of a projection beauty wearing device in an embodiment of the present application is shown. As shown in the figure, the projection beauty dressing wearing device is a hair clip 1 for fixing hair, one or more interaction units 11 are arranged on the hair clip 1, and the interaction units 11 include: the micro-camera is used for acquiring a face area image at least containing eyes of a user in real time, and the micro-projector is used for projecting the projection information to the eyes of the user so as to map an eye protection effect and/or an eye beautifying effect.
In the present embodiment, for example, when the hair-care product is used only for eye protection or eye makeup, the number of the interaction units 11 may be one, and the interaction units are disposed right in front of the head of the user after the hair-grip product is worn by the user; or, when it is necessary to combine with other facial makeup effects or to achieve better effects, as shown in fig. 1A, two interaction units 11 may be provided, which are respectively disposed at the left and right sides of the hair clip worn by the user and corresponding to the front of the head of the user. The micro camera is used for collecting a face area image at least containing eyes of a user, then accurately detecting and positioning the eyes according to the face area image, and loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or position areas of white eyes, eyeball and pupil in the eyes and the eye state; for example, the projection information of the eye protection mode and/or the eye beautifying mode can be loaded by switching through a switching key or selecting a device. Also can load the projection information of eyeshield mode and/or beautiful eye mode through mobile terminal 2, mobile terminal 2 can be the equipment that can load APP (or believe little procedure a little) such as smart mobile phone, panel computer, intelligent wrist-watch, mobile terminal, then carries out communication connection through mobile terminal 2 and hairpin 1, like bluetooth connection, wifi is connected, LAN connects, data line connection etc. will make up information transmission for hairpin 1 on mobile terminal 2 good beautiful. And finally, projecting the projection information of the loaded eye protection mode and/or eye beautifying mode aiming at the eyes of the user by using the micro projector so as to map the eye protection effect and/or eye beautifying effect. It is often necessary here that the micro-cameras and micro-projectors are located overlapping or very close together or even combined into one to achieve accurate projection.
Second embodiment
Fig. 1B is a schematic view of a scene in which the projection beauty dressing wearing apparatus is a hat according to an embodiment of the present disclosure. As shown in the figure, the projection beauty dressing equipment is a hat 3 with a front brim, one or more interaction units 31 are arranged below the front brim of the hat 3, and the interaction units 31 comprise a micro camera and a micro projector. The specific process is similar to that of the first embodiment, and is not described herein again.
Fig. 2 is a schematic flow chart of a projection-based eye-protecting cosmetic according to an embodiment of the present disclosure. The method is mainly applied to the projection beauty dressing wearing equipment. As shown, the method comprises:
step S201: an image of a face region of a user containing at least eyes is acquired in real time.
In this embodiment, with the projection cosmetic wearing device as shown in fig. 1A or 1B, after the user wears the device, the micro camera on the device aligns to the facial region at least including the eyes of the user, and then the micro camera is used to collect the image of the facial region at least including the eyes of the user in real time, that is, the facial information at least including the eyes of the user.
Step S202: and accurately detecting and positioning the eyes according to the face region image.
In this embodiment, the eye detection and positioning are performed on the collected face information or face region image at least including the eyes. It should be noted that there are many methods for detecting and locating eye parts. Here, the eye detection and positioning of the face region image may be a single module, or may be included in a detection and positioning module for multiple parts of the human face.
For example, a pre-trained face recognition module may be used to recognize the captured image of the face region of the user to specifically recognize the eye region, or to screen out the eye region from the recognized whole face region.
In the present application, the process of detecting and positioning the eye is mainly to know where the eye is, and where the shape and the precise position of the eye are. In some application scenes with higher requirements, the shapes and the positions of white eyes, eyeball, pupil and the like of eyes can be accurately detected according to requirements.
Step S203: and loading projection information of the eye protection mode and/or the eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state.
In this embodiment, the eye is accurately detected and positioned according to the facial region image, and then projection information of the eye protection mode and/or the eye beautifying mode is loaded based on the recognized eye or the position regions of the white, the eyeball, and the pupil in the eye and the eye state. The information to be projected is generated mainly by performing eye protection processing and/or adding eye makeup information under a frame which at least comprises facial information or facial area images of eyes.
In one embodiment of the present application, the eye protection mode includes: A. setting all pixels at least corresponding to the pupil range or the corresponding eye range as none to realize blackening treatment and generate eye protection projection information; or B, reducing the projection intensity parameter at least corresponding to the pupil range or the eye range to realize light weakening treatment and generate eye protection projection information.
In the present application, for a collected facial region image at least including an eye, through eye detection and positioning, for a pupil part of the eye or a part with a larger range (such as between the pupil range and the eye range), each pixel of a position covered by the part image is set to be "none" (or the information intensity is weak enough), that is, "blackening" is performed, and eye projection information, that is, an image to be projected is generated; or, the projection intensity parameter at least corresponding to the pupil range or the corresponding eye range is reduced, so that no or few projection light rays are actually projected to the pupil when the image is projected to the corresponding eye of the user subsequently, and the eye protection effect can be achieved.
It should be understood that the eye protection effect can be achieved as long as there is not enough projection light to reach the pupil. However, in some cases, such as when the positioning accuracy is not high, or purely for simplification, the "blackening" range (the range in which the pixel information is set to "none") may be expanded to the eyeball part, or even a larger range, such as the orbit range, as long as the range includes the pupil. Therefore, when the eye protection projection information images subjected to the blackening processing are projected to the corresponding eyes of the user, the eye protection effect is more easily achieved.
It should be noted that, in one or more practical embodiments, the projection-based eye protection cosmetic method in the present application is mostly performed together with the projection-based cosmetic method for the whole face of the user, and of course, an application scenario in which the eye protection cosmetic mode is performed separately for a local area also exists.
In an embodiment of the present application, the eye beautifying mode includes:
A. whether the eyes are in the eye-closing state or the eye-opening state is detected.
For example, it is determined whether the eyes of the face region image have an eye white region, and if not, it is determined as an eye-closing state, and if so, it is determined as an eye-opening state.
B. If the eye is detected to be in the eye closing state, the beautification treatment is not performed on the inside of the eye.
In short, the main purpose of determining whether the eyes are open or closed is to beautify the eyes, and therefore, if the eyes are closed, there is no need to perform a process for beautifying the inside of the eyes.
It should be understood, however, that subsequent projections of the present application are processed based on at least M (e.g., 24) images acquired per second, and that subsequent projections are also projected substantially continuously based on this frequency. Therefore, the present application considers that when a user blinks or closes his eyes normally during use, a cosmetic treatment is selected to be performed or not performed accordingly in order to maintain natural makeup.
Further, when the eye is detected to be in the eye-closed state, the eye-protection mode may be applied, that is, the eye may not be blackened.
In some implementations of the present application, the cosmetic eye pattern further includes: when the eyes are detected to be in the eye closing state, corresponding makeup information can be loaded for the parts around the eyes.
Preferably, when the eye is detected to be in the closed state, the eye shadow makeup information may be loaded to the eyelid or eyelid of the eye or the false eyelash makeup information may be loaded to the eyelash part of the eye.
In consideration, the eye protection cosmetic method based on projection in the application is mostly carried out together with the whole cosmetic on the face of the user based on projection. Therefore, when the eyes are detected to be in the eye closing state, in order to keep the whole face natural make-up, although the beautification treatment is not needed inside the eyes, the corresponding beautification treatment can still be carried out on the outside of the eyes, such as eyelids and eyelashes. For example, the beautification treatment of eyelash and false eyelash is performed for eyelash and eyelash.
C. If the eye is detected to be open, the recognized eye white, eye bead, and pupil position area in the eye is beautified or blackened.
Further, the method specifically comprises the following steps:
1) selecting a makeup effect aiming at pixels at positions covered by the white eyes and the eyeball parts respectively to generate eye beautifying projection information based on the recognized white eyes and eyeball parts in the eyes; wherein the makeup effects include: any one or more of color, pattern, shape, coverage area size and special effect;
2) selecting a makeup effect aiming at pixels of a position covered by a pupil part to generate eye beautifying projection information based on the identified pupil part in the eye; or carrying out blackening treatment in an eye protection mode aiming at pixels at positions covered by pupil parts to generate eye protection projection information; when the makeup effect is selected according to the pixels at the positions covered by the pupil parts, the brightness of the pixels is properly controlled.
In brief, for the white eye and eyeball parts, the facial area image can be selectively set to be different colors or makeup patterns according to the pixels at the positions covered by the parts, the shape is changed, the coverage range is enlarged or reduced, special effects are introduced, and the like, so that the eye beautifying projection information to be projected is generated, and therefore, when the eye beautifying projection information is subsequently projected to the corresponding eyes of a user, different eyeball colors can be displayed, and more abundant eyeball or white eye patterns and color makeup effects can be mapped.
The pupil area is usually treated with "blackening" to achieve the eye protection effect. In addition, the beautification treatment can be selected, and only the brightness of the pixel needs to be properly controlled, so that discomfort caused after projection is avoided.
The eye protection mode and the eye beautifying mode are not contradictory, and one of the eye protection mode and the eye beautifying mode can be selected, or the eye protection mode and the eye beautifying mode can be selected simultaneously.
Step S204: and projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
In an embodiment of the present application, step S204 specifically includes:
A. calibrating the reference coordinates of the image acquisition unit and the projection unit to accurately position the projection range;
B. projecting the image corresponding to the eye protection projection information and/or the eye beautifying projection information to the face of the user at the frequency of M times per second; and the image projected each time is the latest image obtained by respectively processing each part of the eye based on the latest acquired face area image and based on the eye identification projection information and/or the eye beautifying projection information, and loading the eye protection projection information and/or the eye beautifying projection information. Such as performing a graceful adjustment or rendering process on the original image.
In the present application, the eye protection projection information and/or the beauty eye projection information generated as described above may be projected onto the eyes of the user by using a micro projector in the projection beauty wearing device shown in fig. 1A or 1B. It should be noted that during the projection process, the precise positioning is required, and the projection deviation is controlled within a small enough range to make the projected information sufficiently fit with the corresponding portion of the user.
It should be noted that the eye protection projection information and/or the eye beautifying projection information to be projected is essentially a frame-by-frame image, which is combined with the acquired position information of the facial area at least including the eyes or the moderately processed original image, and is loaded with the projection information of the required eye protection mode and/or eye beautifying mode. While the projection process is a continuous reciprocating process and maintains a sufficiently high frequency. I.e. within one second, the above steps 101-S104 are repeated M times. M is usually not lower than 24 and is larger than the maximum number of blinks of a normal person in one second, so as to ensure that the projection effect is continuous and natural enough under the persistence of vision effect.
The eye-protecting makeup method based on projection can be implemented independently, is not excluded from practice, is combined with other makeup methods, or is embedded into other makeup methods for implementation.
In addition, the realization that the acquisition position is used as the base point, the micro camera and the micro projector in the projection cosmetic wearing device are required to be close to each other as much as possible in position, and even the two devices are integrated, so that the real-time conversion and the projection positioning of the cosmetic effect are facilitated.
This application can adopt miniature projecting apparatus, and on wearable equipment was located to its less convenient of size, its projection light source heat was low secondly, and is harmless to skin, and the power consumption is few, and the precision is high, delays for a short time. The method and the device can enable the facial area image loaded with the projection information of the eye protection mode and/or the eye beautifying mode to follow changes of expressions, textures and the like of the face of the user, reduce or eliminate errors or delay between projection and changes of the face of the user, enable the projection image to be completely and dynamically attached to the face in real time, and enable the projection image to be real and natural enough to look like.
Generally, when M reaches 24 or more, the observed makeup effect is sufficiently continuous and natural due to persistence of vision of human eyes. The standard frame number per second of the movie, M is 24, since the action amplitude and speed of the human face are not large, M can be lower, or, in order to make the effect better, the frame number can be increased according to the situation. Generally, the higher the frame number is, the better the effect is, but the calculation amount and the energy consumption are also higher, and the standby time and the equipment heating are influenced. And the frame number is too high, and to a certain extent, the human eyes can difficultly distinguish obvious effect difference. The number of frames per second must be taken to an appropriate value.
At present, projection technology is more perfect, and the makeup is mainly carried out through the projection technology, and the makeup is perfectly fitted to the eyes and the face of a user and changes along with the changes of the eyes and the face, so that the makeup looks natural enough.
Fig. 3 is a schematic structural view of a projection cosmetic wearing device according to an embodiment of the present application. As shown, the apparatus 300 includes:
one or more cameras 301 for acquiring in real time an image of a face region of a user containing at least eyes;
a processor 302, configured to perform accurate eye detection and positioning according to the facial region image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state;
one or more projectors 303, configured to project the projection information to the eyes of the user to map an eye protection effect and/or an eye beautifying effect with the collection position as a base point.
The Processor 302 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
Further, the air conditioner is provided with a fan,
the apparatus 300 may further comprise: the memory 304 is used for storing preset multiple groups of makeup effects, or eye protection modes and/or eye beautifying modes, so that the equipment can obtain the makeup effects through a switching key or a selection device.
In addition, the memory 304 stores computer instructions, and the processor 302 loads one or more instructions corresponding to the processes of the application program into the memory 304 according to the steps described in fig. 2, and the processor 302 executes the application program stored in the memory 304, thereby implementing the method described in fig. 2.
The Memory 304 may include a Random Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory.
When the projection cosmetic wearing device 300 is a cosmetic effect by receiving any combination of the selection on the mobile terminal, or an eye protection mode and/or an eye protection mode, the device 300 may further include: a communicator 305, configured to perform a communication connection with the mobile terminal, so as to receive a makeup effect, or an eye protection mode and/or an eye beautifying mode, in any combination selected on the mobile terminal.
Specifically, the communication method of the communicator 305 includes: any one or more of WIFI, NFC, Bluetooth, Ethernet, GSM, 3G and GPRS. The network communication method of the communication method comprises the following steps: any one or more of the internet, an intranet, a Wide Area Network (WAN), a Local Area Network (LAN), a wireless network, a Digital Subscriber Line (DSL) network, a frame relay network, an Asynchronous Transfer Mode (ATM) network, a Virtual Private Network (VPN), and/or any other suitable communication network.
In an embodiment of the present application, the device 300 is a card issuing device, which can refer to the card issuing device shown in fig. 1A. One or more interaction units which extend to the front of the face of the user when the user wears the hairpin are arranged on the hairpin; the interaction unit comprises the camera 301 and the projector 303, and the collection direction and the projection direction are both towards the face of the user.
In another embodiment of the present application, the apparatus 300 may also be a hat with a front brim, as described with reference to fig. 1B. One or more interaction units facing the face of the user are arranged below the front brim of the hat; each of the interaction units includes one of the cameras 301 and one of the projectors 303, and the capturing and projecting directions are both toward the face of the user.
In the present application, whether the device 300 is a hair clip or a hat, it is generally desirable that the camera 301 and the projector 303 be located in close proximity to achieve accurate projection.
In this embodiment, the device 300 may be powered by a small lithium battery or other energy source, for example, a lithium battery is replaced by a solar battery, so that the device 300 is more energy-saving and environment-friendly.
The application mainly solves the problems of changing the color displayed by the eyeball and mapping the makeup effect of richer eyeball or eye white patterns, can be used for improving the existing problem of makeup inside the eye, and provides corresponding measures for protecting the eye.
To sum up, the application provides a beautiful dress up method of eyeshield based on projection and beautiful dress up wearing apparatus of projection. Acquiring a face area image at least containing eyes of a user; accurately detecting and positioning the eyes according to the face region image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state; and projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
The application effectively overcomes some defects in the prior art and has higher industrial utilization value.
The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.

Claims (10)

1. A projection-based eye protection makeup method is applied to projection makeup wearable equipment, and comprises the following steps:
acquiring a face area image at least containing eyes of a user in real time;
accurately detecting and positioning the eyes according to the face region image;
loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state;
and projecting the projection information to the eyes of the user by taking the acquisition position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
2. The method of claim 1, wherein the eye-shielding mode comprises:
setting all pixels at least corresponding to the pupil range or the corresponding eye range as none to realize blackening treatment and generate eye protection projection information; alternatively, the first and second electrodes may be,
and reducing the projection intensity parameters at least corresponding to the pupil range or the eye range so as to realize light weakening treatment and generate eye protection projection information.
3. The method of claim 1, wherein the eye-beautifying mode comprises:
detecting whether the eyes are in an eye closing state or an eye opening state;
if the eyes are detected to be in the eye closing state, beautifying the interior of the eyes;
if the eye is detected to be open, the recognized eye white, eye bead, and pupil position area in the eye is beautified or blackened.
4. The method according to claim 3, wherein the beautifying or blackening treatment of the location areas of the white eye, the eyeball, and the pupil in the identified eye part comprises:
selecting a makeup effect aiming at pixels at positions covered by the white eyes and the eyeball parts respectively to generate eye beautifying projection information based on the recognized white eyes and eyeball parts in the eyes; wherein the makeup effects include: any one or more of color, pattern, shape, coverage area size and special effect;
selecting a makeup effect aiming at pixels of a position covered by a pupil part to generate eye beautifying projection information based on the identified pupil part in the eye; or carrying out blackening treatment in an eye protection mode aiming at pixels at positions covered by pupil parts to generate eye protection projection information; when the makeup effect is selected according to the pixels at the positions covered by the pupil parts, the brightness of the pixels is properly controlled.
5. The method of claim 3, wherein the cosmetic eye pattern further comprises:
when the eyes are detected to be in the eye closing state, corresponding makeup information can be loaded for the parts around the eyes.
6. The method according to claim 1, wherein the projecting the projection information to the eyes of the user to map the eye protection effect and/or the eye beautifying effect based on the collection position comprises:
calibrating the reference coordinates of the image acquisition unit and the projection unit to accurately position the projection range;
projecting the image corresponding to the eye protection projection information and/or the eye beautifying projection information to the face of the user at the frequency of M times per second; and the image projected each time is the latest image obtained by respectively processing each part of the eye based on the face area image acquired last time and loading eye protection projection information and/or eye beautifying projection information.
7. A projected cosmetic wearing device, characterized in that the device comprises:
one or more cameras for acquiring in real time an image of a face region of a user including at least eyes;
the processor is used for accurately detecting and positioning the eyes according to the face area image; loading projection information of an eye protection mode and/or an eye beautifying mode based on the recognized eyes or the position areas of the white eyes, the eyeball and the pupil in the eyes and the eye state;
one or more projectors, which are used for projecting the projection information to the eyes of the user by taking the collection position as a base point so as to map the eye protection effect and/or the eye beautifying effect.
8. The projected cosmetic wearing device according to claim 7, further comprising:
the memory is used for storing preset multiple groups of makeup effects, or eye protection modes and/or eye beautifying modes, so that the equipment can obtain the makeup effects through a switching key or a selection device;
or the like, or, alternatively,
the communicator is used for being in communication connection with the mobile terminal so as to receive the makeup effect, or the eye protection mode and/or the eye beautifying mode in any combination form selected on the mobile terminal.
9. The projection beauty dressing wearing device according to claim 7, wherein the device is a hair card, and one or more interaction units extending to the front of the user's face when worn by the user are arranged on the hair card; each interaction unit comprises a camera and a projector, and the collection direction and the projection direction face the face of the user.
10. The projected makeup wearing apparatus according to claim 7, wherein said apparatus is a hat with a front brim, and one or more interaction units facing the face of the user are provided under the front brim of the hat; each interaction unit comprises a camera and a projector, and the collection direction and the projection direction face the face of the user.
CN202011377709.5A 2020-11-30 2020-11-30 Eye protection makeup method based on projection and projection makeup dressing wearing equipment Pending CN112486263A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011377709.5A CN112486263A (en) 2020-11-30 2020-11-30 Eye protection makeup method based on projection and projection makeup dressing wearing equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011377709.5A CN112486263A (en) 2020-11-30 2020-11-30 Eye protection makeup method based on projection and projection makeup dressing wearing equipment

Publications (1)

Publication Number Publication Date
CN112486263A true CN112486263A (en) 2021-03-12

Family

ID=74937821

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011377709.5A Pending CN112486263A (en) 2020-11-30 2020-11-30 Eye protection makeup method based on projection and projection makeup dressing wearing equipment

Country Status (1)

Country Link
CN (1) CN112486263A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791028A (en) * 2016-11-30 2017-05-31 努比亚技术有限公司 A kind of display adjusting method, device and terminal
CN107153805A (en) * 2016-03-02 2017-09-12 北京美到家科技有限公司 Customize makeups servicing unit and method
TW201737237A (en) * 2016-04-05 2017-10-16 鴻海精密工業股份有限公司 Electronic device, system and method for adjusting display device
CN107766831A (en) * 2017-10-31 2018-03-06 广东欧珀移动通信有限公司 Image processing method, device, mobile terminal and computer-readable recording medium
CN108711180A (en) * 2018-05-02 2018-10-26 北京市商汤科技开发有限公司 Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device
CN109785259A (en) * 2019-01-09 2019-05-21 成都品果科技有限公司 A kind of real-time U.S. pupil method and device
CN111260587A (en) * 2020-01-21 2020-06-09 科珑诗菁生物科技(上海)有限公司 3D projection makeup method and 3D projection makeup dressing equipment
CN111782854A (en) * 2020-07-07 2020-10-16 科珑诗菁生物科技(上海)有限公司 Multi-view projection makeup method and multi-view projection makeup dressing wearing equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107153805A (en) * 2016-03-02 2017-09-12 北京美到家科技有限公司 Customize makeups servicing unit and method
TW201737237A (en) * 2016-04-05 2017-10-16 鴻海精密工業股份有限公司 Electronic device, system and method for adjusting display device
CN106791028A (en) * 2016-11-30 2017-05-31 努比亚技术有限公司 A kind of display adjusting method, device and terminal
CN107766831A (en) * 2017-10-31 2018-03-06 广东欧珀移动通信有限公司 Image processing method, device, mobile terminal and computer-readable recording medium
CN108711180A (en) * 2018-05-02 2018-10-26 北京市商汤科技开发有限公司 Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device
CN109785259A (en) * 2019-01-09 2019-05-21 成都品果科技有限公司 A kind of real-time U.S. pupil method and device
CN111260587A (en) * 2020-01-21 2020-06-09 科珑诗菁生物科技(上海)有限公司 3D projection makeup method and 3D projection makeup dressing equipment
CN111782854A (en) * 2020-07-07 2020-10-16 科珑诗菁生物科技(上海)有限公司 Multi-view projection makeup method and multi-view projection makeup dressing wearing equipment

Similar Documents

Publication Publication Date Title
CN104992402B (en) A kind of U.S. face processing method and processing device
CN103885589B (en) Eye movement tracking method and device
US10955689B2 (en) Contact lens and storage medium
CN107123160A (en) Simulation lift face system, method and mobile terminal based on three-dimensional image
JP2019527410A (en) Method for hiding objects in images or videos and related augmented reality methods
KR101520778B1 (en) Method, apparatus and computer program executing the method for fitting contact lens virtually
CN110111245B (en) Image processing method, device, terminal and computer readable storage medium
CN107578380A (en) Image processing method and device, electronic equipment and storage medium
CN103945104B (en) Information processing method and electronic equipment
CN109155053B (en) Information processing apparatus, information processing method, and recording medium
CN106293362A (en) A kind of guiding cosmetic equipment
CN108875672A (en) The screen brightness regulation method and device of intelligent wearable device
WO2016158729A1 (en) Makeup assistance system, measurement device, portable terminal device, and program
WO2021197186A1 (en) Auxiliary makeup method, terminal device, storage medium and program product
JP2018049593A (en) Method and system for tracking line of sight
US11138429B2 (en) Iris recognition using eye-tracking system
JP2014064248A (en) Image projection device and image projection method
CN103714225A (en) Information system with automatic make-up function and make-up method of information system
CN107145217A (en) Intelligent interactive system and intelligent interactive method
CN112486263A (en) Eye protection makeup method based on projection and projection makeup dressing wearing equipment
CN111260587A (en) 3D projection makeup method and 3D projection makeup dressing equipment
CN105975920A (en) Method and system for trying glasses
KR101507410B1 (en) Live make-up photograpy method and apparatus of mobile terminal
CN111782854A (en) Multi-view projection makeup method and multi-view projection makeup dressing wearing equipment
CN106598259A (en) Input method and input unit for head-mounted equipment and VR head-mounted equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination