CN108629236A - Control method, device and the bathroom mirror of bathroom mirror - Google Patents
Control method, device and the bathroom mirror of bathroom mirror Download PDFInfo
- Publication number
- CN108629236A CN108629236A CN201710170010.3A CN201710170010A CN108629236A CN 108629236 A CN108629236 A CN 108629236A CN 201710170010 A CN201710170010 A CN 201710170010A CN 108629236 A CN108629236 A CN 108629236A
- Authority
- CN
- China
- Prior art keywords
- acne
- user
- bathroom mirror
- face
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
Abstract
The invention discloses a kind of control method of bathroom mirror, device and bathroom mirrors, the described method comprises the following steps：Obtain the face image of user；Face image is identified, to judge that the face of user whether there is acne；If the face of user there are acne, obtains the acne information in face image；And user is accordingly recommended by bathroom mirror according to acne information.The method of the embodiment of the present invention can be identified the acne of user face by bathroom mirror and accordingly be recommended, keep bathroom mirror more intelligent, while improving user experience.
Description
Technical field
The present invention relates to household electrical appliance technical field, more particularly to a kind of control method of bathroom mirror, a kind of bathroom mirror
Control device and a kind of bathroom mirror.
Background technology
Currently, bathroom has become the pith in people's life, people will use arrive bathroom nearly every day.And
With the continuous improvement of people's living standards, the intelligence system in bathroom is also increasingly valued by people, especially bathroom mirror
It is intelligent.
Invention content
The present invention is directed to solve one of the technical problem in above-mentioned technology at least to a certain extent.
For this purpose, first purpose of the present invention is to propose a kind of control method of bathroom mirror, can be known by bathroom mirror
The acne of other user face are simultaneously accordingly recommended, and keep bathroom mirror more intelligent, while improving user experience.
Second object of the present invention is to propose a kind of control device of bathroom mirror.
Third object of the present invention is to propose a kind of bathroom mirror.
In order to achieve the above objectives, first aspect present invention embodiment proposes a kind of control method of bathroom mirror, including with
Lower step：Obtain the face image of user；The face image is identified, to judge that the face of the user whether there is
Acne；If the face of the user there are acne, obtains the acne information in the face image；And according to the powder
Thorn information accordingly recommends user by the bathroom mirror.
The control method of bathroom mirror according to the ... of the embodiment of the present invention obtains the face image of user, then to face first
Image is identified, and to judge that the face of user whether there is acne, if there are acne for the face of user, obtains face's figure
Acne information as in, finally accordingly recommends user by bathroom mirror according to acne information.This method can lead to as a result,
It crosses the acne of bathroom mirror identification user face and is accordingly recommended, keep bathroom mirror more intelligent, while improving user
Experience.
In addition, the control method of the bathroom mirror proposed according to the above embodiment of the present invention can also have following additional skill
Art feature：
In one embodiment of the invention, according to preset acne image recognition model and corresponding recognizer to institute
It states face image to be identified, to judge that the face of the user whether there is acne.
In one embodiment of the invention, before the face image for obtaining the user, further include：Connection Service
Device, and detect whether the preset acne image recognition model and corresponding recognizer have update by the server；
If the preset acne image recognition model and corresponding recognizer have update, downloaded by the server newest
Acne image recognition model and corresponding recognizer, with to the preset acne image recognition model and corresponding identification
Algorithm is updated.
In one embodiment of the invention, if there are acne for the face of the user, further include：In the face
The position of the acne is marked in image, and the face image after marking is provided to the user by the bathroom mirror.
In one embodiment of the invention, described that phase is carried out to user by the bathroom mirror according to the acne information
It should recommend, specifically include：Method and the link of relevant article of acne are removed according to the acne acquisition of information；Pass through the bath
Room mirror provides method and the link of relevant article of the removal acne to the user.
In one embodiment of the invention, the control method of above-mentioned bathroom mirror further includes：If the face of the user
Not there are no acne, then reports corresponding voice prompt.
In one embodiment of the invention, the control method of above-mentioned bathroom mirror further includes：It is carried from the face image
Take facial feature information；According to facial skin health status reference information in the facial feature information and database to the use
The health status of family facial skin is assessed, and generates corresponding assessment result；And by the bathroom mirror to the use
Family provides the assessment result.
In order to achieve the above objectives, second aspect of the present invention embodiment proposes a kind of control device of bathroom mirror, including：The
One acquisition module, first acquisition module are used to obtain the face image of user；Identification module, the identification module with it is described
First acquisition module is connected, and the identification module is for being identified the face image, to judge the face of the user
With the presence or absence of acne；Second acquisition module, second acquisition module are connected with the identification module, second acquisition module
For when there are acne information when acne, obtained in the face image for the face of the user；And recommending module, it is described
Recommending module is connected with second acquisition module, and the recommending module is used to pass through the bathroom mirror according to the acne information
User is accordingly recommended.
The control device of bathroom mirror according to the ... of the embodiment of the present invention, the face that user is obtained by the first acquisition module schemes
Picture, and face image is identified by identification module, to judge that the face of user whether there is acne, if the face of user
There are acne in portion, then the acne information in face image are obtained by the second acquisition module, so that recommending module is believed according to acne
Breath accordingly recommends user by bathroom mirror.The device can make the acne of bathroom mirror identification user face go forward side by side as a result,
Row is corresponding to be recommended, and has not only improved the intelligence degree of bathroom mirror, but also improve user experience.
In addition, the control device of the bathroom mirror proposed according to the above embodiment of the present invention can also have following additional skill
Art feature：
In one embodiment of the invention, the identification module is according to preset acne image recognition model and corresponding
The face image is identified in recognizer, to judge that the face of the user whether there is acne.
In one embodiment of the invention, first acquisition module, is additionally operable to：In the face's figure for obtaining the user
Before picture, Connection Service device, and the preset acne image recognition model and corresponding identification are detected by the server
Whether algorithm has update；If the preset acne image recognition model and corresponding recognizer have update, pass through institute
It states server and downloads newest acne image recognition model and corresponding recognizer, with to the preset acne image recognition
Model and corresponding recognizer are updated.
In one embodiment of the invention, second acquisition module, is additionally operable to：When there are powder for the face of the user
When thorn, the position of the acne is marked in the face image, and label is provided to the user by the bathroom mirror
Face image afterwards.
In one embodiment of the invention, the recommending module, is specifically used for：It is removed according to the acne acquisition of information
The method of acne and the link of relevant article；The method and phase of the removal acne are provided by the bathroom mirror to the user
The article of pass links.
In one embodiment of the invention, second acquisition module, is additionally operable to：When the face of the user does not exist
When acne, corresponding voice prompt is reported.
In one embodiment of the invention, the control device of above-mentioned bathroom mirror further includes：Extraction module, the extraction mould
Block is connected with first acquisition module, and the extraction module from the face image for extracting facial feature information；It comments
Estimate module, the evaluation module is connected with the extraction module, the evaluation module be used for according to the facial feature information and
Facial skin health status reference information assesses the health status of user's facial skin in database, and generates phase
The assessment result answered；And module is provided, the offer module is connected with the evaluation module, and the offer module is for passing through
The bathroom mirror provides the assessment result to the user.
To achieve the goals above, a kind of bathroom mirror of third aspect present invention embodiment proposition includes：The present invention second
The control device of the bathroom mirror of aspect embodiment.
The bathroom mirror of the embodiment of the present invention can make bathroom mirror identify user's face by the control device of above-mentioned bathroom mirror
The acne in portion are simultaneously accordingly recommended, and the intelligence degree of bathroom mirror has not only been improved, but also improve user experience.
The advantages of additional aspect of the invention, will be set forth in part in the description, and will partly become from the following description
Obviously, or practice through the invention is recognized.
Description of the drawings
Fig. 1 is the flow chart of the control method of bathroom mirror according to an embodiment of the invention.
Fig. 2 is the schematic diagram of bathroom mirror according to the ... of the embodiment of the present invention.
Fig. 3 is the flow chart of the control method of bathroom mirror in accordance with another embodiment of the present invention.
Fig. 4 is the block diagram of the control device of bathroom mirror according to an embodiment of the invention.
Fig. 5 is the block diagram of the control device of bathroom mirror in accordance with another embodiment of the present invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Below in conjunction with the accompanying drawings come describe the embodiment of the present invention bathroom mirror control method, device and bathroom mirror.
Fig. 1 is the flow chart of the control method of bathroom mirror according to an embodiment of the invention.In the embodiment of the present invention
In, can load Android intelligence system in bathroom mirror, and the Android intelligence system carry WIFI (Wireless Fidelity, wirelessly
LAN) function.
As shown in Figure 1, the control method of the bathroom mirror of the embodiment of the present invention includes the following steps：
S1 obtains the face image of user.
In an embodiment of the present invention, the face image of user can be obtained by camera.As shown in Fig. 2, the camera
The top of bathroom mirror can be mounted on.It should be noted that user uses bathroom mirror for convenience under normal circumstances, in installation bathroom mirror
When, the top of bathroom mirror can be made to be slightly above the height of user, therefore, when subscriber station is in front of bathroom mirror, be mounted on bathroom
The camera in vertex portion, which does not need excessive adjustment focal length and angle, can get the face image of user, be obtained to save
Take the time of family face image.
Specifically, as shown in Fig. 2, bathroom mirror enters init state after the power-up, at this time at the display screen of the bathroom mirror
In closed state.When the bathroom mirror receives enabled instruction input by user, bathroom mirror can be waken up (that is, waking up bathroom mirror dress
The Android intelligence system of load), while the display screen for lighting the bathroom mirror shows home interface.Wherein, display screen can be touch
Display screen, home interface may include the function menu viewing area of the main interface viewing area and right side in left side, the input of enabled instruction
Mode may include the key-press input etc. in remote controler input, mobile terminal input and the bathroom mirror.
In the purpose for ensureing privacy of user safety, the camera mounted on the top of bathroom mirror is not receiving accordingly
It will be closed before function command.When the user clicks when acne button on the bathroom mirror display screen, which will
Start the camera at top, and controls the face image that the camera obtains the user.
It should be noted that when the display screen of the bathroom mirror described in the embodiment is closed, can be used as
Common mirror is for users to use on one side.
Face image is identified in S2, to judge that the face of user whether there is acne.Wherein, acne can be divided into two
Kind, one is the closed of not head acne, that is, Whiteheads, another kind is open comedones, that is, blackhead.
It in one embodiment of the invention, can be according to preset acne image recognition model and corresponding recognizer pair
Face image is identified, to judge that the face of user whether there is acne.Wherein, preset acne image recognition model and right
The recognizer answered can be demarcated according to actual conditions.
Specifically, in view of image in acquisition and transmission, color information be easy by light source colour and direction etc. it is a variety of because
The influence of element.In order to avoid this color offset, bathroom mirror can first scheme the face after getting the face image of user
As carrying out image enhancement processing, it may include contrast enhancing, airspace filter, noise elimination, image smoothing and image sharpening etc..So
Afterwards according to preset acne image recognition model and corresponding recognizer to the face image after carrying out image enhancement processing into
Row identification.
For the accuracy for further keeping acne to identify, in one embodiment of the invention, in the face for obtaining user
Further include Connection Service device before portion's image, and preset acne image recognition model and corresponding knowledge are detected by server
Whether other algorithm has update, if preset acne image recognition model and corresponding recognizer have update, passes through service
Device downloads newest acne image recognition model and corresponding recognizer, with to preset acne image recognition model and correspondence
Recognizer be updated.
For example, when bathroom mirror is waken up (that is, when the Android intelligence system that bathroom mirror loads is waken up), it can be by built-in
WIFI module connect corresponding server, and the acne image recognition mould in bathroom mirror is stored in advance in by server detection
Whether type and corresponding recognizer have update.If the acne image recognition model that is stored in advance in bathroom mirror and corresponding
Recognizer has update, then downloads newest acne image recognition model and corresponding recognizer by server, to replace
The acne image recognition model being stored in advance in bathroom mirror and corresponding recognizer.So that it is guaranteed that the face of user into
Before the identification of row acne, acne image recognition model and corresponding recognizer in bathroom mirror are newest.
S3, if the face of user there are acne, obtains the acne information in face image.
S4 accordingly recommends user by bathroom mirror according to acne information.
In one embodiment of the invention, user is accordingly recommended by bathroom mirror according to acne information, specifically
Include method and the link of relevant article of acne being removed according to acne acquisition of information, and removal is provided a user by bathroom mirror
The method of acne and the link of relevant article.
Specifically, during the face image after progress image enhancement processing is identified, if identifying use
The face at family can obtain the acne information in face image there are acne, wherein acne information includes type and the distribution of acne
In the position of user face acne.Then according to the acne acquisition of information remove acne method and purchase relative article (for example,
Face's skin care products, Medicines and cosmetics etc.) link, and it will be shown in main interface viewing areas as shown in Figure 2, with side
Just user checks and selects.
Automatic jump to corresponding shopping website when the connection of relative article when the user clicks, and main interface viewing area into
Row shows that user can buy required article according to the method and the economic conditions of itself of the removal acne of above-mentioned offer at this time,
Substantially increase user experience.
In addition, bathroom mirror also can record image data when user carries out acne identification each time, and generates and go through accordingly
History acne image data is checked for user, in order to which user determines the processing done according to the method for the removal acne of above-mentioned offer
Whether effectively, it and adjusts processing method in time when invalid, improves user experience.
In one embodiment of the invention, if the face of user does not have acne, corresponding voice prompt is reported.
For example, during the face image after progress image enhancement processing is identified, if identifying the face of user not
There are acne, then corresponding voice prompt can be reported by the voice announcer built in bathroom mirror (for example, your face does not find
Acne), the recommendation of face's maintenance can be also carried out to user by bathroom mirror.
In conclusion the control method of bathroom mirror provided in an embodiment of the present invention, can identify user's face by bathroom mirror
The acne in portion are simultaneously accordingly recommended, and keep bathroom mirror more intelligent, while improving user experience.
The acne for preferably observing face for the convenience of the user, in one embodiment of the invention, if the face of user
There are acne, then the control method of above-mentioned bathroom mirror may additionally include the position that acne are marked in face image, and pass through bath
Room mirror provides a user the face image after label.
Specifically, during the face image after progress image enhancement processing is identified, if identifying use
The position that red circle marks acne in above-mentioned face image may be used there are acne in the face at family, and by its
It is shown in main interface viewing area as shown in Figure 2.When the user clicks when some red circle of label acne, bathroom mirror should
Red circle is amplified.
In other embodiments of the invention, bathroom mirror can also carry out related in the top of the red circle for label
Annotation, the content of annotation may include the type of acne.
Further to promote the intelligence degree of bathroom mirror, in one embodiment of the invention, as shown in figure 3, above-mentioned
The control method of bathroom mirror can also include the steps of：
S101 extracts facial feature information from face image.
In an embodiment of the present invention, facial feature information may include the Skin Color Information of face, the abnormal area of face is believed
Breath and abnormal area location information etc., wherein Skin Color Information may include it is ruddy, pale, pitch-dark, pale, obscure, wax yellow etc.,
Abnormal area can be the region with lesions such as spot, acne, small pox, moss, and the location information of abnormal area is positioned at face
Position, such as positioned at nose, cheek, forehead position.
It should be noted that when carrying out skin color model, the coloration of luminance information and skin itself when in order to take pictures
Information is distinguished, and can select the information of the YCbCr color spaces record colour of skin.Certain amount is established in face image region
The colour of skin sampled point of grade calculates the possibility that each pixel in sampled point colour belongs to skin, to obtain with Gauss model
The color-values of skin, i.e. Skin Color Information.
S102, according to facial skin health status reference information in facial feature information and database to user's facial skin
Health status assessed, and generate corresponding assessment result.Wherein, database can be cloud database or bathroom mirror
Database.It stores various skin health state reference information in database, including health status and is directed to the health status
Maintenance be applicable in scheme.
S103 provides a user assessment result by bathroom mirror.
For example, bathroom mirror can be inquired in database and believe with the facial characteristics according to the face feature information of the user of acquisition
The corresponding skin health state reference information progress health Evaluation of manner of breathing, the corresponding diagnosis description (health status) of acquisition,
The assessment results such as maintenance scheme, and include in main interface viewing area as shown in Figure 2, in order to which user looks by the assessment result
It sees.
To sum up, the control method of bathroom mirror according to the ... of the embodiment of the present invention obtains the face image of user first, then right
Face image is identified, to judge that the face of user obtains face with the presence or absence of acne if there are acne for the face of user
Acne information in portion's image finally accordingly recommends user by bathroom mirror according to acne information.This method energy as a result,
The acne of user face are enough identified by bathroom mirror and are accordingly recommended, keeps bathroom mirror more intelligent, improves simultaneously
User experience.
Fig. 4 is the block diagram of the control device of bathroom mirror according to an embodiment of the invention.In the reality of the present invention
It applies in example, Android intelligence system can be loaded in bathroom mirror, and the Android intelligence system carries WIFI function.
As shown in figure 4, the control device of the bathroom mirror of the embodiment of the present invention includes：First acquisition module 100, identification module
200, the second acquisition module 300 and recommending module 400.
Wherein, the first acquisition module 100 is used to obtain the face image of user.
In an embodiment of the present invention, the first acquisition module 100 can obtain the face image of user by camera.Such as figure
Shown in 2, which can be mounted on the top of bathroom mirror.It should be noted that user uses bathroom for convenience under normal circumstances
Mirror can make the top of bathroom mirror be slightly above the height of user when installing bathroom mirror, therefore, when subscriber station is before bathroom mirror
Fang Shi, adjustment focal length and angle that the camera at the top of bathroom mirror need not be excessive can get the face of user
Image, to save the time for obtaining user's face image.
Specifically, as shown in Fig. 2, bathroom mirror enters init state after the power-up, at this time at the display screen of the bathroom mirror
In closed state.When the bathroom mirror receives enabled instruction input by user, the first acquisition module 100 can wake up bathroom mirror
(that is, waking up the Android intelligence system that bathroom mirror loads), while the display screen for lighting the bathroom mirror shows home interface.Wherein,
Display screen can be touching display screen, and home interface may include that the main interface viewing area in left side and the function menu on right side are shown
The input mode in area, enabled instruction may include the key-press input etc. in remote controler input, mobile terminal input and the bathroom mirror.
In the purpose for ensureing privacy of user safety, the camera mounted on the top of bathroom mirror is not receiving accordingly
It will be closed before function command.When the user clicks when acne button on the bathroom mirror display screen, first obtains mould
Block 100 will start the camera at top, and control the face image that the camera obtains the user.
It should be noted that when the display screen of the bathroom mirror described in the embodiment is closed, can be used as
Common mirror is for users to use on one side.
Identification module 200 is connected with the first acquisition module 100, and identification module 200 is used to that face image to be identified, with
Judge that the face of user whether there is acne.Wherein, acne can be divided into two kinds, and one is the closed of not head acne, that is, hoary hairs
Acne, another kind are open comedones, that is, blackhead.
In one embodiment of the invention, identification module 200 can be according to preset acne image recognition model and correspondence
Recognizer face image is identified, with judge user face whether there is acne.Wherein, preset acne image
Identification model and corresponding recognizer can be demarcated according to actual conditions.
Specifically, in view of image in acquisition and transmission, color information be easy by light source colour and direction etc. it is a variety of because
The influence of element.In order to avoid this color offset, after the first acquisition module 100 gets the face image of user, mould is identified
Block 200 can carry out image enhancement processing to the face image first, it may include contrast enhancing, airspace filter, noise are eliminated, schemed
As smooth and image sharpening etc..Then identification module 200 is according to preset acne image recognition model and corresponding recognizer
Face image after progress image enhancement processing is identified.
For the accuracy for further keeping acne to identify, in one embodiment of the invention, the first acquisition module 100
It is additionally operable to before the face image for obtaining user, Connection Service device, and preset acne image recognition is detected by server
Whether model and corresponding recognizer have update, if preset acne image recognition model and corresponding recognizer have more
Newly, then newest acne image recognition model and corresponding recognizer are downloaded by server, with to preset acne image
Identification model and corresponding recognizer are updated.
For example, when bathroom mirror is waken up (that is, when the Android intelligence system that bathroom mirror loads is waken up), first obtains mould
Block 100 can connect corresponding server by the WIFI module built in the bathroom mirror, and be stored in advance in by server detection
Whether acne image recognition model and corresponding recognizer in bathroom mirror have update.If be stored in advance in bathroom mirror
Acne image recognition model and corresponding recognizer have update, the first acquisition module 100 then to be downloaded by server newest
Acne image recognition model and corresponding recognizer, with replace be stored in advance in acne image recognition model in bathroom mirror and
Corresponding recognizer.So that it is guaranteed that before carrying out acne identification to the face of user, the acne image recognition in bathroom mirror
Model and corresponding recognizer are newest.
Second acquisition module 300 is connected with identification module 200, and the second acquisition module 300 is used to exist when the face of user
When acne, the acne information in face image is obtained.
Recommending module 400 is connected with the second acquisition module 300, and recommending module 400 is used to pass through bathroom according to acne information
Mirror accordingly recommends user.
In one embodiment of the invention, recommending module 400 is specifically used for removing acne according to acne acquisition of information
Method and the link of relevant article, and method and the link of relevant article for removing acne are provided a user by bathroom mirror.
Specifically, during the face image after carrying out image enhancement processing is identified in identification module 200, such as
Fruit identifies the face of user there are acne, and the second acquisition module 300 can obtain the acne information in face image, wherein powder
Thorn information includes the type of acne and the position for being distributed in user face acne.Then recommending module 400 is according to the acne information
The link of the method and purchase relative article (for example, face's skin care products, Medicines and cosmetics etc.) of removal acne is obtained, and
It will be shown in main interface viewing areas as shown in Figure 2, to facilitate user to check and select.
Automatic jump to corresponding shopping website when the connection of relative article when the user clicks, and main interface viewing area into
Row shows that user can buy required article according to the method and the economic conditions of itself of the removal acne of above-mentioned offer at this time,
Substantially increase user experience.
In addition, recommending module 400 also can record image data when user carries out acne identification each time, and generate corresponding
History acne image data checked for user, done according to the method for the removal acne of above-mentioned offer in order to which user determines
Whether processing is effective, and adjusts processing method in time when invalid, improves user experience.
In one embodiment of the invention, the second acquisition module 300 is additionally operable to when the face of user does not have acne,
Report corresponding voice prompt.For example, the face image after carrying out image enhancement processing is identified in identification module 200
In the process, if identifying that the face of user does not have acne, the second acquisition module 300 ifs, can pass through the voice built in bathroom mirror
Broadcast device reports corresponding voice prompt (for example, your face does not find acne), can also carry out face to user by bathroom mirror
The recommendation of portion's maintenance.
In conclusion the control device of bathroom mirror provided in an embodiment of the present invention, can make bathroom mirror identification user face
Acne and accordingly recommended, not only improved the intelligence degree of bathroom mirror, but also improve user experience.
The acne of face, in one embodiment of the invention, the second acquisition module 300 are preferably observed for the convenience of the user
It is additionally operable to when the face of user in face image there are when acne, marking the position of acne, and by bathroom mirror to user
Face image after label is provided.
Specifically, during the face image after carrying out image enhancement processing is identified in identification module 200, such as
Fruit identifies the face of user there are acne, then the second acquisition module 300 can be used red circle in above-mentioned face image
In mark the positions of acne, and it will be shown in main interface viewing areas as shown in Figure 2.Certain of label acne when the user clicks
When the circle of a red, the circle of the red is amplified by the second acquisition module 300.
In other embodiments of the invention, the second acquisition module 300 can also be in the red circle for label
The content of the relevant annotations of Fang Jinhang, annotation may include the type of acne.
Further to promote the intelligence degree of bathroom mirror, in one embodiment of the invention, as shown in figure 5, above-mentioned
The control device of bathroom mirror may also include：Extraction module 500, evaluation module 600 and offer module 700.
Wherein, extraction module 500 is connected with the first acquisition module 100, and extraction module 500 from face image for extracting
Facial feature information.
In an embodiment of the present invention, facial feature information may include the Skin Color Information of face, the abnormal area of face is believed
Breath and abnormal area location information etc., wherein Skin Color Information may include it is ruddy, pale, pitch-dark, pale, obscure, wax yellow etc.,
Abnormal area can be the region with lesions such as spot, acne, small pox, moss, and the location information of abnormal area is positioned at face
Position, such as positioned at nose, cheek, forehead position.
It should be noted that when carrying out skin color model, the coloration of luminance information and skin itself when in order to take pictures
Information is distinguished, and extraction module 500 can select the information of the YCbCr color spaces record colour of skin.Extraction module 500 is in face
The colour of skin sampled point that certain amount grade is established in image-region calculates each pixel in sampled point colour with Gauss model and belongs to
The possibility of skin, to obtain the color-values of skin, i.e. Skin Color Information.
Evaluation module 600 is connected with extraction module 500, and evaluation module 600 is used for according to facial feature information and database
Middle facial skin health status reference information assesses the health status of user's facial skin, and generates corresponding assessment knot
Fruit.Wherein, database can be the database of cloud database or bathroom mirror.Various skin health shapes are stored in database
State reference information, including health status and the applicable scheme of maintenance for the health status.
It provides module 700 with evaluation module 600 to be connected, provides module 700 for providing a user assessment by bathroom mirror
As a result.
For example, extraction module 500 can be according to the face feature information of the user of acquisition, then evaluation module 600 inquires number
Health Evaluation is carried out according to skin health state reference information corresponding with the face feature information in library, is obtained corresponding
The assessment results such as diagnosis description (health status), maintenance scheme, it includes in such as Fig. 2 finally to provide module 700 by the assessment result
Shown in main interface viewing area, in order to which user checks.
To sum up, the control device of bathroom mirror according to the ... of the embodiment of the present invention obtains the face of user by the first acquisition module
Portion's image, and face image is identified by identification module, to judge that the face of user whether there is acne, if user
Face there are acne, then by the second acquisition module obtain face image in acne information so that recommending module is according to powder
Thorn information accordingly recommends user by bathroom mirror.The device can make the acne of bathroom mirror identification user face as a result,
And accordingly recommended, the intelligence degree of bathroom mirror is not only improved, but also improve user experience.
In order to realize that above-described embodiment, the present invention also propose a kind of bathroom mirror comprising the control device of above-mentioned bathroom mirror.
The bathroom mirror of the embodiment of the present invention can make bathroom mirror identify user's face by the control device of above-mentioned bathroom mirror
The acne in portion are simultaneously accordingly recommended, and the intelligence degree of bathroom mirror has not only been improved, but also improve user experience.
In the description of the present invention, it is to be understood that, term "center", " longitudinal direction ", " transverse direction ", " length ", " width ",
" thickness ", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outside", " up time
The orientation or positional relationship of the instructions such as needle ", " counterclockwise ", " axial direction ", " radial direction ", " circumferential direction " be orientation based on ... shown in the drawings or
Position relationship is merely for convenience of description of the present invention and simplification of the description, and does not indicate or imply the indicated device or element must
There must be specific orientation, with specific azimuth configuration and operation, therefore be not considered as limiting the invention.
In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include one or more this feature.In the description of the present invention, the meaning of " plurality " is two or more,
Unless otherwise specifically defined.
In the present invention unless specifically defined or limited otherwise, term " installation ", " connected ", " connection ", " fixation " etc.
Term shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or integral；Can be that machinery connects
It connects, can also be electrical connection；It can be directly connected, can also can be indirectly connected through an intermediary in two elements
The interaction relationship of the connection in portion or two elements.It for the ordinary skill in the art, can be according to specific feelings
Condition understands the concrete meaning of above-mentioned term in the present invention.
In the present invention unless specifically defined or limited otherwise, fisrt feature can be with "above" or "below" second feature
It is that the first and second features are in direct contact or the first and second features pass through intermediary mediate contact.Moreover, fisrt feature exists
Second feature " on ", " top " and " above " but fisrt feature be directly above or diagonally above the second feature, or be merely representative of
Fisrt feature level height is higher than second feature.Fisrt feature second feature " under ", " lower section " and " below " can be
One feature is directly under or diagonally below the second feature, or is merely representative of fisrt feature level height and is less than second feature.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiments or example.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is not considered as limiting the invention, those skilled in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (15)
1. a kind of control method of bathroom mirror, which is characterized in that include the following steps：
Obtain the face image of user；
The face image is identified, to judge that the face of the user whether there is acne；
If the face of the user there are acne, obtains the acne information in the face image；And
User is accordingly recommended by the bathroom mirror according to the acne information.
2. the control method of bathroom mirror as described in claim 1, which is characterized in that wherein,
The face image is identified according to preset acne image recognition model and corresponding recognizer, to judge
The face for stating user whether there is acne.
3. the control method of bathroom mirror as claimed in claim 2, which is characterized in that the face image for obtaining the user it
Before, further include：
Connection Service device, and the preset acne image recognition model and corresponding recognizer are detected by the server
Whether update is had；
If the preset acne image recognition model and corresponding recognizer have update, downloaded by the server
Newest acne image recognition model and corresponding recognizer, with to the preset acne image recognition model and corresponding
Recognizer is updated.
4. the control method of bathroom mirror as described in claim 1, which is characterized in that if there are powder for the face of the user
It pierces, then further includes：
Mark the position of the acne in the face image, and after providing label to the user by the bathroom mirror
Face image.
5. the control method of bathroom mirror as described in claim 1, which is characterized in that described to pass through institute according to the acne information
It states bathroom mirror accordingly to recommend user, specifically include：
Method and the link of relevant article of acne are removed according to the acne acquisition of information；
Method and the link of relevant article of the removal acne are provided by the bathroom mirror to the user.
6. the control method of bathroom mirror as described in claim 1, which is characterized in that further include：
If the face of the user does not have acne, corresponding voice prompt is reported.
7. the control method of bathroom mirror as described in claim 1, which is characterized in that further include：
Facial feature information is extracted from the face image；
According to facial skin health status reference information in the facial feature information and database to user's facial skin
Health status assessed, and generate corresponding assessment result；And
By the bathroom mirror assessment result is provided to the user.
8. a kind of control device of bathroom mirror, which is characterized in that including：
First acquisition module, first acquisition module are used to obtain the face image of user；
Identification module, the identification module are connected with first acquisition module, and the identification module is used to scheme the face
As being identified, to judge that the face of the user whether there is acne；
Second acquisition module, second acquisition module are connected with the identification module, and second acquisition module is for working as institute
Stating the face of user, there are acne information when acne, obtained in the face image；And
Recommending module, the recommending module are connected with second acquisition module, and the recommending module is used for according to the acne
Information accordingly recommends user by the bathroom mirror.
9. the control device of bathroom mirror as claimed in claim 8, which is characterized in that wherein,
The identification module carries out the face image according to preset acne image recognition model and corresponding recognizer
Identification, to judge that the face of the user whether there is acne.
10. the control device of bathroom mirror as claimed in claim 9, which is characterized in that first acquisition module is additionally operable to：
Before the face image for obtaining the user, Connection Service device, and the preset powder is detected by the server
Whether thorn image recognition model and corresponding recognizer have update；
If the preset acne image recognition model and corresponding recognizer have update, downloaded by the server
Newest acne image recognition model and corresponding recognizer, with to the preset acne image recognition model and corresponding
Recognizer is updated.
11. the control device of bathroom mirror as claimed in claim 8, which is characterized in that second acquisition module is additionally operable to：
When the face of the user is there are when acne, the position of the acne is marked in the face image, and pass through institute
State the face image after bathroom mirror provides label to the user.
12. the control device of bathroom mirror as claimed in claim 8, which is characterized in that the recommending module is specifically used for：
Method and the link of relevant article of acne are removed according to the acne acquisition of information；
Method and the link of relevant article of the removal acne are provided by the bathroom mirror to the user.
13. the control device of bathroom mirror as claimed in claim 8, which is characterized in that second acquisition module is additionally operable to：
When the face of the user does not have acne, corresponding voice prompt is reported.
14. the control device of bathroom mirror as claimed in claim 8, which is characterized in that further include：
Extraction module, the extraction module are connected with first acquisition module, and the extraction module is used to scheme from the face
Facial feature information is extracted as in；
Evaluation module, the evaluation module are connected with the extraction module, and the evaluation module is used for according to the face feature
Facial skin health status reference information assesses the health status of user's facial skin in information and database, and
Generate corresponding assessment result；And
Module is provided, the offers module is connected with the evaluation module, the offer module for pass through the bathroom mirror to
The user provides the assessment result.
15. a kind of bathroom mirror, which is characterized in that include the control dress of the bathroom mirror as described in any one of claim 8-14
It sets.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710170010.3A CN108629236A (en) | 2017-03-21 | 2017-03-21 | Control method, device and the bathroom mirror of bathroom mirror |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710170010.3A CN108629236A (en) | 2017-03-21 | 2017-03-21 | Control method, device and the bathroom mirror of bathroom mirror |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108629236A true CN108629236A (en) | 2018-10-09 |
Family
ID=63687879
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710170010.3A Pending CN108629236A (en) | 2017-03-21 | 2017-03-21 | Control method, device and the bathroom mirror of bathroom mirror |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108629236A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07289524A (en) * | 1994-04-27 | 1995-11-07 | Pola Chem Ind Inc | Device for skin evaluation and method therefor |
| CN1750773A (en) * | 2003-01-07 | 2006-03-22 | 荷兰联合利华有限公司 | Article and method for selection of individualized personal care products |
| CN1781448A (en) * | 1999-06-14 | 2006-06-07 | 宝洁公司 | Skin imaging and analysis system and method |
| TW201247168A (en) * | 2011-05-30 | 2012-12-01 | Univ Southern Taiwan | Smart video skin test system and method of the same |
| CN103324952A (en) * | 2013-05-27 | 2013-09-25 | 北京工业大学 | Method for acne classification based on characteristic extraction |
| CN105231999A (en) * | 2015-10-26 | 2016-01-13 | 四川省人民医院 | Prediction device and prediction method for skin lesions of acne inflammation |
| CN105455522A (en) * | 2015-11-30 | 2016-04-06 | 深圳市欧蒙设计有限公司 | Intelligent cosmetic mirror |
| CN105574484A (en) * | 2014-11-04 | 2016-05-11 | 三星电子株式会社 | Electronic device, and method for analyzing face information in electronic device |
| CN105640492A (en) * | 2014-11-28 | 2016-06-08 | 松下知识产权经营株式会社 | Wrinkle care support device and method for supporting wrinkle care |
| CN106469302A (en) * | 2016-09-07 | 2017-03-01 | 成都知识视觉科技有限公司 | A kind of face skin quality detection method based on artificial neural network |
-
2017
- 2017-03-21 CN CN201710170010.3A patent/CN108629236A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07289524A (en) * | 1994-04-27 | 1995-11-07 | Pola Chem Ind Inc | Device for skin evaluation and method therefor |
| CN1781448A (en) * | 1999-06-14 | 2006-06-07 | 宝洁公司 | Skin imaging and analysis system and method |
| CN1750773A (en) * | 2003-01-07 | 2006-03-22 | 荷兰联合利华有限公司 | Article and method for selection of individualized personal care products |
| TW201247168A (en) * | 2011-05-30 | 2012-12-01 | Univ Southern Taiwan | Smart video skin test system and method of the same |
| CN103324952A (en) * | 2013-05-27 | 2013-09-25 | 北京工业大学 | Method for acne classification based on characteristic extraction |
| CN105574484A (en) * | 2014-11-04 | 2016-05-11 | 三星电子株式会社 | Electronic device, and method for analyzing face information in electronic device |
| CN105640492A (en) * | 2014-11-28 | 2016-06-08 | 松下知识产权经营株式会社 | Wrinkle care support device and method for supporting wrinkle care |
| CN105231999A (en) * | 2015-10-26 | 2016-01-13 | 四川省人民医院 | Prediction device and prediction method for skin lesions of acne inflammation |
| CN105455522A (en) * | 2015-11-30 | 2016-04-06 | 深圳市欧蒙设计有限公司 | Intelligent cosmetic mirror |
| CN106469302A (en) * | 2016-09-07 | 2017-03-01 | 成都知识视觉科技有限公司 | A kind of face skin quality detection method based on artificial neural network |
Non-Patent Citations (1)
| Title |
|---|
| FAZLY SALLEH ABAS 等: "Acne image analysis: lesion localization and classification" * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2919142B1 (en) | Electronic apparatus and method for providing health status information | |
| US10304105B2 (en) | Shopping guide robot system and customer identification notification method of shopping guide robot | |
| KR102420100B1 (en) | Electronic apparatus for providing health status information, method for controlling the same, and computer-readable storage medium | |
| CN108758996B (en) | Air conditioner, control method and device thereof and readable storage medium | |
| JP2017211970A (en) | Care information acquisition method, care information sharing method, and electronic device for those methods | |
| CN205003739U (en) | Health monitoring of community platform based on intelligence bracelet | |
| CN107392124A (en) | Emotion identification method, apparatus, terminal and storage medium | |
| US20140275948A1 (en) | Information terminal device | |
| CN103456032B (en) | A kind of method and apparatus processing virtual fitting model image | |
| CN105407799A (en) | Skin analysis method, skin analysis device, and method for controlling skin analysis device | |
| CN104298983A (en) | Tongue fur image acquisition and analysis system with distributed user terminals | |
| KR20170049873A (en) | Method and apparatus of guest room management | |
| WO2022242139A1 (en) | Method and apparatus for controlling air conditioner, and air conditioner | |
| JP2018163644A (en) | Bed exit monitoring system | |
| CN105656679A (en) | Control method and control device of smart home equipment and smart home equipment | |
| CN111240220B (en) | Equipment control method and device | |
| CN106288132A (en) | The control method of air-conditioner and device | |
| Li et al. | Understanding the impact of building thermal environments on occupants' comfort and mental workload demand through human physiological sensing | |
| CN105955451A (en) | Travel prompt method based on user image | |
| CN109213311A (en) | Purifying drinking appliance and its control method and control device | |
| CN108629236A (en) | Control method, device and the bathroom mirror of bathroom mirror | |
| CN107311002A (en) | A kind of elevator | |
| CN106388441A (en) | Method and device for displaying, and intelligent mirror | |
| CN108844288A (en) | A kind of refrigerator electronic screen and awakening method | |
| CN207164764U (en) | The control device and bathroom mirror of bathroom mirror |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |