CN107340857A - Automatic screenshot method, controller, Intelligent mirror and computer-readable recording medium - Google Patents
Automatic screenshot method, controller, Intelligent mirror and computer-readable recording medium Download PDFInfo
- Publication number
- CN107340857A CN107340857A CN201710440183.2A CN201710440183A CN107340857A CN 107340857 A CN107340857 A CN 107340857A CN 201710440183 A CN201710440183 A CN 201710440183A CN 107340857 A CN107340857 A CN 107340857A
- Authority
- CN
- China
- Prior art keywords
- active user
- mirror
- intelligent mirror
- image
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention discloses a kind of automatic screenshot method, for Intelligent mirror.Intelligent mirror includes camera and display mirror.Automatic screenshot method includes：Control the multiple image of camera shooting active user；Multiple image is handled to judge whether the eye opening time of active user is more than preset time；The display content of Intelligent mirror interception display mirror is controlled when the eye opening time of active user being more than preset time to obtain sectional drawing picture.The invention also discloses a kind of controller, Intelligent mirror and computer-readable recording medium.Automatic screenshot method, controller, Intelligent mirror and the computer-readable recording medium of embodiment of the present invention are by judging that the time of opening eyes of user carries out the automatic sectional drawing of the display content of display mirror, without the manual touch control operation of user, facilitate user to vacate both hands when using Intelligent mirror and carry out other operations, lift the usage experience of user.
Description
Technical field
The present invention relates to smart home field, more particularly to a kind of automatic screenshot method, controller, Intelligent mirror and calculating
Machine readable storage medium storing program for executing.
Background technology
Existing smart mirror lacks automatic sectional drawing function.User needs manual push button to be cut when using smart mirror
Figure, Consumer's Experience are poor.
The content of the invention
It is contemplated that at least solves one of technical problem present in prior art.Therefore, the present invention provides one kind certainly
Dynamic screenshot method, controller, Intelligent mirror and computer-readable recording medium.
The automatic screenshot method of embodiment of the present invention, for Intelligent mirror.The Intelligent mirror includes camera and shown
Show minute surface, the automatic screenshot method comprises the following steps：
Control the multiple image of the camera shooting active user；
The multiple image is handled to judge whether the eye opening time of the active user is more than preset time；With
Control the Intelligent mirror interception described aobvious when the eye opening time of the active user being more than the preset time
Show the display content of minute surface to obtain sectional drawing picture.
In some embodiments, it is described to handle the multiple image whether to judge the eye opening time of the active user
The step of more than preset time, includes following sub-step：
The multiple image is handled to extract the multiframe ocular image of active user described in each frame described image；
Handle the multiframe ocular image with calculate in ocular image described in each frame upper eyelid and palpebra inferior it
Between distance to obtain multiple interval widths；
Calculate the number of the interval width more than predetermined interval width；With
Determine that the eye opening time of the active user is more than the preset time when the number is more than predetermined number.
In some embodiments, the preset time is more than or equal to 5 seconds.
In some embodiments, the display content of the display mirror uses the smart mirror including the active user
The interaction results that the interactive function of son obtains.
In some embodiments, the interactive function of the Intelligent mirror includes sprouting face processing, the processing of U.S. face, virtual examination
Adornment, 2D masks render, 3D cartoon characters render, virtual glasses render and/or virtual hair style renders.
The controller of embodiment of the present invention, for Intelligent mirror, the Intelligent mirror includes camera and display mirror,
The controller includes filming apparatus, judgment means and sectional drawing device.The filming apparatus is used to control the camera to shoot
The multiple image of active user；When the judgment means are used to handle the multiple image to judge the eye opening of the active user
Between whether be more than preset time；The sectional drawing device is used for when the eye opening time of the active user being more than the preset time
The Intelligent mirror is controlled to intercept the display content of the display mirror to obtain sectional drawing picture.
The Intelligent mirror of embodiment of the present invention includes camera, display mirror and above-mentioned controller.The controller
Electrically connected with the camera and the display mirror.
In some embodiments, the judgment means include：
First processing units, for handling the multiple image to extract the more of active user described in each frame described image
Frame ocular image；
Second processing unit, for handling the multiframe ocular image to calculate in ocular image described in each frame
The distance between upper eyelid and palpebra inferior are to obtain multiple interval widths；
Computing unit, for calculating the number of the interval width more than predetermined interval width；With
Determining unit, for determining that the eye opening time of the active user is more than institute when the number is more than predetermined number
State preset time.
In some embodiments, the preset time is more than or equal to 5 seconds.
In some embodiments, the display content of the display mirror uses the smart mirror including the active user
The interaction results that the interactive function of son obtains.
In some embodiments, the interactive function of the Intelligent mirror includes sprouting face processing, the processing of U.S. face, virtual examination
Adornment, 2D masks render, 3D cartoon characters render, virtual glasses render and/or virtual hair style renders.
The Intelligent mirror of embodiment of the present invention includes camera, display mirror and above-mentioned controller, the controller
Electrically connected with the camera and the display mirror.
The Intelligent mirror of embodiment of the present invention include camera, display mirror, one or more processors, memory and
One or more programs, wherein one or more of programs are stored in the memory, and it is configured to by described
One or more processors perform, and described program includes being used for the instruction for performing following steps：
Control the multiple image of the camera shooting active user；
The multiple image is handled to judge whether the eye opening time of the active user is more than preset time；With
Control the Intelligent mirror interception described aobvious when the eye opening time of the active user being more than the preset time
Show the display content of minute surface to obtain sectional drawing picture.
In some embodiments, described program also includes being used for the instruction for performing following steps：
The multiple image is handled to extract the multiframe ocular image of active user described in each frame described image；
Handle the multiframe ocular image with calculate in ocular image described in each frame upper eyelid and palpebra inferior it
Between distance to obtain multiple interval widths；
Calculate the number of the interval width more than predetermined interval width；With
Determine that the eye opening time of the active user is more than the preset time when the number is more than predetermined number.
In some embodiments, the preset time is more than or equal to 5 seconds.
In some embodiments, the display content of the display mirror uses the smart mirror including the active user
The interaction results that the interactive function of son obtains.
In some embodiments, the interactive function of the Intelligent mirror includes sprouting face processing, the processing of U.S. face, virtual examination
Adornment, 2D masks render, 3D cartoon characters render, virtual glasses render and/or virtual hair style renders.
The computer-readable recording medium of embodiment of the present invention, including combined with being capable of the electronic installation of display picture and make
Computer program, the computer program can be executed by processor to complete above-mentioned automatic screenshot method.
Automatic screenshot method, controller, Intelligent mirror and the computer-readable recording medium of embodiment of the present invention pass through
Judge that the time of opening eyes of user carries out the automatic sectional drawing of the display content of display mirror, it is convenient without the manual touch control operation of user
User can vacate both hands when using Intelligent mirror and carry out other operations, lift the usage experience of user.
The additional aspect and advantage of the present invention will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention is from combining in description of the accompanying drawings below to embodiment by change
Obtain substantially and be readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet of the automatic screenshot method of some embodiments of the present invention.
Fig. 2 is the module diagram of the Intelligent mirror of some embodiments of the present invention.
Fig. 3 is the floor map of the Intelligent mirror of some embodiments of the present invention.
Fig. 4 is the module diagram of the Intelligent mirror of some embodiments of the present invention.
Fig. 5 is the schematic flow sheet of the automatic screenshot method of some embodiments of the present invention.
Fig. 6 is the module diagram of the judgment means of some embodiments of the present invention.
Fig. 7 is the view of the automatic screenshot method of some embodiments of the present invention.
Fig. 8 is the view of the automatic screenshot method of some embodiments of the present invention.
Fig. 9 is the view of the automatic screenshot method of some embodiments of the present invention.
Figure 10 is the view of the automatic screenshot method of some embodiments of the present invention.
Figure 11 is the view of the automatic screenshot method of some embodiments of the present invention.
Figure 12 is the view of the automatic screenshot method of some embodiments of the present invention.
Figure 13 is the view of the automatic screenshot method of some embodiments of the present invention.
Embodiment
Embodiments of the present invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning
Same or similar element is represented to same or similar label eventually or there is the element of same or like function.Below by ginseng
The embodiment for examining accompanying drawing description is exemplary, is only used for explaining the present invention, and is not considered as limiting the invention.
Also referring to Fig. 1 to 3, the automatic screenshot method of embodiment of the present invention is used for Intelligent mirror 100.Intelligent mirror
100 include camera 20 and display mirror 30.Automatic screenshot method comprises the following steps：
S11：Camera 20 is controlled to shoot the multiple image of active user；
S12：Multiple image is handled to judge whether the eye opening time of active user is more than preset time；With
S13：Intelligent mirror 100 is controlled to intercept display mirror 30 when the eye opening time of active user being more than preset time
Display content is to obtain sectional drawing picture.
The automatic screenshot method of embodiment of the present invention can be realized by the controller 10 of embodiment of the present invention.The present invention
The controller 10 of embodiment is used for Intelligent mirror 100.Controller 10 includes filming apparatus 11, judgment means 12 and sectional drawing device
13.Step S11 can be realized that step S12 can be realized that step S13 can be by sectional drawing by judgment means 12 by filming apparatus 11
Device 13 is realized.
In other words, filming apparatus 11 is used for the multiple image for controlling camera 20 to shoot active user.Judgment means 12
For handling the multiple image to judge whether the eye opening time of the active user is more than preset time.Sectional drawing device 13 is used
The Intelligent mirror 100 is controlled to intercept the display mirror when preset time is more than in the eye opening time of the active user
The display content in face 30 is to obtain sectional drawing picture.
The controller 10 of embodiment of the present invention can apply to the Intelligent mirror 100 of embodiment of the present invention.It that is to say
Say, the Intelligent mirror 100 of embodiment of the present invention includes the controller 10 of embodiment of the present invention.Certainly, embodiment party of the present invention
The Intelligent mirror 100 of formula also includes camera 20 and display mirror 30.Wherein, controller 10 and camera 20 and display mirror 30
Electrically connect.
Referring to Fig. 4, the Intelligent mirror 100 of embodiment of the present invention includes camera 20, display mirror 30, one or more
Individual processor 40, memory 50 and one or more programs 51.Wherein, one or more programs 51 are stored in memory 50
In, and be configured to be performed by one or more processors 40.Program 51 includes being used for the instruction for performing following steps：
S11：Camera 20 is controlled to shoot the multiple image of active user；
S12：Multiple image is handled to judge whether the eye opening time of active user is more than preset time；With
S13：Intelligent mirror 100 is controlled to intercept display mirror 30 when the eye opening time of active user being more than preset time
Display content is to obtain sectional drawing picture.
It is appreciated that existing many Intelligent mirrors 100 do not possess automatic sectional drawing function.User is generally required to carry out manually
Touch-control could realize sectional drawing.If in this way, want that one must just be vacateed by carrying out sectional drawing to the display picture in mirror when user looks in the mirror
Hand is operated, and Consumer's Experience is poor.
When the automatic screenshot method of embodiment of the present invention is by judging whether the eye opening time of active user is more than default
Between, the sectional drawing function of triggering Intelligent mirror 100 when the eye opening time of active user being more than preset time.In this way, current use
Family can vacate both hands to do other operations, such as, pose.In addition, active user need not touch Intelligent mirror 100 i.e.
Sectional drawing can be achieved, therefore the distance between active user and Intelligent mirror 100 are not limited too much, active user may stand in
The position nearer from Intelligent mirror 100 with shown in Intelligent mirror 100 half body shine, can also stand from Intelligent mirror 100 compared with
Remote position with shown in Intelligent mirror 100 whole body shine.In this way, user can be truncated to further types of picture, lifting is used
The usage experience at family.
Referring to Fig. 5, in some embodiments, when step S12 handles multiple image to judge the eye opening of active user
Between the step of whether being more than preset time include following sub-step：
S121：Multiple image is handled to extract the multiframe ocular image of active user in each two field picture；
S122：Multiframe ocular image is handled to calculate in each frame ocular image between upper eyelid and palpebra inferior
Distance is to obtain multiple interval widths；
S123：Calculate the number of the interval width more than predetermined interval width；With
S124：Determine that the eye opening time of active user is more than preset time when number is more than predetermined number.
Referring to Fig. 6, in some embodiments, judgment means 12 include first processing units 121, second processing unit
122nd, computing unit 123 and determining unit 124.Step S121 can realize by first processing units 121, and step S122 can be by
Second processing unit 122 realizes that step S123 can be realized by computing unit 123, and step S124 can be real by determining unit 124
It is existing.
In other words, first processing units 121 are used to handle multiple image to extract the more of active user in each two field picture
Frame ocular image；Second processing unit 122 is used to handle multiframe ocular image to calculate each frame ocular image
The distance between middle upper eyelid and palpebra inferior are to obtain multiple interval widths；Computing unit 123, which is used to calculate, is more than predetermined interval
The number of the interval width of width；When determining unit 124 is used to determine the eye opening of active user when number is more than predetermined number
Between be more than preset time.
In some embodiments, program 51 includes being used for the instruction for performing following steps：
S121：Multiple image is handled to extract the multiframe ocular image of active user in each two field picture；
S122：Multiframe ocular image is handled to calculate in each frame ocular image between upper eyelid and palpebra inferior
Distance is to obtain multiple interval widths；
S123：Calculate the number of the interval width more than predetermined interval width；With
S124：Determine that the eye opening time of active user is more than preset time when number is more than predetermined number.
During active user opens eyes, camera 20 can be continuously shot user and obtain multiple image.First processing is single
Member 121 determines the ocular image in each two field picture by handling each two field picture.First, first processing units 121
Human face region image is determined using region-growing method first.Specifically, it is each two field picture progress region segmentation is multiple to obtain
Subregion, a pixel in choosing per sub-regions is as central pixel point, then calculates each pixel in regional
The pixel value of point and the pixel value of corresponding central pixel point difference absolute value, then by pixel value and central pixel point
The absolute value of the difference of pixel value is human face region less than pixel merger corresponding to predetermined threshold value.Afterwards, merger is obtained
Human face region is corroded and expansion process is to remove noise, so as to obtain final human face region image.Then, second processing
Unit 122 is using the method for template matches to be handled human face region image to obtain the position of human eye, so as to obtain eye
Portion's area image.Specifically, Gray Projection method can be used to carry out the projection on both horizontally and vertically, root to human face region image
The position of eyes is positioned according to the distributed intelligence of the Wave crest and wave trough of gray value after Gray Projection.After ocular image is obtained,
Second processing unit 122 goes out position and the size of pupil and iris by handling ocular framing, recycles CANNY to calculate
Son carries out the edge extracting of ocular image to obtain the profile diagram of eye.Upper eyelid can be calculated according to eye profile diagram
The size of interval width between palpebra inferior.
The eye opening time of active user, which requires more than preset time, could trigger the sectional drawing function of Intelligent mirror 100.Some
In embodiment, preset time is more than or equal to 5 seconds.In other words, the value of preset time can be 5s, 6.5s, 8s, 10s etc.
Value.It is appreciated that normal person typically can blink once eye at interval of 3s~5s, it is to prevent active user in normal use Intelligent mirror
The problem of sectional drawing function is to cause frequent sectional drawing will not be triggered when 100, the value of preset time is set to more than or equal to 5s.Such as
This, active user triggers sectional drawing function by extending the eye opening time of oneself.Camera 20 persistently claps active user to obtain
Multiple image, multiple image can obtain the value of a series of interval width after treatment.Computing unit 123 is needed according to above-mentioned
A series of interval width statistics are more than the number of the interval width of predetermined interval width, so as to judge to work as according to the number counted on
Whether the eye opening time of preceding user is more than preset time.Wherein, interval width shows current frame image more than predetermined interval width
In human eye be in eyes-open state, show that the human eye in current frame image is in closed-eye state less than predetermined interval width.It is if individual
Number is more than predetermined number, and the number of image frames that interval width is more than predetermined interval width is more than predetermined number, that is, thinks opening for user
Exceed preset time between at the moment, then the sectional drawing function of Intelligent mirror 100 can be triggered.
It should be noted that because the eyes size of different people differs, therefore the value of predetermined interval width is not only
One.Predetermined interval width can be obtained by the calculating for the interval width for carrying out substantial amounts of human eye early stage.And computing unit 123
In number of the statistics more than the interval width of predetermined interval width, one first can be chosen according to the value of the interval width of multiple image
Individual suitable predetermined interval width value carries out follow-up comparison again, so as to the degree of accuracy of the judgement for the time that ensures to open eyes.
In some embodiments, the display content of display mirror 30 includes the friendship that active user uses Intelligent mirror 100
The getable interaction results of mutual work(.
Wherein, the interactive function of Intelligent mirror 100 include sprouting face processing, the processing of U.S. face, virtually try adornment, 2D masks render,
3D cartoon characters render, virtual glasses render and/or virtual hair style renders.In other words, the interactive function of Intelligent mirror 100 can
With only include sprout face processing, U.S. face processing, virtually try adornment, 2D masks render, 3D cartoon characters render, virtual glasses render or
Virtual hair style renders.Or interactive function can include sprouting simultaneously face processing, the processing of U.S. face, virtually try adornment, 2D masks render,
3D cartoon characters are rendered, virtual glasses are rendered and rendered with virtual hair style.Or interactive function can include sprouting face processing, U.S. simultaneously
Face processing, virtually try adornment, 2D masks render, 3D cartoon characters render, virtual glasses render it is several in being rendered with virtual hair style.
Specifically, refer on the human face region of active user referring to Fig. 7, sprouting face processing, obtained according to detection
Human face characteristic point (such as nose, eyes, face, ear, hair) carries out the superposition of ornament effect.For example, it is superimposed in face
The virtual decorations such as lovely expression, head superposition hair fastener, head superposition animal ear, nose shape superposition animal nose, cheek
Position superposition Animal Whisker etc..The face processing function of sprouting of Intelligent mirror 100 sprouts face material including a variety of, and active user can voluntarily select
Surely sprout face material and be superimposed to face and sprout face image to obtain.Sprout face image to be shown in display mirror 30, if active user wants to cut
Figure preservation can exceed preset time to trigger sectional drawing function by opening eyes.
Referring to Fig. 8, U.S. face processing refers to that carrying out whitening, ruddy, thin face and big eye to the face of active user stares at place
Reason.The U.S. face image after U.S. face can be seen by clicking specific U.S. face function in active user in display mirror 30.Currently
User carries out the sectional drawing of U.S. face image by the action triggers sectional drawing function of opening eyes more than preheating setting time.
Referring to Fig. 9, virtually examination adornment refers to carrying out makeups processing to the face of active user.The dressing material package of makeups
Include eyes material, informer's material, rouge material, lip gloss material and eyebrow material etc..Active user is by clicking specific dressing
Material, you can the virtual examination adornment image after corresponding trial assembly is seen in display mirror 30.Active user is exceeded in advance by opening eyes
If the action triggers sectional drawing function of time carries out the sectional drawing of virtual examination adornment image.
Referring to Fig. 10,2D masks, which render, refers to that virtual mask is put on by the face for active user.2D masks render
Interactive function in include a variety of 2D masks materials, such as classical white mask, type of facial makeup in Beijing opera, the animal types of facial makeup in Beijing operas, cartoon character face
Spectrum etc..When user clicks specific 2D masks material, the 2D masks after the display processing of display mirror 30 render image.In this way,
User can put on the effect after mask with direct feel oneself.Active user is cut by the action triggers opened eyes more than preset time
Figure function carries out the sectional drawing that 2D masks render image.
Refer to Figure 11, it is to shoot active user by camera 20 to obtain the dynamic of active user that 3D cartoon characters, which render,
Make, and control action (such as action of the angle of head deflection, face etc.) of the 3D cartoon characters to active user to imitate
Follow.The interactive function that 3D cartoon characters render includes a variety of 3D cartoon characters, as Sponge Bob, DINGDANG CAT, Kung Fu Panda,
Winnie the Pooh etc..It is the 3D that can be shown and click after active user clicks specific 3D cartoon characters material, in display mirror 30
3D cartoon characters render image corresponding to cartoon character material.For example, the 3D cartoons element of active user's selection shown in Figure 11
Material is DINGDANG CAT, and active user does the action for magnifying eyes and the laugh that is open, and DINGDANG CAT is carried out magnifying eyes and is open big simultaneously
The action laughed at, realize that imitation follows in real time.If active user's want to save 3D cartoon characters render image, you can are exceeded by opening eyes
The action triggers sectional drawing device 13 of preset time carries out sectional drawing.
Figure 12 is referred to, virtual glasses, which render, to be referred to putting on virtual glasses for active user, and virtual glasses, which can follow, works as
The action on the head of preceding user and act.The interactive function that virtual glasses render includes the virtual of a variety of different colours and moulding
Glasses material.Active user clicks specific virtual glasses material, and display mirror 30 can show that active user puts on virtually
Virtual glasses after glasses render image.If the virtual glasses of active user's want to save render image, you can are exceeded in advance by opening eyes
If the action triggers sectional drawing device 13 of time carries out sectional drawing.
Figure 13 is referred to, virtual hair style, which renders, to be referred to putting on virtual hair style for active user, and virtual hair style can follow
The action on the head of active user and act.The interactive function that virtual hair style renders includes the void of a variety of different shapings and color
Send out type material.Active user clicks specific virtual hair style material, and display mirror 30 can show that active user puts on hair
Virtual hair style after type glasses renders image.If active user's want to save virtual hair style renders image, you can is exceeded by opening eyes
The action triggers sectional drawing device 13 of preset time carries out sectional drawing.
In this way, Intelligent mirror 100 provides the user a variety of interactive functions, the interest between user and Intelligent mirror 100 is realized
Taste is interactive, lifts interesting, the intelligent and practicality of Intelligent mirror 100, while also improves the usage experience of user.And use
Family can trigger sectional drawing device 13 by the action opened eyes more than preset time and the interaction results of the output of Intelligent mirror 100 cut
Figure, the shot operation of user is greatly facilitated, further meet the use demand of user user.
The computer-readable recording medium of embodiment of the present invention, including combined with being capable of the electronic installation of display picture and make
Computer program.Computer program can be executed by processor to complete the automatic screenshot method of any of the above-described embodiment.
For example, computer program can be executed by processor to complete following steps：
S11：Camera 20 is controlled to shoot the multiple image of active user；
S12：Multiple image is handled to judge whether the eye opening time of active user is more than preset time；With
S13：Intelligent mirror 100 is controlled to intercept display mirror 30 when the eye opening time of active user being more than preset time
Display content is to obtain sectional drawing picture.
Computer program can be also executed by processor to complete following steps：
S121：Multiple image is handled to extract the multiframe ocular image of active user in each two field picture；
S122：Multiframe ocular image is handled to calculate in each frame ocular image between upper eyelid and palpebra inferior
Distance is to obtain multiple interval widths；
S123：Calculate the number of the interval width more than predetermined interval width；With
S124：Determine that the eye opening time of active user is more than preset time when number is more than predetermined number.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three
It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize specific logical function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, have suitable combinational logic gate circuit application specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above
Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention
Type.
Claims (17)
1. a kind of automatic screenshot method, for Intelligent mirror, it is characterised in that the Intelligent mirror includes camera and display mirror
Face, the automatic screenshot method comprise the following steps：
Control the multiple image of the camera shooting active user；
The multiple image is handled to judge whether the eye opening time of the active user is more than preset time；With
The Intelligent mirror is controlled to intercept the display mirror when the eye opening time of the active user being more than the preset time
The display content in face is to obtain sectional drawing picture.
2. automatic screenshot method according to claim 1, it is characterised in that the processing multiple image is to judge
Stating the step of whether being more than preset time eye opening time of active user includes following sub-step：
The multiple image is handled to extract the multiframe ocular image of active user described in each frame described image；
The multiframe ocular image is handled to calculate in ocular image described in each frame between upper eyelid and palpebra inferior
Distance is to obtain multiple interval widths；
Calculate the number of the interval width more than predetermined interval width；With
Determine that the eye opening time of the active user is more than the preset time when the number is more than predetermined number.
3. automatic screenshot method according to claim 2, it is characterised in that the preset time is more than or equal to 5 seconds.
4. automatic screenshot method according to claim 1, it is characterised in that the display content of the display mirror includes institute
State the interaction results that active user is obtained using the interactive function of the Intelligent mirror.
5. automatic screenshot method according to claim 4, it is characterised in that the interactive function of the Intelligent mirror includes sprouting
Face processing, U.S. face handle, virtually try adornment, 2D masks render, 3D cartoon characters render, virtual glasses render and/or virtual hair style
Render.
6. a kind of controller, for Intelligent mirror, it is characterised in that the Intelligent mirror includes camera and display mirror, institute
Stating controller includes：
Filming apparatus, for controlling the multiple image of the camera shooting active user；
Judgment means, during for handling the multiple image to judge whether the eye opening time of the active user is more than default
Between；With
Sectional drawing device, for controlling the Intelligent mirror to cut when the eye opening time of the active user being more than the preset time
The display content of the display mirror is taken to obtain sectional drawing picture.
7. the controller according to claim 6, it is characterised in that the judgment means include：
First processing units, for handling the multiple image to extract the multiframe eye of active user described in each frame described image
Portion's area image；
Second processing unit, eye is gone up in ocular image described in each frame to calculate for handling the multiframe ocular image
The distance between eyelid and palpebra inferior are to obtain multiple interval widths；
Computing unit, for calculating the number of the interval width more than predetermined interval width；With
Determining unit, the eye opening time for determining the active user when the number is more than predetermined number are more than described pre-
If the time.
8. the controller according to claim 7, it is characterised in that the preset time is more than or equal to 5 seconds.
9. the controller according to claim 6, it is characterised in that the display content of the display mirror includes described current
The interaction results that user is obtained using the interactive function of the Intelligent mirror.
10. the controller according to claim 9, it is characterised in that the interactive function of the Intelligent mirror includes sprouting at face
Reason, U.S. face handle, virtually try adornment, 2D masks render, 3D cartoon characters render, virtual glasses render and/or virtual hair style renders.
11. a kind of Intelligent mirror, it is characterised in that the Intelligent mirror includes：
Camera；
Display mirror；With
Controller described in claim 6 to 10 any one, the controller and the camera and the display mirror are equal
Electrical connection.
12. a kind of Intelligent mirror, it is characterised in that the Intelligent mirror includes：
Camera；
Display mirror；
One or more processors；
Memory；With
One or more programs, wherein one or more of programs are stored in the memory, and be configured to by
One or more of computing devices, described program include being used for the instruction for performing following steps：
Control the multiple image of the camera shooting active user；
The multiple image is handled to judge whether the eye opening time of the active user is more than preset time；With
The Intelligent mirror is controlled to intercept the display mirror when the eye opening time of the active user being more than the preset time
The display content in face is to obtain sectional drawing picture.
13. Intelligent mirror according to claim 12, it is characterised in that described program also includes being used to perform following steps
Instruction：
The multiple image is handled to extract the multiframe ocular image of active user described in each frame described image；
The multiframe ocular image is handled to calculate in ocular image described in each frame between upper eyelid and palpebra inferior
Distance is to obtain multiple interval widths；
Calculate the number of the interval width more than predetermined interval width；With
Determine that the eye opening time of the active user is more than the preset time when the number is more than predetermined number.
14. Intelligent mirror according to claim 13, it is characterised in that the preset time is more than or equal to 5 seconds.
15. the Intelligent mirror according to right will go 12, it is characterised in that the display content of the display mirror includes described
The interaction results that active user is obtained using the interactive function of the Intelligent mirror.
16. Intelligent mirror according to claim 12, it is characterised in that the interactive function of the Intelligent mirror includes sprouting face
Processing, U.S. face handle, virtually try adornment, 2D masks render, 3D cartoon characters render, virtual glasses render and/or virtual hair style wash with watercolours
Dye.
17. a kind of computer-readable recording medium, including the computer journey being used in combination with being capable of the electronic installation of display picture
Sequence, the computer program can be executed by processor to complete the automatic screenshot method described in claim 1 to 5 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710440183.2A CN107340857A (en) | 2017-06-12 | 2017-06-12 | Automatic screenshot method, controller, Intelligent mirror and computer-readable recording medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710440183.2A CN107340857A (en) | 2017-06-12 | 2017-06-12 | Automatic screenshot method, controller, Intelligent mirror and computer-readable recording medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107340857A true CN107340857A (en) | 2017-11-10 |
Family
ID=60220025
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710440183.2A Pending CN107340857A (en) | 2017-06-12 | 2017-06-12 | Automatic screenshot method, controller, Intelligent mirror and computer-readable recording medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107340857A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108040203A (en) * | 2017-11-30 | 2018-05-15 | 深圳云天励飞技术有限公司 | Operation displaying method, device, Intelligent mirror and computer-readable recording medium |
| CN111109959A (en) * | 2019-12-25 | 2020-05-08 | 珠海格力电器股份有限公司 | Intelligent cosmetic mirror, control method thereof, controller and storage medium |
| CN111698411A (en) * | 2019-03-12 | 2020-09-22 | 丽宝大数据股份有限公司 | Automatic face image detection and shooting method |
| CN116382468A (en) * | 2023-02-24 | 2023-07-04 | 江阴市宝虹电器有限公司 | Automatic triggering method, system and storage medium for interaction function of intelligent mirror |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657722A (en) * | 2015-03-10 | 2015-05-27 | 无锡桑尼安科技有限公司 | Eye parameter detection equipment |
| CN105892635A (en) * | 2015-11-18 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Image capture realization method and apparatus as well as electronic device |
| US20170053456A1 (en) * | 2015-08-19 | 2017-02-23 | Electronics And Telecommunications Research Institute | Method and apparatus for augmented-reality rendering on mirror display based on motion of augmented-reality target |
| CN106572304A (en) * | 2016-11-02 | 2017-04-19 | 西安电子科技大学 | Blink detection-based smart handset photographing system and method |
| CN106781282A (en) * | 2016-12-29 | 2017-05-31 | 天津中科智能识别产业技术研究院有限公司 | A kind of intelligent travelling crane driver fatigue early warning system |
| CN106773852A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Intelligent mirror and its operation control method, device |
-
2017
- 2017-06-12 CN CN201710440183.2A patent/CN107340857A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657722A (en) * | 2015-03-10 | 2015-05-27 | 无锡桑尼安科技有限公司 | Eye parameter detection equipment |
| US20170053456A1 (en) * | 2015-08-19 | 2017-02-23 | Electronics And Telecommunications Research Institute | Method and apparatus for augmented-reality rendering on mirror display based on motion of augmented-reality target |
| CN105892635A (en) * | 2015-11-18 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Image capture realization method and apparatus as well as electronic device |
| CN106572304A (en) * | 2016-11-02 | 2017-04-19 | 西安电子科技大学 | Blink detection-based smart handset photographing system and method |
| CN106773852A (en) * | 2016-12-19 | 2017-05-31 | 北京小米移动软件有限公司 | Intelligent mirror and its operation control method, device |
| CN106781282A (en) * | 2016-12-29 | 2017-05-31 | 天津中科智能识别产业技术研究院有限公司 | A kind of intelligent travelling crane driver fatigue early warning system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108040203A (en) * | 2017-11-30 | 2018-05-15 | 深圳云天励飞技术有限公司 | Operation displaying method, device, Intelligent mirror and computer-readable recording medium |
| CN108040203B (en) * | 2017-11-30 | 2020-06-16 | 深圳云天励飞技术有限公司 | Operation display method and device, intelligent mirror and computer readable storage medium |
| CN111698411A (en) * | 2019-03-12 | 2020-09-22 | 丽宝大数据股份有限公司 | Automatic face image detection and shooting method |
| CN111109959A (en) * | 2019-12-25 | 2020-05-08 | 珠海格力电器股份有限公司 | Intelligent cosmetic mirror, control method thereof, controller and storage medium |
| CN116382468A (en) * | 2023-02-24 | 2023-07-04 | 江阴市宝虹电器有限公司 | Automatic triggering method, system and storage medium for interaction function of intelligent mirror |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10413042B2 (en) | Makeup support device, makeup support method, and makeup support program | |
| CN104391567B (en) | A kind of 3D hologram dummy object display control method based on tracing of human eye | |
| CN107340857A (en) | Automatic screenshot method, controller, Intelligent mirror and computer-readable recording medium | |
| US11819108B2 (en) | Smart mirror system and methods of use thereof | |
| US20190130652A1 (en) | Control method, controller, smart mirror, and computer readable storage medium | |
| JP4789408B2 (en) | Eye form classification method, form classification map, and eye makeup method | |
| US20200082595A1 (en) | Image processing apparatus, image processing system, and image processing method as well as program | |
| AU739559B2 (en) | A method and a device for displaying at least part of the human body with a modified appearance thereof | |
| TWI773096B (en) | Makeup processing method and apparatus, electronic device and storage medium | |
| CA2692667C (en) | Method and apparatus for realistic simulation of wrinkle aging and de-aging | |
| JP4753025B2 (en) | Makeup simulation method | |
| US10796455B2 (en) | Image processing apparatus and image processing method | |
| CN109671142B (en) | Intelligent cosmetic method and intelligent cosmetic mirror | |
| CN110390632B (en) | Image processing method and device based on dressing template, storage medium and terminal | |
| CN107340856A (en) | Control method, controller, Intelligent mirror and computer-readable recording medium | |
| CN204576413U (en) | A kind of internet intelligent mirror based on natural user interface | |
| US8532354B2 (en) | Method for providing visual simulation of teeth whitening | |
| CN107705240A (en) | Virtual examination cosmetic method, device and electronic equipment | |
| WO2016118169A1 (en) | Rendering glasses shadows | |
| CN106293362A (en) | A kind of guiding cosmetic equipment | |
| US9965778B2 (en) | System and method for the indication of modification region boundaries on facial images | |
| Jones et al. | Makeup changes the apparent size of facial features. | |
| US20190254408A1 (en) | Information processing apparatus and information processing method, and program | |
| DE19635753A1 (en) | Virtual imaging device for selecting clothing from catalogue | |
| CN107450717A (en) | A kind of information processing method and Wearable |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171110 |
|
| RJ01 | Rejection of invention patent application after publication |