CN105592249B - The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification - Google Patents
The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification Download PDFInfo
- Publication number
- CN105592249B CN105592249B CN201510980347.1A CN201510980347A CN105592249B CN 105592249 B CN105592249 B CN 105592249B CN 201510980347 A CN201510980347 A CN 201510980347A CN 105592249 B CN105592249 B CN 105592249B
- Authority
- CN
- China
- Prior art keywords
- photo
- processed
- feature
- eyeprint
- personage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 210000000744 eyelid Anatomy 0.000 title claims abstract description 140
- 238000000034 method Methods 0.000 title claims abstract description 33
- 210000001508 eye Anatomy 0.000 claims abstract description 163
- 230000001815 facial effect Effects 0.000 claims abstract description 94
- 230000008439 repair process Effects 0.000 claims abstract description 21
- 238000001514 detection method Methods 0.000 claims abstract description 15
- 230000003321 amplification Effects 0.000 claims description 8
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 8
- 241001269238 Data Species 0.000 claims 2
- 238000004891 communication Methods 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 210000005252 bulbus oculi Anatomy 0.000 description 5
- 230000006837 decompression Effects 0.000 description 5
- 238000010295 mobile communication Methods 0.000 description 4
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000005611 electricity Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000009825 accumulation Methods 0.000 description 2
- 239000003990 capacitor Substances 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 230000005764 inhibitory process Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 241000256844 Apis mellifera Species 0.000 description 1
- 241001062009 Indigofera Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000005622 photoelectricity Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 230000002463 transducing effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- G06T5/77—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
Abstract
The invention discloses a kind of terminals for carrying out eyelid reconstruction to personage in photo based on eyeprint identification, comprising: detection module, the eyelid reconstruction for detecting photo to be processed instruct；Matching module, for identifying the character face's feature for existing in the photo to be processed and closing one's eyes, character face's feature being matched with preset facial characteristics when detecting eyelid reconstruction instruction；Repair module obtains the corresponding eyeprint feature of the preset facial characteristics, and carry out eyelid reconstruction to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature if matching for character face's feature with preset facial characteristics.Invention additionally discloses a kind of methods for carrying out eyelid reconstruction to personage in photo based on eyeprint identification.The present invention can carry out accurate eyelid reconstruction for eye closing personage different in photo to be processed, more efficiently can carry out eyelid reconstruction to photo to be processed.
Description
Technical field
The present invention relates to fields of communication technology, more particularly to a kind of identified based on eyeprint to repair to personage's progress eye in photo
Multiple terminal and method.
Background technique
Currently, taking pictures for intelligent terminal is a very important function, user is also increasingly dependent on intelligence
Terminal shoots the photo of optimum efficiency when various scenes are such as gone sightseeing.Inevitably, intelligent terminal is shot sometimes
The case where personage will appear eye closing in photo out, the photo that user can generally close one's eyes personage are deleted.When intelligent terminal is shot
Although photo personage out closes one's eyes, other effects are fine, such as when user goes sightseeing, to scenery and personage together into
Row shooting is closed one's eyes although finally taking personage in the photo come, and the shooting effect of scenery is very good, and user needs to retain
The photo then needs the eye to eye closing personage in photo to repair, however, in the prior art can not be to the people that closes one's eyes in photo
The eye of object is effectively repaired.
Summary of the invention
It is a primary object of the present invention to propose a kind of end for carrying out eyelid reconstruction to personage in photo based on eyeprint identification
End and method, it is intended to which the eye of eye closing personage in photo is effectively repaired.
To achieve the above object, a kind of identified based on eyeprint provided by the invention carries out eyelid reconstruction to personage in photo
Terminal, the terminal for carrying out eyelid reconstruction to personage in photo based on eyeprint identification include:
Detection module, the eyelid reconstruction for detecting photo to be processed instruct；
Matching module is closed one's eyes for identifying to exist in the photo to be processed when detecting eyelid reconstruction instruction
Character face's feature, character face's feature is matched with preset facial characteristics；
Repair module obtains the preset face if matching for character face's feature with preset facial characteristics
The corresponding eyeprint feature of feature, and eye is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature
It repairs.
Optionally, the detection module is also used to:
When the photo for receiving terminal user checks instruction, the time of single photo, which counts, is checked to terminal user
When；If terminal user checks that the time of single photo is more than preset time threshold, and detects in photo that terminal user checks
There are the personages of eye closing, then the photo checked terminal user is identified as detecting to photograph to be processed as photo to be processed
The eyelid reconstruction of piece instructs.
Optionally, the matching module is also used to:
When detecting eyelid reconstruction instruction, the face for the terminal user for checking the photo to be processed is known
Not, the facial characteristics of terminal user is obtained；Obtain the character face's feature for existing in the photo to be processed and closing one's eyes；By the people
Object facial characteristics is matched with the facial characteristics of terminal user.
Optionally, the repair module is also used to:
If the facial characteristics of character face's feature and terminal user match, to checking the photo to be processed
The eyeprint feature of terminal user records, and when the eyeprint feature of record reaches preset recording rate, the eyeprint based on record is special
It levies and eyelid reconstruction is carried out to the personage that there is eye closing in the photo to be processed.
Optionally, the repair module is also used to:
When receiving the amplification instruction to the photo to be processed, based on the eyeprint feature and it is amplified it is described to
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes；When receiving the instruction of the diminution to the photo to be processed, base
The photo to be processed in the eyeprint feature and after reducing carries out eyelid reconstruction to there is the personage to close one's eyes.
In addition, to achieve the above object, the present invention also proposes that a kind of identify based on eyeprint carries out eye to personage in photo
The method of reparation, it is described based on eyeprint identification in photo personage carry out eyelid reconstruction method the following steps are included:
Detect the eyelid reconstruction instruction of photo to be processed；
When detecting eyelid reconstruction instruction, identify that the character face for existing in the photo to be processed and closing one's eyes is special
Sign, character face's feature is matched with preset facial characteristics；
If character face's feature matches with preset facial characteristics, the corresponding eyeprint of the preset facial characteristics is obtained
Feature, and eyelid reconstruction is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature.
Optionally, the step of eyelid reconstruction instruction of detection photo to be processed includes:
When the photo for receiving terminal user checks instruction, the time of single photo, which counts, is checked to terminal user
When；
If terminal user checks that the time of single photo is more than preset time threshold, and detects the photograph that terminal user checks
There is the personage to close one's eyes in piece, then the photo checked terminal user is identified as detecting and treats place as photo to be processed
Manage the eyelid reconstruction instruction of photo.
Optionally, described when detecting eyelid reconstruction instruction, identify there is eye closing in the photo to be processed
Character face's feature, the step of character face's feature is matched with preset facial characteristics include:
When detecting eyelid reconstruction instruction, the face for the terminal user for checking the photo to be processed is known
Not, the facial characteristics of terminal user is obtained；
Obtain the character face's feature for existing in the photo to be processed and closing one's eyes；
Character face's feature is matched with the facial characteristics of terminal user.
Optionally, if character face's feature matches with preset facial characteristics, it is special to obtain the preset face
Corresponding eyeprint feature is levied, and is repaired based on the eyeprint feature to there is the personage's progress eye closed one's eyes in the photo to be processed
Multiple step includes:
If the facial characteristics of character face's feature and terminal user match, to checking the photo to be processed
The eyeprint feature of terminal user records, and when the eyeprint feature of record reaches preset recording rate, the eyeprint based on record is special
It levies and eyelid reconstruction is carried out to the personage that there is eye closing in the photo to be processed.
Optionally, described to be repaired based on the eyeprint feature to there is the personage's progress eye closed one's eyes in the photo to be processed
Multiple step includes:
When receiving the amplification instruction to the photo to be processed, based on the eyeprint feature and it is amplified it is described to
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes；
When receive the diminution to the photo to be processed instruction when, based on the eyeprint feature and reduce after described in
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes.
The terminal and method proposed by the present invention for carrying out eyelid reconstruction to personage in photo based on eyeprint identification, when detecting
When instructing to the eyelid reconstruction of photo to be processed, will there is the character face's feature closed one's eyes and preset face in the photo to be processed
Portion's feature is matched；If character face's feature matches with preset facial characteristics, the preset facial characteristics is obtained
Corresponding eyeprint feature, and repaired based on the eyeprint feature to there is the personage's progress eye closed one's eyes in the photo to be processed
It is multiple.Due to can using in the photo to be processed exist close one's eyes the corresponding eyeprint feature progress of character face's feature it is corresponding
Eyelid reconstruction, accurate eyelid reconstruction can be carried out for different eye closing personages in photo to be processed, can be more efficiently right
Photo to be processed carries out eyelid reconstruction.
Detailed description of the invention
The hardware structural diagram of Fig. 1 optional mobile terminal of each embodiment to realize the present invention；
Fig. 2 is the electrical structure block diagram of camera in Fig. 1；
Fig. 3 is the function mould for carrying out one embodiment of terminal of eyelid reconstruction to personage in photo the present invention is based on eyeprint identification
Block schematic diagram；
Fig. 4 is to identify to exist in the terminal first embodiment for carrying out personage in photo eyelid reconstruction the present invention is based on eyeprint
The photo to be processed of eye closing personage；
Fig. 5 is to identify to treat in the terminal first embodiment for carrying out personage in photo eyelid reconstruction the present invention is based on eyeprint
It handles and carries out the photo after eyelid reconstruction in photo there are eye closing personage；
Fig. 6 is that the present invention is based on eyeprint identifications to show the process for one embodiment of method that personage in photo carries out eyelid reconstruction
It is intended to；
Fig. 7 is that the present invention is based on eyeprint identifications to carry out in one embodiment of method of eyelid reconstruction personage in photo to terminal
The flow diagram of user's progress eyelid reconstruction.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The mobile terminal of each embodiment of the present invention is realized in description with reference to the drawings.In subsequent description, use
For indicate element such as " module ", " component " or " unit " suffix only for being conducive to explanation of the invention, itself
There is no specific meanings.Therefore, " module " can be used mixedly with " component ".
Mobile terminal can be implemented in a variety of manners.For example, terminal described in the present invention may include such as moving
Phone, smart phone, laptop, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet computer), PMP
The mobile terminal of (portable media player), navigation device etc. and such as number TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that in addition to being used in particular for moving
Except the element of purpose, the construction of embodiment according to the present invention can also apply to the terminal of fixed type.
Fig. 1 to realize the present invention an optional mobile terminal of each embodiment hardware configuration signal.
Mobile terminal 100 may include wireless communication unit 110, A/V (audio/video) input unit 120, user's input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power supply unit 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups shown
Part.More or fewer components can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more components, allows mobile terminal 100 and wireless communication device
Or the radio communication between network.For example, wireless communication unit may include mobile communication module 112, wireless Internet mould
At least one of block 113, short range communication module 114 and location information module 115.
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal may include that voice is logical
Talk about signal, video calling signal or according to text and/or Multimedia Message transmission and/or received various types of data.
The Wi-Fi (Wireless Internet Access) of the support mobile terminal of wireless Internet module 113.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting short range communication.Some examples of short-range communication technology include indigo plant
Tooth TM, radio frequency identification (RFID), Infrared Data Association (IrDA), ultra wide band (UWB), purple honeybee TM etc..
Location information module 115 is the module for checking or obtaining the location information of mobile terminal.Location information module
Typical case be GPS (global pick device).According to current technology, GPS module 115, which calculates, comes from three or more satellites
Range information and correct time information and the Information application triangulation for calculating, thus according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, it is defended for the method for calculating position and temporal information using three
Star and the error that calculated position and temporal information are corrected by using an other satellite.In addition, GPS module 115
It can be by Continuous plus current location information in real time come calculating speed information.
A/V input unit 120 is for receiving audio or video signal.A/V input unit 120 may include 121 He of camera
Microphone 122, camera 121 is to the static images obtained in video acquisition mode or image capture mode by image capture apparatus
Or the image data of video is handled.Treated, and picture frame may be displayed on display unit 151.It is handled through camera 121
Picture frame afterwards can store in memory 160 (or other storage mediums) or be sent out via wireless communication unit 110
It send, two or more cameras 121 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone calling model, note
Sound (audio data) is received via microphone in record mode, speech recognition mode etc. operational mode, and can will in this way
Acoustic processing be audio data.Audio that treated (voice) data can be converted in the case where telephone calling model can
The format output of mobile communication base station is sent to via mobile communication module 112.Various types of make an uproar can be implemented in microphone 122
Sound eliminates (or inhibition) algorithm to eliminate the noise or do that (or inhibition) generates during sending and receiving audio signal
It disturbs.
The order that user input unit 130 can be inputted according to user generates key input data to control each of mobile terminal
Kind operation.User input unit 130 allows user to input various types of information, and may include keyboard, metal dome, touch
Plate (for example, the sensitive component of detection due to the variation of resistance, pressure, capacitor etc. caused by being contacted), idler wheel, rocking bar etc.
Deng.Particularly, when touch tablet is superimposed upon in the form of layer on display unit 151, touch screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 100, (for example, mobile terminal 100 opens or closes shape
State), the position of mobile terminal 100, user is for the presence or absence of contact (that is, touch input) of mobile terminal 100, mobile terminal
100 orientation, the acceleration of mobile terminal 100 or by fast movement and direction etc., and generate for controlling mobile terminal 100
The order of operation or signal.For example, sensing unit 140 can sense when mobile terminal 100 is embodied as sliding-type mobile phone
The sliding-type phone is to open or close.In addition, sensing unit 140 be able to detect power supply unit 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).Interface unit 170 is used as at least one external device (ED) and mobile terminal 100
Connection can by interface.For example, external device (ED) may include wired or wireless headphone port, external power supply (or
Battery charger) port, wired or wireless data port, memory card port, the end for connecting the device with identification module
Mouth, the port audio input/output (I/O), video i/o port, ear port etc..Identification module can be storage for verifying
User using mobile terminal 100 various information and may include subscriber identification module (UIM), client identification module (SIM),
Universal Subscriber identification module (USIM) etc..In addition, the device (hereinafter referred to as " identification device ") with identification module can be adopted
The form of smart card is taken, therefore, identification device can be connect via port or other attachment devices with mobile terminal 100.Interface
Unit 170 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and defeated by what is received
Enter to be transferred to one or more elements in mobile terminal 100 or can be used for transmitting between mobile terminal and external device (ED)
Data.
In addition, when mobile terminal 100 is connect with external base, interface unit 170 may be used as allowing will be electric by it
Power, which is provided from pedestal to the path or may be used as of mobile terminal 100, allows the various command signals inputted from pedestal to pass through it
It is transferred to the path of mobile terminal.The various command signals or electric power inputted from pedestal, which may be used as mobile terminal for identification, is
The no signal being accurately fitted on pedestal.Output unit 150 is configured to provide with vision, audio and/or tactile manner defeated
Signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.) out.
Output unit 150 may include display unit 151, audio output module 152 etc..
Display unit 151 may be displayed on the information handled in mobile terminal 100.For example, when mobile terminal 100 is in electricity
When talking about call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia file
Downloading etc.) relevant user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling mode
Or when image capture mode, display unit 151 can show captured image and/or received image, show video or figure
Picture and the UI or GUI of correlation function etc..
Meanwhile when display unit 151 and touch tablet in the form of layer it is superposed on one another to form touch screen when, display unit
151 may be used as input unit and output device.Display unit 151 may include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user to watch from outside, this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
Desired embodiment, mobile terminal 100 may include two or more display units (or other display devices), for example, moving
Dynamic terminal may include outernal display unit (not shown) and inner display unit (not shown).Touch screen can be used for detecting touch
Input pressure and touch input position and touch input area.
Audio output module 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is when under the isotypes such as speech recognition mode, broadcast reception mode, wireless communication unit 110 is received or in memory 160
The audio data transducing audio signal of middle storage and to export be sound.Moreover, audio output module 152 can provide and movement
The relevant audio output of specific function (for example, call signal receives sound, message sink sound etc.) that terminal 100 executes.
Audio output module 152 may include sound pick-up, buzzer etc..
Memory 160 can store the software program etc. of the processing and control operation that are executed by controller 180, Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And memory 160 can store about the vibrations of various modes and audio signal exported when touching and being applied to touch screen
Data.
Memory 160 may include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, more
Media card, card-type memory (for example, SD or DX memory etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..Moreover, mobile terminal 100 can execute memory with by network connection
The network storage device of 160 store function cooperates.
The overall operation of the usually control mobile terminal of controller 180.For example, controller 180 executes and voice communication, data
Communication, video calling etc. relevant control and processing.In addition, controller 180 may include for reproducing (or playback) more matchmakers
The multi-media module 181 of volume data, multi-media module 181 can construct in controller 180, or can be structured as and control
Device 180 separates.Controller 180 can be with execution pattern identifying processing, by the handwriting input executed on the touchscreen or picture
It draws input and is identified as character or image.
Power supply unit 190 receives external power or internal power under the control of controller 180 and provides operation each member
Electric power appropriate needed for part and component.
Various embodiments described herein can be to use the calculating of such as computer software, hardware or any combination thereof
Machine readable medium is implemented.Hardware is implemented, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), controller, microcontroller, microprocessor, is designed to execute function described herein processor
At least one of electronic unit is implemented, and in some cases, such embodiment can be implemented in controller 180.
For software implementation, the embodiment of such as process or function can with allow to execute the individual of at least one functions or operations
Software module is implemented.Software code can by the software application (or program) write with any programming language appropriate Lai
Implement, software code can store in memory 160 and be executed by controller 180.
So far, oneself is through describing mobile terminal according to its function.In the following, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc., which is used as, to be shown
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
It is the electrical structure block diagram of camera in Fig. 1 referring to Fig. 2, Fig. 2.
Phtographic lens 1211 is made of the multiple optical lens for being used to form shot object image, is single-focus lens or varifocal mirror
Head.Phtographic lens 1211 can move in the direction of the optical axis under the control of lens driver 1221, and lens driver 1221
According to the control signal from lens driving control circuit 1222, the focal position of phtographic lens 1211 is controlled, in zoom lens
In the case of, it also can control focal length.Lens driving control circuit 1222 is according to the control command from microcomputer 1217
Carry out the drive control of lens driver 1221.
It is configured with and takes the photograph near the position of the shot object image formed on the optical axis of phtographic lens 1211, by phtographic lens 1211
Element 1212.Photographing element 1212 is for imaging shot object image and obtaining image data.On photographing element 1212
Two dimension and be arranged in a matrix the photodiode for constituting each pixel.Each photodiode generates photoelectricity corresponding with light income
Switching current, the photoelectric conversion electric current carry out charge accumulation by the capacitor connecting with each photodiode.The preceding table of each pixel
Face is configured with the RGB colour filter of bayer arrangement.
Photographing element 1212 is connect with imaging circuit 1213, which carries out charge in photographing element 1212
Accumulation control and picture signal read control, carry out after reducing resetting noise to the picture signal (analog picture signal) of the reading
Waveform shaping, and then gain raising etc. is carried out to become signal level appropriate.Imaging circuit 1213 and A/D converter 1214 connect
It connects, which carries out analog-to-digital conversion to analog picture signal, (following to 1227 output digital image signal of bus
Referred to as image data).
Bus 1227 is the transmitting path for being transmitted in the various data that the inside of camera reads or generates.In bus
1227 are connected to above-mentioned A/D converter 1214, are additionally connected to image processor 1215, jpeg processor 1216, microcomputer
Calculation machine 1217, SDRAM (Synchronous Dynamic random access memory, Synchronous Dynamic Random Access Memory)
1218, memory interface (hereinafter referred to as memory I/F) 1219, LCD (Liquid Crystal Display, liquid crystal display
Device) driver 1220.
Image processor 1215 carries out OB to the image data of the output based on photographing element 1212 and subtracts each other processing, white balance
Adjustment, gamma conversion, colour difference signal processing, noise removal process, changes processing, edge processing etc. respectively at color matrix operation simultaneously
Kind image procossing.Jpeg processor 1216 is when by Imagery Data Recording in recording medium 1225, according to JPEG compression mode pressure
Contract the image data read from SDRAM1218.In addition, jpeg processor 1216 shows to carry out image reproducing and carries out JPEG
The decompression of image data.When unziping it, the file being recorded in recording medium 1225 is read, in jpeg processor 1216
In implement decompression after, the image data of decompression is temporarily stored in SDRAM1218 and is carried out on LCD1226
Display.In addition, in the present embodiment, as compression of images decompression mode using JPEG mode, however Compress softwares
Contracting mode is without being limited thereto, it is of course possible to using MPEG, TIFF, other compressed and decompressed modes such as H.264.
Microcomputer 1217 plays the function of the control unit as camera entirety, is uniformly controlled the various processing of camera
Sequence.Microcomputer 1217 is connected to operating unit 1223 and flash memory 1224.
Operating unit 1223 includes but is not limited to physical button or virtual key, and the entity or virtual key can be electricity
Source button, camera button, edit key, dynamic image button, reproduction button, menu button, cross key, OK button, delete button,
The operational controls such as the various input buttons such as large buttons and various enter keys, detect the mode of operation of these operational controls,.
It will test result to export to microcomputer 1217.In addition, the front surface in the LCD1226 as display is equipped with
Touch panel detects the touch location of user, which is exported to microcomputer 1217.Microcomputer 1217
According to the testing result of the operating position from operating unit 1223, various processing sequences corresponding with the operation of user are executed.
Flash memory 1224 stores the program for executing the various processing sequences of microcomputer 1217.Microcomputer 1217
The control of camera entirety is carried out according to the program.In addition, flash memory 1224 stores the various adjusted values of camera, microcomputer 1217
Adjusted value is read, the control of camera is carried out according to the adjusted value.
SDRAM1218 be for image data etc. temporarily stored can electricity rewrite volatile memory.It should
SDRAM1218 temporarily stores the image data exported from A/D converter 1214 and in image processor 1215, jpeg processor
1216 it is equal in the image data that carried out that treated.
Memory interface 1219 is connect with recording medium 1225, is carried out image data and the text being attached in image data
First-class control data write-in recording medium 1225 and read from recording medium 1225 of part.Recording medium 1225 is, for example, can
The recording mediums such as memory card of disassembled and assembled freely on camera main-body, however it is without being limited thereto, it is also possible to be built in camera main-body
In hard disk etc..
LCD driver 1210 is connect with LCD1226, will treated that image data is stored in by image processor 1215
SDRAM1218 when needing to show, reads the image data of SDRAM1218 storage and shows on LCD1226, alternatively, at JPEG
The compressed image data of reason device 1216 is stored in SDRAM1218, and when needing to show, jpeg processor 1216 is read
The compressed image data of SDRAM1218, then unzip it, the image data after decompression is carried out by LCD1226
Display.
LCD1226 configuration performs image display at the back side of camera main-body.The LCD1226LCD), however it is without being limited thereto,
The various display panels (LCD1226) such as organic EL can be used, however it is without being limited thereto, it can also be using various displays such as organic EL
Panel.
Electrical structure schematic diagram based on above-mentioned mobile terminal hardware configuration and camera proposes that the present invention is based on eyeprint knowledges
The other each embodiment of terminal that eyelid reconstruction is carried out to personage in photo.
As shown in figure 3, implementing in the terminal first for carrying out eyelid reconstruction to personage in photo the present invention is based on eyeprint identification
In example, the terminal that should carry out eyelid reconstruction to personage in photo based on eyeprint identification includes:
Detection module 01, the eyelid reconstruction for detecting photo to be processed instruct；
In the present embodiment, when terminal user checks the photo shot in terminal, eye if desired is carried out to the photo checked
When portion's repair process, corresponding eyelid reconstruction instruction can be sent to terminal.As terminal can be by detection user to pre-set button
Pressing instruction, or detection user are carried on the back to the default gesture instruction on touch screen, or using pressure sensor detection user in terminal
The modes such as the default gesture instruction on portion's induction region instruct to detect terminal user to the eyelid reconstruction for currently checking photo,
This is not construed as limiting.
In a kind of optional embodiment, used when the photo for receiving terminal user checks instruction, namely in terminal
When the photo shot in terminal is checked at family, the time of single photo, which counts, is checked to terminal user using eyeball tracking technology
When；If terminal user checks that the time of single photo is more than preset time threshold, and detects in photo that terminal user checks
There are the personages of eye closing, then the photo checked terminal user is identified as detecting to photograph to be processed as photo to be processed
The eyelid reconstruction of piece instructs.It is such as found according to statistics, the response patience that user applies one is probably 3s, when user likes
When one photo, it can zoom in or out and check photo, can also control sliding see sometimes and compare, this process can be more than 10s.Cause
This, can be set as 10s for preset time threshold, have the people that closed eyes in the current photo that terminal user checks when detecting
Object, and terminal user's residence time in this photo is more than 10s, then judges that this has the photo for the personage that closed eyes
It for the favorite photo of user, needs to handle the photo, is then identified as detecting the eyelid reconstruction instruction to the photo.
Matching module 02 is closed for identifying to exist in the photo to be processed when detecting eyelid reconstruction instruction
Character face's feature of eye, character face's feature is matched with preset facial characteristics；
When detecting eyelid reconstruction instruction, then the eye for the photo to be processed that terminal user is currently checked in triggering
Repair operation.The character face's feature for existing in the photo to be processed and closing one's eyes, such as eyes, nose, mouth energy are identified first
The feature of different character face's features is distinguished, then will there is the character face's feature closed one's eyes in the photo to be processed of identification
It is matched with preset facial characteristics.Wherein, the preset facial characteristics is either be stored in advance one or more at the terminal
The facial characteristics of a user, the face for being also possible to the current gripping terminal user identified in real time by the camera of terminal are special
Sign, is not limited thereto.
If user can be preset in the terminal by the facial characteristics of itself and multiple good friends difference in advance, when needing to be processed
When photo carries out eyelid reconstruction operation, will there is the character face's feature closed one's eyes and preset face in the photo to be processed of identification
Portion's feature is matched, and can identify there is eye closing in the photo to be processed according to preset facial characteristics in the terminal is corresponding
Personage be itself or other good friends, and then carry out different eyelid reconstruction.
Repair module 03 obtains the preset face if matching for character face's feature with preset facial characteristics
The corresponding eyeprint feature of portion's feature, and eye is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature
It repairs in portion.
If character face's feature matches with preset facial characteristics, it is corresponding that the preset facial characteristics can be obtained
Eyeprint feature, and eyelid reconstruction is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature.Wherein,
The eyeprint feature can be to be extracted from the preset facial characteristics to match, be also possible to it is preset in the terminal with it is described
The accurate eyeprint feature of the preset corresponding storage of facial characteristics, is not limited thereto.
Identified the personage that there is eye closing in the photo to be processed according to preset facial characteristics in the terminal is corresponding
After itself or other good friends, the eyeprint feature extracted from itself or the preset facial characteristics of other good friends is obtained, or straight
It connects and is looked for from the accurate eyeprint feature of preset storage corresponding with the preset facial characteristics of itself or other good friends in the terminal
The eyeprint feature of itself or other good friends out.It can be based on the eyeprint feature of itself or other good friends respectively to the photograph to be processed
There is the personage to close one's eyes in piece and carry out corresponding eyelid reconstruction, to complete the eyelid reconstruction of whole photo to be processed.
In the present embodiment when detecting the eyelid reconstruction instruction to photo to be processed, will exist in the photo to be processed
Character face's feature of eye closing is matched with preset facial characteristics；If character face's feature and preset facial characteristics phase
Match, then obtains the corresponding eyeprint feature of the preset facial characteristics, and based on the eyeprint feature in the photo to be processed
There are the personages of eye closing to carry out eyelid reconstruction.Due to that can utilize and there is the character face's feature closed one's eyes in the photo to be processed
Corresponding eyeprint feature carries out corresponding eyelid reconstruction, can carry out for eye closing personage different in photo to be processed accurate
Eyelid reconstruction more efficiently can carry out eyelid reconstruction to photo to be processed.
Further, in a kind of optional embodiment, as shown in Figure 4, Figure 5, Fig. 4 is that the present invention is based on eyeprint identifications
Personage in photo is carried out in the terminal first embodiment of eyelid reconstruction there are the photo to be processed of eye closing personage, Fig. 5 is this hair
It is bright based on eyeprint identification in photo personage carry out eyelid reconstruction terminal first embodiment in in photo to be processed exist close
Eye personage carries out the photo after eyelid reconstruction.
In the present embodiment, detection module 01 can using eyeball tracking technology to terminal user check time of single photo into
Row timing t if terminal user checks that the time t of single photo is more than 10s, and is detected and is existed in photo that terminal user checks
The personage of eye closing, the then photo checked terminal user are identified as detecting to photo to be processed as photo to be processed
Eyelid reconstruction instruction.Matching module 02 identifies the character face's feature for existing in the photo to be processed and closing one's eyes, such as eyes, nose
The features such as son, mouth, meanwhile, matching module 02 also identifies the face of current end user, and will identify that current
The facial characteristics of terminal user is compared with there is the character face's feature closed one's eyes in the photo to be processed, is judged current whole
Have whether the personage to close one's eyes is the same person in end subscriber and the photo to be processed.Repair module 03 is according to matching module
When 02 comparison result judges that there is the personage to close one's eyes in current end user and the photo to be processed is the same person, utilize
Eyeprint identification technology records the eye feature of current end user, when recording ratio is up to 90%, according to the current of record
The eye feature of terminal user is to there are the eyes of eye closing personage to repair in the photo to be processed, by the photograph to be processed
The closed-eye state reparation of personage is normal eyes-open state in piece.And due to eyeprint identification technology to current end user
What is recorded when eye feature is recorded is vector data, and therefore, when zooming in or out photo, eye feature does not lose user
Very.
Further, in other embodiments, above-mentioned matching module 02 can be used for:
When detecting eyelid reconstruction instruction, the face for the terminal user for checking the photo to be processed is known
Not, the facial characteristics of terminal user is obtained；
Obtain the character face's feature for existing in the photo to be processed and closing one's eyes；
Character face's feature is matched with the facial characteristics of terminal user.
Above-mentioned repair module 03 can be used for:
If the facial characteristics of character face's feature and terminal user match, to checking the photo to be processed
The eyeprint feature of terminal user records, and when the eyeprint feature of record reaches preset recording rate, the eyeprint based on record is special
It levies and eyelid reconstruction is carried out to the personage that there is eye closing in the photo to be processed.
In the present embodiment when detecting the eyelid reconstruction instruction to photo to be processed, automatically starting front camera,
The face for the terminal user for currently checking the photo to be processed is identified, the eyes, nose, mouth of terminal user are obtained
Etc. the facial characteristics that can distinguish different character face's features.It is special to obtain the character face for existing in the photo to be processed and closing one's eyes
Sign, and character face's feature is matched with the facial characteristics of terminal user.If character face's feature and terminal
The facial characteristics of user matches, then judges to have the personage to close one's eyes in the photo to be processed for current terminal user, i.e.,
The eyeprint data in the facial feature data of terminal user can be further obtained, namely to the end for checking the photo to be processed
The eyeprint feature of end subscriber is recorded, and when the eyeprint feature of record reaches preset recording rate such as 90%, then judges to have recorded
Effectively eyeprint feature out, can the eyeprint feature based on record to there is the terminal user's eye closed one's eyes in the photo to be processed
It is repaired in portion.
Since the photo of terminal shooting is largely the photo for including terminal user itself, using front camera come to working as
Before check that the face of the terminal user of the photo to be processed identifies and most photo can be handled, and it is each
The secondary face that can obtain in real time newest terminal user using front camera in the eyelid reconstruction instruction to photo to be processed
Portion's feature and corresponding eyeprint feature are repaired, and more efficiently can be carried out eyelid reconstruction to photo to be processed, be improved pair
Photo to be processed carries out the accuracy of eyelid reconstruction.
Further, in other embodiments, above-mentioned repair module 03 can be also used for:
When receiving the amplification instruction to the photo to be processed, based on the eyeprint feature and it is amplified it is described to
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes；
When receive the diminution to the photo to be processed instruction when, based on the eyeprint feature and reduce after described in
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes.
In the present embodiment, the data of the eyeprint feature for carrying out eyelid reconstruction of acquisition are the data of a vector, when
When receiving the amplification instruction to the photo to be processed, it is based on the eyeprint feature and the amplified photo pair to be processed
There are the personages of eye closing to carry out eyelid reconstruction；When receiving the instruction of the diminution to the photo to be processed, it is based on the eyeprint
The photo to be processed after feature and diminution carries out eyelid reconstruction to there is the personage to close one's eyes.
The present embodiment can show identification according to the ratio of the face and eyes that there is the personage to close one's eyes in photo to be processed
Eyeprint feature, can according to terminal user scale photo size, eyeprint feature be zoomed in or out accordingly.This
Sample, in the photo to be processed after checking that eyeprint is repaired, the eyeprint feature of reparation will not be lost terminal user when zooming in or out
Very, more true instead, no matter the photo to be processed after making eyeprint reparation is attained by good display when zooming in or out
Effect.
Further, in other embodiments, timing t is carried out to every photo that user checks first, detects current shine
Whether piece has the bust that closed eyes, if so, user residence time t in this photo is continued to test, if stop
Between t be more than or equal to 10s, then the face of user is identified, and compared with the bust that closed eyes in photo, if root
It is the same person according to comparison result judgement, then is identified, the eye feature of user is recorded, when recording ratio is reached using eyeprint
When 90%, the eye for the bust that eyes are closed in photo is repaired, what it is due to record is vector data, and user is put
When big diminution photo, eye feature is undistorted.
The present invention further provides a kind of methods for carrying out eyelid reconstruction to personage in photo based on eyeprint identification, referring to figure
6, in one embodiment of method for carrying out eyelid reconstruction to personage in photo the present invention is based on eyeprint identification, it should be identified based on eyeprint
To in photo personage carry out eyelid reconstruction method include:
Step S10 detects the eyelid reconstruction instruction of photo to be processed；
In the present embodiment, when terminal user checks the photo shot in terminal, eye if desired is carried out to the photo checked
When portion's repair process, corresponding eyelid reconstruction instruction can be sent to terminal.As terminal can be by detection user to pre-set button
Pressing instruction, or detection user are carried on the back to the default gesture instruction on touch screen, or using pressure sensor detection user in terminal
The modes such as the default gesture instruction on portion's induction region instruct to detect terminal user to the eyelid reconstruction for currently checking photo,
This is not construed as limiting.
In a kind of optional embodiment, used when the photo for receiving terminal user checks instruction, namely in terminal
When the photo shot in terminal is checked at family, the time of single photo, which counts, is checked to terminal user using eyeball tracking technology
When；If terminal user checks that the time of single photo is more than preset time threshold, and detects in photo that terminal user checks
There are the personages of eye closing, then the photo checked terminal user is identified as detecting to photograph to be processed as photo to be processed
The eyelid reconstruction of piece instructs.It is such as found according to statistics, the response patience that user applies one is probably 3s, when user likes
When one photo, it can zoom in or out and check photo, can also control sliding see sometimes and compare, this process can be more than 10s.Cause
This, can be set as 10s for preset time threshold, have the people that closed eyes in the current photo that terminal user checks when detecting
Object, and terminal user's residence time in this photo is more than 10s, then judges that this has the photo for the personage that closed eyes
It for the favorite photo of user, needs to handle the photo, is then identified as detecting the eyelid reconstruction instruction to the photo.
Step S20 identifies the personage for existing in the photo to be processed and closing one's eyes when detecting eyelid reconstruction instruction
Facial characteristics matches character face's feature with preset facial characteristics；
When detecting eyelid reconstruction instruction, then the eye for the photo to be processed that terminal user is currently checked in triggering
Repair operation.The character face's feature for existing in the photo to be processed and closing one's eyes, such as eyes, nose, mouth energy are identified first
The feature of different character face's features is distinguished, then will there is the character face's feature closed one's eyes in the photo to be processed of identification
It is matched with preset facial characteristics.Wherein, the preset facial characteristics is either be stored in advance one or more at the terminal
The facial characteristics of a user, the face for being also possible to the current gripping terminal user identified in real time by the camera of terminal are special
Sign, is not limited thereto.
If user can be preset in the terminal by the facial characteristics of itself and multiple good friends difference in advance, when needing to be processed
When photo carries out eyelid reconstruction operation, will there is the character face's feature closed one's eyes and preset face in the photo to be processed of identification
Portion's feature is matched, and can identify there is eye closing in the photo to be processed according to preset facial characteristics in the terminal is corresponding
Personage be itself or other good friends, and then carry out different eyelid reconstruction.
Step S30 obtains the preset facial characteristics pair if character face's feature matches with preset facial characteristics
The eyeprint feature answered, and eyelid reconstruction is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature.
If character face's feature matches with preset facial characteristics, it is corresponding that the preset facial characteristics can be obtained
Eyeprint feature, and eyelid reconstruction is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature.Wherein,
The eyeprint feature can be to be extracted from the preset facial characteristics to match, be also possible to it is preset in the terminal with it is described
The accurate eyeprint feature of the preset corresponding storage of facial characteristics, is not limited thereto.
Identified the personage that there is eye closing in the photo to be processed according to preset facial characteristics in the terminal is corresponding
After itself or other good friends, the eyeprint feature extracted from itself or the preset facial characteristics of other good friends is obtained, or straight
It connects and is looked for from the accurate eyeprint feature of preset storage corresponding with the preset facial characteristics of itself or other good friends in the terminal
The eyeprint feature of itself or other good friends out.It can be based on the eyeprint feature of itself or other good friends respectively to the photograph to be processed
There is the personage to close one's eyes in piece and carry out corresponding eyelid reconstruction, to complete the eyelid reconstruction of whole photo to be processed.
In the present embodiment when detecting the eyelid reconstruction instruction to photo to be processed, will exist in the photo to be processed
Character face's feature of eye closing is matched with preset facial characteristics；If character face's feature and preset facial characteristics phase
Match, then obtains the corresponding eyeprint feature of the preset facial characteristics, and based on the eyeprint feature in the photo to be processed
There are the personages of eye closing to carry out eyelid reconstruction.Due to that can utilize and there is the character face's feature closed one's eyes in the photo to be processed
Corresponding eyeprint feature carries out corresponding eyelid reconstruction, can carry out for eye closing personage different in photo to be processed accurate
Eyelid reconstruction more efficiently can carry out eyelid reconstruction to photo to be processed.
Further, in a kind of optional embodiment, firstly, being checked using eyeball tracking technology to terminal user
The time of single photo carries out timing t, if terminal user checks that the time t of single photo is more than 10s, and detects terminal user
There is the personage to close one's eyes in the photo checked, then the photo checked terminal user is identified as detecting as photo to be processed
To the eyelid reconstruction instruction to photo to be processed.The character face's feature for existing in the photo to be processed and closing one's eyes is identified again, such as
The features such as eyes, nose, mouth, meanwhile, the present terminal that also face of current end user is identified, and will identify that
The facial characteristics of user is compared with there is the character face's feature closed one's eyes in the photo to be processed, judges that present terminal is used
Have whether the personage to close one's eyes is the same person in family and the photo to be processed.Judging that present terminal is used according to comparison result
When personage in family and the photo to be processed in the presence of eye closing is the same person, using eyeprint identification technology to current end user
Eye feature recorded, when recording ratio is up to 90%, according to the eye feature of the current end user of record to it is described to
There are the eyes of eye closing personage to repair in processing photo, and the closed-eye state reparation of personage in the photo to be processed is positive
Normal eyes-open state.And since what is recorded when being recorded with eye feature of the eyeprint identification technology to current end user is
Vector data, therefore, for user when zooming in or out photo, eye feature is undistorted.
Further, in other embodiments, above-mentioned steps S20 may include:
When detecting eyelid reconstruction instruction, the face for the terminal user for checking the photo to be processed is known
Not, the facial characteristics of terminal user is obtained；
Obtain the character face's feature for existing in the photo to be processed and closing one's eyes；
Character face's feature is matched with the facial characteristics of terminal user.
Above-mentioned steps S30 may include:
If the facial characteristics of character face's feature and terminal user match, to checking the photo to be processed
The eyeprint feature of terminal user records, and when the eyeprint feature of record reaches preset recording rate, the eyeprint based on record is special
It levies and eyelid reconstruction is carried out to the personage that there is eye closing in the photo to be processed.
In the present embodiment when detecting the eyelid reconstruction instruction to photo to be processed, automatically starting front camera,
The face for the terminal user for currently checking the photo to be processed is identified, the eyes, nose, mouth of terminal user are obtained
Etc. the facial characteristics that can distinguish different character face's features.It is special to obtain the character face for existing in the photo to be processed and closing one's eyes
Sign, and character face's feature is matched with the facial characteristics of terminal user.If character face's feature and terminal
The facial characteristics of user matches, then judges to have the personage to close one's eyes in the photo to be processed for current terminal user, i.e.,
The eyeprint data in the facial feature data of terminal user can be further obtained, namely to the end for checking the photo to be processed
The eyeprint feature of end subscriber is recorded, and when the eyeprint feature of record reaches preset recording rate such as 90%, then judges to have recorded
Effectively eyeprint feature out, can the eyeprint feature based on record to there is the terminal user's eye closed one's eyes in the photo to be processed
It is repaired in portion.
Since the photo of terminal shooting is largely the photo for including terminal user itself, using front camera come to working as
Before check that the face of the terminal user of the photo to be processed identifies and most photo can be handled, and it is each
The secondary face that can obtain in real time newest terminal user using front camera in the eyelid reconstruction instruction to photo to be processed
Portion's feature and corresponding eyeprint feature are repaired, and more efficiently can be carried out eyelid reconstruction to photo to be processed, be improved pair
Photo to be processed carries out the accuracy of eyelid reconstruction.
Further, in other embodiments, above-mentioned steps S30 can also include:
When receiving the amplification instruction to the photo to be processed, based on the eyeprint feature and it is amplified it is described to
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes；
When receive the diminution to the photo to be processed instruction when, based on the eyeprint feature and reduce after described in
It handles photo and carries out eyelid reconstruction to there is the personage to close one's eyes.
In the present embodiment, the data of the eyeprint feature for carrying out eyelid reconstruction of acquisition are the data of a vector, when
When receiving the amplification instruction to the photo to be processed, it is based on the eyeprint feature and the amplified photo pair to be processed
There are the personages of eye closing to carry out eyelid reconstruction；When receiving the instruction of the diminution to the photo to be processed, it is based on the eyeprint
The photo to be processed after feature and diminution carries out eyelid reconstruction to there is the personage to close one's eyes.
The present embodiment can show identification according to the ratio of the face and eyes that there is the personage to close one's eyes in photo to be processed
Eyeprint feature, can according to terminal user scale photo size, eyeprint feature be zoomed in or out accordingly.This
Sample, in the photo to be processed after checking that eyeprint is repaired, the eyeprint feature of reparation will not be lost terminal user when zooming in or out
Very, more true instead, no matter the photo to be processed after making eyeprint reparation is attained by good display when zooming in or out
Effect.
As shown in fig. 7, Fig. 7 is that the method one for carrying out eyelid reconstruction to personage in photo the present invention is based on eyeprint identification is implemented
The flow diagram of eyelid reconstruction is carried out in example to terminal user.
In the present embodiment, timing t is carried out to every photo that user checks first, whether detection current photo closeds eye
The bust of eyeball, if so, user residence time t in this photo is continued to test, if residence time t is more than or equal to 10s,
Then the face of user is identified, and is compared with the bust that closed eyes in photo, if being judged according to comparison result
It is the same person, is then identified using eyeprint, the eye feature of user is recorded, when recording ratio is up to 90%, in photo
The eye that closed the bust of eyes is repaired, and what it is due to record is vector data, when user's zoom photo, eye
Portion's feature is undistorted.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothes
Business device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (8)
1. a kind of terminal for carrying out eyelid reconstruction to personage in photo based on eyeprint identification, which is characterized in that described to be based on eyeprint
Identify that the terminal for carrying out eyelid reconstruction to personage in photo includes:
Detection module, for when the photo for receiving terminal user checks instruction, to terminal user check single photo when
Between carry out timing；If terminal user checks that the time of single photo is more than preset time threshold, and detects that terminal user checks
Photo in there is the personage to close one's eyes, then the photo checked terminal user is identified as detecting pair as photo to be processed
The eyelid reconstruction of photo to be processed instructs；
Matching module, for identifying the people for existing in the photo to be processed and closing one's eyes when detecting eyelid reconstruction instruction
Object facial characteristics matches character face's feature with preset facial characteristics, wherein the preset facial characteristics is pre-
It is first stored in the facial characteristics of one or more users in terminal, or is worked as what the camera by terminal identified in real time
The preceding facial characteristics for holding terminal user；
Repair module obtains the preset facial characteristics if matching for character face's feature with preset facial characteristics
Corresponding eyeprint feature, and repaired based on the eyeprint feature to there is the personage's progress eye closed one's eyes in the photo to be processed
It is multiple.
2. the terminal for carrying out eyelid reconstruction to personage in photo is identified based on eyeprint as described in claim 1, which is characterized in that
The matching module is also used to:
When detecting eyelid reconstruction instruction, the face for the terminal user for checking the photo to be processed is identified,
Obtain the facial characteristics of terminal user；Obtain the character face's feature for existing in the photo to be processed and closing one's eyes；By the personage
Facial characteristics is matched with the facial characteristics of terminal user.
3. the terminal for carrying out eyelid reconstruction to personage in photo is identified based on eyeprint as claimed in claim 2, which is characterized in that
The repair module is also used to:
If the facial characteristics of character face's feature and terminal user match, to the terminal for checking the photo to be processed
The eyeprint feature of user records, when the eyeprint feature of record reaches preset recording rate, the eyeprint feature pair based on record
There is the personage to close one's eyes in the photo to be processed and carries out eyelid reconstruction.
4. the terminal for carrying out eyelid reconstruction to personage in photo is identified based on eyeprint as described in claim 1, which is characterized in that
The data of the eyeprint feature for eyelid reconstruction obtained are a vector datas, and the repair module is also used to:
When receiving the amplification instruction to the photo to be processed, based on the eyeprint feature and amplified described to be processed
Photo carries out eyelid reconstruction to there is the personage to close one's eyes；When receiving the instruction of the diminution to the photo to be processed, it is based on institute
The photo to be processed after stating eyeprint feature and reducing carries out eyelid reconstruction to there is the personage to close one's eyes.
5. a kind of method for carrying out eyelid reconstruction to personage in photo based on eyeprint identification, which is characterized in that described to be based on eyeprint
Identification in photo personage carry out eyelid reconstruction the following steps are included:
When the photo for receiving terminal user checks instruction, the time of single photo, which carries out timing, is checked to terminal user；
If terminal user checks that the time of single photo is more than preset time threshold, and detects in photo that terminal user checks
There are the personages of eye closing, then the photo checked terminal user is identified as detecting to photograph to be processed as photo to be processed
The eyelid reconstruction of piece instructs；
When detecting eyelid reconstruction instruction, the character face's feature for existing in the photo to be processed and closing one's eyes is identified, it will
Character face's feature is matched with preset facial characteristics, wherein the preset facial characteristics is to be stored in advance in terminal
On one or more users facial characteristics, or the current gripping terminal identified in real time for the camera by terminal uses
The facial characteristics at family；
If character face's feature matches with preset facial characteristics, it is special to obtain the corresponding eyeprint of the preset facial characteristics
Sign, and eyelid reconstruction is carried out to there is the personage to close one's eyes in the photo to be processed based on the eyeprint feature.
6. the method for carrying out eyelid reconstruction to personage in photo is identified based on eyeprint as claimed in claim 5, which is characterized in that
It is described to identify the character face's feature for existing in the photo to be processed and closing one's eyes when detecting eyelid reconstruction instruction, it will
The step of character face's feature is matched with preset facial characteristics include:
When detecting eyelid reconstruction instruction, the face for the terminal user for checking the photo to be processed is identified,
Obtain the facial characteristics of terminal user；
Obtain the character face's feature for existing in the photo to be processed and closing one's eyes；
Character face's feature is matched with the facial characteristics of terminal user.
7. the method for carrying out eyelid reconstruction to personage in photo is identified based on eyeprint as claimed in claim 6, which is characterized in that
If character face's feature matches with preset facial characteristics, it is special to obtain the corresponding eyeprint of the preset facial characteristics
Sign, and include: to there is the step of personage to close one's eyes carries out eyelid reconstruction in the photo to be processed based on the eyeprint feature
If the facial characteristics of character face's feature and terminal user match, to the terminal for checking the photo to be processed
The eyeprint feature of user records, when the eyeprint feature of record reaches preset recording rate, the eyeprint feature pair based on record
There is the personage to close one's eyes in the photo to be processed and carries out eyelid reconstruction.
8. the method for carrying out eyelid reconstruction to personage in photo is identified based on eyeprint as claimed in claim 5, which is characterized in that
The data of the eyeprint feature for eyelid reconstruction obtained are a vector datas, described to be based on the eyeprint feature to institute
Stating the step of personage for existing in photo to be processed and closing one's eyes carries out eyelid reconstruction includes:
When receiving the amplification instruction to the photo to be processed, based on the eyeprint feature and amplified described to be processed
Photo carries out eyelid reconstruction to there is the personage to close one's eyes；
It is described to be processed based on the eyeprint feature and after reducing when receiving the instruction of the diminution to the photo to be processed
Photo carries out eyelid reconstruction to there is the personage to close one's eyes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510980347.1A CN105592249B (en) | 2015-12-23 | 2015-12-23 | The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510980347.1A CN105592249B (en) | 2015-12-23 | 2015-12-23 | The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105592249A CN105592249A (en) | 2016-05-18 |
| CN105592249B true CN105592249B (en) | 2018-12-21 |
Family
ID=55931436
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510980347.1A Active CN105592249B (en) | 2015-12-23 | 2015-12-23 | The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105592249B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106251316B (en) * | 2016-08-29 | 2018-09-18 | 珠海格力电器股份有限公司 | The restorative procedure and device of photo |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006330800A (en) * | 2005-05-23 | 2006-12-07 | Nippon Telegr & Teleph Corp <Ntt> | Image synthesis system, image synthesis method, and program of the method |
| CN101617339A (en) * | 2007-02-15 | 2009-12-30 | 索尼株式会社 | Image processing apparatus and image processing method |
| CN102055912A (en) * | 2009-10-29 | 2011-05-11 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| CN103310186A (en) * | 2012-02-29 | 2013-09-18 | 三星电子株式会社 | Method for correcting user's gaze direction in image, machine-readable storage medium and communication terminal |
| CN104954678A (en) * | 2015-06-15 | 2015-09-30 | 联想(北京)有限公司 | Image processing method, image processing device and electronic equipment |
| CN104978566A (en) * | 2015-06-05 | 2015-10-14 | 深圳市金立通信设备有限公司 | Picture processing method and terminal |
| CN105072327A (en) * | 2015-07-15 | 2015-11-18 | 广东欧珀移动通信有限公司 | Eye-closing-preventing person photographing method and device thereof |
-
2015
- 2015-12-23 CN CN201510980347.1A patent/CN105592249B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006330800A (en) * | 2005-05-23 | 2006-12-07 | Nippon Telegr & Teleph Corp <Ntt> | Image synthesis system, image synthesis method, and program of the method |
| CN101617339A (en) * | 2007-02-15 | 2009-12-30 | 索尼株式会社 | Image processing apparatus and image processing method |
| CN102055912A (en) * | 2009-10-29 | 2011-05-11 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| CN103310186A (en) * | 2012-02-29 | 2013-09-18 | 三星电子株式会社 | Method for correcting user's gaze direction in image, machine-readable storage medium and communication terminal |
| CN104978566A (en) * | 2015-06-05 | 2015-10-14 | 深圳市金立通信设备有限公司 | Picture processing method and terminal |
| CN104954678A (en) * | 2015-06-15 | 2015-09-30 | 联想(北京)有限公司 | Image processing method, image processing device and electronic equipment |
| CN105072327A (en) * | 2015-07-15 | 2015-11-18 | 广东欧珀移动通信有限公司 | Eye-closing-preventing person photographing method and device thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105592249A (en) | 2016-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430295B (en) | Image processing apparatus and method | |
| CN105100609B (en) | The adjusting method of mobile terminal and acquisition parameters | |
| CN105959543B (en) | It is a kind of to remove reflective filming apparatus and method | |
| CN104660903B (en) | Image pickup method and filming apparatus | |
| CN105472246B (en) | Camera arrangement and method | |
| CN105513021B (en) | Image denoising device and method | |
| CN105704369B (en) | A kind of information processing method and device, electronic equipment | |
| CN104902185B (en) | Image pickup method and device | |
| CN104811554B (en) | The switching method and terminal of camera mode | |
| CN105335458B (en) | Preview picture method and device | |
| CN105635452B (en) | Mobile terminal and its identification of contacts method | |
| CN105430263A (en) | Long-exposure panoramic image photographing device and method | |
| CN106303290B (en) | A kind of terminal and the method for obtaining video | |
| CN106603917A (en) | Shooting device and method | |
| CN105187724B (en) | A kind of mobile terminal and method handling image | |
| CN109788268A (en) | Terminal and its white balance correction control method and computer readable storage medium | |
| CN109831636A (en) | Interdynamic video control method, terminal and computer readable storage medium | |
| CN105763811A (en) | Shooting control device and method | |
| CN105245777A (en) | Method and device for generating video image | |
| CN105357444B (en) | focusing method and device | |
| CN105959554A (en) | Video shooting apparatus and method | |
| CN105469357B (en) | Image processing method, device and terminal | |
| CN105491358B (en) | A kind of image processing method and device, terminal | |
| WO2017114088A1 (en) | Automatic white balance method and device, terminal, and storage medium | |
| CN105407275B (en) | Photo synthesizer and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |