CN105592249A - Terminal and method of performing eyelid reconstruction on figures in photograph based on eyeprint identification - Google Patents
Terminal and method of performing eyelid reconstruction on figures in photograph based on eyeprint identification Download PDFInfo
- Publication number
- CN105592249A CN105592249A CN201510980347.1A CN201510980347A CN105592249A CN 105592249 A CN105592249 A CN 105592249A CN 201510980347 A CN201510980347 A CN 201510980347A CN 105592249 A CN105592249 A CN 105592249A
- Authority
- CN
- China
- Prior art keywords
- personage
- photo
- facial characteristics
- eyeprint
- eyelid reconstruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 210000000744 eyelid Anatomy 0.000 title claims abstract description 150
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000001815 facial effect Effects 0.000 claims abstract description 158
- 210000001508 eye Anatomy 0.000 claims abstract description 147
- 238000001514 detection method Methods 0.000 claims abstract description 13
- 230000008439 repair process Effects 0.000 claims description 10
- 230000003321 amplification Effects 0.000 claims description 8
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 8
- 238000000151 deposition Methods 0.000 claims description 3
- 230000008878 coupling Effects 0.000 abstract 2
- 238000010168 coupling process Methods 0.000 abstract 2
- 238000005859 coupling reaction Methods 0.000 abstract 2
- 239000010408 film Substances 0.000 description 21
- 238000003860 storage Methods 0.000 description 17
- 238000012545 processing Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 9
- 238000003384 imaging method Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 210000005252 bulbus oculi Anatomy 0.000 description 4
- 230000006837 decompression Effects 0.000 description 4
- 238000000429 assembly Methods 0.000 description 3
- 230000000712 assembly Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 241000562516 Thisbe Species 0.000 description 2
- 208000034699 Vitreous floaters Diseases 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 230000005764 inhibitory process Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000005693 optoelectronics Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 1
- SUBDBMMJDZJVOS-UHFFFAOYSA-N 5-methoxy-2-{[(4-methoxy-3,5-dimethylpyridin-2-yl)methyl]sulfinyl}-1H-benzimidazole Chemical compound N=1C2=CC(OC)=CC=C2NC=1S(=O)CC1=NC=C(C)C(OC)=C1C SUBDBMMJDZJVOS-UHFFFAOYSA-N 0.000 description 1
- 241000256844 Apis mellifera Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 1
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 210000001331 nose Anatomy 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- G06T5/77—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
Abstract
The invention discloses a terminal of performing eyelid reconstruction on figures in a photograph based on eyeprint identification, comprising a detection module used for detecting the eyelid reconstruction of a pending photograph; a coupling module used for identifying the facial feature of the figure having eyes closed in the pending photograph, and coupling the facial feature of the figure with a preset facial feature; and a restoration module used for obtaining the eyeprint feature corresponding to the preset facial feature if the facial feature of the figure couples with the preset facial feature, and performing eyelid reconstruction on the figure having eyes closed in the pending photograph based on the eyeprint feature. The invention also provides a method of performing eyelid reconstruction on figures in a photograph based on eyeprint identification. The terminal and method can perform accurate eyelid reconstruction on different figures having eyes closed in a pending photograph, and more effectively perform eyelid reconstruction on the pending photograph.
Description
Technical field
The present invention relates to communication technical field, relate in particular to one and enter based on personage in eyeprint identification comparison filmThe terminal of row eyelid reconstruction and method.
Background technology
At present, taking pictures for intelligent terminal is a very important function, and user also more and more complies withRely the photo of shooting optimum efficiency in intelligent terminal in various scenes as gone sightseeing time. InevitablyBe, in the photo that intelligent terminal is shot sometimes, personage there will be the situation of closing one's eyes, and user generally can be by peopleThe photo that thing is closed one's eyes is deleted. Although closing one's eyes appears in the photo personage who shoots when intelligent terminal, otherEffect is fine, as gone sightseeing as user, scenery is taken together with personage, finally takesAlthough closing one's eyes appears in personage in photo, the shooting effect of scenery is very good, and user need to retain this photo,Personage's the eye of needing to close one's eyes in comparison film is repaired, but, cannot comparison film in prior art inPersonage's the eye of closing one's eyes is repaired effectively.
Summary of the invention
Main purpose of the present invention is to propose a kind of carry out eye based on personage in eyeprint identification comparison film and repairMultiple terminal and method, the personage's that is intended to close one's eyes in comparison film eye is repaired effectively.
For achieving the above object, one provided by the invention is carried out eye based on personage in eyeprint identification comparison filmThe terminal that portion repairs, described terminal of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film comprises:
Detection module, for detection of the eyelid reconstruction instruction of pending photo;
Matching module, in the time described eyelid reconstruction instruction being detected, identifies in described pending photoPersonage's facial characteristics that existence is closed one's eyes, mates described personage's facial characteristics with preset facial characteristics;
Repair module, if match for described personage's facial characteristics and preset facial characteristics, described in obtainingThe eyeprint feature that preset facial characteristics is corresponding, and based on described eyeprint feature to depositing in described pending photoCarry out eyelid reconstruction the personage who closes one's eyes.
Alternatively, described detection module also for:
In the time receiving terminal use's photo and check instruction, terminal use is checked to the time of single photoCarry out timing; If terminal use checks that the time of single photo exceedes Preset Time threshold value, and end detectedIn the photo that end subscriber is checked, have the personage who closes one's eyes, the photo of terminal use being checked is as pendingPhoto, and be identified as the eyelid reconstruction instruction detecting pending photo.
Alternatively, described matching module also for:
In the time described eyelid reconstruction instruction being detected, to checking terminal use's the face of described pending photoPortion identifies, and obtains terminal use's facial characteristics; Obtain in described pending photo to exist and close one's eyesPersonage's facial characteristics; Described personage's facial characteristics is mated with terminal use's facial characteristics.
Alternatively, described reparation module also for:
If described personage's facial characteristics and terminal use's facial characteristics matches, described in checking, wait to locateThe terminal use's of reason photo eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rateTime, the eyeprint feature based on record is to existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo.
Alternatively, described reparation module also for:
When receive described pending photo amplification instruction time, based on described eyeprint feature and after amplifyingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction; When receiving described pendingPhoto dwindle instruction time, the described pending photo based on described eyeprint feature and after dwindling to exist closeThe personage of eye carries out eyelid reconstruction.
In addition, for achieving the above object, the present invention also proposes a kind of based on personage in eyeprint identification comparison filmCarry out the method for eyelid reconstruction, described method of carrying out eyelid reconstruction based on personage in eyeprint identification comparison filmComprise the following steps:
Detect the eyelid reconstruction instruction of pending photo;
In the time described eyelid reconstruction instruction being detected, identify the personage that in described pending photo, existence is closed one's eyesFacial characteristics, mates described personage's facial characteristics with preset facial characteristics;
If described personage's facial characteristics and preset facial characteristics match, obtain described preset facial characteristics pairThe eyeprint feature of answering, and the personage who existence in described pending photo is closed one's eyes based on described eyeprint feature entersRow eyelid reconstruction.
Alternatively, the step of the eyelid reconstruction instruction of the pending photo of described detection comprises:
In the time receiving terminal use's photo and check instruction, terminal use is checked to the time of single photoCarry out timing;
If terminal use checks that the time of single photo exceedes Preset Time threshold value, and terminal use detectedIn the photo of checking, have the personage that closes one's eyes, the photo of terminal use being checked is as pending photo,And be identified as the eyelid reconstruction instruction detecting pending photo.
Alternatively, described in the time described eyelid reconstruction instruction being detected, identify in described pending photo and depositAt personage's facial characteristics of closing one's eyes, the step that described personage's facial characteristics is mated with preset facial characteristicsSuddenly comprise:
In the time described eyelid reconstruction instruction being detected, to checking terminal use's the face of described pending photoPortion identifies, and obtains terminal use's facial characteristics;
Obtain personage's facial characteristics that in described pending photo, existence is closed one's eyes;
Described personage's facial characteristics is mated with terminal use's facial characteristics.
Alternatively, if described personage's facial characteristics and preset facial characteristics match, obtain described pre-Put the eyeprint feature that facial characteristics is corresponding, and based on described eyeprint feature to existing in described pending photoThe step that the personage who closes one's eyes carries out eyelid reconstruction comprises:
If described personage's facial characteristics and terminal use's facial characteristics matches, described in checking, wait to locateThe terminal use's of reason photo eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rateTime, the eyeprint feature based on record is to existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo.
Alternatively, the described personage who existence in described pending photo is closed one's eyes based on described eyeprint feature entersThe step of row eyelid reconstruction comprises:
When receive described pending photo amplification instruction time, based on described eyeprint feature and after amplifyingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction;
When receive to described pending photo dwindle instruction time, based on described eyeprint feature and after dwindlingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction.
What the present invention proposed carries out terminal and the method for eyelid reconstruction based on personage in eyeprint identification comparison film,When detect pending photo eyelid reconstruction instruction time, close one's eyes existing in described pending photoPersonage's facial characteristics mates with preset facial characteristics; If described personage's facial characteristics and preset face are specialLevy and match, obtain the eyeprint feature that described preset facial characteristics is corresponding, and based on described eyeprint featureTo existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo. Due to can utilize with described in wait to locateIn reason photo, exist the corresponding eyeprint feature of personage's facial characteristics of closing one's eyes to carry out corresponding eyelid reconstruction,Can carry out accurate eyelid reconstruction for the personages that closes one's eyes different in pending photo, can be more effectively rightPending photo carries out eyelid reconstruction.
Brief description of the drawings
Fig. 1 is the hardware configuration schematic diagram of realizing an optional mobile terminal of each embodiment of the present invention;
Fig. 2 is the electrical structure block diagram of camera in Fig. 1;
Fig. 3 is terminal one embodiment that the present invention is based on personage in eyeprint identification comparison film and carry out eyelid reconstructionHigh-level schematic functional block diagram;
Fig. 4 the present invention is based on the terminal first that personage in eyeprint identification comparison film carries out eyelid reconstruction to implementIn example, there is the personage's that closes one's eyes pending photo;
Fig. 5 the present invention is based on the terminal first that personage in eyeprint identification comparison film carries out eyelid reconstruction to implementIn example to existing the personage that closes one's eyes to carry out the photo after eyelid reconstruction in pending photo;
Fig. 6 is method one embodiment that the present invention is based on personage in eyeprint identification comparison film and carry out eyelid reconstructionSchematic flow sheet;
Fig. 7 is method one embodiment that the present invention is based on personage in eyeprint identification comparison film and carry out eyelid reconstructionIn terminal use is carried out to the schematic flow sheet of eyelid reconstruction.
Realization, functional characteristics and the advantage of the object of the invention, in connection with embodiment, are done further with reference to accompanying drawingExplanation.
Detailed description of the invention
Should be appreciated that specific embodiment described herein is only in order to explain the present invention, and be not used in limitDetermine the present invention.
The mobile terminal of realizing each embodiment of the present invention is described referring now to accompanying drawing. In follow-up descriptionIn, use the suffix such as " module ", " parts " or " unit " that is used for representing element only in order to haveBe beneficial to explanation of the present invention, itself do not have specific meaning. Therefore, " module " can with " parts "Mixedly to use.
Mobile terminal can be implemented with various forms. For example, the terminal of describing in the present invention can compriseSuch as mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA, (individual digital helpsReason), PAD (panel computer), PMP (portable media player), guider etc. eventually mobileEnd and such as the fixed terminal of digital TV, desktop computer etc. Suppose that terminal is eventually mobile below,End. But, it will be appreciated by those skilled in the art that the element except being used in particular for mobile object,Structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.
Fig. 1 is the hardware configuration signal that realizes an optional mobile terminal of each embodiment of the present invention.
Mobile terminal 100 can comprise wireless communication unit 110, A/V (audio/video) input block 120,User input unit 130, sensing cell 140, output unit 150, memory 160, interface unit 170,Controller 180 and power subsystem 190 etc. Fig. 1 shows the mobile terminal with various assemblies, but shouldUnderstand, and do not require all assemblies that illustrate of enforcement. Can alternatively implement more or less groupPart. Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 100 with wirelessRadio communication between communicator or network. For example, wireless communication unit can comprise mobile communicationIn module 112, wireless Internet module 113, junction service module 114 and positional information module 115 at leastOne.
Mobile communication module 112 by radio signal send to base station (for example, access point, Node B etc.),At least one in exterior terminal and server and/or receive radio signals from it. Such radioSignal can comprise voice call signal, video calling signal or according to text and/or Multimedia MessageThe various types of data that send and/or receive.
Wireless Internet module 113 is supported the Wi-Fi (Wireless Internet Access) of mobile terminal. This module can be inner orExternally be couple to terminal. The related Wi-Fi (Wireless Internet Access) technology of this module can comprise WLAN (nothingLine LAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (at a high speedDownlink packets access) etc.
Junction service module 114 is the modules for supporting junction service. Some examples of short-range communication technologyComprise bluetooth TM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee TMEtc..
Positional information module 115 is the modules for checking or obtain the positional information of mobile terminal. Position letterThe typical case of breath module is GPS (global pick device). According to current technology, GPS module 115 is calculatedFrom the range information of three or more satellites and correct time information and for the information application of calculatingTriangulation, thus according to longitude, latitude and pin-point accuracy calculate three-dimensional current location information. WhenBefore, use three satellites and pass through to use other one for the method for calculating location and temporal informationThe position that satellite correction calculation goes out and the error of temporal information. In addition, GPS module 115 can be by real timeGround calculates continuously current location information and carrys out computational speed information.
A/V input block 120 is for audio reception or vision signal. A/V input block 120 can comprise phaseMachine 121 and microphone 122, camera 121 in Video Capture pattern or image capture mode by image captureThe static images that device obtains or the view data of video are processed. Picture frame after treatment can showOn display unit 151. (or other is deposited can be stored in memory 160 through camera 121 picture frame after treatmentStorage media) in or send via wireless communication unit 110, can provide according to the structure of mobile terminalTwo or more cameras 121. Microphone 122 can be in telephone relation pattern, logging mode, speech recognitionIn pattern etc. operational mode, receive sound (voice data) via microphone, and can be by such soundBe treated to voice data. Audio frequency after treatment (voice) data can be changed the in the situation that of telephone relation patternFor sending to via mobile communication module 112 formatted output of mobile communication base station. Microphone 122 canImplement various types of noises and eliminate (or inhibition) algorithm to eliminate (or inhibition) in reception and to send audio signalProcess in the noise or the interference that produce.
User input unit 130 can generate key input data to control movement according to the order of user's inputThe various operations of terminal. User input unit 130 allows user to input various types of information, and canComprise that keyboard, the young sheet of pot, touch pad (for example, detect owing to being touched the resistance, pressure, the electricity that causeThe touch-sensitive assembly of variation holding etc.), roller, rocking bar etc. Especially, when touch pad is with the form of layerWhile being superimposed upon on display unit 151, can form touch-screen.
Sensing cell 140 detects the current state of mobile terminal 100, (for example, mobile terminal 100 open orClosed condition), the position of mobile terminal 100, user be for the contact (, touching input) of mobile terminal 100Have or not, the acceleration of the orientation of mobile terminal 100, mobile terminal 100 or speed is moved and direction etc.,And generate order or the signal of the operation for controlling mobile terminal 100. For example,, when mobile terminal 100While being embodied as sliding-type mobile phone, sensing cell 140 can be opened or close by this sliding-type phone of sensingClose. In addition, sensing cell 140 can detect power subsystem 190 whether electric power or interface unit 170 are providedWhether couple with external device (ED). Interface unit 170 connects as at least one external device (ED) and mobile terminal 100Connect the interface that can pass through. For example, external device (ED) can comprise wired or wireless head-band earphone port,External power source (or battery charger) port, wired or wireless FPDP, memory card port, for connectingThere is port, audio frequency I/O (I/O) port, video i/o port, the earphone end of the device of identification moduleMouthful etc. Identification module can be storage for authentication of users use mobile terminal 100 various information andCan comprise subscriber identification module (UIM), client identification module (SIM), general client identification module (USIM)Etc.. In addition, the device (being called " recognition device " below) that has an identification module can be taked smart cardForm, therefore, recognition device can be connected with mobile terminal 100 via port or other jockey. ConnectMouthful unit 170 can be for receiving for example, from the input (, data message, electric power etc.) of external device (ED) alsoAnd by the input receiving be transferred to one or more elements in mobile terminal 100 or can forBetween mobile terminal and external device (ED), transmit data.
In addition, in the time that mobile terminal 100 is connected with external base, interface unit 170 can be logical as allowingCrossing it is provided to electric power the path of mobile terminal 100 or can inputs from base as allowing from baseVarious command signals be transferred to the path of mobile terminal by it. From the various command signals of base inputOr whether electric power can be arranged on the signal on base exactly with acting on identification mobile terminal. Output is singleUnit 150 be constructed to vision, audio frequency and/or tactile manner provide output signal (for example, audio signal,Vision signal, alarm signal, vibration signal etc.).
Output unit 150 can comprise display unit 151, audio frequency output module 152 etc.
Display unit 151 may be displayed on the information of processing in mobile terminal 100. For example, work as mobile terminal100 in the time of telephone relation pattern, and display unit 151 can show and call or other (for example, literary composition of communicating by letterThis information receiving and transmitting, multimedia file are downloaded etc.) relevant user interface (UI) or graphic user interface(GUI). When mobile terminal 100 is during in video calling pattern or image capture mode, display unit 151Can the image of display capture and/or the image of reception, illustrate video or image and correlation function UI orGUI etc.
Meanwhile, in the time that display unit 151 and touch pad superpose to form touch-screen with the form of layer each other, aobviousShow that unit 151 can be used as input unit and output device. Display unit 151 can comprise liquid crystal display(LCD), thin film transistor (TFT) LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible aobviousShow at least one in device, three-dimensional (3D) display etc. Some in these displays can be constructed toTransparence is to allow user to watch from outside, and this can be called transparent display, typical transparent displayIt can be for example TOLED (transparent organic light emitting diode) display etc. According to the specific enforcement of wantingMode, mobile terminal 100 can comprise two or more display units (or other display unit), for example,Mobile terminal can comprise outernal display unit (not shown) and inner display unit (not shown). Touch-screen canFor detection of touching input pressure and touch input position and touch input area.
Audio frequency output module 152 can be at mobile terminal in call signal receiving mode, call mode, noteThe isotype such as record pattern, speech recognition mode, broadcast reception pattern lower time, wireless communication unit 110 is connectReceive or in memory 160 storage voice data convert audio signals and be output as sound. AndAnd audio frequency output module 152 can provide the audio frequency that the specific function carried out to mobile terminal 100 is relevant defeatedGo out (for example, call signal receives sound, message sink sound etc.). Audio frequency output module 152 can wrapDraw together sound pick-up, buzzer etc.
Memory 160 can be stored processing and the software program of control operation etc. carried out by controller 180Deng, or can temporarily store the data that oneself maybe will export through output (for example, telephone directory, message,Still image, video etc.). And memory 160 can be stored about in the time that touch is applied to touch-screenThe vibration of variety of way and the data of audio signal of output.
Memory 160 can comprise the storage medium of at least one type, described storage medium comprise flash memory,Hard disk, multimedia card, card type memory (for example, SD or DX memory etc.), random access storage device(RAM), static random-access memory (SRAM), read-only storage (ROM), electrically erasableRead-only storage (EEPROM), programmable read only memory (PROM), magnetic storage, disk, lightDish etc. And, mobile terminal 100 can with the memory function that is connected execute store 160 by networkNetwork storage device cooperation.
Controller 180 is controlled the overall operation of mobile terminal conventionally. For example, controller 180 is carried out and voiceThe control that call, data communication, video calling etc. are relevant and processing. In addition, controller 180 can wrapDraw together the multi-media module 181 for reproducing (or playback) multi-medium data, multi-media module 181 can be configured inIn controller 180, or can be configured to separate with controller 180. Controller 180 can execution pattern be knownOther places reason, to be identified as character or figure by the handwriting input of carrying out on touch-screen or picture drafting inputPicture.
Power subsystem 190 receives external power or internal power and behaviour is provided under the control of controller 180Make the required suitable electric power of each element and assembly.
Various embodiment described herein can be for example to use computer software, hardware or its any groupThe computer-readable medium closing is implemented. For hardware implementation, embodiment described herein can pass throughUse application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device(DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controlDevice, microcontroller, microprocessor, be designed to carry out in the electronic unit of function described herein extremelyFew one is implemented, and in some cases, such embodiment can be implemented in controller 180. RightIn implement software, can carry out at least one function or behaviour with permission such as the embodiment of process or functionThe independent software module of doing is implemented. Software code can be by writing with any suitable programming languageSoftware application (or program) is implemented, and software code can be stored in memory 160 and by controllingDevice 180 is carried out.
So far, oneself through according to its functional description mobile terminal. Below, for the sake of brevity, will describeSuch as various types of mobile terminals of folded form, board-type, oscillating-type, slide type mobile terminal etc.In slide type mobile terminal as example. Therefore, the present invention can be applied to the eventually mobile of any typeEnd, and be not limited to slide type mobile terminal.
With reference to Fig. 2, Fig. 2 is the electrical structure block diagram of camera in Fig. 1.
Phtographic lens 1211 is made up of the multiple optical lens that are used to form shot object image, is single-focus lensOr zoom lens. Phtographic lens 1211 can move under the control of lens driver 1221 on optical axis directionMoving, lens driver 1221, according to the control signal from lens driving control circuit 1222, is controlled photographyThe focal position of camera lens 1211, the in the situation that of zoom lens, also can control focal length. Lens drivingControl circuit 1222 carries out driving of lens driver 1221 according to the control command from microcomputer 1217Moving control.
Near the position of the shot object image forming on the optical axis of phtographic lens 1211, by phtographic lens 1211Dispose imaging apparatus 1212. Imaging apparatus 1212 is for making a video recording to shot object image and obtaining photographed images numberAccording to. Two dimension and be rectangular disposing and form the photodiode of each pixel on imaging apparatus 1212. RespectivelyPhotodiode produces the opto-electronic conversion electric current corresponding with light income, this opto-electronic conversion electric current by with each photoelectricityThe capacitor that diode connects carries out electric charge and accumulates. The front surface of each pixel disposes the RGB that Bayer is arrangedColour filter.
Imaging apparatus 1212 is connected with imaging circuit 1213, and this imaging circuit 1213 is in imaging apparatus 1212Carry out electric charge accumulate control and picture signal read control, to this picture signal of reading (analog picture signal)After reducing replacement noise, carry out waveform shaping, and then the raising that gain etc. is to become suitable signal level.Imaging circuit 1213 is connected with A/D converter 1214, and this A/D converter 1214 carries out analog picture signalAnalog-to-digital conversion, to bus 1227 output digital image signals (being referred to as below view data).
Bus 1227 is transfer paths of the various data reading or generate of the inside for being transmitted in camera.Connect above-mentioned A/D converter 1214 in bus 1227, connecting in addition image processor 1215, JPEGProcessor 1216, microcomputer 1217, SDRAM (SynchronousDynamicrandomaccessMemory, SDRAM) 1218, memory interface (is referred to as memory belowI/F) 1219, LCD (LiquidCrystalDisplay, liquid crystal display) driver 1220.
Image processor 1215 carries out OB to the view data of the output based on imaging apparatus 1212 and subtracts each other placeReason, blank level adjustment, color matrix computing, gamma conversion, colour difference signal processing, noise removal process,Change the various image processing such as processing, edge treated simultaneously. Jpeg processor 1216 is by Imagery Data RecordingIn the time of recording medium 1225, compress the view data of reading from SDRAM1218 according to JPEG compress mode.In addition, jpeg processor 1216 carries out the decompress(ion) of jpeg image data in order to carry out image reproducing demonstrationContracting. While decompression, read the file being recorded in recording medium 1225, at jpeg processor 1216In implemented after decompression, the view data of decompression is temporarily stored in SDRAM1218 andOn LCD1226, show. In addition, in the present embodiment, adopt as compression of images decompression modeBe JPEG mode, but compressed and decompressed mode is not limited to this, certainly can adopt MPEG, TIFF,H.264 wait other compressed and decompressed mode.
Microcomputer 1217 is brought into play the function as the control part of this camera entirety, unified control cameraVarious processing sequences. Microcomputer 1217 is connecting operating unit 1223 and flash memory 1224.
Operating unit 1223 includes but not limited to physical button or virtual key, this entity or virtual keyCan for power knob, the key of taking pictures, edit key, dynamic image button, reproduce button, menu button,The operations such as various load buttons and various enter keies such as cross key, OK button, delete button, large buttonsControl, detects the mode of operation of these operational controls.
Testing result is exported to microcomputer 1217. In addition, the LCD1226's as displayFront surface is provided with touch panel, detects user's touch location, by this touch location to microcomputer 1217Output. Microcomputer 1217, according to the testing result of the operating position from operating unit 1223, is carried outThe various processing sequences corresponding with user's operation.
Flash memory 1224 storages are used for the program of the various processing sequences of carrying out microcomputer 1217. MicrocomputerCalculation machine 1217 carries out the control of camera entirety according to this program. In addition, flash memory 1224 is stored the various of cameraAdjusted value, microcomputer 1217 is read adjusted value, carries out the control of camera according to this adjusted value.
SDRAM1218 is for view data etc. being carried out to can electric volatibility of rewriting depositing of temporary transient storageReservoir. The view data that the temporary transient storage of this SDRAM1218 is exported from A/D converter 1214 and at imageIn reason device 1215, jpeg processor 1216 etc., carry out view data after treatment.
Memory interface 1219 is connected with recording medium 1225, carries out view data and is attached to picture numberAccording in the first-class data writing recording medium 1225 of file and the control of reading from recording medium 1225. NoteRecording medium 1225 be for example can be on camera main-body the recording medium such as memory cards of disassembled and assembled freely, butBeing not limited to this, can be to be also built in hard disk in camera main-body etc.
Lcd driver 1210 is connected with LCD1226, will be by image processor 1215 picture number after treatmentAccording to being stored in SDRAM1218, need to show time, read the view data of SDRAM1218 storage andThe upper demonstration of LCD1226, or the view data that jpeg processor 1216 compressed is stored inSDRAM1218, in the time that needs show, jpeg processor 1216 reads the compression of SDRAM1218View data, then decompress, the view data after decompressing is shown by LCD1226.
LCD1226 is configured in the back side of camera main-body and carries out image demonstration. This LCD1226LCD), butBe not limited to this, also can adopt the various display floaters (LCD1226) such as organic EL, but be not limited to this,Also can adopt the various display floaters such as organic EL.
Based on the electrical structure schematic diagram of above-mentioned mobile terminal hardware configuration and camera, base of the present invention is proposedIn eyeprint identification comparison film, personage carries out each embodiment of terminal of eyelid reconstruction.
As shown in Figure 3, the present invention is based on personage in eyeprint identification comparison film and carry out the terminal the of eyelid reconstructionIn one embodiment, this terminal of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film comprises:
Detection module 01, for detection of the eyelid reconstruction instruction of pending photo;
In the present embodiment, in the time that terminal use checks the photo of taking in terminal, if desired to the photograph of checkingWhen sheet carries out eyelid reconstruction processing, can send corresponding eyelid reconstruction instruction to terminal. As terminal can be passed throughDetect the press instruction of user to pre-set button, or detect user to the default gesture instruction on touch-screen,Or utilize pressure sensor to detect the modes such as the default gesture instruction of user on the induction region of terminal back and comeSense terminals user is to the current eyelid reconstruction instruction of checking photo, in this no limit.
In the optional embodiment of one, in the time receiving terminal use's photo and check instruction, be alsoIn the time that terminal use checks the photo of taking in terminal, can utilize eyeball tracking technology to check terminal useThe time of single photo is carried out timing; If terminal use checks that the time of single photo exceedes Preset Time thresholdValue, and detect in the photo that terminal use checks and have the personage who closes one's eyes, terminal use is checkedPhoto is as pending photo, and is identified as the eyelid reconstruction instruction detecting pending photo. As rootFind according to statistics, user is to the response patience of an application the chances are 3s, when user likes a photoTime, can zoom in or out and check photo, sometimes also can sliding the seeing in left and right contrast, this process can exceed10s. Therefore can be, 10s by Preset Time Threshold, when the current photograph that detects that terminal use checksIn sheet, have the personage who is closing eyes, and the time that terminal use stops in this photo exceed 10s,Judge that this photo that has the personage who is closing eyes is the photo that user likes, need to be to this photo placeReason, is identified as the eyelid reconstruction instruction detecting this photo.
Matching module 02, in the time described eyelid reconstruction instruction being detected, identifies described pending photoPersonage's facial characteristics that middle existence is closed one's eyes, mates described personage's facial characteristics with preset facial characteristics;
In the time described eyelid reconstruction instruction being detected, trigger the current pending photograph of checking to terminal useThe eyelid reconstruction operation of sheet. First identify personage's facial characteristics that in described pending photo, existence is closed one's eyes,As eyes, nose, face etc. can distinguish the feature of different people thing facial features, then by described in identificationIn pending photo, exist personage's facial characteristics of closing one's eyes to mate with preset facial characteristics. Wherein, shouldPreset facial characteristics can be both pre-stored one or more users' in terminal facial characteristics, alsoCan be the current gripping terminal use's that goes out by the camera Real time identification of terminal facial characteristics, at thisBe not construed as limiting.
As user can be in advance preset at self and multiple good friends' facial characteristics respectively in terminal, work as needsWhen pending photo is carried out to eyelid reconstruction operation, existence in the described pending photo of identification is closed one's eyesPersonage's facial characteristics mates with preset facial characteristics, can be according to the facial characteristics pair being preset in terminalShould identify personage that in described pending photo, existence is closed one's eyes for self or other good friends, and then carry out notSame eyelid reconstruction.
Repair module 03, if match for described personage's facial characteristics and preset facial characteristics, obtain instituteState the eyeprint feature that preset facial characteristics is corresponding, and based on described eyeprint feature in described pending photoThe personage that existence is closed one's eyes carries out eyelid reconstruction.
If described personage's facial characteristics and preset facial characteristics match, can obtain described preset face specialLevy corresponding eyeprint feature, and the people who existence in described pending photo is closed one's eyes based on described eyeprint featureThing carries out eyelid reconstruction. Wherein, described eyeprint feature can be to carry the preset facial characteristics from matchingTaking out, can be to be also preset in terminal and the accurate eye corresponding storage of described preset facial characteristicsLine feature, in this no limit.
As existed in pending photo as described in identifying and close one's eyes according to being preset at facial characteristics correspondence in terminalPersonage be after self or other good friends, obtain from self or other good friends' preset facial characteristics and extractThe eyeprint feature going out, or directly from being preset at terminal and preset facial characteristics self or other good friendsIn the accurate eyeprint feature of corresponding storage, find out self or other good friends' eyeprint feature. Can be based on oneselfBody or other good friends' eyeprint feature is respectively to existing the personage who closes one's eyes to carry out correspondence in described pending photoEyelid reconstruction, thereby complete the eyelid reconstruction of whole pending photo.
In the present embodiment when detect pending photo eyelid reconstruction instruction time, by described pending photographIn sheet, exist personage's facial characteristics of closing one's eyes to mate with preset facial characteristics; If described personage's face is specialLevy with preset facial characteristics and match, obtain the eyeprint feature that described preset facial characteristics is corresponding, and baseExist the personage that closes one's eyes to carry out eyelid reconstruction in described eyeprint feature in to described pending photo. Due to energyUtilize the corresponding eyeprint feature of personage's facial characteristics of closing one's eyes with existence in described pending photo to carry out phaseThe eyelid reconstruction of answering, can carry out accurate eyelid reconstruction for the personages that closes one's eyes different in pending photo,Can more effectively carry out eyelid reconstruction to pending photo.
Further, in the optional embodiment of one, as shown in Figure 4, Figure 5, Fig. 4 is the present inventionCarry out based on personage in eyeprint identification comparison film having the personage that closes one's eyes in terminal first embodiment of eyelid reconstructionPending photo, Fig. 5 is the end that the present invention is based on personage in eyeprint identification comparison film and carry out eyelid reconstructionHold in the first embodiment existing the personage that closes one's eyes to carry out the photo after eyelid reconstruction in pending photo.
In the present embodiment, detection module 01 can utilize eyeball tracking technology to check single photo to terminal useTime carry out timing t, exceed 10s if terminal use checks the time t of single photo, and end detectedIn the photo that end subscriber is checked, have the personage who closes one's eyes, the photo of terminal use being checked is as pendingPhoto, and be identified as the eyelid reconstruction instruction detecting pending photo. Described in matching module 02 identificationIn pending photo, there is personage's facial characteristics of closing one's eyes, as features such as eyes, nose, faces, meanwhile,Matching module 02 is also identified current terminal use's face, and by the current terminal use who identifiesFacial characteristics and described pending photo in exist personage's facial characteristics of closing one's eyes to contrast, judgement is worked asIn front terminal use and described pending photo, have whether the personage who closes one's eyes is same person. Repair module03 exists judging according to the comparison result of matching module 02 in current terminal use and described pending photoWhen the personage who closes one's eyes is same person, utilize eyeprint recognition technology to enter current terminal use's eye featureLine item, in the time that recording ratio reaches 90%, treats described according to the current terminal use's of record eye featureProcess in photo and exist the personage's that closes one's eyes eye to repair, by closing one's eyes of personage in described pending photoState reparation is the state of opening eyes normally. And due to the eye to current terminal use by eyeprint recognition technologyWhen portion's feature records record be vector data, therefore, user in the time zooming in or out photo, eyePortion's feature is undistorted.
Further, in other embodiments, above-mentioned matching module 02 can be for:
In the time described eyelid reconstruction instruction being detected, to checking terminal use's the face of described pending photoPortion identifies, and obtains terminal use's facial characteristics;
Obtain personage's facial characteristics that in described pending photo, existence is closed one's eyes;
Described personage's facial characteristics is mated with terminal use's facial characteristics.
Above-mentioned reparation module 03 can be for:
If described personage's facial characteristics and terminal use's facial characteristics matches, described in checking, wait to locateThe terminal use's of reason photo eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rateTime, the eyeprint feature based on record is to existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo.
In the present embodiment when detect pending photo eyelid reconstruction instruction time, automatically starting is prepositionCamera, identifies the current terminal use's who checks described pending photo face, obtains terminalUser's eyes, nose, face etc. can distinguish the facial characteristics of different people thing facial features. Obtain instituteState personage's facial characteristics that in pending photo, existence is closed one's eyes, and described personage's facial characteristics and terminal are usedThe facial characteristics at family mates. If described personage's facial characteristics and terminal use's facial characteristics matches,Judge that the personage that in described pending photo, existence is closed one's eyes is current terminal use, can be furtherObtain the eyeprint data in terminal use's facial feature data, also to checking described pending photoTerminal use's eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rate as 90% time,Eyeprint feature has effectively been recorded out in judgement, and eyeprint feature that can be based on record is to described pending photographIn sheet, exist terminal use's eye of closing one's eyes to repair.
Because the photo major part of terminal taking is the photo that comprises terminal use self, utilize preposition shootingHead is identified the current terminal use's who checks described pending photo face can be to most photographSheet is processed, and in the time of the eyelid reconstruction instruction to pending photo, can utilize preposition taking the photograph each timeFacial characteristics and corresponding eyeprint feature as the up-to-date terminal use of a Real-time Obtaining are repaired, can be moreAdd effectively pending photo is carried out to eyelid reconstruction, improved pending photo is carried out to eyelid reconstructionAccuracy.
Further, in other embodiments, above-mentioned reparation module 03 can also be used for:
When receive described pending photo amplification instruction time, based on described eyeprint feature and after amplifyingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction;
When receive to described pending photo dwindle instruction time, based on described eyeprint feature and after dwindlingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction.
In the present embodiment, the data for the eyeprint feature of carrying out eyelid reconstruction of obtaining are vectorsData, when receive described pending photo amplification instruction time, based on described eyeprint feature and amplificationAfter described pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction; When receiving, described waiting locatedReason photo dwindle instruction time, the described pending photo based on described eyeprint feature and after dwindling to existThe personage who closes one's eyes carries out eyelid reconstruction.
The present embodiment can be aobvious according to there is personage's face and the ratio of eyes of closing one's eyes in pending photoShow the eyeprint feature of identification, can, according to the size of terminal use's convergent-divergent photo, eyeprint feature be carried out to phaseThat answers zooms in or out. Like this, terminal use, in the time of the pending photo of checking after eyeprint is repaired, repairsEyeprint feature can distortion in the time zooming in or out, truer on the contrary, treating after eyeprint reparation locatedNo matter reason photo can reach good display effect in the time zooming in or out.
Further, in other embodiments, every photo first user being checked carries out timing t, inspectionWhether have the bust that closing eyes, if so, continue to detect user in this photo if surveying current photoThe time t stopping, if time of staying t is more than or equal to 10s, identifies user's face, and andThe bust that is closing eyes in photo contrasts, if judgement is same person according to comparison result, and profitWith eyeprint identification, user's eye feature is carried out to record, in the time that recording ratio reaches 90%, in comparison film, closeThe eye of the bust of eyes and repair, is vector data due to what record, and therefore user amplifies contractingWhen small photo, eye feature is undistorted.
The present invention further provides a kind of side that carries out eyelid reconstruction based on personage in eyeprint identification comparison filmMethod, with reference to Fig. 6, the present invention is based on personage in eyeprint identification comparison film, to carry out the method one of eyelid reconstruction realExecute in example, this method of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film comprises:
Step S10, detects the eyelid reconstruction instruction of pending photo;
In the present embodiment, in the time that terminal use checks the photo of taking in terminal, if desired to the photograph of checkingWhen sheet carries out eyelid reconstruction processing, can send corresponding eyelid reconstruction instruction to terminal. As terminal can be passed throughDetect the press instruction of user to pre-set button, or detect user to the default gesture instruction on touch-screen,Or utilize pressure sensor to detect the modes such as the default gesture instruction of user on the induction region of terminal back and comeSense terminals user is to the current eyelid reconstruction instruction of checking photo, in this no limit.
In the optional embodiment of one, in the time receiving terminal use's photo and check instruction, be alsoIn the time that terminal use checks the photo of taking in terminal, can utilize eyeball tracking technology to check terminal useThe time of single photo is carried out timing; If terminal use checks that the time of single photo exceedes Preset Time thresholdValue, and detect in the photo that terminal use checks and have the personage who closes one's eyes, terminal use is checkedPhoto is as pending photo, and is identified as the eyelid reconstruction instruction detecting pending photo. As rootFind according to statistics, user is to the response patience of an application the chances are 3s, when user likes a photoTime, can zoom in or out and check photo, sometimes also can sliding the seeing in left and right contrast, this process can exceed10s. Therefore can be, 10s by Preset Time Threshold, when the current photograph that detects that terminal use checksIn sheet, have the personage who is closing eyes, and the time that terminal use stops in this photo exceed 10s,Judge that this photo that has the personage who is closing eyes is the photo that user likes, need to be to this photo placeReason, is identified as the eyelid reconstruction instruction detecting this photo.
Step S20, in the time described eyelid reconstruction instruction being detected, identifies in described pending photo and exists and closePersonage's facial characteristics of eye, mates described personage's facial characteristics with preset facial characteristics;
In the time described eyelid reconstruction instruction being detected, trigger the current pending photograph of checking to terminal useThe eyelid reconstruction operation of sheet. First identify personage's facial characteristics that in described pending photo, existence is closed one's eyes,As eyes, nose, face etc. can distinguish the feature of different people thing facial features, then by described in identificationIn pending photo, exist personage's facial characteristics of closing one's eyes to mate with preset facial characteristics. Wherein, shouldPreset facial characteristics can be both pre-stored one or more users' in terminal facial characteristics, alsoCan be the current gripping terminal use's that goes out by the camera Real time identification of terminal facial characteristics, at thisBe not construed as limiting.
As user can be in advance preset at self and multiple good friends' facial characteristics respectively in terminal, work as needsWhen pending photo is carried out to eyelid reconstruction operation, existence in the described pending photo of identification is closed one's eyesPersonage's facial characteristics mates with preset facial characteristics, can be according to the facial characteristics pair being preset in terminalShould identify personage that in described pending photo, existence is closed one's eyes for self or other good friends, and then carry out notSame eyelid reconstruction.
Step S30, if described personage's facial characteristics and preset facial characteristics match, obtains described presetThe eyeprint feature that portion's feature is corresponding, and based on described eyeprint feature to existing and close one's eyes in described pending photoPersonage carry out eyelid reconstruction.
If described personage's facial characteristics and preset facial characteristics match, can obtain described preset face specialLevy corresponding eyeprint feature, and the people who existence in described pending photo is closed one's eyes based on described eyeprint featureThing carries out eyelid reconstruction. Wherein, described eyeprint feature can be to carry the preset facial characteristics from matchingTaking out, can be to be also preset in terminal and the accurate eye corresponding storage of described preset facial characteristicsLine feature, in this no limit.
As existed in pending photo as described in identifying and close one's eyes according to being preset at facial characteristics correspondence in terminalPersonage be after self or other good friends, obtain from self or other good friends' preset facial characteristics and extractThe eyeprint feature going out, or directly from being preset at terminal and preset facial characteristics self or other good friendsIn the accurate eyeprint feature of corresponding storage, find out self or other good friends' eyeprint feature. Can be based on oneselfBody or other good friends' eyeprint feature is respectively to existing the personage who closes one's eyes to carry out correspondence in described pending photoEyelid reconstruction, thereby complete the eyelid reconstruction of whole pending photo.
In the present embodiment when detect pending photo eyelid reconstruction instruction time, by described pending photographIn sheet, exist personage's facial characteristics of closing one's eyes to mate with preset facial characteristics; If described personage's face is specialLevy with preset facial characteristics and match, obtain the eyeprint feature that described preset facial characteristics is corresponding, and baseExist the personage that closes one's eyes to carry out eyelid reconstruction in described eyeprint feature in to described pending photo. Due to energyUtilize the corresponding eyeprint feature of personage's facial characteristics of closing one's eyes with existence in described pending photo to carry out phaseThe eyelid reconstruction of answering, can carry out accurate eyelid reconstruction for the personages that closes one's eyes different in pending photo,Can more effectively carry out eyelid reconstruction to pending photo.
Further, in the optional embodiment of one, first, can utilize eyeball tracking technology to endEnd subscriber checks that the time of single photo carries out timing t, if terminal use checks that the time t of single photo is superCross 10s, and detect in the photo that terminal use checks and have the personage who closes one's eyes, terminal use is checkedPhoto as pending photo, and be identified as the eyelid reconstruction instruction detecting pending photo. AgainIdentify personage's facial characteristics that in described pending photo, existence is closed one's eyes, as spies such as eyes, nose, facesLevy,, also current terminal use's face is identified meanwhile, and by the current terminal use who identifiesFacial characteristics and described pending photo in exist personage's facial characteristics of closing one's eyes to contrast, judgement is worked asIn front terminal use and described pending photo, have whether the personage who closes one's eyes is same person. According to thanResult is judged to the personage that in current terminal use and described pending photo, existence is closed one's eyes is same personTime, utilize eyeprint recognition technology to carry out record to current terminal use's eye feature, when recording ratio reaches 90%Time, according to the current terminal use's of record eye feature to there is the personage that closes one's eyes in described pending photoEye repair, be the shape of opening eyes normally by the closed-eye state reparation of personage in described pending photoState. And owing to by eyeprint recognition technology, current terminal use's eye feature being recorded time recordBe vector data, therefore, user is in the time zooming in or out photo, and eye feature is undistorted.
Further, in other embodiments, above-mentioned steps S20 can comprise:
In the time described eyelid reconstruction instruction being detected, to checking terminal use's the face of described pending photoPortion identifies, and obtains terminal use's facial characteristics;
Obtain personage's facial characteristics that in described pending photo, existence is closed one's eyes;
Described personage's facial characteristics is mated with terminal use's facial characteristics.
Above-mentioned steps S30 can comprise:
If described personage's facial characteristics and terminal use's facial characteristics matches, described in checking, wait to locateThe terminal use's of reason photo eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rateTime, the eyeprint feature based on record is to existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo.
In the present embodiment when detect pending photo eyelid reconstruction instruction time, automatically starting is prepositionCamera, identifies the current terminal use's who checks described pending photo face, obtains terminalUser's eyes, nose, face etc. can distinguish the facial characteristics of different people thing facial features. Obtain instituteState personage's facial characteristics that in pending photo, existence is closed one's eyes, and described personage's facial characteristics and terminal are usedThe facial characteristics at family mates. If described personage's facial characteristics and terminal use's facial characteristics matches,Judge that the personage that in described pending photo, existence is closed one's eyes is current terminal use, can be furtherObtain the eyeprint data in terminal use's facial feature data, also to checking described pending photoTerminal use's eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rate as 90% time,Eyeprint feature has effectively been recorded out in judgement, and eyeprint feature that can be based on record is to described pending photographIn sheet, exist terminal use's eye of closing one's eyes to repair.
Because the photo major part of terminal taking is the photo that comprises terminal use self, utilize preposition shootingHead is identified the current terminal use's who checks described pending photo face can be to most photographSheet is processed, and in the time of the eyelid reconstruction instruction to pending photo, can utilize preposition taking the photograph each timeFacial characteristics and corresponding eyeprint feature as the up-to-date terminal use of a Real-time Obtaining are repaired, can be moreAdd effectively pending photo is carried out to eyelid reconstruction, improved pending photo is carried out to eyelid reconstructionAccuracy.
Further, in other embodiments, above-mentioned steps S30 can also comprise:
When receive described pending photo amplification instruction time, based on described eyeprint feature and after amplifyingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction;
When receive to described pending photo dwindle instruction time, based on described eyeprint feature and after dwindlingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction.
In the present embodiment, the data for the eyeprint feature of carrying out eyelid reconstruction of obtaining are vectorsData, when receive described pending photo amplification instruction time, based on described eyeprint feature and amplificationAfter described pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction; When receiving, described waiting locatedReason photo dwindle instruction time, the described pending photo based on described eyeprint feature and after dwindling to existThe personage who closes one's eyes carries out eyelid reconstruction.
The present embodiment can be aobvious according to there is personage's face and the ratio of eyes of closing one's eyes in pending photoShow the eyeprint feature of identification, can, according to the size of terminal use's convergent-divergent photo, eyeprint feature be carried out to phaseThat answers zooms in or out. Like this, terminal use, in the time of the pending photo of checking after eyeprint is repaired, repairsEyeprint feature can distortion in the time zooming in or out, truer on the contrary, treating after eyeprint reparation locatedNo matter reason photo can reach good display effect in the time zooming in or out.
As shown in Figure 7, Fig. 7 the present invention is based on personage in eyeprint identification comparison film to carry out eyelid reconstructionIn method one embodiment, terminal use is carried out the schematic flow sheet of eyelid reconstruction.
In the present embodiment, every photo first user being checked carries out timing t, whether detects current photoThere is the bust that is closing eyes, if so, continue to detect the time t that user stops in this photo, ifThe time of staying, t was more than or equal to 10s, user's face is identified, and and photo in closing eyesBust contrasts, if judgement is same person according to comparison result, utilizes eyeprint identification, to usingThe eye feature at family carries out record, in the time that recording ratio reaches 90%, is closing the bust of eyes in comparison filmEye is repaired, and is vector data due to what record, and therefore user amplifies while dwindling photo, eye spyLevy undistorted.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variantBe intended to contain comprising of nonexcludability, thus make to comprise a series of key elements process, method, article orPerson's device not only comprises those key elements, but also comprises other key elements of clearly not listing, or alsoBe included as the intrinsic key element of this process, method, article or device. There is no the feelings of more restrictionsUnder condition, by statement " comprising ... " limit key element, and be not precluded within comprise this key element process,In method, article or device, also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to above-mentionedThe mode that embodiment method can add essential general hardware platform by software realizes, and can certainly lead toCross hardware, but in a lot of situation, the former is better embodiment. Based on such understanding, of the present inventionThe part that technical scheme contributes to prior art in essence in other words can be with the form body of software productReveal to come, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, lightDish) in, (can be mobile phone, computer, serves in order to make a station terminal equipment to comprise some instructionsDevice, air-conditioner, or the network equipment etc.) carry out the method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, everyUtilize equivalent structure or the conversion of equivalent flow process that description of the present invention and accompanying drawing content do, or directly orConnect and be used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (10)
1. a terminal of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film, is characterized in that,Described terminal of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film comprises:
Detection module, for detection of the eyelid reconstruction instruction of pending photo;
Matching module, in the time described eyelid reconstruction instruction being detected, identifies in described pending photoPersonage's facial characteristics that existence is closed one's eyes, mates described personage's facial characteristics with preset facial characteristics;
Repair module, if match for described personage's facial characteristics and preset facial characteristics, described in obtainingThe eyeprint feature that preset facial characteristics is corresponding, and based on described eyeprint feature to depositing in described pending photoCarry out eyelid reconstruction the personage who closes one's eyes.
2. end of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film as claimed in claim 1End, it is characterized in that, described detection module also for:
In the time receiving terminal use's photo and check instruction, terminal use is checked to the time of single photoCarry out timing; If terminal use checks that the time of single photo exceedes Preset Time threshold value, and end detectedIn the photo that end subscriber is checked, have the personage who closes one's eyes, the photo of terminal use being checked is as pendingPhoto, and be identified as the eyelid reconstruction instruction detecting pending photo.
3. as claimed in claim 1 or 2ly carry out eyelid reconstruction based on personage in eyeprint identification comparison filmTerminal, is characterized in that, described matching module also for:
In the time described eyelid reconstruction instruction being detected, to checking terminal use's the face of described pending photoPortion identifies, and obtains terminal use's facial characteristics; Obtain in described pending photo to exist and close one's eyesPersonage's facial characteristics; Described personage's facial characteristics is mated with terminal use's facial characteristics.
4. end of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film as claimed in claim 3End, it is characterized in that, described reparation module also for:
If described personage's facial characteristics and terminal use's facial characteristics matches, described in checking, wait to locateThe terminal use's of reason photo eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rateTime, the eyeprint feature based on record is to existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo.
5. end of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film as claimed in claim 1End, it is characterized in that, described reparation module also for:
When receive described pending photo amplification instruction time, based on described eyeprint feature and after amplifyingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction; When receiving described pendingPhoto dwindle instruction time, the described pending photo based on described eyeprint feature and after dwindling to exist closeThe personage of eye carries out eyelid reconstruction.
6. a method of carrying out eyelid reconstruction based on personage in eyeprint identification comparison film, is characterized in that,Describedly carry out eyelid reconstruction based on personage in eyeprint identification comparison film and comprise the following steps:
Detect the eyelid reconstruction instruction of pending photo;
In the time described eyelid reconstruction instruction being detected, identify the personage that in described pending photo, existence is closed one's eyesFacial characteristics, mates described personage's facial characteristics with preset facial characteristics;
If described personage's facial characteristics and preset facial characteristics match, obtain described preset facial characteristics pairThe eyeprint feature of answering, and the personage who existence in described pending photo is closed one's eyes based on described eyeprint feature entersRow eyelid reconstruction.
7. the side that carries out eyelid reconstruction based on personage in eyeprint identification comparison film as claimed in claim 6Method, is characterized in that, the step of the eyelid reconstruction instruction of the pending photo of described detection comprises:
In the time receiving terminal use's photo and check instruction, terminal use is checked to the time of single photoCarry out timing;
If terminal use checks that the time of single photo exceedes Preset Time threshold value, and terminal use detectedIn the photo of checking, have the personage that closes one's eyes, the photo of terminal use being checked is as pending photo,And be identified as the eyelid reconstruction instruction detecting pending photo.
8. as described in claim 6 or 7, carry out eyelid reconstruction based on personage in eyeprint identification comparison filmMethod, is characterized in that, described in the time described eyelid reconstruction instruction being detected, identifies described pending photographIn sheet, there is personage's facial characteristics of closing one's eyes, described personage's facial characteristics and preset facial characteristics are carried outThe step of joining comprises:
In the time described eyelid reconstruction instruction being detected, to checking terminal use's the face of described pending photoPortion identifies, and obtains terminal use's facial characteristics;
Obtain personage's facial characteristics that in described pending photo, existence is closed one's eyes;
Described personage's facial characteristics is mated with terminal use's facial characteristics.
9. the side that carries out eyelid reconstruction based on personage in eyeprint identification comparison film as claimed in claim 8Method, is characterized in that, if described personage's facial characteristics and preset facial characteristics match, obtains instituteState the eyeprint feature that preset facial characteristics is corresponding, and based on described eyeprint feature in described pending photoThe step that the personage that existence is closed one's eyes carries out eyelid reconstruction comprises:
If described personage's facial characteristics and terminal use's facial characteristics matches, described in checking, wait to locateThe terminal use's of reason photo eyeprint feature is carried out record, when the eyeprint feature of record reaches preset recording rateTime, the eyeprint feature based on record is to existing the personage who closes one's eyes to carry out eyelid reconstruction in described pending photo.
10. the side that carries out eyelid reconstruction based on personage in eyeprint identification comparison film as claimed in claim 6Method, is characterized in that, the described people who existence in described pending photo is closed one's eyes based on described eyeprint featureThe step that thing carries out eyelid reconstruction comprises:
When receive described pending photo amplification instruction time, based on described eyeprint feature and after amplifyingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction;
When receive to described pending photo dwindle instruction time, based on described eyeprint feature and after dwindlingDescribed pending photo to existing the personage that closes one's eyes to carry out eyelid reconstruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510980347.1A CN105592249B (en) | 2015-12-23 | 2015-12-23 | The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510980347.1A CN105592249B (en) | 2015-12-23 | 2015-12-23 | The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105592249A true CN105592249A (en) | 2016-05-18 |
| CN105592249B CN105592249B (en) | 2018-12-21 |
Family
ID=55931436
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510980347.1A Active CN105592249B (en) | 2015-12-23 | 2015-12-23 | The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105592249B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106251316A (en) * | 2016-08-29 | 2016-12-21 | 珠海格力电器股份有限公司 | The restorative procedure of photo and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006330800A (en) * | 2005-05-23 | 2006-12-07 | Nippon Telegr & Teleph Corp <Ntt> | Image synthesis system, image synthesis method, and program of the method |
| CN101617339A (en) * | 2007-02-15 | 2009-12-30 | 索尼株式会社 | Image processing apparatus and image processing method |
| CN102055912A (en) * | 2009-10-29 | 2011-05-11 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| CN103310186A (en) * | 2012-02-29 | 2013-09-18 | 三星电子株式会社 | Method for correcting user's gaze direction in image, machine-readable storage medium and communication terminal |
| CN104954678A (en) * | 2015-06-15 | 2015-09-30 | 联想(北京)有限公司 | Image processing method, image processing device and electronic equipment |
| CN104978566A (en) * | 2015-06-05 | 2015-10-14 | 深圳市金立通信设备有限公司 | Picture processing method and terminal |
| CN105072327A (en) * | 2015-07-15 | 2015-11-18 | 广东欧珀移动通信有限公司 | Eye-closing-preventing person photographing method and device thereof |
-
2015
- 2015-12-23 CN CN201510980347.1A patent/CN105592249B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006330800A (en) * | 2005-05-23 | 2006-12-07 | Nippon Telegr & Teleph Corp <Ntt> | Image synthesis system, image synthesis method, and program of the method |
| CN101617339A (en) * | 2007-02-15 | 2009-12-30 | 索尼株式会社 | Image processing apparatus and image processing method |
| CN102055912A (en) * | 2009-10-29 | 2011-05-11 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| CN103310186A (en) * | 2012-02-29 | 2013-09-18 | 三星电子株式会社 | Method for correcting user's gaze direction in image, machine-readable storage medium and communication terminal |
| CN104978566A (en) * | 2015-06-05 | 2015-10-14 | 深圳市金立通信设备有限公司 | Picture processing method and terminal |
| CN104954678A (en) * | 2015-06-15 | 2015-09-30 | 联想(北京)有限公司 | Image processing method, image processing device and electronic equipment |
| CN105072327A (en) * | 2015-07-15 | 2015-11-18 | 广东欧珀移动通信有限公司 | Eye-closing-preventing person photographing method and device thereof |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106251316A (en) * | 2016-08-29 | 2016-12-21 | 珠海格力电器股份有限公司 | The restorative procedure of photo and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105592249B (en) | 2018-12-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430295B (en) | Image processing apparatus and method | |
| CN105100609B (en) | The adjusting method of mobile terminal and acquisition parameters | |
| CN105959543B (en) | It is a kind of to remove reflective filming apparatus and method | |
| CN104660903B (en) | Image pickup method and filming apparatus | |
| CN105516423A (en) | Mobile terminal, data transmission system and mobile terminal shoot method | |
| CN105096241A (en) | Face image beautifying device and method | |
| CN105100481A (en) | Shooting method and apparatus, and mobile terminal | |
| CN104902185B (en) | Image pickup method and device | |
| CN105959554B (en) | Video capture device and method | |
| CN105335458B (en) | Preview picture method and device | |
| CN105578056A (en) | Photographing terminal and method | |
| CN105513021B (en) | Image denoising device and method | |
| CN105704369B (en) | A kind of information processing method and device, electronic equipment | |
| CN105357444B (en) | focusing method and device | |
| CN105245777A (en) | Method and device for generating video image | |
| CN104767941A (en) | Photography method and device | |
| CN109788268A (en) | Terminal and its white balance correction control method and computer readable storage medium | |
| CN105472246A (en) | Photographing device and method | |
| CN105872361A (en) | Shooting guidance device, system and method | |
| CN105469357B (en) | Image processing method, device and terminal | |
| CN105491358B (en) | A kind of image processing method and device, terminal | |
| CN104796625A (en) | Picture synthesizing method and device | |
| CN105611264A (en) | Automatic white balance method and device | |
| CN105407275B (en) | Photo synthesizer and method | |
| CN105163035A (en) | Mobile terminal shooting system and mobile terminal shooting method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |