CN106650631A - Camera preview-based face recognition method and device - Google Patents
Camera preview-based face recognition method and device Download PDFInfo
- Publication number
- CN106650631A CN106650631A CN201611042433.9A CN201611042433A CN106650631A CN 106650631 A CN106650631 A CN 106650631A CN 201611042433 A CN201611042433 A CN 201611042433A CN 106650631 A CN106650631 A CN 106650631A
- Authority
- CN
- China
- Prior art keywords
- face
- compression
- frame
- interface
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Telephone Function (AREA)
Abstract
The present invention discloses a camera preview-based face recognition device. The camera preview-based face recognition device is applied to a mobile terminal capable of photographing. The device comprises a detection module, a compression module, a recognition module and a display module; the detection module is used for extracting a preview frame from a current view-finding interface when detecting that the current view finding interface is enabled under a compression and recognition mode; the compression module is used for compressing the preview frame according to the image pixels of the preview frame; the recognition module is used for performing face recognition on the compressed preview frame to determine the position information of a recognized face; and the display module is used for displaying a face frame in a corresponding area of the view-finding interface according to the position information. Thus, the preview frame of the view-finding interface is compressed, and face recognition is performed in the compressed frame, and therefore, the efficiency of face recognition can be greatly improved, a user can faster experience a face recognition effect, and the face recognition user experience of the mobile terminal can be enhanced.
Description
Technical field
The present invention relates to communication technique field, more particularly to recognition of face side of the mobile terminal capable of taking pictures based on camera preview
Method and device.
Background technology
As the mobile terminals such as mobile phone are possessed by increasing user, now, people are for the dependence of mobile terminal
Property more and more higher, thus, for the diversified and intellectuality of the function of mobile terminal also improves higher requirement.Currently, move
The camera function of dynamic terminal is increasingly favored using the variation of scene because of camera by user, thus, user is to mobile terminal
Camera function intelligent requirements more and more higher.User using mobile terminal camera when being taken pictures, it is often desired to detects people
Face, then carries out follow-up exposure or other operations according to the position of face, but, current silent frame detection face is special
The method levied, its speed does not often reach user's requirement, and acquisition face can be caused to show that face frame is partially slow.
Therefore, it is necessary to provide a kind of face identification method based on camera preview and device, it is to avoid above-mentioned situation goes out
It is existing, improve Consumer's Experience.
The content of the invention
Present invention is primarily targeted at proposing a kind of face identification method and device based on camera preview, it is intended to solve
Mobile terminal face frame showed slow problem in prior art.
For achieving the above object, the present invention proposes a kind of face identification device based on camera preview, is applied to capable of taking pictures
Mobile terminal, described device includes：
Detecting module, for compress recognition mode under when detect camera view interface open when, from camera view circle
Extract preview frame in face；
Compression module, is compressed for the picture pixel according to the preview frame to the preview frame；
Identification module, carries out recognition of face to determine the position of the face for recognizing for the preview frame after to compression
Information；
Display module, for showing face frame in the corresponding region at the interface of finding a view according to the positional information.
Alternatively, described device also includes：
Trigger module, for after default triggering command is detected, opening compression recognition mode.
Alternatively, the compression module is specifically included：
Pixel detecting unit, the picture pixel current for detecting the preview frame, it is right to determine according to the picture pixel
The compression multiple answered；
Multiple compression unit, for being compressed to the preview frame according to the compression multiple.
Alternatively, the face quantity for recognizing is one or more, and described device also includes：
Screening module, for pointing out user to select current face's exposal model, the face exposal model includes
Single player mode, multi-player mode and everybody's pattern.
Alternatively, the display module is specifically included：
Sequencing unit, is ranked up for taking quantity according to pixel to the face for recognizing；
Selected unit, for according to current face's exposal model and ranking results selected target face；
Display unit, for showing the target face in the corresponding region at the interface of finding a view according to the positional information
Corresponding face frame.
Additionally, for achieving the above object, the present invention also proposes a kind of face identification method based on camera preview, is applied to
Mobile terminal capable of taking pictures, the method comprising the steps of：
Under compression recognition mode when camera view interface opening is detected, from camera view interface extraction preview frame；
The preview frame is compressed according to the picture pixel of the preview frame；
The preview frame after to compression carries out recognition of face to determine the positional information of the face for recognizing；
Face frame is shown according to the positional information in the corresponding region at the interface of finding a view.
Alternatively, methods described also includes:
After default triggering command is detected, compression recognition mode is opened.
Alternatively, the picture pixel according to the preview frame is compressed to the preview frame and specifically includes：
The current picture pixel of the preview frame is detected, according to the picture pixel corresponding compression multiple is determined；
The preview frame is compressed according to the compression multiple.
Alternatively, the face quantity for recognizing is one or more, and methods described also includes：
Prompting user is selected current face's exposal model, and the face exposal model includes single player mode, many people
Pattern and everybody's pattern.
Alternatively, it is described to show that face frame is specifically wrapped in the corresponding region at the interface of finding a view according to the positional information
Include：
Quantity is taken according to pixel to be ranked up the face for recognizing；
According to current face's exposal model and ranking results selected target face；
The corresponding face frame of the target face is shown according to the positional information in the corresponding region at the interface of finding a view.
Face identification method proposed by the present invention and device, mobile terminal is taken when detecting camera under compression recognition mode
When scape interface is opened, from camera view interface extraction preview frame；The preview frame is entered according to the picture pixel of the preview frame
Row compression；The preview frame after to compression carries out recognition of face to determine the positional information of the face for recognizing；According to described
Positional information shows face frame in the corresponding region at the interface of finding a view.So as to by compressing interface preview frame of finding a view, in compression
Recognition of face is carried out in frame, the efficiency of recognition of face is greatly improved so that user can experience faster recognition of face effect,
Enhance the Consumer's Experience of mobile terminal recognition of face.
Description of the drawings
Fig. 1 is the hardware architecture diagram for realizing the optional mobile terminal of each embodiment one of the invention；
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；
The module diagram of the face identification device that Fig. 3 is provided for first embodiment of the invention；
Another module diagram of the face identification device that Fig. 4 is provided for second embodiment of the invention；
Fig. 5 arranges the exemplary plot of interface one for mobile terminal fast in the present invention；
Fig. 6 is the exemplary plot of mobile terminal camera interface one in the present invention；
Fig. 7 compresses latter case figure for the preview frame at interface of finding a view in Fig. 6；
Fig. 8 is another exemplary plot in mobile terminal camera interface in the present invention；
The schematic flow sheet of the face identification method that Fig. 9 is provided for third embodiment of the invention；
Figure 10 is the refinement schematic flow sheet of step 910 in third embodiment of the invention.
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that specific embodiment described herein is not intended to limit the present invention only to explain the present invention.
The mobile terminal of each embodiment of the invention is realized referring now to Description of Drawings.In follow-up description, use
For represent element such as " module ", " part " or " unit " suffix only for be conducive to the present invention explanation, itself
Not specific meaning.Therefore, " module " can be used mixedly with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration for realizing the optional mobile terminal of each embodiment one of the invention is illustrated.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups for illustrating
Part.More or less of component can alternatively be implemented.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and wireless communication system
Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module
112nd, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent
The broadcast singal generated before the server or reception of broadcast singal and/or broadcast related information and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include TV broadcast singals, radio signals, data broadcasting
Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Pass information can also be provided via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 is receiving.Broadcast singal can be present in a variety of manners, and for example, it can be with the electronics of DMB (DMB)
The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast
Receiver module 111 can receive signal broadcast by using various types of broadcast systems.Especially, broadcasting reception module 111
Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video
Broadcast-hand-held (DVB-H), forward link media (MediaFLO@) Radio Data System, received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111 may be constructed such that and be adapted to provide for extensively
Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via broadcasting reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal can be logical including voice
Words signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
ToothTM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybeeTMEtc..
Location information module 115 is the module for checking or obtaining the positional information of mobile terminal.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115 is calculated from three or more satellites
Range information and correct time information and for calculate Information application triangulation, so as to according to longitude, latitude
Highly accurately calculate three-dimensional current location information.Currently, the method for calculating position and temporal information is defended using three
The error of star and the position that calculated by using other satellite correction and temporal information.Additionally, GPS module 115
Can be by Continuous plus current location information in real time come calculating speed information.
A/V input blocks 120 are used to receive audio or video signal.A/V input blocks 120 can include microphone 122,
Microphone 122 can be received in telephone calling model, logging mode, speech recognition mode etc. operational mode via microphone
Sound (voice data), and can be voice data by such acoustic processing.Audio frequency (voice) data after process can be with
The form that can be sent to mobile communication base station via mobile communication module 112 is converted in the case of telephone calling model defeated
Go out.Microphone 122 can implement various types of noises and eliminate (or suppression) algorithm to eliminate (or suppression) in reception and send
The noise produced during audio signal or interference.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input
Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch
Plate (for example, detection is due to the sensitive component of the change of touched and caused resistance, pressure, electric capacity etc.), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon in the form of layer on display unit 151, touch-screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 1 00, and (for example, mobile terminal 1 00 opens or closes shape
State), the presence or absence of contact (that is, touch input), the mobile terminal of the position of mobile terminal 1 00, user for mobile terminal 1 00
100 orientation, the acceleration or deceleration movement of mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00
The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can be sensed
The sliding-type phone is opened or closed.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).
Interface unit 170 is connected the interface that can pass through with mobile terminal 1 00 as at least one external device (ED).For example,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, the port for device of the connection with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage uses each of mobile terminal 1 00 for verifying user
Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can take the form of smart card, therefore, know
Other device can be connected via port or other attachment means with mobile terminal 1 00.Interface unit 170 can be used for receive from
The input (for example, data message, electric power etc.) of external device (ED) and the input for receiving is transferred in mobile terminal 1 00
One or more elements can be used for the transmission data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing to pass through it by electricity
Power from base provide to mobile terminal 1 00 path or can serve as allow from base be input into various command signals pass through its
It is transferred to the path of mobile terminal.Can serve as recognizing that mobile terminal is from the various command signals or electric power of base input
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio frequency and/or tactile manner
Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include showing
Unit 151, dio Output Modules 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
During words call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia files
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, illustrate video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when the display unit 151 and touch pad touch-screen with formation superposed on one another in the form of layer, display unit
151 can serve as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user from outside viewing, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
The embodiment wanted, mobile terminal 1 00 can include two or more display units (or other display devices), for example, move
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detection and touch
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal in call signal reception pattern, call mode, logging mode,
It is that wireless communication unit 110 is received or in memory 160 when under the isotypes such as speech recognition mode, broadcast reception mode
The voice data transducing audio signal of middle storage and it is output as sound.And, dio Output Modules 152 can be provided and movement
The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation that terminal 100 is performed.
Dio Output Modules 152 can include loudspeaker, buzzer etc..
Alarm unit 153 can provide output so that event is notified to mobile terminal 1 00.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video is exported, alarm unit
153 can in a different manner provide output with the generation of notification event.For example, alarm unit 153 can be in the form of vibrating
Output is provided, when calling, message or some other entrance communication (incomingcommunication) are received, alarm list
Unit 153 can provide tactile output (that is, vibrating) to notify to user.By providing such tactile output, even if
When the mobile phone of user is in the pocket of user, user also can recognize that the generation of various events.Alarm unit 153
The output of the generation of notification event can be provided via display unit 151 or dio Output Modules 152.
Memory 160 can store software program for the process and control operation performed by controller 180 etc., Huo Zheke
With the data (for example, telephone directory, message, still image, video etc.) for temporarily storing own Jing outputs or will export.And
And, memory 160 can be storing the vibration of various modes with regard to exporting when touching and being applied to touch-screen and audio signal
Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many
Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can perform memory with by network connection
The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data
The related control of communication, video calling etc. and process.In addition, controller 180 can be included for reproducing (or playback) many matchmakers
The multi-media module 1810 of volume data, multi-media module 1810 can be constructed in controller 180, or is so structured that and control
Device processed 180 is separated.Controller 180 can be with execution pattern identifying processing, by the handwriting input for performing on the touchscreen or figure
Piece draws input and is identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Appropriate electric power needed for part and component.
Various embodiments described herein can be with using such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implementing.For hardware is implemented, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein
Implementing, in some cases, such embodiment can be implemented at least one in electronic unit in controller 180.
For software is implemented, the embodiment of such as process or function can with allow to perform the single of at least one function or operation
Software module is implementing.Software code can be come by the software application (or program) write with any appropriate programming language
Implement, software code can be stored in memory 160 and be performed by controller 180.
So far, own Jing describes mobile terminal according to its function.Below, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is used as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
As shown in Figure 1 mobile terminal 1 00 may be constructed such that using via frame or packet transmission data it is all if any
Line and wireless communication system and satellite-based communication system are operating.
The communication system that mobile terminal wherein of the invention is operable to is described referring now to Fig. 2.
Such communication system can use different air interface and/or physical layer.For example, used by communication system
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications system
System (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc..As non-limiting example, under
The description in face is related to cdma communication system, but such teaching is equally applicable to other types of system.
With reference to Fig. 2, cdma wireless communication system can include multiple mobile terminal 1s 00, multiple base stations (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 form interface.MSC280 is also structured to form interface with the BSC275 that can be couple to base station 270 via back haul link.
If any one that back haul link can be in the interface that Ganji knows is constructing, the interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that as shown in Figure 2 system can include multiple BSC2750.
Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of sensing specific direction
Each subregion that line is covered is radially away from BS270.Or, each subregion can by for diversity reception two or more
Antenna is covered.Each BS270 may be constructed such that the multiple frequency distribution of support, and each frequency distribution has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
What subregion and frequency were distributed intersects can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
System (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly representing single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, each subregion of specific BS270 can be claimed
For multiple cellular stations.
As shown in Figure 2, broadcast singal is sent to broadcsting transmitter (BT) 295 mobile terminal operated in system
100.As shown in Figure 1 broadcasting reception module 111 is arranged at mobile terminal 1 00 to receive the broadcast sent by BT295
Signal.In fig. 2 it is shown that several global positioning system (GPS) satellites 300.Satellite 300 helps position multiple mobile terminals
At least one of 100.
In fig. 2, multiple satellites 300 are depicted, it is understood that be, it is possible to use any number of satellite obtains useful
Location information.As shown in Figure 1 GPS module 115 is generally configured to coordinate to obtain the positioning wanted letter with satellite 300
Breath.Substitute GPS tracking techniques or outside GPS tracking techniques, it is possible to use can track the position of mobile terminal other
Technology.In addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.
Used as a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminal 1s 00
Signal.Mobile terminal 1 00 generally participates in call, information receiving and transmitting and other types of communication.Each of the reception of certain base station 270 is anti-
Processed in specific BS270 to link signal.The data of acquisition are forwarded to the BSC275 of correlation.BSC provides call
Resource allocation and the mobile management function of the coordination including the soft switching process between BS270.BSC275 is also by the number for receiving
According to MSC280 is routed to, it provides the extra route service for forming interface with PSTN290.Similarly, PSTN290 with
MSC280 forms interface, and MSC and BSC275 form interface, and BSC275 correspondingly controls BS270 with by forward link signals
It is sent to mobile terminal 1 00.
Based on above-mentioned mobile terminal hardware configuration and communication system, the inventive method each embodiment is proposed.
As shown in figure 3, first embodiment of the invention proposes a kind of face identification device based on camera preview, being applied to can
Take pictures mobile terminal, described device includes：
Detecting module 30, for compress recognition mode under when detect camera view interface open when, from camera view
Interface extraction preview frame；
Specifically, when camera is taken pictures particularly portrait is taken pictures when, it may include general mode and compression recognition mode, it is general
Do not make any change under logical pattern, still carry out recognition of face using conventional method and face frame shows.And compress recognition mode
Then by using the face identification device of the present invention, recognition of face efficiency is further improved.Under compression recognition mode, when detecting
User open camera when, detecting module 30 using extract currently find a view interface preview image as preview frame, i.e. user currently from
The finding scope of view-finder is used as preview frame.
Further, in the present embodiment, described device also includes：
Trigger module 34, for after default triggering command is detected, opening compression recognition mode.
Specifically, in the present invention, user can pass through to click on the button of " compression identification " function at any time, including
Before taking pictures, take pictures it is middle open compression recognition mode.The button of " compression identification " function can be arranged on mobile terminal desktop homepage
Drop-down quick setting interface on recall in order to user, it is also possible in being arranged on the setting interface of camera, can also be arranged on
The compression recognition mode interface individually drawn.When user is after the button of " compression identification " function is clicked on, trigger module 34 feeds back
Trigger message calls drafting function to draw compression recognition mode interface to " compression identification " power function, and user just can be at this
Compression recognition mode is opened on interface.
Fig. 5 is please also refer to, shown is that mobile terminal fast arranges the exemplary plot of interface one in the present invention, fast arranges interface
It is upper to include multiple shortcut function buttons, wherein, " compression identification " button is arranged in this interface.User is any in mobile terminal
Quick setting interface can be recalled by downslide operation under interface, now, user can open by clicking on " compression identification " button
Dynamic pressure contracting recognition mode.
Compression module 31, is compressed for the picture pixel according to the preview frame to the preview frame；
Further, compression module 31 is specifically included：
Pixel detecting unit, the picture pixel current for detecting the preview frame, it is right to determine according to the picture pixel
The compression multiple answered；
Multiple compression unit, for being compressed to the preview frame according to the compression multiple.
Specifically, after getting the preview frame at interface of finding a view, compression module 31 is compressed preview frame, the multiple of compression
It is adjusted according to current picture pixel, the different compression multiples of different picture pixel correspondences, its corresponding relation is by developing
Personnel calculate through Data Collection and set, and are prestored in systems by manufacturer.Pixel detecting unit is by detecting preview frame to determine
Picture pixel, and the corresponding compression multiple of picture pixel is searched, multiple compression unit is pre- according to the compression multiple compression searched
Look at frame.
Identification module 32, carries out recognition of face to determine the position of the face for recognizing for the preview frame after to compression
Confidence ceases；
Display module 33, for showing face frame in the corresponding region at the interface of finding a view according to the positional information.
Specifically, after the preview frame after compression is obtained, in the preview frame upon compression of identification module 32 recognition of face is carried out.
Because the pixel rectangle that recognition of face generally uses 60*60 carries out picture traversal, so upon compression, preview frame pixel value subtracts
Few, in identification, efficiency rises, and the pixel of general passerby's face itself is less, just None- identified in preview frame upon compression
Out, therefore, as long as compression multiple arranges suitable, it is possible to which guarantee has filtered the face of passerby without by the filter of main face
Fall.Preview frame after 32 pairs of compressions of identification module carries out can confirm that what is can recognize that in the preview frame after compression after recognition of face
The positional information of face.Display module 33 according to the positional information, with reference to compression multiple, it may be determined that the face for recognizing is not
Compression obtains finding a view relevant position in interface, human face region in the interface that also can confirm to find a view, and shows face on the area
Frame.
Please also refer to Fig. 6 and Fig. 7, Fig. 6 show the exemplary plot of mobile terminal camera interface one in the present invention；Fig. 7 is
Exemplary plot after the preview frame compression extracted from camera view interface shown in Fig. 6.Preview shows in camera view interface in Fig. 6
There are two faces, detecting module 30 extracts preview frame, and compressed module 31 obtains the preview frame as shown in Fig. 7 (a) after compressing,
In the preview frame, based on big face face is wanted, occupies more pixel value, little face is passerby, the pixel value for occupying compared with
Few, when identification module 32 carries out recognition of face, only main face is identified, and the face of passerby will be filtered.Such as Fig. 7 (b)
Marked in.The face being identified to, display module 33 will in figure 6 find a view corresponding region on interface according to its positional information,
I.e. face region, shows face frame.
The face identification device that the present embodiment is proposed, mobile terminal is under compression recognition mode when detecting camera view circle
When face is opened, from camera view interface extraction preview frame；The preview frame is pressed according to the picture pixel of the preview frame
Contracting；The preview frame after to compression carries out recognition of face to determine the positional information of the face for recognizing；According to the position
Information shows face frame in the corresponding region at the interface of finding a view.So as to by compressing interface preview frame of finding a view, in condensed frame
Recognition of face is carried out, the efficiency of recognition of face is greatly improved so that user can experience faster recognition of face effect, strengthened
The Consumer's Experience of mobile terminal recognition of face.
Fig. 4 is refer to, second embodiment of the invention further provides for another kind of face identification device based on camera preview,
In the present embodiment, the face identification device and first embodiment are differed only in：
In the present embodiment, described device also includes：
Screening module 35, for pointing out user to select current face's exposal model, the face exposal model bag
Include single player mode, multi-player mode and everybody's pattern.
Corresponding, now, display module 33 is specifically included：
Sequencing unit, is ranked up for taking quantity according to pixel to the face for recognizing；
Selected unit, for according to current face's exposal model and ranking results selected target face；
Display unit, for showing the target face in the corresponding region at the interface of finding a view according to the positional information
Corresponding face frame.
Specifically, many times, after the face that identification module 32 has filtered passerby, still can recognize in preview frame
Multiple faces, now, screening module 35 can be selected with user's current face's exposal model, and display module 33 will be according to user
Select the quantity for determining the face frame for needing to show.Herein, face exposal model can include single player mode, multi-player mode and
Everybody's pattern.Finding a view under single player mode a face frame of only show on interface, 2-5 is then shown under multi-player mode, everybody's pattern
Under will then show the corresponding face frame of all faces for recognizing.Identification module 32 is recognized after multiple faces, sequencing unit root
The quantity for taking pixel according to each face is ranked up to the face for recognizing, and pixel takes quantity highest, then before sorting most, according to
It is secondary to successively decrease.The face exposal model that selected unit is selected according to user determines the quantity of the face frame for needing to show, from sorting
Face in determine target face.For example, user have selected single player mode, and the face for recognizing has 5, then sequence first
Face is target face, if user have selected multi-player mode, and the face for recognizing has 3, then three are target face, if
By 7, then 5 faces of first five that sort are target face to the face for recognizing, the like.After determining target person face, show
The positional information for showing unit each target face shows the corresponding face frame of each target face in the corresponding region at interface of finding a view.
Fig. 8 is please also refer to, shown is the exemplary plot of mobile terminal camera interface one in this enforcement, now, is found a view in interface
Preview shows multiple faces, as it was previously stated, wherein, minimum face will be filtered upon compression, and other three faces are all
To be identified and sort, because the face quantity for recognizing is 3, screening module 35 will point out user select face to take pictures by pop-up
Pattern, if user selects single player mode, maximum face will show that corresponding face frame (does not show in figure only in Fig. 8 previews
Go out).
The face identification device that the present embodiment is proposed, mobile terminal, can be according to pattern when multiple faces are recognized
The different face frames for showing varying number automatically, have provided the user multimodal exposal model, while also more intelligent.
As shown in figure 9, third embodiment of the invention proposes a kind of face identification method based on camera preview, being applied to can
Take pictures mobile terminal, the method comprising the steps of：
S900, it is pre- from camera view interface extraction under compression recognition mode when camera view interface opening is detected
Look at frame；
Specifically, when camera is taken pictures particularly portrait is taken pictures when, it may include general mode and compression recognition mode, it is general
Do not make any change under logical pattern, still carry out recognition of face using conventional method and face frame shows.And compress recognition mode
Then by using the face identification device of the present invention, recognition of face efficiency is further improved.Under compression recognition mode, when detecting
User open camera when, detecting module 30 using extract currently find a view interface preview image as preview frame, i.e. user currently from
The finding scope of view-finder is used as preview frame.
Further, in the present embodiment, methods described also includes：
After default triggering command is detected, compression recognition mode is opened.
Specifically, in the present invention, user can pass through to click on the button of " compression identification " function at any time, including
Before taking pictures, take pictures it is middle open compression recognition mode.The button of " compression identification " function can be arranged on mobile terminal desktop homepage
Drop-down quick setting interface on recall in order to user, it is also possible in being arranged on the setting interface of camera, can also be arranged on
The compression recognition mode interface individually drawn.When user is after the button of " compression identification " function is clicked on, trigger module 34 feeds back
Trigger message calls drafting function to draw compression recognition mode interface to " compression identification " power function, and user just can be at this
Compression recognition mode is opened on interface.
Fig. 5 is please also refer to, shown is that mobile terminal fast arranges the exemplary plot of interface one in the present invention, fast arranges interface
It is upper to include multiple shortcut function buttons, wherein, " compression identification " button is arranged in this interface.User is any in mobile terminal
Quick setting interface can be recalled by downslide operation under interface, now, user can open by clicking on " compression identification " button
Dynamic pressure contracting recognition mode.
S910, is compressed in the picture pixel according to the preview frame to the preview frame；
Further, Figure 10 is please also refer to, step S910 is specifically included：
S911, detects the current picture pixel of the preview frame, and according to the picture pixel corresponding compression multiple is determined；
S912, is compressed according to the compression multiple to the preview frame.
Specifically, after getting the preview frame at interface of finding a view, compression module 31 is compressed preview frame, the multiple of compression
It is adjusted according to current picture pixel, the different compression multiples of different picture pixel correspondences, its corresponding relation is by developing
Personnel calculate through Data Collection and set, and are prestored in systems by manufacturer.Pixel detecting unit is by detecting preview frame to determine
Picture pixel, and the corresponding compression multiple of picture pixel is searched, multiple compression unit is pre- according to the compression multiple compression searched
Look at frame.
S920, to compression after the preview frame carry out recognition of face to determine the positional information of the face for recognizing；
S930, face frame is shown according to the positional information in the corresponding region at the interface of finding a view.
Specifically, after the preview frame after compression is obtained, in the preview frame upon compression of identification module 32 recognition of face is carried out.
Because the pixel rectangle that recognition of face generally uses 60*60 carries out picture traversal, so upon compression, preview frame pixel value subtracts
Few, in identification, efficiency rises, and the pixel of general passerby's face itself is less, just None- identified in preview frame upon compression
Out, therefore, as long as compression multiple arranges suitable, it is possible to which guarantee has filtered the face of passerby without by the filter of main face
Fall.Preview frame after 32 pairs of compressions of identification module carries out can confirm that what is can recognize that in the preview frame after compression after recognition of face
The positional information of face.Display module 33 according to the positional information, with reference to compression multiple, it may be determined that the face for recognizing is not
Compression obtains finding a view relevant position in interface, human face region in the interface that also can confirm to find a view, and shows face on the area
Frame.
Please also refer to Fig. 6 and Fig. 7, Fig. 6 show the exemplary plot of mobile terminal camera interface one in the present invention；Fig. 7 is
Exemplary plot after the preview frame compression extracted from camera view interface shown in Fig. 6.Preview shows in camera view interface in Fig. 6
There are two faces, detecting module 30 extracts preview frame, and compressed module 31 obtains the preview frame as shown in Fig. 7 (a) after compressing,
In the preview frame, based on big face face is wanted, occupies more pixel value, little face is passerby, the pixel value for occupying compared with
Few, when identification module 32 carries out recognition of face, only main face is identified, and the face of passerby will be filtered.Such as Fig. 7 (b)
Marked in.The face being identified to, display module 33 will in figure 6 find a view corresponding region on interface according to its positional information,
I.e. face region, shows face frame.
The face identification method that the present embodiment is proposed, mobile terminal is under compression recognition mode when detecting camera view circle
When face is opened, from camera view interface extraction preview frame；The preview frame is pressed according to the picture pixel of the preview frame
Contracting；The preview frame after to compression carries out recognition of face to determine the positional information of the face for recognizing；According to the position
Information shows face frame in the corresponding region at the interface of finding a view.So as to by compressing interface preview frame of finding a view, in condensed frame
Recognition of face is carried out, the efficiency of recognition of face is greatly improved so that user can experience faster recognition of face effect, strengthened
The Consumer's Experience of mobile terminal recognition of face.
Fourth embodiment of the invention further provides for another kind of face identification method based on camera preview, in the present embodiment
In, the face identification method is differed only in 3rd embodiment：
In the present embodiment, methods described is further comprising the steps of：
Prompting user is selected current face's exposal model, and the face exposal model includes single player mode, many people
Pattern and everybody's pattern.
Corresponding, now, step S930 is specifically included：
Quantity is taken according to pixel to be ranked up the face for recognizing；
According to current face's exposal model and ranking results selected target face；
The corresponding face frame of the target face is shown according to the positional information in the corresponding region at the interface of finding a view.
Specifically, many times, after the face that identification module 32 has filtered passerby, still can recognize in preview frame
Multiple faces, now, screening module 35 can be selected with user's current face's exposal model, and display module 33 will be according to user
Select the quantity for determining the face frame for needing to show.Herein, face exposal model can include single player mode, multi-player mode and
Everybody's pattern.Finding a view under single player mode a face frame of only show on interface, 2-5 is then shown under multi-player mode, everybody's pattern
Under will then show the corresponding face frame of all faces for recognizing.Identification module 32 is recognized after multiple faces, sequencing unit root
The quantity for taking pixel according to each face is ranked up to the face for recognizing, and pixel takes quantity highest, then before sorting most, according to
It is secondary to successively decrease.The face exposal model that selected unit is selected according to user determines the quantity of the face frame for needing to show, from sorting
Face in determine target face.For example, user have selected single player mode, and the face for recognizing has 5, then sequence first
Face is target face, if user have selected multi-player mode, and the face for recognizing has 3, then three are target face, if
By 7, then 5 faces of first five that sort are target face to the face for recognizing, the like.After determining target person face, show
The positional information for showing unit each target face shows the corresponding face frame of each target face in the corresponding region at interface of finding a view.
Fig. 8 is please also refer to, shown is the exemplary plot of mobile terminal camera interface one in this enforcement, now, is found a view in interface
Preview shows multiple faces, as it was previously stated, wherein, minimum face will be filtered upon compression, and other three faces are all
To be identified and sort, because the face quantity for recognizing is 3, screening module 35 will point out user select face to take pictures by pop-up
Pattern, if user selects single player mode, maximum face will show that corresponding face frame (does not show in figure only in Fig. 8 previews
Go out).
The face identification method that the present embodiment is proposed, mobile terminal, can be according to pattern when multiple faces are recognized
The different face frames for showing varying number automatically, have provided the user multimodal exposal model, while also more intelligent.
It should be noted that herein, term " including ", "comprising" or its any other variant are intended to non-row
His property is included, so that a series of process, method, article or device including key elements not only include those key elements, and
And also include other key elements being not expressly set out, or also include for this process, method, article or device institute inherently
Key element.In the absence of more restrictions, the key element for being limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment, in the case where not conflicting,
Feature in the embodiment of the present invention and embodiment can be mutually combined enforcement.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words
Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal equipment (can be mobile phone, computer takes
Business device, air-conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the present invention is not thereby limited, it is every using this
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of face identification device based on camera preview, is applied to mobile terminal capable of taking pictures, it is characterised in that described device
Including：
Detecting module, for, when camera view interface opening is detected, carrying from camera view interface under compressing recognition mode
Take preview frame；
Compression module, is compressed for the picture pixel according to the preview frame to the preview frame；
Believe identification module, the position for carrying out recognition of face to determine the face for recognizing for the preview frame after to compression
Breath；
Display module, for showing face frame in the corresponding region at the interface of finding a view according to the positional information.
2. face identification device according to claim 1, it is characterised in that described device also includes：
Trigger module, for after default triggering command is detected, opening compression recognition mode.
3. face identification device according to claim 1, it is characterised in that the compression module is specifically included：
Pixel detecting unit, the picture pixel current for detecting the preview frame determines corresponding according to the picture pixel
Compression multiple；
Multiple compression unit, for being compressed to the preview frame according to the compression multiple.
4. face identification device according to claim 1, it is characterised in that the face quantity for recognizing be one or
Multiple, described device also includes：
Screening module, for pointing out user to select current face's exposal model, the face exposal model includes one
Pattern, multi-player mode and everybody's pattern.
5. face identification device according to claim 4, it is characterised in that the display module is specifically included：
Sequencing unit, is ranked up for taking quantity according to pixel to the face for recognizing；
Selected unit, for according to current face's exposal model and ranking results selected target face；
Display unit, for showing the target face correspondence in the corresponding region at the interface of finding a view according to the positional information
Face frame.
6. a kind of face identification method based on camera preview, is applied to mobile terminal capable of taking pictures, it is characterised in that methods described
Comprise the following steps：
Under compression recognition mode when camera view interface opening is detected, from camera view interface extraction preview frame；
The preview frame is compressed according to the picture pixel of the preview frame；
The preview frame after to compression carries out recognition of face to determine the positional information of the face for recognizing；
Face frame is shown according to the positional information in the corresponding region at the interface of finding a view.
7. face identification method according to claim 6, it is characterised in that methods described also includes:
After default triggering command is detected, compression recognition mode is opened.
8. face identification method according to claim 6, it is characterised in that the picture pixel according to the preview frame
The preview frame is compressed and is specifically included：
The current picture pixel of the preview frame is detected, according to the picture pixel corresponding compression multiple is determined；
The preview frame is compressed according to the compression multiple.
9. face identification method according to claim 6, it is characterised in that the face quantity for recognizing be one or
Multiple, methods described also includes：
Prompting user is selected current face's exposal model, and the face exposal model includes single player mode, multi-player mode
And everybody's pattern.
10. recognition of face side according to claim 9, it is characterised in that described to take described according to the positional information
The corresponding region at scape interface shows that face frame is specifically included：
Quantity is taken according to pixel to be ranked up the face for recognizing；
According to current face's exposal model and ranking results selected target face；
The corresponding face frame of the target face is shown according to the positional information in the corresponding region at the interface of finding a view.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611042433.9A CN106650631A (en) | 2016-11-24 | 2016-11-24 | Camera preview-based face recognition method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611042433.9A CN106650631A (en) | 2016-11-24 | 2016-11-24 | Camera preview-based face recognition method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106650631A true CN106650631A (en) | 2017-05-10 |
Family
ID=58812527
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611042433.9A Pending CN106650631A (en) | 2016-11-24 | 2016-11-24 | Camera preview-based face recognition method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106650631A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729889A (en) * | 2017-11-27 | 2018-02-23 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic equipment, computer-readable recording medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2106125A2 (en) * | 2008-03-25 | 2009-09-30 | Lg Electronics Inc. | Mobile terminal and method of controlling the mobile terminal |
| CN103312949A (en) * | 2012-03-16 | 2013-09-18 | 深圳富泰宏精密工业有限公司 | System and method for prompting autodyne |
| CN103905733A (en) * | 2014-04-02 | 2014-07-02 | 哈尔滨工业大学深圳研究生院 | Method and system for conducting real-time tracking on faces by monocular camera |
| CN104866805A (en) * | 2014-02-20 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Real-time face tracking method and device |
-
2016
- 2016-11-24 CN CN201611042433.9A patent/CN106650631A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2106125A2 (en) * | 2008-03-25 | 2009-09-30 | Lg Electronics Inc. | Mobile terminal and method of controlling the mobile terminal |
| CN103312949A (en) * | 2012-03-16 | 2013-09-18 | 深圳富泰宏精密工业有限公司 | System and method for prompting autodyne |
| CN104866805A (en) * | 2014-02-20 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Real-time face tracking method and device |
| CN103905733A (en) * | 2014-04-02 | 2014-07-02 | 哈尔滨工业大学深圳研究生院 | Method and system for conducting real-time tracking on faces by monocular camera |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107729889A (en) * | 2017-11-27 | 2018-02-23 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic equipment, computer-readable recording medium |
| CN107729889B (en) * | 2017-11-27 | 2020-01-24 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104899062B (en) | Using startup method and device | |
| CN105100892B (en) | Video play device and method | |
| CN104808944B (en) | Touch operation inducing method and device | |
| CN104750420B (en) | Screenshotss method and device | |
| CN104731512B (en) | The method, apparatus and terminal that picture is shared | |
| CN105242898A (en) | Split-screen display device and method of mobile terminal | |
| CN104808945B (en) | The display packing and device of virtual key | |
| CN104679890B (en) | Picture method for pushing and device | |
| CN106603829A (en) | Screen capture method and mobile terminal | |
| CN105430258B (en) | A kind of method and apparatus of self-timer group photo | |
| CN105739873A (en) | Screen capturing method and terminal | |
| CN106873936A (en) | Electronic equipment and information processing method | |
| CN106850941A (en) | Method, photo taking and device | |
| CN104951549A (en) | Mobile terminal and photo/video sort management method thereof | |
| CN106909681A (en) | A kind of information processing method and its device | |
| CN106131274A (en) | Mobile terminal control device and method | |
| CN104731484B (en) | The method and device that picture is checked | |
| CN105262953B (en) | A kind of mobile terminal and its method of control shooting | |
| CN105183830B (en) | picture browsing method and device | |
| CN104898927B (en) | The method and device of information search | |
| CN107071161A (en) | The aggregation display method and mobile terminal of icon in a kind of status bar | |
| CN105100463B (en) | Terminal SIM switching device and method | |
| CN104915230B (en) | application control method and device | |
| CN106357936A (en) | Control method of map application and mobile terminal | |
| CN106791149A (en) | A kind of method of mobile terminal and control screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |