CN107454335A - Image processing method, device, computer-readable recording medium and mobile terminal - Google Patents
Image processing method, device, computer-readable recording medium and mobile terminal Download PDFInfo
- Publication number
- CN107454335A CN107454335A CN201710775165.XA CN201710775165A CN107454335A CN 107454335 A CN107454335 A CN 107454335A CN 201710775165 A CN201710775165 A CN 201710775165A CN 107454335 A CN107454335 A CN 107454335A
- Authority
- CN
- China
- Prior art keywords
- portrait
- image
- carried out
- mobile terminal
- image processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Image Analysis (AREA)
Abstract
The present invention relates to a kind of image processing method, device, computer-readable recording medium and mobile terminal.The above method includes：Portrait in image be present if detecting, infrared heat detection is carried out to the portrait；Obtain the heat radiation value of the portrait；If the heat radiation value is more than first threshold, white balance processing is carried out to described image.The above method, when can detect human face region in the picture, white balance processing is carried out to image so that the realistic colour of scene can be presented in image.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of image processing method, device, computer-readable deposit
Storage media and mobile terminal.
Background technology
With the development of intelligent mobile terminal, the function of intelligent mobile terminal is more and more diversified.For example, using intelligence
When mobile terminal is shot, intelligent mobile terminal can carry out automatic exposure, AWB, automatic to the image that shooting obtains
U.S. face and automatic virtualization processing so that shoot that the image level of acquisition is clearly demarcated, the realistic colour of scene can be presented in image.
The content of the invention
The embodiment of the present invention provides a kind of image processing method, device, computer-readable recording medium and mobile terminal, can
During detecting human face region in the picture, white balance processing is carried out to image so that the realistic colour of scene can be presented in image.
A kind of image processing method, including：
Portrait in image be present if detecting, infrared heat detection is carried out to the portrait；
Obtain the heat radiation value of the portrait；
If the heat radiation value is more than first threshold, white balance processing is carried out to described image.
A kind of image processing apparatus, including：
Detection module, if portrait in image be present for detecting, infrared heat detection is carried out to the portrait；
Acquisition module, for obtaining the heat radiation value of the portrait；
Processing module, if being more than first threshold for the heat radiation value, white balance processing is carried out to described image.
A kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program
The step of image processing method as described above is realized when being executed by processor.
A kind of mobile terminal, including memory and processor, computer-readable instruction is stored in the memory, it is described
When instruction is by the computing device so that the computing device image processing method as described above.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the internal structure schematic diagram of mobile terminal 10 in one embodiment；
Fig. 2 is the flow chart of image processing method in one embodiment；
Fig. 3 is the flow chart of image processing method in another embodiment；
Fig. 4 is the structured flowchart of image processing apparatus in one embodiment；
Fig. 5 is the structured flowchart of image processing apparatus in another embodiment；
Fig. 6 is the structured flowchart of image processing apparatus in another embodiment；
Fig. 7 is the structured flowchart of image processing apparatus in one embodiment；
Fig. 8 is the schematic diagram of image processing circuit in one embodiment.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
It is appreciated that term " first " used in the present invention, " second " etc. can be used to describe various elements herein,
But these elements should not be limited by these terms.These terms are only used for distinguishing first element and another element.Citing comes
Say, without departing from the scope of the invention, the first client can be referred to as the second client, and similarly, can incite somebody to action
Second client is referred to as the first client.First client and the second client both clients, but it is not same visitor
Family end.
Fig. 1 is the internal structure schematic diagram of mobile terminal 10 in one embodiment.As shown in figure 1, the mobile terminal 10 wraps
Include the processor connected by system bus, non-volatile memory medium, built-in storage, network interface, display screen and input dress
Put.Wherein, the non-volatile memory medium of mobile terminal 10 is stored with operating system and computer-readable instruction.The computer can
To realize a kind of image processing method when reading instruction is executed by processor.The processor is used to provide calculating and control ability, branch
Support the operation of whole mobile terminal 10.Built-in storage in mobile terminal 10 is computer-readable in non-volatile memory medium
The operation of instruction provides environment.Network interface is used to carry out network service with server.The display screen of mobile terminal 10 can be
LCDs or electric ink display screen etc., input unit can be the touch layers or shifting covered on display screen
Move button, trace ball or Trackpad or the external keyboard set on the shell of terminal 10, Trackpad or mouse etc..Should
Mobile terminal 10 can be mobile phone, tablet personal computer or personal digital assistant or Wearable etc..Those skilled in the art can
To understand, the block diagram of the structure, the only part-structure related to application scheme that are shown in Fig. 1, do not form to this Shen
Please the restriction of mobile terminal 10 that is applied thereon of scheme, specific mobile terminal 10 can include it is more more than shown in figure or
Less part, either combine some parts or arranged with different parts.
Fig. 2 is the flow chart of image processing method in one embodiment.As shown in Fig. 2 a kind of image processing method, bag
Include：
Step 202, portrait in image be present if detecting, infrared heat detection is carried out to portrait.
When running of mobile terminal photographing program obtains image, mobile terminal can be used in Face datection algorithm detection image
With the presence or absence of face.If detecting face in image be present, i.e., portrait be present in image.Infrared heat is carried out to portrait in image
Detection.
According to heat radiation principle, human body is due to temperature and to the continuous emittance of surrounding space.Wherein, human body temperature
Higher, the energy that human body radiates to surrounding space is more.Infrared detector can receive the energy of human body radiation in mobile terminal, and
According to the temperature for the how much judgement human bodies for receiving emittance.Specifically, because human body steady temperature is 37 DEG C, people knows from experience spoke
The infrared ray of specific wavelength is penetrated, such as the infrared ray that wavelength is 10 μm.Infrared detector can be 10 μm according to the wavelength received
Infrared ray, the radiation energy that infrared ray is had are converted into electric signal, so as to obtain the heat radiation value of portrait and the temperature of portrait.
When human body temperature is higher, human body is more to the energy of external radiation, and the wavelength that infrared detector receives is that 10 μm of infrared ray is got over
More, i.e. the heat radiation value of portrait is higher.
Step 204, the heat radiation value of portrait is obtained.
Infrared detector can judge the position of portrait according to the orientation of the infrared ray received in mobile terminal.Mobile terminal
When running photographing program acquisition image, there can be multiple portraits on image, mobile terminal portrait in image carries out infrared heat
During amount detection, the heat radiation energy of multiple portraits on image can be got.Mobile terminal determines portrait according to the orientation of infrared ray
Position after, choose on image mobile terminal check or owner's face of user's selection corresponding to portrait, obtain corresponding to owner's face
The heat radiation value of portrait.
Step 206, if heat radiation value is more than first threshold, white balance processing is carried out to image.
First threshold is default heat radiation value, such as the heat radiation value that temperature is 20 DEG C of black matrixes.If the heat of portrait
Amount radiation value is more than default first threshold, and can determine whether portrait is live body, and white balance processing is carried out to image.Wherein, to image
Carrying out white balance processing includes：There are three CCD (Charge-coupled Device, electronics coupled original paper) electric in mobile terminal
Sub- coupling element, above three CCD electronics coupleds original paper can receive blueness, green and red light respectively.Mobile terminal is pre-
If the ratio that three CCD electronics coupleds original papers receive blueness, green and red light is 1:1:1.When running of mobile terminal is put down in vain
When accounting method, mobile terminal can adjust three CCD electronics coupleds in real time according to the ratio of blueness, green and red light in scenery
Original paper receives the ratio of light so that the image of shooting is identical with actual color.For example, shooting scenery in blueness, green and
The ratio of red light is 2:1:1, mobile terminal adjustment CCD electronics coupleds original paper receives the ratio of blueness, green and red light
Example is 1:2:2 so that image Green and it is red increase, color is closer to realistic colour in image.
When face in image be present, by carrying out white balance processing to image, it may be such that the portrait color of shooting more connects
The color of nearly true portrait.In conventional art, mobile terminal can carry out recognition of face to image, detect face in image be present
Afterwards, i.e., white balance processing is carried out to image.In actual use, mobile terminal to image when carrying out recognition of face, only
With the presence or absence of the two dimensional image for meeting face characteristic in detection image, when doll, photo, statue, billboard etc. are present in image
During facial image, mobile terminal can also carry out white balance processing, but facial image in doll, photo, statue, billboard to image
Larger with real human face image aberration, the white balance processing to image can cause the image and real scene color phase of shooting acquisition
Difference is larger.
Image processing method in the embodiment of the present application, detected in image when portrait be present, obtained by Face datection algorithm
The heat radiation value of portrait in image is taken, detects whether portrait is true man according to the heat radiation value of portrait in image, if detection
It is true man to portrait, white balance processing is carried out to image so that the color of image is improved pair closer to the color of real scene
Portrait image carries out the accuracy rate of white balance, avoids face in flase drop altimetric image and carries out white balance processing to image, causes
Image differs larger situation with realistic colour.
In one embodiment, if detecting portrait in image be present in step 202, infrared heat detection is carried out to portrait
Including：
(1) multiple portraits be present if detecting in image, obtain the parameter value of multiple portraits successively.
(2) target person picture is chosen according to the parameter value of multiple portraits.
(3) infrared heat detection is carried out to target person picture.
When multiple human face regions in image be present, mobile terminal can obtain the parameter value of multiple human face regions, according to more
The parameter value of individual human face region chooses target face, i.e., owner's face in image.The parameter value of above-mentioned human face region includes：Face area
The length of side in domain, the area of human face region, human face region account for the ratio of image, the ratio of human face region and human face region, face area
The average depth of field value in domain etc..Wherein, mobile terminal can will show the number of pixels of human face region and the area as human face region.
When human face region is regular polygon, the number of pixels shared by the length of side of regular polygon is the length of side of human face region.Move
Dynamic terminal can choose target human face region according to preset rules from multiple human face regions.Above-mentioned preset rules can be situations below
Middle one or more：
(1) area of human face region accounts for the ratio of image and whether is less than the 4th threshold value.
(2) whether the average depth of field value of human face region is less than the 5th threshold value.
When the ratio that the area of human face region accounts for image is less than default four threshold value, i.e., human face region is imaged on image
It is smaller, judge that human face region is not owner's face, then by above-mentioned human face region not as target human face region.When putting down for human face region
When equal depth of field value is less than default five threshold value, judge that face is nearer apart from mobile terminal, using human face region as target face.On
It can be the identical value or different value of user's setting to state the 4th threshold value and the 5th threshold value.
Image processing method in the embodiment of the present application, when multiple human face regions in image be present, filter out main in image
Face, be advantageous to carry out white balance processing to image according to owner's face in image, avoid carrying out in vain image according to non-master face
Balance Treatment causes color distortion in image, owner's face and the inconsistent situation of realistic colour in image.
In one embodiment, after the heat radiation value that step 204 obtains portrait, above-mentioned image processing method also wraps
Include：The heat radiation value of portrait is converted into the temperature of portrait, portrait hygrogram is shown in interface of mobile terminal.
Infrared ray can be converted into portrait surface temperature by infrared detector after infrared ray is received in mobile terminal, and
Portrait surface temperature is shown in the form of coloured image in interface of mobile terminal.Different colors represents difference in coloured image
Temperature, it is generally the case that when temperature is higher, image is partially red, and image is partially green when the temperature is low, according to the color of image
Recognizable portrait surface temperature.
In one embodiment, before step 206 carries out white balance processing to image, method also includes：
(1) face characteristic identification is carried out to portrait, obtains human face region in portrait.
(2) depth of view information of human face region is obtained.
(3) if detecting, depth of view information meets preset rules, and white balance processing is carried out to image.
Mobile terminal can carry out face characteristic identification to portrait, face characteristic identification point in portrait be obtained, as five in face
Official's characteristic point.Human face region in portrait can recognize that according to face characteristic point in face.After human face region is identified, people can be obtained
The depth of view information in face region.The depth of view information of above-mentioned human face region is the depth of field value of each pixel of human face region in image.
When mobile terminal for it is double take the photograph mobile terminal when, can be divided by two respective range sensors of camera of mobile terminal
Not Huo Qu two camera distance objectives distance.As shown in figure 3, the primary optical axis of two cameras is parallel in mobile terminal, L points
To do the photocentre of left camera, R points are the photocentre of right camera.Line segment where PL points and PR points is respectively left and right camera
Image planes, the beeline of photocentre to image planes is focal length f.If P is target point (position as where nose in human face region), P
Point is PL and PR in the imaging point of left and right image planes.The distance of the left hand edge of PL points and PR points away from respective image planes is XL and XR, then regards
Poor d=XR-XL or d=XL-XR.Wherein Z is target point P point depth of field value, and T is the distance between left and right camera photocentre.Then root
It can be obtained according to Similar Principle of Triangle：
Then
I.e.
Or
Z is the depth of field value of target point P points, as distance value of the target point P points apart from mobile terminal.By the above method,
The depth of field value of each pixel in image can be obtained successively, can also obtain the depth of field value of each pixel in human face region, i.e. people
The depth of view information in face region.
When mobile terminal for when singly taking the photograph mobile terminal, using the distance between structural light measurement mobile terminal and target,
Obtain the depth of view information of human face region.Specifically, movement can launch infrared ray by infrared LED lamp, and mobile terminal can receive quilt
The infrared ray of reflection, and according to the strength detection target of infrared ray and the distance of mobile terminal of reception.
After the depth of view information of human face region is got, it can detect whether above-mentioned depth of view information meets preset rules.It is above-mentioned
Preset rules are the 3 D stereo rule of human face region, such as the spatial relationship of human face characteristic point, human face region in human face region
Depth relationship of middle human face characteristic point etc..Whether preset rules are met by the depth of view information for detecting human face region, can determine that figure
Whether human face region is three-dimensional image as in.When the depth of view information of human face region meets preset rules, i.e. people in image
When face region is 3-D view, white balance processing is carried out to image.
Above-mentioned preset rules include one or more in situations below：
(1) detect that the maximal field depth value and the difference of minimum depth of field value are more than first threshold in depth of view information.
(2) detect that the difference of fisrt feature point depth of field value and second feature point depth of field value in human face region is more than the second threshold
Value.
Mobile terminal can obtain maximum scape in human face region after the depth of field value of each pixel in getting human face region
The difference of deep value and minimum depth of field value, detects whether above-mentioned difference is more than first threshold.First threshold can be user preset value,
Can be the average value that mobile terminal is asked for according to the human face region depth of field value of acquisition.If above-mentioned difference is more than first threshold, judge
The depth of view information of human face region meets preset rules, i.e. human face region is three-dimensional image.For example, acquisition for mobile terminal face
The depth of field value of ear-lobe is 20 meters in region, is the maximal field depth value in human face region；The depth of field value of nose is 19.90 in human face region
Rice, is minimum depth of field value in human face region, then the maximal field depth value and the difference of minimum depth of field value are 0.1 meter in human face region, greatly
In 0.05 meter of first threshold, then human face region is three-dimensional image.
Mobile terminal can also obtain the depth of field value that characteristic point is preset in human face region, by the difference of the depth of field value of default characteristic point
Value is compared with Second Threshold.Above-mentioned default characteristic point can be mobile terminal according to face characteristic default characteristic point (such as nose, ear
Hang down), or the characteristic point of user's setting.For example, default fisrt feature point is nose, default second feature point is mouth
After the depth of field value of lip, acquisition for mobile terminal fisrt feature point and second feature point, then obtain fisrt feature point and second feature point
Depth of field value difference, the i.e. depth of field value of nose and lip difference, if the difference of the depth of field value of nose and lip be more than it is default
0.02 meter of Second Threshold, i.e. nose and lip judge that human face region is three-dimensional image not in same plane.
Image processing method in the embodiment of the present application, by the relation between depth of field value in human face region, it can determine that face
Region is two dimensional image or three-dimensional image, and mobile terminal can be avoided to detect the two dimensional image such as photo or the billboard
During upper face, carrying out white balance to the image that shooting obtains makes the phenomenon of image fault.
In one embodiment, before step 206 carries out white balance processing to image, method also includes：According to heat spoke
Penetrate value and obtain portrait surface temperature；If portrait surface temperature is more than Second Threshold, white balance processing is carried out to image.
The heat radiation value received can be converted into by infrared detector after heat radiation value is received in mobile terminal
Electric signal, the portrait surface temperature according to corresponding to obtaining electric signal.Wherein, the temperature of different zones is different in people's image surface, such as
The temperature on portrait head is different from the temperature of portrait hand, the temperature of portrait hand and the temperature difference of portrait foot etc..It is mobile
Terminal can obtain the average value of portrait surface temperature after portrait surface temperature is got, by the average value of portrait surface temperature
Compared with Second Threshold, if being more than Second Threshold, judge that portrait is live body, white balance processing is carried out to image.Mobile terminal is also
The minimum value of portrait surface temperature can be obtained, by the minimum value of portrait surface temperature compared with Second Threshold, if being more than the second threshold
Value, judges that portrait is live body, and white balance processing is carried out to image.Mobile terminal can also obtain the maximum of portrait surface temperature,
By the maximum of portrait surface temperature compared with Second Threshold, if being more than Second Threshold, judge that portrait is live body, image is carried out
White balance processing.Above-mentioned Second Threshold can be mobile terminal or user preset value, such as 35 DEG C.Above example is only for example
It is bright, the mode not limited to this of the temperature of specific people's image surface compared with Second Threshold.
Image processing method in the embodiment of the present application, the heat radiation value of the portrait of acquisition is converted into the temperature of people's image surface
Degree, judge whether portrait is live body, decision procedure simple and fast, improves the effect to image procossing according to the temperature of people's image surface
Rate.
In one embodiment, above-mentioned image processing method also includes：If detecting, portrait surface temperature is less than the 3rd threshold
Value, prompt message is shown in interface of mobile terminal；If receiving the touch control operation to prompt message, sent to default contact person pre-
If information.
Mobile terminal, can be by portrait surface temperature compared with default 3rd threshold value after portrait surface temperature is obtained.3rd
Threshold value can be that user sets human body warning temperature value, such as 35 DEG C, 36 DEG C.Under normal circumstances, human temperature angle value is about 37 DEG C, on
Lower float is no more than 0.5 DEG C.Mobile terminal, can be by lowest temperature angle value in portrait surface temperature after portrait surface temperature is got
Compared with default 3rd threshold value, if lowest temperature angle value is less than the 3rd threshold value in portrait surface temperature, mobile terminal judges people's body surface
Face temperature is too low, and portrait sign is abnormal.Mobile terminal can show the abnormal prompt message of portrait sign in interface of mobile terminal, move
Dynamic terminal can also highlight the region that sign is abnormal in portrait in the picture.For example, user sets the 3rd threshold value as 36 DEG C, move
Dynamic terminal detects that the surface temperature in the right foot part region of portrait in image is less than 36 DEG C, judges the right foot part region sign of portrait
It is abnormal, in the prompt message that interface of mobile terminal displaying portrait sign is abnormal, and the right foot part region of portrait is protruded with square frame
Display.
The prompt message of interface of mobile terminal displaying may include：It is the temperature of people's image surface, the 3rd threshold value, location information, pre-
If contact person, presupposed information and transmission request.If receiving the touch control operation to above-mentioned prompt message, mobile terminal can be to default
Contact person sends presupposed information.After mobile terminal detects that portrait surface temperature is less than the 3rd threshold value, current location information is obtained,
Prompt message is shown in interface of mobile terminal, if detecting the trigger action to sending request in presupposed information, to default
It is that people sends presupposed information.For example, send current location information and distress signals to alarm number.
If mobile terminal gets user and does not receive touching for user to the touch control operation of return key or in preset duration
Control operation, mobile terminal can the above-mentioned presupposed information of revocation token.
Image processing method in the real-time example of the application, when detecting that portrait temperature is relatively low, judge that portrait sign is abnormal, to
Default contact person sends presupposed information.By image detection portrait surface temperature, human health status can be monitored, and send out in time
Distress signals are sent, simplify user's operation, improve the convenience of user's operation.
Fig. 3 is the flow chart of image processing method in another embodiment.As shown in figure 3, a kind of image processing method, bag
Include：
Step 302, portrait in image be present if detecting, infrared heat detection is carried out to portrait.
Portrait in image be present if detecting, infrared heat detection is carried out to portrait includes step (1), (2) and (3)：
(1) multiple portraits be present if detecting in image, obtain the parameter value of multiple portraits successively.
(2) target person picture is chosen according to the parameter value of multiple portraits.
(3) infrared heat detection is carried out to target person picture.
Step 304, the heat radiation value of portrait is obtained.
Step 306, if heat radiation value is more than first threshold, face characteristic identification is carried out to portrait, obtains people in portrait
Face region；Obtain the depth of view information of human face region；If detecting, depth of view information meets preset rules, and image is carried out at white balance
Reason.
Step 308, if heat radiation value is more than first threshold, portrait surface temperature is obtained according to heat radiation value；If people
Image surface temperature is more than Second Threshold, and white balance processing is carried out to image.
Step 310, if detecting, portrait surface temperature is less than the 3rd threshold value, and prompt message is shown in interface of mobile terminal；
If receiving the touch control operation to prompt message, presupposed information is sent to default contact person.
Image processing method in the embodiment of the present application, detected in image when portrait be present, obtained by Face datection algorithm
The heat radiation value of portrait in image is taken, obtains the temperature of portrait, depth of view information detection is carried out to human face region in portrait, judged
After portrait is true man, white balance processing is carried out to image so that the color of image is improved pair closer to the color of real scene
Portrait image carries out the accuracy rate of white balance, avoids face in flase drop altimetric image and carries out white balance processing to image, causes
Image differs larger situation with realistic colour.
Fig. 4 be one embodiment in image processing apparatus structured flowchart, a kind of image processing apparatus, including：
Detection module 402, if portrait in image be present for detecting, infrared heat detection is carried out to portrait.
Acquisition module 404, for obtaining the heat radiation value of portrait.
Processing module 406, if being more than first threshold for heat radiation value, white balance processing is carried out to image.
In one embodiment, if detection module 402, which is additionally operable to detect in image, has multiple portraits, obtain successively more
The parameter value of individual portrait.Target person picture is chosen according to the parameter value of multiple portraits.Infrared heat detection is carried out to target person picture.
Fig. 5 is the structured flowchart of image processing apparatus in another embodiment.As shown in figure 5, a kind of image processing apparatus,
Including：Detection module 502, acquisition module 504, processing module 506, face recognition module 508 and depth of field acquisition module 510.On
It is identical with corresponding functions of modules in Fig. 4 to state detection module 502, acquisition module 504, processing module 506.
Face recognition module 508, for carrying out face characteristic identification to portrait, obtain human face region in portrait.
Depth of field acquisition module 510, for obtaining the depth of view information of human face region.
If processing module 506 is additionally operable to detect that depth of view information meets preset rules, white balance processing is carried out to image.
Fig. 6 is the structured flowchart of image processing apparatus in another embodiment.As shown in fig. 6, a kind of image processing apparatus,
Including：Detection module 602, acquisition module 604, processing module 606, temperature acquisition module 608.Above-mentioned detection module 602, obtain
Module 604, processing module 606 are identical with corresponding functions of modules in Fig. 4.
Temperature acquisition module 608, for obtaining portrait surface temperature according to heat radiation value.
If processing module 606, which is additionally operable to portrait surface temperature, is more than Second Threshold, white balance processing is carried out to image.
Fig. 7 is the structured flowchart of image processing apparatus in one embodiment.As shown in fig. 7, a kind of image processing apparatus, bag
Include：Detection module 702, acquisition module 704, processing module 706, display module 708 and sending module 710.Above-mentioned detection module
702nd, acquisition module 704, processing module 707 are identical with corresponding functions of modules in Fig. 4.
Display module 708, if for detecting that portrait surface temperature is less than the 3rd threshold value, carried in interface of mobile terminal displaying
Show information.
Sending module 710, if for receiving the touch control operation to prompt message, default letter is sent to default contact person
Breath.
The division of modules is only used for for example, in other embodiments, will can scheme in above-mentioned image processing apparatus
As processing unit is divided into different modules as required, to complete all or part of function of above-mentioned image processing apparatus.
The embodiment of the present application additionally provides a kind of computer-readable recording medium.A kind of computer-readable recording medium, its
On be stored with computer program, above computer program realizes the step of image processing method as described above when being executed by processor
Suddenly.
The embodiment of the present invention also provides a kind of mobile terminal.Above-mentioned mobile terminal includes image processing circuit, at image
Managing circuit can utilize hardware and/or component software to realize, it may include define ISP (Image Signal Processing, figure
As signal transacting) the various processing units of pipeline.Fig. 8 is the schematic diagram of image processing circuit in one embodiment.Such as Fig. 8 institutes
Show, for purposes of illustration only, only showing the various aspects of the image processing techniques related to the embodiment of the present invention.
As shown in figure 8, image processing circuit includes ISP processors 840 and control logic device 850.Imaging device 810 is caught
View data handled first by ISP processors 840, ISP processors 840 view data is analyzed with catch can be used for it is true
The image statistics of fixed and/or imaging device 810 one or more control parameters.Imaging device 810 may include there is one
The camera of individual or multiple lens 812 and imaging sensor 814.Imaging sensor 814 may include colour filter array (such as
Bayer filters), imaging sensor 814 can obtain the luminous intensity caught with each imaging pixel of imaging sensor 814 and wavelength
Information, and the one group of raw image data that can be handled by ISP processors 840 is provided.Sensor 820 (such as gyroscope) can be based on passing
The parameter (such as stabilization parameter) of the image procossing of collection is supplied to ISP processors 840 by the interface type of sensor 820.Sensor 820
Interface can utilize SMIA (Standard Mobile Imaging Architecture, Standard Mobile Imager framework) interface,
The combination of other serial or parallel camera interfaces or above-mentioned interface.
In addition, raw image data can also be sent to sensor 820 by imaging sensor 814, sensor 820 can be based on passing
The interface type of sensor 820 is supplied to ISP processors 840, or sensor 820 to deposit raw image data raw image data
Store up in video memory 830.
ISP processors 840 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 840 can be carried out at one or more images to raw image data
Reason operation, statistical information of the collection on view data.Wherein, image processing operations can be by identical or different bit depth precision
Carry out.
ISP processors 840 can also receive view data from video memory 830.For example, the interface of sensor 820 will be original
View data is sent to video memory 830, and the raw image data in video memory 830 is available to ISP processors 840
It is for processing.Video memory 830 can be independent special in the part of storage arrangement, storage device or electronic equipment
With memory, and it may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving from the interface of imaging sensor 814 or from the interface of sensor 820 or from video memory 830
During raw image data, ISP processors 840 can carry out one or more image processing operations, such as time-domain filtering.Figure after processing
As data can be transmitted to video memory 830, to carry out other processing before shown.ISP processors 840 are from image
The reception processing data of memory 830, and the processing data is carried out in original domain and in RGB and YCbCr color spaces
Image real time transfer.ISP processors 840 processing after view data may be output to display 870, for user viewing and/or
Further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).In addition, ISP processors
840 output also can be transmitted to video memory 830, and display 870 can read view data from video memory 830.
In one embodiment, video memory 830 can be configured as realizing one or more frame buffers.In addition, ISP processors 840
Output can be transmitted to encoder/decoder 860, so as to encoding/decoding image data.The view data of coding can be saved,
And decompressed before being shown in the equipment of display 870.Encoder/decoder 860 can be real by CPU or GPU or coprocessor
It is existing.
The statistics that ISP processors 840 determine, which can be transmitted, gives the unit of control logic device 850.For example, statistics can wrap
Include the image sensings such as automatic exposure, AWB, automatic focusing, flicker detection, black level compensation, the shadow correction of lens 812
The statistical information of device 814.Control logic device 850 may include the processor and/or micro-control for performing one or more routines (such as firmware)
Device processed, one or more routines according to the statistics of reception, can determine the control parameter and ISP processors of imaging device 810
840 control parameter.For example, the control parameter of imaging device 810 may include the control parameter of sensor 820 (such as gain, exposure
Time of integration of control, stabilization parameter etc.), camera flash control parameter, the control parameter of lens 812 (such as focus on or zoom
With focal length) or these parameters combination.ISP control parameters may include to be used for AWB and color adjustment (for example, in RGB
During processing) gain level and color correction matrix, and the shadow correction parameter of lens 812.
Image processing method as described above can be realized with image processing techniques in Fig. 8.
One of ordinary skill in the art will appreciate that realize all or part of flow in above-described embodiment method, being can be with
The hardware of correlation is instructed to complete by computer program, described program can be stored in a non-volatile computer and can be read
In storage medium, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage is situated between
Matter can be magnetic disc, CD, read-only memory (Read-Only Memory, ROM) etc..
Embodiment described above only expresses the several embodiments of the present invention, and its description is more specific and detailed, but simultaneously
Therefore the limitation to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that for one of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (12)
- A kind of 1. image processing method, it is characterised in that including：Portrait in image be present if detecting, infrared heat detection is carried out to the portrait；Obtain the heat radiation value of the portrait；If the heat radiation value is more than first threshold, white balance processing is carried out to described image.
- 2. image processing method according to claim 1, it is characterised in that if portrait in image be present in described detect, Infrared heat detection is carried out to the portrait to be included：Multiple portraits be present if detecting in described image, obtain the parameter value of the multiple portrait successively；Target person picture is chosen according to the parameter value of the multiple portrait；Infrared heat detection is carried out to the target person picture.
- 3. image processing method according to claim 1 or 2, it is characterised in that described that white balance is carried out to described image Before processing, methods described also includes：Face characteristic identification is carried out to the portrait, obtains human face region in the portrait；Obtain the depth of view information of the human face region；If detecting, the depth of view information meets preset rules, and white balance processing is carried out to described image.
- 4. image processing method according to claim 1 or 2, it is characterised in that described that white balance is carried out to described image Before processing, methods described also includes：The portrait surface temperature is obtained according to the heat radiation value；If the portrait surface temperature is more than Second Threshold, white balance processing is carried out to described image.
- 5. image processing method according to claim 4, it is characterised in that methods described also includes：If detecting, the portrait surface temperature is less than the 3rd threshold value, and prompt message is shown in interface of mobile terminal；If receiving the touch control operation to the prompt message, presupposed information is sent to default contact person.
- A kind of 6. image processing apparatus, it is characterised in that including：Detection module, if portrait in image be present for detecting, infrared heat detection is carried out to the portrait；Acquisition module, for obtaining the heat radiation value of the portrait；Processing module, if being more than first threshold for the heat radiation value, white balance processing is carried out to described image.
- 7. image processing apparatus according to claim 6, it is characterised in that：If the detection module, which is additionally operable to detect in described image, has multiple portraits, the ginseng of the multiple portrait is obtained successively Numerical value；Target person picture is chosen according to the parameter value of the multiple portrait；Infrared heat detection is carried out to the target person picture.
- 8. the image processing apparatus according to claim 6 or 7, it is characterised in that described device also includes：Face recognition module, for carrying out face characteristic identification to the portrait, obtain human face region in the portrait；Depth of field acquisition module, for obtaining the depth of view information of the human face region；If the processing module is additionally operable to detect that the depth of view information meets preset rules, described image is carried out at white balance Reason.
- 9. the image processing apparatus according to claim 6 or 7, it is characterised in that described device also includes：Temperature acquisition module, for obtaining the portrait surface temperature according to the heat radiation value；If the processing module, which is additionally operable to the portrait surface temperature, is more than Second Threshold, described image is carried out at white balance Reason.
- 10. image processing apparatus according to claim 9, it is characterised in that described device also includes：Display module, if for detecting that the portrait surface temperature is less than the 3rd threshold value, show and prompt in interface of mobile terminal Information；Sending module, if for receiving the touch control operation to the prompt message, presupposed information is sent to default contact person.
- 11. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program The step of image processing method as any one of claim 1 to 5 is realized when being executed by processor.
- 12. a kind of mobile terminal, including memory and processor, computer-readable instruction is stored in the memory, it is described When instruction is by the computing device so that image procossing of the computing device as any one of claim 1 to 5 Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710775165.XA CN107454335B (en) | 2017-08-31 | 2017-08-31 | Image processing method, image processing device, computer-readable storage medium and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710775165.XA CN107454335B (en) | 2017-08-31 | 2017-08-31 | Image processing method, image processing device, computer-readable storage medium and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107454335A true CN107454335A (en) | 2017-12-08 |
| CN107454335B CN107454335B (en) | 2020-03-27 |
Family
ID=60494829
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710775165.XA Expired - Fee Related CN107454335B (en) | 2017-08-31 | 2017-08-31 | Image processing method, image processing device, computer-readable storage medium and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107454335B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108182667A (en) * | 2017-12-29 | 2018-06-19 | 努比亚技术有限公司 | A kind of image optimization method, terminal and computer readable storage medium |
| CN110610171A (en) * | 2019-09-24 | 2019-12-24 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
| CN110929557A (en) * | 2019-09-25 | 2020-03-27 | 四川大学锦城学院 | Intelligent security method, system and processing device based on in-vivo detection |
| CN111292670A (en) * | 2020-03-30 | 2020-06-16 | Tcl华星光电技术有限公司 | White balance adjustment method and white balance test data calculation method |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622588A (en) * | 2012-03-08 | 2012-08-01 | 无锡数字奥森科技有限公司 | Dual-certification face anti-counterfeit method and device |
| CN103235942A (en) * | 2013-05-14 | 2013-08-07 | 苏州福丰科技有限公司 | Facial recognition method applied to entrance guard |
| US20140348399A1 (en) * | 2013-05-22 | 2014-11-27 | Asustek Computer Inc. | Image processing system and method of improving human face recognition |
| CN105138981A (en) * | 2015-08-20 | 2015-12-09 | 北京旷视科技有限公司 | In-vivo detection system and method |
| CN105182983A (en) * | 2015-10-22 | 2015-12-23 | 深圳创想未来机器人有限公司 | Face real-time tracking method and face real-time tracking system based on mobile robot |
| CN105574518A (en) * | 2016-01-25 | 2016-05-11 | 北京天诚盛业科技有限公司 | Method and device for human face living detection |
| CN105654028A (en) * | 2015-09-29 | 2016-06-08 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and apparatus thereof |
| CN106203320A (en) * | 2016-07-06 | 2016-12-07 | 惠州Tcl移动通信有限公司 | A kind of recognition of face optimization method based on mobile terminal and system |
| CN106851238A (en) * | 2017-03-09 | 2017-06-13 | 广东欧珀移动通信有限公司 | Method for controlling white balance, white balance control device and electronic installation |
-
2017
- 2017-08-31 CN CN201710775165.XA patent/CN107454335B/en not_active Expired - Fee Related
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102622588A (en) * | 2012-03-08 | 2012-08-01 | 无锡数字奥森科技有限公司 | Dual-certification face anti-counterfeit method and device |
| CN103235942A (en) * | 2013-05-14 | 2013-08-07 | 苏州福丰科技有限公司 | Facial recognition method applied to entrance guard |
| US20140348399A1 (en) * | 2013-05-22 | 2014-11-27 | Asustek Computer Inc. | Image processing system and method of improving human face recognition |
| CN105138981A (en) * | 2015-08-20 | 2015-12-09 | 北京旷视科技有限公司 | In-vivo detection system and method |
| CN105654028A (en) * | 2015-09-29 | 2016-06-08 | 厦门中控生物识别信息技术有限公司 | True and false face identification method and apparatus thereof |
| CN105182983A (en) * | 2015-10-22 | 2015-12-23 | 深圳创想未来机器人有限公司 | Face real-time tracking method and face real-time tracking system based on mobile robot |
| CN105574518A (en) * | 2016-01-25 | 2016-05-11 | 北京天诚盛业科技有限公司 | Method and device for human face living detection |
| CN106203320A (en) * | 2016-07-06 | 2016-12-07 | 惠州Tcl移动通信有限公司 | A kind of recognition of face optimization method based on mobile terminal and system |
| CN106851238A (en) * | 2017-03-09 | 2017-06-13 | 广东欧珀移动通信有限公司 | Method for controlling white balance, white balance control device and electronic installation |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108182667A (en) * | 2017-12-29 | 2018-06-19 | 努比亚技术有限公司 | A kind of image optimization method, terminal and computer readable storage medium |
| CN108182667B (en) * | 2017-12-29 | 2020-07-17 | 珠海大横琴科技发展有限公司 | Image optimization method, terminal and computer readable storage medium |
| CN110610171A (en) * | 2019-09-24 | 2019-12-24 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
| CN110929557A (en) * | 2019-09-25 | 2020-03-27 | 四川大学锦城学院 | Intelligent security method, system and processing device based on in-vivo detection |
| CN111292670A (en) * | 2020-03-30 | 2020-06-16 | Tcl华星光电技术有限公司 | White balance adjustment method and white balance test data calculation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107454335B (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107948519B (en) | Image processing method, device and equipment | |
| CN107977940B (en) | Background blurring processing method, device and equipment | |
| KR102279436B1 (en) | Image processing methods, devices and devices | |
| CN108683862A (en) | Image formation control method, device, electronic equipment and computer readable storage medium | |
| CN107835372A (en) | Imaging method, device, mobile terminal and storage medium based on dual camera | |
| CN107481186B (en) | Image processing method, image processing device, computer-readable storage medium and computer equipment | |
| CN111028190A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN107704798B (en) | Image blurring method and device, computer readable storage medium and computer device | |
| CN107454335A (en) | Image processing method, device, computer-readable recording medium and mobile terminal | |
| CN107493432A (en) | Image processing method, device, mobile terminal and computer-readable recording medium | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN109685853B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN108024054A (en) | Image processing method, device and equipment | |
| CN108683863A (en) | Image formation control method, device, electronic equipment and readable storage medium storing program for executing | |
| CN108419022A (en) | Control method, control device, computer readable storage medium and computer equipment | |
| CN107563329A (en) | Image processing method, device, computer-readable recording medium and mobile terminal | |
| CN107563979B (en) | Image processing method, image processing device, computer-readable storage medium and computer equipment | |
| WO2019105254A1 (en) | Background blur processing method, apparatus and device | |
| CN108012078A (en) | Brightness of image processing method, device, storage medium and electronic equipment | |
| CN108053438A (en) | Depth of field acquisition methods, device and equipment | |
| CN109040607A (en) | Image formation control method, device, electronic equipment and computer readable storage medium | |
| CN107465903B (en) | Image white balance method, device and computer readable storage medium | |
| CN108965729A (en) | Control method, device, electronic equipment and computer readable storage medium | |
| CN107959843B (en) | Image processing method and device, computer readable storage medium and computer equipment | |
| CN107454328B (en) | Image processing method, device, computer readable storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200327 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |