CN107454335A - Image processing method, device, computer-readable recording medium and mobile terminal - Google Patents

Image processing method, device, computer-readable recording medium and mobile terminal Download PDF

Info

Publication number
CN107454335A
CN107454335A CN201710775165.XA CN201710775165A CN107454335A CN 107454335 A CN107454335 A CN 107454335A CN 201710775165 A CN201710775165 A CN 201710775165A CN 107454335 A CN107454335 A CN 107454335A
Authority
CN
China
Prior art keywords
portrait
image
carried out
mobile terminal
image processing
Prior art date
Application number
CN201710775165.XA
Other languages
Chinese (zh)
Other versions
CN107454335B (en
Inventor
袁全
Original Assignee
广东欧珀移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东欧珀移动通信有限公司 filed Critical 广东欧珀移动通信有限公司
Priority to CN201710775165.XA priority Critical patent/CN107454335B/en
Publication of CN107454335A publication Critical patent/CN107454335A/en
Application granted granted Critical
Publication of CN107454335B publication Critical patent/CN107454335B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23218Control of camera operation based on recognized objects
    • H04N5/23219Control of camera operation based on recognized objects where the recognized objects include parts of the human body, e.g. human faces, facial parts or facial expressions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23216Control of parameters, e.g. field or angle of view of camera via graphical user interface, e.g. touchscreen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/04Picture signal generators
    • H04N9/045Picture signal generators using solid-state devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/73Circuits for processing colour signals colour balance circuits, e.g. white balance circuits, colour temperature control
    • H04N9/735Circuits for processing colour signals colour balance circuits, e.g. white balance circuits, colour temperature control for picture signal generators

Abstract

The present invention relates to a kind of image processing method, device, computer-readable recording medium and mobile terminal.The above method includes:Portrait in image be present if detecting, infrared heat detection is carried out to the portrait;Obtain the heat radiation value of the portrait;If the heat radiation value is more than first threshold, white balance processing is carried out to described image.The above method, when can detect human face region in the picture, white balance processing is carried out to image so that the realistic colour of scene can be presented in image.

Description

Image processing method, device, computer-readable recording medium and mobile terminal

Technical field

The present invention relates to field of computer technology, more particularly to a kind of image processing method, device, computer-readable deposit Storage media and mobile terminal.

Background technology

With the development of intelligent mobile terminal, the function of intelligent mobile terminal is more and more diversified.For example, using intelligence When mobile terminal is shot, intelligent mobile terminal can carry out automatic exposure, AWB, automatic to the image that shooting obtains U.S. face and automatic virtualization processing so that shoot that the image level of acquisition is clearly demarcated, the realistic colour of scene can be presented in image.

The content of the invention

The embodiment of the present invention provides a kind of image processing method, device, computer-readable recording medium and mobile terminal, can During detecting human face region in the picture, white balance processing is carried out to image so that the realistic colour of scene can be presented in image.

A kind of image processing method, including:

Portrait in image be present if detecting, infrared heat detection is carried out to the portrait;

Obtain the heat radiation value of the portrait;

If the heat radiation value is more than first threshold, white balance processing is carried out to described image.

A kind of image processing apparatus, including:

Detection module, if portrait in image be present for detecting, infrared heat detection is carried out to the portrait;

Acquisition module, for obtaining the heat radiation value of the portrait;

Processing module, if being more than first threshold for the heat radiation value, white balance processing is carried out to described image.

A kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program The step of image processing method as described above is realized when being executed by processor.

A kind of mobile terminal, including memory and processor, computer-readable instruction is stored in the memory, it is described When instruction is by the computing device so that the computing device image processing method as described above.

Brief description of the drawings

In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with Other accompanying drawings are obtained according to these accompanying drawings.

Fig. 1 is the internal structure schematic diagram of mobile terminal 10 in one embodiment;

Fig. 2 is the flow chart of image processing method in one embodiment;

Fig. 3 is the flow chart of image processing method in another embodiment;

Fig. 4 is the structured flowchart of image processing apparatus in one embodiment;

Fig. 5 is the structured flowchart of image processing apparatus in another embodiment;

Fig. 6 is the structured flowchart of image processing apparatus in another embodiment;

Fig. 7 is the structured flowchart of image processing apparatus in one embodiment;

Fig. 8 is the schematic diagram of image processing circuit in one embodiment.

Embodiment

In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.

It is appreciated that term " first " used in the present invention, " second " etc. can be used to describe various elements herein, But these elements should not be limited by these terms.These terms are only used for distinguishing first element and another element.Citing comes Say, without departing from the scope of the invention, the first client can be referred to as the second client, and similarly, can incite somebody to action Second client is referred to as the first client.First client and the second client both clients, but it is not same visitor Family end.

Fig. 1 is the internal structure schematic diagram of mobile terminal 10 in one embodiment.As shown in figure 1, the mobile terminal 10 wraps Include the processor connected by system bus, non-volatile memory medium, built-in storage, network interface, display screen and input dress Put.Wherein, the non-volatile memory medium of mobile terminal 10 is stored with operating system and computer-readable instruction.The computer can To realize a kind of image processing method when reading instruction is executed by processor.The processor is used to provide calculating and control ability, branch Support the operation of whole mobile terminal 10.Built-in storage in mobile terminal 10 is computer-readable in non-volatile memory medium The operation of instruction provides environment.Network interface is used to carry out network service with server.The display screen of mobile terminal 10 can be LCDs or electric ink display screen etc., input unit can be the touch layers or shifting covered on display screen Move button, trace ball or Trackpad or the external keyboard set on the shell of terminal 10, Trackpad or mouse etc..Should Mobile terminal 10 can be mobile phone, tablet personal computer or personal digital assistant or Wearable etc..Those skilled in the art can To understand, the block diagram of the structure, the only part-structure related to application scheme that are shown in Fig. 1, do not form to this Shen Please the restriction of mobile terminal 10 that is applied thereon of scheme, specific mobile terminal 10 can include it is more more than shown in figure or Less part, either combine some parts or arranged with different parts.

Fig. 2 is the flow chart of image processing method in one embodiment.As shown in Fig. 2 a kind of image processing method, bag Include:

Step 202, portrait in image be present if detecting, infrared heat detection is carried out to portrait.

When running of mobile terminal photographing program obtains image, mobile terminal can be used in Face datection algorithm detection image With the presence or absence of face.If detecting face in image be present, i.e., portrait be present in image.Infrared heat is carried out to portrait in image Detection.

According to heat radiation principle, human body is due to temperature and to the continuous emittance of surrounding space.Wherein, human body temperature Higher, the energy that human body radiates to surrounding space is more.Infrared detector can receive the energy of human body radiation in mobile terminal, and According to the temperature for the how much judgement human bodies for receiving emittance.Specifically, because human body steady temperature is 37 DEG C, people knows from experience spoke The infrared ray of specific wavelength is penetrated, such as the infrared ray that wavelength is 10 μm.Infrared detector can be 10 μm according to the wavelength received Infrared ray, the radiation energy that infrared ray is had are converted into electric signal, so as to obtain the heat radiation value of portrait and the temperature of portrait. When human body temperature is higher, human body is more to the energy of external radiation, and the wavelength that infrared detector receives is that 10 μm of infrared ray is got over More, i.e. the heat radiation value of portrait is higher.

Step 204, the heat radiation value of portrait is obtained.

Infrared detector can judge the position of portrait according to the orientation of the infrared ray received in mobile terminal.Mobile terminal When running photographing program acquisition image, there can be multiple portraits on image, mobile terminal portrait in image carries out infrared heat During amount detection, the heat radiation energy of multiple portraits on image can be got.Mobile terminal determines portrait according to the orientation of infrared ray Position after, choose on image mobile terminal check or owner's face of user's selection corresponding to portrait, obtain corresponding to owner's face The heat radiation value of portrait.

Step 206, if heat radiation value is more than first threshold, white balance processing is carried out to image.

First threshold is default heat radiation value, such as the heat radiation value that temperature is 20 DEG C of black matrixes.If the heat of portrait Amount radiation value is more than default first threshold, and can determine whether portrait is live body, and white balance processing is carried out to image.Wherein, to image Carrying out white balance processing includes:There are three CCD (Charge-coupled Device, electronics coupled original paper) electric in mobile terminal Sub- coupling element, above three CCD electronics coupleds original paper can receive blueness, green and red light respectively.Mobile terminal is pre- If the ratio that three CCD electronics coupleds original papers receive blueness, green and red light is 1:1:1.When running of mobile terminal is put down in vain When accounting method, mobile terminal can adjust three CCD electronics coupleds in real time according to the ratio of blueness, green and red light in scenery Original paper receives the ratio of light so that the image of shooting is identical with actual color.For example, shooting scenery in blueness, green and The ratio of red light is 2:1:1, mobile terminal adjustment CCD electronics coupleds original paper receives the ratio of blueness, green and red light Example is 1:2:2 so that image Green and it is red increase, color is closer to realistic colour in image.

When face in image be present, by carrying out white balance processing to image, it may be such that the portrait color of shooting more connects The color of nearly true portrait.In conventional art, mobile terminal can carry out recognition of face to image, detect face in image be present Afterwards, i.e., white balance processing is carried out to image.In actual use, mobile terminal to image when carrying out recognition of face, only With the presence or absence of the two dimensional image for meeting face characteristic in detection image, when doll, photo, statue, billboard etc. are present in image During facial image, mobile terminal can also carry out white balance processing, but facial image in doll, photo, statue, billboard to image Larger with real human face image aberration, the white balance processing to image can cause the image and real scene color phase of shooting acquisition Difference is larger.

Image processing method in the embodiment of the present application, detected in image when portrait be present, obtained by Face datection algorithm The heat radiation value of portrait in image is taken, detects whether portrait is true man according to the heat radiation value of portrait in image, if detection It is true man to portrait, white balance processing is carried out to image so that the color of image is improved pair closer to the color of real scene Portrait image carries out the accuracy rate of white balance, avoids face in flase drop altimetric image and carries out white balance processing to image, causes Image differs larger situation with realistic colour.

In one embodiment, if detecting portrait in image be present in step 202, infrared heat detection is carried out to portrait Including:

(1) multiple portraits be present if detecting in image, obtain the parameter value of multiple portraits successively.

(2) target person picture is chosen according to the parameter value of multiple portraits.

(3) infrared heat detection is carried out to target person picture.

When multiple human face regions in image be present, mobile terminal can obtain the parameter value of multiple human face regions, according to more The parameter value of individual human face region chooses target face, i.e., owner's face in image.The parameter value of above-mentioned human face region includes:Face area The length of side in domain, the area of human face region, human face region account for the ratio of image, the ratio of human face region and human face region, face area The average depth of field value in domain etc..Wherein, mobile terminal can will show the number of pixels of human face region and the area as human face region. When human face region is regular polygon, the number of pixels shared by the length of side of regular polygon is the length of side of human face region.Move Dynamic terminal can choose target human face region according to preset rules from multiple human face regions.Above-mentioned preset rules can be situations below Middle one or more:

(1) area of human face region accounts for the ratio of image and whether is less than the 4th threshold value.

(2) whether the average depth of field value of human face region is less than the 5th threshold value.

When the ratio that the area of human face region accounts for image is less than default four threshold value, i.e., human face region is imaged on image It is smaller, judge that human face region is not owner's face, then by above-mentioned human face region not as target human face region.When putting down for human face region When equal depth of field value is less than default five threshold value, judge that face is nearer apart from mobile terminal, using human face region as target face.On It can be the identical value or different value of user's setting to state the 4th threshold value and the 5th threshold value.

Image processing method in the embodiment of the present application, when multiple human face regions in image be present, filter out main in image Face, be advantageous to carry out white balance processing to image according to owner's face in image, avoid carrying out in vain image according to non-master face Balance Treatment causes color distortion in image, owner's face and the inconsistent situation of realistic colour in image.

In one embodiment, after the heat radiation value that step 204 obtains portrait, above-mentioned image processing method also wraps Include:The heat radiation value of portrait is converted into the temperature of portrait, portrait hygrogram is shown in interface of mobile terminal.

Infrared ray can be converted into portrait surface temperature by infrared detector after infrared ray is received in mobile terminal, and Portrait surface temperature is shown in the form of coloured image in interface of mobile terminal.Different colors represents difference in coloured image Temperature, it is generally the case that when temperature is higher, image is partially red, and image is partially green when the temperature is low, according to the color of image Recognizable portrait surface temperature.

In one embodiment, before step 206 carries out white balance processing to image, method also includes:

(1) face characteristic identification is carried out to portrait, obtains human face region in portrait.

(2) depth of view information of human face region is obtained.

(3) if detecting, depth of view information meets preset rules, and white balance processing is carried out to image.

Mobile terminal can carry out face characteristic identification to portrait, face characteristic identification point in portrait be obtained, as five in face Official's characteristic point.Human face region in portrait can recognize that according to face characteristic point in face.After human face region is identified, people can be obtained The depth of view information in face region.The depth of view information of above-mentioned human face region is the depth of field value of each pixel of human face region in image.

When mobile terminal for it is double take the photograph mobile terminal when, can be divided by two respective range sensors of camera of mobile terminal Not Huo Qu two camera distance objectives distance.As shown in figure 3, the primary optical axis of two cameras is parallel in mobile terminal, L points To do the photocentre of left camera, R points are the photocentre of right camera.Line segment where PL points and PR points is respectively left and right camera Image planes, the beeline of photocentre to image planes is focal length f.If P is target point (position as where nose in human face region), P Point is PL and PR in the imaging point of left and right image planes.The distance of the left hand edge of PL points and PR points away from respective image planes is XL and XR, then regards Poor d=XR-XL or d=XL-XR.Wherein Z is target point P point depth of field value, and T is the distance between left and right camera photocentre.Then root It can be obtained according to Similar Principle of Triangle:

Then

I.e.

Or

Z is the depth of field value of target point P points, as distance value of the target point P points apart from mobile terminal.By the above method, The depth of field value of each pixel in image can be obtained successively, can also obtain the depth of field value of each pixel in human face region, i.e. people The depth of view information in face region.

When mobile terminal for when singly taking the photograph mobile terminal, using the distance between structural light measurement mobile terminal and target, Obtain the depth of view information of human face region.Specifically, movement can launch infrared ray by infrared LED lamp, and mobile terminal can receive quilt The infrared ray of reflection, and according to the strength detection target of infrared ray and the distance of mobile terminal of reception.

After the depth of view information of human face region is got, it can detect whether above-mentioned depth of view information meets preset rules.It is above-mentioned Preset rules are the 3 D stereo rule of human face region, such as the spatial relationship of human face characteristic point, human face region in human face region Depth relationship of middle human face characteristic point etc..Whether preset rules are met by the depth of view information for detecting human face region, can determine that figure Whether human face region is three-dimensional image as in.When the depth of view information of human face region meets preset rules, i.e. people in image When face region is 3-D view, white balance processing is carried out to image.

Above-mentioned preset rules include one or more in situations below:

(1) detect that the maximal field depth value and the difference of minimum depth of field value are more than first threshold in depth of view information.

(2) detect that the difference of fisrt feature point depth of field value and second feature point depth of field value in human face region is more than the second threshold Value.

Mobile terminal can obtain maximum scape in human face region after the depth of field value of each pixel in getting human face region The difference of deep value and minimum depth of field value, detects whether above-mentioned difference is more than first threshold.First threshold can be user preset value, Can be the average value that mobile terminal is asked for according to the human face region depth of field value of acquisition.If above-mentioned difference is more than first threshold, judge The depth of view information of human face region meets preset rules, i.e. human face region is three-dimensional image.For example, acquisition for mobile terminal face The depth of field value of ear-lobe is 20 meters in region, is the maximal field depth value in human face region;The depth of field value of nose is 19.90 in human face region Rice, is minimum depth of field value in human face region, then the maximal field depth value and the difference of minimum depth of field value are 0.1 meter in human face region, greatly In 0.05 meter of first threshold, then human face region is three-dimensional image.

Mobile terminal can also obtain the depth of field value that characteristic point is preset in human face region, by the difference of the depth of field value of default characteristic point Value is compared with Second Threshold.Above-mentioned default characteristic point can be mobile terminal according to face characteristic default characteristic point (such as nose, ear Hang down), or the characteristic point of user's setting.For example, default fisrt feature point is nose, default second feature point is mouth After the depth of field value of lip, acquisition for mobile terminal fisrt feature point and second feature point, then obtain fisrt feature point and second feature point Depth of field value difference, the i.e. depth of field value of nose and lip difference, if the difference of the depth of field value of nose and lip be more than it is default 0.02 meter of Second Threshold, i.e. nose and lip judge that human face region is three-dimensional image not in same plane.

Image processing method in the embodiment of the present application, by the relation between depth of field value in human face region, it can determine that face Region is two dimensional image or three-dimensional image, and mobile terminal can be avoided to detect the two dimensional image such as photo or the billboard During upper face, carrying out white balance to the image that shooting obtains makes the phenomenon of image fault.

In one embodiment, before step 206 carries out white balance processing to image, method also includes:According to heat spoke Penetrate value and obtain portrait surface temperature;If portrait surface temperature is more than Second Threshold, white balance processing is carried out to image.

The heat radiation value received can be converted into by infrared detector after heat radiation value is received in mobile terminal Electric signal, the portrait surface temperature according to corresponding to obtaining electric signal.Wherein, the temperature of different zones is different in people's image surface, such as The temperature on portrait head is different from the temperature of portrait hand, the temperature of portrait hand and the temperature difference of portrait foot etc..It is mobile Terminal can obtain the average value of portrait surface temperature after portrait surface temperature is got, by the average value of portrait surface temperature Compared with Second Threshold, if being more than Second Threshold, judge that portrait is live body, white balance processing is carried out to image.Mobile terminal is also The minimum value of portrait surface temperature can be obtained, by the minimum value of portrait surface temperature compared with Second Threshold, if being more than the second threshold Value, judges that portrait is live body, and white balance processing is carried out to image.Mobile terminal can also obtain the maximum of portrait surface temperature, By the maximum of portrait surface temperature compared with Second Threshold, if being more than Second Threshold, judge that portrait is live body, image is carried out White balance processing.Above-mentioned Second Threshold can be mobile terminal or user preset value, such as 35 DEG C.Above example is only for example It is bright, the mode not limited to this of the temperature of specific people's image surface compared with Second Threshold.

Image processing method in the embodiment of the present application, the heat radiation value of the portrait of acquisition is converted into the temperature of people's image surface Degree, judge whether portrait is live body, decision procedure simple and fast, improves the effect to image procossing according to the temperature of people's image surface Rate.

In one embodiment, above-mentioned image processing method also includes:If detecting, portrait surface temperature is less than the 3rd threshold Value, prompt message is shown in interface of mobile terminal;If receiving the touch control operation to prompt message, sent to default contact person pre- If information.

Mobile terminal, can be by portrait surface temperature compared with default 3rd threshold value after portrait surface temperature is obtained.3rd Threshold value can be that user sets human body warning temperature value, such as 35 DEG C, 36 DEG C.Under normal circumstances, human temperature angle value is about 37 DEG C, on Lower float is no more than 0.5 DEG C.Mobile terminal, can be by lowest temperature angle value in portrait surface temperature after portrait surface temperature is got Compared with default 3rd threshold value, if lowest temperature angle value is less than the 3rd threshold value in portrait surface temperature, mobile terminal judges people's body surface Face temperature is too low, and portrait sign is abnormal.Mobile terminal can show the abnormal prompt message of portrait sign in interface of mobile terminal, move Dynamic terminal can also highlight the region that sign is abnormal in portrait in the picture.For example, user sets the 3rd threshold value as 36 DEG C, move Dynamic terminal detects that the surface temperature in the right foot part region of portrait in image is less than 36 DEG C, judges the right foot part region sign of portrait It is abnormal, in the prompt message that interface of mobile terminal displaying portrait sign is abnormal, and the right foot part region of portrait is protruded with square frame Display.

The prompt message of interface of mobile terminal displaying may include:It is the temperature of people's image surface, the 3rd threshold value, location information, pre- If contact person, presupposed information and transmission request.If receiving the touch control operation to above-mentioned prompt message, mobile terminal can be to default Contact person sends presupposed information.After mobile terminal detects that portrait surface temperature is less than the 3rd threshold value, current location information is obtained, Prompt message is shown in interface of mobile terminal, if detecting the trigger action to sending request in presupposed information, to default It is that people sends presupposed information.For example, send current location information and distress signals to alarm number.

If mobile terminal gets user and does not receive touching for user to the touch control operation of return key or in preset duration Control operation, mobile terminal can the above-mentioned presupposed information of revocation token.

Image processing method in the real-time example of the application, when detecting that portrait temperature is relatively low, judge that portrait sign is abnormal, to Default contact person sends presupposed information.By image detection portrait surface temperature, human health status can be monitored, and send out in time Distress signals are sent, simplify user's operation, improve the convenience of user's operation.

Fig. 3 is the flow chart of image processing method in another embodiment.As shown in figure 3, a kind of image processing method, bag Include:

Step 302, portrait in image be present if detecting, infrared heat detection is carried out to portrait.

Portrait in image be present if detecting, infrared heat detection is carried out to portrait includes step (1), (2) and (3):

(1) multiple portraits be present if detecting in image, obtain the parameter value of multiple portraits successively.

(2) target person picture is chosen according to the parameter value of multiple portraits.

(3) infrared heat detection is carried out to target person picture.

Step 304, the heat radiation value of portrait is obtained.

Step 306, if heat radiation value is more than first threshold, face characteristic identification is carried out to portrait, obtains people in portrait Face region;Obtain the depth of view information of human face region;If detecting, depth of view information meets preset rules, and image is carried out at white balance Reason.

Step 308, if heat radiation value is more than first threshold, portrait surface temperature is obtained according to heat radiation value;If people Image surface temperature is more than Second Threshold, and white balance processing is carried out to image.

Step 310, if detecting, portrait surface temperature is less than the 3rd threshold value, and prompt message is shown in interface of mobile terminal; If receiving the touch control operation to prompt message, presupposed information is sent to default contact person.

Image processing method in the embodiment of the present application, detected in image when portrait be present, obtained by Face datection algorithm The heat radiation value of portrait in image is taken, obtains the temperature of portrait, depth of view information detection is carried out to human face region in portrait, judged After portrait is true man, white balance processing is carried out to image so that the color of image is improved pair closer to the color of real scene Portrait image carries out the accuracy rate of white balance, avoids face in flase drop altimetric image and carries out white balance processing to image, causes Image differs larger situation with realistic colour.

Fig. 4 be one embodiment in image processing apparatus structured flowchart, a kind of image processing apparatus, including:

Detection module 402, if portrait in image be present for detecting, infrared heat detection is carried out to portrait.

Acquisition module 404, for obtaining the heat radiation value of portrait.

Processing module 406, if being more than first threshold for heat radiation value, white balance processing is carried out to image.

In one embodiment, if detection module 402, which is additionally operable to detect in image, has multiple portraits, obtain successively more The parameter value of individual portrait.Target person picture is chosen according to the parameter value of multiple portraits.Infrared heat detection is carried out to target person picture.

Fig. 5 is the structured flowchart of image processing apparatus in another embodiment.As shown in figure 5, a kind of image processing apparatus, Including:Detection module 502, acquisition module 504, processing module 506, face recognition module 508 and depth of field acquisition module 510.On It is identical with corresponding functions of modules in Fig. 4 to state detection module 502, acquisition module 504, processing module 506.

Face recognition module 508, for carrying out face characteristic identification to portrait, obtain human face region in portrait.

Depth of field acquisition module 510, for obtaining the depth of view information of human face region.

If processing module 506 is additionally operable to detect that depth of view information meets preset rules, white balance processing is carried out to image.

Fig. 6 is the structured flowchart of image processing apparatus in another embodiment.As shown in fig. 6, a kind of image processing apparatus, Including:Detection module 602, acquisition module 604, processing module 606, temperature acquisition module 608.Above-mentioned detection module 602, obtain Module 604, processing module 606 are identical with corresponding functions of modules in Fig. 4.

Temperature acquisition module 608, for obtaining portrait surface temperature according to heat radiation value.

If processing module 606, which is additionally operable to portrait surface temperature, is more than Second Threshold, white balance processing is carried out to image.

Fig. 7 is the structured flowchart of image processing apparatus in one embodiment.As shown in fig. 7, a kind of image processing apparatus, bag Include:Detection module 702, acquisition module 704, processing module 706, display module 708 and sending module 710.Above-mentioned detection module 702nd, acquisition module 704, processing module 707 are identical with corresponding functions of modules in Fig. 4.

Display module 708, if for detecting that portrait surface temperature is less than the 3rd threshold value, carried in interface of mobile terminal displaying Show information.

Sending module 710, if for receiving the touch control operation to prompt message, default letter is sent to default contact person Breath.

The division of modules is only used for for example, in other embodiments, will can scheme in above-mentioned image processing apparatus As processing unit is divided into different modules as required, to complete all or part of function of above-mentioned image processing apparatus.

The embodiment of the present application additionally provides a kind of computer-readable recording medium.A kind of computer-readable recording medium, its On be stored with computer program, above computer program realizes the step of image processing method as described above when being executed by processor Suddenly.

The embodiment of the present invention also provides a kind of mobile terminal.Above-mentioned mobile terminal includes image processing circuit, at image Managing circuit can utilize hardware and/or component software to realize, it may include define ISP (Image Signal Processing, figure As signal transacting) the various processing units of pipeline.Fig. 8 is the schematic diagram of image processing circuit in one embodiment.Such as Fig. 8 institutes Show, for purposes of illustration only, only showing the various aspects of the image processing techniques related to the embodiment of the present invention.

As shown in figure 8, image processing circuit includes ISP processors 840 and control logic device 850.Imaging device 810 is caught View data handled first by ISP processors 840, ISP processors 840 view data is analyzed with catch can be used for it is true The image statistics of fixed and/or imaging device 810 one or more control parameters.Imaging device 810 may include there is one The camera of individual or multiple lens 812 and imaging sensor 814.Imaging sensor 814 may include colour filter array (such as Bayer filters), imaging sensor 814 can obtain the luminous intensity caught with each imaging pixel of imaging sensor 814 and wavelength Information, and the one group of raw image data that can be handled by ISP processors 840 is provided.Sensor 820 (such as gyroscope) can be based on passing The parameter (such as stabilization parameter) of the image procossing of collection is supplied to ISP processors 840 by the interface type of sensor 820.Sensor 820 Interface can utilize SMIA (Standard Mobile Imaging Architecture, Standard Mobile Imager framework) interface, The combination of other serial or parallel camera interfaces or above-mentioned interface.

In addition, raw image data can also be sent to sensor 820 by imaging sensor 814, sensor 820 can be based on passing The interface type of sensor 820 is supplied to ISP processors 840, or sensor 820 to deposit raw image data raw image data Store up in video memory 830.

ISP processors 840 handle raw image data pixel by pixel in various formats.For example, each image pixel can Bit depth with 8,10,12 or 14 bits, ISP processors 840 can be carried out at one or more images to raw image data Reason operation, statistical information of the collection on view data.Wherein, image processing operations can be by identical or different bit depth precision Carry out.

ISP processors 840 can also receive view data from video memory 830.For example, the interface of sensor 820 will be original View data is sent to video memory 830, and the raw image data in video memory 830 is available to ISP processors 840 It is for processing.Video memory 830 can be independent special in the part of storage arrangement, storage device or electronic equipment With memory, and it may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.

When receiving from the interface of imaging sensor 814 or from the interface of sensor 820 or from video memory 830 During raw image data, ISP processors 840 can carry out one or more image processing operations, such as time-domain filtering.Figure after processing As data can be transmitted to video memory 830, to carry out other processing before shown.ISP processors 840 are from image The reception processing data of memory 830, and the processing data is carried out in original domain and in RGB and YCbCr color spaces Image real time transfer.ISP processors 840 processing after view data may be output to display 870, for user viewing and/or Further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).In addition, ISP processors 840 output also can be transmitted to video memory 830, and display 870 can read view data from video memory 830. In one embodiment, video memory 830 can be configured as realizing one or more frame buffers.In addition, ISP processors 840 Output can be transmitted to encoder/decoder 860, so as to encoding/decoding image data.The view data of coding can be saved, And decompressed before being shown in the equipment of display 870.Encoder/decoder 860 can be real by CPU or GPU or coprocessor It is existing.

The statistics that ISP processors 840 determine, which can be transmitted, gives the unit of control logic device 850.For example, statistics can wrap Include the image sensings such as automatic exposure, AWB, automatic focusing, flicker detection, black level compensation, the shadow correction of lens 812 The statistical information of device 814.Control logic device 850 may include the processor and/or micro-control for performing one or more routines (such as firmware) Device processed, one or more routines according to the statistics of reception, can determine the control parameter and ISP processors of imaging device 810 840 control parameter.For example, the control parameter of imaging device 810 may include the control parameter of sensor 820 (such as gain, exposure Time of integration of control, stabilization parameter etc.), camera flash control parameter, the control parameter of lens 812 (such as focus on or zoom With focal length) or these parameters combination.ISP control parameters may include to be used for AWB and color adjustment (for example, in RGB During processing) gain level and color correction matrix, and the shadow correction parameter of lens 812.

Image processing method as described above can be realized with image processing techniques in Fig. 8.

One of ordinary skill in the art will appreciate that realize all or part of flow in above-described embodiment method, being can be with The hardware of correlation is instructed to complete by computer program, described program can be stored in a non-volatile computer and can be read In storage medium, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage is situated between Matter can be magnetic disc, CD, read-only memory (Read-Only Memory, ROM) etc..

Embodiment described above only expresses the several embodiments of the present invention, and its description is more specific and detailed, but simultaneously Therefore the limitation to the scope of the claims of the present invention can not be interpreted as.It should be pointed out that for one of ordinary skill in the art For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention Protect scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.

Claims (12)

  1. A kind of 1. image processing method, it is characterised in that including:
    Portrait in image be present if detecting, infrared heat detection is carried out to the portrait;
    Obtain the heat radiation value of the portrait;
    If the heat radiation value is more than first threshold, white balance processing is carried out to described image.
  2. 2. image processing method according to claim 1, it is characterised in that if portrait in image be present in described detect, Infrared heat detection is carried out to the portrait to be included:
    Multiple portraits be present if detecting in described image, obtain the parameter value of the multiple portrait successively;
    Target person picture is chosen according to the parameter value of the multiple portrait;
    Infrared heat detection is carried out to the target person picture.
  3. 3. image processing method according to claim 1 or 2, it is characterised in that described that white balance is carried out to described image Before processing, methods described also includes:
    Face characteristic identification is carried out to the portrait, obtains human face region in the portrait;
    Obtain the depth of view information of the human face region;
    If detecting, the depth of view information meets preset rules, and white balance processing is carried out to described image.
  4. 4. image processing method according to claim 1 or 2, it is characterised in that described that white balance is carried out to described image Before processing, methods described also includes:
    The portrait surface temperature is obtained according to the heat radiation value;
    If the portrait surface temperature is more than Second Threshold, white balance processing is carried out to described image.
  5. 5. image processing method according to claim 4, it is characterised in that methods described also includes:
    If detecting, the portrait surface temperature is less than the 3rd threshold value, and prompt message is shown in interface of mobile terminal;
    If receiving the touch control operation to the prompt message, presupposed information is sent to default contact person.
  6. A kind of 6. image processing apparatus, it is characterised in that including:
    Detection module, if portrait in image be present for detecting, infrared heat detection is carried out to the portrait;
    Acquisition module, for obtaining the heat radiation value of the portrait;
    Processing module, if being more than first threshold for the heat radiation value, white balance processing is carried out to described image.
  7. 7. image processing apparatus according to claim 6, it is characterised in that:
    If the detection module, which is additionally operable to detect in described image, has multiple portraits, the ginseng of the multiple portrait is obtained successively Numerical value;Target person picture is chosen according to the parameter value of the multiple portrait;Infrared heat detection is carried out to the target person picture.
  8. 8. the image processing apparatus according to claim 6 or 7, it is characterised in that described device also includes:
    Face recognition module, for carrying out face characteristic identification to the portrait, obtain human face region in the portrait;
    Depth of field acquisition module, for obtaining the depth of view information of the human face region;
    If the processing module is additionally operable to detect that the depth of view information meets preset rules, described image is carried out at white balance Reason.
  9. 9. the image processing apparatus according to claim 6 or 7, it is characterised in that described device also includes:
    Temperature acquisition module, for obtaining the portrait surface temperature according to the heat radiation value;
    If the processing module, which is additionally operable to the portrait surface temperature, is more than Second Threshold, described image is carried out at white balance Reason.
  10. 10. image processing apparatus according to claim 9, it is characterised in that described device also includes:
    Display module, if for detecting that the portrait surface temperature is less than the 3rd threshold value, show and prompt in interface of mobile terminal Information;
    Sending module, if for receiving the touch control operation to the prompt message, presupposed information is sent to default contact person.
  11. 11. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program The step of image processing method as any one of claim 1 to 5 is realized when being executed by processor.
  12. 12. a kind of mobile terminal, including memory and processor, computer-readable instruction is stored in the memory, it is described When instruction is by the computing device so that image procossing of the computing device as any one of claim 1 to 5 Method.
CN201710775165.XA 2017-08-31 2017-08-31 Image processing method, image processing device, computer-readable storage medium and mobile terminal CN107454335B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710775165.XA CN107454335B (en) 2017-08-31 2017-08-31 Image processing method, image processing device, computer-readable storage medium and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710775165.XA CN107454335B (en) 2017-08-31 2017-08-31 Image processing method, image processing device, computer-readable storage medium and mobile terminal

Publications (2)

Publication Number Publication Date
CN107454335A true CN107454335A (en) 2017-12-08
CN107454335B CN107454335B (en) 2020-03-27

Family

ID=60494829

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710775165.XA CN107454335B (en) 2017-08-31 2017-08-31 Image processing method, image processing device, computer-readable storage medium and mobile terminal

Country Status (1)

Country Link
CN (1) CN107454335B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108182667A (en) * 2017-12-29 2018-06-19 努比亚技术有限公司 A kind of image optimization method, terminal and computer readable storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622588A (en) * 2012-03-08 2012-08-01 无锡数字奥森科技有限公司 Dual-certification face anti-counterfeit method and device
CN103235942A (en) * 2013-05-14 2013-08-07 苏州福丰科技有限公司 Facial recognition method applied to entrance guard
US20140348399A1 (en) * 2013-05-22 2014-11-27 Asustek Computer Inc. Image processing system and method of improving human face recognition
CN105138981A (en) * 2015-08-20 2015-12-09 北京旷视科技有限公司 In-vivo detection system and method
CN105182983A (en) * 2015-10-22 2015-12-23 深圳创想未来机器人有限公司 Face real-time tracking method and face real-time tracking system based on mobile robot
CN105574518A (en) * 2016-01-25 2016-05-11 北京天诚盛业科技有限公司 Method and device for human face living detection
CN105654028A (en) * 2015-09-29 2016-06-08 厦门中控生物识别信息技术有限公司 True and false face identification method and apparatus thereof
CN106203320A (en) * 2016-07-06 2016-12-07 惠州Tcl移动通信有限公司 A kind of recognition of face optimization method based on mobile terminal and system
CN106851238A (en) * 2017-03-09 2017-06-13 广东欧珀移动通信有限公司 Method for controlling white balance, white balance control device and electronic installation

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622588A (en) * 2012-03-08 2012-08-01 无锡数字奥森科技有限公司 Dual-certification face anti-counterfeit method and device
CN103235942A (en) * 2013-05-14 2013-08-07 苏州福丰科技有限公司 Facial recognition method applied to entrance guard
US20140348399A1 (en) * 2013-05-22 2014-11-27 Asustek Computer Inc. Image processing system and method of improving human face recognition
CN105138981A (en) * 2015-08-20 2015-12-09 北京旷视科技有限公司 In-vivo detection system and method
CN105654028A (en) * 2015-09-29 2016-06-08 厦门中控生物识别信息技术有限公司 True and false face identification method and apparatus thereof
CN105182983A (en) * 2015-10-22 2015-12-23 深圳创想未来机器人有限公司 Face real-time tracking method and face real-time tracking system based on mobile robot
CN105574518A (en) * 2016-01-25 2016-05-11 北京天诚盛业科技有限公司 Method and device for human face living detection
CN106203320A (en) * 2016-07-06 2016-12-07 惠州Tcl移动通信有限公司 A kind of recognition of face optimization method based on mobile terminal and system
CN106851238A (en) * 2017-03-09 2017-06-13 广东欧珀移动通信有限公司 Method for controlling white balance, white balance control device and electronic installation

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108182667A (en) * 2017-12-29 2018-06-19 努比亚技术有限公司 A kind of image optimization method, terminal and computer readable storage medium

Also Published As

Publication number Publication date
CN107454335B (en) 2020-03-27

Similar Documents

Publication Publication Date Title
US10009540B2 (en) Image processing device, image capturing device, and image processing method for setting a combination parameter for combining a plurality of image data
CN103051833B (en) Picture pick-up device and manufacture method, image processing apparatus and image processing method
CN102378015B (en) Use the image capture of brightness and chromaticity transducer
US8767103B2 (en) Color filter, image processing apparatus, image processing method, image-capture apparatus, image-capture method, program and recording medium
EP3399289A1 (en) Camera assembly and mobile electronic device
US9866748B2 (en) System and method for controlling a camera based on processing an image captured by other camera
CN102892008B (en) Dual image capture processes
JP5971207B2 (en) Image adjustment apparatus, image adjustment method, and program
CN101325658B (en) Imaging device, imaging method and computer program
JP5251547B2 (en) Image photographing apparatus, image photographing method, and computer program
JP4902562B2 (en) Imaging apparatus, image processing apparatus, control method, and program
US20160227100A1 (en) Dual camera systems and methods for rapid 3a convergence and high dynamic range exposure metering
US20140192238A1 (en) System and Method for Imaging and Image Processing
US8761596B2 (en) Dichroic aperture for electronic imaging device
JP4431532B2 (en) Target image position detecting device and method, and program for controlling target image position detecting device
EP3507765A1 (en) Systems and methods for adjusting focus based on focus target information
JP6456156B2 (en) Normal line information generating apparatus, imaging apparatus, normal line information generating method, and normal line information generating program
TWI386056B (en) A composition determination means, a composition determination method, and a composition determination program
US6924841B2 (en) System and method for capturing color images that extends the dynamic range of an image sensor using first and second groups of pixels
CN105229411A (en) Sane three-dimensional depth system
US8456536B2 (en) Image processing apparatus, image processing method and program with sightline detection
CN106416226B (en) Image processing system, imaging device, image processing method and computer readable recording medium
WO2014185064A1 (en) Image processing method and system
CN105430359B (en) Imaging method, imaging sensor, imaging device and electronic device
CN104580878A (en) Automatic effect method for photography and electronic apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: OPPO Guangdong Mobile Communications Co., Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: Guangdong Opel Mobile Communications Co., Ltd.

GR01 Patent grant
GR01 Patent grant