CN109584180A

CN109584180A - Face image processing process, device, electronic equipment and computer storage medium

Info

Publication number: CN109584180A
Application number: CN201811457973.2A
Authority: CN
Inventors: 梁冰雁
Original assignee: Shenzhen Face Meng Technology Co Ltd
Current assignee: Shenzhen Face Meng Technology Co Ltd
Priority date: 2018-11-30
Filing date: 2018-11-30
Publication date: 2019-04-05

Abstract

Embodiment of the disclosure provides a kind of face image processing process, device, electronic equipment and computer storage medium, this method comprises: according to the lip dressing parameter modification information based on facial image to be processed for including in lip dressing adjustment instruction, it detects the lip characteristic point in facial image to be processed and interpolation processing is carried out to lip characteristic point and obtain interpolation characteristic point, it is then based on lip characteristic point and interpolation characteristic point determines lip-region, according to lip dressing parameter modification information, lip-region to be processed is performed corresponding processing, facial image to be processed after being adjusted.Scheme through this embodiment, when receiving lip dressing adjustment instruction, facial image to be processed can be handled according to lip dressing adjustment instruction, realize the function of user's lip dressing in key adjustment image, the lip dressing of facial image is edited manually without user, reduce the processing time, improves the usage experience of user.

Description

Face image processing process, device, electronic equipment and computer storage medium

Technical field

This disclosure relates to technical field of image processing, specifically, this disclosure relates to a kind of face image processing process, dress It sets, electronic equipment and computer storage medium.

Background technique

In U.S. face class tool, user can carry out dressing special effect processing to image, to promote the aesthetic feeling of image.But In existing U.S. face class tool, when dressing of the user to lip in image is dissatisfied to be wanted to be adjusted, user needs to figure The dressing of lip is manually adjusted as in, and required image just can be obtained.

For example, the color of adjustment lip, user needs to manually adjust the color of lip, after capable of being just adjusted Image.Generally for the unskilled user of image is manually adjusted, the dressing processing of image is carried out by way of manually adjusting, no But it is extremely difficult to the purpose of U.S. face, and U.S. face processing short time consumption is long, reduces the usage experience of user.

Summary of the invention

The purpose of the disclosure is intended at least can solve above-mentioned one of technological deficiency, promotes the usage experience of user.This public affairs Open the technical solution adopted is as follows::

In a first aspect, present disclose provides a kind of face image processing process, this method comprises:

Obtain facial image to be processed；

The lip dressing adjustment instruction to facial image to be processed is received, includes based on wait locate in lip dressing adjustment instruction Manage the lip dressing parameter modification information of facial image；

According to lip dressing parameter modification information, the lip characteristic point in facial image to be processed is detected, and to lip spy Sign clicks through row interpolation processing, obtains interpolation characteristic point；

According to lip characteristic point and interpolation characteristic point, the lip-region to be processed in facial image to be processed is determined；

According to lip dressing parameter modification information, lip-region to be processed is performed corresponding processing, after being adjusted Facial image to be processed；

Show facial image to be processed adjusted.

In embodiment of the disclosure, according to lip dressing parameter modification information, lip-region to be processed is carried out corresponding Processing, comprising:

The corresponding dressing material of lip dressing parameter modification information is superimposed on lip-region to be processed；Alternatively,

Determine color of object reference map corresponding with lip dressing parameter modification information；

According to color of object reference map, the target color values of each pixel of lip-region to be processed are determined；

The original color value of each pixel of lip-region to be processed is revised as target color values.

In embodiment of the disclosure, color of object reference map corresponding with lip dressing parameter modification information is determined, comprising:

According to the corresponding relationship of the parameter modification information and filter mode that are pre-configured, lip dressing parameter modification information is determined Corresponding filter mode；

Corresponding filter processing is carried out according to default color reference map of the filter mode determined to pre-configuration, obtains mesh Mark color references figure；

Alternatively,

It is determining to be modified with lip dressing parameter according to the corresponding relationship of the parameter modification information and color references figure that are pre-configured The corresponding color of object reference map of information.

In embodiment of the disclosure, according to lip characteristic point and interpolation characteristic point, determine in facial image to be processed to Handle lip-region, comprising:

According to lip characteristic point and interpolation characteristic point, lip profile is determined；

Generate the mask image of facial image to be processed corresponding with lip dressing parameter modification information, the sense of mask image Interest region region corresponding with lip profile matches；

According to facial image to be processed and mask image, image of interest, the area-of-interest in image of interest are generated For lip-region to be processed.

It further include the tune for lip dressing parameter modification information in embodiment of the disclosure, in lip dressing adjustment instruction Whole index, adjustment index is for identifying the corresponding transparency of lip dressing parameter modification information；

The corresponding dressing material of lip dressing parameter modification information is superimposed on lip-region to be processed, comprising:

According to adjustment index, and be pre-configured adjustment index and parameter modification information transparency corresponding relationship, really The transparency of the corresponding lip dressing parameter modification information of whole index of setting the tone；

According to the transparency of lip dressing parameter modification information, dressing material corresponding to lip dressing parameter modification information Transparency handled, the dressing material after being adjusted；

Dressing material adjusted is superimposed on lip-region to be processed；

According to color of object reference map, the target color values of each pixel of lip-region to be processed are determined, comprising:

According to the transparency of lip dressing parameter modification information, color of object corresponding to lip dressing parameter modification information The transparency of reference map is adjusted, the color of object reference map after being adjusted；

According to color of object reference map adjusted, the color of object of each pixel of lip-region to be processed is determined Value.

In embodiment of the disclosure, user is met to the lip dressing adjustment instruction of facial image to be processed, comprising:

It receives user and triggering command is adjusted to the lip dressing of facial image to be processed；

Triggering command is adjusted in response to lip dressing, display lip dressing adjusts interface, and lip dressing is adjusted in interface and shown It is shown with lip dressing parameter modification information option and facial image to be processed；

Interface is adjusted by lip dressing, receives lip dressing adjustment instruction.

In embodiment of the disclosure, facial image to be processed is the present image captured in real time, or from local image library The facial image of selection.

Second aspect, present disclose provides a kind of face image processing device, which includes:

Image collection module, for obtaining facial image to be processed；

Command reception module, for receiving the lip dressing adjustment instruction to facial image to be processed, lip dressing adjustment It include the lip dressing parameter modification information based on facial image to be processed in instruction；

Image processing module, for detecting the lip in facial image to be processed according to lip dressing parameter modification information Characteristic point, and interpolation processing is carried out to lip characteristic point, interpolation characteristic point is obtained, according to lip characteristic point and interpolation characteristic point, The lip-region to be processed in facial image to be processed is determined, and according to lip dressing parameter modification information, to lip to be processed Portion region performs corresponding processing, the facial image to be processed after being adjusted；

Image display, for showing facial image to be processed adjusted.

In embodiment of the disclosure, image processing module is according to lip dressing parameter modification information, to lip to be processed When region performs corresponding processing, it is specifically used for:

In embodiment of the disclosure, image processing module is according to lip dressing special efficacy, to lip to be processed

In embodiment of the disclosure, image processing module is determining target face corresponding with lip dressing parameter modification information When color reference map, it is specifically used for:

Alternatively,

In embodiment of the disclosure, image processing module determines to be processed according to lip characteristic point and interpolation characteristic point When lip-region to be processed in facial image, it is specifically used for:

The mask image of facial image to be processed corresponding with lip dressing parameter modification information is stated is generated, mask image Area-of-interest region corresponding with lip profile matches；

The corresponding dressing material of lip dressing parameter modification information is being superimposed to lip area to be processed by image processing module When on domain, it is specifically used for:

Dressing material adjusted is superimposed on lip-region to be processed；

Image processing module determines the mesh of each pixel of lip-region to be processed according to color of object reference map When marking color value, it is specifically used for:

In embodiment of the disclosure, command reception module refers to the lip dressing of facial image to be processed adjustment meeting user When enabling, it is specifically used for:

The third aspect, present disclose provides a kind of electronic equipment, which includes processor and memory；

Memory, for storing operational order；

Processor is executed as shown in any embodiment of the first aspect of the disclosure for being instructed by call operation Method.

Fourth aspect stores on computer readable storage medium present disclose provides a kind of computer readable storage medium There are computer program instructions, computer program instructions are used to that computer to be made to execute to realize any of the first aspect such as the disclosure Method shown in embodiment.

The technical solution that the embodiment of the present disclosure provides has the benefit that

Scheme in embodiment of the disclosure can be according to lip in the lip dressing adjustment instruction for receiving selection Lip dressing in dressing adjustment instruction corresponds to facial image to be processed and is handled, that is, realizes user in key adjustment image The function of lip dressing manually edits the lip dressing of facial image without user, greatly reduces lip adornment The time of the processing of appearance improves the usage experience of user.

Detailed description of the invention

In order to illustrate more clearly of technical solution in embodiment of the disclosure, the embodiment of the present disclosure will be described below Needed in attached drawing be briefly described.

Fig. 1 is a kind of flow diagram for image processing method that the embodiment of the present disclosure provides；

Fig. 2 a is a kind of schematic diagram of the characteristic point of needs in the embodiment of the present disclosure；

Fig. 2 b is the schematic diagram of another characteristic point needed in the embodiment of the present disclosure；

Fig. 3 a is a kind of schematic diagram at lip dressing adjustment triggering interface in the embodiment of the present disclosure；

Fig. 3 b is the schematic diagram that another lip dressing adjusts interface in the embodiment of the present disclosure；

Fig. 4 a is a kind of schematic diagram of type selection interface in the embodiment of the present disclosure；

Fig. 4 b is a kind of schematic diagram of lip dressing parameter modification information selection interface in the embodiment of the present disclosure；

Fig. 5 a is a kind of schematic diagram of facial image to be processed in the embodiment of the present disclosure；

Fig. 5 b is a kind of schematic diagram of mask image in the embodiment of the present disclosure；

Fig. 5 c is a kind of schematic diagram of image of interest in the embodiment of the present disclosure；

Fig. 6 is a kind of schematic diagram at adjustment index adjustment interface in the embodiment of the present disclosure；

Fig. 7 is a kind of structural schematic diagram of image processing apparatus in the embodiment of the present disclosure；

Fig. 8 is a kind of structural schematic diagram of the electronic equipment of image procossing in the embodiment of the present disclosure.

Specific embodiment

Embodiment of the disclosure is described below in detail, the example of the embodiment is shown in the accompanying drawings, wherein phase from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached drawing The embodiment of description is exemplary, and is only used for explaining the Sense of Technology of the disclosure, and cannot be construed to the limitation to the disclosure.

Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, "one" It may also comprise plural form with "the".It is to be further understood that wording " comprising " used in the specification of the disclosure is Refer to that there are this feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition it is one or more its His feature, integer, step, operation, element, component and/or their group.It should be understood that when we claim element be " connected " or When " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be intermediary elements.This Outside, " connection " or " coupling " used herein may include being wirelessly connected or wirelessly coupling.Wording "and/or" packet used herein Include one or more associated wholes for listing item or any cell and all combination.

How the technical solution of the disclosure and the technical solution of the disclosure are solved with specifically embodiment below above-mentioned Technical problem is described in detail.These specific embodiments can be combined with each other below, for the same or similar concept Or process may repeat no more in certain embodiments.Below in conjunction with attached drawing, embodiment of the disclosure is described.

Embodiment of the disclosure provides a kind of face image processing process, as shown in Figure 1, this method may include:

Step S110 obtains facial image to be processed.

Wherein, facial image to be processed can be the current video frame image in the user video for obtaining user in real time, It can be the facial image that user chooses from local image library.

Step S120 receives the lip dressing adjustment instruction to facial image to be processed, wraps in lip dressing adjustment instruction Include the lip dressing parameter modification information based on facial image to be processed.

Wherein, lip dressing parameter modification information indicates to carry out lip dressing spy to the lip-region in processing facial image The strategy for imitating processing, i.e., specifically need how to handle lip-region, that is, need to which parameter or which parameter It modifies, i.e., different lip dressing parameter modification informations can indicate different lip dressing special efficacys, according to different lips Portion's dressing parameter modification information, which carries out processing to facial image to be processed, can be obtained by the effect of different lip dressing special efficacys Figure.

In the embodiments of the present disclosure, lip dressing adjustment instruction indicates to send the choosing of lip portion dressing special efficacy by display interface Select the instruction of operation, wherein the lip for being added to facial image to be processed is wanted in the selection of lip dressing special efficacy selection operation, i.e. user The movement of portion's dressing special efficacy, the specific implementation form of the operation configure as needed, for example, the lip dressing special efficacy selection operation User be can be on the display interface of the application program of client to the point of the corresponding specified operating position of lip dressing special efficacy Hit movement.In the program, after detecting the lip dressing special efficacy selection operation, use can be learnt based on the operation of user Think lip dressing special efficacy to be added in family.

In practical applications, the lip dressing special efficacy selection behaviour for receiving user can be identified by the associated trigger of client Make, wherein the concrete form for triggering mark can configure according to actual needs, for example, can be specified on client end interface Trigger button or input frame can also be the phonetic order of user, specifically, for example can be on the display interface of client The virtual push button of lip dressing special efficacy corresponding to the various lipstick colors and/or various lipstick shapes of display, user click it Middle either button operation be user lip dressing special efficacy selection operation, as user click it is virtual corresponding to lip color at prime The movement of button is the lip dressing special efficacy selection operation of user, includes the selected lip dressing special efficacy of user in the operation That is lipstick Color effect, lipstick color are positive red, which illustrates that user wants the lipstick in facial image to be processed Color is to become positive red.

Step S130 detects the lip characteristic point in facial image to be processed according to lip dressing parameter modification information, and Interpolation processing is carried out to lip characteristic point, obtains interpolation characteristic point.

Wherein, the feature for the specific method of lip sign point in facial image and specifically needing to detect which position is detected Point, without limitation, for example, as shown in Figure 2 a, the lip sign point of detection may include left side corners of the mouth position to embodiment of the disclosure Characteristic point a, right side corners of the mouth position feature point b, upper lip top position characteristic point c, e and f, lower lip middle part lowermost position are special Levy point d.

In actual application, due to being usually discrete point between each lip characteristic point, and then in image procossing During, the display effect that may result in image is unsmooth.Therefore lip feature can be clicked through in the embodiments of the present disclosure Row interpolation processing, obtains interpolation characteristic point.Wherein, interpolation processing is carried out to lip characteristic point, obtains the specific of interpolation characteristic point Embodiment can refer to the prior art, and details are not described herein again for the embodiment of the present disclosure.For example, the lip detected such as Fig. 2 b is levied Point may include left side corners of the mouth position feature point a, right side corners of the mouth position feature point b, upper lip top position characteristic point c, e and f, Interpolation characteristic point k1, k2 that lowermost position characteristic point d and interpolation obtain in the middle part of lower lip.

In practical applications, identical interpolation algorithm can be configured to different lip dressing parameter modification informations, it can also To configure different interpolation algorithms, when lip dressing parameter modification information is that (lipstick color is special for lipstick color parameter modification information Effect) when, interpolation algorithm corresponding with lipstick color is algorithm A, when lip dressing parameter modification information is that lipstick form parameter is repaired When converting to breath (lipstick shape special efficacy), interpolation algorithm corresponding with lipstick form parameter modification information is algorithm B, certainly in reality Application in, the different corresponding interpolation algorithms of lip dressing parameter modification information can also configure identical interpolation algorithm, such as Lipstick color parameter modification information and the corresponding interpolation algorithm of lipstick form parameter modification information are algorithm A.

Step S140 determines the lip to be processed in facial image to be processed according to lip characteristic point and interpolation characteristic point Region.

Step S150 performs corresponding processing lip-region to be processed, obtains according to lip dressing parameter modification information Facial image to be processed adjusted.

Correspondingly, after obtaining lip characteristic point and interpolation characteristic point, it can be directly special according to lip characteristic point and interpolation Sign point determines the lip profile in facial image to be processed, can be using the lip profile as lip-region to be processed, then Lip-region to be processed can be performed corresponding processing according to lip dressing parameter modification information.

Step S160 shows facial image to be processed adjusted.

In embodiment of the disclosure, in step S120,

User is met to the lip dressing adjustment instruction of facial image to be processed, comprising:

Triggering command is adjusted in response to lip dressing, display lip dressing adjusts interface, shows in lip dressing adjustment Lip dressing parameter modification information option and facial image to be processed；

In the embodiments of the present disclosure, lip dressing adjustment triggering command can be expressed as sending lip adornment by display interface Hold the instruction of special efficacy trigger action, wherein lip dressing special efficacy trigger action indicates that user wants to add facial image to be processed Add lip dressing special efficacy, i.e. user is used to trigger the movement for starting to carry out the addition of lip dressing special efficacy, the concrete form of the operation It can according to need configuration, for example, it may be the trigger action of user specific operation position on the display interface of client, It can be the operation etc. for clicking specific virtual push button.In the program, after detecting lip dressing special efficacy trigger action Lip dressing adjustment interface is shown, allows the user to carry out lip dressing at the interface by the operation based on user Special efficacy selection operation.

In practical applications, user can be identified by the associated trigger of client triggers lip dressing special efficacy triggering behaviour Make, for example, specified trigger button or input frame on client display interface, can also be the phonetic order etc. of user.For example, In an optional way, virtually pressing for " the lipstick color " or " lip dressing " shown on the display interface of client can be Button, the operation that user clicks the button are the lip dressing special efficacy trigger action of user.

Wherein, lip dressing adjustment interface is for interaction between electronic equipment and user, can be with by interface user Send the dependent instruction of the lip dressing parameter modification information for facial image to be processed.

As an example, a kind of lip dressing adjustment triggering circle of client in a kind of electronic equipment is shown in Fig. 3 a Face, that is, user interface schematic diagram shows pending facial image (facial image shown in figure) in the interface, The virtual push button of " the lip dressing " that shows on interface is lip dressing special efficacy trigger button, and user clicks on the display interface The virtual push button of " the lip dressing " of display, as the lip dressing special efficacy trigger action of user, after receiving the trigger action, It can show that lip dressing adjusts interface.

As an example, a kind of schematic diagram at lip dressing adjustment interface is shown in Fig. 3 b, A, B shown in figure, C, D, E are respectively virtual push button corresponding to different lip dressing parameter modification informations, and user can be by clicking wherein one A virtual push button determines lip dressing parameter modification information, for example clicks virtual push button A, it is determined that the modification of lip dressing parameter Information is lip dressing parameter modification information corresponding to virtual push button A, after receiving the instruction, can be based on the instruction The lip dressing parameter modification information of middle determination, performs corresponding processing facial image to be processed.

In order to allow users to definitely know lip dressing parameter modification information corresponding to each virtual push button Effect, in practical application, effect picture corresponding to each lip dressing parameter modification information is can be directly used to show in virtual push button Show, for example, can be using the effect picture of various lip colors as the display format of virtual push button.

In practical applications, since the type of lip dressing parameter modification information is more, corresponding virtual push button quantity is more, by It is limited in the display screen of electronic equipment, possibly all virtual push buttons disposably can not be all shown, at this point, can then pass through setting The list or other modes of virtual push button allow users to check whole virtual push buttons, for example, user can be in virtual push button More lip dressing parameter modification information options are checked in corresponding display area by way of sliding virtual push button.

In embodiment of the disclosure, lip dressing adjustment interface includes type selection interface and lip dressing parameter modification letter Selection interface is ceased, lip dressing adjustment instruction includes type selection command and lip dressing parameter modification information selection instruction；

Interface is adjusted by lip dressing, receives lip dressing adjustment instruction, comprising:

By type selection interface, type selection command is received；

In response to type selection command, lip dressing parameter modification information selection interface corresponding to respective type is shown；

By lip dressing parameter modification information selection interface, lip dressing parameter modification information selection instruction is received.

It wherein, can be by lip dressing parameter modification information in order to realize the processing for carrying out different mode to lip dressing Classify, obtains lip dressing parameter modification information type, wherein the specific mode classification of lip dressing parameter modification information It can be configured according to actual demand.U.S. face demand based on the different mode to lip dressing, a lip dressing parameter It may include one or more lip dressing parameter modification informations in modification information type.

In practical applications, lip dressing parameter modification information type can be shown to by use by type selection interface Family receives the type selection command of user by the interface, to obtain the selected lip dressing parameter modification information of user Type, later, the lip dressing parameter modification information option under the lip dressing parameter modification information type that user can be selected It is presented to the user by lip dressing parameter modification information selection interface, allows users to the lip adornment by showing in the interface Hold parameter modification information option, selects lip dressing lip dressing.

As an example, a kind of schematic diagram of type selection interface is shown in Fig. 4 a, is shown in the type selection interface The different corresponding virtual push buttons of lip dressing parameter modification information type being shown with: " Class1 " and " type as illustrated in the drawing 2 ", user can select lip dressing parameter modification information type by click " Class1 " or " type 2 ", for example, clicking " type After 1 ", then selection interface corresponding to " Class1 " is shown, a kind of parameter modification information selection interface is shown in Fig. 4 b Schematic diagram corresponding lip dressing parameter modification information option is shown in " type " 1 in interface as shown in fig 4b A1, B1 and C1, user can determine lip dressing parameter modification information by selection A1, one or more of B1 and C1.

It is understood that in practical applications, type selection interface and parameter modification information selection interface can be same One user interface, or different user interfaces, the embodiment of the present disclosure is without limitation.

In embodiment of the disclosure, lip dressing parameter modification information type may include lip color parameter modification letter Breath is lipstick Color effect, lip dressing form parameter modification information, that is, lipstick shape special efficacy etc..Wherein, lipstick Color effect refers to Be in facial image lip addition color effects, lipstick shape special efficacy also refer in facial image using difference Shape adding mouth red color.In practical applications, the partitioning standards of lip dressing parameter modification information type can be according to need It sets, that is to say, that match which kind of type be divided to and can according to need for which specific lip dressing parameter modification information It sets, the embodiment of the present disclosure does not do specific restriction.

Wherein, in a kind of optinal plan, lip dressing parameter modification information type can be drawn according to lipstick color Divide, such as color type at prime and rhodo color type, may further include multiple lipstick shapes under the color under each type Lip adornment, too lip at prime, certain lip dressing parameter modification information are stung including positive red under shape, such as color type at prime Type can also be divided according to lipstick shape, such as sting lip adornment type and too lip type, can be further under each type Including multiple colors under lipstick shape, such as sting include under lip adornment type it is positive red sting lip adornment, rose stings lip adornment.

In practical applications, in order to guarantee to determine that lip-region to be processed is more accurate, and subsequent to be processed When lip-region performs corresponding processing, other regions in facial image to be processed are not impacted, therefore in the disclosure In embodiment, according to lip characteristic point and interpolation characteristic point, the lip-region to be processed in facial image to be processed is determined, wrap It includes:

Wherein it is possible to understand, the size of the mask image of facial image to be processed and facial image to be processed Identical, the area-of-interest in mask image corresponds to lip-region to be treated in image to be processed.

In practical applications, it after determining lip profile according to lip characteristic point and interpolation characteristic point, that is, can determine that The mask image of facial image to be processed, specifically, the mask image and facial image to be processed are equal in magnitude, area-of-interest Position in mask image is corresponding with position of the lip contour area in facial image to be processed, optionally, region of interest It position of the domain in mask image can be identical with position of the lip contour area in facial image to be processed, that is to say, that When two image overlappings are placed, area-of-interest and the overlapping of lip contour area, alternatively, area-of-interest is in mask image Position and position of the lip contour area in facial image to be processed it is at least partly identical, for example, two images are overlapped When placement, area-of-interest may include lip contour area, alternatively, lip contour area may include area-of-interest, sense The chamfered shape in interest region is generally similar to the shape of lip contour area.

It is understood that in practical applications, the color of area-of-interest can be white, i.e. RGB (Red, Green, Blue, red, green, blue) value is 255,255,255, the region in addition to area-of-interest can be black, i.e. rgb value It is 0,0,0.

Further, mask image is multiplied to obtain image of interest with facial image to be processed, wherein the sense generated is emerging Interesting image includes two regions, and a region is white, another region is in facial image to be processed in addition to lip profile region Other regions except domain.

In one example, (a-quadrant indicates to use in facial image to be processed facial image to be processed in figure as illustrated in fig. 5 a The mouth region at family, B area indicate other regions in facial image to be processed), according to lip characteristic point and interpolation characteristic point After determining lip profile, the mask image for the facial image to be processed determined according to lip dressing parameter modification information is (as schemed Shown in 5b), wherein area-of-interest (as shown in a-quadrant in Fig. 5 b) region corresponding with lip profile phase of mask image Then mask image is multiplied to obtain image of interest with facial image to be processed by matching, generate interested as shown in Figure 5 c Image, wherein area-of-interest in image of interest is white area (as shown in a-quadrant in Fig. 5 c), in image of interest Region except area-of-interest shows other regions (such as Fig. 5 c in facial image to be processed other than lip contour area Shown in middle B area).

Correspondingly, after determining lip-region to be processed, so that it may according to lip dressing parameter modification information, treat place Reason lip-region performs corresponding processing.

In the disclosed embodiment, according to lip dressing parameter modification information, lip-region to be processed is located accordingly Reason, comprising:

In one example, if the lip dressing parameter modification information that selects of user for lip color parameter modification information i.e. Lipstick Color effect, and determine lip-region to be processed (as shown in B area in Fig. 5 c), at this time by lipstick Color effect pair The folded A of the dressing material answered is superimposed to lip-region to be processed and the effect picture of adding mouth red color special efficacy can be obtained.

Wherein it is determined that the concrete mode of the different corresponding dressing materials of lip dressing parameter modification information, and by lip The corresponding dressing material of portion's dressing parameter modification information is superimposed to the specific stacked system in lip-region to be processed, can basis It needs to configure, embodiment of the disclosure is not specifically limited, and can such as be drawn in fixed figure layer in advance in practical applications The different corresponding dressing materials of lip dressing special efficacy, and can fold the methods of bottom using sheen, normal or positive and be overlapped, Details are not described herein again for embodiment of the disclosure.

In practical applications, color references figure, that is, color lookup table, color lookup table are once converted all colours, Become a new color after namely each original color is converted, for example, primitive color is red, progress Become yellow after conversion, then all in lip-region to be processed is that the pixel of red can all be automatically converted to the pixel of yellow Point.

Wherein, the original color value of pixel refers to the color value of pixel in the facial image to be processed before processing, as The target color values of vegetarian refreshments refer to for lip dressing parameter modification information, need by picture to be processed pixel it is original The modified color of color value.In the embodiment of the present disclosure, the corresponding color references figure of each lip dressing parameter modification information, After receiving determining lip dressing parameter modification information, that is, it can determine that corresponding to the lip dressing parameter modification information Color references figure, that is, color of object reference map is based on the color of object reference map, can search and determine lip-region to be processed In target color values corresponding to each priming color value.

In the disclosed embodiment, color of object reference map corresponding with lip dressing parameter modification information is determined, comprising:

Alternatively,

In actual application, determine that one kind of color of object reference map corresponding with lip dressing parameter modification information can It selects embodiment can be to be pre-configured the corresponding filter mode of each parameter modification information, and is pre-configured a color references figure (initial baseline figure) is used as default color reference map, that is, is pre-configured with the mapping relations of parameter modification information Yu filter mode, After the lip dressing parameter modification information for receiving user's selection, that is, it can determine that currently determining lip dressing parameter modification letter The corresponding filter mode of breath, after determining the corresponding filter mode of lip dressing parameter modification information, so that it may according to true The filter mode made carries out corresponding filter processing to default color reference map, and it is corresponding to obtain lip dressing parameter modification information Color of object reference map.Wherein, the concrete methods of realizing that filter processing is carried out to default color reference map, can refer to existing Technology, details are not described herein again for the embodiment of the present disclosure.

Another optional embodiment, can be pre-configured with the corresponding color references figure of each parameter modification information. That is, the mapping of the mapping relations of preconfiguration parameters modification information and color references figure, i.e. special efficacy and color references figure is closed System, after receiving the lip dressing parameter modification information of user's selection, so that it may parameter modification information based on pre-configuration with The corresponding relationship of color references figure is determined corresponding with lip dressing parameter modification information from the color references figure of pre-configuration Then color of object reference map can locate accordingly lip-region to be processed according to the color of object reference map determined Reason.

In one example, it has been pre-configured with positive red and has stung the corresponding target fiducials figure A of lip adornment special efficacy, positive red too lip spy Imitate corresponding target fiducials figure B, that rose stings the corresponding target fiducials figure C of lip adornment special efficacy, rose too lip special efficacy is corresponding Target fiducials figure D etc. at this time can be from being pre-configured with if the lip dressing special efficacy red that is positive of user's selection stings lip adornment special efficacy Target fiducials figure in determine to scheme A on the basis of corresponding target fiducials figure.

It in the embodiments of the present disclosure, further include the tune for being directed to lip dressing parameter modification information in lip dressing adjustment instruction Whole index, adjustment index is for identifying the corresponding transparency of lip dressing parameter modification information；

Dressing material adjusted is superimposed on lip-region to be processed；

Wherein, adjustment index can actually adjust the numerical value or numberical range of demand configuration according to, be also possible to other Can be used in identify lip dressing parameter modification information adjustment intensity (i.e. lip dressing parameter modification information is corresponding transparent Degree) index, in the embodiment of the present disclosure without limitation to the specific implementation of adjustment index.Different adjustment indexs can be right The transparency for answering lip dressing parameter modification information different, that is to say, that for same lip dressing parameter modification information, when with When family selects different adjustment indexs, it can be based on the adjustment index, different adjustment intensity are carried out to facial image to be processed Processing.

In an optinal plan, adjustment index can be presented to the user in the form of numberical range list, numberical range Different numerical value in list can represent different adjustment intensity, and user can be pressed by the sliding on the display interface of client Button adjusts the selection of index, a kind of client display interface as shown in FIG. 6, wherein image preview area can be used for realize Display facial image (can be facial image to be processed, the facial image being also possible in treatment process is also possible to mediate reason Facial image afterwards), it can be 0 to 100 that dressing, which adjusts the corresponding numberical range list of index, and user can be referred to by sliding adjustment Button is marked to select different adjustment indexs.

Since numerical value different in adjustment index can correspond to different adjustment intensity, in order to understand user, oneself is selected The corresponding adjustment intensity effect of adjustment index, preview function can also be provided, selected any of 0 to 100 in user When adjusting index, such as when 27, based on adjustment index 27, facial image to be processed is performed corresponding processing, by the index pair Facial image is shown in image preview area after the adjustment answered.

Wherein, the corresponding relationship for adjusting the transparency of index and parameter modification information can according to need configuration, configure When can according to need the granulate of setting corresponding relationship and can configure all parameters modifications for example, in an optional way The adjustment index of information and the corresponding relationship of transparency are all the same, that is to say, that the transparency of parameter modification information and user Selected adjustment index is related, unrelated with specific parameter modification information.

For example, in one example, if the special efficacy adjustment index that user selects be 15, according to the adjustment index being pre-configured with The corresponding relationship of parameter modification information transparency determines that the adjustment corresponding transparency of index 15 is 25, at this point, no matter the adjustment refers to Mark is the adjustment index of which kind of lip dressing parameter modification information, at this time the transparency of corresponding lip dressing parameter modification information It is 25.

In another alternative, due in practical applications, lip dressing parameter modification information usually all can there are many, The adjustment index and the corresponding relationship of the transparency of parameter modification information of different lip dressing parameter modification informations are also possible to Different.That is, different dressing parameter modifications can be respectively configured for different lip dressing parameter modification informations Information adjusts the corresponding relationship of the transparency of index and parameter modification information.At this time, it may be necessary to be first depending on the selected tool of user The lip dressing parameter modification information of body determines the saturating of adjustment index corresponding to the parameter modification information and parameter modification information The corresponding relationship of lightness, then according to the adjustment index and the corresponding relationship of user's selection, determine the selected lip adornment of user Hold transparency corresponding to parameter modification information.

For example, when lip dressing parameter modification information is lipstick Color effect, adjustment index and parameter modification information Transparency corresponding relationship is the corresponding relationship 2 in preconfigured correspondence set, when lip dressing parameter modification information is When lipstick shape special efficacy, it can be preconfigured corresponding for adjusting index to be with the corresponding relationship of the transparency of parameter modification information Corresponding relationship 3 in set of relationship.When the lip dressing parameter modification information that user selects is lipstick Color effect, first really Determining corresponding relationship is above-mentioned corresponding relationship 2, then according to the corresponding relationship 2, is determined corresponding to the selected adjustment index of user Transparency.

Correspondingly, after determining transparency corresponding to the selected adjustment index of user, if to lip area to be processed Domain performs corresponding processing, and is superimposed to lip to be processed using by the corresponding dressing material of lip dressing parameter modification information Mode on region is needed at this time according to determining transparency to the corresponding dressing material of lip dressing parameter modification information Transparency is handled, then dressing material adjusted is superimposed to lip area to be processed by the dressing material after being adjusted On domain.

It, will be wait locate using according to color of object reference map if performed corresponding processing to lip-region to be processed The original color value for managing each pixel of lip-region is revised as the mode of target color values, at this time can be according to determining Transparency is adjusted the transparency of the corresponding color of object reference map of lip dressing parameter modification information, after being adjusted Color of object reference map determine the mesh of each pixel of lip-region to be processed then according to color of object reference map Color value is marked, and the original color value of each pixel of lip-region to be processed is revised as target color values.

In actual application, in order to make facial image to be processed adjusted more true nature, in the disclosure Facial image to be processed adjusted can be rendered in implementation, obtain effect corresponding with lip dressing parameter modification information Figure.In the embodiment of the present disclosure without limitation to the specific implementation of rendering.

Wherein, a kind of optional rendering embodiment are as follows: it is corresponding with texture coordinate to preset each lip characteristic point After obtaining lip characteristic point interpolation characteristic point can be calculated according to the corresponding texture coordinate of lip characteristic point in relationship Texture coordinate.The representative points coordinate of lip-region to be processed is determined according to lip characteristic point and interpolation characteristic point, then base It is corresponding in preconfigured each lip characteristic point and the corresponding relationship and lip characteristic point and interpolation characteristic point of texture coordinate Texture coordinate, texture coordinate corresponding to representative points coordinate is determined, later by the corresponding texture of obtained texture coordinate It is attached in lip-region to be processed, obtains the effect picture with lip dressing parameter modification information.

Further, after the facial image to be processed after being adjusted, if the picture for receiving user saves instruction, this When facial image to be processed adjusted can be stored in by corresponding memory space according to pre-configured store path. For example, pre-configured store path can be the memory space of local picture library, it is also possible to cloud server, the disclosure is real Example is applied not limit this.

Based on the same principle with method shown in Fig. 1, a kind of face image processing is additionally provided in embodiment of the disclosure Device 20, as shown in fig. 7, the device 20 may include: image collection module 210, command reception module 220, image procossing mould Block 230 and image display 240, wherein

Image collection module 210, for obtaining facial image to be processed；

Command reception module 220, for receiving the lip dressing adjustment instruction to facial image to be processed, lip dressing tune It include the lip dressing parameter modification information based on facial image to be processed in whole instruction；

Image processing module 230, for detecting the lip in facial image to be processed according to lip dressing parameter modification information Portion's characteristic point, and interpolation processing is carried out to lip characteristic point, interpolation characteristic point is obtained, according to lip characteristic point and interpolation feature Point determines the lip-region to be processed in facial image to be processed, and according to lip dressing parameter modification information, to be processed Lip-region performs corresponding processing, the facial image to be processed after being adjusted；

Image display 240, for showing facial image to be processed adjusted.

Alternatively,

Dressing material adjusted is superimposed on lip-region to be processed；

Based on principle identical with the image processing method in embodiment of the disclosure, also provided in embodiment of the disclosure A kind of electronic equipment, the electronic equipment can include but is not limited to: processor and memory；Memory is calculated for storing Machine operational order；Processor, for by calling computer operation instruction to execute method shown in embodiment.

Based on principle identical with the image processing method in embodiment of the disclosure, also provided in embodiment of the disclosure A kind of computer readable storage medium is stored with computer program instructions, computer program on computer readable storage medium Instruction is for executing computer to realize method shown in above-described embodiment, and details are not described herein.

Below with reference to Fig. 8, it illustrates the structural representations for the electronic equipment 800 for being suitable for being used to realize the embodiment of the present disclosure Figure, which can be terminal device or server.Wherein, terminal device can include but is not limited to such as move Phone, laptop, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet computer), PMP (portable more matchmakers Body player), the mobile terminal of car-mounted terminal (such as vehicle mounted guidance terminal) etc. and number TV, desktop computer etc. Deng fixed terminal.Electronic equipment shown in Fig. 8 is only an example, function to the embodiment of the present disclosure and should not use model Shroud carrys out any restrictions.

As shown in figure 8, electronic equipment 800 may include processing unit (such as central processing unit, graphics processor etc.) 801, random access can be loaded into according to the program being stored in read-only memory (ROM) 802 or from storage device 808 Program in memory (RAM) 803 and execute various movements appropriate and processing.In RAM 803, it is also stored with electronic equipment Various programs and data needed for 800 operations.Processing unit 801, ROM 802 and RAM 803 pass through the phase each other of bus 804 Even.Input/output (I/O) interface 805 is also connected to bus 804.

In general, following device can connect to I/O interface 805: including such as touch screen, touch tablet, keyboard, mouse, taking the photograph As the input unit 806 of head, microphone, accelerometer, gyroscope etc.；Including such as liquid crystal display (LCD), loudspeaker, vibration The output device 807 of dynamic device etc.；Storage device 808 including such as tape, hard disk etc.；And communication device 809.Communication device 809, which can permit electronic equipment 800, is wirelessly or non-wirelessly communicated with other equipment to exchange data.Although Fig. 8 shows tool There is the electronic equipment 800 of various devices, it should be understood that being not required for implementing or having all devices shown.It can be with Alternatively implement or have more or fewer devices.

Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed from network by communication device 809, or from storage device 808 It is mounted, or is mounted from ROM 802.When the computer program is executed by processing unit 801, the embodiment of the present disclosure is executed Method in the above-mentioned function that limits.

It should be noted that the above-mentioned computer-readable medium of the disclosure can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be it is any include or storage journey The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this In open, computer-readable signal media may include in a base band or as the data-signal that carrier wave a part is propagated, In carry computer-readable program code.The data-signal of this propagation can take various forms, including but not limited to Electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable and deposit Any computer-readable medium other than storage media, the computer-readable signal media can send, propagate or transmit and be used for By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium Program code can transmit with any suitable medium, including but not limited to: electric wire, optical cable, RF (radio frequency) etc. are above-mentioned Any appropriate combination.

Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment；It is also possible to individualism, and not It is fitted into the electronic equipment.

Above-mentioned computer-readable medium carries one or more program, when said one or multiple programs are by the electricity When sub- equipment executes, so that the electronic equipment executes method shown in above-described embodiment.

The calculating of the operation for executing the disclosure can be write with one or more programming languages or combinations thereof Machine program code, above procedure design language include object oriented program language-such as Java, Smalltalk, C+ +, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code can Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package, Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part. In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN) Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service Provider is connected by internet).

Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.

Being described in unit involved in the embodiment of the present disclosure can be realized by way of software, can also be by hard The mode of part is realized.Wherein, the title of unit does not constitute the restriction to the unit itself under certain conditions, for example, the One acquiring unit is also described as " obtaining the unit of at least two internet protocol addresses ".

Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art Member is it should be appreciated that the open scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from design disclosed above, it is carried out by above-mentioned technical characteristic or its equivalent feature Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed in the disclosure Can technical characteristic replaced mutually and the technical solution that is formed.

Claims

1. a kind of face image processing process characterized by comprising

Obtain facial image to be processed；

The lip dressing adjustment instruction to the facial image to be processed is received, includes being based in the lip dressing adjustment instruction The lip dressing parameter modification information of the facial image to be processed；

According to the lip dressing parameter modification information, the lip characteristic point in the facial image to be processed is detected, and to institute It states lip characteristic point and carries out interpolation processing, obtain interpolation characteristic point；

According to the lip characteristic point and the interpolation characteristic point, the lip area to be processed in the facial image to be processed is determined Domain；

According to the lip dressing parameter modification information, the lip-region to be processed is performed corresponding processing, is adjusted The facial image to be processed afterwards；

Show the facial image to be processed adjusted.

2. right the method according to claim 1, wherein described according to the lip dressing parameter modification information The lip-region to be processed performs corresponding processing, comprising:

The corresponding dressing material of the lip dressing parameter modification information is superimposed on the lip-region to be processed；Or Person,

Determine color of object reference map corresponding with the lip dressing parameter modification information；

According to the color of object reference map, the target color values of each pixel of the lip-region to be processed are determined；

The original color value of each pixel of the lip-region to be processed is revised as the target color values.

3. according to the method described in claim 2, it is characterized in that, the determination and the lip dressing parameter modification information pair The color of object reference map answered, comprising:

According to the corresponding relationship of the parameter modification information and filter mode that are pre-configured, the lip dressing parameter modification information is determined Corresponding filter mode；

Corresponding filter processing is carried out according to default color reference map of the filter mode determined to pre-configuration, obtains the mesh Mark color references figure；

Alternatively,

It is determining to be modified with the lip dressing parameter according to the corresponding relationship of the parameter modification information and color references figure that are pre-configured The corresponding color of object reference map of information.

4. the method according to claim 1, wherein according to the lip characteristic point and the interpolation characteristic point, Determine the lip-region to be processed in the facial image to be processed, comprising:

According to the lip characteristic point and the interpolation characteristic point, lip profile is determined；

Generate the mask image of the facial image to be processed corresponding with the lip dressing parameter modification information, the exposure mask The area-of-interest of image region corresponding with the lip profile matches；

According to the facial image to be processed and the mask image, image of interest, the sense in the image of interest are generated Interest region is the lip-region to be processed.

5. according to claim 1 to any method in 4, which is characterized in that also wrapped in the lip dressing adjustment instruction The adjustment index for lip dressing parameter modification information is included, the adjustment index is for identifying the lip dressing parameter modification The corresponding transparency of information；

It is described that the corresponding dressing material of the lip dressing parameter modification information is superimposed on the lip-region to be processed, Include:

According to the adjustment index, and the corresponding relationship of the transparency of adjustment index and parameter modification information being pre-configured, really The fixed transparency for adjusting the corresponding lip dressing parameter modification information of index；

According to the transparency of the lip dressing parameter modification information, dressing corresponding to the lip dressing parameter modification information The transparency of material is handled, the dressing material after being adjusted；

The dressing material adjusted is superimposed on the lip-region to be processed；

It is described according to the color of object reference map, determine the color of object of each pixel of the lip-region to be processed Value, comprising:

According to the transparency of the lip dressing parameter modification information, target corresponding to the lip dressing parameter modification information The transparency of color references figure is adjusted, the color of object reference map after being adjusted；

According to the color of object reference map adjusted, the target of each pixel of the lip-region to be processed is determined Color value.

6. the method according to claim 1, wherein described meet user to the lip of the facial image to be processed Dressing adjustment instruction, comprising:

It receives the user and triggering command is adjusted to the lip dressing of the facial image to be processed；

Triggering command is adjusted in response to the lip dressing, display lip dressing adjusts interface, and the lip dressing adjusts interface In show lip dressing parameter modification information option and the facial image to be processed；

Interface is adjusted by the lip dressing, receives the lip dressing adjustment instruction.

7. method according to any one of claim 1 to 6, which is characterized in that the facial image to be processed is real-time The present image of capture or the facial image chosen from local image library.

8. a kind of face image processing device characterized by comprising

Image collection module, for obtaining facial image to be processed；

Command reception module, for receiving the lip dressing adjustment instruction to the facial image to be processed, the lip dressing It include the lip dressing parameter modification information based on the facial image to be processed in adjustment instruction；

Image processing module, for detecting in the facial image to be processed according to the lip dressing parameter modification information Lip characteristic point, and carry out interpolation processing to the lip characteristic point, obtains interpolation characteristic point, according to the lip characteristic point and The interpolation characteristic point determines the lip-region to be processed in the facial image to be processed, and according to the lip dressing Parameter modification information performs corresponding processing the lip-region to be processed, the face figure to be processed after being adjusted Picture；

Image display, for showing the facial image to be processed adjusted.

9. a kind of electronic equipment characterized by comprising

Processor and memory；

The memory, for storing computer operation instruction；

The processor, for executing any one of the claims 1 to 7 institute by calling the computer operation instruction The method stated.

10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium Program instruction, the computer program instructions are for executing the computer described in any one of the claims 1 to 7 Method.