CN107833177A - A kind of image processing method and mobile terminal - Google Patents

A kind of image processing method and mobile terminal Download PDF

Info

Publication number
CN107833177A
CN107833177A CN201711048808.7A CN201711048808A CN107833177A CN 107833177 A CN107833177 A CN 107833177A CN 201711048808 A CN201711048808 A CN 201711048808A CN 107833177 A CN107833177 A CN 107833177A
Authority
CN
China
Prior art keywords
face
ratio
characteristic point
width
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711048808.7A
Other languages
Chinese (zh)
Inventor
陈惬意
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201711048808.7A priority Critical patent/CN107833177A/en
Publication of CN107833177A publication Critical patent/CN107833177A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the invention discloses a kind of image processing method and mobile terminal, methods described includes:Face characteristic point data is extracted from facial image;According to the face characteristic point data, the target shape of face belonging to the facial image is determined;According to benchmark face ratio mapping relations corresponding to the target shape of face, the face ratio of the facial image is adjusted.The embodiment of the present invention can optimize the face ratio in facial image, improve the landscaping effect of facial image and the satisfaction of user.

Description

A kind of image processing method and mobile terminal
Technical field
The present embodiments relate to the communications field, more particularly to a kind of image processing method and mobile terminal.
Background technology
At present, increasing user is taken pictures by terminals such as mobile phone, tablet personal computers.User upon taking a picture, may think that Face in photo is not attractive in appearance enough, and needs to carry out photo facial image landscaping treatment, for example, adding for the face in photo Add the U.S. face special efficacy of eyes amplification, skin-whitening etc..
However, in current facial image landscaping treatment, only to some face addition such as the eyes in face, nose U.S. face special efficacy, or some face is zoomed in or out, landscaping effect is poor.
The content of the invention
The invention provides a kind of image processing method and mobile terminal, U.S. be present to solve existing image processing method Change the problem of effect is poor.
In order to solve the above-mentioned technical problem, the present invention is realized in:At a kind of image Reason method, applied to mobile terminal, the mobile terminal prestores a variety of shapes of face and multiple benchmark five corresponding with its difference Official's ratio mapping relations, methods described include:
Face characteristic point data is extracted from facial image;
According to the face characteristic point data, the target shape of face belonging to the facial image is determined;
According to benchmark face ratio mapping relations corresponding to the target shape of face, the face ratio of the facial image is entered Row adjustment.
In a first aspect, the embodiment of the present invention additionally provides a kind of mobile terminal, the mobile terminal prestores a variety of shapes of face And corresponding multiple benchmark face ratio mapping relations, the mobile terminal include respectively with it:
Human face characteristic point data extraction module, for extracting face characteristic point data from facial image;
Target shape of face determining module, for according to the face characteristic point data, determining the mesh belonging to the facial image Mark shape of face;
Face ratio adjusting module, for the benchmark face ratio mapping relations according to corresponding to the target shape of face, to institute The face ratio for stating facial image is adjusted.
Second aspect, the embodiment of the present invention additionally provide a kind of mobile terminal, including processor, memory and are stored in institute The computer program that can be run on memory and on the processor is stated, when the computer program is by the computing device The step of realizing described image processing method.
The third aspect, the embodiment of the present invention additionally provide a kind of computer-readable recording medium, described computer-readable to deposit Computer program is stored on storage media, the step of described image processing method is realized when the computer program is executed by processor Suddenly.
In embodiments of the present invention, by extracting face characteristic point data from facial image, counted according to face characteristic According to the target shape of face determined belonging to facial image, and benchmark face ratio mapping relations according to corresponding to target shape of face, people is adjusted Face ratio in face image, the face ratio in facial image can be optimized, improve the landscaping effect and use of facial image The satisfaction at family.
Brief description of the drawings
Fig. 1 is the flow chart for the image processing method that the embodiment of the present invention one provides;
Fig. 2A is one of flow chart of image processing method that the embodiment of the present invention two provides;
Fig. 2 B are the two of the flow chart for the image processing method that the embodiment of the present invention two provides;
Fig. 2 C are the three of the flow chart for the image processing method that the embodiment of the present invention two provides;
Fig. 3 is the schematic diagram of multiple facial contour feature points in the facial image of the embodiment of the present invention;
Fig. 4 be the embodiment of the present invention facial image in the schematic diagram of altitude feature point and width characteristics point;
Fig. 5 is a kind of structured flowchart for mobile terminal that the embodiment of the present invention three provides;
Fig. 6 is a kind of structured flowchart for mobile terminal that the embodiment of the present invention four provides;
Fig. 7 is a kind of hardware architecture diagram for the mobile terminal for realizing each embodiment of the present invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure Completely it is communicated to those skilled in the art.
Embodiment one
Fig. 1 is the flow chart for the image processing method that the embodiment of the present invention one provides, and this method is applied to mobile terminal, institute State that mobile terminal prestores a variety of shapes of face and the multiple standard face characteristic area sizes being respectively associated with it, this method are specific It may include steps of:
Step 110, face characteristic point data is extracted from facial image.
It should be noted that above-mentioned mobile terminal can include the terminals such as mobile phone, tablet personal computer.Image capture instruction can With including shooting instruction etc..Facial image can be the image for including face.User can be directed to some face, pass through movement Terminal submits image capture instruction, and mobile terminal when receiving image capture instruction, can call the camera of mobile terminal Shot, to gather facial image.
In the specific implementation, the face characteristic point data in facial image can be identified, and face characteristic point data is extracted, with Just the shape of face of face in facial image is determined according to face characteristic point data.
For example, can identify the forehead hairline line in face, brow ridge, nose, lower chin, left side hair line, right side hair line, Canthus on the right side of canthus, left eye right side canthus, right eye left side canthus and right eye on the left of left eye.By forehead hairline line, brow ridge, nose and Canthus, left eye right side canthus, right eye left side on the left of the horizontal direction tangent line of lower chin, with left side hair line, right side hair line, left eye The human face characteristic point such as canthus on the right side of canthus and right eye, as above-mentioned face characteristic point data.
Step 120, according to the face characteristic point data, the target shape of face belonging to the facial image is determined.
In the specific implementation, mobile terminal can be classified, really according to the face characteristic point data of extraction to facial image Shape of face belonging to the fixed facial image, as target shape of face.
It should be noted that face can have a variety of shapes of face in reality, for example, elongated face, round face, square face, pyriform face, Rhombus face, oval face, cardioid face etc..Mobile terminal can prestore above-mentioned a variety of shapes of face.In practical application, art technology Personnel can be according to other a variety of shapes of face that prestore be actually needed, and the embodiment of the present invention is not restricted to this.
Elongated face, round face, square face, pyriform face, rhombus face, oval face, cardioid face etc. a variety of shapes of face are directed to, it is different The face depth-width ratio of shape of face has different scopes respectively, can correspond to the scope of the different depth-width ratio as the shape of face Face depth-width ratio scope.When it is determined that the face depth-width ratio in some facial image belongs to some depth-width ratio scope, you can it is determined that Shape of face in the facial image.
It is determined that in the embodiment of target shape of face, because different shapes of face correspond to different face depth-width ratio scopes, Therefore, multiple facial contour feature points in facial image can be determined first in face characteristic point data.For example, determine Forehead hairline line, lower chin in facial image, left side hair line, right side hair line are face contour feature point, before then calculating The distance between volume hair line and lower chin, and, left side the distance between hair line and right side hair line are calculated, then calculates two The ratio of person's distance, i.e. calculate the face depth-width ratio in facial image.Search the face belonging to the face depth-width ratio being calculated Depth-width ratio scope, by shape of face corresponding to affiliated face depth-width ratio scope, as the target shape of face belonging to the facial image.
Step 130, the benchmark face ratio mapping relations according to corresponding to the target shape of face, to the five of the facial image Official's ratio is adjusted.
In the specific implementation, can be according to benchmark face ratio mapping relations corresponding to target shape of face, in facial image The size of each face characteristic area is adjusted, so as to be adjusted to the face ratio of facial image to meet benchmark face ratio The face ratio of mapping relations.
It should be noted that user wishes that the face in facial image has aesthetic feeling.Face ratio meets base in face During quasi- ratio, face can just meet human body aesthetic, create an aesthetic feeling.However, for different shapes of face, meet the face of human body aesthetic Face ratio also can be accordingly different, therefore its benchmark face ratio is also corresponding different.Therefore, facial image can be directed to not Same shape of face, adjustment is optimized according to different benchmark face ratio mapping relations to facial image so that face, which has, to be met The face ratio of human body aesthetic.
In embodiments of the present invention, by extracting face characteristic point data from facial image, counted according to face characteristic According to the target shape of face determined belonging to facial image, and benchmark face ratio mapping relations according to corresponding to target shape of face, people is adjusted Face ratio in face image, the face ratio in facial image can be optimized, improve the landscaping effect and use of facial image The satisfaction at family.
Embodiment two
Fig. 2A is one of flow chart of image processing method that the embodiment of the present invention two provides, and this method is applied to mobile whole End, the mobile terminal prestore a variety of shapes of face and the multiple standard face characteristic area sizes being respectively associated with it, the party Method specifically may include steps of:
Step 210, face characteristic point data is extracted from facial image.
Step 220, according to the face characteristic point data, the target shape of face belonging to the facial image is determined.
On the basis of Fig. 2A, Fig. 2 B are the two of the flow chart for the image processing method that the embodiment of the present invention two provides.Can Selection of land, the mobile terminal include default multiple face depth-width ratio scopes, the multiple face depth-width ratio scope with it is described more Kind of shape of face has a corresponding relation respectively, and the human face characteristic point data include multiple facial contour feature points, the step 220, It can include:
Step 221, using the multiple facial contour feature point, face depth-width ratio is calculated.
In the specific implementation, forehead hairline line, lower chin in facial image can be extracted from face characteristic point data, it is left Side hair line, right side hair line, as above-mentioned facial contour feature point.
Step 222, when the face depth-width ratio is within the scope of target face depth-width ratio, extraction is high with the target face Width is than shape of face corresponding to scope, as the target shape of face.
It should be noted that can be directed to a large amount of facial images carries out machine learning, the face in facial image is high Width compares facial image and carries out shape of face classification, so as to obtain the face depth-width ratio scope corresponding to various shapes of face.In the specific implementation, For the facial image currently collected, after its face depth-width ratio is calculated, the mesh belonging to the face depth-width ratio is searched Face depth-width ratio scope is marked, by shape of face corresponding to target face depth-width ratio scope, as target shape of face.
Alternatively, it is left to include face top characteristic point, face bottom characteristic point, face for the multiple facial contour feature point Characteristic point and face right-hand member characteristic point are held, the step 221, can be specifically included:
The distance value of face top characteristic point and face bottom characteristic point is calculated, as facial contour height Value;
The distance value of the face left end characteristic point and the face right-hand member characteristic point is calculated, as facial contour width Value;
The ratio of the facial contour height value and the facial contour width value is calculated, obtains the face depth-width ratio.
For example, face top characteristic point and face bottom characteristic point can be respectively forehead hairline line and lower chin, before calculating The distance between volume hair line and lower chin, as facial contour height value;Face left end characteristic point and face right-hand member characteristic point can To be respectively left side hair line and right side hair line, left side the distance between hair line and right side hair line are calculated, as face Profile width value.Then, the ratio of facial contour height value and facial contour width value is calculated, obtains face depth-width ratio.
Fig. 3 is the schematic diagram of multiple facial contour feature points in the facial image of the embodiment of the present invention.Can from Fig. 3 See, the forehead hairline line of face and lower chin can be identified, respectively as facial contour feature point A and facial contour feature point A `.The left side hair line and right side hair line of face can be identified, it is special respectively as facial contour feature point B and facial contour Levy point B`.A to A` distance AA` is calculated, calculates B to B` distance BB`.Calculate face depth-width ratio β=AA`/BB`, it is assumed that β exists Within the face depth-width ratio scope [a, b] of long face shape of face, i.e. β ∈ [a, b], then it can determine the target shape of face belonging to facial image For long face shape of face.
Step 230, the target human face ratio optimization grade that user submits is received;Every kind of shape of face has multiple human face ratios excellent Change grade, the multiple human face ratio optimization grade corresponds to multiple candidate's face ratio mapping relations respectively.
Step 240, by the target human face ratio optimize grade corresponding to candidate's face ratio mapping relations, as with institute State benchmark face ratio mapping relations corresponding to target shape of face.
Selected in the specific implementation, multiple human face ratio optimization grades can be provided for user, user selectes some target person After face ratio optimization grade, candidate's face ratio mapping relations corresponding to target human face ratio optimization grade can be searched, as The benchmark face ratio mapping relations associated with the target shape of face.
It should be noted that, although five, three front yard is more satisfactory face, but may be with script in facial image Face differs greatly, and when user needs to obtain facial image less with script face difference, it is relatively low degree can be carried out Human face ratio optimization, when user needs to obtain the facial image of face standard of comparison, the higher face of degree can be carried out Ratio optimization, i.e., according to the progress human face ratio optimization of five, three front yard.By optimizing grade according to different human face ratios, using not Same benchmark face ratio mapping relations are adjusted to human face five-sense-organ ratio, are improved user and are beautified the flexible of facial image Property.
Step 250, the benchmark face ratio mapping relations according to corresponding to the target shape of face, to the five of the facial image Official's ratio is adjusted.
Alternatively, the human face characteristic point data include multiple altitude feature points in the facial image and multiple width Characteristic point, before the step 250, methods described can also include:
Determine between the horizontal tangent of the multiple altitude feature point and the vertical tangent lines of the multiple width characteristics point Multiple intersection points.
The region that will be formed between the multiple intersection point, as each face characteristic area.
For example, can in face characteristic point data, determine forehead hairline line in facial image, brow ridge, nose, under Chin, as multiple altitude feature points, determine left side hair line, right side hair line, left eye left side canthus, the left eye in facial image Canthus and right eye right side canthus on the left of right side canthus, right eye, as multiple width characteristics points.By forehead hairline line, brow ridge, nose With canthus, left eye on the left of the tangent line of the horizontal direction of the height characteristic point such as lower chin, with left side hair line, right side hair line, left eye The tangent line of the vertical direction of canthus and right eye right side canthus equal in width characteristic point intersects on the left of right side canthus, right eye, obtains multiple Intersection point.The region formed between the plurality of intersection point, as above-mentioned multiple human face five-sense-organ characteristic areas, each face feature In region, the human face five-sense-organ feature of eyes, eyebrow, nose, face etc. can be included respectively.
Fig. 4 be the embodiment of the present invention facial image in the schematic diagram of altitude feature point and width characteristics point.Can from Fig. 4 See, forehead hairline line, brow ridge, nose, the lower chin of face, as the altitude feature point in facial image, the left side hairline of face Canthus on the right side of line, right side hair line, left eye left side canthus, left eye right side canthus, right eye left side canthus and right eye, as face figure Width characteristics point as in.The horizontal tangent of altitude feature point intersects with the vertical tangent lines of width characteristics point, obtains multiple intersection points, Respectively using multiple intersection points as region end points, multiple human face five-sense-organ characteristic areas are obtained.
On the basis of Fig. 2A, Fig. 2 C are the three of the flow chart for the image processing method that the embodiment of the present invention two provides.Can Selection of land, the benchmark face ratio mapping relations include benchmark face characteristic area height and benchmark face characteristic area width it Between proportionate relationship, the step 250, can include:
Step 251, by the height of each face characteristic area of the facial image, it is increased or decreased to and the target Benchmark face characteristic area height corresponding to shape of face;
Step 252, by the width of each face characteristic area of the facial image, it is increased or decreased to and the target Benchmark face characteristic area width corresponding to shape of face.
For example, in the facial image shown in Fig. 4, the distance between forehead hairline line and brow ridge are a1, brow ridge and nose The distance between be a2, the distance between nose and lower chin are a3, a1、a2And a3The height of respectively each face characteristic area. The distance between canthus is b on the left of left side hair line and left eye1, the distance between canthus and left eye right side canthus are on the left of left eye b2, the distance between left eye right side canthus and right eye left side canthus are b3, on the left of right eye on the right side of canthus and right eye between canthus away from From for b4, right eye right side the distance between canthus and right side hair line are b5, b1、b2、b3、b4And b5Respectively each face feature The width in region.Assuming that target shape of face is long face shape of face, the benchmark face characteristic area height and benchmark face of long face shape of face are special Sign peak width is respectively M and N, can be by a1、a2And a3M is increased or decreased to respectively, can be by b1、b2、b3、b4And b5Respectively It is increased or decreased to N, i.e. each face characteristic area is adjusted to the face characteristic area that height and width are respectively M and N.
It should be added that, on the one hand, preferable face should comply with five, three front yard.So-called three front yard, is face The distance between the distance between the distance between middle forehead hairline line and brow ridge, brow ridge and nose, nose and lower chin, the three Between distance tend to be impartial.So-called five, be the distance between canthus, canthus on the left of left eye on the left of left side hair line and left eye With the distance between canthus on the right side of left eye, the distance between canthus and canthus on the left of right eye on the right side of left eye, on the left of right eye canthus with The distance between canthus on the right side of right eye, right eye right side the distance between canthus and right side hair line, the distance between this becomes In equalization.Meet five, three front yard ratio in face, the face then belongs to standard faces ideal in human body aesthetic.The opposing party Face, in order to obtain ideal facial image, face is in addition to meeting five, three front yard, the size of each face in face Certain baseline scale is should comply with, and the baseline scale of face is also different in different shapes of face.Therefore, face figure can be directed to The different shapes of face of picture optimize to the face ratio of facial image.
In embodiments of the present invention, by identifying the target shape of face belonging to facial image, and according to corresponding to target shape of face Benchmark face ratio mapping relations, adjust the size of each face characteristic area in facial image so that facial image meets three The human face ratio that front yard is five, while cause the size of each face in facial image, meet the mark of each face in specific shape of face Object staff cun.So as to obtain the target facial image for meeting user's request.
Because the size of the face characteristic area in facial image can be adjusted, rather than face characteristic area size not It can be adjusted, if facial image is oversized or too small, by the size adjusting of face characteristic area to benchmark face feature The height or width of region height or width rather than face characteristic area are remained stationary, then can cause non-face characteristic area The size difference of size and face characteristic area is excessive, causes face distortion.Therefore, by the way that facial image is adjusted to standard drawing After size as that within size range, can avoid adjusting face characteristic area the problem of face distortion.
Therefore, in actual applications, mobile terminal, for facial image, can be judged with preset standard picture size scope Whether the size of facial image meets standard picture size range;If the size of facial image does not meet standard picture size model Enclose, then adjust the size of facial image, obtain the facial image for meeting standard picture size range.
For example, the height of facial image is 1000 pixels, width is 600 pixels, in default standard picture size range, Altitude range is [600,800] pixel, and width range is [400,600] pixel, and the size of facial image does not simultaneously meet standard drawing As size range, compression facial image can be adjusted, obtains the facial image of a pixel of 800 pixel * 600, so as to meet mark Quasi- picture size scope.
Step 260, by the facial image after the height and width adjustment of each face characteristic area, as target face figure Picture.
Step 270, face U.S. face special efficacy is added on the target facial image;Face U.S. face special efficacy includes face Whitening special efficacy, face mill skin special efficacy, eyes amplification special efficacy, thin face special efficacy and/or contracting nose special efficacy.
In target facial image is obtained, user can submit different types of face U.S. face special efficacy according to being actually needed Addition request, to add corresponding face U.S. face special efficacy for facial image.So that the face in facial image more has U.S. Sense, has further obtained the facial image for meeting user's request.
Embodiment three
Fig. 5 is a kind of structured flowchart for mobile terminal that the embodiment of the present invention three provides, and the mobile terminal 300 prestores A variety of shapes of face and multiple benchmark face ratio mapping relations corresponding with its difference, the mobile terminal 300 can be wrapped specifically Include following module:
Human face characteristic point data extraction module 310, for extracting face characteristic point data from facial image.
Target shape of face determining module 320, for according to the face characteristic point data, determining belonging to the facial image Target shape of face.
Face ratio adjusting module 330, it is right for the benchmark face ratio mapping relations according to corresponding to the target shape of face The face ratio of the facial image is adjusted.
Example IV
Fig. 6 is a kind of structured flowchart for mobile terminal that the embodiment of the present invention four provides, and the mobile terminal 400 prestores A variety of shapes of face and multiple benchmark face ratio mapping relations corresponding with its difference, the mobile terminal 400 can be wrapped specifically Include following module:
Human face characteristic point data extraction module 410, for extracting face characteristic point data from facial image.
Target shape of face determining module 420, for according to the face characteristic point data, determining belonging to the facial image Target shape of face.
Optimize grade receiving module 430, the target human face ratio for receiving user's submission optimizes grade;Every kind of shape of face tool There are multiple human face ratio optimization grades, the multiple human face ratio optimization grade corresponds to multiple candidate's face ratio mappings and closed respectively System.
Benchmark face ratio mapping relations determining module 440, for the target human face ratio to be optimized corresponding to grade Candidate's face ratio mapping relations, as benchmark face ratio mapping relations corresponding with the target shape of face.
Face ratio adjusting module 450, it is right for the benchmark face ratio mapping relations according to corresponding to the target shape of face The face ratio of the facial image is adjusted.
Target facial image generation module 460, for by the people after the height and width adjustment of each face characteristic area Face image, as target facial image.
U.S. face special efficacy add module 470, for adding face U.S. face special efficacy on the target facial image;The face U.S. face special efficacy includes face whitening special efficacy, face mill skin special efficacy, eyes amplification special efficacy, thin face special efficacy and/or contracting nose special efficacy.
Alternatively, the mobile terminal includes default multiple face depth-width ratio scopes, the multiple face depth-width ratio model Enclose has corresponding relation respectively with a variety of shapes of face, the target shape of face determining module 420, can include:
Face depth-width ratio calculating sub module 421, for using the multiple facial contour feature point, it is high wide to calculate face Than;
Target shape of face extracting sub-module 422, for when the face depth-width ratio is within the scope of target face depth-width ratio, carrying Shape of face corresponding with the target face depth-width ratio scope is taken, as the target shape of face.
Alternatively, it is left to include face top characteristic point, face bottom characteristic point, face for the multiple facial contour feature point Characteristic point and face right-hand member characteristic point are held, the face depth-width ratio calculating sub module 421, can be specifically included:
Facial contour height value computing unit, for calculating face top characteristic point and face bottom characteristic point Distance value, as facial contour height value;
Facial contour width value computing unit, for calculating the face left end characteristic point and the face right-hand member characteristic point Distance value, as facial contour width value;
Face depth-width ratio computing unit, for calculating the ratio of the facial contour height value and the facial contour width value Value, obtains the face depth-width ratio.
Alternatively, the human face characteristic point data include multiple altitude feature points in the facial image and multiple width Characteristic point, the mobile terminal 400 can also include:
Intersection point determining module, for determining the horizontal tangent and the multiple width characteristics point of the multiple altitude feature point Vertical tangent lines between multiple intersection points;
Face characteristic area determining module, for the region that will be formed between the multiple intersection point, as the face Each face characteristic area of image.
Alternatively, the benchmark face ratio mapping relations include benchmark face characteristic area height and benchmark face feature Proportionate relationship between peak width, the face ratio adjusting module 450, can include:
Face characteristic area highly adjusts submodule 451, for by each face characteristic area of the facial image Highly, it is increased or decreased to benchmark face characteristic area height corresponding with the target shape of face;
Face characteristic area width adjustment submodule 452, for by each face characteristic area of the facial image Width, it is increased or decreased to benchmark face characteristic area width corresponding with the target shape of face.
The mobile terminal that the embodiment of the present invention three and the embodiment of the present invention four provide, can realize Fig. 1, Fig. 2A, Fig. 2 B and Each process that mobile terminal is realized in Fig. 2 C embodiment of the method, to avoid repeating, is repeated no more here.
Fig. 7 is a kind of hardware architecture diagram for the mobile terminal for realizing each embodiment of the present invention, the mobile terminal 500 Including but not limited to:It is radio frequency unit 501, mixed-media network modules mixed-media 502, audio output unit 503, input block 504, sensor 505, aobvious Show the parts such as unit 506, user input unit 507, interface unit 508, memory 509, processor 510 and power supply 511. It will be understood by those skilled in the art that the mobile terminal structure shown in Fig. 7 does not form the restriction to mobile terminal, it is mobile whole End can be included than illustrating more or less parts, either combine some parts or different parts arrangement.In the present invention In embodiment, mobile terminal includes but is not limited to mobile phone, tablet personal computer, notebook computer, palm PC, car-mounted terminal, can worn Wear equipment and pedometer etc..
Wherein, processor 510, for extracting face characteristic point data from facial image;According to the human face characteristic point Data, determine the target shape of face belonging to the facial image;Closed according to benchmark face ratio mapping corresponding to the target shape of face System, is adjusted to the face ratio of the facial image.
In embodiments of the present invention, by extracting face characteristic point data from facial image, counted according to face characteristic According to the target shape of face determined belonging to facial image, and benchmark face ratio mapping relations according to corresponding to target shape of face, people is adjusted Face ratio in face image so that the face ratio in facial image, meet the face ratio created an aesthetic feeling in specific shape of face. So as to obtain the facial image for meeting user's request.
It should be understood that in the embodiment of the present invention, radio frequency unit 501 can be used for receiving and sending messages or communication process in, signal Reception and transmission, specifically, by from base station downlink data receive after, handled to processor 510;In addition, will be up Data are sent to base station.Generally, radio frequency unit 501 includes but is not limited to antenna, at least one amplifier, transceiver, coupling Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 501 can also by wireless communication system and network and other set Standby communication.
Mobile terminal has provided the user wireless broadband internet by mixed-media network modules mixed-media 502 and accessed, and such as helps user to receive Send e-mails, browse webpage and access streaming video etc..
Audio output unit 503 can be receiving by radio frequency unit 501 or mixed-media network modules mixed-media 502 or in memory 509 It is sound that the voice data of storage, which is converted into audio signal and exported,.Moreover, audio output unit 503 can also be provided and moved The audio output for the specific function correlation that dynamic terminal 500 performs is (for example, call signal receives sound, message sink sound etc. Deng).Audio output unit 503 includes loudspeaker, buzzer and receiver etc..
Input block 504 is used to receive audio or video signal.Input block 504 can include graphics processor (Graphics Processing Unit, GPU) 5041 and microphone 5042, graphics processor 5041 is in video acquisition mode Or the static images or the view data of video obtained in image capture mode by image capture apparatus (such as camera) are carried out Reason.Picture frame after processing may be displayed on display unit 506.Picture frame after the processing of graphics processor 5041 can be deposited Storage is transmitted in memory 509 (or other storage mediums) or via radio frequency unit 501 or mixed-media network modules mixed-media 502.Mike Wind 5042 can receive sound, and can be voice data by such acoustic processing.Voice data after processing can be The form output of mobile communication base station can be sent to via radio frequency unit 501 by being converted in the case of telephone calling model.
Mobile terminal 500 also includes at least one sensor 505, such as optical sensor, motion sensor and other biographies Sensor.Specifically, optical sensor includes ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 5061, and proximity transducer can close when mobile terminal 500 is moved in one's ear Display panel 5061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general For three axles) size of acceleration, size and the direction of gravity are can detect that when static, available for identification mobile terminal posture (ratio Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap);Pass Sensor 505 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet Meter, thermometer, infrared ray sensor etc. are spent, will not be repeated here.
Display unit 506 is used for the information for showing the information inputted by user or being supplied to user.Display unit 506 can wrap Display panel 5061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used Forms such as (Organic Light-Emitting Diode, OLED) configures display panel 5061.
User input unit 507 can be used for the numeral or character information for receiving input, and produce the use with mobile terminal The key signals input that family is set and function control is relevant.Specifically, user input unit 507 include contact panel 5071 and Other input equipments 5072.Contact panel 5071, also referred to as touch-screen, collect touch operation of the user on or near it (for example user uses any suitable objects or annex such as finger, stylus on contact panel 5071 or in contact panel 5071 Neighbouring operation).Contact panel 5071 may include both touch detecting apparatus and touch controller.Wherein, touch detection Device detects the touch orientation of user, and detects the signal that touch operation is brought, and transmits a signal to touch controller;Touch control Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 510, receiving area Manage the order that device 510 is sent and performed.It is furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc. Type realizes contact panel 5071.Except contact panel 5071, user input unit 507 can also include other input equipments 5072.Specifically, other input equipments 5072 can include but is not limited to physical keyboard, function key (such as volume control button, Switch key etc.), trace ball, mouse, action bars, will not be repeated here.
Further, contact panel 5071 can be covered on display panel 5061, when contact panel 5071 is detected at it On or near touch operation after, send processor 510 to determine the type of touch event, be followed by subsequent processing device 510 according to touch The type for touching event provides corresponding visual output on display panel 5061.Although in the figure 7, contact panel 5071 and display Panel 5061 is the part independent as two to realize the input of mobile terminal and output function, but in some embodiments In, can be integrated by contact panel 5071 and display panel 5061 and realize input and the output function of mobile terminal, it is specific this Place does not limit.
Interface unit 508 is the interface that external device (ED) is connected with mobile terminal 500.For example, external device (ED) can include Line or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, storage card end Mouth, port, audio input/output (I/O) port, video i/o port, earphone end for connecting the device with identification module Mouthful etc..Interface unit 508 can be used for receive the input (for example, data message, electric power etc.) from external device (ED) and One or more elements that the input received is transferred in mobile terminal 500 can be used in the He of mobile terminal 500 Data are transmitted between external device (ED).
Memory 509 can be used for storage software program and various data.Memory 509 can mainly include storing program area And storage data field, wherein, storing program area can storage program area, application program (such as the sound needed at least one function Sound playing function, image player function etc.) etc.;Storage data field can store according to mobile phone use created data (such as Voice data, phone directory etc.) etc..In addition, memory 509 can include high-speed random access memory, can also include non-easy The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 510 is the control centre of mobile terminal, utilizes each of various interfaces and the whole mobile terminal of connection Individual part, by running or performing the software program and/or module that are stored in memory 509, and call and be stored in storage Data in device 509, the various functions and processing data of mobile terminal are performed, so as to carry out integral monitoring to mobile terminal.Place Reason device 510 may include one or more processing units;Preferably, processor 510 can integrate application processor and modulatedemodulate is mediated Device is managed, wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor is main Handle radio communication.It is understood that above-mentioned modem processor can not also be integrated into processor 510.
Mobile terminal 500 can also include the power supply 511 (such as battery) to all parts power supply, it is preferred that power supply 511 Can be logically contiguous by power-supply management system and processor 510, so as to realize management charging by power-supply management system, put The function such as electricity and power managed.
In addition, mobile terminal 500 includes some unshowned functional modules, will not be repeated here.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor 510, memory 509, is stored in On memory 509 and the computer program that can be run on the processor 510, the computer program are performed by processor 510 Each process of the above-mentioned image processing method embodiments of Shi Shixian, and identical technique effect can be reached, to avoid repeating, here Repeat no more.
The embodiment of the present invention also provides a kind of computer-readable recording medium, and meter is stored with computer-readable recording medium Calculation machine program, the computer program realize each process of above-mentioned image processing method embodiment when being performed by processor 510, and Identical technique effect can be reached, to avoid repeating, repeated no more here.Wherein, described computer-readable recording medium, such as Read-only storage (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic disc or CD etc..
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row His property includes, so that process, method, article or device including a series of elements not only include those key elements, and And also include the other element being not expressly set out, or also include for this process, method, article or device institute inherently Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this Other identical element also be present in the process of key element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words Going out the part of contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium In (such as ROM/RAM, magnetic disc, CD), including some instructions to cause a station terminal (can be mobile phone, computer, service Device, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
Embodiments of the invention are described above in conjunction with accompanying drawing, but the invention is not limited in above-mentioned specific Embodiment, above-mentioned embodiment is only schematical, rather than restricted, one of ordinary skill in the art Under the enlightenment of the present invention, in the case of present inventive concept and scope of the claimed protection is not departed from, it can also make a lot Form, belong within the protection of the present invention.

Claims (10)

  1. A kind of 1. image processing method, applied to mobile terminal, it is characterised in that the mobile terminal prestore a variety of shapes of face with And corresponding multiple benchmark face ratio mapping relations, methods described include respectively with it:
    Face characteristic point data is extracted from facial image;
    According to the face characteristic point data, the target shape of face belonging to the facial image is determined;
    According to benchmark face ratio mapping relations corresponding to the target shape of face, the face ratio of the facial image is adjusted It is whole.
  2. 2. according to the method for claim 1, it is characterised in that the mobile terminal includes default multiple face depth-width ratios Scope, the multiple face depth-width ratio scope have corresponding relation, the face characteristic point data respectively with a variety of shapes of face It is described according to the face characteristic point data including multiple facial contour feature points, determine the target belonging to the facial image The step of shape of face, including:
    Using the multiple facial contour feature point, face depth-width ratio is calculated;
    When the face depth-width ratio is within the scope of target face depth-width ratio, extraction is corresponding with the target face depth-width ratio scope Shape of face, as the target shape of face.
  3. 3. according to the method for claim 2, it is characterised in that it is special that the multiple facial contour feature point includes face top Point, face bottom characteristic point, face left end characteristic point and face right-hand member characteristic point are levied, it is described special using the multiple facial contour Levy point, calculate face depth-width ratio the step of, including:
    The distance value of face top characteristic point and face bottom characteristic point is calculated, as facial contour height value;
    The distance value of the face left end characteristic point and the face right-hand member characteristic point is calculated, as facial contour width value;
    The ratio of the facial contour height value and the facial contour width value is calculated, obtains the face depth-width ratio.
  4. 4. according to the method for claim 1, it is characterised in that the human face characteristic point data are included in the facial image Multiple altitude feature points and multiple width characteristics point, the benchmark face ratio according to corresponding to the target shape of face map Relation, before the step of being adjusted to the face ratio of the facial image, methods described also includes:
    Determine multiple between the horizontal tangent of the multiple altitude feature point and the vertical tangent lines of the multiple width characteristics point Intersection point;
    The region that will be formed between the multiple intersection point, each face characteristic area as the facial image.
  5. 5. a kind of mobile terminal, it is characterised in that the mobile terminal prestores a variety of shapes of face and distinguished with it corresponding more Individual benchmark face ratio mapping relations, the mobile terminal include:
    Human face characteristic point data extraction module, for extracting face characteristic point data from facial image;
    Target shape of face determining module, for according to the face characteristic point data, determining the target face belonging to the facial image Type;
    Face ratio adjusting module, for the benchmark face ratio mapping relations according to corresponding to the target shape of face, to the people The face ratio of face image is adjusted.
  6. 6. mobile terminal according to claim 5, it is characterised in that it is high that the mobile terminal includes default multiple faces Wide the multiple face depth-width ratio scope and a variety of shapes of face have a corresponding relation respectively than scope, and the target shape of face is true Cover half block, including:
    Face depth-width ratio calculating sub module, for using the multiple facial contour feature point, calculate face depth-width ratio;
    Target shape of face extracting sub-module, for when the face depth-width ratio is within the scope of target face depth-width ratio, extraction and institute Shape of face corresponding to target face depth-width ratio scope is stated, as the target shape of face.
  7. 7. mobile terminal according to claim 6, it is characterised in that the multiple facial contour feature point includes face top Characteristic point, face bottom characteristic point, face left end characteristic point and face right-hand member characteristic point are held, the face depth-width ratio calculates submodule Block, including:
    Facial contour height value computing unit, for calculate face top characteristic point and face bottom characteristic point away from From value, as facial contour height value;
    Facial contour width value computing unit, for calculate the face left end characteristic point and the face right-hand member characteristic point away from From value, as facial contour width value;
    Face depth-width ratio computing unit, for calculating the ratio of the facial contour height value and the facial contour width value, Obtain the face depth-width ratio.
  8. 8. mobile terminal according to claim 5, it is characterised in that the human face characteristic point data include the face figure Multiple altitude feature points and multiple width characteristics point, the mobile terminal as in also include:
    Intersection point determining module, for determining the horizontal tangent of the multiple altitude feature point and hanging down for the multiple width characteristics point Multiple intersection points between straight tangent line;
    Face characteristic area determining module, for the region that will be formed between the multiple intersection point, as the facial image Each face characteristic area.
  9. 9. a kind of mobile terminal, it is characterised in that including processor, memory and be stored on the memory and can be described The computer program run on processor, the computer program are realized during the computing device as in Claims 1-4 The step of image processing method described in any one.
  10. 10. a kind of computer-readable recording medium, it is characterised in that computer journey is stored on the computer-readable recording medium Sequence, realized when the computer program is executed by processor such as the image processing method any one of Claims 1-4 Step.
CN201711048808.7A 2017-10-31 2017-10-31 A kind of image processing method and mobile terminal Pending CN107833177A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711048808.7A CN107833177A (en) 2017-10-31 2017-10-31 A kind of image processing method and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711048808.7A CN107833177A (en) 2017-10-31 2017-10-31 A kind of image processing method and mobile terminal

Publications (1)

Publication Number Publication Date
CN107833177A true CN107833177A (en) 2018-03-23

Family

ID=61651174

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711048808.7A Pending CN107833177A (en) 2017-10-31 2017-10-31 A kind of image processing method and mobile terminal

Country Status (1)

Country Link
CN (1) CN107833177A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109087239A (en) * 2018-07-25 2018-12-25 腾讯科技(深圳)有限公司 A kind of face image processing process, device and storage medium
CN109190533A (en) * 2018-08-22 2019-01-11 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN109214373A (en) * 2018-11-05 2019-01-15 绍兴文理学院 A kind of face identification system and method for attendance
CN109345636A (en) * 2018-07-19 2019-02-15 北京永航科技有限公司 The method and apparatus for obtaining conjecture face figure
CN109584150A (en) * 2018-11-28 2019-04-05 维沃移动通信(杭州)有限公司 A kind of image processing method and terminal device
CN109584151A (en) * 2018-11-30 2019-04-05 腾讯科技(深圳)有限公司 Method for beautifying faces, device, terminal and storage medium
CN109658331A (en) * 2018-12-14 2019-04-19 北京旷视科技有限公司 Image processing method, device, system and computer storage medium
CN109858364A (en) * 2018-12-28 2019-06-07 维沃移动通信有限公司 A kind of processing method and mobile terminal of facial image
CN111402115A (en) * 2020-03-10 2020-07-10 维沃移动通信有限公司 Image processing method and electronic equipment
CN111445417A (en) * 2020-03-31 2020-07-24 维沃移动通信有限公司 Image processing method, image processing apparatus, electronic device, and medium
CN112037271A (en) * 2020-07-16 2020-12-04 北京旷视科技有限公司 Image processing method, apparatus, device and medium
CN112052792A (en) * 2020-09-04 2020-12-08 恒睿(重庆)人工智能技术研究院有限公司 Cross-model face recognition method, device, equipment and medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101887513A (en) * 2009-05-12 2010-11-17 联咏科技股份有限公司 Expression detecting device and method
CN102393951A (en) * 2011-06-30 2012-03-28 Tcl集团股份有限公司 Deformation method of human face model
CN104751408A (en) * 2015-03-26 2015-07-01 广东欧珀移动通信有限公司 Face image adjusting method and device
CN105530435A (en) * 2016-02-01 2016-04-27 深圳市金立通信设备有限公司 Shooting method and mobile terminal
CN105554389A (en) * 2015-12-24 2016-05-04 小米科技有限责任公司 Photographing method and photographing apparatus
CN106204665A (en) * 2016-06-27 2016-12-07 深圳市金立通信设备有限公司 A kind of image processing method and terminal
CN106296572A (en) * 2016-08-01 2017-01-04 南京信息工程大学 A kind of face editor based on parts and beautification method
CN106447720A (en) * 2016-08-29 2017-02-22 重庆市云日信息技术有限公司 Method for constructing golden-ratio face
CN106558025A (en) * 2015-09-29 2017-04-05 腾讯科技(深圳)有限公司 A kind for the treatment of method and apparatus of picture
CN106909892A (en) * 2017-01-24 2017-06-30 珠海市魅族科技有限公司 A kind of image processing method and system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101887513A (en) * 2009-05-12 2010-11-17 联咏科技股份有限公司 Expression detecting device and method
CN102393951A (en) * 2011-06-30 2012-03-28 Tcl集团股份有限公司 Deformation method of human face model
CN104751408A (en) * 2015-03-26 2015-07-01 广东欧珀移动通信有限公司 Face image adjusting method and device
CN106558025A (en) * 2015-09-29 2017-04-05 腾讯科技(深圳)有限公司 A kind for the treatment of method and apparatus of picture
CN105554389A (en) * 2015-12-24 2016-05-04 小米科技有限责任公司 Photographing method and photographing apparatus
CN105530435A (en) * 2016-02-01 2016-04-27 深圳市金立通信设备有限公司 Shooting method and mobile terminal
CN106204665A (en) * 2016-06-27 2016-12-07 深圳市金立通信设备有限公司 A kind of image processing method and terminal
CN106296572A (en) * 2016-08-01 2017-01-04 南京信息工程大学 A kind of face editor based on parts and beautification method
CN106447720A (en) * 2016-08-29 2017-02-22 重庆市云日信息技术有限公司 Method for constructing golden-ratio face
CN106909892A (en) * 2017-01-24 2017-06-30 珠海市魅族科技有限公司 A kind of image processing method and system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109345636A (en) * 2018-07-19 2019-02-15 北京永航科技有限公司 The method and apparatus for obtaining conjecture face figure
CN109087239A (en) * 2018-07-25 2018-12-25 腾讯科技(深圳)有限公司 A kind of face image processing process, device and storage medium
CN109087239B (en) * 2018-07-25 2023-03-21 腾讯科技(深圳)有限公司 Face image processing method and device and storage medium
CN109190533A (en) * 2018-08-22 2019-01-11 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN109214373A (en) * 2018-11-05 2019-01-15 绍兴文理学院 A kind of face identification system and method for attendance
CN109214373B (en) * 2018-11-05 2020-11-13 绍兴文理学院 Face recognition system and method for attendance checking
CN109584150A (en) * 2018-11-28 2019-04-05 维沃移动通信(杭州)有限公司 A kind of image processing method and terminal device
CN109584151B (en) * 2018-11-30 2022-12-13 腾讯科技(深圳)有限公司 Face beautifying method, device, terminal and storage medium
CN109584151A (en) * 2018-11-30 2019-04-05 腾讯科技(深圳)有限公司 Method for beautifying faces, device, terminal and storage medium
CN109658331A (en) * 2018-12-14 2019-04-19 北京旷视科技有限公司 Image processing method, device, system and computer storage medium
CN109658331B (en) * 2018-12-14 2023-07-21 北京旷视科技有限公司 Image processing method, device, system and computer storage medium
CN109858364A (en) * 2018-12-28 2019-06-07 维沃移动通信有限公司 A kind of processing method and mobile terminal of facial image
CN111402115A (en) * 2020-03-10 2020-07-10 维沃移动通信有限公司 Image processing method and electronic equipment
CN111402115B (en) * 2020-03-10 2024-02-20 维沃移动通信有限公司 Image processing method and electronic equipment
CN111445417A (en) * 2020-03-31 2020-07-24 维沃移动通信有限公司 Image processing method, image processing apparatus, electronic device, and medium
CN111445417B (en) * 2020-03-31 2023-12-19 维沃移动通信有限公司 Image processing method, device, electronic equipment and medium
CN112037271A (en) * 2020-07-16 2020-12-04 北京旷视科技有限公司 Image processing method, apparatus, device and medium
CN112052792A (en) * 2020-09-04 2020-12-08 恒睿(重庆)人工智能技术研究院有限公司 Cross-model face recognition method, device, equipment and medium

Similar Documents

Publication Publication Date Title
CN107833177A (en) A kind of image processing method and mobile terminal
CN107835367A (en) A kind of image processing method, device and mobile terminal
CN107835364A (en) One kind is taken pictures householder method and mobile terminal
CN107833178A (en) A kind of image processing method, device and mobile terminal
CN107734251A (en) A kind of photographic method and mobile terminal
CN107817939A (en) A kind of image processing method and mobile terminal
CN107872639A (en) Transmission method, device and the mobile terminal of communication video
CN109461117A (en) A kind of image processing method and mobile terminal
CN107592466A (en) A kind of photographic method and mobile terminal
CN108491775A (en) A kind of image correcting method and mobile terminal
CN107948499A (en) A kind of image capturing method and mobile terminal
CN108184050A (en) A kind of photographic method, mobile terminal
CN107734260A (en) A kind of image processing method and mobile terminal
CN107845057A (en) One kind is taken pictures method for previewing and mobile terminal
CN108550117A (en) A kind of image processing method, device and terminal device
CN107895352A (en) A kind of image processing method and mobile terminal
CN107831891A (en) A kind of brightness adjusting method and mobile terminal
CN109409244A (en) A kind of object puts the output method and mobile terminal of scheme
CN107644396A (en) A kind of lip color adjustment method and apparatus
CN109461124A (en) A kind of image processing method and terminal device
CN109167914A (en) A kind of image processing method and mobile terminal
CN107864336A (en) A kind of image processing method, mobile terminal
CN107678672A (en) A kind of display processing method and mobile terminal
CN107786811A (en) A kind of photographic method and mobile terminal
CN109671034A (en) A kind of image processing method and terminal device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180323

RJ01 Rejection of invention patent application after publication