CN107948506A - Image processing method and device and electronic equipment - Google Patents
Image processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN107948506A CN107948506A CN201711173989.6A CN201711173989A CN107948506A CN 107948506 A CN107948506 A CN 107948506A CN 201711173989 A CN201711173989 A CN 201711173989A CN 107948506 A CN107948506 A CN 107948506A
- Authority
- CN
- China
- Prior art keywords
- face
- preview image
- processed
- image
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000000034 method Methods 0.000 claims abstract description 57
- 238000012545 processing Methods 0.000 claims abstract description 45
- 238000003860 storage Methods 0.000 claims description 18
- 238000005516 engineering process Methods 0.000 abstract description 7
- 210000000887 face Anatomy 0.000 description 26
- 230000006870 function Effects 0.000 description 18
- 238000001514 detection method Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 11
- 230000003796 beauty Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 230000001815 facial effect Effects 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 238000000701 chemical imaging Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 210000000744 eyelid Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
- Studio Devices (AREA)
Abstract
The present invention relates to the field of computer technologies, and in particular, to an image processing method and apparatus, and an electronic device. The method comprises the following steps: when the opening of a camera of a terminal is detected, judging whether a shooting preview image of the camera comprises a human face or not; if the preview image comprises a face, determining the face to be processed in the preview image; and executing preset operation on the determined face to be processed in the preview image. The embodiment can subjectively select the face in the image to carry out special processing, enriches the function of image processing and improves the autonomy of the user.
Description
[ technical field ] A method for producing a semiconductor device
The present invention relates to the field of computer technologies, and in particular, to an image processing method and apparatus, and an electronic device.
[ background of the invention ]
At present, various Applications (APPs) with beauty or special effects functions can be used in mobile terminal devices, and people are increasingly used to take pictures with such APPs.
However, the beautifying operation or the special effect function operation performed after the photographing through the APP is performed is to perform an integral processing on the whole image, for example, one-key beautifying. So that the functions are too general to individually perform special processing on a certain face or a certain number of faces in the image.
[ summary of the invention ]
The invention aims to provide an image processing method, an image processing device and electronic equipment, and solves the problem of single function of the conventional image processing.
In one aspect of the embodiments of the present invention, an image processing method is provided, including:
when the opening of a camera of a terminal is detected, judging whether a shooting preview image of the camera comprises a human face or not;
if the image comprises a face, determining the face to be processed in the preview image;
and executing preset operation on the determined face to be processed in the preview image.
Optionally, the determining a face to be processed in the preview image includes:
judging whether a face selection instruction is received within preset time;
if the face selection instruction is received within the preset time, acquiring feature information carried by the face selection instruction, wherein the feature information comprises at least one of position features, dressing features and appearance features;
and determining the face matched with the characteristic information as the face to be processed in the preview image.
Optionally, the method further comprises:
if the face selection instruction is not received within the preset time, judging whether the preview image comprises at least two faces;
if so, acquiring the face proportion, the skin fineness and the skin color glossiness of the face in the preview image;
according to the face proportion, the skin fineness and the skin color glossiness of the faces, scoring the at least two faces in the preview image;
according to the scoring result, obtaining the face with the highest score in the preview image;
and determining the face with the highest score as the face to be processed in the preview image.
Optionally, the executing a preset operation on the determined face to be processed in the preview image includes:
performing face beautifying processing on the determined face to be processed in the preview image; and/or
And endowing a preset label to the determined face to be processed in the preview image.
Optionally, the method further comprises:
after the camera shoots the preview image after the preset operation is executed, receiving a storage instruction;
and saving the preview image after the preset operation is executed according to the saving instruction.
In another aspect of the embodiments of the present invention, there is provided an image processing apparatus including:
the first judgment module is used for judging whether a shooting preview image of a camera comprises a human face or not when the camera of the terminal is detected to be opened;
the first determining module is used for determining a face to be processed in the preview image if the preview image comprises the face;
and the first processing module is used for executing preset operation on the determined human face to be processed in the preview image.
Optionally, the first determining module includes:
the first judgment unit is used for judging whether a face selection instruction is received within preset time;
the first obtaining unit is used for obtaining feature information carried by the face selection instruction if the face selection instruction is received within the preset time, wherein the feature information comprises at least one of position features, dressing features and appearance features;
and the first determining unit is used for determining the face matched with the characteristic information as the face to be processed in the preview image.
Optionally, the first determining module further includes:
a second judging unit, configured to judge whether the preview image includes at least two faces if the face selection instruction is not received within the preset time;
the second acquisition unit is used for acquiring the face proportion, the skin fineness and the skin color glossiness of the human face in the preview image if the face proportion, the skin fineness and the skin color glossiness are acquired;
the scoring unit is used for scoring the at least two human faces in the preview image according to the face proportion, the skin fineness and the skin color glossiness of the human faces;
the third acquisition unit is used for acquiring the face with the highest score in the preview image according to the scoring result;
and the second determining unit is used for determining the face with the highest score as the face to be processed in the preview image.
Optionally, the first processing module is specifically configured to:
performing face beautifying processing on the determined face to be processed in the preview image; and/or
And endowing a preset label to the determined face to be processed in the preview image.
Optionally, the apparatus further comprises:
the receiving module is used for receiving a storage instruction after the camera shoots the preview image after the preset operation is executed;
and the storage module is used for storing the preview image after the preset operation is executed according to the storage instruction.
In another aspect of the embodiments of the present invention, an electronic device is provided, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method as described above.
In the embodiment of the invention, after the terminal camera is started, whether the preview image shot by the terminal comprises a human face is judged, if the image comprises the human face, the human face to be processed is determined according to a preset condition, and therefore, the determined human face to be processed is subjected to preset operation. The embodiment can subjectively select the face in the image to carry out special processing, enriches the function of image processing and improves the autonomy of the user.
[ description of the drawings ]
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a method for determining a face to be processed in an image according to a preset condition in an image processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating an image processing method according to another embodiment of the present invention;
FIG. 4 is a flowchart illustrating an image processing method according to another embodiment of the present invention;
FIG. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
[ detailed description ] embodiments
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that, if not conflicted, the various features of the embodiments of the invention may be combined with each other within the scope of protection of the invention. Additionally, while functional block divisions are performed in the device diagrams, with logical sequences shown in the flowcharts, in some cases, the steps shown or described may be performed in a different order than the block divisions in the device diagrams, or the flowcharts. Further, the terms "first," "second," and the like, as used herein, do not limit the order of data and execution, but merely distinguish identical or similar items having substantially the same function or effect.
The embodiment of the invention provides an image processing method which can be suitable for mobile terminal equipment comprising a camera, wherein the mobile terminal equipment comprises a smart phone, a tablet personal computer, a portable computer, a smart camera and the like. The method can be realized in an APP mode operated on a smart phone or a tablet computer, can also be realized in software installed in a portable computer, and can also be realized in a system software function mode in mobile terminal equipment. As shown in fig. 1, the image processing method includes:
s101, when the fact that a camera of a terminal is opened is detected, whether a shot preview image of the camera comprises a human face or not is judged;
the method comprises the steps of shooting a preview image of a camera, namely the preview image corresponding to a preview mode of the camera, judging whether the preview image comprises a human face or not, specifically, preprocessing and feature extraction are carried out on the preview image, so that the extracted features are matched with preset human face features, and if the feature matching is the same, the situation that the image to be shot corresponding to the camera comprises the human face is indicated. In addition, whether the image to be shot corresponding to the camera includes the face can be judged by a method for identifying the face in the image in the prior art.
S102, if the preview image comprises a human face, determining the human face to be processed in the preview image;
in this embodiment, specifically, as shown in fig. 2, determining a face to be processed in the preview image includes:
s1021, judging whether a face selection instruction is received within preset time;
s1022, if the face selection instruction is received within the preset time, acquiring feature information carried by the face selection instruction, wherein the feature information comprises at least one of a position feature, a dressing feature and an appearance feature;
and S1023, determining the face matched with the feature information as the face to be processed in the preview image.
The face selection instruction is used for selecting a face in an image, the user sends the face selection instruction, and the user can send the face selection instruction by touching a display screen or by voice input and the like. The preset time may be set manually or by a system, such as 10 seconds or 30 seconds.
In this embodiment, the face selection instruction may select one face in the image, or may select a plurality of faces in the image.
For example, when the user sends the face selection instruction by touching the display screen, the face selection instruction is triggered when the user touches the display screen, and at this time, the mobile terminal device executing the method can acquire a specific position touched by the user on the display screen, where the specific position is the position feature; further, acquiring a face feature of the image corresponding to the specific position, for example, if the specific position is a nose, the face feature of the image corresponding to the specific position is a nose; then, taking the specific position as a center, and acquiring other human face features within a preset range; and finally, determining the whole face according to the obtained face features and other face features, wherein the determined whole face is the face to be processed.
For example, when the user sends the face selection instruction in a voice manner, if only one face exists in the image, the user can directly output the face in a voice manner, that is, the face is selected, and when the face is processed subsequently, the face and the background area can be distinguished so as to process the face independently; if the image comprises a plurality of faces, the user can output voice instructions such as a left face or a middle face through voice at the moment, and the obtained voice instructions are subjected to voice recognition and voice processing, so that the face selected by the user is determined; in addition, when a plurality of faces are included in the image, the user may also output a voice instruction containing a dress feature or an appearance feature of a person, such as "yellow hair", "double eyelids", "red clothes", and the like, so that after the voice instruction is recognized by the machine, the face to be processed is determined.
S103, executing preset operation on the determined face to be processed in the preview image.
The method for executing the preset operation on the face to be processed comprises the following steps: performing face beautifying processing on the determined face to be processed in the image; and/or endowing the determined face to be processed in the image with a preset label.
Wherein, the effect of adding the beauty can refer to the existing beauty mode. Giving a preset label to the face to be processed, such as a character label of 'lovely' or 'beautiful'.
The embodiment of the invention provides an image processing method, which comprises the steps of judging whether a preview image shot by a terminal comprises a face or not after a terminal camera is started, judging whether a face selection instruction is received within preset time or not if the preview image shot by the terminal comprises the face, and determining the face to be processed according to the face selection instruction if the face selection instruction is received, so as to carry out preset operation on the determined face to be processed. The embodiment can subjectively select the face in the image to carry out special processing, enriches the function of image processing and improves the autonomy of the user.
The embodiment can be used for enabling the user to autonomously select the face in the image, so that the face selected by the user is specially processed. When the user does not issue a face selection instruction within a preset time, the face to be processed may be determined by the system. Specifically, as shown in fig. 3, another embodiment of the present invention provides an image processing method, where the method further includes:
s201, when the fact that a camera of a terminal is started is detected, whether a preview image shot by the terminal comprises a human face or not is judged;
s202, if the preview image comprises a face, judging whether a face selection instruction is received within preset time;
s203, if the face selection instruction is not received within the preset time, judging whether the preview image comprises at least two faces; the process, i.e., the face recognition process, may refer to the step of determining whether there is a face in the preview image in the above embodiment.
S204, if yes, acquiring the face proportion, the skin fineness and the skin color glossiness of the face in the preview image;
the face proportion of the human face can be calculated based on the existing related algorithm of the human face recognition, and the face proportion comprises the proportion of the length and the width of the whole human face and the proportion of parts of five sense organs in one human face.
In the embodiment, image skin detection can be performed by adopting other methods such as a skin detection method based on an HSV color space, an image skin detection method based on content, a skin detection method based on multispectral imaging, and the like, and the skin fineness and the skin glossiness are obtained in the detection process. It should be noted that specific processes of the skin detection method based on the HSV color space, the image skin detection method based on the content, and the skin detection method based on the multispectral imaging are described in detail in the related art, and are not described herein again.
S205, scoring the at least two human faces in the preview image according to the face proportion, the skin fineness and the skin color glossiness of the human faces;
in this embodiment, a face database is pre-established, and data of different face proportions, data of different skin fineness, and data of different skin glossiness are stored in the preset face database by performing data acquisition on a face in real life, and weights of the data in the preset face database are respectively determined based on existing public aesthetic standards, for example, the closer the face proportion is to the "three-family five-eye" standard, the higher the weight of the face proportion is.
After the face proportion, the skin fineness and the skin color glossiness of the face in the image are obtained, data corresponding to the face proportion, the skin fineness and the skin color glossiness of the face are searched in the preset face database, data identical to the data are searched, the weight of the face proportion, the skin fineness and the skin color glossiness of the face in the image is determined according to the weight corresponding to the identical data, and finally the obtained weights of the three parameters are summed up to obtain the sum, namely the score value of the face.
And calculating the score value of each face in the image according to the embodiment, thereby completing the process of scoring the faces in the image.
It should be noted that the face in the image may also be scored by other methods, which is not limited to the method provided in this embodiment.
S206, obtaining the face with the highest score in the preview image according to the scoring result;
s207, determining the face with the highest score as the face to be processed;
and S208, executing preset operation on the determined face to be processed in the preview image.
After scoring each face in an image including a plurality of faces, a face with the highest score value is obtained, and the face may be considered as the most beautiful face in the image. And finally, displaying the image after the preset operation is executed on a screen of the terminal, and in addition, simultaneously displaying the scoring result of the face in the image.
It should be noted that, when the face in the image moves in the camera screen, the label or the scoring result corresponding to the face moves along with the movement of the face, and the special processing effect performed on the face also moves along with the movement of the face, so that the label, the scoring result and the special processing effect do not separate from the face, and the processed image can look more natural.
In this embodiment, the facial image after the facial beautification processing, and/or the labeled facial image, and/or the score corresponding to the facial image are displayed, so that the user can see the final processing result. In addition to the advantages of the above embodiment, the embodiment also enhances the interactivity between users when taking a self-timer because the result corresponding to each face is displayed on the image.
It should be noted that, when the user does not send a face selection instruction within the preset time and the image only contains one face, the above method may be adopted to score only one face in the image, and finally the scoring result of the face may be displayed, thereby increasing the entertainment of the user during self-timer shooting.
In some other embodiments, the method may further include: according to the scoring result, obtaining the face with the lowest score in the image; acquiring the evaluation information of the face with the lowest score according to the face proportion, the skin fineness and the skin color glossiness corresponding to the face with the lowest score; and displaying the evaluation information in a preset area of the face with the lowest score in the image, wherein the evaluation information comprises serious dark eye circles, darker skin, a small amount of color spots and the like. Therefore, reference suggestions can be provided for the people who are not beautiful in the image to help the people who are not beautiful become beautiful, the self-timer has scientific significance, and the user experience is improved.
In some other embodiments, the method further comprises: and performing beautifying processing on other faces in the at least two faces according to the skin fineness and the skin color glossiness corresponding to the face with the highest score. It can be understood that the face with the highest score is the 'beauty' person according to the mass aesthetic, and other people are beautified based on the skin parameters of the beauty person, so that other faces in the image can be close to the face of the user with the beauty, the image beautifying method is enriched, and the entertainment of the user is enhanced.
The embodiment of the invention provides an image processing method, which scores a plurality of faces in a preview image through related technologies such as face recognition, face skin detection and the like when the preview image is detected to contain the plurality of faces, so as to obtain the 'most beautiful' face, and specially processes the 'most beautiful' face. The embodiment can independently process a certain face or a plurality of faces in the preview image, not only enriches the image processing function, but also enhances the entertainment of the user during self-shooting.
Referring to fig. 4, fig. 4 is a flowchart illustrating an image processing method according to another embodiment of the present invention. Fig. 4 differs from fig. 3 above mainly in that the method further comprises:
s209, after the preview image after the preset operation is executed is shot by the camera, a storage instruction is received; the saving instruction may be actively triggered by a user, for example, the user triggers the saving instruction by performing a preset operation, where the preset operation may be a gesture made by a finger on a screen, a pressing of a saving button on the mobile terminal device, a voice output of the saving instruction, or the like. The saving instruction may also be triggered automatically by the system, for example, when the system captures an expression that a face in an image has smile, that is, automatically capturing a picture, and the like.
And S210, saving the preview image after the preset operation is executed according to the saving instruction.
The user can share the stored image to a preset third-party application program according to the wish of the user, wherein the third-party application program comprises WeChat, QQ, microblog and the like.
The embodiment of the invention provides an image processing method, which comprises the steps of judging whether a shooting preview image of a camera comprises a face or not after the terminal camera is started, judging whether a face selection instruction is received within preset time or not if the image comprises the face, and determining the face to be processed according to the face selection instruction if the face selection instruction is received, so as to perform preset operation on the determined face to be processed; if the face selection instruction is not received and at least two faces are included in the image, determining the 'beauty' face in the image through a face recognition technology and a face skin detection technology, carrying out corresponding processing on the 'beauty' face, and further, after the processed image is shot by the camera, storing the shot image. This embodiment, the face in the subjective selection image of one side can carry out special treatment, has richened image processing's function, has promoted user's autonomy, and on the other hand has strengthened the interest when the user autodynes, has promoted user experience.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention. As shown in fig. 5, the apparatus 30 includes: a first judging module 301, a first determining module 302 and a first processing module 303.
The first judging module 301 is configured to, when it is detected that a camera of a terminal is turned on, judge whether a shooting preview image of the camera includes a human face; a first determining module 302, configured to determine a face to be processed in the preview image if the image includes the face; the first processing module 303 is configured to perform a preset operation on the determined face to be processed in the preview image.
The first processing module 303 is specifically configured to: performing face beautifying processing on the determined face to be processed in the preview image; and/or endowing a preset label to the determined human face to be processed in the preview image.
In this embodiment, the first determining module 302 includes: a first judging unit 3021, a first acquiring unit 3022, and a first determining unit 3023. A first judging unit 3021, configured to judge whether a face selection instruction is received within a preset time; a first obtaining unit 3022, configured to obtain feature information carried by the face selection instruction if the face selection instruction is received within the preset time, where the feature information includes at least one of a position feature, a dressing feature, and an appearance feature; a first determining unit 3023 configured to determine a face matching the feature information as a face to be processed in the preview image.
In some other embodiments, referring to fig. 5 as well, if the face selection instruction is not received within the preset time, the first determining module 302 further includes: a second determination unit 3024, a second acquisition unit 3025, a scoring unit 3026, a third acquisition unit 3027, and a second determination unit 3028. A second judging unit 3024, configured to judge whether the preview image includes at least two faces if the face selection instruction is not received within the preset time; a second obtaining unit 3025, configured to obtain, if yes, a face proportion, skin fineness, and skin color glossiness of the face in the preview image; a scoring unit 3026, configured to score the at least two faces in the preview image according to a face proportion, skin fineness, and skin color glossiness of the faces; a third obtaining unit 3027, configured to obtain, according to the scoring result, a face with the highest score in the preview image; a second determining unit 3028, configured to determine the face with the highest score as a face to be processed in the preview image.
In some other embodiments, referring to fig. 5 as well, the apparatus 30 further includes a receiving module 304, a saving module 305, and a sharing module 306. A receiving module 304, configured to receive a saving instruction after the camera shoots the preview image after the preset operation is executed; a saving module 305, configured to save the preview image after the preset operation is executed according to the saving instruction; and a sharing module 306, configured to share the saved preview image.
It should be noted that, as the contents of information interaction, execution processes and the like between the respective modules and units in the image processing apparatus in the embodiment of the present invention are based on the same concept as the method embodiment of the present invention, the specific contents are also applicable to the image processing apparatus. The respective modules in the embodiments of the present invention can be implemented as separate hardware or software, and the combination of the functions of the respective units can be implemented using separate hardware or software as necessary.
The embodiment of the invention provides an image processing device, which judges whether a preview image shot by a terminal comprises a face or not after a terminal camera is started, judges whether a face selection instruction is received within preset time or not if the image comprises the face, and determines the face to be processed according to the face selection instruction if the face selection instruction is received, so that the determined face to be processed is subjected to preset operation; if the face selection instruction is not received and at least two faces are included in the image, determining the 'beauty' face in the image through a face recognition technology and a face skin detection technology, carrying out corresponding processing on the 'beauty' face, and further, after the processed image is shot by the camera, storing the shot image. This embodiment, the face in the subjective selection image of one side can carry out special treatment, has richened image processing's function, has promoted user's autonomy, and on the other hand has strengthened the interest when the user autodynes, has promoted user experience.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 6, the electronic device 40 includes:
one or more processors 41 and memory 42, with one processor 41 being an example in fig. 6.
The processor 41 and the memory 42 may be connected by a bus or other means, such as the bus connection in fig. 6.
The memory 42, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions/modules (e.g., modules and units shown in fig. 5) corresponding to the image processing method in the embodiment of the present invention. The processor 41 executes various functional applications of the server and data processing by running nonvolatile software programs, instructions, and modules stored in the memory 42, that is, implements the image processing method of the above-described method embodiment.
The memory 42 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the image processing apparatus, and the like. Further, the memory 42 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 42 optionally includes memory located remotely from processor 41, which may be connected to the image processing device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory 42 and, when executed by the one or more processors 41, perform the image processing method in any of the above-described method embodiments, e.g., performing the above-described method steps S101 to S103 in fig. 1, method steps S1021 to S1023 in fig. 2, method steps S201 to S208 in fig. 3, and method steps S201 to S210 in fig. 4, implementing the functions of the modules 301-306, the units 3021-3028 in fig. 5.
The product can execute the method provided by the embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiment of the present invention.
The electronic device of embodiments of the present invention exists in a variety of forms, including but not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones, multimedia phones, functional phones, and low-end phones, etc.
(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc.
(3) And other electronic devices with data interaction functions.
Embodiments of the present invention provide a non-transitory computer-readable storage medium storing computer-executable instructions for an electronic device to perform an image processing method in any of the above-described method embodiments, for example, performing the above-described method steps S101 to S103 in fig. 1, method steps S1021 to S1023 in fig. 2, method steps S201 to S208 in fig. 3, and method steps S201 to S210 in fig. 4, to implement the functions of the modules 301 to 306 and the units 3021 to 3028 in fig. 5.
Embodiments of the present invention provide a computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions which, when executed by a computer, cause the computer to perform the image processing method of any of the above-described method embodiments, e.g., performing method steps S101 to S103 in fig. 1, method steps S1021 to S1023 in fig. 2, method steps S201 to S208 in fig. 3, method steps S201 to S210 in fig. 4, described above, implementing the functions of modules 301-306, units 3021-3028 in fig. 5.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a general hardware platform, and certainly can also be implemented by hardware. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a computer readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; within the idea of the invention, also technical features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (11)
1. An image processing method, comprising:
when the opening of a camera of a terminal is detected, judging whether a shooting preview image of the camera comprises a human face or not;
if the preview image comprises a face, determining the face to be processed in the preview image;
and executing preset operation on the determined face to be processed in the preview image.
2. The method of claim 1, wherein the determining the face to be processed in the preview image comprises:
judging whether a face selection instruction is received within preset time;
if the face selection instruction is received within the preset time, acquiring feature information carried by the face selection instruction, wherein the feature information comprises at least one of position features, dressing features and appearance features;
and determining the face matched with the characteristic information as the face to be processed in the preview image.
3. The method of claim 2, further comprising:
if the face selection instruction is not received within the preset time, judging whether the preview image comprises at least two faces;
if so, acquiring the face proportion, the skin fineness and the skin color glossiness of the face in the preview image;
according to the face proportion, the skin fineness and the skin color glossiness of the faces, scoring the at least two faces in the preview image;
according to the scoring result, obtaining the face with the highest score in the preview image;
and determining the face with the highest score as the face to be processed in the preview image.
4. The method according to any one of claims 1 to 3, wherein the performing of the preset operation on the determined face to be processed in the preview image comprises:
performing face beautifying processing on the determined face to be processed in the preview image; and/or
And endowing a preset label to the determined face to be processed in the preview image.
5. The method of claim 4, further comprising:
after the camera shoots the preview image after the preset operation is executed, receiving a storage instruction;
and saving the preview image after the preset operation is executed according to the saving instruction.
6. An image processing apparatus characterized by comprising:
the first judgment module is used for judging whether a shooting preview image of a camera comprises a human face or not when the camera of the terminal is detected to be opened;
the first determining module is used for determining a face to be processed in the preview image if the preview image comprises the face;
and the first processing module is used for executing preset operation on the determined human face to be processed in the preview image.
7. The apparatus of claim 6, wherein the first determining module comprises:
the first judgment unit is used for judging whether a face selection instruction is received within preset time;
the first obtaining unit is used for obtaining feature information carried by the face selection instruction if the face selection instruction is received within the preset time, wherein the feature information comprises at least one of position features, dressing features and appearance features;
and the first determining unit is used for determining the face matched with the characteristic information as the face to be processed in the preview image.
8. The apparatus of claim 7, wherein the first determining module further comprises:
a second judging unit, configured to judge whether the preview image includes at least two faces if the face selection instruction is not received within the preset time;
the second acquisition unit is used for acquiring the face proportion, the skin fineness and the skin color glossiness of the human face in the preview image if the face proportion, the skin fineness and the skin color glossiness are acquired;
the scoring unit is used for scoring the at least two human faces in the preview image according to the face proportion, the skin fineness and the skin color glossiness of the human faces;
the third acquisition unit is used for acquiring the face with the highest score in the preview image according to the scoring result;
and the second determining unit is used for determining the face with the highest score as the face to be processed in the preview image.
9. The apparatus according to any one of claims 6 to 8, wherein the first processing module is specifically configured to:
performing face beautifying processing on the determined face to be processed in the preview image; and/or
And endowing a preset label to the determined face to be processed in the preview image.
10. The apparatus of claim 9, further comprising:
the receiving module is used for receiving a storage instruction after the camera shoots the preview image after the preset operation is executed;
and the storage module is used for storing the preview image after the preset operation is executed according to the storage instruction.
11. An electronic device, comprising: at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711173989.6A CN107948506A (en) | 2017-11-22 | 2017-11-22 | Image processing method and device and electronic equipment |
| PCT/CN2018/100213 WO2019100766A1 (en) | 2017-11-22 | 2018-08-13 | Image processing method and apparatus, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711173989.6A CN107948506A (en) | 2017-11-22 | 2017-11-22 | Image processing method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107948506A true CN107948506A (en) | 2018-04-20 |
Family
ID=61930687
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711173989.6A Pending CN107948506A (en) | 2017-11-22 | 2017-11-22 | Image processing method and device and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107948506A (en) |
| WO (1) | WO2019100766A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108965692A (en) * | 2018-06-15 | 2018-12-07 | Oppo广东移动通信有限公司 | Paster setting method and device |
| CN109034063A (en) * | 2018-07-27 | 2018-12-18 | 北京微播视界科技有限公司 | Plurality of human faces tracking, device and the electronic equipment of face special efficacy |
| CN109145878A (en) * | 2018-09-30 | 2019-01-04 | 北京小米移动软件有限公司 | image extraction method and device |
| WO2019100766A1 (en) * | 2017-11-22 | 2019-05-31 | 格力电器（武汉）有限公司 | Image processing method and apparatus, electronic device and storage medium |
| CN110580808A (en) * | 2018-06-08 | 2019-12-17 | 杭州海康威视数字技术股份有限公司 | Information processing method and device, electronic equipment and intelligent traffic system |
| CN111860342A (en) * | 2020-07-22 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
| CN113206930A (en) * | 2020-01-30 | 2021-08-03 | 佳能株式会社 | Display control apparatus, control method thereof, and recording medium |
| WO2021244174A1 (en) * | 2020-06-05 | 2021-12-09 | 华为技术有限公司 | Skin detection method and device |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112785488A (en) * | 2019-11-11 | 2021-05-11 | 宇龙计算机通信科技(深圳)有限公司 | Image processing method and device, storage medium and terminal |
| CN111091512B (en) * | 2019-12-18 | 2024-03-01 | 广州酷狗计算机科技有限公司 | Image processing method and device and computer readable storage medium |
| CN112734661A (en) * | 2020-12-30 | 2021-04-30 | 维沃移动通信有限公司 | Image processing method and device |
| CN113240760B (en) * | 2021-06-29 | 2023-11-24 | 北京市商汤科技开发有限公司 | Image processing method, device, computer equipment and storage medium |
| CN114092357A (en) * | 2021-11-26 | 2022-02-25 | 维沃移动通信有限公司 | Image processing method, image processing device and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090273667A1 (en) * | 2006-04-11 | 2009-11-05 | Nikon Corporation | Electronic Camera |
| CN103413270A (en) * | 2013-08-15 | 2013-11-27 | 北京小米科技有限责任公司 | Method and device for image processing and terminal device |
| CN106210521A (en) * | 2016-07-15 | 2016-12-07 | 深圳市金立通信设备有限公司 | A kind of photographic method and terminal |
| CN106412458A (en) * | 2015-07-31 | 2017-02-15 | 中兴通讯股份有限公司 | Image processing method and apparatus |
| CN106815557A (en) * | 2016-12-20 | 2017-06-09 | 北京奇虎科技有限公司 | A kind of evaluation method of face features, device and mobile terminal |
| CN107274354A (en) * | 2017-05-22 | 2017-10-20 | 奇酷互联网络科技（深圳）有限公司 | image processing method, device and mobile terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107948506A (en) * | 2017-11-22 | 2018-04-20 | 珠海格力电器股份有限公司 | Image processing method and device and electronic equipment |
-
2017
- 2017-11-22 CN CN201711173989.6A patent/CN107948506A/en active Pending
-
2018
- 2018-08-13 WO PCT/CN2018/100213 patent/WO2019100766A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090273667A1 (en) * | 2006-04-11 | 2009-11-05 | Nikon Corporation | Electronic Camera |
| CN103413270A (en) * | 2013-08-15 | 2013-11-27 | 北京小米科技有限责任公司 | Method and device for image processing and terminal device |
| CN106412458A (en) * | 2015-07-31 | 2017-02-15 | 中兴通讯股份有限公司 | Image processing method and apparatus |
| CN106210521A (en) * | 2016-07-15 | 2016-12-07 | 深圳市金立通信设备有限公司 | A kind of photographic method and terminal |
| CN106815557A (en) * | 2016-12-20 | 2017-06-09 | 北京奇虎科技有限公司 | A kind of evaluation method of face features, device and mobile terminal |
| CN107274354A (en) * | 2017-05-22 | 2017-10-20 | 奇酷互联网络科技（深圳）有限公司 | image processing method, device and mobile terminal |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019100766A1 (en) * | 2017-11-22 | 2019-05-31 | 格力电器（武汉）有限公司 | Image processing method and apparatus, electronic device and storage medium |
| CN110580808B (en) * | 2018-06-08 | 2021-03-23 | 杭州海康威视数字技术股份有限公司 | Information processing method and device, electronic equipment and intelligent traffic system |
| CN110580808A (en) * | 2018-06-08 | 2019-12-17 | 杭州海康威视数字技术股份有限公司 | Information processing method and device, electronic equipment and intelligent traffic system |
| CN108965692B (en) * | 2018-06-15 | 2021-03-09 | Oppo广东移动通信有限公司 | Sticker setting method and device |
| CN108965692A (en) * | 2018-06-15 | 2018-12-07 | Oppo广东移动通信有限公司 | Paster setting method and device |
| CN109034063A (en) * | 2018-07-27 | 2018-12-18 | 北京微播视界科技有限公司 | Plurality of human faces tracking, device and the electronic equipment of face special efficacy |
| US11749020B2 (en) | 2018-07-27 | 2023-09-05 | Beijing Microlive Vision Technology Co., Ltd | Method and apparatus for multi-face tracking of a face effect, and electronic device |
| CN109145878A (en) * | 2018-09-30 | 2019-01-04 | 北京小米移动软件有限公司 | image extraction method and device |
| CN109145878B (en) * | 2018-09-30 | 2022-02-15 | 北京小米移动软件有限公司 | Image extraction method and device |
| CN113206930A (en) * | 2020-01-30 | 2021-08-03 | 佳能株式会社 | Display control apparatus, control method thereof, and recording medium |
| CN113206930B (en) * | 2020-01-30 | 2023-09-12 | 佳能株式会社 | Display control apparatus, control method thereof, and recording medium |
| WO2021244174A1 (en) * | 2020-06-05 | 2021-12-09 | 华为技术有限公司 | Skin detection method and device |
| CN111860342A (en) * | 2020-07-22 | 2020-10-30 | 北京字节跳动网络技术有限公司 | Image processing method, image processing device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019100766A1 (en) | 2019-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107948506A (en) | Image processing method and device and electronic equipment | |
| CN107886032B (en) | Terminal device, smart phone, authentication method and system based on face recognition | |
| CN105893920B (en) | Face living body detection method and device | |
| WO2019019836A1 (en) | Unlocking control method and related product | |
| WO2017185630A1 (en) | Emotion recognition-based information recommendation method and apparatus, and electronic device | |
| CN105160739B (en) | Automatic identification equipment, method and access control system | |
| US10846514B2 (en) | Processing images from an electronic mirror | |
| CN108399665A (en) | Method for safety monitoring, device based on recognition of face and storage medium | |
| CN107527046B (en) | Unlocking control method and related product | |
| CN107633204A (en) | Face occlusion detection method, apparatus and storage medium | |
| CN108681390B (en) | Information interaction method and device, storage medium and electronic device | |
| CN107622243B (en) | Unlocking control method and related product | |
| CN106161962B (en) | A kind of image processing method and terminal | |
| KR20170000128A (en) | Mobile electric document system of multiple biometric | |
| CN110866236B (en) | Private picture display method, device, terminal and storage medium | |
| CN111240482B (en) | Special effect display method and device | |
| CN102929660A (en) | Control method of mood theme of terminal device and terminal device | |
| CN111643900A (en) | Display picture control method and device, electronic equipment and storage medium | |
| CN107909011B (en) | Face recognition method and related product | |
| CN108108711B (en) | Face control method, electronic device and storage medium | |
| CN112422817B (en) | Image processing method and device | |
| CN111738735A (en) | Image data processing method and device and related equipment | |
| CN109814964B (en) | Interface display method, terminal equipment and computer readable storage medium | |
| CN106445349A (en) | Method and device for adjusting system parameters of mobile terminal and electronic equipment | |
| CN110909746A (en) | Clothing recommendation method, related device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180420 |