CN109086680A - Image processing method, device, storage medium and electronic equipment - Google Patents

Image processing method, device, storage medium and electronic equipment Download PDF

Info

Publication number
CN109086680A
CN109086680A CN201810753632.3A CN201810753632A CN109086680A CN 109086680 A CN109086680 A CN 109086680A CN 201810753632 A CN201810753632 A CN 201810753632A CN 109086680 A CN109086680 A CN 109086680A
Authority
CN
China
Prior art keywords
image
information
user
facial
age
Prior art date
Application number
CN201810753632.3A
Other languages
Chinese (zh)
Inventor
胡心洋
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to CN201810753632.3A priority Critical patent/CN109086680A/en
Publication of CN109086680A publication Critical patent/CN109086680A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00228Detection; Localisation; Normalisation
    • G06K9/00255Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00268Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00288Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K2009/00322Acquiring or recognising human faces, facial parts, facial sketches, facial expressions estimating age from face image; using age information for improving recognition

Abstract

The embodiment of the present application discloses a kind of image processing method, device, storage medium and electronic equipment;The described method includes: obtaining the original image comprising face, the facial image in original image is obtained, and predicts the age information of user according to facial image, augmented reality dummy model is generated according to age information, original image is handled according to dummy model.The embodiment of the present application can be when user takes pictures, the age information of automatic identification active user, and it is generated and the age-dependent augmented reality dummy model according to expression information, it avoids the user effort a large amount of time from being selected, improves the recommendation quality selected efficiency and promote augmented reality paster.

Description

Image processing method, device, storage medium and electronic equipment

Technical field

This application involves field of electronic devices, and in particular to a kind of image processing method, device, storage medium and electronics are set It is standby.

Background technique

With the development of terminal technology, terminal have begun from simply provided in the past verbal system become gradually one it is logical The platform run with software.The platform no longer to provide call management as the main purpose, and be to provide one include call management, Running environment including the types of applications softwares such as Entertainment, office account, mobile payment, is popularized with a large amount of, deep Enter to people's lives, the every aspect of work.

The function of terminal device is increasingly rich, and recently, most enable user's fanaticism is to shoot paster photo by terminal device. On the basis of paster photo is the photo based on head image in user's self-timer or other people shootings, increase various patterns Paster, to generate different effects.However, the application program for being attached to the camera function of paster now is more and more, the sample of paster Formula also increases increasingly, and user is caused to be difficult the paster that selection one is suitble to oneself.And after user selects paster, once it is uncomfortable Oneself is closed, can be tried to be clever only to end up with a blunder instead.

Summary of the invention

The embodiment of the present application provides a kind of image processing method, device, storage medium and electronic equipment, can be rapidly and efficiently The superiority and inferiority for contrasting algorithms of different library.

In a first aspect, the embodiment of the present application provides a kind of image processing method, comprising:

Obtain the original image comprising face;

The facial image in the original image is extracted, and predicts that the age of the user believes according to the facial image Breath;

Augmented reality dummy model is generated according to the age information;

The original image is handled according to the dummy model.

Second aspect, the embodiment of the present application also provides a kind of image processing apparatus, comprising: obtain module, prediction module, Generation module and processing module;

The acquisition module, for obtaining the original image comprising face;

The prediction module is predicted for extracting the facial image in the original image, and according to the facial image The age information of the user;

The generation module, for generating augmented reality dummy model according to the age information;

The processing module, for being handled according to the dummy model the original image.

The third aspect, the embodiment of the present application also provide a kind of storage medium, are stored thereon with computer program, the calculating The step of machine program realizes above-mentioned image processing method when being executed by processor.

Fourth aspect, the embodiment of the present application also provide a kind of electronic equipment, including memory, processor and are stored in storage On device and the computer program that can run on a processor, the processor realize above-mentioned image processing method when executing described program The step of method.

Image processing method provided by the embodiments of the present application obtains the original image comprising face first, obtains original image In facial image, and according to facial image predict user age information, according to age information generate the virtual mould of augmented reality Type is handled original image according to dummy model.The embodiment of the present application can be when user takes pictures, and automatic identification is currently used The age information at family, and according to expression information generation and the age-dependent augmented reality dummy model, avoid user effort big The time of amount is selected, and the recommendation quality selected efficiency and promote augmented reality paster is improved.

Detailed description of the invention

In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.

Fig. 1 is a kind of flow diagram of image processing method provided by the embodiments of the present application.

Fig. 2 is another flow diagram of image processing method provided by the embodiments of the present application.

Fig. 3 is a kind of schematic diagram of a scenario of image processing method provided by the embodiments of the present application.

Fig. 4 is a kind of structural schematic diagram of image processing apparatus provided by the embodiments of the present application.

Fig. 5 is another structural schematic diagram of image processing apparatus provided by the embodiments of the present application.

Fig. 6 is a kind of structural schematic diagram of electronic equipment provided by the embodiments of the present application.

Fig. 7 is another structural schematic diagram of electronic equipment provided by the embodiments of the present application.

Specific embodiment

Schema is please referred to, wherein identical component symbol represents identical component, the principle of the application is to implement one It is illustrated in computing environment appropriate.The following description be based on illustrated by the application specific embodiment, should not be by It is considered as limitation the application other specific embodiments not detailed herein.

In the following description, the specific embodiment of the application will refer to the step as performed by one or multi-section computer And symbol illustrates, unless otherwise stating clearly.Therefore, these steps and operation will have to mention for several times is executed by computer, this paper institute The computer execution of finger includes by representing with the computer processing unit of the electronic signal of the data in a structuring pattern Operation.This operation is converted at the data or the position being maintained in the memory system of the computer, reconfigurable Or in addition change the running of the computer in mode known to the tester of this field.The maintained data structure of the data For the provider location of the memory, there is the specific feature as defined in the data format.But the application principle is with above-mentioned text Word illustrates that be not represented as a kind of limitation, this field tester will appreciate that plurality of step and behaviour as described below Also it may be implemented in hardware.

The principle of the application is grasped using many other wide usages or specific purpose operation, communication environment or configuration Make.The known example suitable for the arithmetic system of the application, environment and configuration may include (but being not limited to) hold phone, Personal computer, server, multicomputer system, system, body frame configuration computer and distributed arithmetic ring based on micro computer Border, which includes any above system or devices.

It will be described in detail respectively below.

The present embodiment will be described from the angle of image processing apparatus, which specifically can integrate in electronic equipment In, which can connect the network equipment (such as smart phone, tablet computer) for mobile internet and have image processing function Electronic equipment.

Referring initially to Fig. 1, Fig. 1 is a kind of flow diagram of image processing method provided by the embodiments of the present application, including Following steps:

Step S101 obtains the original image comprising face.

Wherein, the specific implementation for choosing above-mentioned original image, can be acquisition have digital image format (such as BMP, JPG etc.) portrait photographs, for example taken pictures immediately by digital camera or mobile phone and generate portrait photographs.Those skilled in the art Will be readily apparent, can also obtain character image by modes such as video interception, photo scannings, the embodiment of the present invention to this not It is limited.

Optionally, image is the image comprising face, and electronic equipment can also be mostly used from the machine and/or other equipment Family family, which shares, obtains image in photograph album, can be also electronic equipment by image shared in other equipment, the shared image The image in photograph album is shared by multi-user family with access authority, identifies and obtains the face in the image.

Electronic equipment can receive image acquisition instruction, which can open the photographic device of electronic equipment and to current Scene obtained.For the image of acquisition, can further judge in the image with the presence or absence of face, and if it exists, then continue Current process can then be terminated if it does not exist by executing step S102.

In one embodiment, electronic equipment can be shot to obtain original image, specifically by built-in camera It may include: enabled instruction of the electronic equipment reception to built-in camera, respond the instruction and start the built-in camera, taking the photograph During picture is in the open state, by the external environment of preview area preview electronic equipment, to obtain the scene that preview is arrived Image.

In one embodiment, above-mentioned built-in camera can may be dual camera for single camera, for example, double camera shootings Head may include wide-angle camera and focal length camera, wherein can using wide-angle camera as the main camera of electronic equipment, Focal length camera is as secondary camera.When needing to shoot electronic equipment and being currently located the image of scene, which can be with It is only shot, can also be shot jointly by its wide-angle camera and focal length camera by its wide-angle imaging mould group.? It can also be three cameras etc. in other embodiments, the present invention is not further qualified this.

Step S102 extracts the facial image in original image, and the age information of user is predicted according to facial image.

If can also further determine that the target person in above-mentioned multiple personages in view of there are multiple personages in current picture Object, such as user click and choose target person, and then choose the facial image of the target person.Recognition of face can specifically be passed through Technology is chosen, and recognition of face is a kind of biological identification technology for carrying out identification based on facial feature information of people. Image or video flowing containing face, and automatic detection and tracking face in the picture are acquired with video camera or camera, in turn A series of the relevant technologies of face are carried out to the face detected, are usually also referred to as Identification of Images or face recognition etc..In addition, Above-mentioned face recognition technology can be calculated using the Adaboost (AdaptiveBoosting, adaptive to enhance) based on Haar feature Method detects the face in original image, or is detected using other algorithms to the face in original image, this reality Example is applied not limit this.

After the facial image that electronic equipment obtains in original image, the age information of the user is further predicted, than Such as face characteristic can be obtained according to above-mentioned facial image, the age information of user is then determined according to the face characteristic, wherein The age information can may be age value for age range, wherein the characteristic information of face can be the SIFT of face (Scale-Invariant Feature Transform, Scale invariant features transform) characteristic information.

Specifically, can affect to image because Image Acquisition may be limited by the external world and interference, because This needs the human face image information to the user to pre-process before extracting the face characteristic data.For example, right first The human face image information of the user carries out the processing such as gray processing, smooth, denoising to exclude illumination to the human face image information Influence;In addition, the difference that the human face image information as caused by the factors such as shooting distance, face inclination is shown, may be used also The human face image information to be normalized, because two distances are that opposite variation is the smallest in face, The position of eyes and distance can be used as the foundation of normalized;Finally again to the facial image after normalized Information is cut out and image enhancement.After completing pretreated step, the face characteristic in the human face image information is extracted, then The age information of user is determined according to the face characteristic.

Step S103 generates augmented reality dummy model according to age information.

In the age information for determining the user, it is empty that augmented reality corresponding with the age information is chosen from database Analog model, and show that the screen to electronic equipment selects addition for user in the middle.Specifically, before obtaining original image, electricity Augmented reality dummy model database can be prestored in sub- equipment, includes multiple augmented reality dummy models, and according to the age Information is classified, and is determining in original image after the age information of user, matched classification is searched in the database, And corresponding augmented reality dummy model is shown to screen.Optionally, can also after determining the age information of user, Augmented reality dummy model corresponding with the age information namely above-mentioned augmented reality dummy model can also be downloaded from network side It can obtain or be read from locally stored file from downloading on network and obtain.

With above-mentioned augmented reality dummy model for AR (Augmented Reality, augmented reality) paster for, it is subsidiary to paste The camera function of paper can be certain U.S. face camera.Wherein, after opening certain U.S. face camera, often paster is carried out according to type Summarize, according to the user's choice, the paster in each paster group is presented to user, in this process, user generally requires A large amount of paster picture is browsed, and is difficult to find the paster picture for being suitble to oneself.

The embodiment of the present application can obtain preview after opening certain U.S. face camera or opening the AR paster function of camera Facial image in image, wherein can pass through the personage's in identification prediction preview image after user opens camera function Age information exports according to age information and recommends paster.Wherein, electronic equipment can be the process by detecting the camera and be created It determines that the camera function is opened when building, can also be and be determined when receiving the broadcast message that the camera function is opened. The recommendation paster of above-mentioned output can be for one or multiple, and the pattern of paster can be dynamic paster, be also possible to quiet State paster can be used when paster is dynamic paster in recording short-sighted frequency or production dynamic picture.

Step S104 is handled original image according to dummy model.

Specifically, continuing so that dummy model is AR paster as an example, user can choose mesh in the recommendation paster of output Label paster, for example by way of click, which is added in original image by electronic equipment automatically.Implement in the application In example, if user after choosing a paster and being added in original image, again taps on and chooses other pasters, then electronics Equipment can eliminate the last paster being added in original image automatically, and the paster that user is chosen again is added to original In beginning image.

In one embodiment, user can also be detected for paster after the paster is added in original image Touch control operation, according to information such as the size positions of touch control operation local directed complete set target paster.Since paster is directly added to original The case where in beginning image, it is not high that there are precision, detail section Incomplete matching, therefore user is allowed to watch treatment effect After figure, local directed complete set manually can also be carried out to the paster being superimposed upon on original image.

In one embodiment, can by detection user be directed to paster double click operation or drag operation, to paster into Row amplification is reduced, the operation such as rotation or dragging, also by detection user to the enlargement reduction operation of the designated position of paster come The size adjustment of part is carried out to the part, specific implementation can be no longer superfluous herein according to the various operating methods of multi-point touch It states.

In one embodiment, after being handled according to dummy model the original image, can also scheme to treated As carrying out subsequent image procossing, which may include image enhancement, smoothing processing etc..For example, being handled After image, the information in image selectively can be reinforced and be inhibited, to improve the visual effect of image, or image be turned Become the form more suitable for machine processing, in order to data pick-up or identification.Such as an Image Intensified System can pass through High-pass filter protrudes the contour line of image, to enable the machine to the shape and perimeter of measurement contour line.Image enhancement skill There are many method, contrast broadening, logarithmic transformation, density stratification and histogram equalization etc. can be used in changing image tone and dash forward art Details out.

In the embodiment of the present invention, above-mentioned electronic equipment can be any electronic equipment for having image processing function, such as: Mobile phone, tablet computer (Tablet Personal Computer), laptop computer (Laptop Computer), individual digital Assistant (personal digital assistant, abbreviation PDA), mobile Internet access device (Mobile Internet Device, ) or wearable device (Wearable Device) etc. MID.

From the foregoing, it will be observed that the available original image comprising face of the embodiment of the present application, obtains the face in original image Image, and according to the age information of facial image prediction user, augmented reality dummy model is generated according to age information, according to void Analog model handles original image.The embodiment of the present application can be when user takes pictures, the age of automatic identification active user Information, and according to expression information generation and the age-dependent augmented reality dummy model, avoid the user effort a large amount of time It is selected, improves the recommendation quality selected efficiency and promote augmented reality paster.

According to the description of a upper embodiment, illustrate the image processing method of the application by further below.

Referring to Fig. 2, Fig. 2 is the flow diagram of another image processing method provided by the embodiments of the present application, the figure As the process of processing may include:

Step S201 obtains the original image that multiple include face.

Electronic equipment can receive image acquisition instruction, which can open the photographic device of electronic equipment and to current Scene obtained.For the image of acquisition, can further judge in the image with the presence or absence of face, and if it exists, then continue Current process can then be terminated if it does not exist by executing step S202.

Wherein, electronic equipment can obtain multiple image when shooting image in preview image, for example, entering After the preview interface of camera, electronic equipment can be according to current environmental parameter, every 30 milliseconds to 60 milliseconds one frame figures of acquisition Picture, and acquired image is saved in buffer queue.The buffer queue can be fixed length queue, such as the buffer queue can be with Save the newest collected 15 frame image of electronic equipment.After receiving the photographing instruction of user, from buffer queue obtain with It takes pictures moment immediate multiple image.

Step S202 extracts the facial image in multiple original images.

As shown in figure 3, Fig. 3 is a kind of schematic diagram of a scenario of image processing method provided by the embodiments of the present application.Obtain electricity Sub- equipment is currently located in the image of scene comprising multiple elements such as trees, cloud, personages, can be determined first in the image Personage may then pass through the facial image that recognition of face further obtains the personage.

If can also further determine that the target person in above-mentioned multiple personages in view of there are multiple personages in current picture Object, such as user click and choose target person, and then choose the facial image of the target person.Recognition of face can specifically be passed through Technology is chosen.

Multiple facial images are separately input in preset neural network prediction model by step S203, to be used Multiple prediction age values at family.

Wherein, above-mentioned neural network model (NeuralNetwork, NN) is a kind of number for simulating the practical neural network of the mankind According to model, it is the complex networks system for widely being interconnected by a large amount of, simple processing unit and being formed, and can also be managed Solution is a highly complex non-linear dynamic learning system, the superiority with self-learning function.For example, realizing image recognition When, only formerly in many different pictures and corresponding knowledge another characteristic (recognition result) input model, model will pass through Self-learning function, what is obtained is a series of for predicting the new feature of output variable.

In one embodiment, before predicting age value, above-mentioned neural network model can also be trained, such as will Multiple groups facial image is learnt as sample set input training pattern with the Optimal Parameters of the prediction model after being trained simultaneously Prediction model is generated, wherein the above-mentioned facial image for being used as sample set can also carry age information, then by multiple above-mentioned people Face image is separately input in prediction model, to obtain multiple prediction age values of user.

Step S204 calculates target age value according to multiple prediction age values.

By predicting multiple facial images of user and exporting multiple prediction age values respectively, then calculating average value is Target age value can further promote the accuracy of age value prediction.

In one embodiment, the application can also obtain face characteristic according to above-mentioned facial image, then according to the face Feature determines the age value of user, for example, can prestore facial feature database in electronic equipment, includes in the database Mapping relations between multiple face characteristics and age value, after getting face characteristic, in above-mentioned mapping relations search with The corresponding age value of the face characteristic.Namely the facial image in the extraction original image, and it is pre- according to the facial image The age information for surveying the user, specifically includes:

It extracts the facial image in the original image and obtains the facial feature information in the facial image;

It is searched and the matched age value of the facial feature information in face feature database.

In one embodiment, to promote matching efficiency, the gender of user further can also be first determined according to face characteristic, Then the corresponding face characteristic sample of the gender need to be only searched in database.Namely in face feature database It searches and the matched age value of the facial feature information, comprising:

The gender of user is determined according to the facial feature information;

It is searched in the face feature database according to the gender and the facial feature information matched age Value.

Step S205 generates augmented reality dummy model according to target age value.

In the age information for determining the user, it is empty that augmented reality corresponding with the age information is chosen from database Analog model, and show that the screen to electronic equipment selects addition for user in the middle.Specifically, before obtaining original image, electricity Augmented reality dummy model database can be prestored in sub- equipment, includes multiple augmented reality dummy models, and according to the age Information is classified, and is determining in original image after the age information of user, matched classification is searched in the database, And corresponding augmented reality dummy model is shown to screen.

Step S206 obtains location information of the facial image in original image.

In an embodiment, one can be chosen in multiple above-mentioned original graph images and is used as target original image, The higher conduct target original image of a clarity can specifically be chosen can also be according to other in other embodiments Parameter chosen, for example brightness, acutance of image etc. can also be chosen manually by user, the application to this not It is further qualified.

Step S207 obtains the attribute information of dummy model.

Wherein, the attribute information of above-mentioned dummy model may include the characteristic point of dummy model, by taking AR paster as an example, the spy Sign point can be a position for face corresponding to AR paster, than if any AR paster need to be placed on user on the face, some AR pasters The lower of user need to be placed on, and some AR pasters then need to be placed on the head of user etc..

Step S208 closes dummy model and original image according to the attribute information of location information and dummy model At.

For example, user can be by way of click, the AR paster chosen is added to original image automatically by electronic equipment Corresponding position in the middle.In the embodiment of the present application, if user is after choosing a paster and being added in original image, then Other pasters are chosen in secondary click, then electronic equipment can eliminate the last paster being added in original image automatically, and The paster that user is chosen again is added in original image.

In one embodiment, user can also be detected for paster after the paster is added in original image Touch control operation, according to information such as the size positions of touch control operation local directed complete set target paster.Since paster is directly added to original The case where in beginning image, it is not high that there are precision, detail section Incomplete matching, therefore user is allowed to watch treatment effect After figure, local directed complete set manually can also be carried out to the paster being superimposed upon on original image

In the embodiment of the present invention, above-mentioned electronic equipment can be any electronic equipment for having image processing function, such as: Mobile phone, tablet computer (Tablet Personal Computer), laptop computer (Laptop Computer), individual digital Assistant (personal digital assistant, abbreviation PDA), mobile Internet access device (Mobile Internet Device, ) or wearable device (Wearable Device) etc. MID.

From the foregoing, it will be observed that multiple available original graphs comprising face of image processing method provided by the embodiments of the present application Picture extracts the facial image in multiple original images, multiple facial images are separately input to preset neural network prediction mould In type, to obtain multiple prediction age values of user, target age value is calculated according to multiple prediction age values, according to target year Age value generates augmented reality dummy model, obtains location information of the facial image in original image, obtains dummy model Attribute information synthesizes dummy model and original image according to the attribute information of location information and dummy model.This Shen Please embodiment can be when user takes pictures, the age information of automatic identification active user, and according to expression information generate with the year Age relevant augmented reality dummy model, avoids the user effort a large amount of time from being selected, improves and select efficiency and mention Rise the recommendation quality of augmented reality paster.

For the ease of better implementation image processing method provided by the embodiments of the present application, the embodiment of the present application also provides A kind of device based on above-mentioned image processing method.Wherein the meaning of noun is identical with above-mentioned image processing method, specific real Existing details can be with reference to the explanation in embodiment of the method.

Referring to Fig. 4, Fig. 4 is a kind of structural schematic diagram of image processing apparatus provided by the embodiments of the present application, the image Processing unit 30 includes: to obtain module 301, prediction module 302, generation module 303 and processing module 304;

The acquisition module 301, for obtaining the original image comprising face;

The prediction module 302, for extracting the facial image in the original image, and it is pre- according to the facial image Survey the age information of the user;

The generation module 303, for generating augmented reality dummy model according to the age information;

The processing module 304, for being handled according to the dummy model the original image.

In one embodiment, as shown in figure 5, the prediction module 302, may include: extracting sub-module 3021 and prediction Submodule 3022;

The extracting sub-module 3021, for extracting the facial image in the original image;

The prediction submodule 3022, works as the facial image to be input to preset neural network prediction model In, to obtain the prediction age value of the user.

In one embodiment, above-mentioned processing module 304 may include: position acquisition submodule 3041, attribute acquisition submodule Block 3042 and synthesis submodule 3043;

The position acquisition submodule 3041, for obtaining position letter of the facial image in the original image Breath;

The attribute acquisition submodule 3042, for obtaining the attribute information of the dummy model;

The synthesis submodule 3043, for according to the positional information and the attribute information of the dummy model is by institute Dummy model is stated to be synthesized with the original image.

From the foregoing, it will be observed that the available original image comprising face of image processing apparatus 30 provided by the embodiments of the present application, The facial image in original image is obtained, and predicts the age information of user according to facial image, is generated and is increased according to age information Strong virtual reality model, is handled original image according to dummy model.The embodiment of the present application can be when user takes pictures, certainly The age information of dynamic identification active user, and according to expression information generation and the age-dependent augmented reality dummy model, it keeps away Exempt from the user effort a large amount of time to be selected, improves the recommendation quality selected efficiency and promote augmented reality paster.

The application also provides a kind of storage medium, is stored thereon with computer program, which is characterized in that the computer journey The image processing method that implementation method embodiment provides when sequence is executed by processor.

The application also provides a kind of electronic equipment, including memory, and processor and storage on a memory and can handled The computer program run on device, which is characterized in that implementation method embodiment provides when the processor executes described program Image processing method.

A kind of electronic equipment is also provided in the another embodiment of the application, which can be smart phone, plate Apparatus such as computer.As shown in fig. 6, electronic equipment 400 includes processor 401, memory 402.Wherein, processor 401 and storage Device 402 is electrically connected.

Processor 401 is the control centre of electronic equipment 400, utilizes various interfaces and the entire electronic equipment of connection Various pieces by the application program of operation or load store in memory 402, and are called and are stored in memory 402 Data, execute electronic equipment various functions and processing data, thus to electronic equipment carry out integral monitoring.

In the present embodiment, processor 401 in electronic equipment 400 can according to following step, by one or one with On the corresponding instruction of process of application program be loaded into memory 402, and be stored in memory by processor 401 to run Application program in 402, to realize various functions:

Obtain the original image comprising face;

The facial image in the original image is extracted, and predicts that the age of the user believes according to the facial image Breath;

Augmented reality dummy model is generated according to the age information;

The original image is handled according to the dummy model.

Referring to Fig. 7, Fig. 7 is electronic devices structure schematic diagram provided by the embodiments of the present application.The electronic equipment 500 can be with Including radio frequency (RF, Radio Frequency) circuit 501, include one or more computer readable storage medium Memory 502, input unit 503, display unit 504, sensor 504, voicefrequency circuit 506, Wireless Fidelity (WiFi, Wireless Fidelity) module 507, include one or more than one the processor 508 and power supply of processing core 509 equal components.It will be understood by those skilled in the art that electronic devices structure shown in Fig. 7 is not constituted to electronic equipment It limits, may include perhaps combining certain components or different component layouts than illustrating more or fewer components.

Radio circuit 501 can be used for receiving and sending messages or communication process in signal send and receive, particularly, by base station Downlink information receive after, transfer to one or more than one processor 508 processing;In addition, the data for being related to uplink are sent To base station.In general, radio circuit 501 includes but is not limited to antenna, at least one amplifier, tuner, one or more oscillations Device, subscriber identity module (SIM, Subscriber Identity Module) card, transceiver, coupler, low noise amplification Device (LNA, Low Noise Amplifier), duplexer etc..In addition, radio circuit 501 can also by wireless communication with network It is communicated with other equipment.Any communication standard or agreement, including but not limited to global mobile communication can be used in the wireless communication System (GSM, Global System of Mobile communication), general packet radio service (GPRS, General Packet Radio Service), CDMA (CDMA, Code Division Multiple Access), wideband code division it is more Location (WCDMA, Wideband Code Division Multiple Access), long term evolution (LTE, Long Term Evolution), Email, short message service (SMS, Short Messaging Service) etc..

Memory 502 can be used for storing application program and data.It include that can hold in the application program that memory 502 stores Line code.Application program can form various functional modules.Processor 508 is stored in the application journey of memory 502 by operation Sequence, thereby executing various function application and data processing.Memory 502 can mainly include storing program area and storing data Area, wherein storing program area can application program needed for storage program area, at least one function (such as sound-playing function, Image player function etc.) etc.;Storage data area, which can be stored, uses created data (such as audio number according to electronic equipment According to, phone directory etc.) etc..In addition, memory 502 may include high-speed random access memory, it can also include non-volatile deposit Reservoir, for example, at least a disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memory 502 can also include Memory Controller, to provide the access of processor 508 and input unit 503 to memory 502.

Input unit 503 can be used for receiving number, character information or the user's characteristic information (such as fingerprint) of input, and Generate keyboard related with user setting and function control, mouse, operating stick, optics or trackball signal input.Specifically Ground, in a specific embodiment, input unit 503 may include touch sensitive surface and other input equipments.Touch sensitive surface, Referred to as touch display screen or Trackpad, collect user on it or nearby touch operation (such as user using finger, touching The operations of any suitable object or attachment on touch sensitive surface or near touch sensitive surface such as pen), and according to preset Formula drives corresponding attachment device.Optionally, touch sensitive surface may include both touch detecting apparatus and touch controller. Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, transmit a signal to touch Controller;Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processing Device 508, and order that processor 508 is sent can be received and executed.

Display unit 504 can be used for showing information input by user or the information and electronic equipment that are supplied to user Various graphical user interface, these graphical user interface can be made of figure, text, icon, video and any combination thereof. Display unit 504 may include display panel.Optionally, liquid crystal display (LCD, Liquid Crystal can be used Display), the forms such as Organic Light Emitting Diode (OLED, Organic Light-Emitting Diode) configure display surface Plate.Further, touch sensitive surface can cover display panel, after touch sensitive surface detects touch operation on it or nearby, Processor 508 is sent to determine the type of touch event, is followed by subsequent processing device 508 according to the type of touch event in display panel It is upper that corresponding visual output is provided.Although touch sensitive surface and display panel are realized as two independent components in Fig. 7 Input and input function, but in some embodiments it is possible to it is touch sensitive surface and display panel is integrated and realize and input and defeated Function out.

Electronic equipment may also include at least one sensor 505, such as optical sensor, motion sensor and other sensings Device.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel, and proximity sensor can close display surface when electronic equipment is moved in one's ear Plate and/or backlight.As a kind of motion sensor, gravity accelerometer can detect in all directions (generally three axis) The size of acceleration can detect that size and the direction of gravity when static, the application that can be used to identify mobile phone posture is (such as vertical and horizontal Shield switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.;As for electronics Gyroscope, barometer, hygrometer, thermometer, infrared sensor that equipment can also configure etc..

Voicefrequency circuit 506 can provide the audio interface between user and electronic equipment by loudspeaker, microphone.Audio-frequency electric The audio data received can be converted into electric signal by road 506, be transferred to loudspeaker, and it is defeated to be converted to voice signal by loudspeaker Out;On the other hand, the voice signal of collection is converted to electric signal by microphone, is converted to audio after being received by voicefrequency circuit 506 Data, then by after the processing of audio data output processor 508, such as another electronic equipment is sent to through radio circuit 501, or Person exports audio data to memory 502 to be further processed.Voicefrequency circuit 506 is also possible that earphone jack, to mention For the communication of peripheral hardware earphone and electronic equipment.

Wireless Fidelity (WiFi) belongs to short range wireless transmission technology, and electronic equipment can be with by wireless fidelity module 507 Help user to send and receive e-mail, browse webpage and access streaming video etc., it provides wireless broadband internet for user Access.Although Fig. 7 shows wireless fidelity module 507, but it is understood that, and it is not belonging to the necessary structure of electronic equipment At can according to need within the scope of not changing the essence of the invention and omit completely.

Processor 508 is the control centre of electronic equipment, utilizes each of various interfaces and the entire electronic equipment of connection A part by running or execute the application program being stored in memory 502, and is called and is stored in memory 502 Data execute the various functions and processing data of electronic equipment, to carry out integral monitoring to electronic equipment.Optionally, it handles Device 508 may include one or more processing cores;Preferably, processor 508 can integrate application processor and modulation /demodulation processing Device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is mainly located Reason wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 508.

Electronic equipment further includes the power supply 509 (such as battery) powered to all parts.Preferably, power supply can pass through electricity Management system and processor 508 are logically contiguous, to realize management charging, electric discharge and power consumption by power-supply management system The functions such as management.Power supply 509 can also include one or more direct current or AC power source, recharging system, power supply event Hinder the random components such as detection circuit, power adapter or inverter, power supply status indicator.

Although being not shown in Fig. 7, electronic equipment can also include camera, bluetooth module etc., and details are not described herein.

When it is implemented, the above modules can be used as independent entity to realize, any combination can also be carried out, is made It is realized for same or several entities, the specific implementation of the above modules can be found in the embodiment of the method for front, herein not It repeats again.

It should be noted that those of ordinary skill in the art will appreciate that whole in the various methods of above-described embodiment or Part steps are relevant hardware can be instructed to complete by program, which can store in computer-readable storage medium It in matter, is such as stored in the memory of terminal, and is executed by least one processor in the terminal, can be wrapped in the process of implementation Include the process of the embodiment such as image processing method.Wherein, storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc..

A kind of image processing method provided by the embodiments of the present application, device, storage medium and electronic equipment are carried out above It being discussed in detail, each functional module can integrate in a processing chip, and it is also possible to modules and physically exists alone, It can also be integrated in two or more modules in a module.Above-mentioned integrated module both can take the form of hardware reality It is existing, it can also be realized in the form of software function module.Used herein principle and implementation of the specific case to the application Mode is expounded, the description of the example is only used to help understand the method for the present application and its core ideas;Meanwhile For those skilled in the art, according to the thought of the application, change is had in specific embodiments and applications Place, in conclusion the contents of this specification should not be construed as limiting the present application.

Claims (11)

1. a kind of image processing method is applied to electronic equipment, which comprises the following steps:
Obtain the original image comprising face;
The facial image in the original image is extracted, and predicts the age information of the user according to the facial image;
Augmented reality dummy model is generated according to the age information;
The original image is handled according to the dummy model.
2. image processing method according to claim 1, which is characterized in that extract the face figure in the original image Picture, and predict according to the facial image age information of the user, comprising:
Extract the facial image in the original image;
The facial image is input in preset neural network prediction model, to obtain the prediction age of the user Value.
3. image processing method according to claim 2, which is characterized in that the original image comprising face is more ?;
The facial image is input in preset neural network prediction model, to obtain the prediction age of the user Value, comprising:
Multiple described facial images are separately input in preset neural network prediction model, to obtain the more of the user A prediction age value;
Target age value is calculated according to the multiple prediction age value.
4. image processing method according to claim 1, which is characterized in that extract the face figure in the original image Picture, and predict according to the facial image age information of the user, comprising:
It extracts the facial image in the original image and obtains the facial feature information in the facial image;
It is searched and the matched age value of the facial feature information in face feature database.
5. image processing method according to claim 4, which is characterized in that lookup and institute in face feature database State the matched age value of facial feature information, comprising:
The gender of user is determined according to the facial feature information;
It is searched in the face feature database according to the gender and the matched age value of the facial feature information.
6. image processing method according to claim 1, which is characterized in that according to the dummy model to the original graph As being handled, comprising:
Obtain location information of the facial image in the original image;
Obtain the attribute information of the dummy model;
According to the positional information and the attribute information of the dummy model by the dummy model and the original image into Row synthesis.
7. a kind of image processing apparatus, which is characterized in that described device include: obtain module, prediction module, generation module and Processing module;
The acquisition module, for obtaining the original image comprising face;
The prediction module, for extracting the facial image in the original image, and according to facial image prediction The age information of user;
The generation module, for generating augmented reality dummy model according to the age information;
The processing module, for being handled according to the dummy model the original image.
8. image processing apparatus according to claim 7, which is characterized in that the prediction module, comprising: extracting sub-module With prediction submodule;
The extracting sub-module, for extracting the facial image in the original image;
The prediction submodule, for the facial image to be input in preset neural network prediction model, to obtain The prediction age value of the user.
9. image processing apparatus according to claim 7, which is characterized in that the processing module, comprising: position acquisition Module, attribute acquisition submodule and synthesis submodule;
The position acquisition submodule, for obtaining location information of the facial image in the original image;
The attribute acquisition submodule, for obtaining the attribute information of the dummy model;
The synthesis submodule, for according to the positional information and the attribute information of the dummy model is by the virtual mould Type is synthesized with the original image.
10. a kind of storage medium, is stored thereon with computer program, which is characterized in that the computer program is held by processor It is realized when row such as the step of any one of claim 1-6 the method.
11. a kind of electronic equipment, including memory, processor and storage are on a memory and the calculating that can run on a processor Machine program, which is characterized in that the processor realizes the step such as any one of claim 1-6 the method when executing described program Suddenly.
CN201810753632.3A 2018-07-10 2018-07-10 Image processing method, device, storage medium and electronic equipment CN109086680A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810753632.3A CN109086680A (en) 2018-07-10 2018-07-10 Image processing method, device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810753632.3A CN109086680A (en) 2018-07-10 2018-07-10 Image processing method, device, storage medium and electronic equipment

Publications (1)

Publication Number Publication Date
CN109086680A true CN109086680A (en) 2018-12-25

Family

ID=64837524

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810753632.3A CN109086680A (en) 2018-07-10 2018-07-10 Image processing method, device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN109086680A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110008926A (en) * 2019-04-15 2019-07-12 北京字节跳动网络技术有限公司 The method and apparatus at age for identification

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7912246B1 (en) * 2002-10-28 2011-03-22 Videomining Corporation Method and system for determining the age category of people based on facial images
US20120308087A1 (en) * 2011-05-31 2012-12-06 Hui Chao System and method for determining estimated age using an image collection
US20120314957A1 (en) * 2011-06-13 2012-12-13 Sony Corporation Information processing apparatus, information processing method, and program
CN104899920A (en) * 2015-05-25 2015-09-09 联想(北京)有限公司 Image processing method, image processing device and electronic device
US20150332087A1 (en) * 2014-05-15 2015-11-19 Fuji Xerox Co., Ltd. Systems and Methods for Identifying a User's Demographic Characteristics Based on the User's Social Media Photographs
CN105404848A (en) * 2014-09-05 2016-03-16 欧姆龙株式会社 Identification apparatus and method for controlling identification apparatus
CN105827930A (en) * 2015-05-27 2016-08-03 广东维沃软件技术有限公司 Method and device of auxiliary photographing
CN106210545A (en) * 2016-08-22 2016-12-07 北京金山安全软件有限公司 A kind of video capture method, device and electronic equipment
CN107347138A (en) * 2017-06-30 2017-11-14 广东欧珀移动通信有限公司 Image processing method, device, storage medium and terminal
CN107959790A (en) * 2017-11-15 2018-04-24 维沃移动通信有限公司 A kind of image capturing method, device and mobile terminal
CN108229269A (en) * 2016-12-31 2018-06-29 深圳市商汤科技有限公司 Method for detecting human face, device and electronic equipment
CN108257200A (en) * 2018-02-01 2018-07-06 广东欧珀移动通信有限公司 A kind of method, apparatus and computer readable storage medium for handling photo moulding

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7912246B1 (en) * 2002-10-28 2011-03-22 Videomining Corporation Method and system for determining the age category of people based on facial images
US20120308087A1 (en) * 2011-05-31 2012-12-06 Hui Chao System and method for determining estimated age using an image collection
US20120314957A1 (en) * 2011-06-13 2012-12-13 Sony Corporation Information processing apparatus, information processing method, and program
US20150332087A1 (en) * 2014-05-15 2015-11-19 Fuji Xerox Co., Ltd. Systems and Methods for Identifying a User's Demographic Characteristics Based on the User's Social Media Photographs
CN105404848A (en) * 2014-09-05 2016-03-16 欧姆龙株式会社 Identification apparatus and method for controlling identification apparatus
CN104899920A (en) * 2015-05-25 2015-09-09 联想(北京)有限公司 Image processing method, image processing device and electronic device
CN105827930A (en) * 2015-05-27 2016-08-03 广东维沃软件技术有限公司 Method and device of auxiliary photographing
CN106210545A (en) * 2016-08-22 2016-12-07 北京金山安全软件有限公司 A kind of video capture method, device and electronic equipment
CN108229269A (en) * 2016-12-31 2018-06-29 深圳市商汤科技有限公司 Method for detecting human face, device and electronic equipment
CN107347138A (en) * 2017-06-30 2017-11-14 广东欧珀移动通信有限公司 Image processing method, device, storage medium and terminal
CN107959790A (en) * 2017-11-15 2018-04-24 维沃移动通信有限公司 A kind of image capturing method, device and mobile terminal
CN108257200A (en) * 2018-02-01 2018-07-06 广东欧珀移动通信有限公司 A kind of method, apparatus and computer readable storage medium for handling photo moulding

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110008926A (en) * 2019-04-15 2019-07-12 北京字节跳动网络技术有限公司 The method and apparatus at age for identification

Similar Documents

Publication Publication Date Title
RU2626090C2 (en) Method, device and terminal device for processing image
CN103632165B (en) A kind of method of image procossing, device and terminal device
CN103871051B (en) Image processing method, device and electronic equipment
US10484673B2 (en) Wearable device and method for providing augmented reality information
KR102022444B1 (en) Method for synthesizing valid images in mobile terminal having multi camera and the mobile terminal therefor
EP2942705A1 (en) Method and device for controlling multiple displays
KR20150125472A (en) Voice command providing method and apparatus
EP3107270B1 (en) Electronic device with foldable display areas
CN105096241A (en) Face image beautifying device and method
CN103414814A (en) Picture processing method and device and terminal device
US10181203B2 (en) Method for processing image data and apparatus for the same
WO2018219072A1 (en) Image blurring method, electronic device and computer readable storage medium
CN104135609B (en) Auxiliary photo-taking method, apparatus and terminal
CN103702297B (en) Short message enhancement, apparatus and system
CN107124555B (en) Method and device for controlling focusing, computer equipment and computer readable storage medium
WO2016019926A1 (en) Photo shooting method, device, and mobile terminal
US10277804B2 (en) Method and terminal for acquiring panoramic image
US20160247034A1 (en) Method and apparatus for measuring the quality of an image
CN108141518A (en) Camera model with stabilizer and the electronic equipment including the camera model
RU2615679C2 (en) Method, device and terminal for forming thumbnail image
US10244177B2 (en) Method for processing image to generate relevant data based on user inputs and electronic device supporting the same
TWI660309B (en) Fingerprint collection method and related products
CN106856543B (en) Picture display method and device and mobile terminal
CN104717125B (en) Graphic code store method and device
EP3454255A1 (en) Facial recognition method and related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination