CN114222995A

CN114222995A - Image processing method and device and electronic equipment

Info

Publication number: CN114222995A
Application number: CN201980099144.8A
Authority: CN
Inventors: 孙安辉
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd; Shenzhen Huantai Technology Co Ltd
Priority date: 2019-10-25
Filing date: 2019-10-25
Publication date: 2022-03-22
Also published as: WO2021077426A1

Abstract

The embodiment of the application discloses an image processing method and device and electronic equipment. The method comprises the following steps: acquiring relationship information of a plurality of photographic objects; processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and outputting the processed image. Therefore, in the process of processing the images comprising the plurality of photographic objects, the relationship information of the plurality of photographic objects can be automatically acquired first, and then the images are processed based on the relationship information, so that the processed images can reflect the relationship of the plurality of photographic objects, the intelligent degree in the processing process is further improved, and the user experience is also improved.

Description

Image processing method and device and electronic equipment

Technical Field

The present application belongs to the field of image processing technologies, and in particular, to an image processing method, system, apparatus, electronic device, and storage medium.

Background

As more electronic devices are configured with cameras, more users prefer to take pictures with electronic device configured cameras. And, for the image obtained by taking a picture, further processing can be carried out to meet the requirements of users. However, in the related image processing process, the user experience of the processing method for the photographic subject still needs to be improved.

Disclosure of Invention

In view of the above problems, the present application proposes an image processing method, an apparatus, an electronic device, and a storage medium to achieve an improvement of the above problems.

In a first aspect, an embodiment of the present application provides an image processing method, which is applied to an electronic device, and the method includes: acquiring relationship information of a plurality of photographic objects; processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and outputting the processed image.

In a second aspect, an embodiment of the present application provides an image processing apparatus, including: an information acquisition unit configured to acquire relationship information of a plurality of photographic subjects; the image processing unit is used for processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and the image output unit is used for outputting the processed image.

In a third aspect, an embodiment of the present application provides an electronic device, including one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods described above.

In a fourth aspect, the present application provides a computer-readable storage medium, in which a program code is stored, wherein the program code performs the above-mentioned method when running.

The embodiment of the application provides a method, a system, a device, electronic equipment and a storage medium for image processing, wherein firstly, relationship information of a plurality of photographic objects is obtained; processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and outputting the processed image. Therefore, in the process of processing the images comprising the plurality of photographic objects, the relationship information of the plurality of photographic objects can be automatically acquired first, and then the images are processed based on the relationship information, so that the processed images can reflect the relationship of the plurality of photographic objects, the intelligent degree in the processing process is further improved, and the user experience is also improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a flowchart illustrating an image processing method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a scene of an image process proposed in an embodiment of the present application;

FIG. 3 is a flow chart illustrating a method of image processing according to another embodiment of the present application;

FIG. 4 is a schematic diagram of an image processing scene according to another embodiment of the present application;

FIG. 5 is a schematic diagram of an image processing scene according to another embodiment of the present application;

FIG. 6 is a flow chart illustrating an image processing method according to yet another embodiment of the present application;

FIG. 7 is a diagram illustrating a scene of image processing according to yet another embodiment of the present application;

FIG. 8 is a flow chart illustrating an image processing method according to yet another embodiment of the present application;

fig. 9 is a block diagram showing a configuration of an image processing apparatus according to an embodiment of the present application;

fig. 10 is a block diagram showing a structure of an information acquisition unit according to an embodiment of the present application;

fig. 11 is a block diagram showing a configuration of an image processing apparatus according to an embodiment of the present application;

fig. 12 is a block diagram showing a configuration of an image processing apparatus according to still another embodiment of the present application;

fig. 13 is a block diagram showing a configuration of an electronic device for executing an image processing method according to an embodiment of the present application in real time;

fig. 14 shows a storage unit for storing or carrying program codes for implementing the image processing method according to the embodiment of the present application in real time.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Modern people who love life like recording life with a camera, and especially some people like taking photos by themselves or by two or more people. For example, when traveling or at appointments, people often take a camera to record nice moments, which is a popular and active upward lifestyle. However, sometimes, some outsiders are confused when taking a picture, for example, two couples or two brothers are supposed to take a picture, and only the images of two people are supposed to be kept, but the outsiders are confused when taking a picture, so that the picture looks not perfect, and at this time, people often choose to process the picture.

In the research of the inventor on the process of the related image processing, it is found that the user often performs the chartlet processing or adds special effects such as mosaics to the image including the photographic subject, and in the processing, because the user performs the operation manually, the electronic device does not acquire the relationship among a plurality of photographic subjects in the photographic process. For this related approach, the inventors found not only to be inefficient, but also the user experience was also poor.

Therefore, the inventor proposes that in the process of processing the image including the plurality of photographic objects in the application, the relationship information of the plurality of photographic objects can be automatically acquired first, and then the image processing is performed based on the relationship information, so that the processed image can reflect the relationship of the plurality of photographic objects, the intelligent degree in the processing process is further improved, and the user experience is also improved.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Referring to fig. 1, an image processing method provided in an embodiment of the present application is applied to an electronic device, and the method includes:

step S110: relationship information of a plurality of photographic subjects is acquired.

Wherein the relationship information is used to characterize how the relationship between the plurality of photographic subjects is. As one mode, the relationship information between the photo-objects may include a lover relationship, a parent-child/parent-child relationship, a classmate relationship, a relatives relationship, a classmates relationship, and the like, and may also be understood as a stranger relationship between the photo-objects.

Optionally, first, relationship information between the photo-objects needs to be established, and the relationship information may identify the relationship information between the photo-objects according to some features between the photo-objects. For example, the electronic device may evaluate the relationship information of the plurality of photographic subjects by gesture actions between the plurality of photographic subjects. For example, if the electronic device recognizes gestures such as a handle, a hand-pulling, a kiss, and a hug among a plurality of photographic subjects, the electronic device can recognize that the relationship among the plurality of photographic subjects is a lover relationship, and the generated content is relationship information of the lover relationship. In addition, for example, if the photographed objects are in a lover relationship with each other, the relationship information can be established by performing intimacy assessment through postures such as hand-drawing, hand-pulling, kissing, hugging and the like.

Step S120: and processing the images comprising the plurality of photographic objects based on the relationship information to obtain the processed images representing the relationship of the plurality of photographic objects.

As one way, in the photographing process, the image of the plurality of photographic subjects including the recognized relationship information may be subjected to blurring processing or mapping processing, so that the relationship between the plurality of photographic subjects may be embodied for the processed image including the plurality of photographic subjects. For example, when lovers have a date, strangers who are not aware often get together to get a match, and in order to avoid the problem, after the electronic device recognizes that two persons are in a lovers relationship, a map is automatically added to the strangers.

Illustratively, as shown in fig. 2, the electronic device detects that there are three photo-objects in the photo-interface, and the electronic device performs face recognition on the photo-objects first to identify a first face image 101, a second face image 102 and a third face image 103. Further, the electronic device detects that a pull action 104 exists between the photo-object corresponding to the first face image 101 and the photo-object corresponding to the second face image 102, and the photo-object corresponding to the third face image 103 and the photo-object corresponding to the first face image 101 and the photo-object corresponding to the second face image 102 do not make the pull action 104, so that the electronic device establishes the relationship information between the photo-object corresponding to the first face image 101 and the photo-object corresponding to the second face image 102 as a lover relationship according to the identified pull action 104.

Step S130: and outputting the processed image.

In the embodiment of the present application, outputting the processed image may be understood as displaying the processed image, or may be understood as directly sending the processed image to a specified terminal device.

The embodiment of the application provides an image processing method, which comprises the steps of firstly, obtaining relationship information of a plurality of photographic objects; processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and outputting the processed image. Therefore, in the process of processing the images comprising the plurality of photographic objects, the relationship information of the plurality of photographic objects can be automatically acquired first, and then the images are processed based on the relationship information, so that the processed images can reflect the relationship of the plurality of photographic objects, the intelligent degree in the processing process is further improved, and the user experience is also improved.

Referring to fig. 3, an image processing method provided in the embodiment of the present application is applied to an electronic device, and the method includes:

step S210: face recognition is carried out on a plurality of photographic subjects to detect whether relationship information of the photographic subjects is stored.

As a mode, in a user photographing stage, face recognition may be performed on a plurality of photographing objects first, so that the electronic device detects whether relationship information corresponding to the photographing objects is stored in the electronic device database, and if the electronic device detects that the relationship information data of the photographing objects is stored, relationship information between the photographing objects is not re-established.

Step S220: and if the electronic equipment does not detect that the relational information data of the photographic objects are stored in the electronic equipment database, establishing the relational information of the plurality of photographic objects according to the preset conditions.

It should be noted that, as a way of establishing relationship information of a plurality of photographic subjects, a user of the electronic device may configure a mapping relationship between the gesture motion and the relationship information in advance. So that the electronic equipment can take some gesture actions of the user as preset conditions for establishing the relation information of the photographing object. In the process of photographing by a user, the photographed object makes gesture actions as preset conditions, the electronic equipment establishes relationship information among a plurality of photographed objects according to the recognized gesture actions, and the relationship information corresponding to different gesture actions is different.

For example, the gesture action of the electronic device for recognizing the photo-object of the lovers relationship may be to draw the hand or to catch the kiss; the gesture actions of the electronic equipment for recognizing the photo-object in the parent-child relationship can be hand-pulling, kissing and holding. It should be noted that, when the electronic device identifies the relationship between the father and the son as well as the mother and the son, firstly, the electronic device performs face identification on the photographed object, and determines whether the photographed object is a young friend or an adult according to parameters such as height, face appearance characteristics and the like of the photographed object.

For example, when the electronic device detects that there are height differences among several photographic subjects, the electronic device determines the ages of the photographic subjects according to the identified heights and facial features of the photographic subjects, and then identifies the relationship information among the photographic subjects according to the posture actions among the photographic subjects after determining the ages of the photographic subjects.

As shown in fig. 4, the electronic device detects three photo-objects in the photo-interface, first, the electronic device detects a first photo-object 201, a second photo-object 202, a third photo-object 203 and face images corresponding to the three photo-objects, and detects a hand-pulling action 204 between the first photo-object 201 and the second photo-object 202, the electronic device can recognize that the first photo-object 201 and the second photo-object 202 are adults, the third photo-object 203 is a girl according to the detected heights and face images of the first photo-object 201, the second photo-object 201, the third photo-object 203, and determine that the relationship information between the second photo-object 202 and the third photo-object 203 is a mother-girl relationship according to the hand-pulling action 204 between the second photo-object 202 and the third photo-object 203.

As another way to establish relationship information of a plurality of photographic subjects, a user of the electronic device may configure a mapping relationship between the gesture motion and the relationship information in advance. So that the electronic equipment can establish the relation information of the photographic subject by combining the scene depth information of the photographic subject and the gesture action of the photographic subject. For example, the electronic device detects that the scene depth information of the face image of the photographic subject a is the same as the scene depth information of the face image of the photographic subject B in the photographic interface, and the depth information of the pose motions of the photographic subject a and the photographic subject B is also the same, so that the relationship between the photographic subject a and the photographic subject B can be set as the relationship information corresponding to the pose motions. The method for combining the scene depth information of the photographic subject with the preset mapping relation between the gesture action of the photographic subject and the relation information improves the accuracy of the electronic equipment system in recognizing the relation information. Further, the distance between the face image of the photographic subject and the posture movement of the recognition relationship information may be one of the ways of determining the relationship information of the photographic subject.

It should be noted that, when the subject selects to take a picture, the subject may be a friend or a colleague familiar with the past, or may be a person who just knows, so that it is often necessary to establish relationship information with a new friend. Since the electronic device has not previously stored the relationship information between the photo subjects, the photo subjects can manually add new relationship information on the electronic device.

When the photographic objects select to add the relationship information manually, the plurality of photographic objects make the same gesture at the same time, the electronic equipment is triggered to pop up a preset relationship information option list to enable the photographic objects to select the relationship information, and the electronic equipment takes the relationship information selected by the photographic objects as the relationship information of the photographic objects. The storage data of the electronic equipment database can be updated in time by manually adding new relation information to the photo object, so that the experience of photographing after the same photo object is taken is improved.

As shown in fig. 5, when the electronic device detects that a plurality of photo-objects simultaneously perform the same action, the electronic device pops up a relationship information option for the user to select. For example, when the electronic device recognizes the gesture, a relationship information option box 300 pops up, the relationship information option box 300 includes a recognition selection box 301, the content of the recognition selection box 301 is "recognize many people and please select their relationship at the same time than the scissors hand", a parent relationship option box 302, a sibling relationship option box 303, a classmate relationship option box 304, and other relationship option boxes 305, and the photographic subject can select the corresponding relationship information as the relationship information of the photographic subject according to the requirement and select to store the relationship information in the electronic device database.

Step S230: when it is detected that the relationship information of the plurality of photographic subjects changes, the stored relationship information of the plurality of photographic subjects is updated.

As one mode, when the photo-taking object uses the photo-taking function of the electronic device, the electronic device may first detect the relationship information of the photo-taking object stored in the database, and when detecting that the relationship information of the photo-taking object changes, may automatically update the relationship information corresponding to the relationship information list.

For example, the original relationship information of two photo-objects is the lovers relationship, but now, they select the sharing hands, so as not to cause misunderstanding, at this time, the photo-objects can select to manually delete the original relationship information of the lovers stored in the electronic device, and when the electronic device detects the action of deleting the relationship information by the photo-objects, the electronic device automatically updates the relationship information list; in addition, if the electronic device detects that the database does not store the relationship information between the photographic objects, the user can also manually add new relationship information between the photographic objects, specifically, a plurality of photographic objects can make the same scissor-hand gesture at the same time, the electronic device pops up a relationship information option list when recognizing the scissor-hand gesture, and the photographic objects can manually select the relationship information as the relationship information between the photographic objects and store the added relationship information in the electronic device database.

Step S240: and processing the images comprising the plurality of photographic objects based on the relationship information to obtain the processed images representing the relationship of the plurality of photographic objects.

Step S250: and outputting the processed image.

The application provides an image processing method, which comprises the steps of firstly obtaining relationship information of a plurality of photographic objects; processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and outputting the processed image. In the method, before the relation information of the photographed image is obtained, the face recognition is firstly carried out on the photographed object, whether the relation information of the photographed object is stored in an electronic equipment database or not is detected, and if not, the relation information of the photographed object is firstly established according to preset conditions. By the method, the user relationship information in the electronic equipment database can be updated in real time, and the photographing experience of the user is improved.

Referring to fig. 6, an image processing method provided in the embodiment of the present application includes:

step S310: an image including a plurality of photographic subjects is acquired and displayed.

Step S320: the method comprises the steps of displaying a plurality of target controls and face images of a plurality of photographic objects in a suspension mode on an image comprising the photographic objects, wherein each target control corresponds to different relationship information.

As one mode, a plurality of target controls are set on a user photographing interface and used for acquiring a face image of a photographed object having the same relationship information, and in addition, each target control corresponds to different relationship information.

Step S330: and configuring the corresponding relation between the face images of the plurality of photographing objects and the plurality of target controls.

As one mode, the step of configuring the correspondence between the face images of the plurality of photographic subjects and the plurality of target controls includes: and responding to touch operation to move the selected face images in the face images of the plurality of photographing objects to the target control acted by the touch operation so as to establish the corresponding relation between the selected face images and the target control.

It should be noted that, a user can manually set relationship information between a plurality of photographic objects according to a requirement of the user, the electronic device can set relationship information between a plurality of photographic objects according to a touch operation of the user, and the set relationship information corresponding to the target control is the relationship information corresponding to the photographic object corresponding to the detected face image.

For example, as shown in fig. 7, four target controls are set on the user photographing interface, the relationship information corresponding to the first target control 401 is a lover relationship, the relationship information corresponding to the second target control 402 is a sibling relationship, the relationship information corresponding to the third target control 403 is a classmate/colleague relationship, and the relationship information corresponding to the fourth target control 404 is a relatives relationship. The user can move the face images with the same relationship information to the corresponding target control according to the face image of the photographic object in the user photographing interface identified by the electronic equipment.

Step S340: and determining the relationship information of a plurality of photographic objects of which the face images correspond to the same target control as the relationship information corresponding to the target control commonly corresponding to the face images of the photographic objects.

Optionally, according to the scene shown in fig. 7, in the shooting process, after face recognition, the electronic device finds that the face images of two persons in the shooting object correspond to the lovers relationship and the face images of two persons correspond to the father-son relationship, so that a user of the electronic device can manually move two face images with relationship information of the lovers relationship into the first target control 401, and take the lovers relationship as the relationship information between the two persons; two face images with relationship information as parent-child relationship are moved to a fourth target control 404, the parent-child relationship is used as the relationship information between the two face images, and then the user images are processed in the target control corresponding to the relationship information.

Step S350: and processing the images comprising the plurality of photographic objects based on the relationship information to obtain the processed images representing the relationship of the plurality of photographic objects.

As one mode, the step of processing the image including the plurality of photographic subjects based on the relationship information to obtain a processed image representing the relationship between the plurality of photographic subjects includes: acquiring image processing modes corresponding to the relationship information, wherein the image processing modes corresponding to different relationship information are different; and processing the image comprising the plurality of photographing objects based on the processing mode.

It can be understood that different relationship information corresponds to different image processing modes, and the image processing mode includes mapping or blurring the image.

For example, when a parent and a child play in a playground, the parent often chooses to take a picture to record the happy hours of the child, but in the playground where people are dense, the parent often sees that a pile of people is disorderly inserted into the picture when taking the picture, so that the picture does not look important, in this case, the user can choose to perform mosaic processing on the people, and the experience of going out and swimming in person is improved.

In addition, the electronic device can also identify the current photographing scene, the electronic device can process the image by combining the relationship information of the photographing object and the current photographing scene, and different image processing modes can be selected for different scenes.

Illustratively, classmates have a contract to study in a library of schools, and the classmates A propose photo-taking for a friend circle to keep a memorial. In addition, for example, when friends sing at KTV, in order to make the atmosphere of the photo look stronger, the user can add a special lighting effect during the photographing process.

As another mode, the step of processing the image including the plurality of photographic subjects based on the relationship information to obtain a processed image representing the relationship between the plurality of photographic subjects includes:

acquiring a photographic subject having a specified relationship among the plurality of photographic subjects based on the relationship information; acquiring an image processing mode corresponding to the specified relationship; and processing the image comprising the plurality of photographing objects based on the processing mode.

Wherein the step of processing the image including the plurality of photographic subjects based on the processing manner includes: mapping the photographic objects with the specified relationship; alternatively, the blurring process is performed on the photographic subjects other than the photographic subject having the specified relationship.

It should be noted that the specified relationship here refers to a relationship corresponding to the photographic subject for which the relationship information has been determined, and includes: relationship information such as lovers 'relationship, colleagues' relationship, father-mother relationship, and friendship.

For example, after the electronic device detects the action of taking a picture by the user or stopping taking a picture by the user, the electronic device recognizes that a plurality of sets of relationship information exist in the picture. For example, when a lover takes a picture, the lover may have a relationship of the same school, and they all take the same picture, in this case, the electronic device may pop up a relationship information option to allow the user to select which group of relationship information to keep, in this way, for example, the user selects a lover relationship, the user may perform mapping processing on a face image of a picture-taking object corresponding to the relationship information of the friend, and may select a mapping element that the user likes on the face image to perform mapping, where the type of the mapping element includes, but is not limited to, a makeup mapping, an expression mapping, a text mapping, a filter mapping, a music mapping, a decoration mapping (the decoration includes, but is not limited to, hair ornaments, beards, hats, and the like); for any one type of map element, it may have multiple styles of map elements, where the style of the map may or may not be visible to the user. Alternatively, the user may select to blur the photographic subject corresponding to the friendship information other than the photographic subject corresponding to the selected lover relationship information.

Step S360: and displaying the processed image.

As one mode, the image processed according to the above mode can be displayed on an image display interface of the electronic device in real time.

Step S370: and if the instruction for storing the processed image is detected, storing the processed image.

As one mode, after the electronic device detects an action of completing processing of a photo, an image display interface of the electronic device pops up an effect diagram of the processed photo, and a user can select to save or not save the photo according to the satisfaction degree of the user on the processed photo. When the electronic equipment detects an instruction of the user for selecting to store the processed image, the electronic equipment stores the processed image according to the instruction and stores the image in a local database of the electronic equipment.

The method for processing the image comprises the steps of firstly obtaining relationship information of a plurality of photographing objects; processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects; and outputting the processed image. The method is added with the steps of configuring the corresponding relation between the face images of a plurality of photographic objects and a plurality of target controls by setting a plurality of target controls and setting relation information for each control, determining the relation information of the plurality of photographic objects of which the face images correspond to the same target control as the relation information corresponding to the target controls commonly corresponding to the face images of the plurality of photographic objects, and finally carrying out personalized processing on the image of the photographic object corresponding to the relation information according to the relation information. Through individualized setting, the interest of photographing of the user is increased, and the user experience is improved.

Referring to fig. 8, an image processing method according to an embodiment of the present application includes:

step S410: and establishing relationship information of a plurality of photographic objects according to preset conditions.

It should be noted that the electronic device may establish the relationship information of the plurality of photo-objects according to the preset condition in two different scenes, one is a photo preview scene, and the other is an image capture scene.

As one mode, the step of establishing relationship information of a plurality of photographic subjects according to a preset condition includes: under a photographing preview scene, establishing relationship information of a plurality of photographing objects according to preset conditions; the image comprising the plurality of photographic objects is an image shot based on the photographing preview scene.

It should be noted that, in the preview photographing scene, the electronic device acquires an image captured based on the preview photographing scene, and the electronic device establishes relationship information between the photographed objects according to the motion made by the photographed object corresponding to the face image in the image.

As another mode, the step of establishing relationship information of a plurality of photographic subjects according to a preset condition includes: when image shooting operation is detected, establishing relation information of a plurality of shot objects according to preset conditions; the image including the plurality of photographic subjects is an image obtained based on the image capturing operation.

When the electronic equipment detects the image shooting operation, the electronic equipment can identify the face in the image according to the shot image, and then establish the relationship information between the shot objects according to the action of the shot objects corresponding to the face image in the image.

Step S420: relationship information of a plurality of photographic subjects is acquired.

Step S430: and processing the images comprising the plurality of photographic objects based on the relationship information to obtain the processed images representing the relationship of the plurality of photographic objects.

Step S440: and outputting the processed image.

The method for processing the image comprises the steps of firstly obtaining relationship information of a plurality of photographing objects; and processing the images comprising the plurality of photographic objects based on the relationship information to obtain the processed images representing the relationship of the plurality of photographic objects. In the process of establishing the relationship information of the photographic object, the relationship information of the photographic object is established based on the images of the photographic object acquired by two different application scenes, so that the comprehensiveness of the relationship information of the photographic object is increased, and the photographic experience of a user is improved.

Referring to fig. 9, an image processing apparatus 500 according to an embodiment of the present application includes:

an information acquisition unit 510 for acquiring relationship information of a plurality of photographic subjects.

In one mode, the relationship information may be understood as an affinity between the photographic subjects, wherein the affinity includes a lover relationship, a father-son/father-mother relationship, a mother-son/mother-mother relationship, a classmate relationship, an affinity, a classmate relationship, and the like, and may also be understood as a stranger relationship between the photographic subjects.

Optionally, first, affinity information needs to be established, where the affinity information may identify the affinity of the photographed object according to some features, for example, when photographing, the photographed object may complete affinity assessment through some specified actions or behaviors on an interface previewed by a camera, for example, if the photographed objects are in a lover relationship with each other, affinity assessment may be completed through gestures such as hand pulling, kissing, hugging, and the like, and the affinity information is established.

An image processing unit 520, configured to process the image including the multiple photographic subjects based on the relationship information, so as to obtain a processed image representing the relationship between the multiple photographic subjects.

As one way, in the photographing process, the image of the plurality of photographic subjects including the recognized relationship information may be subjected to blurring processing or mapping processing, so that the relationship between the plurality of photographic subjects may be embodied for the processed image including the plurality of photographic subjects. For example, when lovers have a date, strangers who are not aware often get together to get a match, and in order to avoid the problem, after the electronic device recognizes that two persons are in a lovers relationship, a map is automatically added to the strangers. And processing the image of the photographed object to obtain a relation information image desired by the user.

An image output unit 530 for outputting the processed image.

Optionally, the photographic subject corresponding to the selected relationship information is processed, and then the processed image is output. For example, in the course of photographing, images of subjects other than the selected lovers' relationship are processed to obtain images of only two persons of the lovers, and then the images are outputted.

Referring to fig. 10, the information obtaining unit 510 includes:

the feature obtaining module 512 is configured to obtain a preset condition feature.

The relationship generating module 514 is configured to identify the photo object in the preview scene according to the preset condition characteristics, so as to obtain relationship information of the photo object.

The storage module 516 is configured to store the relationship information of the photo-object.

Optionally, in the photographing stage, the feature obtaining module 512 needs to obtain the motion of the photographed object as the feature for identifying the relationship information of the photographed object, then the relationship generating module 514 establishes the relationship information between the photographed objects according to the identified relationship information feature, and finally the storage module 516 stores the obtained relationship information corresponding to the photographed object.

Referring to fig. 11, an image processing apparatus 600 according to an embodiment of the present application includes:

the face recognition unit 610 is configured to perform face recognition on a plurality of photographic subjects to detect whether relationship information of the plurality of photographic subjects is stored.

As one mode, in the user photographing stage, the face recognition unit 610 may perform face recognition on a plurality of photographing objects first, so that the electronic device detects whether relationship information corresponding to the photographing objects is stored in the electronic device database, and if the electronic device detects that the relationship information data of the photographing objects is stored, the relationship information between the photographing objects is not re-established.

The relationship establishing unit 620 is configured to establish relationship information of a plurality of photo objects according to a preset condition if the electronic device does not detect that the relationship information data of the photo objects are stored in the electronic device database.

An information updating unit 630 for updating the stored relationship information of the plurality of photographic subjects when a change in the relationship information of the plurality of photographic subjects is detected.

As one mode, when the photo-taking object uses the photo-taking function of the electronic device, the electronic device may first detect the relationship information of the photo-taking object stored in the database, and when detecting that the relationship information of the photo-taking object changes, the information updating unit 630 may automatically update the relationship information corresponding to the relationship information list.

Referring to fig. 12, an image processing apparatus 700 according to an embodiment of the present application includes:

an acquisition display unit 710 for acquiring and displaying an image including a plurality of photographic subjects.

The control setting unit 720 is configured to display a plurality of target controls and face images of the plurality of photographic subjects in a suspended manner on an image including the plurality of photographic subjects, where each target control corresponds to different relationship information.

As one mode, the control setting unit 720 is configured to set a plurality of target controls on the user photographing interface, and is configured to obtain a face image of a photographic object with the same relationship information, where each target control corresponds to different relationship information.

The relationship configuration unit 730 is configured to configure the corresponding relationships between the face images of the plurality of photographic subjects and the plurality of target controls.

The relationship determining unit 740 is configured to determine relationship information of multiple photographic objects corresponding to the same target control by the face image, as relationship information corresponding to a target control commonly corresponding to the face images of the multiple photographic objects.

It should be noted that the device embodiment and the method embodiment in the present application correspond to each other, and specific principles in the device embodiment may refer to the contents in the method embodiment, which is not described herein again.

An electronic device provided by the present application will be described below with reference to fig. 13.

Referring to fig. 13, based on the system recovery method and apparatus, another electronic device 800 capable of executing the system recovery method is further provided in the embodiment of the present application. The electronic device 800 includes one or more processors 802 (only one shown), a memory 804, an image processor 806, a camera 807, and a network module 808 coupled to each other. The memory 804 stores programs that can execute the content of the foregoing embodiments, and the processor 802 can execute the programs stored in the memory 804.

Processor 802 may include one or more processing cores, among others. The processor 802 interfaces with various components throughout the electronic device 800 using various interfaces and circuitry to perform various functions of the electronic device 800 and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 804 and invoking data stored in the memory 804. Alternatively, the processor 802 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 802 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 802, but may be implemented by a single communication chip.

The Memory 804 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 804 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 804 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The stored data area may also store data created by the terminal 800 during use (e.g., phone books, audio-visual data, chat log data), and the like.

The camera 807 is used for image acquisition and transmitting the acquired image to the image processor 806 for processing.

The image processor 806 is used to improve the quality of the picture by image enhancement or restoration, etc. The processing mode comprises the steps of removing noise points, correcting wide-angle distortion of the digital photos, improving the contrast of the photos, eliminating red eyes and the like. The image processor 806 can also be used for picture composition, that is, combining multiple pictures to realize a process of changing the content of the pictures, where picture composition usually needs to be realized by matting, and picture composition has a main meaning of replacing a background by matting, or directly combining multiple pictures, for example, various fusion modes are all picture composition modes.

The network module 808 is configured to receive and transmit electromagnetic waves, and implement interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, for example, an audio playing device. The network module 808 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The network module 808 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. For example, the network module 808 may communicate information with a base station.

Referring to fig. 14, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 900 has stored therein program code that can be called by a processor to perform the methods described in the above-described method embodiments.

The computer-readable storage medium 900 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 900 includes a non-volatile computer-readable storage medium. The computer readable storage medium 900 has storage space for program code 910 to perform any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 910 may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

An image processing method applied to an electronic device, the method comprising:

acquiring relationship information of a plurality of photographic objects;

processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects;

and outputting the processed image.
The method of claim 1, wherein the step of obtaining relationship information of a plurality of photographic subjects comprises:

and establishing relationship information of a plurality of photographic objects according to preset conditions.
The method of claim 2, wherein the step of establishing the plurality of photo object relationship information according to the preset condition comprises:

under a photographing preview scene, establishing relationship information of a plurality of photographing objects according to preset conditions;

the image comprising the plurality of photographic objects is an image shot based on the photographing preview scene.
The method of claim 2, wherein the step of establishing the plurality of photo object relationship information according to the preset condition comprises:

when image shooting operation is detected, establishing relation information of a plurality of shot objects according to preset conditions;

the image including the plurality of photographic subjects is an image obtained based on the image capturing operation.
The method according to any one of claims 2 to 4, wherein the step of establishing the relationship information of the photographic subject according to the preset condition comprises:

acquiring preset condition characteristics;

identifying a plurality of photographic objects according to the preset condition characteristics to obtain relationship information of the photographic objects;

and storing the relation information of the photographed object.
The method according to claim 5, wherein before the step of establishing the relationship information of the photographic subject according to the preset condition, the method further comprises:

carrying out face recognition on a plurality of photographic objects to detect whether relationship information of the photographic objects is stored or not;

and if not, executing the relationship information of the photo-object established according to the preset conditions.
The method of claim 5, wherein the step of obtaining the preset condition characteristics comprises:

and setting the gesture action as a preset condition characteristic.
The method according to claim 7, wherein after the step of establishing the relationship information corresponding to the plurality of photo subjects according to the preset condition, the method further comprises:

when it is detected that the relationship information of the plurality of photographic subjects changes, the stored relationship information of the plurality of photographic subjects is updated.
The method according to claim 7, wherein the step of establishing the relationship information corresponding to the plurality of photographing objects according to the gesture recognition result comprises:

if a plurality of photographing objects corresponding to the same photographing action exist, popping up a relation information option list to allow a user to select;

and taking the relationship information corresponding to the selected relationship information item as the relationship information of the plurality of photographing objects corresponding to the same photographing action.
The method of claim 1, wherein the step of obtaining relationship information of a plurality of photographic subjects comprises:

displaying a plurality of target controls and face images of a plurality of photographic objects in a suspension manner on an image comprising the photographic objects, wherein each target control corresponds to different relationship information;

configuring corresponding relations between the face images of a plurality of photographic objects and the plurality of target controls;

and determining the relationship information of a plurality of photographic objects of which the face images correspond to the same target control as the relationship information corresponding to the target control commonly corresponding to the face images of the photographic objects.
The method of claim 10, wherein the step of configuring the correspondence between the face images of the plurality of subjects and the plurality of target controls comprises:

and responding to touch operation to move the selected face images in the face images of the plurality of photographing objects to the target control acted by the touch operation so as to establish the corresponding relation between the selected face images and the target control.
The method of any of claims 1-11, wherein the step of processing the image including the plurality of subjects based on the relationship information to obtain the processed image characterizing the relationship of the plurality of subjects comprises:

acquiring image processing modes corresponding to the relationship information, wherein the image processing modes corresponding to different relationship information are different;

and processing the image comprising the plurality of photographing objects based on the processing mode.
The method of any of claims 1-11, wherein the step of processing the image including the plurality of subjects based on the relationship information to obtain the processed image characterizing the relationship of the plurality of subjects comprises:

acquiring a photographic subject having a specified relationship among the plurality of photographic subjects based on the relationship information;

acquiring an image processing mode corresponding to the specified relationship;

and processing the image comprising the plurality of photographing objects based on the processing mode.
The method according to claim 12, wherein the step of processing the image including the plurality of photographic subjects based on the processing manner includes:

and mapping the photographic objects with the specified relationship.
The method according to claim 12, wherein the step of processing the image including the plurality of photographic subjects based on the processing manner includes:

and carrying out fuzzy processing on the photographic subjects except the photographic subject with the specified relation.
The method of any of claims 1-15, wherein outputting the processed image further comprises:

displaying the processed image;

and if the instruction for storing the processed image is detected, storing the processed image.
An image processing apparatus, characterized in that the apparatus comprises:

an information acquisition unit configured to acquire relationship information of a plurality of photographic subjects;

the image processing unit is used for processing the images comprising the plurality of photographic objects based on the relationship information to obtain processed images representing the relationship of the plurality of photographic objects;

and the image output unit is used for outputting the processed image.
The apparatus according to claim 17, wherein the information obtaining unit includes:

the characteristic acquisition module is used for acquiring preset condition characteristics;

the relation generation module is used for identifying the photographed object in the photographing preview scene according to the preset condition characteristics to obtain the relation information of the photographed object;

and the storage module is used for storing the relationship information of the photographed object.
An electronic device comprising one or more processors and memory; one or more programs stored in the memory and configured to be executed by the one or more processors to perform the method of any of claims 1-15.
A computer-readable storage medium, having program code stored therein, wherein the program code when executed by a processor performs the method of any of claims 1-15.