CN112529864A

CN112529864A - Picture processing method, device, equipment and medium

Info

Publication number: CN112529864A
Application number: CN202011419118.XA
Authority: CN
Inventors: 尚辉
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-12-07
Filing date: 2020-12-07
Publication date: 2021-03-19

Abstract

The application discloses a picture processing method, a picture processing device, picture processing equipment and a picture processing medium, and belongs to the technical field of picture processing. The picture processing method comprises the following steps: acquiring a plurality of first pictures, wherein the plurality of first pictures comprise first shooting objects; carrying out picture synthesis according to the plurality of first pictures to obtain a second picture; displaying the second picture under the condition that the first picture quality of the second picture is higher than the first picture quality of each first picture; the first picture quality is obtained by evaluating a picture according to a preset quality evaluation parameter. According to the embodiment of the application, the process of obtaining the high-quality picture through manual comparison and screening can be saved, and the operation complexity of a user is reduced.

Description

Picture processing method, device, equipment and medium

Technical Field

The present application belongs to the field of image processing technologies, and in particular, to an image processing method, apparatus, device, and medium.

Background

With the development of electronic technology, photographing has become a common function in electronic devices, and meanwhile, people have higher and higher requirements on the quality of pictures obtained by photographing.

At present, a plurality of pictures are often acquired by adopting an automatic continuous shooting mode or a manual multiple single shooting mode, and then a user needs to manually compare and screen the plurality of pictures to obtain a picture with higher quality, so that the problem of more complicated user operation is also brought.

Disclosure of Invention

The embodiment of the application aims to provide a picture processing method, a picture processing device, picture processing equipment and a picture processing medium, and the problem that in the prior art, a user needs to manually screen a plurality of pictures to obtain a picture with good quality, and the operation of the user is complicated is solved.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides an image processing method, including:

acquiring a plurality of first pictures, wherein the plurality of first pictures comprise first shooting objects;

carrying out picture synthesis according to the plurality of first pictures to obtain a second picture;

displaying the second picture under the condition that the first picture quality of the second picture is higher than the first picture quality of each first picture;

the first picture quality is obtained by evaluating a picture according to a preset quality evaluation parameter.

In a second aspect, an embodiment of the present application provides an image processing apparatus, including:

the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring a plurality of first pictures, and the first pictures comprise first shooting objects;

the synthesis module is used for carrying out picture synthesis according to the plurality of first pictures to obtain a second picture;

the first display module is used for displaying the second picture under the condition that the first picture quality of the second picture is higher than that of each first picture;

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the method according to the first aspect.

The picture processing method provided by the embodiment of the application comprises the steps of obtaining a plurality of first pictures including a first shooting object, carrying out picture synthesis according to the plurality of first pictures to obtain a second picture, and displaying the second picture when the quality of the first picture of the second picture is higher than that of each first picture, wherein the quality of the first picture can be obtained by evaluating the pictures according to preset quality evaluation parameters; according to the method and the device, the second picture is obtained through picture synthesis, the defects possibly existing in the first picture are made up, the second picture is compared with the first picture based on the first picture quality, the displayed second picture is further guaranteed to have higher picture quality, in addition, the process of obtaining the high-quality picture through manual comparison and screening is also saved, and the operation complexity of a user is reduced.

Drawings

Fig. 1 is a flowchart of a picture processing method provided in an embodiment of the present application;

FIG. 2 is a diagram illustrating an example of a picture browsing interface in an embodiment of the present application;

FIGS. 3a, 3b, 4a and 4b are diagrams illustrating a picture preview interface according to an embodiment of the present disclosure;

fig. 5 is a flowchart of a picture processing method provided in an embodiment of the present application in a specific application example;

FIG. 6 is a schematic structural diagram of a picture processing apparatus according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 8 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The following describes in detail a picture processing method, an apparatus, a device, and a medium provided in the embodiments of the present application with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application. The picture processing method may include:

step 101, acquiring a plurality of first pictures, wherein the plurality of first pictures comprise first shooting objects;

102, synthesizing pictures according to the plurality of first pictures to obtain a second picture;

103, displaying the second picture under the condition that the first picture quality of the second picture is higher than that of each first picture;

In this embodiment, the plurality of first pictures may be obtained by automatic continuous shooting or manual multiple shooting, and it is easy to understand that, in the above shooting process, some specific objects may be usually shot, such as specific persons, small animals, or plants, in other words, the plurality of first pictures may all include the specific objects, that is, the above first objects.

Taking the example of shooting a specific person, in some shooting scenes, for example, when shooting a young child, the young child may not be matched, sloppy and moving, or eyes may be closed, and further different areas in each first picture obtained by shooting may be blurred to different degrees; for another example, when multiple persons are photographed, the following situations may occur in the multiple first pictures obtained by photographing: in the first picture, person a is not occluded, but person B is closed; in the second first picture, the person B has their eyes open, while the person a is occluded. In other words, even when continuous shooting is performed, it is often difficult to ensure that each person has a good state in one first picture.

Of course, as shown above, in practical applications, the plurality of first pictures may be obtained by photographing small animals or plants. For example, when the leaves are photographed, the leaves may shake under the action of wind, which may also cause the first picture to be blurred.

In this embodiment, for the picture defects that may occur in the above shooting scene, picture synthesis may be performed according to the multiple first pictures to obtain the second picture.

For simplicity of description, a scene photographed by multiple persons will be mainly used as an example in the following description. In combination with the above-mentioned multiple first pictures including the person a and the person B, when picture composition is performed according to the multiple first pictures, the eyes of the person B in the first picture can be replaced by the eyes of the person B in the second picture, so as to obtain the second picture. In this way, the second picture can be obtained in which the person a is not blocked, and the eyes of the person B are opened, so that each person in the first picture has a better state.

Of course, the above image synthesis process may involve identification of a person, or identification of specific parts of the person, such as the head, eyes, and mouth, etc., and the above identification process may be regarded as feature identification of the first image, and the feature identification may be implemented by an artificial intelligence algorithm of a type such as a neural network, for example, and the specific implementation process is not described herein again.

In this embodiment, after obtaining the second picture, the first picture quality comparison between the second picture and each of the first pictures may be further performed. It is easily understood that, for the first picture quality, the picture may be evaluated based on preset quality evaluation parameters. In combination with the above multi-person combined scene, the quality evaluation parameters may include light conditions, definition, whether head occlusion exists, head angle, whether eye closure exists, and the like. That is, the quality evaluation parameter may be a picture parameter such as brightness and contrast, or a picture feature obtained by feature recognition, and is not limited in detail here. Meanwhile, the specific mode of evaluating the picture based on the quality evaluation parameter can also be set according to actual needs, and is not specifically limited here.

The first picture quality of the second picture is higher than that of each first picture, and the overall picture quality of the second picture can be considered to be higher than that of each first picture to a certain extent. For example, when the first picture and the second picture are both a group picture with a plurality of specific characters, the eyes of all the characters in the second picture are in an open state, and no obvious occlusion exists between the heads of the characters; in each first picture, there may be a case where the eyes of the person are closed or the head of the person is significantly occluded; at this time, the first picture quality of the second picture may be considered to be higher than the first picture quality of the first picture. Of course, this is merely an example of the comparison of the first picture quality, and in practical applications, the quality evaluation parameter selected for evaluating the first picture quality may be selected as needed.

In the case that the first picture quality of the second picture is higher than the first picture quality of each first picture, the second picture may be displayed, specifically, an original image, a preview image, or a thumbnail of the second picture may be displayed, which is not limited herein. For example, in one application scenario, a preview of the second picture may be displayed in an upper display area of the display screen, while a thumbnail of the second picture may be displayed in a lower display area of the display screen.

In order to ensure the picture quality of the synthesized second picture, optionally, in step 102, performing picture synthesis according to the plurality of first pictures to obtain the second picture, includes:

respectively identifying picture features in each first picture and feature identification of the picture features;

determining a third picture from the plurality of first pictures according to the picture characteristics in each first picture;

and replacing the first picture characteristics in the third picture with the second picture characteristics in the fourth picture to obtain the second picture, wherein the first picture characteristics and the second picture characteristics are picture characteristics with the same characteristic identification, and the second picture quality of the second picture characteristics is higher than that of the first picture characteristics.

As described in the above embodiment, the picture features may be obtained by identifying the picture through an artificial intelligence algorithm such as a neural network, and similarly, the picture features of each first picture may be obtained based on the artificial intelligence algorithm.

Taking the first picture as an example of a multi-person photo, the recognized picture features may be human body parts such as the whole head, eyes, mouth, or face, and the picture features may further indicate specific expressions or states of the human body parts, such as "open eyes", "closed eyes", or "blocked head".

According to the picture characteristics of each first picture, a third picture can be determined from the plurality of first pictures. For example, the third picture may be a first picture with better picture characteristics in the plurality of first pictures; also in connection with the above-mentioned example of multi-person group photograph, generally speaking, the first picture with less head occlusion and more eyes open can be considered as the picture with better feature performance.

In practical applications, some defects may still exist in the determined third picture, for example, in a certain person, the head of the person may be less blocked, and the eyes of most persons are open, while the eyes of the only person a are closed; at this time, the eye of the person a may need to be replaced. Assuming that the fourth picture has eye features corresponding to the open state of the eyes of the person a, the eyes of the person a in the third picture may be replaced with the eyes of the person a in the fourth picture. The eyes of person a in the third picture may correspond to the first picture characteristic, and the eyes of person B in the fourth picture may correspond to the second picture characteristic.

It will be readily appreciated that in the course of performing an eye replacement, it is often necessary to determine that the two eyes being replaced are of the same character a, and to this end, each picture feature in the first picture may be made to have a corresponding feature identifier, for example, the feature identifier may be used to indicate "eyes of character a", "mouth of character B", etc. In the eye replacement, two picture features with the same feature identifier in different pictures can be replaced. As for the distinction between "person a" and "person B", it can be realized based on the existing face recognition or other person recognition means, and will not be described in detail here.

In order to achieve the purpose that the synthesized second picture has higher picture quality as much as possible, the second picture quality of the second picture feature used for replacement may be higher than the second picture quality of the replaced first picture feature. The second picture quality is similar to the first picture quality mentioned in the previous embodiment and can be obtained by evaluating picture characteristics or picture parameters, and the difference between the second picture quality and the first picture quality is that the first picture quality can be more embodied in the quality of the whole picture, and the second picture quality can be embodied in the quality of a local area of the picture corresponding to each picture characteristic. For example, the second picture quality of "open eyes" may be higher than the second picture quality of "closed eyes" for this picture feature of eyes. Of course, this is merely an example of the second picture quality, and in practical applications, the evaluation mode of the second picture quality may be set as needed.

When the second picture characteristic and the first picture characteristic have the same characteristic identification and the second picture quality of the second picture characteristic is higher than that of the first picture characteristic, the first picture characteristic can be replaced by using the second picture characteristic. By way of example in connection with the group of persons, the "closed eyes of person a" in the third picture may be replaced by the "open eyes of person a" in the fourth picture, by the above-mentioned limitation of the conditions. Certainly, in a specific replacement process, the contour of the part may need to be identified by using the key points, so as to ensure that the replaced eyes are at a reasonable position of the head of the person a, and the synthesized second picture is not obviously distorted.

In this embodiment, the first picture feature in the third picture is actually replaced by specifically having the second picture feature in the fourth picture, so as to achieve the purpose of improving the picture quality; therefore, in some feasible embodiments, the method can replace the means of improving the picture quality by the facial beautification processing in the form of filtering and the like in the prior art, so that the problem of face blurring or excessive facial beautification caused by facial beautification can be effectively avoided.

In some examples, the fourth picture may be a different first picture from the third picture in the plurality of first pictures, or a pre-stored picture, or both.

For example, the fourth picture may be a second picture which is suboptimal with respect to the third picture, in other words, in the picture synthesis process mentioned in step 102, several first pictures with better effect may be screened out as candidate pictures by an artificial intelligence algorithm, and then picture synthesis is performed with respect to these candidate pictures.

For another example, in combination with the above example of the character photo, it is assumed that the face of the character B is excessively occluded in the plurality of first pictures obtained by the automatic continuous shooting; in order to make the face of the person B sufficiently appear in the photo album, the facial feature of the person B may be obtained from a photograph taken and stored for the person B at a certain time in the history and used to replace the face of the person B in the photo album. Of course, in practical applications, in order to avoid the face of the replaced person B from blocking other persons again, the head of the person B may be slightly shifted overall, and the like, and the details are not limited herein.

In the case where the fourth picture includes a picture stored in advance, the fourth picture may be manually selected from the album by the user in the step of acquiring the plurality of first pictures. Of course, each picture in the album may be identified and labeled in advance, and when the first picture feature of the third picture is replaced, the corresponding second picture feature is directly called from the album for replacement.

In other words, in this example, the fourth picture can be flexibly selected as needed, which is helpful for realizing the picture synthesis between the pictures at the cross-shooting time and the cross-shooting location, and improves the success rate of obtaining the second picture with higher picture quality.

Certainly, in consideration of some practical application scenarios, a user may be satisfied with the quality of a picture directly obtained by shooting, and a picture with higher quality does not need to be obtained through picture synthesis; in this embodiment, an interactive design may be added, and a user may manually select whether to perform picture synthesis. Specifically, in this embodiment, before the step 101 acquires a plurality of first pictures, the picture processing method further includes:

displaying a picture browsing interface;

and under the condition of receiving a first input, switching and displaying a picture selection interface used for acquiring a plurality of first pictures from the picture browsing interface.

With reference to fig. 2, fig. 2 shows an exemplary diagram of a picture browsing interface, in which a front cover picture 21 and a first operation control 22 may be displayed, and the first operation control 22 may be specifically displayed as a "continuous shooting photo", when a user performs a first input for the first operation control 22, the user may trigger entering a picture selection interface, and after completing selection of multiple first pictures, processing procedures such as synthesizing a second picture may be further performed.

The first input may be a single-machine, double-click, or long-press type input to the first operation control 22, and is not particularly limited herein. After the user makes the first input to the first operation control 22, it may be considered that the second picture synthesis and picture quality ratio peer-to-peer picture processing procedure needs to be performed.

In some application scenarios, the obtaining of the plurality of first pictures may be automatically obtained by selecting the plurality of first pictures shot in a continuous shooting cycle, or may be obtained by manually selecting the first pictures shot multiple times by a user. And for the fourth picture which is stored in advance and mentioned in the previous example, the selection can be carried out in the picture selection interface.

In the embodiment, the user is triggered to enter the picture selection interface for acquiring the plurality of first pictures based on the first input of the user on the picture browsing interface, so that whether the picture processing processes such as second picture synthesis and the like are selected according to the actual requirements of the user can be realized, the occupation of computing resources is reduced, and the use experience of the user is improved.

In order to enable the user to distinguish the synthesized picture from the shot picture, optionally, in step 103, the displaying the second picture includes:

and arranging and displaying the thumbnails of the first pictures and the thumbnails of the second pictures, and displaying a first identifier aiming at the thumbnails of the second pictures, wherein the thumbnails of the second pictures are displayed at the head.

In connection with fig. 3a, fig. 3a shows an exemplary view of a picture preview interface in the lower display area of which a row of thumbnails is displayed, wherein thumbnails of a second picture can be displayed at a first position 31, thumbnails of a plurality of first pictures can be displayed in sequence at a second position 32, with the first position to the left of the second position 32; therefore, the arrangement display of the thumbnails of the second pictures and the thumbnails of the plurality of first pictures can be realized, and the thumbnails of the second pictures are displayed at the head, so that a user can acquire the thumbnails of the second pictures relatively quickly.

In order to enable the user to directly know that the picture displayed at the head is the thumbnail of the second picture, the first identifier may be displayed for the thumbnail of the second picture.

Referring to fig. 3a, the first indicator may include a fixed indicator 33, which may have a specific shape, such as a crown shape, a pentagram shape, or other shapes, and may be selected according to actual needs to fix the position of the thumbnail of the second picture. Referring to fig. 3b, the first mark may further include a bubble mark 34, where the bubble mark 34 may be displayed when a second picture is synthesized for the first time, and disappears after a preset time, so as to prompt that the second picture is synthesized; for example, in the bubble logo 34, the text "best group photo has been generated for you" may be displayed. As will be readily appreciated, for the first identifier, it may be generated and further displayed in a particular display area when the second picture is obtained.

In one example, there may be a certain spacing between the first position 31 and the second position 32 described above in order to enable the thumbnails of the second picture to be more easily visually distinguished. Of course, in some possible embodiments, the thumbnails corresponding to the first picture and the second picture may also be displayed in a matrix manner, and the thumbnail of the second picture may be located at the head of the matrix.

In some application scenarios, a certain time may be spent for picture synthesis, so that a user cannot immediately obtain a second picture after completing selection of a plurality of first pictures, at this time, a thumbnail of the first picture may be displayed on a picture preview interface, and after the second picture is generated, the thumbnail of the second picture is displayed in a fade-in manner or the like.

In addition, referring to fig. 3a and 3b, in another example, the picture preview interface may have a display area 35 for displaying a preview, and in the case of generating a second picture, the preview of the second picture may be displayed in the display area 35.

In some scenarios, the first picture quality of the synthesized second picture may be lower than the first picture quality of one or more first pictures, for example, the person in the synthesized second picture is obviously distorted, the light change is not reasonable enough, and the like. In order to ensure the quality of the picture finally displayed to the user, optionally, in step 102, after the picture is synthesized according to the plurality of first pictures to obtain the second picture, the picture processing method may further include:

under the condition that the first picture quality of the second picture is lower than the first picture quality of at least one first picture, determining a target picture from the plurality of first pictures, wherein the target picture is the first picture with the highest first picture quality in the plurality of first pictures;

arranging and displaying the thumbnails of the plurality of first pictures, and displaying a second identifier aiming at the thumbnails of the target picture; and the target pictures are arranged and displayed at preset positions.

In combination with the above embodiment, the quality of the first picture may be obtained by evaluating the picture according to a preset quality evaluation parameter, which is not described herein again.

When the first picture quality of the second picture is lower than the first picture quality of any one of the first pictures, a first picture with the highest first picture quality can be selected from the plurality of first pictures as a target picture. For example, the target picture may be a picture in which the head of the person is blocked the least and the eyes of the person are open in a plurality of photos of the person.

Referring to fig. 4a, fig. 4a shows an exemplary diagram of a picture preview interface, in a display area 41 below the picture preview interface, thumbnails of a plurality of first pictures can be arranged and displayed, and thumbnails of the target pictures are also located therein, and furthermore, thumbnails of the target pictures can be located at a preset position, for example, at the middle or the leftmost position of the display area 41, so that the thumbnails of the target pictures can be located at a preferred position where they can be quickly viewed by a user.

Similarly to the first identifier displayed on the second picture in the previous embodiment, in this embodiment, the second identifier may also be displayed on the target picture. Referring to fig. 4a, the second indicator may include a fixed indicator 42, which may have a specific shape, such as a crown shape, a pentagram shape, or other shapes, and may be selected according to actual needs to fix the position of the thumbnail indicating the target picture. Referring to fig. 4b, the second indicator may further include a bubble indicator 43, and the bubble indicator 43 may be displayed when a certain target picture is determined for the first time and disappear after a preset time, so as to prompt that a target picture with higher quality is screened out. For example, in bubble banner 43, the text "best group photo has been picked for you" may be displayed.

The thumbnails of the plurality of first pictures may have a picture ordering according to the picture shooting time or the selected picture shooting time; in one example, after the target picture is determined, the position of the target picture in the picture ordering may not be changed, but the target picture is displayed at a preferred position by adjusting the display position of each first picture.

In one example, after exiting the picture preview interface shown in fig. 4a or 4b, the picture browsing interface shown in fig. 2 may be switched to be displayed, and at this time, the cover picture 21 in the picture browsing interface may be updated to be the target picture.

As will be readily understood, the picture preview interface shown in fig. 3a, 3b, 4a, and 4b may be considered as an optimal picture selection interface, and may be used to display the optimal picture obtained based on the first picture quality comparison, or may be used by the user to manually select and store a favorite picture.

The following describes the image processing method provided in the embodiment of the present application with reference to a specific application example, as shown in fig. 5, the image processing method may include:

step 501, opening a camera or an album to obtain a plurality of photo-combination photos;

the user can start the camera function to perform continuous shooting to obtain a plurality of photo-combination photos; alternatively, a non-burst scene captures multiple co-shots.

Step 502, synthesizing a plurality of obtained photo-combination photos to obtain a synthetic photo;

and synthesizing to obtain a synthesized photo according to the obtained multiple synthesized photos. Specifically, a plurality of candidate images of the most preferred human faces are screened and selected by means of an artificial intelligence algorithm according to a photo album transmitted by a client, then characters and expressions in the images are recognized, the human face parts needing to be replaced are determined according to the eye and mouth shielding condition, the same human faces meeting requirements are searched for the human face parts needing to be replaced, the part outlines are identified by means of key points, and then replacement is carried out.

Step 503, judging whether the best group photo is a synthesized photo obtained by synthesis, if yes, executing step 504, and if not, executing step 505;

after the synthesis is finished, the best group photo is judged to be the synthesized photo or the photo which is preferred in the original group photo by comparing the quality of the human face.

Step 504, the thumbnail of the composite photo is displayed at the head of all the thumbnails;

when the best group photo is a composite photo, the thumbnail of the composite photo is displayed at the head of the thumbnail (e.g., the leftmost side) and is separated from the sequence of the original continuously taken group photos, and the best group photo thumbnail displays a special identifier. For example, when a user enters a photo selection interface with a composite photo for the first time, if the execution of an algorithm for synthesizing the photo is completed, a fade-in dynamic effect can be displayed on a thumbnail of the composite photo, the thumbnail of the composite photo automatically appears at the head of a continuous shooting sequence, and in addition, a bubble hint which is 'an optimal portrait has been generated for you' is displayed, and the bubble hint can disappear after a preset time elapses; as another example, the thumbnail of the composite photograph may also carry a fixed identification indicating the best group photo.

Step 505, when entering the photo selection interface, the best photo album is displayed at the best position by default.

When the best photo is a photo in the original continuous shooting and enters a photo selection interface, the best photo is displayed at the best photo position by default; the position of the selected best photo in the original continuously shot photo sequence is unchanged, and the thumbnail of the best photo displays a special identifier. For example, when entering a continuous shooting selection interface with the best combination photo for the first time, a bubble prompt is displayed, namely that the best portrait is selected for you, and in combination with an actual application scene, multiple combination photos are obtained by shooting for multiple times, and when entering the continuous shooting selection interface for each combination photo, the bubble prompt can be performed for one time; further, the above-mentioned bubble cue may disappear after a lapse of a preset time. When the continuous shooting selection interface is exited and the picture browsing interface is entered, the best photo album can be set as the front cover picture of the picture browsing interface.

As can be seen from the above specific application examples, the embodiment of the application can synthesize the photos according to the multiple original photos obtained in the automatic continuous shooting mode or the multiple manually selected photos in the non-continuous shooting mode, and can display the synthesized photos and the best photos in the multiple original photos on the cover, thereby omitting the process of manually selecting the best photos by the user; and when the photos are synthesized, the expressions of the characters in the photos can be in the optimal state through the expression fusion of the same characters. The trouble of selecting the best photo by a user can be saved, the success rate of the best photo can be improved, and the problem that the original photo is easy to have character expression flaws is effectively solved.

It should be noted that, in the image processing method provided in the embodiment of the present application, the execution main body may be an image processing apparatus, or a control module used in the image processing apparatus to execute the image processing method. The embodiment of the present application takes an image processing apparatus as an example to execute an image processing method, and the image processing apparatus provided in the embodiment of the present application is described.

Fig. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application. The picture processing apparatus 600 may include:

an obtaining module 601, configured to obtain a plurality of first pictures, where each of the plurality of first pictures includes a first shooting object;

a synthesizing module 602, configured to perform picture synthesis according to the multiple first pictures to obtain a second picture;

a first display module 603, configured to display the second picture if a first picture quality of the second picture is higher than a first picture quality of each of the first pictures;

The image processing device provided by the embodiment of the application obtains a plurality of first images, each first image comprises a first shooting object, and a second image is obtained by synthesizing the plurality of first images, so that possible defects in the first images can be compensated, and the second image has higher probability and better image quality; furthermore, in the embodiment of the application, when the first picture quality of the second picture is higher than that of each first picture, the second picture is displayed, so that the pictures presented to the user have higher picture quality; therefore, the process of obtaining high-quality pictures through manual comparison and screening is saved, and the operation complexity of the user is reduced.

Optionally, the synthesis module 602 may include:

the identification unit is used for respectively identifying the picture characteristics in each first picture and the characteristic identification of the picture characteristics;

the determining unit is used for determining a third picture from the plurality of first pictures according to the picture characteristics in each first picture;

and the replacing unit is used for replacing the first picture characteristics in the third picture with the second picture characteristics in the fourth picture to obtain the second picture, wherein the first picture characteristics and the second picture characteristics are picture characteristics with the same characteristic identification, and the second picture quality of the second picture characteristics is higher than that of the first picture characteristics.

Optionally, the fourth picture comprises at least one of:

a first picture different from the third picture among the plurality of first pictures;

a picture stored in advance.

Optionally, the first display module 603 may include:

the first display unit is used for displaying the thumbnails of the first pictures and the thumbnails of the second pictures in an arranged manner, and displaying a first identifier for the thumbnails of the second pictures, wherein the thumbnails of the second pictures are displayed at the head.

Optionally, the image processing apparatus 600 may further include:

the determining module is used for determining a target picture from the plurality of first pictures under the condition that the first picture quality of the second picture is lower than the first picture quality of at least one first picture, wherein the target picture is the first picture with the highest first picture quality in the plurality of first pictures;

the second display module is used for arranging and displaying the thumbnails of the first pictures and displaying a second identifier aiming at the thumbnails of the target picture; and the target pictures are arranged and displayed at preset positions.

Optionally, the image processing apparatus 600 may further include:

the third display module is used for displaying a picture browsing interface before acquiring a plurality of first pictures;

and the fourth display module is used for switching and displaying the picture selection interface used for acquiring the plurality of first pictures from the picture browsing interface under the condition of receiving the first input.

The image processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The image processing device provided in the embodiment of the present application can implement each process implemented by the image processing device in the embodiment of the image processing method, and is not repeated here to avoid repetition.

Optionally, as shown in fig. 7, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the above-mentioned image processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Fig. 8 is a hardware structure diagram of an electronic device implementing an embodiment of the present application.

The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.

Those skilled in the art will appreciate that the electronic device 800 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 810 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The input unit 804 is configured to acquire a plurality of first pictures, where each of the plurality of first pictures includes a first shooting object;

correspondingly, the processor 810 is configured to perform picture synthesis according to the plurality of first pictures to obtain a second picture;

a display unit 806, configured to display the second picture if a first picture quality of the second picture is higher than a first picture quality of each of the first pictures;

In the electronic device 800 provided by the embodiment of the application, a plurality of first pictures are acquired through the input unit 804; the processor 810 performs picture synthesis according to the plurality of first pictures to obtain a second picture; the display unit 806 displays the second picture when the first picture quality of the second picture is higher than the first picture quality of each first picture, where the first picture quality may be obtained by evaluating the pictures according to preset quality evaluation parameters; according to the method and the device, the second picture is obtained through picture synthesis, defects possibly existing in the first picture are compensated, the second picture is compared with the first picture based on the first picture quality, the displayed second picture is further guaranteed to have high picture quality, in addition, the process of obtaining high-quality pictures through manual comparison and screening is also saved, and the operation complexity of a user is reduced.

Optionally, the processor 810 may be further configured to identify a picture feature in each of the first pictures and a feature identifier of the picture feature;

Optionally, the fourth picture comprises at least one of:

a picture stored in advance.

Optionally, the display unit 806 may be further configured to arrange and display the thumbnails of the multiple first pictures and the thumbnails of the second pictures, and display a first identifier for the thumbnail of the second picture, where the thumbnail of the second picture is displayed at the head.

Optionally, the processor 810 may be further configured to determine, when the first picture quality of the second picture is lower than the first picture quality of at least one of the first pictures, a target picture from the multiple first pictures, where the target picture is a first picture with a highest first picture quality among the multiple first pictures;

correspondingly, the display unit 806 may be further configured to display thumbnails of the multiple first pictures in an arranged manner, and display a second identifier for the thumbnail of the target picture; and the target pictures are arranged and displayed at preset positions.

Optionally, the display unit 806 may be further configured to display a picture browsing interface;

It should be understood that in the embodiment of the present application, the input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics Processing Unit 8041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072. A touch panel 8071, also referred to as a touch screen. The touch panel 8071 may include two portions of a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 809 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned image processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above-mentioned embodiment of the image processing method, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An image processing method, comprising:

2. The method according to claim 1, wherein the picture composition from the plurality of first pictures to obtain a second picture comprises:

3. The method of claim 2, wherein the fourth picture comprises at least one of:

a picture stored in advance.

4. The method of claim 1, wherein the displaying the second picture comprises:

5. The method according to claim 1, wherein after the picture composition is performed according to the plurality of first pictures to obtain a second picture, the method further comprises:

6. A picture processing apparatus, comprising:

7. The apparatus of claim 6, wherein the synthesis module comprises:

8. The apparatus of claim 7, wherein the fourth picture comprises at least one of:

a picture stored in advance.

9. The apparatus of claim 6, wherein the first display module comprises:

10. The apparatus of claim 6, further comprising:

11. An electronic device, characterized in that the electronic device comprises: processor, memory and a program or instructions stored on the memory and executable on the processor, which when executed by the processor implement the steps of the picture processing method according to any of claims 1 to 5.

12. A readable storage medium, on which a program or instructions are stored, which, when executed by a processor, implement the steps of the picture processing method according to any one of claims 1 to 5.