CN108540726B - Method and device for processing continuous shooting image, storage medium and terminal - Google Patents
Method and device for processing continuous shooting image, storage medium and terminal Download PDFInfo
- Publication number
- CN108540726B CN108540726B CN201810462742.4A CN201810462742A CN108540726B CN 108540726 B CN108540726 B CN 108540726B CN 201810462742 A CN201810462742 A CN 201810462742A CN 108540726 B CN108540726 B CN 108540726B
- Authority
- CN
- China
- Prior art keywords
- image
- area
- continuous shooting
- images
- background
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Abstract
The embodiment of the application discloses a method, a device, a storage medium and a terminal for processing continuous shooting images, wherein the method comprises the following steps: acquiring a main body area and a background area of a plurality of continuous shooting images in a continuous shooting image set; determining a first image and at least one second image according to a plurality of continuous shooting images, wherein the image quality of the first image is higher than that of the second image; performing a first storage operation on the main areas of the first image and a second image, wherein the second image is a continuous shooting image except the first image in the multiple continuous shooting images; performing a second storage operation on a background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation; when the second image is output, the second image is restored according to the background area of the first image and the main area of the second image, so that the occupied storage space can be reduced, and the utilization rate of system resources is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of mobile terminals, in particular to a method and a device for processing continuous shooting images, a storage medium and a terminal.
Background
With the continuous development of mobile terminals, a photographing application is set on the mobile terminal, and the photographing application includes a continuous shooting function. And after the user continuously shoots, the mobile terminal stores the continuously shot images.
And the terminal allocates storage space for the photo album in the storage space. The photo album storage space can store continuous photos obtained by photographing by the photographing application. However, the continuous shooting image occupies more storage space and system resources.
Disclosure of Invention
The embodiment of the application aims to provide a method and a device for processing continuous shooting images, a storage medium and a terminal, which can reduce the storage space occupied by the continuous shooting images and improve the utilization rate of system resources.
In a first aspect, an embodiment of the present application provides a method for processing continuously shot images, including:
acquiring a main body area and a background area of a plurality of continuous shooting images in a continuous shooting image set;
determining a first image and at least one second image according to a plurality of continuous shooting images, wherein the image quality of the first image is higher than that of the second image;
performing a first storage operation on a first image and a main body area of a second image, wherein the second image is a continuous shooting image except the first image in a plurality of continuous shooting images;
performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation;
and restoring the second image according to the background region of the first image and the main body region of the second image when the second image is output.
In a second aspect, an embodiment of the present application provides a device for processing continuous shooting images, including:
the acquisition module is used for acquiring a main area and a background area of a plurality of continuous shooting images in the continuous shooting image set;
the determining module is used for determining a first image and at least one second image according to the plurality of continuous shooting images acquired by the acquiring module, wherein the image quality of the first image is higher than that of the second image;
the first storage module is used for carrying out first storage operation on the first image determined by the determination module and the main body area of a second image, and the second image is a continuous shooting image except the first image in the multiple continuous shooting images;
the second storage module is used for performing second storage operation on the background area of the second image determined by the determination module, and the storage quality of the second storage operation is lower than that of the first storage operation;
and the output module is used for restoring the second image according to the background area of the first image and the main area of the second image when the second image is output.
In a third aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the processing method of the continuous shooting image as shown in the first aspect.
In a fourth aspect, an embodiment of the present application provides a terminal, which includes a memory, a processor, and a computer program stored on the memory and executable by the processor, and when the processor executes the computer program, the processor implements the method for processing a continuous shooting image as shown in the first aspect.
According to the processing scheme of the continuous shooting image provided by the embodiment of the application, a main area and a background area of a plurality of continuous shooting images in a continuous shooting image set are obtained at first; secondly, determining a first image and at least one second image according to the multiple continuous shooting images, wherein the image quality of the first image is higher than that of the second image; thirdly, performing first storage operation on the main areas of the first image and a second image, wherein the second image is a continuous shooting image except the first image in the plurality of continuous shooting images; and finally, performing second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation. When the second image is output, the second image is restored according to the background area of the first image and the main area of the second image, so that the image quality of the second image can be maintained, the occupied storage space can be reduced, and the utilization rate of system resources can be improved.
Drawings
Fig. 1 is a schematic flowchart of a method for processing a continuously shot image according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of another method for processing continuous shooting images according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of another method for processing continuous shooting images according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of another method for processing continuous shooting images according to an embodiment of the present disclosure;
fig. 5 is a schematic flowchart of another method for processing continuous shooting images according to an embodiment of the present disclosure;
fig. 6 is a schematic flowchart of another method for processing continuous shooting images according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a device for processing continuous shooting images according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
Detailed Description
The technical scheme of the application is further explained by the specific implementation mode in combination with the attached drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
With the continuous development of mobile terminals, a photographing application is set on the mobile terminal, and the photographing application includes a continuous shooting function. And after the user continuously shoots, the mobile terminal stores the continuously shot images. And the terminal allocates storage space for the photo album in the storage space. The photo album storage space can store continuous photos obtained by photographing by the photographing application. However, the continuous shooting image occupies more storage space and system resources. At present, a mobile terminal stores any one continuous shot image in continuous shot pictures shot by a user and other continuous shot images without difference.
The embodiment of the application provides a method for processing continuous shooting images, which can be used for identifying a main area and a background area of the continuous shooting images, performing first storage operation on the main area and the background area of one continuous shooting image in the continuous shooting images, performing first storage operation on the main areas of other continuous shooting images in the continuous shooting images, and performing second storage operation on the background areas of the other continuous shooting images. Because the storage quality of the second storage operation is lower than that of the first storage operation, the storage space occupied by the background area stored by the second storage operation is smaller than that of the background area stored by the first storage operation, so that the storage space occupied by the continuous shooting image is reduced, and the utilization rate of system resources is improved. The specific scheme is as follows:
fig. 1 is a schematic flow diagram of a method for processing a continuously shot image according to an embodiment of the present application, where the method is used in a situation where a terminal stores and displays the continuously shot image, and the method may be executed by a mobile terminal having a shooting function, where the shooting function includes the continuously shot function, and the mobile terminal may be a smart phone, a tablet computer, a wearable device, a notebook computer, or the like, where the shooting function may be a camera application configured in a factory of the mobile terminal, or a shooting function included in a third-party application, such as a shooting function included in an instant chat application, and the method specifically includes the following steps:
and step 110, acquiring a main body area and a background area of a plurality of continuous shooting images in the continuous shooting image set.
When the user continuously presses the photographing button in the photographing application for more than a preset time (such as 1 second), the photographing application continuously acquires a plurality of continuous photographing images according to a preset time interval (such as 0.2 second). Or, the user continuously clicks the photographing button by the finger, and the mobile terminal continuously acquires a plurality of continuously photographed images. And taking the obtained continuous shooting images as a continuous shooting image set.
The subject of the photographed image may include a portrait, a person, a still, or the like. The subject characteristics of the photographing subject can be configured in advance, and the photographing subject of the photographed image can be determined according to the subject characteristics. After the photographing subject is determined, a subject region corresponding to the photographing subject is acquired from the continuous shooting image.
Optionally, a machine learning model is set, and machine learning is performed by inputting a plurality of pictures and the main features marked in the pictures to obtain the machine learning model. And inputting the continuous shot pictures into the machine learning model to obtain the main body characteristics.
After the characteristics of the main body are determined, the contour line of the main body is determined, and the main body area is determined according to the contour line. The region other than the main region in the continuously shot image is set as a background region.
The body region may include one body object or may include a plurality of body objects. If a plurality of subject objects are included, a subject region corresponding to each subject object is acquired, and a region except the plurality of subject regions in the continuous shooting image is used as a background region.
The set of continuous shot images includes a plurality of continuous shot images including a first image and at least one second image. All of the continuous shots in the set of continuous shot images may be determined as a plurality of continuous shot images. In this case, a continuous shot image of the same subject may be acquired from the continuous shot image set, and the continuous shot image of the same subject may be determined as a plurality of continuous shot images.
Optionally, the quality of the first image and the quality of the second image are scored, and the first image with higher quality and the second image with lower quality are determined according to the scoring result. Further, only the subject region in the burst image may be subjected to quality scoring. Further, a final score is determined according to the overall image quality score and the subject region quality score. The final score is determined, for example, from the overall quality score and the average score of the subject region quality scores. Or a higher weight (e.g., 0.8) may be assigned to the subject region quality score and a lower weight (e.g., 0.2) may be assigned to the overall quality score, with the final score calculated by a weighted average. Quality scoring is performed based on quality scoring parameters including, but not limited to: image brightness, image sharpness, image exposure, or the like.
The image types of each image in the continuous shooting images are the same, such as High-dynamic range (HDR) images, or square images. And acquiring a default storage mode corresponding to the continuous shooting image, and taking the default storage mode as a first storage operation. The main area of the first image, the background area of the first image, and the main area of the second image are stored using a first storage operation. The default storage mode includes an image compression mode, an image storage structure, and the like.
And 140, performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation.
And determining a corresponding second storage operation according to the first storage operation, wherein the storage quality of the second storage operation is lower than that of the first storage operation. For example, the resolution of the second storage operation is lower than the resolution of the first storage operation. As another example, the second storage operation is lossy compression and the first storage operation is lossless compression.
In one implementation, the second storing operation may be omitted, i.e. the background region of the second image is not stored, only the body region of the second image is stored. At this time, a complete background area image may be determined according to the background area of the first image and the background area of the at least one second image. The whole background region image does not include the main body region, and all the background regions are background regions. And taking the complete background area image as the background area of the first image.
And 150, restoring the second image according to the background area of the first image and the main area of the second image when the second image is output.
In one implementation, a body region of the second image is filled into a background region of the first image. If an unfilled area exists, the unfilled area is patched using the background area of the first image. In another implementation, the body region of the second image is filled into the full background region image.
In the processing method of the continuously shot images provided in the embodiment of the application, a main area and a background area of a plurality of continuously shot images in a continuously shot image set are obtained first. Secondly, a first image and at least one second image are determined from the plurality of continuously shot images, the image quality of the first image being higher than the image quality of the second image. And thirdly, performing a first storage operation on the main areas of the first image and a second image, wherein the second image is a continuous shooting image except the first image in the plurality of continuous shooting images. And finally, performing second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation. And restoring the second image according to the background area of the first image and the main area of the second image, and outputting the restored second image when the continuous shooting image is output. Compared with the case that each continuous shooting image is stored in the same storage mode, the continuous shooting image processing method occupies more storage space, can store background areas of a plurality of second images by using second storage operation, and further can reduce the storage space of the second images. Meanwhile, when the second image is output, the second image is restored according to the background area of the first image and the main area of the second image, so that the storage space is reduced, and the image quality of the second image is improved.
Fig. 2 is a schematic flowchart of a method for processing a continuously shot image according to an embodiment of the present application, and as a further description of the foregoing embodiment, the method includes:
and step 210, acquiring a main body area and a background area of a plurality of continuous shooting images in the continuous shooting image set.
And step 220, acquiring the photographing parameters of each continuous shooting image in the plurality of continuous shooting images and the outline information of the main body area.
The photographing parameters include environmental parameters and optical parameters when photographing. The environment parameters include location information, ambient light information, time information, and the like. The optical parameters include brightness information, exposure information, white balance information, contrast information, and the like. Preferred optical parameters may be determined from the environmental parameters, and an image having optical parameters matching the environmental parameters may be selected from the burst images.
And determining the contour line of the main body area according to the jumping information of the pixel values of the pixels and the coordinate information of the pixels with the pixel value jumping. In the case of high-speed movement or large amplitude jitter or insufficient exposure, the problem of unclear contour lines can occur. Therefore, contour line information for indicating the definition of the contour lines can be determined from the contour lines.
Optionally, a continuous shooting image with clear outline of the main area is selected as the first image.
Optionally, the continuously shot image with the environmental parameter matched with the optical parameter is used as the first image according to the shooting parameter.
Furthermore, the screening can be performed according to the profile information of the main body region, and then the screening result is subjected to secondary screening based on the photographing parameters to determine the first image. And after the first image is determined, taking the images except the first image in the continuous shooting image set as second images. Further, an image identical to the first image subject object is searched from the images except the first image in the continuous shooting image set to be used as a second image.
And step 250, performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation.
And step 260, restoring the second image according to the background area of the first image and the main area of the second image when the second image is output.
The method for processing the continuous shooting image can determine the first image based on the shooting parameters and the outline information of the main body area, so that the accuracy of the first image is improved, and the processing efficiency is improved.
Fig. 3 is a schematic flowchart of a method for processing a continuously shot image according to an embodiment of the present application, which is used to further describe the foregoing embodiment, and includes:
and 310, acquiring the proportion of the face area in the main body area of each continuous shooting image in the plurality of continuous shooting images in the continuous shooting image set.
After the subject region is determined, it is determined whether a facial feature is present in the subject region. If facial features are present, a facial region is acquired. The proportion of the face area in the main body area in each continuous shooting image is calculated respectively. Optionally, the number of first pixel points covered by the main area and the number of second pixel points covered by the face area are obtained. The number of the first pixel points is obtained by dividing the number of the second pixel points by the number of the first pixel points.
And step 320, judging whether the proportion of the face area is larger than a preset proportion.
The predetermined ratio may be greater than 60%, and optionally 80%. If the proportion of the face area is greater than the predetermined proportion, step 330 is performed. Otherwise, if the proportion of the face area is less than or equal to the preset proportion, the step 340 is executed. If the user takes a self-timer, the proportion of the face area in the main body area is larger than the preset proportion.
And step 330, when the proportion of the face area is greater than the preset proportion, determining the face area as the main area.
And step 340, when the proportion of the face area is smaller than the preset proportion, determining the main area according to the content of the continuous shooting image.
The subject region may include a face region. Alternatively, the subject region may not be a portrait. And if the proportion of the face area is smaller than the preset proportion, taking the acquired main body area as the finally determined main body area.
And step 360, performing a first storage operation on the first image and a main body area of a second image, wherein the second image is a continuous shooting image except the first image in the multiple continuous shooting images.
And 380, restoring the second image according to the background area of the first image and the main area of the second image when the second image is output.
The processing method for the continuous shooting image, provided by the embodiment of the application, can identify a user self-shooting scene, namely, whether the face area is used as the main body area or not is determined according to whether the proportion of the face area in the main body area is larger than a preset proportion or not, so that the area of the main body area is reduced, the storage space occupied by the main body area is reduced, and the utilization rate of system resources is further improved.
Fig. 4 is a schematic flowchart of a method for processing a continuous shooting image according to an embodiment of the present application, and as a further description of the foregoing embodiment, the method includes:
and step 410, acquiring a main body area and a background area of a plurality of continuous shooting images in the continuous shooting image set.
The plurality of second images may be all of the second images or partial images in the second images. The background images of the multiple continuous photographs in the continuous photograph collection may be the same solid background or a fixed background of the object. At this time, the difference feature of the background area in each second image is smaller than the preset difference threshold. For example, the background image of the continuous shot image is a white wall, a red curtain, or the like.
The difference characteristic may be the number of pixels with different pixel values, and the corresponding preset difference threshold is a preset number of pixels, such as 50 pixels. The difference characteristic may also be a sum of pixel values of the pixels, and accordingly, the preset difference threshold is a preset pixel value, such as 200.
If the difference feature of the background areas of the plurality of second images is less than the preset difference threshold, step 450 is performed. Otherwise, if the difference feature of the background areas of the plurality of second images is greater than or equal to the preset difference threshold, step 470 is performed.
And step 450, selecting a third image from the plurality of second images when the difference characteristic of the background areas of the plurality of second images is smaller than a preset difference threshold value.
Optionally, any one of the second images is taken as the third image. Or selecting the image with the minimum difference characteristic with other images from the second images as the third image.
And step 460, determining the background area of the third image as a common background area of the plurality of second images to perform a second storage operation, wherein the storage quality of the second storage operation is lower than that of the first storage operation.
And acquiring a background area of the third image, and establishing an association relation between the third image and the plurality of second images. The jump proceeds to step 480.
Further, the background area of the third image may be optimized according to the second image and the selected third image. The optimization content is that the main area in the background area of the third image is filled according to the second image to obtain a background area image without the main area, so that when the main area of any second image is filled into the background area image, no blank area or ghost area exists.
And 470, when the difference features of the background areas of the plurality of second images are greater than a preset difference threshold, respectively performing a second storage operation on each second image.
And 480, restoring the second image according to the background area of the first image and the main area of the second image when the second image is output.
The method for processing the continuous shooting image, provided by the embodiment of the application, can select the background area of the third picture as the common background area according to the difference characteristics, further reduce the storage space occupied by the background area, and improve the utilization rate of storage resources.
Fig. 5 is a schematic flowchart of a method for processing a continuous shooting image according to an embodiment of the present application, and as a further description of the foregoing embodiment, the method includes:
and step 510, acquiring a main body area and a background area of a plurality of continuous shooting images in the continuous shooting image set.
And 540, performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation.
And 550, when the second image is output, restoring the second image according to the background area of the first image, the main body area of the second image and the background area of the second image.
Optionally, the background region does not include the main body region, and the background region is image data including the hollow region. And filling the main body area of the second image into the background area of the first image, and if the uncovered hollow-out area exists, filling the uncovered hollow-out area by using the background area of the second image.
Further, first, an overlap region and a bias region are determined from the background region of the first image and the background region of the second image. Then, the offset area is repaired based on the overlap area. And finally, restoring the second image according to the restoration result and the main body area of the second image.
And respectively acquiring pixel point coordinates in the background area of the first image and pixel point coordinates in the background area of the first image, and taking the area corresponding to the pixel point with overlapped coordinates as an overlapped area. The region included in the background region of the second image and not included in the background region of the first image is set as a bias region. And repairing the pixel value of the deviation area according to the pixel value of the overlapping area, so that the pixel value of the deviation area is consistent with the pixel value of the overlapping area. Then, the main body area of the second image is added to the restored background area of the first image, and the second image is restored.
The processing method for the continuous shooting image provided by the embodiment of the application can be used for restoring the second image by combining the background area of the second image, so that the image quality of the second image is improved.
Fig. 6 is a schematic flowchart of a method for processing a continuous shooting image according to an embodiment of the present application, and as a further description of the foregoing embodiment, the method includes:
And step 604, performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation.
And step 606, acquiring a pixel value interval of the reference area around the deviation area.
And acquiring a coordinate end value of the deviation area, and acquiring a circumscribed rectangle corresponding to the deviation area. And acquiring four reference rectangular areas adjacent to four sides of the circumscribed rectangle according to the circumscribed rectangle as reference areas. Furthermore, eight reference rectangular areas with the circumscribed rectangle as the center are used as reference areas, for example, the circumscribed rectangle is a central grid of the nine-grid, and the reference rectangular areas are the rest eight areas in the nine-grid.
Optionally, an average value of two end values of the pixel value interval is obtained, and the filling pixel value is determined according to the average value. And filling the deviation area by using the filling pixel value.
A fitting function of the pixel value change can be generated according to the pixel value and the pixel point coordinate. And determining the pixel value of the deviation area according to the fitting function and the pixel value of the edge of the deviation area.
And step 610, restoring the second image according to the restoration result and the main body area of the second image.
The processing method for the continuous shooting image, provided by the embodiment of the application, can fill the deviation area according to the reference area around the deviation area, and improve the restoration quality of the second image.
Fig. 7 is a schematic structural diagram of a device for processing continuous shooting images according to an embodiment of the present application. As shown in fig. 7, the apparatus includes: an acquisition module 710, a determination module 720, a first storage module 730, a second storage module 740, and an output module 750.
An obtaining module 710, configured to obtain a main area and a background area of multiple continuous shooting images in a continuous shooting image set;
a determining module 720, configured to determine a first image and at least one second image according to the multiple continuous-shot images acquired by the acquiring module 710, where the image quality of the first image is higher than that of the second image;
a first storage module 730, configured to perform a first storage operation on the first image determined by the determination module 720 and a main area of a second image, where the second image is a continuous shooting image other than the first image in the multiple continuous shooting images;
a second storage module 740, configured to perform a second storage operation on the background area of the second image determined by the determination module 720, where the storage quality of the second storage operation is lower than that of the first storage operation;
and an output module 750 for restoring the second image according to the background region of the first image and the main region of the second image when the second image is output.
Further, the determining module 720 is configured to:
acquiring photographing parameters of each continuous shooting image in a plurality of continuous shooting images and outline information of a main body area;
determining a first image according to the photographing parameters and the contour information of the main body region, and determining at least one second image according to the first image and the multiple continuous-shot images, wherein the second image is a continuous-shot image except the first image in the multiple continuous-shot images.
Further, the obtaining module 710 is configured to:
acquiring the proportion of a face area in a main body area of each continuous shooting image in a plurality of continuous shooting images in a continuous shooting image set;
and when the proportion of the face area is greater than the preset proportion, determining the face area as the main area.
Further, the second storage module 740 is configured to:
judging whether the difference characteristics of the background areas of the plurality of second images are smaller than a preset difference threshold value or not;
when the difference characteristic of the background areas of the plurality of second images is smaller than a preset difference threshold value, selecting a third image from the plurality of second images;
and determining the background area of the third image into a common background area of the plurality of second images to perform a second storage operation.
Further, the output module 750 is configured to:
and restoring the second image according to the background area of the first image, the main body area of the second image and the background area of the second image.
Further, the output module 750 is configured to:
determining an overlapping area and a deviation area according to the background area of the first image and the background area of the second image;
repairing the deviation area according to the overlapping area;
and restoring the second image according to the restoration result and the main body area of the second image.
Further, the output module 750 is configured to:
acquiring a pixel value interval of a reference area around the deviation area;
when the color difference of the pixel value interval is smaller than a preset color difference threshold value, filling a deviation area according to the pixel value interval;
when the color difference of the pixel value interval is larger than a preset color difference threshold value, the pixel change characteristic of the reference area is obtained, the pixel value change characteristic of the deviation area is determined according to the pixel change characteristic of the reference area, and the deviation area is filled according to the pixel value change characteristic of the deviation area and the pixel value interval of the reference area.
In the processing apparatus for continuously shot images provided in the embodiment of the present application, first, the obtaining module 710 obtains a main area and a background area of a plurality of continuously shot images in a continuously shot image set; secondly, the determining module 720 determines a first image and at least one second image from the set of continuously shot images, wherein the image quality of the first image is higher than that of the second image; thirdly, the first storage module 730 performs a first storage operation on the first image and a main area of a second image, wherein the second image is a continuous shooting image except the first image in the plurality of continuous shooting images; finally, the second storage module 740 performs a second storage operation on the background area of the second image, where the storage quality of the second storage operation is lower than that of the first storage operation. The output module 750 restores the second image according to the background region of the first image and the body region of the second image when the second image is output. Compared with the case that each continuous shooting image is stored in the same storage mode, the continuous shooting image processing method occupies more storage space, can store background areas of a plurality of second images by using second storage operation, and further can reduce the storage space of the second images. Meanwhile, when the second image is output, the second image is restored according to the background area of the first image and the main area of the second image, so that the storage space is reduced, and the image quality of the second image is improved.
The device can execute the methods provided by all the embodiments of the application, and has corresponding functional modules and beneficial effects for executing the methods. For details of the technology not described in detail in this embodiment, reference may be made to the methods provided in all the foregoing embodiments of the present application.
Fig. 8 is a schematic structural diagram of another terminal device provided in an embodiment of the present application. As shown in fig. 8, the terminal may include: a housing (not shown), a memory 801, a Central Processing Unit (CPU) 802 (also called a processor, hereinafter referred to as CPU), a computer program stored in the memory 801 and operable on the processor 802, a circuit board (not shown), and a power circuit (not shown). The circuit board is arranged in a space enclosed by the shell; the CPU802 and the memory 801 are provided on a circuit board; the power supply circuit is used for supplying power to each circuit or device of the terminal; a memory 801 for storing executable program code; the CPU802 executes a program corresponding to the executable program code by reading the executable program code stored in the memory 801.
The terminal further includes: peripheral interface 803, RF (Radio Frequency) circuitry 805, audio circuitry 806, speakers 811, power management chip 808, input/output (I/O) subsystem 809, touch screen 812, other input/control devices 810, and external port 804, which communicate over one or more communication buses or signal lines 807.
It should be understood that the illustrated terminal device 800 is merely one example of a terminal, and that the terminal device 800 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
The following describes in detail a terminal device provided in this embodiment, where the terminal device is a smart phone as an example.
Peripheral interface 803, peripheral interface 803 may connect input and output peripherals of the device to CPU802 and memory 801.
I/O subsystems 809, I/O subsystems 809 can connect input and output peripherals on the device, such as touch screen 812 and other input/control devices 810, to peripheral interface 803. The I/O subsystem 809 may include a display controller 8091 and one or more input controllers 8092 for controlling other input/control devices 810. Where one or more input controllers 8092 receive electrical signals from or transmit electrical signals to other input/control devices 810, other input/control devices 810 may include physical buttons (push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 8092 may be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.
The touch screen 812 may be a resistive type, a capacitive type, an infrared type, or a surface acoustic wave type, according to the operating principle of the touch screen and the classification of media for transmitting information. The touch screen 812 may be classified by installation method: external hanging, internal or integral. Classified according to technical principles, the touch screen 812 may be: a vector pressure sensing technology touch screen, a resistive technology touch screen, a capacitive technology touch screen, an infrared technology touch screen, or a surface acoustic wave technology touch screen.
The display controller 8091 in the I/O subsystem 809 receives electrical signals from the touch screen 812 or sends electrical signals to the touch screen 812. The touch screen 812 detects a contact on the touch screen, and the display controller 8091 converts the detected contact into an interaction with a user interface object displayed on the touch screen 812, that is, implements a human-computer interaction, and the user interface object displayed on the touch screen 812 may be an icon for running a game, an icon networked to a corresponding network, or the like. It is worth mentioning that the device may also comprise a light mouse, which is a touch sensitive surface that does not show visual output, or an extension of the touch sensitive surface formed by the touch screen.
The RF circuit 805 is mainly used to establish communication between the smart speaker and a wireless network (i.e., a network side), and implement data reception and transmission between the smart speaker and the wireless network. Such as sending and receiving short messages, e-mails, etc.
The audio circuit 806 is mainly used to receive audio data from the peripheral interface 803, convert the audio data into an electric signal, and transmit the electric signal to the speaker 811.
And the power management chip 808 is used for supplying power and managing power to the hardware connected with the CPU802, the I/O subsystem and the peripheral interface.
In this embodiment, the cpu802 is configured to:
acquiring a main body area and a background area of a plurality of continuous shooting images in a continuous shooting image set;
determining a first image and at least one second image according to a plurality of continuous shooting images, wherein the image quality of the first image is higher than that of the second image;
performing a first storage operation on a first image and a main body area of a second image, wherein the second image is a continuous shooting image except the first image in a plurality of continuous shooting images;
performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation;
and restoring the second image according to the background region of the first image and the main body region of the second image when the second image is output.
Further, determining the first image and the at least one second image from the plurality of consecutively taken images comprises:
acquiring photographing parameters of each continuous shooting image in a plurality of continuous shooting images and outline information of a main body area;
determining a first image according to the photographing parameters and the contour information of the main body region;
and determining at least one second image according to the first image and the multiple continuous shooting images, wherein the second image is a continuous shooting image except the first image in the multiple continuous shooting images.
Further, acquiring a main area and a background area of a plurality of continuous shooting images in the continuous shooting image set includes:
acquiring the proportion of a face area in a main body area of each continuous shooting image in a plurality of continuous shooting images in a continuous shooting image set;
and when the proportion of the face area is greater than the preset proportion, determining the face area as the main area.
Further, the second storing operation is performed on the background area of the second image, and includes:
judging whether the difference characteristics of the background areas of the plurality of second images are smaller than a preset difference threshold value or not;
when the difference characteristic of the background areas of the plurality of second images is smaller than a preset difference threshold value, selecting a third image from the plurality of second images;
and determining the background area of the third image as the common background area of the plurality of second images to perform a second storage operation.
Further, restoring the second image according to the background region of the first image and the main body region of the second image includes:
and restoring the second image according to the background area of the first image, the main body area of the second image and the background area of the second image.
Further, restoring the second image according to the background region of the first image, the main body region of the second image, and the background region of the second image, includes:
determining an overlapping area and a deviation area according to the background area of the first image and the background area of the second image;
repairing the deviation area according to the overlapping area;
and restoring the second image according to the restoration result and the main body area of the second image.
Further, repairing the deviation area according to the overlapping area includes:
acquiring a pixel value interval of a reference area around the deviation area;
when the color difference of the pixel value interval is smaller than a preset color difference threshold value, filling a deviation area according to the pixel value interval;
when the color difference of the pixel value interval is larger than a preset color difference threshold value, the pixel change characteristic of the reference area is obtained, the pixel value change characteristic of the deviation area is determined according to the pixel change characteristic of the reference area, and the deviation area is filled according to the pixel value change characteristic of the deviation area and the pixel value interval of the reference area.
The embodiment of the present application further provides a storage medium containing terminal device executable instructions, where the terminal device executable instructions are executed by a terminal device processor to perform a processing method for continuously shooting images, and the method includes:
acquiring a main body area and a background area of a plurality of continuous shooting images in a continuous shooting image set;
determining a first image and at least one second image according to a plurality of continuous shooting images, wherein the image quality of the first image is higher than that of the second image;
performing a first storage operation on a first image and a main body area of a second image, wherein the second image is a continuous shooting image except the first image in a plurality of continuous shooting images;
performing a second storage operation on the background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation;
and restoring the second image according to the background region of the first image and the main body region of the second image when the second image is output.
Further, determining the first image and the at least one second image from the plurality of consecutively taken images comprises:
acquiring photographing parameters of each continuous shooting image in a plurality of continuous shooting images and outline information of a main body area;
determining a first image according to the photographing parameters and the contour information of the main body region;
and determining at least one second image according to the first image and the multiple continuous shooting images, wherein the second image is a continuous shooting image except the first image in the multiple continuous shooting images.
Further, acquiring a main area and a background area of a plurality of continuous shooting images in the continuous shooting image set includes:
acquiring the proportion of a face area in a main body area of each continuous shooting image in a plurality of continuous shooting images in a continuous shooting image set;
and when the proportion of the face area is greater than the preset proportion, determining the face area as the main area.
Further, the second storing operation is performed on the background area of the second image, and includes:
judging whether the difference characteristics of the background areas of the plurality of second images are smaller than a preset difference threshold value or not;
when the difference characteristic of the background areas of the plurality of second images is smaller than a preset difference threshold value, selecting a third image from the plurality of second images;
and determining the background area of the third image as the common background area of the plurality of second images to perform a second storage operation.
Further, restoring the second image according to the background region of the first image and the main body region of the second image includes:
and restoring the second image according to the background area of the first image, the main body area of the second image and the background area of the second image.
Further, restoring the second image according to the background region of the first image, the main body region of the second image, and the background region of the second image, includes:
determining an overlapping area and a deviation area according to the background area of the first image and the background area of the second image;
repairing the deviation area according to the overlapping area;
and restoring the second image according to the restoration result and the main body area of the second image.
Further, repairing the deviation area according to the overlapping area includes:
acquiring a pixel value interval of a reference area around the deviation area;
when the color difference of the pixel value interval is smaller than a preset color difference threshold value, filling a deviation area according to the pixel value interval;
when the color difference of the pixel value interval is larger than a preset color difference threshold value, the pixel change characteristic of the reference area is obtained, the pixel value change characteristic of the deviation area is determined according to the pixel change characteristic of the reference area, and the deviation area is filled according to the pixel value change characteristic of the deviation area and the pixel value interval of the reference area.
The computer storage media of the embodiments of the present application may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
Of course, the storage medium provided in the embodiments of the present application and containing computer-executable instructions is not limited to the above-described application recommendation operation, and may also perform related operations in the application recommendation method provided in any embodiment of the present application.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims (10)
1. A method for processing continuous shooting images is characterized by comprising the following steps:
acquiring a main body area and a background area of a plurality of continuous shooting images in a continuous shooting image set;
determining a first image and at least one second image according to the multiple continuous shooting images, wherein the image quality of the first image is higher than that of the second image;
performing a first storage operation on the first image, and performing a first storage operation on a main body area of a second image, wherein the second image is a continuous shooting image except the first image in the plurality of continuous shooting images;
performing a second storage operation on a background area of the second image, wherein the storage quality of the second storage operation is lower than that of the first storage operation;
restoring the second image according to a background region of the first image and a body region of the second image when the second image is output.
2. The method for processing continuous shooting images according to claim 1, wherein the determining a first image and at least one second image from the plurality of continuous shooting images comprises:
acquiring photographing parameters of each continuous shooting image in the plurality of continuous shooting images and outline information of a main body area;
determining a first image according to the photographing parameters and the outline information of the main body region;
and determining at least one second image according to the first image and the multiple continuous shooting images, wherein the second image is a continuous shooting image except the first image in the multiple continuous shooting images.
3. The method for processing the continuous shooting image according to claim 1, wherein the acquiring the main area and the background area of the plurality of continuous shooting images in the continuous shooting image set comprises:
acquiring the proportion of a face area in a main body area of each continuous shooting image in a plurality of continuous shooting images in a continuous shooting image set;
and when the proportion of the face area is greater than the preset proportion, determining the face area as a main area.
4. The method for processing the continuous shooting image according to claim 1, wherein the second storing operation on the background area of the second image comprises:
when the difference features of the background areas of the plurality of second images are smaller than a preset difference threshold value, selecting a third image from the plurality of second images;
and determining the background area of the third image as the common background area of the plurality of second images to perform a second storage operation.
5. The method for processing the continuous shooting image according to claim 1, wherein restoring the second image according to the background region of the first image and the main body region of the second image comprises:
restoring the second image according to the background area of the first image, the main body area of the second image and the background area of the second image.
6. The method for processing the continuous shooting image according to claim 5, wherein the restoring the second image according to the background region of the first image, the main body region of the second image and the background region of the second image comprises:
determining an overlapping area and a deviation area according to the background area of the first image and the background area of the second image;
repairing the deviation area according to the overlapping area;
and restoring the second image according to the restoration result and the main body area of the second image.
7. The method for processing the continuous shooting image according to claim 6, wherein the repairing the deviation area according to the overlap area comprises:
acquiring a pixel value interval of a reference area around the deviation area;
when the color difference of the pixel value interval is smaller than a preset color difference threshold value, filling the deviation area according to the pixel value interval;
when the color difference of the pixel value interval is larger than a preset color difference threshold value, acquiring the pixel change characteristic of the reference area, determining the pixel value change characteristic of the deviation area according to the pixel change characteristic of the reference area, and filling the deviation area according to the pixel value change characteristic of the deviation area and the pixel value interval of the reference area.
8. A device for processing a continuous shooting image, comprising:
the acquisition module is used for acquiring a main area and a background area of a plurality of continuous shooting images in the continuous shooting image set;
the determining module is used for determining a first image and at least one second image according to the plurality of continuous shooting images acquired by the acquiring module, wherein the image quality of the first image is higher than that of the second image;
a first storage module, configured to perform a first storage operation on the first image determined by the determination module, and perform a first storage operation on a main area of a second image, where the second image is a continuous shooting image other than the first image in the multiple continuous shooting images;
a second storage module, configured to perform a second storage operation on the background area of the second image determined by the determination module, where a storage quality of the second storage operation is lower than that of the first storage operation;
and the output module is used for restoring the second image according to the background area of the first image and the main area of the second image when the second image is output.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of processing a continuously shot image as claimed in any one of claims 1 to 7.
10. A terminal comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for processing a continuously shot image according to any one of claims 1 to 7 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810462742.4A CN108540726B (en) | 2018-05-15 | 2018-05-15 | Method and device for processing continuous shooting image, storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810462742.4A CN108540726B (en) | 2018-05-15 | 2018-05-15 | Method and device for processing continuous shooting image, storage medium and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108540726A CN108540726A (en) | 2018-09-14 |
| CN108540726B true CN108540726B (en) | 2020-05-05 |
Family
ID=63477142
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810462742.4A Active CN108540726B (en) | 2018-05-15 | 2018-05-15 | Method and device for processing continuous shooting image, storage medium and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108540726B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110933312B (en) * | 2019-12-09 | 2021-07-06 | Oppo广东移动通信有限公司 | Photographing control method and related product |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101335819A (en) * | 2008-08-06 | 2008-12-31 | 中兴通讯股份有限公司 | Continuous photo processing apparatus, method and image processing apparatus |
| CN101431607A (en) * | 2007-11-06 | 2009-05-13 | 华晶科技股份有限公司 | Method and system for selecting better shooting images |
| CN103607533A (en) * | 2013-12-03 | 2014-02-26 | 厦门美图移动科技有限公司 | Photographing method and device suitable for zero-lag shutter |
| CN105531988A (en) * | 2013-09-09 | 2016-04-27 | 苹果公司 | Automated selection of keeper images from a burst photo captured set |
| CN105654463A (en) * | 2015-11-06 | 2016-06-08 | 乐视移动智能信息技术（北京）有限公司 | Image processing method applied to continuous shooting process and apparatus thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170109367A1 (en) * | 2015-10-16 | 2017-04-20 | International Business Machines Corporation | Early compression related processing with offline compression |
-
2018
- 2018-05-15 CN CN201810462742.4A patent/CN108540726B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101431607A (en) * | 2007-11-06 | 2009-05-13 | 华晶科技股份有限公司 | Method and system for selecting better shooting images |
| CN101335819A (en) * | 2008-08-06 | 2008-12-31 | 中兴通讯股份有限公司 | Continuous photo processing apparatus, method and image processing apparatus |
| CN105531988A (en) * | 2013-09-09 | 2016-04-27 | 苹果公司 | Automated selection of keeper images from a burst photo captured set |
| CN103607533A (en) * | 2013-12-03 | 2014-02-26 | 厦门美图移动科技有限公司 | Photographing method and device suitable for zero-lag shutter |
| CN105654463A (en) * | 2015-11-06 | 2016-06-08 | 乐视移动智能信息技术（北京）有限公司 | Image processing method applied to continuous shooting process and apparatus thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108540726A (en) | 2018-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3579544B1 (en) | Electronic device for providing quality-customized image and method of controlling the same | |
| WO2019184889A1 (en) | Method and apparatus for adjusting augmented reality model, storage medium, and electronic device | |
| CN110059685B (en) | Character area detection method, device and storage medium | |
| CN104869305B (en) | Method and apparatus for processing image data | |
| CN108989678B (en) | Image processing method and mobile terminal | |
| KR102566998B1 (en) | Apparatus and method for determining image sharpness | |
| CN109040524B (en) | Artifact eliminating method and device, storage medium and terminal | |
| WO2018120238A1 (en) | File processing device and method, and graphical user interface | |
| CN109040523B (en) | Artifact eliminating method and device, storage medium and terminal | |
| CN108665510B (en) | Rendering method and device of continuous shooting image, storage medium and terminal | |
| CN108668086B (en) | Automatic focusing method and device, storage medium and terminal | |
| CN107810472B (en) | Electronic device and method for controlling display of panoramic image | |
| CN108881875B (en) | Image white balance processing method and device, storage medium and terminal | |
| CN109495616B (en) | Photographing method and terminal equipment | |
| CN110442521B (en) | Control unit detection method and device | |
| CN110290426B (en) | Method, device and equipment for displaying resources and storage medium | |
| CN113038165B (en) | Method, apparatus and storage medium for determining encoding parameter set | |
| CN109104578B (en) | Image processing method and mobile terminal | |
| CN111290896A (en) | Server pressure testing method, device, equipment and medium | |
| CN111325220B (en) | Image generation method, device, equipment and storage medium | |
| CN114782296B (en) | Image fusion method, device and storage medium | |
| CN111083386B (en) | Image processing method and electronic device | |
| CN110807769B (en) | Image display control method and device | |
| CN109040729B (en) | Image white balance correction method and device, storage medium and terminal | |
| CN109302563B (en) | Anti-shake processing method and device, storage medium and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |