CN112995502A

CN112995502A - Image processing method and device and electronic equipment

Info

Publication number: CN112995502A
Application number: CN202110169368.0A
Authority: CN
Inventors: 罗梓杰; 罗春晖
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2021-02-07
Filing date: 2021-02-07
Publication date: 2021-06-18
Anticipated expiration: 2041-02-07
Also published as: CN112995502B

Abstract

The application discloses an image processing method and device and electronic equipment, and belongs to the technical field of camera shooting. The method mainly comprises receiving a first input for taking a first image; responding to a first input, and controlling the shooting module to acquire a plurality of images according to the moving directions of a plurality of moving control lines under the condition that a first image meets a first preset condition, wherein each moving control line in the plurality of moving control lines controls the shooting module to have a different moving direction; and determining an abnormal area in the first image according to the movement tracks of the abnormal points in the plurality of images. The method provided by the embodiment of the application can solve the problem that the abnormal light spot cannot be positioned at present.

Description

Image processing method and device and electronic equipment

Technical Field

The application belongs to the technical field of camera shooting, and particularly relates to an image processing method and device and electronic equipment.

Background

With the development of electronic devices, electronic devices with shooting functions become necessary equipment for people to record life, and are popular and used by people.

At present, in a scene of shooting a stronger light source by using electronic equipment, if the scene is shot directly by sunlight or a strong light at night, abnormal light spots can appear during imaging. If not located and eliminated, the resulting imaging quality is compromised. Therefore, how to locate the abnormal light spot becomes a problem which needs attention.

Disclosure of Invention

The embodiment of the application aims to provide an image processing method, an image processing device and electronic equipment, and the problem that abnormal light spots cannot be located at present can be solved.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides an image processing apparatus, which is applied to an electronic device, where the electronic device includes a shooting module, and the image processing apparatus includes:

a receiving module for receiving a first input for capturing a first image;

the control module is used for responding to a first input, controlling the shooting module to acquire a plurality of images according to the moving directions of the plurality of moving control lines under the condition that the first image meets a first preset condition, wherein the moving directions of each of the plurality of moving control lines for controlling the shooting module are different;

and the processing module is used for determining the abnormal area in the first image according to the movement tracks of the abnormal points in the plurality of images.

In a second aspect, an embodiment of the present application provides an image processing method, which is applied to an electronic device, where the electronic device includes a shooting module, and the image processing method includes:

receiving a first input to take a first image;

responding to a first input, and controlling the shooting module to acquire a plurality of images according to the moving directions of a plurality of moving control lines under the condition that a first image meets a first preset condition, wherein each moving control line in the plurality of moving control lines controls the shooting module to have a different moving direction;

and determining an abnormal area in the first image according to the movement tracks of the abnormal points in the plurality of images.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a shooting module, a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium on which a program or instructions are stored, which when executed by a processor implement the steps of the method as shown in the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, a plurality of images are acquired by controlling the shooting module to move along a plurality of movement control lines in different movement directions. Then, an abnormal region in the first image is determined based on the movement trajectory of the abnormal point in the plurality of images. The optical characteristics can be effectively utilized, namely, different light rays of images shot in different directions are different, the abnormal points in the multiple images are identified, and the abnormal area such as the abnormal light spots in the first image are positioned according to the moving track of the abnormal points in the multiple images, so that the abnormal light spots are eliminated in the later period, and the possibility is provided for improving the imaging quality.

Drawings

FIG. 1 is a schematic diagram of an abnormal light spot;

fig. 2 is a schematic view of an application scenario of an image processing method according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a shooting module according to an embodiment of the present disclosure;

fig. 4 is a flowchart of an image processing method according to an embodiment of the present application;

fig. 5 is a flowchart of an image processing method for determining an abnormal region in a first image based on a plurality of images according to an embodiment of the present application;

fig. 6 is a schematic diagram of a first image according to an embodiment of the present disclosure;

fig. 7 is a schematic diagram of a leftward moving image according to an embodiment of the present application;

fig. 8 is a schematic diagram of a rightward moving image according to an embodiment of the present application;

fig. 9 is a schematic diagram of an upward moving image according to an embodiment of the present application;

fig. 10 is a schematic diagram of a downward moving image according to an embodiment of the present application;

fig. 11 is a schematic diagram illustrating a position of an abnormal region in a first image according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 14 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

Currently, an electronic device includes a protective lens, a camera lens module, and a camera module of a CMOS image sensor (CMOS image sensor). Compared with a single-lens reflex camera, the protective lens enables some point light sources to have more primary light path reflection. As shown in fig. 1, in a photographing scene of a point light source such as a strong light at night or in direct sunlight, a point light source reaches one position of a CMOS image sensor through a protective lens of a lens in an electronic device and a camera lens module to form an image, and simultaneously, a part of light is reflected and refracted in a series of ways to form an image at another position of the CMOS image sensor, that is, at a position of an abnormal light spot.

Here, as shown in the schematic diagram of the imaging principle of the abnormal light spot shown in fig. 2, the point light source firstly passes through the protective lens, reflects a part of the point light source, and refracts another part of the point light source to pass through the protective lens and the camera lens module, and then reaches the position of the CMOS image sensor. At this time, position 1 is the normal representation of the point light source in the picture. Still another part of energy at the CMOS image sensor will return almost along the incident light path in a reflection form, such as the light path 21 (the thickened part) reaches the protection lens in fig. 2, and then the reflection reaches the CMOS image sensor through the camera lens module, because the center characteristic wavelength of the film coating on the surface of the camera lens module has the best effect on the middle section (such as green) of visible light, after a series of reflections, the imaging at the position 2 of the CMOS image sensor is often a green spot (commonly called "ghost"), which is the position of the abnormal light spot appearing during photographing.

Therefore, the embodiment of the application provides an image processing method of an abnormal light spot, and the image processing method can acquire a plurality of images by controlling the shooting module to move along a plurality of movement control lines in different movement directions. Then, an abnormal region in the first image is determined based on the movement trajectory of the abnormal point in the plurality of images. The optical characteristics can be effectively utilized, namely, different light rays of images shot in different directions are different, the abnormal points in the multiple images are identified, and the abnormal area such as the abnormal light spots in the first image are positioned according to the moving track of the abnormal points in the multiple images, so that the abnormal light spots are eliminated in the later period, and the possibility is provided for improving the imaging quality.

Based on this, the following describes in detail the image processing method provided by the embodiment of the present application through a specific embodiment and an application scenario thereof with reference to fig. 3.

The image processing method provided by the present application is applied to an electronic device, as shown in fig. 3, the electronic device includes a protective lens 30 and a shooting module 31. Here, the photographing module 31 may be a pan-tilt photographing module or a photographing module that can move a camera direction and/or angle. The camera module 31 is provided with a camera lens module 311 and an image sensor 321 such as a CMOS image sensor. The camera lens module 311 is disposed between the protective mirror 30 and the image sensor 321.

The method for processing the image of the abnormal flare provided in the embodiment of the present application will be described in detail with reference to the electronic device. When the user takes the first image, the electronic device identifies whether a point light source exists in the first image. If no point light source exists, image shooting is continued. If the point light source exists in the first image, the electronic equipment controls to close the cradle head anti-shake function of the cradle head shooting module, and controls the cradle head shooting module to acquire a plurality of images according to the moving directions of a plurality of moving control lines, wherein the moving directions of the shooting module are different according to each moving control line in the plurality of moving control lines. Because the imaging position of the abnormal light spot and the imaging position of the point light source are approximately in central symmetry, when the position of the shooting module 31 can be slightly shifted through a small angle, the change of the related picture of the first image is not large, but the offset of the abnormal light spot reflected by a plurality of rows can be far larger than that of the whole image, so that the abnormal area in the first image is determined according to the moving track of the abnormal point in the plurality of images by combining the shooting module 33 in the electronic equipment.

Then, the abnormal region in the first image may be removed to obtain an image to be filled, and the blank region image in the image to be filled is filled to obtain an image to be displayed, so as to display an image not including "ghost" to the user.

Therefore, the shooting module 31 can be applied, the optical characteristics can be flexibly utilized, and the characteristics of light path propagation and abnormal spot imaging are combined.

According to the application scenario, the following describes in detail the image processing method provided by the embodiment of the present application with reference to fig. 4 to 11.

Fig. 4 is a flowchart of an image processing method according to an embodiment of the present application.

As shown in fig. 4, the image processing method may be applied to an electronic device, and specifically may include the following steps based on this:

first, a first input to capture a first image is received, step 410. Next, in step 420, in response to the first input, in a case that the first image satisfies a first preset condition, the shooting module is controlled to obtain a plurality of images according to the moving directions of the plurality of movement control lines, where the moving directions of each of the plurality of movement control lines are different. Then, step 430, according to the moving tracks of the abnormal points in the plurality of images, the abnormal area in the first image is determined.

Thus, a plurality of images are acquired by controlling the shooting module to move along a plurality of movement control lines in different moving directions. Then, an abnormal region in the first image is determined based on the movement trajectory of the abnormal point in the plurality of images. The optical characteristics can be effectively utilized, namely, different light rays of images shot in different directions are different, the abnormal points in the multiple images are identified, and the abnormal area such as the abnormal light spots in the first image are positioned according to the moving track of the abnormal points in the multiple images, so that the abnormal light spots are eliminated in the later period, and the possibility is provided for improving the imaging quality.

The above steps are described in detail below, specifically as follows:

first, after step 410 is involved, the embodiment of the present application provides two ways to determine whether the first image satisfies the first preset condition, which are specifically as follows:

in one or more alternative embodiments, before this step, the image processing method may further include:

performing photometry on at least one area in the first image;

and determining that the first image meets a first preset condition under the condition that the brightness value of the target area in the at least one area is greater than or equal to a second preset threshold value.

For example, when a user takes an image, the user may perform photometry on each area in the image, so as to detect whether a certain area or a subject in the image has a higher brightness value than other areas, that is, a phenomenon of single-point overexposure, to determine whether a point light source is in the image. Therefore, if the brightness value of a certain area in the first image, such as the target area, is greater than or equal to the second preset threshold value, the existence of the point light source in the image can be proved; on the contrary, if the brightness value of any one region in the first image is smaller than the second preset threshold, it can be proved that no point light source exists in the image.

Alternatively, in another or various alternative embodiments, before this step, the image processing method may further include:

determining an exposure scale value for taking a first image;

and under the condition that the exposure scale value is greater than or equal to a third preset threshold value, determining that the first image meets a first preset condition.

For example, it may be detected whether the exposure scale value of the first image is greater than or equal to a third preset threshold value according to the exposure scale value when the first image is captured. If the exposure scale value is greater than or equal to a third preset threshold value, the point light source in the image can be proved to exist; on the contrary, if the exposure scale value is smaller than the third preset threshold, it can be proved that no point light source exists in the image.

Referring to step 420, in the embodiment of the present application, the following manner is provided to acquire a plurality of images to determine an abnormal area in the first image according to the moving track of the abnormal point in the plurality of images.

In one or more alternative embodiments, in the case that the plurality of movement control lines include a first movement control line and a second movement control line, and the plurality of images include a second image and a third image, step 420 may specifically include:

controlling the shooting module to acquire a second image along a first moving direction of the first moving control line;

and after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to acquire a third image along the second moving direction of the second moving control line. The first moving direction may be a direction parallel to the horizon, and the second moving direction may be a direction perpendicular to the horizon.

For example, the shooting module is controlled to move leftwards or rightwards along the direction of the first movement control line, which is parallel to the horizon, so as to acquire a second image; and after the shooting module is controlled to reset to the initial position, the shooting module is controlled to obtain a third image along the direction of the second movement control line, which is vertical to the horizontal line.

Similarly, the position for shooting the first image can be used as an initial position, and the shooting module is controlled to rotate leftwards or rightwards along the direction of the first movement control line, which is parallel to the horizon, so as to obtain a second image; and after the shooting module is controlled to reset to the initial position, the shooting module is controlled to take the position of shooting the first image as the initial position, and a third image is acquired along the direction of the second moving control line, which is vertical to the horizontal line.

In another or multiple optional embodiments, in the case that the movement angle of each of the plurality of movement control lines for moving the shooting module is the same, step 420 may specifically include:

controlling the shooting module to move along the first moving direction and the target moving angle to acquire a second image;

and after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to move along the second moving direction and the target moving angle to acquire a third image.

For example, the electronic device may use the position where the first image is captured as a starting position, control the capturing module to rotate the target by 30 degrees in a direction parallel to the horizon, such as by 30 degrees to the left and/or 30 degrees to the right, and obtain the second image; after the shooting module is controlled to reset to the initial position, the shooting module is controlled to take the position of the first image as the initial position, the target is moved by 30 degrees along the direction of the second movement control line, which is vertical to the horizon, for example, the target is moved by 30 degrees, or the target is moved by 30 degrees downwards, and a third image is acquired.

Or, under the condition that the movement angle of each of the plurality of movement control lines for moving the shooting module is different and the movement angle of each of the movement control lines for moving the shooting module meets the second preset condition, step 420 may specifically include:

controlling the shooting module to obtain a second image along a first moving direction and a first moving angle;

after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to move along a second moving direction and a second moving angle to obtain a third image;

the difference between the first movement angle and the second movement angle satisfies a first preset threshold.

For example, the electronic device may further control the shooting module to rotate by a first movement angle of 30 degrees, such as rotate by 30 degrees to the left and/or rotate by 30 degrees to the right, along a direction parallel to the horizon, with the position where the first image is shot as a starting position, to acquire a second image; after the shooting module is controlled to reset to the initial position, the shooting module is controlled to rotate by a second movement angle of 35 degrees, such as 35 degrees towards the horizon and/or 35 degrees downwards, along the direction of the second movement control line, which is vertical to the horizon, by taking the position of shooting the first image as the initial position, and a third image is acquired.

It should be noted that, in order to ensure that the moving trajectory of the abnormal point in the plurality of images moves in a smaller area as much as possible to improve the accuracy of determining the abnormal area in the first image, when setting the first moving angle and the second moving angle, the difference between the two moving angles may be controlled not to be excessively large, for example, the difference is less than or equal to 10 degrees.

Next, step 430 is involved, which may specifically include:

identifying a fourth image and a fifth image of the plurality of images, determining at least one moving first point;

determining a first abnormal point of which the movement track meets a third preset condition in at least one moving first point;

and determining an abnormal area in the first image according to the first moving track of the first abnormal point in the fourth image and the fifth image.

For example, the fourth image and the fifth image are compared to screen the first point a with a larger motion trajectory. And if the similarity between the movement track 1 of the first point A in the fourth image and the movement track 2 of the first point B in the fifth image is greater than the first preset similarity, determining an abnormal area in the first image according to the overlapped part of the movement tracks 1 and 2. In some possible embodiments, the fourth image may be the second image or the third image shown in the foregoing, and the fifth image may also be the second image or the third image described in the foregoing. And if the fourth image is the second image, the fifth image is the third image.

In addition, in some embodiments of the present application, in order to improve the accuracy of locating the abnormal region, the module may be controlled to acquire images of each direction along a plurality of directions, for example, a starting position of a position where the first image is captured, a first moving angle, such as left and right, and a second moving angle, such as up and down, to determine the abnormal region in the first image according to a moving track of the abnormal point in at least 4 images, and thus the step 430 may specifically include:

identifying a sixth image and a seventh image of the plurality of images, determining at least one moving second point;

determining a second abnormal point of which the moving track meets a fourth preset condition in at least one moving second point;

and determining an abnormal area in the first image according to a connecting line area of the second movement track and the first movement track of the second abnormal point in the sixth image and the seventh image.

For example, the sixth image and the seventh image are compared to screen the second point B with a larger motion trajectory. And if the similarity between the moving track 3 of the second point C in the sixth image and the moving track 3 of the second point D in the seventh image is greater than a second preset similarity, determining an abnormal area in the first image according to a connecting line area of the second moving track and the first moving track of the second abnormal point in the sixth image and the seventh image.

In order to better describe the image processing method provided by the above embodiment in detail, the embodiment of the present application, with reference to fig. 5 to 11 as an example, describes the image processing method provided by the embodiment in detail.

As shown in fig. 5, the image processing method for determining an abnormal region in a first image based on a plurality of images may specifically include steps 501 to 540.

Step 510, a first input of a user to capture a first image is received.

Ori, as shown in fig. 6, is a first image taken by the user, which is a current image, and the first image includes an abnormal spot.

Step 520, in response to the first input, performing photometry on at least one region in the first image, and determining whether a brightness value of a target region in the at least one region is greater than or equal to a second preset threshold.

Here, in a case where the brightness value of the target region in the at least one region is greater than or equal to a second preset threshold, it is determined that the point light source is included in the first image, and step 530 is performed.

And under the condition that the brightness value of the target area in at least one area is smaller than a second preset threshold value, determining that the point light source is not included in the first image, and normally photographing.

And step 530, controlling the shooting module to acquire a plurality of images according to the moving directions of the plurality of moving control lines.

The electronic device controls the shooting module to take the position of shooting the first image as an initial position, and as shown in fig. 7, the shooting module rotates to the left by an angle a in a direction parallel to the horizon, and records image information img.left; and as shown in fig. 8, the image information img.right is recorded by rotating the image sensor a angle to the right after returning to the initial position. Then, the electronic device controls the shooting module to take the position of shooting the first image as the initial position, and as shown in fig. 9, the shooting module rotates upwards by an angle a in the direction perpendicular to the horizon, and records the image signal img.up; as shown in fig. 10, the image information img.down is recorded by rotating the image back to the initial position by an angle a.

And step 540, determining an abnormal area in the first image according to the movement tracks of the abnormal points in the plurality of images.

Comparing the abnormal light spot position 1, the abnormal light spot position 2, the abnormal light spot position 3 and the abnormal light spot position 4 in the four rotated images with the abnormal light spot in the first image, as shown in fig. 11, connecting the movement tracks of the abnormal light spots, namely connecting the abnormal light spot position 2 with the abnormal light spot position 3, and connecting the abnormal light spot position 4 with the abnormal light spot position, wherein the overlapping part of the two-time connecting areas is the area where the abnormal light spot position 5 in the first image is located.

In step 550, the abnormal region in the first image is removed to obtain the image to be filled.

And step 560, filling the blank area in the image to be filled to obtain an image to be displayed, so as to display the image without the abnormal light spot to a user.

And filling the blank area image in the image to be filled by using the area corresponding to the blank area in any image of the four images to obtain the image to be displayed.

Or, the other blank area images in the first image can be filled with the other blank area images in the first image in an image processing mode to obtain the image to be displayed.

In summary, in the embodiment of the present application, the plurality of images are obtained by controlling the shooting module to move along the plurality of movement control lines in different movement directions. Then, an abnormal region in the first image is determined based on the movement trajectory of the abnormal point in the plurality of images. The optical characteristics can be effectively utilized, namely, different light rays of images shot in different directions are different, the abnormal points in the multiple images are identified, and the abnormal area such as the abnormal light spots in the first image are positioned according to the moving track of the abnormal points in the multiple images, so that the abnormal light spots are eliminated in the later period, and the possibility is provided for improving the imaging quality.

It should be noted that, in the image processing method provided in the embodiment of the present application, the execution subject may be an image processing apparatus, or a control module for executing the method of image processing in the image processing apparatus. The image processing apparatus provided in the embodiment of the present application is described with an example in which an image processing apparatus executes an image processing method.

Based on the same inventive concept, the application also provides an image processing device. The details are described with reference to fig. 12.

Fig. 12 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.

As shown in fig. 12, the image processing apparatus 120 is applied to an electronic device, and may specifically include:

a receiving module 1201, configured to receive a first input for capturing a first image;

the control module 1202 is configured to, when the first image meets a first preset condition, control the shooting module to obtain a plurality of images according to the moving directions of the plurality of movement control lines, where the moving directions of each of the plurality of movement control lines are different;

the processing module 1203 is configured to determine an abnormal area in the first image according to the movement tracks of the abnormal points in the multiple images.

Therefore, a plurality of images can be acquired by controlling the shooting module to move along a plurality of movement control lines in different movement directions. Then, an abnormal region in the first image is determined based on the movement trajectory of the abnormal point in the plurality of images. The optical characteristics can be effectively utilized, namely, different light rays of images shot in different directions are different, the abnormal points in the multiple images are identified, and the abnormal area such as the abnormal light spots in the first image are positioned according to the moving track of the abnormal points in the multiple images, so that the abnormal light spots are eliminated in the later period, and the possibility is provided for improving the imaging quality.

The image processing apparatus 120 will be described in detail below, specifically as follows:

in some embodiments of the present application, the control module 1202 may be specifically configured to, when the plurality of movement control lines include a first movement control line and a second movement control line, and the plurality of images include a second image and a third image, control the shooting module to acquire the second image along a first movement direction of the first movement control line;

and after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to acquire a third image along the second moving direction of the second moving control line.

In other embodiments of the present application, the control module 1202 may be specifically configured to, under the condition that the movement angle of each of the plurality of movement control lines for moving the shooting module is the same, control the shooting module to move along the first movement direction and the target movement angle to obtain a second image;

In still other embodiments of the present application, the control module 1202 may be specifically configured to, when a moving angle of each of the plurality of moving control lines for moving the shooting module is different, and the moving angle of each of the plurality of moving control lines for moving the shooting module meets a second preset condition, control the shooting module to obtain a second image along the first moving direction and the first moving angle;

In some embodiments of the present application, the processing module 1203 provided in this application embodiment may be specifically configured to identify a fourth image and a fifth image in the multiple images, and determine at least one moving first point;

determining a first abnormal point of which the moving track meets a third preset condition in the first point;

Based on this, the image processing apparatus 120 provided in the embodiment of the present application may further include a recognition module, a first determination module, and a second determination module. The identification module is used for identifying a sixth image and a seventh image in the plurality of images and determining at least one moving second point; the first determining module is used for determining a second abnormal point of which the moving track meets a fourth preset condition in the second point; and the second determining module is used for determining the abnormal area in the first image according to the connecting line area of the second moving track and the first moving track of the second abnormal point in the sixth image and the seventh image.

In some embodiments, the image processing apparatus 120 provided in this embodiment of the present application may further include a removing module and a filling module; the removing module is used for removing the abnormal area in the first image to obtain an image to be filled; and the filling module is used for filling the blank area image in the image to be filled according to the fifth image and the fourth image to obtain the image to be displayed.

In some embodiments, the image processing apparatus 120 provided in this embodiment may further include a detection module and a third determination module. The detection module is used for performing photometry on at least one area in the first image; and the third determining module is used for determining that the first image meets the first preset condition under the condition that the brightness value of the target area in the at least one area is greater than or equal to the second preset threshold.

In some embodiments, the image processing apparatus 120 provided in this embodiment may further include a fourth determining module and a fifth determining module. The fourth determining module is used for determining an exposure scale value for shooting the first image; and the fifth determining module is used for determining that the first image meets the first preset condition under the condition that the exposure scale value is greater than or equal to the third preset threshold value.

The image processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in an electronic device. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The image processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments in fig. 1 to fig. 11, and is not described herein again to avoid repetition.

Optionally, as shown in fig. 13, an electronic device 1300 is further provided in an embodiment of the present application, and includes a processor 1301, a memory 1302, and a program or an instruction stored in the memory 1302 and executable on the processor 1301, where the program or the instruction is executed by the processor 1301 to implement each process of the embodiment of the image processing method, and can achieve the same technical effect, and no further description is provided here to avoid repetition.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic device and the non-mobile electronic device described above.

The electronic device 1400 includes, but is not limited to: a radio frequency unit 1401, a network module 1402, an audio output unit 1403, an input unit 1404, a sensor 1405, a display unit 1406, a user input unit 1407, an interface unit 1408, a memory 1409, a processor 1410, and a photographing module 1411.

Those skilled in the art will appreciate that the electronic device 1400 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1410 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 14 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.

In the embodiment of the present application, the user input unit 1407 is configured to receive a first input of capturing a first image; the processor 1410, configured to respond to a first input, and control the shooting module to obtain a plurality of images according to the moving directions of the plurality of movement control lines when the first image meets a first preset condition, where the moving directions of each of the plurality of movement control lines are different; and determining an abnormal area in the first image according to the movement tracks of the abnormal points in the plurality of images.

Therefore, a plurality of images are acquired by controlling the shooting module to move along a plurality of movement control lines in different movement directions. Then, an abnormal region in the first image is determined based on the movement trajectory of the abnormal point in the plurality of images. The optical characteristics can be effectively utilized, namely, different light rays of images shot in different directions are different, the abnormal points in the multiple images are identified, and the abnormal area such as the abnormal light spots in the first image are positioned according to the moving track of the abnormal points in the multiple images, so that the abnormal light spots are eliminated in the later period, and the possibility is provided for improving the imaging quality.

It is to be appreciated that the input Unit 1404 can include a Graphics Processing Unit (GPU) 14041 and a microphone 14042, the Graphics processor 14041 Processing image data of still pictures or video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 1406 may include a display panel 14061, and the display panel 14061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1407 includes a touch panel 14071 and other input devices 14072. Touch panel 14071, also referred to as a touch screen. The touch panel 14071 may include two parts of a touch detection device and a touch controller. Other input devices 14072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1409 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. The processor 1410 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1410. The photographing module 1411 in the embodiment of the present application includes a camera lens module and an image sensor such as a CMOS image sensor. The camera lens module is arranged between the protective lens and the image sensor and used for shooting images.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

In addition, an embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned embodiment of the image processing method, and the same technical effect can be achieved.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the methods of the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An image processing apparatus characterized by comprising:

a receiving module for receiving a first input for capturing a first image;

the control module is used for controlling the shooting module to acquire a plurality of images according to the moving directions of a plurality of moving control lines under the condition that the first image meets a first preset condition, wherein each moving control line in the plurality of moving control lines controls the shooting module to have a different moving direction;

and the processing module is used for determining an abnormal area in the first image according to the movement tracks of the abnormal points in the plurality of images.

2. The apparatus according to claim 1, wherein the control module is specifically configured to, in a case where the plurality of movement control lines include a first movement control line and a second movement control line, and the plurality of images include a second image and a third image, control the photographing module to acquire the second image along a first movement direction of the first movement control line;

and after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to obtain a third image along a second moving direction of the second moving control line.

3. The apparatus according to claim 2, wherein the control module is specifically configured to, in a case where a movement angle of each of the plurality of movement control lines moving the photographing module is the same, control the photographing module to obtain a second image along the first movement direction and the target movement angle;

and after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to obtain a third image along the second moving direction and the target moving angle.

4. The apparatus according to claim 2, wherein the control module is specifically configured to, in a case that a movement angle of each of the plurality of movement control lines for moving the photographing module is different, and the movement angle of each of the movement control lines for moving the photographing module satisfies a second preset condition, control the photographing module to obtain a second image along the first movement direction and the first movement angle;

after controlling the shooting module to reset to the position for shooting the first image, controlling the shooting module to move along the second moving direction and the second moving angle to obtain a third image;

5. The apparatus according to claim 1, wherein the processing module is specifically configured to identify a fourth image and a fifth image of the plurality of images, determine at least one moving first point;

determining a first abnormal point of which the movement track meets a third preset condition in the at least one moving first point;

and determining an abnormal area in the first image according to a first moving track of the first abnormal point in the fourth image and the fifth image.

6. The apparatus according to claim 5, wherein the image processing apparatus further comprises a recognition module, a first determination module, and a second determination module; wherein the content of the first and second substances,

the identification module is used for identifying a sixth image and a seventh image in the plurality of images and determining at least one moving second point;

the first determining module is configured to determine, among the at least one moving second point, a second outlier whose moving trajectory meets a fourth preset condition;

the second determining module is configured to determine an abnormal region in the first image according to a second movement trajectory of the second abnormal point in the sixth image and the seventh image and a connection line region of the first movement trajectory.

7. The apparatus according to claim 5, wherein the image processing apparatus further comprises a removal module and a filling module; wherein the content of the first and second substances,

the removing module is used for removing the abnormal area in the first image to obtain an image to be filled;

and the filling module is used for filling the blank area image in the image to be filled according to the fifth image and the fourth image to obtain the image to be displayed.

8. The apparatus according to claim 1, wherein the image processing apparatus further comprises a detection module and a third determination module; wherein the content of the first and second substances,

the detection module is used for performing photometry on at least one area in the first image;

the third determining module is configured to determine that the first image satisfies a first preset condition when the brightness value of the target area in the at least one area is greater than or equal to a second preset threshold.

9. The apparatus according to claim 1, wherein the image processing apparatus further comprises a fourth determination module and a fifth determination module; wherein the content of the first and second substances,

the fourth determining module is configured to determine an exposure scale value for capturing the first image;

the fifth determining module is configured to determine that the first image meets a first preset condition when the exposure scale value is greater than or equal to a third preset threshold.

10. An image processing method, comprising:

receiving a first input to take a first image;

responding to the first input, and controlling a shooting module to acquire a plurality of images according to the moving directions of a plurality of moving control lines under the condition that a first image meets a first preset condition, wherein each moving control line in the plurality of moving control lines controls the shooting module to have a different moving direction;