JP6803473B2 - Image processing methods and equipment, as well as non-temporary computer-readable storage media - Google Patents

Description

The present disclosure relates to image processing techniques, in particular to image processing methods, image processing devices, and non-temporary computer-readable storage media.

In existing blur algorithms, such as blurring the background of a portrait photo, the blur software algorithm typically uses a fuzzy algorithm to blur the light source on the photo. The fuzzy algorithm is a calculation that averages the brightness of the pixels of the light source. The light source appears dark on the photograph and can have an adverse effect.

The embodiments of the present disclosure aim to solve at least one of the technical problems existing in the related technology to at least to some extent. Therefore, embodiments of the present disclosure are required to provide image processing methods, image processing devices, and non-temporary computer-readable storage media.

The present disclosure provides an image processing method that includes the following steps:
(A) Acquire the first image corresponding to the first photography parameter;
(B) Acquire a second image having the same scene as the first image, which corresponds to the second photography parameter;
(C) Blur the first image and obtain a blurred first image;
(D) Define the part to be replaced of the blurred first image corresponding to the overexposed part of the first image;
(E) Acquire the replacement portion of the second image corresponding to the replacement target portion; and (f) Replace the replacement target portion of the blurred first image with the replacement portion of the second image to obtain the merged image. To do.

The present disclosure provides an image processing apparatus including:
With the processor
A method that includes memory attached to a processor that contains multiple program instructions that can be executed by a processor that is configured to perform the method.
(A) Acquiring the first image corresponding to the first photography parameter;
(B) Acquiring a second image having the same scene as the first image, which corresponds to the second photography parameter;
(C) Blurring the first image to obtain a blurred first image;
(D) To define the replacement target portion of the blurred first image corresponding to the overexposed portion of the first image;
(E) Obtaining the replacement portion of the second image corresponding to the replacement target portion; and (f) Replacing the replacement target portion of the blurred first image with the replacement portion of the second image to obtain the merged image. Including to get.

The present disclosure provides a non-temporary computer-readable storage medium that stores an instruction for executing an image processing method according to the above-mentioned image processing method when an electronic device executes an instruction using a processor.

In the aspects of the image processing method and apparatus according to the present disclosure, two images are captured, one is an in-focus image and the other is an out-of-focus image, which corresponds to an overexposed portion of the in-focus image. The material portion of the image is extracted and merged into a blurred in-focus image to get a merged image with the actual flare effect. Excellent flare effect.

In another aspect of the image processing method and apparatus according to the present disclosure, two images are taken, one is an equiexposed image and the other is an underexposed image, and the two images are both blurred and , The brightness of the overexposed portion is increased, the corresponding false overexposed portion is extracted, and the overexposed portion of the blurred or other exposed image is replaced with the false overexposed portion, which has an actual flare effect. Merge into a blurred image. Excellent flare effect.

Further aspects and advantages of the present disclosure can be obtained in part as described below, as partially revealed by the description below, or by implementing the present disclosure.

The above and / or additional aspects and advantages of the present disclosure, together with the drawings, will be apparent and readily understood in the description of the embodiments below.

FIG. 1 is a flowchart of the image processing method of the present disclosure. FIG. 2 is a flowchart of the image processing method according to the first embodiment of the present disclosure. FIG. 3 is a block diagram showing an image processing apparatus according to the first embodiment of the present disclosure. FIG. 4 is a flowchart of the control method according to the first embodiment of the present disclosure. FIG. 5 is a block diagram showing a control device according to the first embodiment of the present disclosure. FIG. 6 is a block diagram showing an imaging device according to the first embodiment of the present disclosure. FIG. 7 is a block diagram showing an electronic device according to the first embodiment of the present disclosure. FIG. 8 is a schematic view showing a physical article of the electronic device shown in FIG. 7. FIG. 9 is a schematic view showing the workflow of the electronic device of the present disclosure. FIG. 10 is a flowchart of the image processing method of the second embodiment of the present disclosure. FIG. 11 is a block diagram showing an image processing apparatus according to a second embodiment of the present disclosure. FIG. 12 is a histogram of the in-focus image according to the present disclosure. FIG. 13 is a flowchart of the control method according to the second embodiment of the present disclosure. FIG. 14 is a block diagram showing a control device according to a second embodiment of the present disclosure. FIG. 15 is a block diagram showing an imaging device according to a second embodiment of the present disclosure. FIG. 16 is a block diagram showing an electronic device according to a second embodiment of the present disclosure. FIG. 17 is a flowchart of the image processing method according to the third embodiment of the present disclosure. FIG. 18 is a block diagram showing an image processing apparatus according to a third embodiment of the present disclosure. FIG. 19 is a flowchart of a control method according to a third embodiment of the present disclosure. FIG. 20 is a block diagram showing a control device according to a third embodiment of the present disclosure. FIG. 21 is a block diagram showing an imaging device according to a third embodiment of the present disclosure. FIG. 22 is a block diagram showing an electronic device according to a third embodiment of the present disclosure. FIG. 23 is a flowchart of the image processing method according to the fourth embodiment of the present disclosure. FIG. 24 is a block diagram showing an image processing apparatus according to a fourth embodiment of the present disclosure. FIG. 25 is a flowchart of the control method according to the fourth embodiment of the present disclosure. FIG. 26 is a block diagram showing a control device according to a fourth embodiment of the present disclosure. FIG. 27 is a block diagram showing an imaging device according to a fourth embodiment of the present disclosure. FIG. 28 is a block diagram showing an electronic device according to a fourth embodiment of the present disclosure. FIG. 29 is a flowchart according to some embodiments of the present disclosure, which controls an imaging device to output in-focus images and out-of-focus images of the same scene. FIG. 30 is a block diagram showing a control module according to some embodiments of the present disclosure. FIG. 31 is a flowchart of the image processing method according to the fifth embodiment of the present disclosure. FIG. 32 is a block diagram showing an image processing apparatus according to a fifth embodiment of the present disclosure. FIG. 33 is a flowchart of the control method according to the fifth embodiment of the present disclosure. FIG. 34 is a block diagram showing a control device according to a fifth embodiment of the present disclosure. FIG. 35 is a block diagram showing an imaging device according to a fifth embodiment of the present disclosure. FIG. 36 is a block diagram showing an electronic device according to a fifth embodiment of the present disclosure. FIG. 37 is a schematic diagram showing a workflow of the electronic device of the present disclosure. FIG. 38 is a flowchart of the image processing method according to the sixth embodiment of the present disclosure. FIG. 39 is a block diagram showing an image processing apparatus according to a sixth embodiment of the present disclosure. FIG. 40 is a flowchart of the control method according to the sixth embodiment of the present disclosure. FIG. 41 is a block diagram showing a control device according to a sixth embodiment of the present disclosure. FIG. 42 is a block diagram showing an imaging device according to a sixth embodiment of the present disclosure. FIG. 43 is a block diagram showing an electronic device according to a sixth embodiment of the present disclosure. FIG. 44 is a flowchart of the image processing method according to the seventh embodiment of the present disclosure. FIG. 45 is a block diagram showing an image processing apparatus according to a seventh embodiment of the present disclosure. FIG. 46 is a flowchart of the control method according to the seventh embodiment of the present disclosure. FIG. 47 is a block diagram showing a control device according to a seventh embodiment of the present disclosure. FIG. 48 is a block diagram showing an imaging device according to a seventh embodiment of the present disclosure. FIG. 49 is a block diagram showing an electronic device according to a seventh embodiment of the present disclosure. FIG. 50 is a flowchart of the image processing method according to the eighth embodiment of the present disclosure. FIG. 51 is a block diagram showing an image processing apparatus according to an eighth embodiment of the present disclosure. FIG. 52 is a flowchart of the control method according to the eighth embodiment of the present disclosure. FIG. 53 is a block diagram showing a control device according to an eighth embodiment of the present disclosure. FIG. 54 is a block diagram showing an imaging device according to an eighth embodiment of the present disclosure. FIG. 55 is a block diagram showing an electronic device according to an eighth embodiment of the present disclosure. FIG. 56 is a flowchart according to some embodiments of the present disclosure, which controls an imaging device to output an equally exposed image and an underexposed image of the same scene. FIG. 57 is a block diagram showing a control module according to some embodiments of the present disclosure. FIG. 58 is a flowchart according to some embodiments of the present disclosure, which controls an image pickup apparatus to output an equally exposed image and an underexposed image of the same scene. FIG. 59 is a block diagram showing a control module according to some embodiments of the present disclosure.

Hereinafter, embodiments of the present invention will be described in detail. Embodiments are shown in the accompanying drawings, and the same or similar reference numerals are shown throughout, as identical or similar components, or components having the same or similar function. The embodiments described below with reference to the accompanying drawings are exemplary and are used merely to illustrate this disclosure and should not be construed as a limitation of this disclosure.

In the description of the present disclosure, terms such as "first" and "second" are used herein for explanatory purposes to indicate relative significance or materiality. It is not intended to imply or imply the number of technical features shown. Therefore, the features defined by "first" and "second" can include one or more of these features. In the description of the present disclosure, "plurality" means two or more unless otherwise specified.

In the description of the present disclosure, unless otherwise specified or restricted, "mounted", "connected", "coupled", "fixed", etc. The terminology is widely used, for example, it can be a fixed connection, a removable connection, or an integral connection, which can be understood by one of ordinary skill in the art depending on the particular situation, with a mechanical or electrical connection. It should be noted that it can be a direct connection, an indirect connection via an intervening structure, or an internal communication of the two elements.

The following disclosures provide many different embodiments or examples for implementing the different structures of the present disclosure. To simplify this disclosure, the components and components of a particular example are described below. Obviously, they are merely examples and are not intended to limit this disclosure. Moreover, reference numerals and / or letters can be repeated in different examples of the present disclosure for the purposes of simplification and clarification without showing the relationships between the embodiments and / or configurations described. In addition, the present disclosure provides examples of various specific processes and materials, but those skilled in the art can understand the availability of other processes and / or the use of other materials.

The present disclosure relates to a plurality of embodiments of an image processing method, a plurality of embodiments of a control method, a plurality of embodiments of an image processing apparatus, a plurality of embodiments of a control apparatus, a plurality of embodiments of an imaging apparatus, and an electronic device. A plurality of embodiments are provided. The plurality of embodiments of the image processing method include sequence numbers, and a plurality of embodiments of the control method, a plurality of embodiments of the image processing apparatus, a plurality of embodiments of the control apparatus, a plurality of embodiments of the imaging apparatus, and an electronic device. Will be described below by a plurality of embodiments of. Each embodiment of the image processing method corresponds to an embodiment of a control method, an embodiment of an image processing device, an embodiment of a control device, an embodiment of an imaging device, and an embodiment of an electronic device. For example, the first embodiment of the image processing method includes a first embodiment of a control method, a first embodiment of an image processing device, a first embodiment of a control device, and a first embodiment of an imaging device. And corresponding to the first embodiment of the electronic device, the second embodiment of the image processing method is the second embodiment of the control method, the second embodiment of the image processing device, and the second embodiment of the control device. Corresponds to the second embodiment of the embodiment, the image pickup apparatus, and the second embodiment of the electronic device.

The present disclosure relates to an image processing method. The image processing method includes the following steps: (a) acquiring the first image corresponding to the first photographic parameter; (b) identical to the first image corresponding to the second photographic parameter. Acquire a second image with a scene; (c) Blur the first image and acquire a blurred first image; (d) Blurred first image corresponding to the overexposed portion of the first image Defines the replacement target portion of the image; (e) obtains the replacement target portion of the second image corresponding to the replacement target portion; and (f) replaces the replacement target portion of the blurred first image with the second image. Get the merged image by replacing with the replacement part.

The present disclosure relates to control methods. The control method is used to control the imaging device. The control method is to control the image pickup device to output the in-focus image and the out-of-focus image of the same scene, and to process the in-focus image and the out-of-focus image by using the image processing method described above. Including.

The present disclosure relates to an image processing apparatus. The image processor includes a processor and a memory containing a plurality of program instructions that can be executed by the processor connected to the processor and configured to perform the method. The method is to (a) obtain a first image corresponding to the first photography parameter; (b) a second image having the same scene as the first image corresponding to the second photography parameter. Acquiring an image; (c) Blurring the first image and acquiring a blurred first image; (d) Replacing the blurred first image corresponding to the overexposed portion of the first image To define the target part; (e) to obtain the replacement part of the second image corresponding to the replacement target part; and (f) to replace the blurred first image replacement target part with the second image replacement part. Includes replacing with to get the merged image.

The present disclosure relates to a control device. The control device is used to control the image pickup device. The control device includes a control module configured to control an image pickup device to output in-focus images and out-of-focus images of the same scene, and the above-mentioned image processing device that is electrically connected to the control module. ..

The present disclosure relates to an imaging device. The image pickup apparatus includes a camera lens, a control module that is electrically connected to the camera lens, and is configured to control the camera lens to output in-focus images and out-of-focus images of the same scene, and the control module. Includes the above-mentioned image processing device that is electrically connected.

The present disclosure relates to electronic devices. The electronic device includes the above-mentioned imaging device.

The present disclosure relates to electronic devices. The electronic device includes a processor and a storage device. The storage device is configured to store the executable program code. By reading the executable program code stored in the storage device, the processor executes the program corresponding to the executable program code, and executes the image processing method described above or the control method described above.

The present disclosure relates to a non-temporary computer-readable storage medium that stores an instruction in which the above-mentioned image processing method or the above-mentioned control method is executed when an electronic device executes an instruction by using a processor.

With reference to FIG. 1, the image processing method of the present disclosure includes the following operations in the block.

In block S1, the first image corresponding to the first photography parameter is acquired.

In block S2, a second image having the same scene as the first image is acquired. The second image corresponds to the second photography parameter.

In block S3, the first image is blurred and the blurred first image is acquired.

In block S4, the replacement target portion is defined in the blurred first image. The replacement target portion corresponds to the overexposed portion of the first image.

In block S5, the replacement portion of the second image is acquired. The replacement portion corresponds to the replacement target portion.

In block S6, the replacement target portion of the blurred first image is replaced with the replacement portion of the second image, and the merged image is acquired.

Existing techniques use blurring software algorithms to blur the background of a photo (eg, the background of a portrait photo). In the presence of a light source in the background, the light source in a blurred photo looks dark. The image processing method of the present disclosure can replace the light source on a blurred photo with an actual flare effect. Practically, the blurred first image can be an image with a blurred background. The blurred light source of the first image (corresponding to the overexposed portion) is replaced with the replacement portion of the second image. The second image is processed to have a better light effect on the light source. Therefore, the merged image is improved with the actual flare effect.

In aspects of the present disclosure, the first photography parameter and the second photography parameter can be focal or defocusing parameters. That is, the first image can be an in-focus image and the second image can be an out-of-focus image. In another aspect of the present disclosure, the first photography parameter and the second photography parameter can be exposure parameters. That is, the first image can be an equi-exposure image obtained using a first exposure value that is compatible with the bright environment, and the second image is a second image that is smaller than the first exposure value. It can be an underexposed image obtained using the exposure value of. The two aspects are described in more detail below. Those skilled in the art will appreciate that the concepts of the present disclosure are not limited to the two aspects.

By the operation of the block described above, the image processing method of the present disclosure can acquire a merged image having an actual flare effect. Excellent flare effect.

In a situation where the first image is an in-focus image and the second image is an out-of-focus image, with reference to FIG. 2, the first embodiment of the image processing method of the present disclosure is the following operation in the block. including.

In block S11, it is identified whether the focused image has an overexposed portion in the focused state.

In block S12, the in-focus image is blurred, and the out-of-focus image is acquired. The blurred in-focus image includes a blurred overexposed portion corresponding to the overexposed portion.

In block S13, an unfocused image of the same scene as the in-focus image is acquired according to the overexposed portion of the in-focus image, and the out-of-focus image is a material corresponding to the overexposed portion of the in-focus image. Processed to get the part.

In block S14, the overexposed portion corresponding to the overexposed portion in the blurred in-focus image is replaced with the material portion, and the merged image is acquired.

Blurring the in-focus image to obtain a blurred in-focus image can be performed by a Gaussian blur algorithm. The in-focus image is taken in focus using the full depth of focus. The degree of blurring the material part is substantially the same as the degree of blurring the overexposed part.

With reference to FIG. 3, the first embodiment of the image processing method can be implemented by the first embodiment of the image processing apparatus 111 of the present disclosure. A first embodiment of the image processing apparatus 111 of the present disclosure includes an identification module 1111, a blur module 1112, a processing module 1113, and a merge module 1114 configured to perform the operations of blocks S11 to S14, respectively. That is, the identification module 1111 is configured to identify whether the focused image has an overexposed portion in the focused state. The blur module 1112 is configured to blur the in-focus image and acquire a blurred in-focus image including the overexposed portion corresponding to the overexposed portion. The processing module 1113 acquires an out-of-focus image having the same scene as the in-focus image, and processes the out-of-focus image in response to the in-focus image having an overexposed portion, so that the over-exposure portion of the in-focus image is obtained. It is configured to acquire the material part corresponding to. The merge module 1114 is configured to replace the overexposed portion corresponding to the overexposed portion in the blurred in-focus image with the material portion and acquire the merged image.

The blur module 1112 uses a Gaussian blur algorithm to blur the in-focus image and obtain a blurred in-focus image. The in-focus image is taken in focus using the full depth of focus. The degree of blurring the material part is substantially the same as the degree of blurring the overexposed part.

With reference to FIGS. 4 and 6-8, the first embodiment of the control method of the present disclosure is utilized to control the imaging apparatus 10. The control method includes the following operations in the block.

In block S16, the imaging device 10 is controlled to output in-focus images and out-of-focus images of the same scene.

In block S11, it is identified whether the focused image has an overexposed portion in the focused state.

In block S12, the in-focus image is blurred, and the out-of-focus image is acquired. The blurred in-focus image includes a blurred overexposed portion corresponding to the overexposed portion.

In block S13, an unfocused image of the same scene as the in-focus image is acquired according to the overexposed portion of the in-focus image, and the out-of-focus image is a material corresponding to the overexposed portion of the in-focus image. Processed to get the part.

In block S14, the overexposed portion corresponding to the overexposed portion in the blurred in-focus image is replaced with the material portion, and the merged image is acquired.

Blurring the in-focus image to obtain a blurred in-focus image can be performed by a Gaussian blur algorithm. The in-focus image is taken in focus using the full depth of focus. The degree of blurring the material part is substantially the same as the degree of blurring the overexposed part.

With reference to FIG. 5, the first embodiment of the control method can be implemented by the first embodiment of the control device 11 of the present disclosure. In the first embodiment of the control device 11 of the present disclosure, the control device 11 is a control module 112 that electrically connects the image processing device 111 according to the first embodiment of the image processing device 111 and the image processing device 111. And include. The image processing device 111 is configured to execute the operations of blocks S11 to S14. The control module 112 is configured to execute block S16. Since the configuration of the image processing device 111 has been described in the first embodiment described above, it will not be described in detail here. The control module 112 is configured to control the image pickup apparatus 10 (shown in FIGS. 6 to 8) to output in-focus images and out-of-focus images of the same scene.

Referring to FIG. 6, the first embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to the first embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the first embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

Referring to FIGS. 7 and 8, the first embodiment of the electronic device 100 of the present disclosure includes the imaging device 10 according to the first embodiment of the imaging device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. When the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

For example, accompanying FIG. 9, the camera lens 12 captures an in-focus image (shown in the upper left of FIG. 9) and an out-of-focus image (shown in the upper right of FIG. 9) of the same scene. The in-focus image is taken in focus using the full depth of focus. After identification, it can be determined that the focused image has an overexposed portion, i.e. an elongated tube at the upper corner. The in-focus image is blurred, and a blurred in-focus image (shown in the lower left of FIG. 9) is acquired. In this example, the background of the in-focus image is blurred. The overexposed part (elongated tube) of the in-focus image is blurred, and the overexposed part (elongated tube) that is blurred is acquired. If the in-focus image has an overexposed portion, the out-of-focus image is processed to acquire the material portion (elongated tube) corresponding to the overexposed portion. In this example, the out-of-focus image is acquired by capturing the out-of-focus scene. The overexposed portion corresponding to the overexposed portion in the blurred in-focus image is replaced with the material portion, and a merged image (lower right of FIG. 9) is acquired.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the first embodiment of the present disclosure, two images are taken, one of which is a focused image. , The other is an out-of-focus image, where the material portion of the out-of-focus image corresponding to the overexposed portion of the in-focus image is extracted and then merged into the blurred in-focus image to create a merged image with the actual flare effect. get. Excellent flare effect.

With reference to FIG. 10, the second embodiment of the image processing method of the present disclosure is substantially the same as the first embodiment of the image processing method, but does the focused image have an overexposed portion in the focused state? Identification of whether further includes the following actions in the block:

In block S111, it is determined according to the histogram of the focused image whether or not the number of overexposed pixels of the focused image is equal to or greater than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S112, it is determined that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 11, the second embodiment of the image processing method can be implemented by the second embodiment of the image processing apparatus 111 of the present disclosure. The image processing device 111 according to the second embodiment of the image processing device 111 of the present disclosure has substantially the same configuration as the first embodiment of the image processing device 111, but the difference between them is the second embodiment. The identification module 1111 of the image processing apparatus 111 of the above includes a first determination submodule 11111 and a second determination submodule 11112 configured to perform the operations of blocks S111 and S112. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the in-focus image is equal to or greater than the first predetermined number according to the histogram of the in-focus image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the focused image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the focused image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, but this is merely an example, and the present disclosure is not limited thereto.

With reference to FIG. 13, the second embodiment of the control method of the present disclosure is substantially the same as the first embodiment of the control method, but whether or not the focused image has an overexposed portion in the focused state. Identification further includes the following actions in the block:

In block S111, it is determined according to the histogram of the focused image whether or not the number of overexposed pixels of the focused image is equal to or greater than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S112, it is determined that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 14, the second embodiment of the control method can be implemented by the second embodiment of the control device 11 of the present disclosure. The control device 11 according to the second embodiment of the control device 11 of the present disclosure has substantially the same structure as the first embodiment of the control device 11, but the difference between them is the control device of the second embodiment. The identification module 1111 of 11 includes a first determination submodule 11111 and a second determination submodule 11112 configured to perform the operations of blocks S111 and S112. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the in-focus image is equal to or greater than the first predetermined number according to the histogram of the in-focus image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the focused image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the focused image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, but this is merely an example, and the present disclosure is not limited thereto.

Referring to FIG. 15, a second embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to a second embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the first embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

With reference to FIG. 16, the second embodiment of the electronic device 100 of the present disclosure includes the image pickup device 10 according to the second embodiment of the image pickup device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. When the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the second embodiment of the present disclosure, two images are taken, one of which is a focused image. , The other is an out-of-focus image, where the material portion of the out-of-focus image corresponding to the overexposed portion of the in-focus image is extracted and then merged into the blurred in-focus image to create a merged image with the actual flare effect. get. Excellent flare effect.

With reference to FIG. 17, the third embodiment of the image processing method of the present disclosure is substantially the same as the first embodiment of the image processing method, but does the focused image have an overexposed portion in the focused state? Identification of whether further includes the following actions in the block:

In block S111, it is determined according to the histogram of the focused image whether or not the number of overexposed pixels of the focused image is equal to or greater than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S112, it is determined that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

In block S113, it is determined whether or not there are adjacent overexposed pixels in the focused image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number.

In block S114, it is determined that the adjacent overexposed pixels belong to the overexposed portion according to the determination that there are adjacent overexposed pixels in the focused image.

With reference to FIG. 18, the third embodiment of the image processing method can be implemented by the third embodiment of the image processing apparatus 111 of the present disclosure. The image processing device 111 according to the third embodiment of the image processing device 111 of the present disclosure has substantially the same configuration as the first embodiment of the image processing device 111, but the difference between them is the third embodiment. First determination submodule 11111, first determination submodule 11112, second determination configured such that the identification module 1111 of the image processing apparatus 111 of the above is configured to perform the operations of blocks S111, S112, S113, and S114. It includes a submodule 11113 and a second determination submodule 11114. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the in-focus image is equal to or greater than the first predetermined number according to the histogram of the in-focus image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number. The second determination submodule 11113 determines whether or not there are adjacent overexposed pixels in the focused image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number. It is composed of. The second determination submodule 11114 is configured to determine that the adjacent overexposed pixels belong to the overexposed portion in response to determining that there are adjacent overexposed pixels in the focused image.

The second predetermined number is greater than the first predetermined number because the first predetermined number may include noise points, or even an in-focus image may contain a plurality of adjacent overexposed pixels. Should also be small, for example, there are multiple light sources that both have divergent rays that contribute to the overexposed portion.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the focused image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the focused image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number and the second predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, and the second predetermined number can be set to one-fourth of the total number of pixels, but this is only an example. However, the present disclosure is not limited to this.

With reference to FIG. 19, the third embodiment of the control method of the present disclosure is substantially the same as the first embodiment of the control method, but whether or not the focused image has an overexposed portion in the focused state. Identification further includes the following actions in the block:

In block S111, it is determined according to the histogram of the focused image whether or not the number of overexposed pixels of the focused image is equal to or greater than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S112, it is determined that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

In block S113, it is determined whether or not there are adjacent overexposed pixels in the focused image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number.

In block S114, it is determined that the adjacent overexposed pixels belong to the overexposed portion according to the determination that there are adjacent overexposed pixels in the focused image.

With reference to FIG. 20, the third embodiment of the control method can be implemented by the third embodiment of the control device 11 of the present disclosure. The control device 11 according to the third embodiment of the control device 11 of the present disclosure has substantially the same structure as the first embodiment of the control device 11, but the difference between them is the control device of the third embodiment. A first determination submodule 11111, a first determination submodule 11112, and a second determination submodule 11113, wherein the identification module 1111 of 11 is configured to perform the operations of blocks S111, S112, S113, and S114. And a second determination submodule 11114 is included. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the in-focus image is equal to or greater than the first predetermined number according to the histogram of the in-focus image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the in-focus image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number. The second determination submodule 11113 determines whether or not there are adjacent overexposed pixels in the focused image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number. It is composed of. The second determination submodule 11114 is configured to determine that the adjacent overexposed pixels belong to the overexposed portion in response to determining that there are adjacent overexposed pixels in the focused image.

The second predetermined number is greater than the first predetermined number because the first predetermined number may include noise points, or even an in-focus image may contain a plurality of adjacent overexposed pixels. Should also be small, for example, there are multiple light sources that both have divergent rays that contribute to the overexposed portion.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the focused image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the focused image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number and the second predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, and the second predetermined number can be set to one-fourth of the total number of pixels, but this is only an example. However, the present disclosure is not limited to this.

Referring to FIG. 21, a third embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to a third embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the third embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

With reference to FIG. 22, the third embodiment of the electronic device 100 of the present disclosure includes the image pickup device 10 according to the third embodiment of the image pickup device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. When the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the third embodiment of the present disclosure, two images are captured, one of which is a focused image. , The other is an out-of-focus image, where the material portion of the out-of-focus image corresponding to the overexposed portion of the in-focus image is extracted and then merged into the blurred in-focus image to create a merged image with the actual flare effect. get. Excellent flare effect.

Referring to FIG. 23, the fourth embodiment of the image processing method of the present disclosure is substantially the same as the first embodiment of the image processing method, but the fourth embodiment of the image processing method further blocks. Including the following operations.

In block S17, a merged image is output according to the identification that the focused image has an overexposed portion.

In block S18, a blurred in-focus image is output according to the identification that the in-focus image does not have an overexposed portion.

With reference to FIG. 24, the fourth embodiment of the image processing method can be implemented by the fourth embodiment of the image processing apparatus 111 of the present disclosure. The image processing device 111 according to the fourth embodiment of the image processing device 111 of the present disclosure has substantially the same configuration as the first embodiment of the image processing device 111, but the difference between them is the fourth embodiment. The image processing apparatus 111 according to the above further includes a first output module 1117 and a second output module 1118 configured to perform the operations of blocks S17 and S18. That is, the first output module 1117 is configured to output the merged image according to the identification that the focused image has an overexposed portion. The second output module 1118 is configured to output a blurred in-focus image according to the identification that the in-focus image does not have an overexposed portion.

With reference to FIG. 25, the fourth embodiment of the control method of the present disclosure is substantially the same as the first embodiment of the control method, but the fourth embodiment of the control method is further described in blocks below. Including operation.

In block S17, a merged image is output according to the identification that the focused image has an overexposed portion.

In block S18, a blurred in-focus image is output according to the identification that the in-focus image does not have an overexposed portion.

With reference to FIG. 26, the fourth embodiment of the control method can be implemented by the fourth embodiment of the control device 11 of the present disclosure. The control device 11 according to the fourth embodiment of the control device 11 of the present disclosure has substantially the same structure as the first embodiment of the control device 11, but the difference between them is the control device of the fourth embodiment. 11 further includes a first output module 1117 and a second output module 1118 configured to perform the operations of blocks S17 and S18. That is, the first output module 1117 is configured to output the merged image according to the identification that the focused image has an overexposed portion. The second output module 1118 is configured to output a blurred in-focus image according to the identification that the in-focus image does not have an overexposed portion.

Referring to FIG. 27, a fourth embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to a fourth embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the fourth embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

Referring to FIG. 28, a fourth embodiment of the electronic device 100 of the present disclosure includes an imaging device 10 according to a fourth embodiment of the imaging device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. When the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the fourth embodiment of the present disclosure, two images are captured, one of which is a focused image. , The other is an out-of-focus image, where the material portion of the out-of-focus image corresponding to the overexposed portion of the in-focus image is extracted and then merged into the blurred in-focus image to create a merged image with the actual flare effect. get. Excellent flare effect.

It can be understood that the blocks S17 and S18 are also applicable to the second embodiment of the image processing method and the second embodiment of the control method. Correspondingly, the first output module 1117 and the second output module 1118 also include a second embodiment of the image processing apparatus, a second embodiment of the control apparatus, a second embodiment of the image processing apparatus, and It is also applicable to the second embodiment of the electronic device. Blocks S17 and S18 are also applicable to the third embodiment of the image processing method and the third embodiment of the control method. Correspondingly, the first output module 1117 and the second output module 1118 also include a third embodiment of the image processing apparatus, a third embodiment of the control apparatus, a third embodiment of the image processing apparatus, and It is also applicable to the third embodiment of the electronic device.

Referring to FIG. 29, in the control method according to the first to fourth embodiments described above, controlling the image pickup apparatus 10 so as to output an in-focus image and an out-of-focus image of the same scene (block S16) , The block can include the following actions.

In block S161, the imaging device is controlled to focus in order to acquire a focused image.

In block S162, the image pickup apparatus is controlled to refocus and process the buffer image output by the image pickup apparatus in a refocused state different from the focused state in order to acquire the corresponding degree of blurring. ..

In block S163, a buffer image having a degree of blurring substantially the same as the degree of blurring of the focused image is saved as a non-focused image.

Correspondingly, referring to FIG. 30, the control module 112 of the control device 11 according to the first to fourth embodiments is a focusing submodule configured to perform the operations of the blocks S161, S162, and S163. Includes 1121, refocusing submodule 1122, and storage submodule 1123. That is, the focusing submodule 1121 is configured to control the imaging device to focus in order to acquire a focused image. The refocusing submodule 1122 controls the imaging device to refocus and process the buffer image output by the imaging device in a refocusing state different from the focusing state in order to obtain the corresponding degree of blurring. It is configured to do. The storage submodule 1123 is configured to store as a non-focused image a buffer image having substantially the same degree of blurring as the degree of blurring of the focused image.

Correspondingly, the control module 112 of the imaging device 10 and the electronic device 100 according to the first to fourth embodiments may also include a focusing submodule 1121, a refocusing submodule 1122, and a storage submodule 1123. Yes, its structure and function are the same as above and will not be detailed here.

In a situation where the first image is an equiexposed image and the second image is an underexposed image, with reference to FIG. 31, the fifth embodiment of the image processing method of the present disclosure performs the following operations in the block. Including.

In block S21, an equal exposure image is obtained by exposing using a first exposure value that matches the bright environment, and it is identified whether the equal exposure image has an overexposed portion.

In the block S22, the equal exposure image is blurred, and the blurred equal exposure image is acquired. An overexposed image such as a blur includes an overexposed portion that corresponds to an overexposed portion.

In block S23, depending on that the equal exposure image has an overexposed portion, an underexposed image having the same scene as the equal exposure image is acquired by exposing using the second exposure amount, and the underexposed image is obtained. A blurred and blurred exposed riverbed image is acquired, the underexposed image contains the material portion corresponding to the overexposed portion, and the blurred underexposed image contains the blurred material portion corresponding to the overexposed portion. The exposure value of 2 is smaller than the first exposure value.

In block S24, the brightness of the blurred material portion is increased to obtain a false overexposed portion.

In block S25, the overexposed portion of the blurred or otherwise exposed image is replaced with a false overexposed portion, and a merged image is acquired.

Blurring an equal-exposure image and obtaining a blurred equal-exposure image can be performed by the Gaussian blur algorithm, and / or blurring an underexposed image and obtaining a blurred underexposed image can be performed by the Gaussian blur algorithm. Can be done by. Increasing the brightness of the blurred material portion to obtain the fake overexposed portion can be performed by increasing the brightness of the underexposed image N times blurred to obtain the fake overexposed portion. , N is the ratio of the first exposure value to the second exposure value.

With reference to FIG. 32, the fifth embodiment of the image processing method can be implemented by the fifth embodiment of the image processing apparatus 111 of the present disclosure. A fifth embodiment of the image processing apparatus 111 of the present disclosure is an identification module 1111, a first blurring module 11121, a second blurring module 11122, and a brightness increasing module configured to execute blocks S21 to S25, respectively. Includes 1116, and merge module 1115. That is, the identification module 1111 is configured to acquire an equiexposed image by exposing it using a first exposure value that matches the bright environment and identify whether the equiexposed image has an overexposed portion. To. The first blur module 11121 is configured to blur an equal exposure image and acquire a blurred equal exposure image including a blurred overexposed portion corresponding to the overexposed portion. In response to the equal exposure image having an overexposed portion, the second blur module 11122 acquires an underexposed image having the same scene as the equal exposure image by exposing using the second exposure value. The underexposed image is configured to blur the underexposed image to obtain a blurred underexposed image, the underexposed image contains a material portion corresponding to the overexposed portion, and the blurred underexposed image is blurred corresponding to the overexposed portion. The second exposure value is smaller than the first exposure value, including the material portion. The brightness increase module 1116 is configured to increase the brightness of the blurred material portion to obtain a false overexposed portion. The merge module 1115 is configured to replace the overexposed portion of the blurred or otherwise exposed image with a false overexposed portion to obtain the merged image.

The first blur module 11121 employs a Gaussian blur algorithm to blur an equiexposed image and obtain a blurred equiexposed image, and / or the second blur module 11122 employs a Gaussian blur algorithm. Blur the underexposed image and get a blurred underexposed image. When increasing the brightness of the blurred material portion to obtain a false overexposed portion, the brightness increasing module 1116 may increase the brightness of the blurred underexposed image by N times to obtain a false overexposed portion. Yes, N is the ratio of the first exposure value to the second exposure value.

With reference to FIGS. 33 and 35-37, a fifth embodiment of the control method of the present disclosure is utilized to control the imaging device 10. The control method includes the following operations in the block.

In block S26, the imaging device 10 is controlled to output an equally exposed image and an underexposed image of the same scene.

In block S21, an equal exposure image is obtained by exposing using a first exposure value that matches the bright environment, and it is identified whether the equal exposure image has an overexposed portion.

In the block S22, the equal exposure image is blurred, and the blurred equal exposure image is acquired. An overexposed image such as a blur includes an overexposed portion that corresponds to an overexposed portion.

In block S23, depending on that the equal exposure image has an overexposed portion, an underexposed image having the same scene as the equal exposure image is acquired by exposing using the second exposure amount, and the underexposed image is obtained. A blurred and blurred exposed riverbed image is acquired, the underexposed image contains the material portion corresponding to the overexposed portion, and the blurred underexposed image contains the blurred material portion corresponding to the overexposed portion. The exposure value of 2 is smaller than the first exposure value.

In block S24, the brightness of the blurred material portion is increased to obtain a false overexposed portion.

In block S25, the overexposed portion of the blurred or otherwise exposed image is replaced with a false overexposed portion, and a merged image is acquired.

Blurring an equal-exposure image and obtaining a blurred equal-exposure image can be performed by the Gaussian blur algorithm, and / or blurring an underexposed image and obtaining a blurred underexposed image can be performed by the Gaussian blur algorithm. Can be done by. Increasing the brightness of the blurred material portion to obtain the fake overexposed portion can be performed by increasing the brightness of the underexposed image N times blurred to obtain the fake overexposed portion. , N is the ratio of the first exposure value to the second exposure value.

With reference to FIG. 34, the fifth embodiment of the control method can be implemented by the fifth embodiment of the control device 11 of the present disclosure. In the fifth embodiment of the control device 11 of the present disclosure, the control device 11 is a control module 112 that electrically connects the image processing device 111 according to the fifth embodiment of the image processing device 111 and the image processing device 111. And include. The image processing device 111 is configured to execute blocks S21 to S25. The control module 112 is configured to execute block S26. Since the configuration of the image processing device 111 has been described in the fifth embodiment described above, it will not be described in detail here. The control module 112 is configured to control the image pickup apparatus 10 (shown in FIGS. 35 to 37) to output an equally exposed image and an underexposed image of the same scene.

Referring to FIG. 35, a fifth embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to a fifth embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the fifth embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

With reference to FIGS. 36 and 8, the fifth embodiment of the electronic device 100 of the present disclosure includes the imaging device 10 according to the fifth embodiment of the imaging device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. When the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

For example, accompanying FIG. 37, the camera lens 12 is used to capture an evenly exposed image and an underexposed image in the same scene. For illustration purposes, two images actually taken are shown in FIG. The scenes in the two images are not exactly the same. However, in the implementation of the present disclosure, the time required to capture an equiexposed image and an underexposed image is very short, and the same scene can be completely executed. The equi-exposure image is acquired by exposing using a first exposure value that matches the bright environment. The underexposed image is acquired by an exposure value using a second exposure value that is smaller than the first exposure value. After identification, it can be determined that the equiexposed image has an overexposed portion, i.e. a circular light source on the right side. The underexposed image includes a material portion (circular light source) corresponding to the overexposed portion (circular light source). Next, the equal exposure image is blurred, and the blurred equal exposure image is acquired. In this example, the background of the equiexposed image is blurred. What is shown in FIG. 37 is mainly the background portion, not the entire image. The underexposed image is blurred and the underexposed image is acquired. In this example, the technique used to blur the underexposed image can be the same as or similar to the technique used to blur the evenly exposed image. The overexposed portion (circular light source) of an overexposed image such as a blur is blurred, and the overexposed portion (circular light source) that is blurred is acquired. Blurred Underexposed The material part (circular light source) of the image is blurred, and the blurred material part (circular light source) is acquired. The brightness of the blurred material part is increased to obtain a fake overexposed part. In the embodiment, the brightness of the blurred underexposed image can be increased overall, while the brightness of the blurred material portion is also increased. Alternatively, it can only be done by increasing the brightness of the blurred material portion. Finally, the overexposed portion of the blurred or otherwise exposed image is replaced with a false overexposed portion to obtain a merged image.

In the image processing method, the image processing device 111, the control method, the control device 11, the image pickup device 10, and the electronic device 100 according to the present disclosure, two images are taken, one is an equal exposure image and the other is an underexposed image. The two images are both blurred, and the brightness of the blurred overexposed portion is increased, the corresponding false overexposed portion is extracted, and the blurred overexposed portion of the blurred or other overexposed image is Replaced by a fake overexposed portion and merged into a blurred image with the actual flare effect. Excellent flare effect.

With reference to FIG. 38, the sixth embodiment of the image processing method of the present disclosure is substantially the same as the fifth embodiment of the image processing method, but the identification of whether or not the equiexposed image has an overexposed portion can be determined. In addition, the block includes the following actions.

In block S211 it is determined according to the histogram of the equal exposure image whether or not the number of overexposed pixels in the equal exposure image is equal to or more than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S212, it is determined that the equally exposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 39, the sixth embodiment of the image processing method can be implemented by the sixth embodiment of the image processing apparatus 111 of the present disclosure. The image processing device 111 according to the sixth embodiment of the image processing device 111 of the present disclosure has substantially the same configuration as the fifth embodiment of the image processing device 111, but the difference between them is the sixth embodiment. The identification module 1111 of the image processing apparatus 111 of the above includes a first determination submodule 11111 and a second determination submodule 11112 configured to execute blocks S211 and S212. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the equal exposure image is equal to or greater than the first predetermined number according to the histogram of the equal exposure image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the equiexposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the equi-exposure image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the equiexposed image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, but this is merely an example, and the present disclosure is not limited thereto.

With reference to FIG. 40, the sixth embodiment of the control method of the present disclosure is substantially identical to the fifth embodiment of the control method, but the identification of whether the equiexposed image has an overexposed portion is further described. , Including the following actions in the block.

In block S211 it is determined according to the histogram of the equal exposure image whether or not the number of overexposed pixels in the equal exposure image is equal to or more than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S212, it is determined that the equally exposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 41, the sixth embodiment of the control method can be implemented by the sixth embodiment of the control device 11 of the present disclosure. The control device 11 according to the sixth embodiment of the control device 11 of the present disclosure has substantially the same structure as the fifth embodiment of the control device 11, but the difference between them is the control device of the sixth embodiment. The identification module 1111 of 11 includes a first determination submodule 11111 and a second determination submodule 11112 configured to execute blocks S211 and S212. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the equal exposure image is equal to or greater than the first predetermined number according to the histogram of the equal exposure image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the equiexposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the equi-exposure image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the equiexposed image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, but this is merely an example, and the present disclosure is not limited thereto.

With reference to FIG. 42, a sixth embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to a sixth embodiment of the control device 11, and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the fifth embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

Referring to FIG. 43, the sixth embodiment of the electronic device 100 of the present disclosure includes the image pickup device 10 according to the sixth embodiment of the image pickup device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. In the present embodiment, when the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the sixth embodiment of the present disclosure, two images are taken, one of which is an equal exposure image. , The other is an underexposed image, the two images are both blurred, and the brightness of the blurred overexposed portion is increased, the corresponding fake overexposed portion is extracted, and the blurred etc. The overexposed portion is replaced with a false overexposed portion and merged into a blurred image with the actual flare effect. Excellent flare effect.

With reference to FIG. 44, the seventh embodiment of the image processing method of the present disclosure is substantially the same as the fifth embodiment of the image processing method, but the identification of whether or not the equiexposed image has an overexposed portion can be determined. In addition, the block includes the following actions.

In block S211 it is determined according to the histogram of the equal exposure image whether or not the number of overexposed pixels in the equal exposure image is equal to or more than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S212, it is determined that the equally exposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

In block S213, it is determined whether or not there are adjacent overexposed pixels in the equal exposure image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number.

In block S214, it is determined that the adjacent overexposed pixels belong to the overexposed portion according to the determination that there are adjacent overexposed pixels in the equal exposure image.

With reference to FIG. 45, the seventh embodiment of the image processing method can be implemented by the seventh embodiment of the image processing apparatus 111 of the present disclosure. The image processing device 111 according to the seventh embodiment of the image processing device 111 of the present disclosure has substantially the same configuration as the fifth embodiment of the image processing device 111, but the difference between them is the seventh embodiment. First determination submodule 1111, first determination submodule 11112, second determination submodule configured such that the identification module 1111 of the image processing apparatus 111 of the image processing apparatus 111 executes the blocks S211, S212, S213, and S214. It includes 11113 and a second determination submodule 11114. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the equal exposure image is equal to or greater than the first predetermined number according to the histogram of the equal exposure image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the equiexposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number. The second determination submodule 11113 determines whether or not there are adjacent overexposed pixels in the equal exposure image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number. It is composed of. The second determination submodule 11114 is configured to determine that the adjacent overexposed pixels belong to the overexposed portion in response to determining that there are adjacent overexposed pixels in the equal exposure image.

The second predetermined number is greater than the first predetermined number because the first predetermined number may include noise points, or even an equiexposed image may contain a plurality of adjacent overexposed pixels. Should also be small, for example, there are multiple light sources that both have divergent rays that contribute to the overexposed portion.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the equi-exposure image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the equiexposed image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number and the second predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, and the second predetermined number can be set to one-fourth of the total number of pixels, but this is only an example. However, the present disclosure is not limited to this.

With reference to FIG. 46, the seventh embodiment of the control method of the present disclosure is substantially identical to the fifth embodiment of the control method, but the identification of whether the equiexposed image has an overexposed portion is further described. , Including the following actions in the block.

In block S211 it is determined according to the histogram of the equal exposure image whether or not the number of overexposed pixels in the equal exposure image is equal to or more than the first predetermined number. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value.

In block S212, it is determined that the equally exposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number.

In block S213, it is determined whether or not there are adjacent overexposed pixels in the equal exposure image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number.

In block S214, it is determined that the adjacent overexposed pixels belong to the overexposed portion according to the determination that there are adjacent overexposed pixels in the equal exposure image.

With reference to FIG. 47, the seventh embodiment of the control method can be implemented by the seventh embodiment of the control device 11 of the present disclosure. The control device 11 according to the seventh embodiment of the control device 11 of the present disclosure has substantially the same structure as the fifth embodiment of the control device 11, but the difference between them is the control device of the seventh embodiment. A first determination submodule 11111, a first determination submodule 11112, a second determination submodule 11113, and a second determination module 1111 configured to perform blocks S211, S212, S213, and S214 by the identification module 1111 of 11. It means that the determination submodule 11114 of 2 is included. That is, the first determination submodule 1111 is configured to determine whether or not the number of overexposed pixels in the equal exposure image is equal to or greater than the first predetermined number according to the histogram of the equal exposure image. The pixel value of the overexposed pixel is equal to or greater than a predetermined pixel value. The first determination submodule 11112 is configured to determine that the equiexposed image has an overexposed portion according to the number of overexposed pixels being equal to or greater than the first predetermined number. The second determination submodule 11113 determines whether or not there are adjacent overexposed pixels in the equal exposure image by determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number. It is composed of. The second determination submodule 11114 is configured to determine that the adjacent overexposed pixels belong to the overexposed portion in response to determining that there are adjacent overexposed pixels in the equal exposure image.

The second predetermined number is greater than the first predetermined number because the first predetermined number may include noise points, or even an equiexposed image may contain a plurality of adjacent overexposed pixels. Should also be small, for example, there are multiple light sources that both have divergent rays that contribute to the overexposed portion.

With reference to FIG. 12, generally speaking, the pixel value (gray value) increases from left to right along the horizontal axis of the histogram of the equi-exposure image, and the number of pixels of a predetermined pixel value (gray value). Increases from bottom to top along the vertical axis of the histogram of the equiexposed image. The range of pixel values (gray values) is between 0 and 255, that is, from black to white. The higher the peak, the larger the number of pixels with a given pixel value (gray value).

The first predetermined number and the second predetermined number should be the number of pixels near the right boundary of the histogram, that is, the number of overexposed pixels. The first predetermined number can be set to one-third of the total number of pixels, and the second predetermined number can be set to one-fourth of the total number of pixels, but this is only an example. However, the present disclosure is not limited to this.

Referring to FIG. 48, a seventh embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to a seventh embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the seventh embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

Referring to FIG. 49, the seventh embodiment of the electronic device 100 of the present disclosure includes the imaging device 10 according to the seventh embodiment of the imaging device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. In the present embodiment, when the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the seventh embodiment of the present disclosure, two images are taken, one of which is an equal exposure image. , The other is an underexposed image, the two images are both blurred, and the brightness of the blurred overexposed portion is increased, the corresponding fake overexposed portion is extracted, and the blurred etc. The overexposed portion is replaced with a false overexposed portion and merged into a blurred image with the actual flare effect. Excellent flare effect.

Referring to FIG. 50, the eighth embodiment of the image processing method of the present disclosure is substantially the same as the fifth embodiment of the image processing method, but the eighth embodiment of the image processing method further blocks. Including the following operations.

In block S27, a merged image is output in response to the identification that the equiexposed image has an overexposed portion.

In block S28, a blurred iso-exposed image is output according to the identification that the equi-exposed image does not have an overexposed portion.

With reference to FIG. 51, an eighth embodiment of the image processing method can be implemented by the eighth embodiment of the image processing apparatus 111 of the present disclosure. The image processing device 111 according to the eighth embodiment of the image processing device 111 of the present disclosure has substantially the same configuration as the fifth embodiment of the image processing device 111, but the difference between them is the eighth embodiment. The image processing apparatus 111 according to the above further includes a first output module 1117 and a second output module 1118 configured to execute blocks S27 and S28. That is, the first output module 1117 is configured to output the merged image according to the identification that the equiexposed image has an overexposed portion. The second output module 1118 is configured to output a blurred equiexposed image in response to the identification that the equiexposed image does not have an overexposed portion.

With reference to FIG. 52, the eighth embodiment of the control method of the present disclosure is substantially the same as the fifth embodiment of the control method, but the eighth embodiment of the control method is further described in blocks below. Including operation.

In block S27, a merged image is output in response to the identification that the equiexposed image has an overexposed portion.

In block S28, a blurred iso-exposed image is output according to the identification that the equi-exposed image does not have an overexposed portion.

With reference to FIG. 53, an eighth embodiment of the control method can be implemented by the eighth embodiment of the control device 11 of the present disclosure. The control device 11 according to the eighth embodiment of the control device 11 of the present disclosure has substantially the same structure as the fifth embodiment of the control device 11, but the difference between them is the control device of the eighth embodiment. 11 further includes a first output module 1117 and a second output module 1118 configured to execute blocks S7 and S8. That is, the first output module 1117 is configured to output the merged image according to the identification that the equiexposed image has an overexposed portion. The second output module 1118 is configured to output a blurred equiexposed image in response to the identification that the equiexposed image does not have an overexposed portion.

Referring to FIG. 54, an eighth embodiment of the imaging device 10 of the present disclosure includes a control device 11 according to an eighth embodiment of the control device 11 and a camera lens 12 electrically connected to the control device 11. including. In other words, the image pickup apparatus 10 of the present embodiment includes the image processing apparatus 111 according to the eighth embodiment of the image processing apparatus 111, the control module 112, and the camera lens 12. The control module 112, the camera lens 12, and the image processing device 111 are all electrically connected to each other.

Referring to FIG. 55, an eighth embodiment of the electronic device 100 of the present disclosure includes an imaging device 10 according to an eighth embodiment of the imaging device 10. The electronic device 100 has a shooting function such as a mobile phone, a tablet, a notebook computer, a smart watch, a smart ring, a smart helmet, a smart glasses, another VR (virtual reality) wearable device, and another AR (augmented reality) wearable device. It can be performed by any kind of terminal that has. In the present embodiment, when the number of image pickup devices 10 is one, the image pickup device 10 can be a front camera or a rear camera. When the number of image pickup devices 10 is two, can the two image pickup devices 10 be a front camera and a rear camera, respectively, or are both of the two image pickup devices 10 a front camera? Or, both of the two image pickup devices 10 are rear cameras. When the number of image pickup devices 10 is larger than two, the image pickup device 10 can be a camera arranged at an arbitrary position such as a top camera, a bottom camera, and a lateral camera, excluding the front camera and the rear camera.

In the image processing method, image processing device 111, control method, control device 11, image pickup device 10, and electronic device 100 according to the eighth embodiment of the present disclosure, two images are taken, one of which is an equal exposure image. , The other is an underexposed image, the two images are both blurred, and the brightness of the blurred overexposed portion is increased, the corresponding fake overexposed portion is extracted, and the blurred etc. The overexposed portion is replaced with a false overexposed portion and merged into a blurred image with the actual flare effect. Excellent flare effect.

It can be understood that the blocks S27 and S28 are also applicable to the sixth embodiment of the image processing method and the sixth embodiment of the control method. Correspondingly, the first output module 1117 and the second output module 1118 also include a sixth embodiment of the image processing apparatus, a sixth embodiment of the control apparatus, a sixth embodiment of the image processing apparatus, and It is also applicable to the sixth embodiment of the electronic device. Blocks S27 and S28 are also applicable to the seventh embodiment of the image processing method and the seventh embodiment of the control method. Correspondingly, the first output module 1117 and the second output module 1118 also include a seventh embodiment of the image processing apparatus, a seventh embodiment of the control apparatus, a seventh embodiment of the image processing apparatus, and It is also applicable to the seventh embodiment of the electronic device.

With reference to FIG. 56, in the control method according to the fifth to eighth embodiments described above, when the image pickup device controlled by using the control method includes a camera lens, the image pickup device is controlled to control the same scene. Outputting an equally exposed image and an underexposed image (block S26) can include the following operations in the block.

In block S261, the first exposure value is determined based on the bright environment.

In block S262, the second exposure value is determined based on the overexposed portion.

In block S263, the camera lens is controlled to sequentially perform exposure using the first exposure value and the second exposure value, and acquire an equal exposure image and an underexposed image.

Correspondingly, referring to FIG. 57, the control module 112 of the control device 11 according to the fifth to eighth embodiments is a first exposure determination unit configured to execute blocks S261, S262, and S263. It includes 1131, a second exposure determination unit 1132, and a first control unit 1133. That is, the first exposure determination unit 1131 is configured to determine the first exposure amount based on the bright environment. The second exposure determination unit 1132 is configured to determine the second exposure value based on the overexposed portion. The first control unit 1133 is configured to control the camera lens to sequentially perform exposure using the first exposure value and the second exposure value to acquire an equal exposure image and an underexposed image. ..

Correspondingly, the control module 112 of the image pickup apparatus 10 and the electronic device 100 according to the fifth to eighth embodiments also also has the first exposure determination unit 1131, the second exposure determination unit 1132, and the first control unit. 1133 can be included, the structure and function of which is identical to the above and is not detailed here.

With reference to FIG. 58, in the control method according to the fifth to eighth embodiments described above, when the image pickup apparatus controlled by using the control method includes a first camera lens and a second camera lens. Controlling the image pickup device to output an equally exposed image and an underexposed image of the same scene (block S26) can include the following operations in the block.

In block S261, the first exposure value is determined based on the bright environment.

In block S262, the second exposure value is determined based on the overexposed portion.

In block S264, the first camera lens and the second camera lens are controlled to perform exposure using the first exposure value and the second exposure value, respectively, to produce an equal exposure image and an underexposure image. get.

Correspondingly, with reference to FIG. 59, the control module 112 of the control device 11 according to the fifth to eighth embodiments is a first exposure determination unit configured to execute blocks S261, S262, and S264. It includes 1131, a second exposure determination unit 1132, and a second control unit 1134. That is, the first exposure determination unit 1131 is configured to determine the first exposure amount based on the bright environment. The second exposure determination unit 1132 is configured to determine the second exposure value based on the overexposed portion. The second control unit 1134 controls the first camera lens and the second camera lens, respectively, to perform exposure using the first exposure value and the second exposure value, and equal-exposure image and underexposure. It is configured to acquire an image.

Correspondingly, the control module 112 of the image pickup apparatus 10 and the electronic device 100 according to the fifth to eighth embodiments also also has the first exposure determination unit 1131, the second exposure determination unit 1132, and the second control unit. 1134 can be included, the structure and function of which is identical to the above and is not detailed here.

Some embodiments of the present disclosure provide electronic devices. Electronic devices include housings, processors, storage devices, circuit boards, and power circuits. The circuit board is arranged in the space defined by the housing. The processor and storage device are located on the circuit board. The power supply circuit is configured to supply power to each circuit or device of the electronic device. The storage device is configured to store the executable program code. The processor executes the program corresponding to the executable program code by reading the executable program code stored in the storage device, and either the image processing method according to any of the above-described embodiments or the above-described embodiment. Execute the control method. Electronic devices can be implemented by any of mobile phones, tablets, notebook computers, smart watches, smart rings, smart helmets, and smart glasses.

The embodiments of the present disclosure also provide a computer-readable storage medium that stores instructions. When the instruction is executed by the processor of the electronic device, the electronic device executes the image processing method of any of the above-described embodiments or the control method of any of the above-described embodiments.

Throughout the present specification, "an embodiment", "some embodiments", "one embodied", "another ingredient", "an example", "an embodiment", "an embodiment", "an embodiment", "an embodiment" References such as "exemple", "a specific example", or "some samples" are specific features, structures, materials, or specific features, structures, materials, or described in connection with an embodiment or example. It is meant that the property is included in at least one embodiment or example of the present disclosure. Thus, throughout the specification, "in some embodiments", "in one embodied", "in an embodied", "others" in various places throughout the specification. Appearance of phrases such as "in an embodied cognitive" in an example, "in an embodied cognitive in an example", "in an embodied cognitive in a specific example", or "in some embodied cognitive in some examples" Does not necessarily refer to the same embodiment or example of the present disclosure. Furthermore, specific features, structures, materials, or properties can be combined in any suitable way in one or more embodiments or examples.

Any process or method described herein or otherwise described herein is one or more modules, segments or codes of executable instructions to achieve a particular logical function or step in the process. It can be understood to include a portion of, and the scope of preferred embodiments of the present disclosure is not necessarily in the order shown and described herein, but perhaps in much the same or reverse order of the functions involved. It includes other implementations, including, which should be understood by those skilled in the art.

The logic and / or steps described otherwise or shown in the flowcharts herein, such as a particular sequence table of executable instructions to implement a logical function, are instruction execution systems, devices or equipment. Will be used by (such as computer-based systems, systems that include processors, or instruction execution systems, other systems that can take instructions from devices and equipment and execute the instructions), or execute the instructions. It can be specifically achieved in any computer readable medium that will be used in combination with systems, devices and equipment. As used herein, a "computer-readable medium" includes, stores, communicates, propagates, or transfers programs that will be used by or in combination with an instruction execution system, device or device. It can be any device adapted for. More specific examples of computer-readable media are, but are not limited to, electronic connections (electronic devices) with one or more wires, portable computer enclosures (magnetic devices), random access memory (RAM). Includes read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), fiber optic devices and portable compact disk read-only memory (CDROM). In addition, the computer-readable medium can further be paper or other suitable medium on which the program can be printed. This is done, for example, when the program needs to be obtained electrically, paper or other suitable medium is optically scanned and then edited, decoded or otherwise processed, and the program is computerized. This is because it can be stored in the memory.

It should be understood that each part of the disclosure can be achieved by hardware, software, firmware or a combination thereof. In the above embodiments, the plurality of steps or methods may be implemented by software or firmware stored in memory and executed by an appropriate instruction execution system. For example, if implemented by hardware as in other embodiments, the steps or methods can be implemented by one or a combination of the following techniques known in the art: Discrete logic circuits with logic gate circuits that realize logic functions, application-specific integrated circuits with appropriate combination logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

Those skilled in the art will appreciate that all or part of the steps in the above exemplary method of the present disclosure can be accomplished by programmatically instructing the relevant hardware. The program can be stored on a computer-readable storage medium, and the program comprises one or a combination of steps in embodiments of the methods of the present disclosure when executed on a computer.

Further, each functional cell of the embodiments of the present disclosure may be integrated into a processing module, or these cells may be separate physical entities, or two or more cells may be integrated into a processing module. May be done. The integrated module can be implemented in the form of hardware or software function modules. When the integrated module is implemented in the form of a software functional module and sold or used as a stand-alone product, the integrated module may be stored on a computer-readable storage medium.

The storage medium described above can be a read-only memory, a magnetic disk, a CD, or the like. Although exemplary embodiments have been shown and described, the above embodiments cannot be construed as limiting the present disclosure and are modified in the embodiments without departing from the scope of the present disclosure. It will be appreciated by those skilled in the art that alternatives and changes can be made.

Claims (8)

It is an image processing method
(A) A step of acquiring a first image corresponding to the first photography parameter, and
(B) A step of acquiring a second image having the same scene as the first image corresponding to the second photography parameter.
(C) A step of blurring the first image and acquiring a blurred first image, and
(D) A step of defining a replacement target portion of the blurred first image corresponding to the overexposed portion of the first image, and
(E) A step of acquiring a replacement portion of the second image corresponding to the replacement target portion, and
(F) viewed including the steps of obtaining a first merged image the substituted and replacement parts of the replaced portion of the second image of the images the blur,
The first image includes an in-focus image, the second image includes an out-of-focus image, and steps (a) to (f) are described.
A step of identifying whether the focused image has the overexposed portion in the focused state, and
A step of blurring the in-focus image and acquiring a blurred in-focus image including the overexposed portion corresponding to the overexposed portion.
In response to the overexposed image having the overexposed portion, an out-of-focus image having the same scene as the in-focus image is acquired, and the out-of-focus image is processed to process the overexposure of the in-focus image. Steps to get the material part corresponding to the part,
With the step of acquiring the merged image by replacing the overexposed portion corresponding to the overexposed portion in the blurred in-focus image with the material portion.
An image processing method characterized by being performed by . Identifying whether the focused image has the overexposed portion in the focused state can be identified.
It is to determine whether or not the number of overexposed pixels in the in-focus image is equal to or greater than the first predetermined number according to the histogram of the overexposed image, and the pixel value of the overexposed pixels is a predetermined pixel. Being above the value and
In response to the number of exposures excessive pixels is the first predetermined number or more, the image of claim 1, wherein the focused image is characterized in that it comprises a determining and having the exposed excessive portions Processing method. Identifying whether the focused image has the overexposed portion in the focused state can be identified.
By determining whether or not the number of adjacent overexposed pixels is equal to or greater than the second predetermined number, it is determined whether or not there are adjacent overexposed pixels in the in-focus image.
A claim further comprising determining that the adjacent overexposed pixels belong to the overexposed portion in response to the determination that there are the adjacent overexposed pixels in the focused image. the image processing method according to 2. The image processing method according to any one of claims 1 to 3 , wherein blurring the focused image to obtain the blurred focused image is performed by a Gauss blur algorithm. The image processing method according to any one of claims 1 to 4 , wherein the degree of blurring of the material portion is substantially the same as the degree of blurring of the overexposed portion. The above method
To output the merged image in response to identifying that the focused image has the overexposed portion.
The aspect of any one of claims 1 to 5 , further comprising outputting the blurred in-focus image in response to identifying that the in-focus image does not have the overexposed portion. The image processing method described. It is an image processing device
With the processor
A memory connected to the processor, comprising a memory containing a plurality of program instructions that can be executed by the processor configured to execute the method.
(A) A step of acquiring a first image corresponding to the first photography parameter, and
(B) A step of acquiring a second image having the same scene as the first image corresponding to the second photography parameter.
(C) A step of blurring the first image and acquiring a blurred first image, and
(D) A step of defining a replacement target portion of the blurred first image corresponding to the overexposed portion of the first image, and
(E) A step of acquiring a replacement portion of the second image corresponding to the replacement target portion, and
(F) viewed including the steps of obtaining a first merged image the substituted and replacement parts of the replaced portion of the second image of the images the blur,
The first image includes an in-focus image, the second image includes an out-of-focus image, and steps (a) to (f) are described.
A step of identifying whether the focused image has the overexposed portion in the focused state, and
A step of blurring the in-focus image and acquiring a blurred in-focus image including the overexposed portion corresponding to the overexposed portion.
As the in-focus image has the overexposed portion, an out-of-focus image having the same scene as the in-focus image is acquired, and the out-of-focus image is processed to process the overexposure of the in-focus image. Steps to get the material part corresponding to the part,
With the step of acquiring the merged image by replacing the overexposed portion corresponding to the overexposed portion in the blurred in-focus image with the material portion.
Image processing device performed by . A non-temporary computer-readable storage medium that stores an instruction, wherein the image processing method according to claim 1 is executed when an electronic device executes an instruction using a processor.