WO2018112763A1

WO2018112763A1 - Image processing method and device, control method and device, and imaging device and electronic device

Info

Publication number: WO2018112763A1
Application number: PCT/CN2016/111147
Authority: WO
Inventors: 孙剑波
Original assignee: 广东欧珀移动通信有限公司
Priority date: 2016-12-20
Filing date: 2016-12-20
Publication date: 2018-06-28

Abstract

An image processing method, comprising: recognizing whether a properly-exposed image has an over-exposed portion (S1); blurring the properly-exposed image to obtain a blurred properly-exposed image (S2); when the properly-exposed image has an over-exposed portion, blurring an under-exposed image to obtain a blurred under-exposed image (S3); increasing the brightness of a blurred material portion to obtain an originally-imitated over-exposed portion (S4); and substituting the blurred over-exposed portion in the blurred properly-exposed image with the originally-imitated over-exposed portion to obtain a combined image (S5). Further disclosed are an image processing device (111), a control method, a control device (11), an imaging device (10), and an electronic device (100).

Description

Image processing method and device, control method and device, imaging and electronic device

Technical field

The present invention relates to image processing technology, and in particular, to an image processing method, a control method, an image processing device, a control device, an imaging device, and an electronic device.

Background technique

Existing blurring algorithms, such as the background blur of portrait photos, generally use a fuzzy algorithm for the software blurring algorithm. The fuzzy algorithm is an average algorithm that averages the pixel brightness values of the light source when blurring the light source in the photo. The light source in the photo appears dim and the effect is not good.

Summary of the invention

Embodiments of the present invention aim to solve at least one of the technical problems existing in the prior art. To this end, embodiments of the present invention are required to provide an image processing method, a control method, an image processing device, a control device, an imaging device, and an electronic device.

The invention provides an image processing method, the image processing method comprising the following steps:

Identifying whether there is an overexposed portion in the image that is exposed, the exposed image being obtained by exposure with a first exposure amount that matches the light environment;

Blooming the suitable exposed image to obtain a blurred exposure image, the blurred exposure image including a blurred overexposure portion corresponding to the overexposed portion;

In the presence of the overexposed portion, the underexposed image is blurred to obtain a blurred underexposure image, and the underexposed image is obtained by exposure using a second exposure amount, the underexposed image and the scene of the suitable exposed image Similarly, the underexposed image includes a material portion corresponding to the overexposed portion, the blurred underexposure image includes a blur material portion corresponding to the overexposed portion, and the second exposure amount is less than the first An exposure amount such that a pixel value of the material portion is smaller than an upper limit of a range of pixel values of the material portion;

Elevating the brightness of the portion of the imaginary material to obtain a pseudo-overexposure portion; and

The imaginary overexposed portion in the blurred exposure image is replaced with the primordial overexposed portion to obtain a merged image.

In some embodiments, the step of identifying whether an overexposed portion is present in the exposed image comprises:

Determining, according to the histogram of the exposing image, whether the overexposed pixel in the exposing image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value; and

It is determined that the overexposed portion exists when the overexposed pixel is more than or equal to the first predetermined number.

When there is the overexposed portion, determining whether there is an adjacent overexposed pixel in the exposing image, the number of the adjacent overexposed pixels being more than or equal to a second predetermined number; and

When the adjacent overexposed pixels are present, it is determined that the adjacent overexposed pixels belong to the overexposed portion.

In some embodiments, the predetermined pixel value is an upper limit of a range of pixel values of the expansive image.

In some embodiments, the step of blurring the expansive image to obtain a blurred exposure image is implemented using a Gaussian blur algorithm; or/and

The step of blurring the underexposed image to obtain the blurred underexposure image is implemented by using a Gaussian blur algorithm.

In some embodiments, the step of lifting the brightness of the portion of the blurred material to obtain a simulated overexposed portion includes:

And increasing the brightness of the blurred underexposure image by N times to obtain the pseudo-overexposure portion, wherein N is a ratio between the first exposure amount and the second exposure amount.

In some embodiments, the image processing method comprises:

Outputting the merged image when the overexposed portion is present; and

The blurred exposure image is output when the overexposed portion is absent.

The present invention provides a control method for controlling an imaging device, the control method comprising the following steps:

Controlling the imaging device to output an exposed image and an underexposed image of the same scene; and

The adaptive image and the underexposed image are processed by the image processing method according to any of the above embodiments.

In some embodiments, the imaging device includes a camera, and the step of controlling the imaging device to output an appropriately exposed image and an underexposed image of the same scene includes the following steps:

Determining the first exposure amount according to a light environment;

Determining the second exposure amount according to the overexposed portion; and

The camera is controlled to be sequentially exposed with the first exposure amount and the second exposure amount to obtain the exposed image and the underexposed image.

In some embodiments, the imaging device includes a first camera and a second camera, and the step of controlling the imaging device to output an appropriately exposed image and an underexposed image of the same scene includes the following steps:

Determining the first exposure amount according to a light environment;

The first camera and the second camera are controlled to be exposed with the first exposure amount and the second exposure amount, respectively, to obtain the exposed image and the underexposed image.

The present invention provides an image processing apparatus, the image processing apparatus comprising:

An identification module, configured to identify whether an overexposed portion exists in the exposed image, and the exposed image is obtained by exposing the first exposure amount that matches the light environment;

a first blurring module, configured to blur the exposed image to obtain a blurred exposure image, where the blurred exposure image includes a blurred overexposure portion corresponding to the overexposed portion;

a second blurring module, configured to: when the overexposed portion exists, blur the underexposed image to obtain a blurred underexposure image, wherein the underexposed image is obtained by using a second exposure amount exposure, the underexposure image In the same manner as the scene of the exposed image, the underexposed image includes a material portion corresponding to the overexposed portion, and the blurred underexposure image includes a blur material portion corresponding to the overexposed portion, The second exposure amount is smaller than the first exposure amount such that a pixel value of the material portion is smaller than an upper limit of a pixel value range of the material portion;

a brightening module, configured to: boost a brightness of the portion of the imaginary material to obtain an original overexposed portion; and

And a merging module, configured to replace the imaginary overexposed portion in the imaginary exposing image with the primordial overexposed portion to obtain a merged image.

In some embodiments, the identification module comprises:

a first determining sub-module, configured to determine, according to the histogram of the exposing image, whether the overexposed pixel in the exposing image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel Value; and

The first determining submodule is configured to determine that the overexposed portion exists when the overexposed pixel is more than or equal to the first predetermined number.

In some embodiments, the identification module further includes:

a second determining sub-module, configured to determine, in the presence of the over-exposed portion, whether there is an adjacent over-exposed pixel in the exposed image, and the number of adjacent over-exposed pixels is greater than or equal to Two predetermined numbers; and

a second determining submodule, configured to determine that the adjacent overexposed pixels belong to the overexposed portion when the adjacent overexposed pixels are present.

In some embodiments, the first blurring module uses a Gaussian blurring algorithm to blur the exposed image to obtain a blurred exposure image; or/and

The second blurring module uses a Gaussian blurring algorithm to blur the underexposed image to obtain a blurred underexposure image.

In some embodiments, the brightening module is configured to increase a brightness of the blurred underexposure image by N times to obtain the pseudo-overexposure portion, wherein N is the first exposure amount and the The ratio between the second exposures.

In some embodiments, the image processing apparatus further includes:

a first output module, configured to output the merged image; or

And a second output module, configured to output the blurred exposure image when the overexposed portion is absent.

The present invention provides a control device for controlling an imaging device, the control device comprising:

a control module, configured to control the image forming apparatus to output an exposed image and an underexposed image of the same scene; and

An image processing apparatus as described in any of the above embodiments and electrically connected to the control module.

In some embodiments, the imaging device includes a camera, and the control module includes:

a first exposure determining unit, configured to determine the first exposure amount according to a light environment;

a second exposure determining unit, configured to determine the second exposure amount according to the overexposed portion; and

And a control unit, configured to control the camera to sequentially expose the first exposure amount and the second exposure amount to obtain the exposed image and the underexposed image.

In some embodiments, the imaging device includes a first camera and a second camera, and the control module includes:

And a control unit, configured to control the first camera and the second camera to respectively expose the first exposure amount and the second exposure amount to obtain the exposed image and the underexposure image.

The invention provides an imaging device, the imaging device comprising:

camera;

a control module electrically connected to the camera, configured to control the camera to output an exposed image and an underexposed image of the same scene; and

In some embodiments, the control module comprises:

a first control unit, configured to control the camera to sequentially expose the first exposure amount and the second exposure amount to obtain the exposed image and the underexposed image.

In some embodiments, the number of the cameras includes two, respectively a first camera and a second camera, and the control module includes:

a second control unit, configured to control the first camera and the second camera to be exposed by the first exposure amount and the second exposure amount, respectively, to obtain the exposed image and the underexposed image.

The present invention provides an electronic device comprising the imaging device according to any of the above embodiments.

In some embodiments, the electronic device includes any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart bracelet, a smart helmet, and smart glasses.

In certain embodiments, the imaging device comprises a front camera or/and a rear camera.

The present invention also provides an electronic device including a housing, a processor, a memory, a circuit board, and a power supply circuit. The circuit board is disposed inside a space enclosed by the housing, and the processor and the memory are disposed in the On the board. The power circuit for supplying power to respective circuits or devices of the electronic device; the memory for storing executable program code; the processor running by reading executable program code stored in the memory The program corresponding to the executable program code is used to execute the image processing method according to any of the above embodiments or to execute the control method described in any of the above embodiments.

The present invention also provides a computer readable storage medium having instructions stored therein, when the processor of the electronic device executes the instructions, the electronic device performs an image processing method or execution according to any of the above embodiments The control method according to any of the above embodiments.

The image processing method, the image processing device, the control method, the control device, the imaging device, the electronic device, and the computer readable storage medium in the present invention capture two images, one suitable exposure image, one underexposed image, and two images Both are blurred, and then the brightness of the underexposed image after blurring is brightened, and the part of the underexposed image is taken out, and the image is exposed in the blurred image to form a blur with a real spot effect. The image has a good spot effect.

The additional aspects and advantages of the embodiments of the present invention will be set forth in part in the description which follows.

DRAWINGS

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from

1 is a flow chart showing an image processing method according to a first embodiment of the present invention.

2 is a functional block diagram of an image processing apparatus according to a first embodiment of the present invention.

3 is a flow chart showing a control method of the first embodiment of the present invention.

4 is a schematic diagram of functional blocks of a control device according to a first embodiment of the present invention.

Fig. 5 is a schematic diagram showing the functional blocks of the image forming apparatus of the first embodiment of the present invention.

6 is a schematic diagram of functional blocks of an electronic device according to a first embodiment of the present invention.

FIG. 7 is a schematic diagram of a physical object of the electronic device of FIG. 6. FIG.

Figure 8 is a schematic view showing the operation of the electronic device of the present invention.

9 is a flow chart showing an image processing method according to a second embodiment of the present invention.

Fig. 10 is a functional block diagram of an image processing apparatus according to a second embodiment of the present invention.

Figure 11 is a histogram of an image of the present invention.

Fig. 12 is a flow chart showing the control method of the second embodiment of the present invention.

Fig. 13 is a schematic diagram showing the functional blocks of the control device according to the second embodiment of the present invention.

Fig. 14 is a schematic diagram showing the functional blocks of an image forming apparatus according to a second embodiment of the present invention.

15 is a schematic diagram of functional blocks of an electronic device according to a second embodiment of the present invention.

Fig. 16 is a flow chart showing an image processing method according to a third embodiment of the present invention.

Figure 17 is a diagram showing the functional blocks of an image processing apparatus according to a third embodiment of the present invention.

Fig. 18 is a flow chart showing the control method of the third embodiment of the present invention.

Fig. 19 is a schematic diagram showing the functional blocks of the control device according to the third embodiment of the present invention.

20 is a schematic diagram of functional blocks of an image forming apparatus according to a third embodiment of the present invention.

21 is a schematic diagram of functional blocks of an electronic device according to a third embodiment of the present invention.

Fig. 22 is a flow chart showing an image processing method according to a fourth embodiment of the present invention.

Figure 23 is a diagram showing the functional blocks of an image processing apparatus according to a fourth embodiment of the present invention.

Fig. 24 is a flow chart showing the control method of the fourth embodiment of the present invention.

Figure 25 is a diagram showing the functional blocks of a control device according to a fourth embodiment of the present invention.

Fig. 26 is a schematic diagram showing the functional blocks of an image forming apparatus according to a fourth embodiment of the present invention.

Figure 27 is a diagram showing the functional blocks of an electronic device according to a fourth embodiment of the present invention.

28 is a flow diagram of controlling an imaged device to output an appropriately exposed image and an underexposed image of the same scene, in accordance with some embodiments of the present invention.

29 is a functional block diagram of a control module of some embodiments of the present invention.

30 is a flow diagram showing the control of an image-forming device to output an appropriately exposed image and an underexposed image of the same scene, in accordance with some embodiments of the present invention.

31 is a functional block diagram of a control module of some embodiments of the present invention.

detailed description

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

In the description of the present invention, it is to be understood that the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include one or more of the described features either explicitly or implicitly. In the description of the present invention, the meaning of "a plurality" is two or more unless specifically and specifically defined otherwise.

In the description of the present invention, it should be noted that the terms "installation", "connected", and "connected" are to be understood broadly, and may be fixed or detachable, for example, unless otherwise explicitly defined and defined. Connected, or integrally connected; may be mechanically connected, or may be electrically connected or may communicate with each other; may be directly connected or indirectly connected through an intermediate medium, may be internal communication of two elements or interaction of two elements relationship. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.

The following disclosure provides many different embodiments or examples for implementing different structures of the present invention. In order to simplify the disclosure of the present invention, the components and arrangements of the specific examples are described below. Of course, they are merely examples and are not intended to limit the invention. In addition, the present invention may be repeated with reference to the numerals and/or reference numerals in the various examples, which are for the purpose of simplicity and clarity, and do not indicate the relationship between the various embodiments and/or arrangements discussed. Moreover, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art will recognize the use of other processes and/or the use of other materials.

The present invention provides an image processing method according to a plurality of embodiments, a control method of a plurality of embodiments, an image processing apparatus according to a plurality of embodiments, a control apparatus of a plurality of embodiments, an imaging apparatus of a plurality of embodiments, and a plurality of embodiments Electronic device. Hereinafter, the image processing methods of the plurality of embodiments are sequentially numbered, the control methods of the plurality of embodiments are sequentially numbered, the image processing apparatuses of the plurality of embodiments are sequentially numbered, and the control apparatuses of the plurality of embodiments are described. The sequential numbering will be described, the imaging devices of the plurality of embodiments will be sequentially numbered, and the electronic devices of the plurality of embodiments will be sequentially numbered. The image processing method of each embodiment may correspond to a control method of one embodiment, an image processing device corresponding to one embodiment, a control device corresponding to one embodiment, an imaging device corresponding to one embodiment, and a corresponding embodiment. Electronic device. For example, the image processing method of the first embodiment may correspond to the control method of the first embodiment, the image processing device that can correspond to the first embodiment, the control device that can correspond to the first embodiment, and the imaging device that can correspond to the first embodiment. And the electronic device according to the first embodiment; the image processing method according to the second embodiment can correspond to the control method of the second embodiment, the image processing device according to the second embodiment, and the control device according to the second embodiment. The imaging device according to the first embodiment and the electronic device according to the second embodiment can be used.

Referring to FIG. 1, an image processing method according to a first embodiment of the present invention includes the following steps:

S1, identifying whether there is an overexposed portion in the exposed image, and the suitable exposure image is an image obtained by exposing the first exposure amount matched with the light environment;

S2, blurring the image to obtain a blurred exposure image, and blurring the exposed image includes a blurred overexposure portion corresponding to the overexposed portion;

S3, when there is an overexposed portion, the underexposure image is blurred to obtain a blurred underexposure image, and the underexposed image is obtained by exposure with a second exposure amount, and the underexposed image is the same as the scene of the suitable exposed image, and the underexposed image includes a portion of the material corresponding to the overexposed portion, the blurred underexposure image includes a portion of the blur material corresponding to the overexposed portion, and the second exposure amount is smaller than the first exposure amount such that the pixel value of the material portion is smaller than the pixel value range of the material portion Upper limit (the purpose is not to overflow);

S4, increasing the brightness of the portion of the imaginary material to obtain a portion of the original over-exposure; and

S5, replacing the blurred overexposed portion in the blurred exposure image with the original overexposed portion to obtain a merged image.

Wherein, the step of blurring the exposed image to obtain the blurred exposure image may be implemented by using a Gaussian fuzzy algorithm; The step of blurring the underexposed image to obtain a blurred underexposure image may be implemented using a Gaussian blur algorithm. The step of increasing the brightness of the imaginary material portion to obtain the original overexposed portion may be to increase the brightness of the imaginary underexposed image by N times to obtain a pseudo overexposed portion, where N is between the first exposure amount and the second exposure amount. ratio.

Referring to FIG. 2, the image processing method of the first embodiment described above can be realized by the image processing apparatus 111 of the first embodiment of the present invention. Specifically, the image processing apparatus 111 of the first embodiment of the present invention includes an identification module 1111, a first blurring module 1112, a second blurring module 1113, a brightening module 1114, and a merging module 1115, which can be respectively used to execute S1 to S5. . That is to say, the identification module 1111 is configured to identify whether there is an overexposed portion in the exposed image, and the suitable exposure image is an image obtained by exposure with a first exposure amount that matches the light environment. The first blurring module 1112 is configured to blur the exposed image to obtain a blurred exposure image, and the blurred exposure image includes a blurred overexposure portion corresponding to the overexposed portion. The second blurring module 1113 is configured to blur the underexposed image to obtain a blurred underexposure image when the overexposed portion is present, and the underexposed image is obtained by using the second exposure amount to expose the underexposed image and the exposed image. Similarly, the underexposed image includes a material portion corresponding to the overexposed portion, and the blurred underexposure image includes a blur material portion corresponding to the overexposed portion, and the second exposure amount is less than the first exposure amount such that the pixel value of the material portion is smaller than the material The upper limit of the range of pixel values. The brightening module 1114 is configured to increase the brightness of the portion of the imaginary material to obtain a portion of the original overexposed portion. The merging module 15 is configured to replace the imaginary overexposed portion in the imaginary exposing image with the primordial overexposed portion to obtain a merged image.

The first blurring module 1112 uses a Gaussian blur algorithm to blur the suitable exposed image to obtain a blurred exposure image; or/and the second blurring module 1113 uses a Gaussian blur algorithm to blur the underexposed image to obtain a virtual image. Underexposure images. The step of lifting the module 1114 may be to increase the brightness of the portion of the imaginary material to obtain a portion of the imaginary overexposed portion, which is to increase the brightness of the imaginary underexposed image by N times to obtain a portion of the original overexposure portion, where N is the first exposure amount and the second portion. The ratio between the exposures.

Referring to FIG. 3 and FIG. 5-7, the control method of the first embodiment of the present invention is used to control the imaging device 10. The control method includes the following steps:

S6, controlling the imaging device 10 to output an exposed image and an underexposed image of the same scene;

The step of blurring the image to obtain the blurred image may be implemented by using a Gaussian blur algorithm; or/and the step of blurring the underexposed image to obtain the image of the underexposed image may be implemented by using a Gaussian fuzzy algorithm. . The step of increasing the brightness of the imaginary material portion to obtain the original overexposed portion may be to increase the brightness of the imaginary underexposed image by N times to obtain a pseudo overexposed portion, where N is between the first exposure amount and the second exposure amount. ratio.

Referring to FIG. 4, the control method of the above-described first embodiment can be realized by the control device 11 of the first embodiment of the present invention. Specifically, in the control device 11 of the first embodiment of the present invention, the control device 11 includes the image processing device 111 in the first embodiment and a control module 112 electrically connected to the image processing device 111. The image processing device 111 is configured to perform steps S1 to S5, and the control module 112 is configured to perform step S6. The structure of the image processing apparatus 111 is as described in the first embodiment, and will not be described herein. The control module 112 is configured to control the imaging device 10 (shown in Figures 5-7) to output an appropriately exposed image and an underexposed image of the same scene.

Referring to Fig. 5, an image forming apparatus 10 according to a first embodiment of the present invention includes a control device 11 of the first embodiment and a camera 12 electrically connected to the control device 11 of the first embodiment. In other words, the imaging device 10 of the present embodiment includes the image processing device 111 of the first embodiment, the control module 112, and the camera 12. The control module 112 is electrically connected to both the camera 12 and the image processing device 111.

Referring to FIGS. 6 and 7, an electronic device 100 according to a first embodiment of the present invention includes the imaging device 10 of the first embodiment. The electronic device 100 may be any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart wristband, a smart helmet, smart glasses, other virtual reality wearable devices, and other augmented reality wearable devices. When the number of imaging devices 10 is one, the imaging device 10 may be a front camera or a rear camera. When the number of imaging devices 10 is two, the two imaging devices 10 may be a front camera and a rear camera, respectively; or both imaging devices 10 are front cameras; or both imaging devices 10 are rear cameras . Of course, when the number of the imaging devices 10 is two or more, the imaging device 10 may be a camera disposed at any position, and may be a top camera, a bottom camera, a side wall camera, or the like in addition to the front camera and the rear camera.

For example, referring to FIG. 8 , the camera 12 captures an appropriately exposed image and an underexposed image for the same scene ( FIG. 8 illustrates for example, using two actually captured images, the scenes of the two images are not identical, but the present invention In the specific execution, the time for the exposure of the exposed image and the underexposure image is very short, and it is completely possible to achieve the same scene). Wherein, the suitable exposure image is obtained by exposure with a first exposure amount matched to the light environment, and the underexposure image is obtained by using a second exposure amount smaller than the first exposure amount. After being identified, it can be judged that there is an overexposed portion in the suitable exposed image, that is, a circular light source on the right side, and the underexposed image includes a material portion (circular light source) corresponding to the overexposed portion (circular light source). Blur the exposed image to obtain a blurred exposure image, and blur the underexposed image to obtain a blurred underexposure image, wherein the overexposed portion (circular light source) in the blurred exposure image is blurred to be blurred Overexposed part (circular light source), blurring underexposure image The material part (circular light source) is blurred to obtain a blurred material part (circular light source). The brightness of the portion of the imaginary material is increased to obtain a partial overexposure portion, wherein the imaginary underexposure image is entirely brightened, and at this time, the brightness of the imaginary material portion is also brightened; or, it may be only brightening the imaginary The brightness of the material part. Finally, the blurred overexposed portion in the blurred exposure image is replaced with the original overexposed portion to obtain a merged image.

The image processing method, the image processing device 111, the control method, the control device 11, the imaging device 10, and the electronic device 100 in the first embodiment of the present invention capture two images, one suitable exposure image, one underexposed image, and two The image is blurred, and then the brightness of the underexposed image is blurred, and the imitation original overexposed portion is taken out, and the blurred overexposed portion in the blurred exposure image is replaced with the original overexposed portion. Combine a blurred image with a real flare effect, and the spot effect is good.

Referring to FIG. 9, the image processing method of the second embodiment of the present invention is substantially the same as the image processing method of the first embodiment. Further, the step of identifying whether there is an overexposed portion in the exposed image includes the following steps:

S11. Determine, according to the histogram of the suitable exposed image, whether the overexposed pixel in the exposed image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value, and the predetermined pixel value is a pixel value of the exposed image. The upper limit of the range, such as a predetermined pixel value of 255; and

S12, determining that there is an overexposed portion when the overexposed pixel is more than or equal to the first predetermined number.

Referring to Fig. 10, the image processing method of the second embodiment described above can be realized by the image processing apparatus 111 of the second embodiment of the present invention. The image processing device 111 of the second embodiment of the present invention has substantially the same structure as the image processing device 111 of the first embodiment, except that the identification module 1111 of the image processing device 111 of the second embodiment includes the first determination sub-module 11111. And the first determining sub-module 11112 can be used to perform steps S11 and S12, respectively. That is, the first determining sub-module 11111 is configured to determine, according to the histogram of the suitable exposed image, whether the overexposed pixel in the exposed image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value. The predetermined pixel value is an upper limit of a range of pixel values of the exposed image, for example, a predetermined pixel value is 255. The first determining sub-module 11112 is configured to determine that there is an overexposed portion when the overexposed pixel is more than or equal to the first predetermined number.

Referring to FIG. 11, generally, the horizontal axis of the histogram of the suitable image represents the increment of the pixel value (gray value) from left to right, and the vertical axis represents the pixel value (gray value) from bottom to top. The number of pixels is incremented. The pixel value (gray value) ranges from 0 to 255, that is, from black to white, and the higher the peak at a certain point, the more pixels are indicated at the pixel value (gray value).

The first predetermined number should be the number of pixels in the histogram near the right border, that is, the number of overexposed pixels, and the first predetermined number can be set to be one third of the total pixels. It should be noted that one third is only It is a schematic illustration and is not a limitation of the invention.

Referring to FIG. 12, the control method of the second embodiment of the present invention is substantially the same as the control method of the first embodiment. Further, the step of identifying whether there is an overexposed portion in the exposed image includes the following steps:

Referring to Fig. 13, the control method of the second embodiment described above can be realized by the control device 11 of the second embodiment of the present invention. The control device 11 of the second embodiment of the present invention has substantially the same structure as the control device 11 of the first embodiment, except that the identification module 1111 of the control device 11 of the second embodiment includes a first determination sub-module 11111 and a first The determining sub-module 11112 can be used to perform steps S11 and S12, respectively. That is, the first determining sub-module 11111 is configured to determine, according to the histogram of the suitable exposed image, whether the overexposed pixel in the exposed image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value. The predetermined pixel value is an upper limit of a range of pixel values of the exposed image, for example, a predetermined pixel value is 255. The first determining sub-module 11112 is configured to determine that there is an overexposed portion when the overexposed pixel is more than or equal to the first predetermined number.

Referring to FIG. 11, in general, the horizontal axis of the histogram of the suitable image represents the increment of the pixel value (gray value) from left to right, and the vertical axis represents the pixel value (gray value) from bottom to top. The number of pixels is incremented. The pixel value (gray value) ranges from 0 to 255, that is, from black to white, and the higher the peak at a certain point, the more pixels are indicated at the pixel value (gray value).

Referring to Fig. 14, an image forming apparatus 10 according to a second embodiment of the present invention includes a control device 11 of the second embodiment and a camera 12 electrically connected to the control device 11 of the second embodiment. In other words, the imaging device 10 of the present embodiment includes the image processing device 111, the control module 112, and the camera 12 of the second embodiment. The control module 112 is electrically connected to both the camera 12 and the image processing device 111.

Referring to FIG. 15, an electronic device 100 according to a second embodiment of the present invention includes the imaging device 10 of the second embodiment. The electronic device 100 may be any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart wristband, a smart helmet, smart glasses, other virtual reality wearable devices, and other augmented reality wearable devices. In the present embodiment, when the number of the imaging devices 10 is one, the imaging device 10 may be a front camera or a rear camera. When the number of imaging devices 10 is two, the two imaging devices 10 may be a front camera and a rear camera, respectively; or both imaging devices 10 are front cameras; or both imaging devices 10 are rear cameras . Of course, when the number of the imaging devices 10 is two or more, the imaging device 10 may be a camera disposed at any position, and may be a top camera, a bottom camera, a side wall camera, or the like in addition to the front camera and the rear camera.

The image processing method, the image processing device 111, the control method, the control device 11, the imaging device 10, and the electronic device 100 in the second embodiment of the present invention capture two images, one suitable exposure image, one underexposed image, and two The image is blurred, and then the brightness of the underexposed image is blurred, and the imitation original overexposed portion is taken out, and the blurred overexposed portion in the blurred exposure image is replaced with the original overexposed portion. Combine a blurred image with a real flare effect, and the spot effect is good.

Referring to FIG. 16, the image processing method of the third embodiment of the present invention is substantially the same as the image processing method of the first embodiment. Further, the step of identifying whether there is an overexposed portion in the exposed image includes the following steps:

S11. Determine, according to the histogram of the suitable exposed image, whether the overexposed pixel in the exposed image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value, and the predetermined pixel value is a pixel value of the exposed image. The upper limit of the range, for example, the predetermined pixel value is 255;

S12, determining that there is an overexposed portion when the overexposed pixel is more than or equal to the first predetermined number;

S13, when there is an overexposed portion, determining whether there is an adjacent overexposed pixel in the suitable exposed image, and the number of adjacent overexposed pixels is more than or equal to a second predetermined number; and

S14. When there is an adjacent overexposed pixel, it is determined that the adjacent overexposed pixel belongs to the overexposed portion.

Referring to Fig. 17, the image processing method of the third embodiment described above can be realized by the image processing apparatus 111 of the third embodiment of the present invention. The image processing device 111 of the third embodiment of the present invention has substantially the same structure as the image processing device 111 of the first embodiment, except that the recognition module 1111 of the image processing device 111 of the third embodiment includes the first determination sub-module 11111. The first determining sub-module 11112, the second determining sub-module 11113, and the second determining sub-module 11114 are respectively configured to perform steps S11, S12, S13, and S14. That is, the first determining sub-module 11111 is configured to determine, according to the histogram of the suitable exposed image, whether the overexposed pixel in the exposed image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value. The predetermined pixel value is an upper limit of a range of pixel values of the exposed image, for example, a predetermined pixel value is 255. The first determining sub-module 11112 is configured to determine that there is an overexposed portion when the overexposed pixel is more than or equal to the first predetermined number. The second determining sub-module 11113 is configured to determine whether there is an adjacent over-exposed pixel in the exposed image when there is an over-exposed portion, and the number of adjacent over-exposed pixels is greater than or equal to a second predetermined number. The second determining sub-module 11114 is configured to determine that the adjacent over-exposed pixels belong to the over-exposed portion when there is an adjacent over-exposed pixel.

Wherein, the second predetermined number should be smaller than the first predetermined number, because the first predetermined number may include noise, and even the exposed image may include a plurality of adjacent overexposed pixels, for example, there are a plurality of discrete light sources, and the light sources are common Form the overexposed part.

Referring to FIG. 11, in general, the horizontal axis of the histogram of the suitable image represents the increment of the pixel value (gray value) from left to right, and the vertical axis represents the pixel value (gray value) from bottom to top. The number of pixels is incremented. The pixel value (gray value) ranges from 0 to 255, that is, from black to white, the higher the peak at a certain point, the pixel value (gray value) is represented. The more pixels there are.

The first predetermined number and the second predetermined number should be the number of pixels in the histogram near the right boundary, that is, the number of overexposed pixels, and the first predetermined number may be set to be one third of the total pixels, and the second predetermined number may be It is set to account for a quarter of the total pixels. It should be noted that one-third and one-quarter are only illustrative and are not intended to limit the invention.

Referring to FIG. 18, the control method of the third embodiment of the present invention is substantially the same as the control method of the first embodiment. Further, the step of identifying whether there is an overexposed portion in the exposed image includes the following steps:

Referring to Fig. 19, the control method of the third embodiment described above can be realized by the control device 11 of the third embodiment of the present invention. The control device 11 of the third embodiment of the present invention has substantially the same structure as the control device 11 of the first embodiment, except that the identification module 1111 of the control device 11 of the third embodiment includes a first determination sub-module 11111, and a first The determining sub-module 11112, the second determining sub-module 11113, and the second determining sub-module 11114 are respectively configured to perform steps S11, S12, S13, and S14. That is, the first determining sub-module 11111 is configured to determine, according to the histogram of the suitable exposed image, whether the overexposed pixel in the exposed image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value. The predetermined pixel value is an upper limit of a range of pixel values of the exposed image, for example, a predetermined pixel value is 255. The first determining sub-module 11112 is configured to determine that there is an overexposed portion when the overexposed pixel is more than or equal to the first predetermined number. The second determining sub-module 11113 is configured to determine whether there is an adjacent over-exposed pixel in the exposed image when there is an over-exposed portion, and the number of adjacent over-exposed pixels is greater than or equal to a second predetermined number. The second determining sub-module 11114 is configured to determine that the adjacent over-exposed pixels belong to the over-exposed portion when there is an adjacent over-exposed pixel.

Referring to Fig. 20, an image forming apparatus 10 according to a third embodiment of the present invention includes a control device 11 of a third embodiment and a camera 12 electrically connected to the control device 11 of the third embodiment. In other words, the imaging device 10 of the present embodiment includes the image processing device 111, the control module 112, and the camera 12 of the third embodiment. The control module 112 is electrically connected to both the camera 12 and the image processing device 111.

Referring to FIG. 21, an electronic device 100 according to a third embodiment of the present invention includes the imaging device 10 of the third embodiment. The electronic device 100 may be any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart wristband, a smart helmet, smart glasses, other virtual reality wearable devices, and other augmented reality wearable devices. In the present embodiment, when the number of the imaging devices 10 is one, the imaging device 10 may be a front camera or a rear camera. When the number of imaging devices 10 is two, the two imaging devices 10 may be a front camera and a rear camera, respectively; or both imaging devices 10 are front cameras; or both imaging devices 10 are rear cameras . Of course, when the number of the imaging devices 10 is two or more, the imaging device 10 may be a camera disposed at any position, and may be a top camera, a bottom camera, a side wall camera, or the like in addition to the front camera and the rear camera.

The image processing method, the image processing device 111, the control method, the control device 11, the imaging device 10, and the electronic device 100 in the third embodiment of the present invention take two images, one suitable exposure image, one underexposed image, and two The image is blurred, and then the brightness of the underexposed image is blurred, and the imitation original overexposed portion is taken out, and the blurred overexposed portion in the blurred exposure image is replaced with the original overexposed portion. Combine a blurred image with a real flare effect, and the spot effect is good.

Referring to FIG. 22, the image processing method of the fourth embodiment of the present invention is substantially the same as the image processing method of the first embodiment. Further, the image processing method of the fourth embodiment further includes the following steps:

S7, outputting a merged image when there is an overexposed portion; and

S8, when there is no overexposed portion, the output image is blurred.

Referring to Fig. 23, the image processing method of the fourth embodiment described above can be realized by the image processing apparatus 111 of the fourth embodiment of the present invention. The image processing device 111 of the fourth embodiment of the present invention has substantially the same structure as the image processing device 111 of the first embodiment, except that the image processing device 111 of the fourth embodiment further includes a first output module 1117 and a second output. Module 1118 can be used to perform steps S7 and S8, respectively. That is, the first output module 1117 is configured to output a merged image when there is an overexposed portion. Second output module 1118 Used to output a blurred exposure image when there is no overexposed portion.

Referring to FIG. 24, the control method of the fourth embodiment of the present invention is substantially the same as the control method of the first embodiment. The control method of the fourth embodiment further includes the following steps:

S7, outputting a merged image when there is an overexposed portion; and

S8, when there is no overexposed portion, the output image is blurred.

Referring to Fig. 25, the control method of the fourth embodiment described above can be realized by the control device 11 of the fourth embodiment of the present invention. The control device 11 of the fourth embodiment of the present invention has substantially the same structure as the control device 11 of the first embodiment, except that the control device 11 of the fourth embodiment further includes a first output module 1117 and a second output module 1118. It can be used to perform steps S7 and S8, respectively. That is, the first output module 1117 is configured to output a merged image when there is an overexposed portion. The second output module 1118 is configured to output a blurred exposure image when there is no overexposed portion.

Referring to Fig. 26, an image forming apparatus 10 according to a fourth embodiment of the present invention includes a control device 11 of a fourth embodiment and a camera 12 electrically connected to the control device 11 of the fourth embodiment. In other words, the imaging device 10 of the present embodiment includes the image processing device 111, the control module 112, and the camera 12 of the fourth embodiment. The control module 112 is electrically connected to both the camera 12 and the image processing device 111.

Referring to FIG. 27, an electronic device 100 according to a fourth embodiment of the present invention includes the imaging device 10 of the fourth embodiment. The electronic device 100 may be any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart wristband, a smart helmet, smart glasses, other virtual reality wearable devices, and other augmented reality wearable devices. In the present embodiment, when the number of the imaging devices 10 is one, the imaging device 10 may be a front camera or a rear camera. When the number of imaging devices 10 is two, the two imaging devices 10 may be a front camera and a rear camera, respectively; or both imaging devices 10 are front cameras; or both imaging devices 10 are rear cameras . Of course, when the number of the imaging devices 10 is two or more, the imaging device 10 may be a camera disposed at any position, and may be a top camera, a bottom camera, a side wall camera, or the like in addition to the front camera and the rear camera.

The image processing method, the image processing device 111, the control method, the control device 11, the imaging device 10, and the electronic device 100 in the fourth embodiment of the present invention capture two images, one suitable exposure image, one underexposed image, and two The image is blurred, and then the brightness of the underexposed image is blurred, and the imitation original overexposed portion is taken out, and the blurred overexposed portion in the blurred exposure image is replaced with the original overexposed portion. Combine a blurred image with a real flare effect, and the spot effect is good.

It can be understood that the steps S7 and S8 can also be applied to the image processing method of the second embodiment and the control method of the second embodiment. Correspondingly, the first output module 1117 and the second output module 1118 can also be applied to the second embodiment. Image processing device, control device of the second embodiment, and imaging device of the second embodiment In the electronic device of the second embodiment. Steps S7 and S8 can also be applied to the image processing method of the third embodiment and the control method of the third embodiment. Correspondingly, the first output module 1117 and the second output module 1118 can also be applied to the image processing of the third embodiment. The device, the control device of the third embodiment, the imaging device of the third embodiment, and the electronic device of the third embodiment.

Referring to FIG. 28, in the control methods of the foregoing first to fourth embodiments, further, if the imaging device controlled by the control method includes a camera, the control imaging device outputs the exposed image and the underexposed image of the same scene. The step (step S6) may include the following steps:

S61. Determine a first exposure amount according to a light environment.

S62, determining a second exposure amount according to the overexposed portion; and

S63. The control camera is sequentially exposed with the first exposure amount and the second exposure amount to obtain an appropriately exposed image and an underexposed image.

Correspondingly, referring to FIG. 29, the control module 112 in the control device 11 of the first to fourth embodiments includes a first exposure determining unit 1121, a second exposure determining unit 1122, and a first control unit 1123, which can be used to respectively Steps S61, S62, and S63 are performed. That is, the first exposure determining unit 1121 is configured to determine the first exposure amount according to the light environment. The second exposure determining unit 1122 is configured to determine the second exposure amount according to the overexposed portion. The first control unit 1123 is configured to control the camera to sequentially expose the first exposure amount and the second exposure amount to obtain an appropriately exposed image and an underexposed image.

Correspondingly, the imaging device 10 of the first to fourth embodiments and the control module 112 in the electronic device 100 may also include a first exposure determining unit 1121, a second exposure determining unit 1122, and a first control unit 1123, the specific structure and The function is the same as before and will not be expanded in detail here.

Referring to FIG. 30, in the control methods of the foregoing first to fourth embodiments, further, if the imaging device controlled by the control method includes the first camera and the second camera, the control imaging device outputs the same scene. The step of image and underexposure of the image (step S6) may further comprise the following steps:

S61. Determine a first exposure amount according to a light environment.

S63. Control the first camera and the second camera to respectively expose the first exposure amount and the second exposure amount to obtain an appropriately exposed image and an underexposed image.

Correspondingly, referring to FIG. 31, the control module 112 in the control device 11 of the first to fourth embodiments includes a first exposure determining unit 1121, a second exposure determining unit 1122, and a second control unit 1123, which can be used to respectively Steps S61, S62, and S63 are performed. That is, the first exposure determining unit 1121 is configured to determine the first exposure amount according to the light environment. The second exposure determining unit 1122 is configured to determine the second exposure amount according to the overexposed portion. The second control unit 1123 is configured to control the first camera and the second camera to respectively expose the first exposure amount and the second exposure amount. To the appropriate exposure image and underexposure image.

Correspondingly, the imaging device 10 of the first to fourth embodiments and the control module 112 in the electronic device 100 may also include a first exposure determining unit 1121, a second exposure determining unit 1122, and a second control unit 1123, the specific structure and The function is the same as above, and will not be expanded in detail here.

Certain embodiments of the present invention also provide an electronic device including a housing, a processor, a memory, a circuit board, and a power supply circuit. The circuit board is disposed inside a space enclosed by the casing, and the processor and the memory are disposed on the circuit board. The power circuit for supplying power to respective circuits or devices of the electronic device; the memory for storing executable program code; the processor running by reading executable program code stored in the memory The program corresponding to the executable program code is used to execute the image processing method according to any of the above embodiments or to execute the control method described in any of the above embodiments. The electronic device may be any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart bracelet, a smart helmet, and smart glasses.

The embodiment of the present invention further provides a computer readable storage medium having instructions stored therein, when the processor of the electronic device executes the instruction, the electronic device executes the image processing method according to any one of the above embodiments Or the control method described in any of the above embodiments is performed.

In the description of the present specification, the terms "some embodiments", "an embodiment", "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", The description of "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a particular logical function or process. And the scope of the preferred embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an opposite order depending on the functions involved, in the order shown or discussed. It will be understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. In the context of the present specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. Set. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

A person skilled in the art can understand that all or part of the steps carried in implementing the above implementation method can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium, and the program is executed. Including one or a combination of the steps of the method embodiments.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.

The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims

An image processing method, characterized in that the image processing method comprises the following steps:

Identifying whether there is an overexposed portion in the image that is exposed, the exposed image being obtained by exposure with a first exposure amount that matches the light environment;

Blooming the suitable exposed image to obtain a blurred exposure image, the blurred exposure image including a blurred overexposure portion corresponding to the overexposed portion;

In the presence of the overexposed portion, the underexposed image is blurred to obtain a blurred underexposure image, and the underexposed image is obtained by exposure using a second exposure amount, the underexposed image and the scene of the suitable exposed image Similarly, the underexposed image includes a material portion corresponding to the overexposed portion, the blurred underexposure image includes a blur material portion corresponding to the overexposed portion, and the second exposure amount is less than the first An exposure amount such that a pixel value of the material portion is smaller than an upper limit of a range of pixel values of the material portion;

Elevating the brightness of the portion of the imaginary material to obtain a pseudo-overexposure portion; and

The imaginary overexposed portion in the blurred exposure image is replaced with the primordial overexposed portion to obtain a merged image.
The image processing method according to claim 1, wherein the step of identifying whether there is an overexposed portion in the expansive image comprises:

Determining, according to the histogram of the exposing image, whether the overexposed pixel in the exposing image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel value; and

It is determined that the overexposed portion exists when the overexposed pixel is more than or equal to the first predetermined number.
The image processing method according to claim 2, wherein the step of identifying whether there is an overexposed portion in the expansive image comprises:

When there is the overexposed portion, determining whether there is an adjacent overexposed pixel in the exposing image, the number of the adjacent overexposed pixels being more than or equal to a second predetermined number; and

When the adjacent overexposed pixels are present, it is determined that the adjacent overexposed pixels belong to the overexposed portion.
The image processing method according to claim 2 or 3, wherein the predetermined pixel value is an upper limit of a range of pixel values of the expansive image.
The image processing method according to claim 1, wherein the step of blurring the suitable exposure image to obtain a blurred exposure image is implemented by using a Gaussian blur algorithm; or/and

The step of blurring the underexposed image to obtain the blurred underexposure image is implemented by using a Gaussian blur algorithm.
The image processing method according to claim 1, wherein the step of ascending the brightness of the portion of the imaginary material to obtain a simulated overexposed portion comprises:

And increasing the brightness of the blurred underexposure image by N times to obtain the pseudo-overexposure portion, wherein N is a ratio between the first exposure amount and the second exposure amount.
The image processing method according to claim 1, wherein the image processing method comprises:

Outputting the merged image when the overexposed portion is present; and

The blurred exposure image is output when the overexposed portion is absent.
A control method for controlling an imaging device, wherein the control method comprises the following steps:

Controlling the imaging device to output an exposed image and an underexposed image of the same scene; and

The adaptive image and the underexposed image are processed by the image processing method according to any one of claims 1-7.
The control method according to claim 8, wherein said imaging means comprises a camera, and said step of controlling said imaging means to output an appropriately exposed image and an underexposed image of the same scene comprises the steps of:

Determining the first exposure amount according to a light environment;

Determining the second exposure amount according to the overexposed portion; and

The camera is controlled to be sequentially exposed with the first exposure amount and the second exposure amount to obtain the exposed image and the underexposed image.
The control method according to claim 8, wherein said imaging means comprises a first camera and a second camera, and said step of controlling said imaging means to output an image of the same scene and an underexposed image comprises the following steps :

Determining the first exposure amount according to a light environment;

Determining the second exposure amount according to the overexposed portion; and

The first camera and the second camera are controlled to be exposed with the first exposure amount and the second exposure amount, respectively, to obtain the exposed image and the underexposed image.
An image processing apparatus, characterized in that the image processing apparatus comprises:

An identification module, configured to identify whether an overexposed portion exists in the exposed image, and the exposed image is used in a light environment Obtained with the first exposure amount obtained;

a first blurring module, configured to blur the exposed image to obtain a blurred exposure image, where the blurred exposure image includes a blurred overexposure portion corresponding to the overexposed portion;

a second blurring module, configured to: when the overexposed portion exists, blur the underexposed image to obtain a blurred underexposure image, wherein the underexposed image is obtained by using a second exposure amount exposure, the underexposure image In the same manner as the scene of the exposed image, the underexposed image includes a material portion corresponding to the overexposed portion, and the blurred underexposure image includes a blur material portion corresponding to the overexposed portion, The second exposure amount is smaller than the first exposure amount such that a pixel value of the material portion is smaller than an upper limit of a pixel value range of the material portion;

a brightening module, configured to: boost a brightness of the portion of the imaginary material to obtain an original overexposed portion; and

And a merging module, configured to replace the imaginary overexposed portion in the imaginary exposing image with the primordial overexposed portion to obtain a merged image.
The image processing device according to claim 11, wherein the identification module comprises:

a first determining sub-module, configured to determine, according to the histogram of the exposing image, whether the overexposed pixel in the exposing image is more than or equal to a first predetermined number, and the pixel value of the overexposed pixel is greater than or equal to a predetermined pixel Value; and

The first determining submodule is configured to determine that the overexposed portion exists when the overexposed pixel is more than or equal to the first predetermined number.
The image processing device according to claim 12, wherein the identification module further comprises:

a second determining sub-module, configured to determine, in the presence of the over-exposed portion, whether there is an adjacent over-exposed pixel in the exposed image, and the number of adjacent over-exposed pixels is greater than or equal to Two predetermined numbers; and

a second determining submodule, configured to determine that the adjacent overexposed pixels belong to the overexposed portion when the adjacent overexposed pixels are present.
The image processing device according to claim 12 or 13, wherein said predetermined pixel value is an upper limit of a range of pixel values of said expansive image.
The image processing apparatus according to claim 11, wherein the first blurring module uses a Gaussian blurring algorithm to blur the suitable exposed image to obtain a blurred exposure image; or/and

The second blurring module uses a Gaussian blurring algorithm to blur the underexposed image to obtain a blurred underexposure image.
The image processing device according to claim 11, wherein said brightening module is for rendering said blur The brightness of the underexposed image is increased by N times to obtain the pseudo-overexposure portion, wherein N is a ratio between the first exposure amount and the second exposure amount.
The image processing device according to claim 11, wherein the image processing device further comprises:

a first output module, configured to output the merged image; or

And a second output module, configured to output the blurred exposure image when the overexposed portion is absent.
A control device for controlling an imaging device, wherein the control device comprises:

a control module, configured to control the image forming apparatus to output an exposed image and an underexposed image of the same scene; and

An image processing apparatus according to any of claims 11-17 and electrically connected to said control module.
The control device according to claim 18, wherein the imaging device comprises a camera, and the control module comprises:

a first exposure determining unit, configured to determine the first exposure amount according to a light environment;

a second exposure determining unit, configured to determine the second exposure amount according to the overexposed portion; and

And a control unit, configured to control the camera to sequentially expose the first exposure amount and the second exposure amount to obtain the exposed image and the underexposed image.
The control device according to claim 18, wherein the imaging device comprises a first camera and a second camera, and the control module comprises:

a first exposure determining unit, configured to determine the first exposure amount according to a light environment;

a second exposure determining unit, configured to determine the second exposure amount according to the overexposed portion; and

And a control unit, configured to control the first camera and the second camera to respectively expose the first exposure amount and the second exposure amount to obtain the exposed image and the underexposure image.
An imaging device, characterized in that the imaging device comprises:

camera;

a control module electrically connected to the camera, configured to control the camera to output an exposed image and an underexposed image of the same scene; and

An image processing apparatus according to any of claims 11-17 and electrically connected to said control module.
The image forming apparatus according to claim 21, wherein said control module comprises:

a first exposure determining unit, configured to determine the first exposure amount according to a light environment;

a second exposure determining unit, configured to determine the second exposure amount according to the overexposed portion; and

a first control unit, configured to control the camera to sequentially expose the first exposure amount and the second exposure amount to obtain the exposed image and the underexposed image.
The imaging device according to claim 21, wherein the number of the cameras comprises two, respectively a first camera and a second camera, and the control module comprises:

a first exposure determining unit, configured to determine the first exposure amount according to a light environment;

a second exposure determining unit, configured to determine the second exposure amount according to the overexposed portion; and

a second control unit, configured to control the first camera and the second camera to be exposed by the first exposure amount and the second exposure amount, respectively, to obtain the exposed image and the underexposed image.
An electronic device, characterized in that the electronic device comprises the image forming device according to any one of claims 21-23.
The electronic device according to claim 24, wherein the electronic device comprises any one of a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart bracelet, a smart helmet, and smart glasses.
The electronic device of claim 24, wherein the imaging device comprises a front camera or/and a rear camera.
An electronic device includes a housing, a processor, a memory, a circuit board, and a power supply circuit, wherein the circuit board is disposed inside a space enclosed by the housing, and the processor and the memory are disposed in the a power circuit for powering various circuits or devices of the electronic device; the memory for storing executable program code; the processor reading an executable program stored in the memory Codes for executing a program corresponding to the executable program code for performing the image processing method according to any one of claims 1 to 7 or performing the control according to any one of claims 8 to 10. method.
A computer readable storage medium having instructions stored therein, the electronic device performing the image processing method or performing according to any one of claims 1 to 7 when the processor of the electronic device executes the instruction A control method according to any one of claims 8 to 10.