CN115134508A - Image processing method, imaging device, image processing device, and readable storage medium - Google Patents
Image processing method, imaging device, image processing device, and readable storage medium Download PDFInfo
- Publication number
- CN115134508A CN115134508A CN202110328957.9A CN202110328957A CN115134508A CN 115134508 A CN115134508 A CN 115134508A CN 202110328957 A CN202110328957 A CN 202110328957A CN 115134508 A CN115134508 A CN 115134508A
- Authority
- CN
- China
- Prior art keywords
- value
- exposure value
- calculating
- frame
- brightness
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
Abstract
The invention discloses an image processing method, which comprises the following steps: acquiring an initial exposure value EV0 of a preview frame of a picture to be shot; calculating a first long exposure value EV1 according to pixels of which the brightness value of the preview frame is smaller than a first brightness threshold Y1; calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2; calculating a second long exposure value EV3 from the frame blocks having the average luminance value smaller than the third luminance threshold value Y3; calculating a second short exposure value EV4 from the frame blocks having the average luminance value greater than the fourth luminance threshold Y4; calculating a final long exposure value EV5 according to the first long exposure value EV1 and the second long exposure value EV 3; calculating a final short exposure value EV6 according to the first short exposure value EV2 and the second short exposure value EV 4; the photographs with exposure values of initial exposure value EV0, final long exposure value EV5 and final short exposure value EV6, respectively, were fused to obtain HDR photographs. Compared with the prior art, the invention obtains the proper EV interval through the whole brightness value of the preview frame of the picture to be shot and the brightness value of the partial frame block of the preview frame, and the shot HDR picture can well reserve the details of the bright part and the dark part in the picture, thereby reducing the problems of false images, smear and the like which are easy to appear in multi-frame HDR pictures and simultaneously improving the shooting speed.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to a photographing apparatus, an image processing apparatus, and a computer-readable storage medium.
Background
Most of existing electronic devices (such as digital cameras or smart phones) with a shooting function have a High-Dynamic Range (HDR) function, and the HDR technology is mainly used for a user to obtain a High-quality photo, that is, to make details of a dark part of the photo clear and to make a scene of a bright part of the photo not overexposed. Therefore, when performing shooting using the HDR function, HDR algorithm synthesis is often performed using a dynamic Exposure Value (EV), where the dynamic EV is a different EV corresponding to a plurality of input frames in the HDR algorithm, and the EV is adaptive according to different scenes.
However, in the conventional technique, a fixed value is often used for the short exposure time and the long exposure time. In other words, in any scene, the electronic device uses a fixed short exposure time and a fixed long exposure time to achieve HDR during shooting. Therefore, shooting is performed by using a fixed EV interval in a complicated shooting scene, and when the number of frames to be shot is small (3 frames), various environments cannot be completely covered, and the effect of shot pictures is not ideal; when the number of frames of the shot is large (9 frames), the shooting process takes a long time, and the time for synthesizing the electronic device algorithm is also long. In addition, when the number of frames is large, if the hand is shaken during shooting or a moving object is present in the shot image, there are problems of serious smear and artifacts.
Therefore, there is a need for an improvement in existing image processing methods.
Disclosure of Invention
The invention aims to provide an image processing method, an image capturing device, an image processing device and a computer readable storage medium, and aims to overcome the defects existing in the conventional HDR photograph capturing.
In a first aspect, the present invention provides an image processing method, comprising:
acquiring an initial exposure value EV0 of a preview frame of a picture to be shot;
calculating a first long exposure value EV1 according to pixels of which the luminance values of the preview frames are smaller than a first luminance threshold Y1;
calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2;
dividing a preview frame into a plurality of frame blocks;
calculating a second long exposure value EV3 from the frame blocks having the average luminance value smaller than the third luminance threshold value Y3;
calculating a second short exposure value EV4 from the frame blocks having the average luminance value greater than the fourth luminance threshold Y4;
calculating a final long exposure value EV5 according to the first long exposure value EV1 and the second long exposure value EV 3;
calculating a final short exposure value EV6 from the first short exposure value EV2 and the second short exposure value EV 4;
the photographs with exposure values of initial exposure value EV0, final long exposure value EV5 and final short exposure value EV6, respectively, were fused to obtain HDR photographs.
In a second aspect, the present invention provides a photographing apparatus comprising:
the shooting module is used for acquiring a picture to be shot;
the acquisition module is used for acquiring an initial exposure value EV0 of a preview frame of a picture to be shot;
a first calculating module, configured to calculate a first long exposure value EV1 according to a pixel whose luminance value of the preview frame is less than a first luminance threshold Y1;
a second calculation module for calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2;
a dividing module, configured to divide the preview frame into a plurality of frame blocks;
a third calculation module for calculating a second long exposure value EV3 from frame blocks having an average luminance value less than a third luminance threshold Y3;
a fourth calculation module for calculating a second short exposure value EV4 from a block of frames whose average luminance value is greater than a fourth luminance threshold Y4;
a fifth calculation module for calculating a final long exposure value EV5 according to the first long exposure value EV1 and the second long exposure value EV 3;
a sixth calculation module for calculating a final short exposure value EV6 from the first short exposure value EV2 and the second short exposure value EV 4;
and a photo fusion module for fusing the photos with the exposure values of the initial exposure value EV0, the final long exposure value EV5 and the final short exposure value EV6 respectively to obtain the HDR photo.
In a third aspect, the present invention provides an image processing apparatus comprising:
the image receiving module is used for receiving a picture to be shot;
the acquisition module is used for acquiring an initial exposure value EV0 of a preview frame of a picture to be shot;
a first calculating module, configured to calculate a first long exposure value EV1 according to a pixel whose luminance value of the preview frame is less than a first luminance threshold Y1;
a second calculation module for calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2;
a dividing module, configured to divide the preview frame into a plurality of frame blocks;
a third calculation module for calculating a second long exposure value EV3 from frame blocks having an average luminance value less than a third luminance threshold Y3;
a fourth calculation module for calculating a second short exposure value EV4 from a block of frames whose average luminance value is greater than a fourth luminance threshold Y4;
a fifth calculation module for calculating a final long exposure value EV5 from the first long exposure value EV1 and the second long exposure value EV 3;
a sixth calculating module for calculating a final short exposure value EV6 according to the first short exposure value EV2 and the second short exposure value EV 4;
and a photo fusion module for fusing the photos with exposure values of the initial exposure value EV0, the final long exposure value EV5 and the final short exposure value EV6 respectively to obtain an HDR photo.
In a fourth aspect, the invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described image processing method.
Compared with the prior art, the invention obtains the proper EV interval through the whole brightness value of the preview frame of the picture to be shot and the brightness value of the partial frame block of the preview frame, and the shot HDR picture can well reserve the details of the bright part and the dark part in the picture, thereby reducing the problems of artifacts, smear and the like easily appearing in multiple (more than 7) HDR pictures and simultaneously improving the shooting speed.
Drawings
Fig. 1 is a flowchart of an image processing method in embodiment 1 of the present invention.
Fig. 2 is a first look-up table LUT1 in embodiment 1 of the invention.
Fig. 3 is a second lookup table LUT2 in embodiment 1 of the invention.
Fig. 4 is a second lookup table LUT3 in embodiment 1 of the invention.
Fig. 5 is a second lookup table LUT4 in embodiment 1 of the invention.
Fig. 6 is a block diagram of an imaging apparatus in embodiment 2 of the present invention.
Fig. 7 is a block diagram of an image processing apparatus in embodiment 3 of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clearly apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
Example 1
As shown in fig. 1, a preferred embodiment of the image processing method in the present embodiment includes the following steps.
S0: and adjusting the brightness of the preview frame of the picture to be shot.
The step is mainly used for adjusting the brightness of the preview frame of the picture to be shot to be proper. The factors for adjusting the brightness include combinations of photographing environments (e.g., photographing time, photographing weather) and photographing contents (e.g., sky, people, scenery), and the like, and the brightness values of the combinations are empirical values. The brightness adjustment of the preview frame of the picture to be shot can be realized by the following modes: assuming that the luminance of the current image is La, the exposure amount of the current image is EVa, and the reference luminance of the corresponding shooting scene is Lb, the exposure amount EVb = EVa × Lb/La to be output next time. Where the exposure amount EV is a combination of the shutter time, the ISO value, and the aperture, the brightness of the preview frame of the picture to be taken is adjusted by adjusting the shutter time in the present embodiment.
S1: the initial exposure value EV0 of the preview frame of the picture to be taken is acquired.
Acquiring exposure parameters of a shooting device for shooting the preview frame of the shooting picture, wherein the exposure parameters comprise exposure time T and an exposure gain value G, and calculating an initial exposure value EV0 of the preview frame of the picture to be shot according to the exposure time and the exposure, and the calculation formula is as follows: EV0= T × G.
S2: the first long exposure value EV1 is calculated from pixels whose luminance value of the preview frame is less than the first luminance threshold Y1.
Specifically, the brightness value of each pixel of the preview frame is calculated, and then calculated according to the total weighted number S1 of all pixels whose brightness values are smaller than the first brightness threshold Y1, the initial exposure value EV0, and the first lookup table LUT 1.
In this embodiment, luminance histogram statistics is performed for each pixel of a preview frame, and luminance distribution information is collected. The method specifically comprises the following steps: converting RGB of each pixel into a brightness value Y, wherein the interval of the RGB values is 0-255, and the calculation formula of the brightness value Y of the pixel is as follows: y = R0.299 + G0.587 + B0.114, and then the number of corresponding pixels per luminance is counted and stored.
Calculating a weighted total number S1, S1= of pixels having a luminance value Y less than a first luminance threshold value Y1
Wherein i is less than Y1, Hj]WG1[ i ] representing the number of pixels with a luminance value of i in the preview frame]The weight value of the pixel with the brightness value i. Then, EV1 is calculated from the total weight S1, the initial exposure value EV0 of the preview frame, and the first lookup table LUT 1. Wherein, the weight value WG1[ i ]]In relation to the luminance value of the pixel, the smaller the luminance value, the higher the weight thereof, to calculate a more suitable first long exposure value EV1, first lookupThe data in the Look-Up Table LUT1 (Look-Up-Table) is empirical data and can be adjusted according to actual conditions.
In this embodiment, the first luminance threshold Y1 is 64, the relative weight value of luminance value 1 is 10, the relative weight value of luminance value 64 is 2, the relative weight value of luminance value 2-63 of the pixel is set between 2-10, and the corresponding data of the first lookup table LUT1 is as shown in fig. 2. Specifically, the total weighting number S1 is an index of the horizontal data, the initial exposure value EV0 is an index of the vertical data, the four nearest values are found according to the actual total weighting number S1 and the initial exposure value EV0, and the first long exposure value EV2 is obtained by interpolation. The first luminance threshold value Y1 may be calculated similarly when it takes other values.
S3: the first short exposure value EV2 is calculated from pixels whose luminance value of the preview frame is greater than the second luminance threshold Y2.
In this step, similar to S2, the first short exposure value EV2 is calculated from the number and weight of pixels having luminance values greater than the second luminance threshold value Y2, the initial exposure value EV0, and the second lookup table LUT 2.
Since the counting and storing of the brightness values of the pixels in the preview frame are completed in step S2, the implementation procedure of this step is as follows: calculating a weighted total number S2, S2= of pixels having a luminance value Y greater than the second luminance value Y2
Wherein i is greater than Y2, Hi]Denotes the number of pixels with a luminance value i in the preview frame, WG2[ i [ ]]The weight value of the pixel with the brightness value of i. Then, EV2 is calculated from the initial exposure value EV0 of the preview frame, the second lookup table LUT2 according to the total number of weights S2. Wherein, the weight value WG2[ i ]]In relation to the luminance value of the pixel, the larger the luminance value, the higher the weight thereof to calculate the more suitable first short exposure value EV2, and similarly, the data in the second lookup Table LUT2 (Look-Up-Table) is empirical data and can be adjusted according to actual conditions.
In the embodiment, the second luminance threshold Y2 is 192, the relative weight value of the luminance value 192 is 2, the relative weight value of the luminance value 255 is 10, and the relative weight values of the luminance values 193 and 254 of the pixels are set between 2-10. Specifically, the total weighting number S2 is an index of the horizontal data, the initial exposure value EV0 is an index of the vertical data, the four nearest values are found according to the actual total weighting number S2 and the initial exposure value EV0, and the first short exposure value EV2 is obtained by interpolation.
S4: the preview frame is divided into a plurality of frame blocks.
In this step, the manner of dividing the preview frame into a plurality of frame blocks is not limited. For example, the preview frame may be divided into a fixed size or may be divided into object shapes in the preview frame. In this embodiment, the preview frame is divided equally into 16 × 16 frame blocks of the same size and shape.
S5: the second long exposure value EV3 is calculated from the frame block having the average luminance value smaller than the third luminance threshold value Y3.
In this step, the average luminance of each frame block in step S3 is counted, and if the average luminance of a certain frame block is smaller than the third luminance threshold Y3, the average luminance of the certain frame block is listed in the calculation of the second long exposure value EV3, and then the total weighting number S3 is calculated according to the average luminance and the weight of the certain frame block, and then the EV3 is calculated by combining the initial exposure value EV0 and the third lookup Table LUT3, and the data in the third lookup Table LUT3 (Look-Up-Table) is empirical data and can be adjusted according to actual conditions.
The average luminance calculation for a frame block can be calculated by the following formula:
where m is the total number of pixels of the block of frames, P [ k ]]Is the luminance value of the kth pixel in the frame block, P [ k ]]In the range of 0-255, luminance values P [ k ]]= R*0.299 + G*0.587 + B*0.114。
The total number of weights S3 is calculated in the manner of S3=
Wherein, L [ j ]]Average luminance value of jth frame block, WG3[ j]Is the weight value of the jth frame block, Lj]Less than a third luminance threshold Y3. Weight value WG3[ j]And picture content and/or of frame block jLocation correlation in the preview frame; generally, the closer the frame block is to the center of the preview frame, the higher the weight, and the higher the weight when the picture content in the frame block is a main subject or person. In the present embodiment, the third luminance threshold value Y3 is 32, but may have another value.
The second long exposure value EV3 is specifically calculated as follows, where the total weighting number S3 is an index of the horizontal data, the initial exposure value EV0 is an index of the vertical data, the four nearest values are found out according to the actual total weighting number S3 and the initial exposure value EV0, and the second long exposure value EV3 is obtained by interpolation.
S6: the second short exposure value EV4 is calculated from the frame block having the average luminance value greater than the fourth luminance threshold Y4.
In this step, according to the average luminance of each frame block in step S4, if the average luminance of a certain frame block is greater than the fourth luminance threshold Y4, the average luminance of the certain frame block is listed in the calculation of the second short exposure value EV4, then the total weighting number S4 is calculated according to the average luminance and the weight of the certain frame block, and then EV4 is calculated by combining the initial exposure value EV0 and the third lookup Table LUT4, and the data in the fourth lookup Table LUT4 (hook-Up-Table) is empirical data and can be adjusted according to actual conditions. The calculation of the average luminance of the frame block may refer to step S4.
The total number of weights S4 is calculated in the manner of S4=
Wherein, L [ j ]]Average luminance value of jth frame block, WG4[ j]Is the weight value of the jth frame block. Weight value WG3[ j]Related to the picture content of frame block j and/or the position in the preview frame; generally, the closer the frame block is to the center of the preview frame, the higher the weight, and the higher the weight when the picture content in the frame block is a main subject or person. In the present embodiment, the third luminance threshold value Y4 is 224. Of course, other values may be used.
The second short exposure value EV4 is specifically calculated as follows, where the total weighting number S4 is an index of the horizontal data, the initial exposure value EV0 is an index of the vertical data, the four nearest values are found out according to the actual total weighting number S4 and the initial exposure value EV0, and the second short exposure value EV4 is obtained by interpolation.
S7: the final long exposure value EV5 is calculated from the first long exposure value EV1 and the second long exposure value EV 3.
The final long exposure value EV5 is calculated as: EV5= EV1 r + EV3 (1-r1), and r1 is a weight adjustment coefficient, which can be adjusted according to the difference in the overall and local attention of the photographer to the photograph. In this example, r1 is 0.5, i.e., EV5= (EV1+ EV 3)/2.
S8: the final short exposure value EV6 is calculated from the first short exposure value EV2 and the second short exposure value EV 4.
The final short exposure value EV6 is calculated as: EV6= EV2 × r2+ EV4 (1-r2), and r2 is a weight adjustment coefficient, which can be adjusted according to the difference in the overall and local attention of the photographer to the photograph. In this example, r2 is 0.5, i.e. EV6= (EV2+ EV 4)/2.
S9: the photographs with exposure values of initial exposure value EV0, final long exposure value EV5 and final short exposure value EV6, respectively, were fused to obtain HDR photographs.
The exposure values are set to an initial exposure value EV0, a final long exposure value EV5, and a final short exposure value EV6, one photo is taken for each picture to be taken, and then the three photos are subjected to fusion processing to obtain an HDR photo.
It should be noted that, the implementation of each step in the present embodiment does not necessarily have to be performed in the order of reference, unless the step must depend on the previous step or steps.
Example 2
The embodiment of the invention discloses a shooting device which comprises but is not limited to a shooting terminal such as a smart phone, a camera or a law enforcement recorder. The photographing apparatus includes: the shooting module (such as a camera) is used for acquiring a picture to be shot; the acquisition module is used for acquiring an initial exposure value EV0 of a preview frame of a picture to be shot; the brightness adjusting module is used for adjusting the brightness of the preview frame before the initial exposure value of the preview frame of the picture to be shot is acquired; a first calculation module, configured to calculate a first long exposure value EV1 according to pixels whose luminance values of the preview frame are less than a first luminance threshold Y1; a second calculation module for calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2; a dividing module, configured to divide the preview frame into a plurality of frame blocks; a third calculation module for calculating a second long exposure value EV3 from frame blocks having an average luminance value less than a third luminance threshold Y3; a fourth calculation module for calculating a second short exposure value EV4 from a block of frames whose average luminance value is greater than a fourth luminance threshold Y4; a fifth calculation module for calculating a final long exposure value EV5 from the first long exposure value EV1 and the second long exposure value EV 3; a sixth calculating module for calculating a final short exposure value EV6 according to the first short exposure value EV2 and the second short exposure value EV 4; and a photo fusion module for fusing the photos with exposure values of the initial exposure value EV0, the final long exposure value EV5 and the final short exposure value EV6 respectively to obtain an HDR photo.
In this embodiment, the processing procedure and corresponding parameters of each module are the same as or similar to those in embodiment 1.
Example 3
The embodiment discloses an image processing device which comprises an electronic device or a server which has an image processing function and does not have a shooting module. The image processing apparatus includes: the image receiving module is used for receiving pictures to be shot, the pictures are obtained through a camera or a shooting terminal (such as a camera, a smart phone, a law enforcement recorder and other shooting terminals with cameras), and the image receiving module comprises but is not limited to a Bluetooth module, an NFC module, a WIFI module and the like; the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring an initial exposure value EV0 of a preview frame of a picture to be shot; the brightness adjusting module is used for adjusting the brightness of the preview frame before the initial exposure value of the preview frame of the picture to be shot is acquired; a first calculation module, configured to calculate a first long exposure value EV1 according to pixels whose luminance values of the preview frame are less than a first luminance threshold Y1; a second calculation module for calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2; a dividing module, configured to divide the preview frame into a plurality of frame blocks; a third calculating module for calculating a second long exposure value EV3 from frame blocks having an average luminance value less than a third luminance threshold Y3; a fourth calculation module for calculating a second short exposure value EV4 from a block of frames whose average luminance value is greater than a fourth luminance threshold Y4; a fifth calculation module for calculating a final long exposure value EV5 from the first long exposure value EV1 and the second long exposure value EV 3; a sixth calculating module for calculating a final short exposure value EV6 according to the first short exposure value EV2 and the second short exposure value EV 4; a photo fusion module for fusing the photos with exposure values of the initial exposure value EV0, the final long exposure value EV5 and the final short exposure value EV6 respectively to obtain an HDR photo; and the image sending module is used for sending the HDR photo to other terminals, wherein the other terminals include but are not limited to a shooting terminal.
In this embodiment, the processing procedure and corresponding parameters of each module are the same as or similar to those in embodiment 1.
Example 4
The present embodiment discloses a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the image processing method in embodiment 1.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing associated hardware, and the storage medium may be a computer-readable storage medium, such as a ferroelectric Memory (FRAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Erasable Programmable Read Only Memory (EEPROM), a flash Memory, a magnetic surface Memory, an optical disc, or a Compact disc Read Only Memory (CD-ROM), etc.; or may be various devices including one or any combination of the above memories.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (13)
1. An image processing method, characterized by comprising:
acquiring an initial exposure value EV0 of a preview frame of a picture to be shot;
calculating a first long exposure value EV1 according to pixels of which the luminance values of the preview frames are smaller than a first luminance threshold Y1;
calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2;
dividing a preview frame into a plurality of frame blocks;
calculating a second long exposure value EV3 from the frame blocks having the average luminance value less than the third luminance threshold value Y3;
calculating a second short exposure value EV4 from the frame blocks having the average luminance value greater than the fourth luminance threshold Y4;
calculating a final long exposure value EV5 according to the first long exposure value EV1 and the second long exposure value EV 3;
calculating a final short exposure value EV6 according to the first short exposure value EV2 and the second short exposure value EV 4;
the photographs with exposure values of initial exposure value EV0, final long exposure value EV5, and final short exposure value EV6, respectively, were fused to obtain HDR photographs.
2. The image processing method according to claim 1, wherein the brightness of the preview frame of the picture to be taken is adjusted before the initial exposure value of the preview frame of the picture to be taken is acquired.
3. The image processing method according to claim 1, characterized in that said calculating a first long exposure value EV1 from pixels whose luminance values of the preview frames are smaller than a first luminance threshold is specifically: calculating the total weighted number S1, S1 =pixels with brightness values smaller than the first brightness threshold Y1 in the preview frame
Wherein i is less than Y1，H[i]WG1[ i ] representing the number of pixels with a luminance value of i in the preview frame]The weighted value is calculated according to the brightness value and the weight of the pixel with the brightness value smaller than the first brightness threshold value Y1, the initial exposure value EV0 and the first lookup table LUT 1.
4. The image processing method according to claim 1, wherein said calculating the first short exposure value EV2 from pixels whose luminance values of the preview frame are greater than the second luminance threshold Y2 is specifically: calculating the total weighted number S2, S2 =pixels with brightness value of preview frame greater than the second brightness value Y2
Wherein i is greater than Y2, Hi]WG2[ i ] representing the number of pixels with a luminance value of i in the preview frame]The weighted value is calculated according to the brightness value and the weight of the pixel with the brightness value larger than the second brightness threshold value Y2, the initial exposure value EV0 and the second lookup table LUT 2.
5. The image processing method of claim 1, wherein the dividing the preview frame into a plurality of frame blocks comprises: the preview frame is divided into a plurality of frame blocks with the same shape or divided into a plurality of frame blocks according to objects in the preview frame.
6. The image processing method according to claim 1, characterized in that said calculating of the second long exposure value EV3 from a block of frames having an average luminance value less than the third luminance threshold Y3 is in particular: and calculating the average brightness value of each frame block, and then calculating according to the average brightness value of the frame blocks with the average brightness value smaller than the third brightness threshold value Y3, the total weighting number of the weights, the initial exposure value EV0 and the third lookup table LUT 3.
7. The image processing method according to claim 1, characterized in that said calculating of the second short exposure value EV4 from a block of frames having an average luminance value greater than the fourth luminance threshold Y4 is in particular: and calculating the average brightness value of each frame block, and calculating according to the average brightness value of the frame block with the average brightness value larger than the fourth brightness threshold value Y4, the total weighting number of the weights, the initial exposure value EV0 and the fourth lookup table LUT 4.
8. A camera, comprising:
the shooting module is used for acquiring a picture to be shot;
the acquisition module is used for acquiring an initial exposure value EV0 of a preview frame of a picture to be shot;
a first calculation module, configured to calculate a first long exposure value EV1 according to pixels whose luminance values of the preview frame are less than a first luminance threshold Y1;
a second calculating module, configured to calculate a first short exposure value EV2 according to pixels whose luminance values of the preview frames are greater than a second luminance threshold Y2;
a dividing module, configured to divide the preview frame into a plurality of frame blocks;
a third calculation module for calculating a second long exposure value EV3 from frame blocks having an average luminance value less than a third luminance threshold Y3;
a fourth calculation module for calculating a second short exposure value EV4 from a block of frames whose average luminance value is greater than a fourth luminance threshold Y4;
a fifth calculation module for calculating a final long exposure value EV5 from the first long exposure value EV1 and the second long exposure value EV 3;
a sixth calculation module for calculating a final short exposure value EV6 from the first short exposure value EV2 and the second short exposure value EV 4;
and a photo fusion module for fusing the photos with the exposure values of the initial exposure value EV0, the final long exposure value EV5 and the final short exposure value EV6 respectively to obtain the HDR photo.
9. The camera of claim 8, further comprising:
and the brightness adjusting module is used for adjusting the brightness of the preview frame before the initial exposure value of the preview frame of the picture to be shot is acquired.
10. An image processing apparatus characterized by comprising:
the image receiving module is used for receiving a picture to be shot;
the acquisition module is used for acquiring an initial exposure value EV0 of a preview frame of a picture to be shot;
a first calculation module, configured to calculate a first long exposure value EV1 according to pixels whose luminance values of the preview frame are less than a first luminance threshold Y1;
a second calculation module for calculating a first short exposure value EV2 according to pixels of which the brightness value of the preview frame is greater than a second brightness threshold Y2;
a dividing module, configured to divide the preview frame into a plurality of frame blocks;
a third calculation module for calculating a second long exposure value EV3 from frame blocks having an average luminance value less than a third luminance threshold Y3;
a fourth calculation module for calculating a second short exposure value EV4 from the frame blocks having the average luminance value greater than a fourth luminance threshold Y4;
a fifth calculation module for calculating a final long exposure value EV5 from the first long exposure value EV1 and the second long exposure value EV 3;
a sixth calculation module for calculating a final short exposure value EV6 from the first short exposure value EV2 and the second short exposure value EV 4;
and a photo fusion module for fusing the photos with the exposure values of the initial exposure value EV0, the final long exposure value EV5 and the final short exposure value EV6 respectively to obtain the HDR photo.
11. The image processing apparatus according to claim 10, further comprising:
and the brightness adjusting module is used for adjusting the brightness of the preview frame before the initial exposure value of the preview frame of the picture to be shot is acquired.
12. The image processing apparatus according to claim 10, further comprising:
and the image sending module is used for sending the HDR photos to other terminals.
13. A computer-readable storage medium, characterized in that a computer program is stored thereon, which, when being executed by a processor, implements the automatic exposure method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110328957.9A CN115134508A (en) | 2021-03-27 | 2021-03-27 | Image processing method, imaging device, image processing device, and readable storage medium |
| PCT/CN2022/080597 WO2022206353A1 (en) | 2021-03-27 | 2022-03-14 | Image processing method, photographic apparatus, image processing apparatus and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110328957.9A CN115134508A (en) | 2021-03-27 | 2021-03-27 | Image processing method, imaging device, image processing device, and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115134508A true CN115134508A (en) | 2022-09-30 |
Family
ID=83374848
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110328957.9A Pending CN115134508A (en) | 2021-03-27 | 2021-03-27 | Image processing method, imaging device, image processing device, and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115134508A (en) |
| WO (1) | WO2022206353A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117440253A (en) * | 2023-12-22 | 2024-01-23 | 荣耀终端有限公司 | Image processing method and related device |
| CN117499779A (en) * | 2023-12-27 | 2024-02-02 | 荣耀终端有限公司 | Image preview method, device and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115412678B (en) * | 2022-10-20 | 2023-05-26 | 荣耀终端有限公司 | Exposure processing method and device and electronic equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007053617A (en) * | 2005-08-18 | 2007-03-01 | Fujifilm Holdings Corp | Exposure value operation method and imaging apparatus |
| CN102143326B (en) * | 2010-01-28 | 2013-07-24 | 比亚迪股份有限公司 | Automatic exposure unit and method thereof |
| TWI486057B (en) * | 2012-05-17 | 2015-05-21 | Altek Corp | Image pickup device and image synthesis method thereof |
| CN105578068B (en) * | 2015-12-21 | 2018-09-04 | 广东欧珀移动通信有限公司 | A kind of generation method of high dynamic range images, device and mobile terminal |
| CN106791472B (en) * | 2016-12-29 | 2019-07-30 | 努比亚技术有限公司 | A kind of exposure method and terminal |
| JP7130777B2 (en) * | 2018-06-07 | 2022-09-05 | ドルビー ラボラトリーズ ライセンシング コーポレイション | HDR image generation from a single-shot HDR color image sensor |
| US10855931B1 (en) * | 2019-11-07 | 2020-12-01 | Novatek Microelectronics Corp. | High dynamic range image sensing method for image sensing device |
-
2021
- 2021-03-27 CN CN202110328957.9A patent/CN115134508A/en active Pending
-
2022
- 2022-03-14 WO PCT/CN2022/080597 patent/WO2022206353A1/en active Application Filing
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117440253A (en) * | 2023-12-22 | 2024-01-23 | 荣耀终端有限公司 | Image processing method and related device |
| CN117499779A (en) * | 2023-12-27 | 2024-02-02 | 荣耀终端有限公司 | Image preview method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022206353A1 (en) | 2022-10-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019183813A1 (en) | Image capture method and device | |
| CN112150399B (en) | Image enhancement method based on wide dynamic range and electronic equipment | |
| CN107925751B (en) | System and method for multiple views noise reduction and high dynamic range | |
| US7916181B2 (en) | Method and device for creating high dynamic range pictures from multiple exposures | |
| CN115134508A (en) | Image processing method, imaging device, image processing device, and readable storage medium | |
| US9613408B2 (en) | High dynamic range image composition using multiple images | |
| JP4846259B2 (en) | Brightness correction | |
| TWI602152B (en) | Image capturing device nd image processing method thereof | |
| CN107948500A (en) | Image processing method and device | |
| WO2014123603A1 (en) | Noise models for image processing | |
| JP6824817B2 (en) | Image processing device and image processing method | |
| CN111242860B (en) | Super night scene image generation method and device, electronic equipment and storage medium | |
| CN113313661A (en) | Image fusion method and device, electronic equipment and computer readable storage medium | |
| KR101294735B1 (en) | Image processing method and photographing apparatus using the same | |
| WO2020029679A1 (en) | Control method and apparatus, imaging device, electronic device and readable storage medium | |
| CN107682611B (en) | Focusing method and device, computer readable storage medium and electronic equipment | |
| CN114820405A (en) | Image fusion method, device, equipment and computer readable storage medium | |
| JP2022179514A (en) | Control apparatus, imaging apparatus, control method, and program | |
| CN112598609A (en) | Dynamic image processing method and device | |
| CN116668862B (en) | Image processing method and electronic equipment | |
| CN116437222B (en) | Image processing method and electronic equipment | |
| JP2023090492A (en) | Image processing device, image processing method, and imaging apparatus | |
| CN115988311A (en) | Image processing method and electronic equipment | |
| CN109447925B (en) | Image processing method and device, storage medium and electronic equipment | |
| JP2017068513A (en) | Image processing device and method thereof, program, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |