WO2016046664A1 - Procédé de traitement d'images, appareil de traitement d'images et dispositif électronique - Google Patents
Procédé de traitement d'images, appareil de traitement d'images et dispositif électronique Download PDFInfo
- Publication number
- WO2016046664A1 WO2016046664A1 PCT/IB2015/056507 IB2015056507W WO2016046664A1 WO 2016046664 A1 WO2016046664 A1 WO 2016046664A1 IB 2015056507 W IB2015056507 W IB 2015056507W WO 2016046664 A1 WO2016046664 A1 WO 2016046664A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- parameter
- shoot
- processing
- shoot scene
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 196
- 238000003672 processing method Methods 0.000 title claims abstract description 27
- 238000012937 correction Methods 0.000 claims abstract description 65
- 238000010191 image analysis Methods 0.000 claims abstract description 15
- 238000009826 distribution Methods 0.000 claims description 35
- 238000000605 extraction Methods 0.000 claims description 19
- 238000001514 detection method Methods 0.000 claims description 15
- 230000009467 reduction Effects 0.000 claims description 8
- 239000004576 sand Substances 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 26
- 230000006870 function Effects 0.000 description 24
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 16
- 238000004891 communication Methods 0.000 description 13
- 238000000034 method Methods 0.000 description 13
- 230000000694 effects Effects 0.000 description 12
- 239000000284 extract Substances 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000000052 comparative effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 241001270131 Agaricus moelleri Species 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000012886 linear function Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000000149 argon plasma sintering Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000003702 image correction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
Definitions
- the present disclosure relates to the field of image processing, and particularly, to an image processing method, an image processing apparatus and an electronic device.
- some abnormal shoot scenes e.g., the light is non-ideal
- the electronic devices may be waterproof in hardware; thus, the user can shoot underwater with the electronic devices, thereby increasing the fun of using the electronic devices.
- the light fades very quickly and seriously in the water.
- the shooting in the water cannot achieve the same effect as the shooting in the air.
- people will find that the contrast, saturation and brightness of the image shot in the water are all unsatisfactory, and many details cannot be presented in the image.
- the inventor of the present application finds that with the popularity of, for example, the mobile terminal, the shooting in various shoot scenes (e.g., underwater shoot scenes ) is increasingly frequent, and the user also has higher and higher requirements for the quality of the images shot in various shoot scenes. Thus, it is necessary to specifically process the images shot in various shoot scenes, so as to improve the quality of the shot image.
- various shoot scenes e.g., underwater shoot scenes
- the embodiments of the present application provide an image processing method, an image processing apparatus and an electronic device, for the purpose of improving the quality of the images shot in various shoot scenes.
- an image processing apparatus including:
- a shoot scene determination portion (the term “portion” may also be referred to and understood throughout this application as module) configured to determine a shoot scene of an image
- an image analysis portion configured to analyze the image to determine a degree of influence of the shoot scene on the shoot quality of the image
- an image processing portion configured to perform a correction processing of the image according to the degree of influence.
- the shoot scene determination portion includes:
- a first parameter extraction portion configured to extract a first parameter reflecting features of the image
- a first comparison portion configured to compare the first parameter with a preset first threshold
- the first parameter includes any or a combination of a parameter reflecting color histogram features or grayscale distribution histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- the image analysis portion includes:
- a second parameter extraction portion configured to extract a second parameter reflecting features of the image
- an influence degree determination portion configured to determine the degree of influence of the shoot scene on the shoot quality of the image according to the second parameter.
- the second parameter includes any or a combination of a parameter reflecting color histogram features or grayscale distribution histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- the image processing portion includes:
- a processing parameter setting portion configured to set a processing parameter required to perform a correction processing of the image according to the degree of influence
- a processing execution portion configured to perform the correction processing of the image according to the processing parameter set by the processing parameter setting portion.
- the correction processing of the image performed by the processing execution portion at least includes a gamma correction and/or a histogram adjustment.
- the shoot scene includes an underwater shoot scene, a smoky shoot scene, an overcast and rainy shoot scene, a haze shoot scene, a sand storm shoot scene or a dim shoot scene.
- the shoot scene determination portion determines the shoot scene of the image by detecting the image or through a sensor detection.
- an electronic device is provided, including the aforementioned image processing apparatus.
- an image processing method including:
- determining a shoot scene of an image includes:
- the first parameter includes any or a combination of a parameter reflecting color histogram features or grayscale distribution histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- analyzing the image to determine a degree of influence of the shoot scene on the shoot quality of the image includes:
- the second parameter includes any or a combination combinations of a parameter reflecting color histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- performing a correction processing of the image according to the degree of influence includes: setting a processing parameter required to perform a correction processing of the image according to the degree of influence;
- the performed correction processing of the image at least includes a gamma correction and/or a histogram adjustment.
- the performed correction processing of the image further includes any or a combination combinations of an edge enhancement processing, a noise reduction processing and/or a dark area enhancement processing.
- the shoot scene includes an underwater shoot scene, a smoky shoot scene, an overcast and rainy shoot scene, a haze shoot scene, a sand storm shoot scene or a dim shoot scene.
- the shoot scene of the image is determined by detecting the image or through a sensor detection.
- the embodiments of the present disclosure have the following beneficial effect: by determining a shoot scene of an image, determining a degree of influence of the shoot scene on the shoot quality of the image, and performing a correction processing of the image according to the degree of influence, the degree of influence of the shoot scene on the shoot quality of the image can be reduced or eliminated, and the quality of the shot image can be improved.
- Fig. 1 is a structural diagram of an image processing apparatus in Embodiment 1;
- Fig. 2 is a structural diagram of a shoot scene determination portion in Embodiment 1;
- Fig. 3 is a comparative diagram of color histograms of RGB images shot in the water and air;
- Fig. 4 is a structural diagram of an image analysis portion in Embodiment 1;
- Fig. 5 is a structural diagram of an image processing portion in Embodiment 1;
- Fig. 6 is a structural diagram of a processing execution portion in Embodiment 1;
- Fig. 7 is a comparative diagram of the effects before and after a processing of an image shot in the water made by an image processing apparatus of the Embodiment 1;
- Fig. 8 is a flow diagram of an image processing method in Embodiment 2.
- Fig. 9 is another flow diagram of an image processing method in Embodiment 2.
- Fig. 10 is a flow diagram of determining a shoot scene in Embodiment 2.
- Fig. 11 is a flow diagram of determining a degree of influence of a shoot scene on the shoot quality of an image in Embodiment 2;
- Fig. 12 is a flow diagram of performing an image correction processing in Embodiment 2;
- Fig. 13 is a block diagram of a system construction of an electronic device in Embodiment 3.
- the interchangeable terms “electronic device” and “electronic apparatus” include a portable radio communication device.
- the term “portable radio communication device”, which is hereinafter referred to as “mobile radio terminal”, “portable electronic apparatus”, or “portable communication apparatus”, includes all devices such as mobile phone, pager, communication apparatus, electronic organizer, personal digital assistant (PDA), smart phone, portable communication apparatus, etc.
- the embodiments of the present disclosure are mainly described with respect to a portable electronic apparatus in the form of a mobile phone (also referred to as "cellular phone").
- a mobile phone also referred to as "cellular phone”
- the present disclosure is not limited to the case of the mobile phone and it may relate to any type of appropriate electronic device, such as mobile terminal, media player, gaming device, PDA and computer, digital video camera, tablet PC, wearable electronic device, etc.
- Embodiment 1 of the present application provides an image processing apparatus for processing an image.
- Fig. 1 is a structural diagram of an image processing apparatus in Embodiment 1.
- the image processing apparatus 100 includes a shoot scene determination portion 101 (the term "portion" may also be referred to and understood throughout this application as module), an image analysis portion 102 and an image processing portion 103.
- the shoot scene determination portion 101 is configured to determine a shoot scene of an image.
- the image analysis portion 102 is configured to analyze the image to determine a degree of influence of the shoot scene on the shoot quality of the image.
- the image processing portion 103 is configured to perform a correction processing of the image according to the degree of influence.
- the image processing apparatus 100 may correct the images under various shoot scenes.
- the shoot scene may be a situation where the light is non-ideal, such as a dim shoot scene due to insufficient light; or a situation of light attenuation, like an underwater shoot scene, due to light propagation in a propagation medium; or a situation of light diffusion or light reflection, like a smoky shoot scene, caused by impurities in a propagation medium.
- the shoot scene may include an underwater shoot scene, a smoky shoot scene, an overcast and rainy shoot scene, a hazy shoot scene, a sand storm shoot scene or a dim shoot scene.
- the present disclosure is not limited thereto, and other shoot scenes may also be possible.
- the present disclosure will be described in details by taking the underwater shoot scene as an example.
- the image processing apparatus 100 may be configured in a waterproof mobile terminal, and an image acquiring member of the mobile terminal may acquire the image.
- the mobile terminal for example may be a camera, a smart phone, a tablet PC, a wearable device, etc., and the image acquiring member for example may be a CCD image sensor, etc., but the present disclosure is not limited thereto.
- the mobile terminal may control the image sensor to acquire the image by shooting underwater.
- the image processing apparatus may process the acquired image, thereby obtaining a corrected image in real time.
- the mobile terminal may obtain a parameter related to the pressure or the light through a pressure sensor or a light sensor.
- the shoot scene determination portion 101 in the image processing apparatus 100 may determine whether it is in the underwater shoot scene by judging whether the parameter is larger than a preset threshold.
- the image analysis portion 102 and the image processing portion 103 correct the image shot by the video camera.
- the mobile terminal may obtain an image through the image sensor.
- the shoot scene determination portion 101 in the image processing apparatus 100 may analyze the image to determine whether it is in the underwater shoot scene.
- the image analysis portion 102 and the image processing portion 103 correct the shot image.
- the image processing apparatus may also be provided in an electronic device which is not a mobile terminal, such as a Personal Computer (PC).
- the electronic device may acquire the image from, for example, a waterproof photo camera through a network, a USB interface, a Bluetooth interface, etc.
- the image processing apparatus may process the acquired image, thereby obtaining a corrected image in non-real time.
- the image processing apparatus 100 may perform a correction processing of the image according to the degree of influence of the underwater shoot scene on the shoot quality of the image, so as to reduce or eliminate the degree of influence.
- the quality of the image shot underwater can be improved.
- Fig. 2 is a structural diagram of a shoot scene determination portion in Embodiment 1.
- the shoot scene determination portion 101 may include a first parameter extraction portion 201, a first comparison portion 202 and a first judgment portion 203.
- the first parameter extraction portion 201 is configured to extract a first parameter reflecting features of the image; the first comparison portion 202 is configured to compare the first parameter with a preset first threshold; and the first judgment portion 203 is configured to judge a shoot scene of the image according to a comparison result of the first comparison portion.
- the first parameter extraction portion 201 may detect the image, and extract a first parameter reflecting features of the image, wherein when the image is a color image, the first parameter, for example, may be a parameter reflecting color histogram features of the image, and when the image is a grayscale image, the first parameter for example may be a parameter reflecting grayscale distribution histogram features of the image.
- Fig. 3 is a comparative diagram of color histograms of RGB images shot in the water and air, wherein Fig. 3 (b) is corresponding to an image shot in the air, and Fig. 3 (a) is corresponding to an image shot in the water.
- R, G and B represent color histograms of red (R), green (G) and blue (B) channels of the image, respectively, wherein in the color histogram of each channel, the horizontal axis represents the grayscale value of the pixel, for example in a range of 0 to 256 from left to right, the color being close to white when the grayscale value increases, and the longitudinal axis represents the number of pixels corresponding to a certain grayscale value in the channel of the color.
- the reason of the phenomenon is that the contrast of the image is decreased due to the effects of light scattering, absorption and refraction by the water, thus the difference between the grayscales of the pixels in the image becomes unobvious. As a result, the grayscale values of the pixels are focused in a middle area of the color histogram. Thus, it can be determined whether the image is shot in the underwater shoot scene according to the width of pixel distribution on the horizontal axis in the color histogram.
- the above analysis is also applicable to the grayscale distribution histogram of the grayscale image, i.e., the image shot in the water has a narrower width of pixel distribution on the horizontal axis in the grayscale distribution histogram than the image shot in the air.
- the first parameter extraction portion may extract a width of pixel distribution in the color histogram as a parameter reflecting features of the color histogram.
- the first parameter extraction portion 201 may detect the color histogram of the R, G or B channel of the image, and calculate a width of pixel distribution on the horizontal axis in the color histogram as the first parameter.
- the first parameter extraction portion 201 may extract those widths in two or three of the color histograms of the R, G and B channels, and combine the widths to obtain the first parameter.
- the combination manner for example may be a simple arithmetic or weighted adding, but the present application is not limited thereto.
- the first parameter extraction portion may extract a width of pixel distribution in the grayscale distribution histogram as a parameter reflecting features of the grayscale distribution histogram.
- the extraction manner of the first parameter is not limited thereto.
- the first parameter extraction portion 201 may further extract any one or more of parameters such as brightness, sharpness, saturation or contrast of the image, and combine the extracted parameters to obtain the first parameter.
- the combination manner for example, may be a simple arithmetic or weighted adding, but the present application is not limited thereto, and, for example, an averaging operation may also be performed.
- RGB colors just take RGB colors as examples, and the present disclosure is not limited thereto.
- the YUV mode, the YCbCr mode, the HSV mode or the HIS mode may also be used.
- the first parameter may be inputted into the first comparison portion 202 that compares the first parameter with a preset first threshold and outputs a comparison result.
- the first threshold may be predetermined, or adjusted through an external device according to the user operation, thereby continuously optimizing the threshold.
- the first judgment portion 203 may judge whether the shoot scene of the image is underwater according to the comparison result.
- the first parameter is the width of pixel distribution on the horizontal axis in the color histogram of the R channel of the image, and it is 134, while the preset threshold is 198.
- the image analysis portion 102 may be started.
- the image analysis portion 102 may not be started, and instead, other processing of the image may be performed.
- the image may be processed in a manner opposite to the result of the correction processing by the image processing portion 103, e.g., an underwater shoot effect is added to the image, or other image processing may be performed.
- the shoot scene determination portion 101 may have other structure.
- the shoot scene determination portion 101 may detect a signal of a capacitive pressure sensor array in an image shooting apparatus, and judges whether the image shooting apparatus shoots the image underwater according to the signal of the capacitive pressure sensor array.
- Fig. 4 is a structural diagram of an image analysis portion in Embodiment 1.
- the image analysis portion 102 may include a second parameter extraction portion 401 and an influence degree determination portion 402, wherein the second parameter extraction portion 401 extracts a second parameter reflecting features of the image, and the influence degree determination portion 402 determines the degree of influence of the shoot scene on the shoot quality of the image according to the second parameter.
- the second parameter extraction portion 401 may analyze the image to extract the second parameter.
- the second parameter may be one or a combination of a parameter reflecting features of a color histogram or a grayscale distribution histogram of the image, brightness of the image, saturation of the image, sharpness of the image and/or contrast of the image.
- the present application is not limited thereto, and other parameter may also be possible.
- the second parameter may be different from the first parameter.
- the first parameter may be a width of pixel distribution in the color histogram of the R channel, and the second parameter may be a sharpness of the image.
- the first parameter may be obtained by weighted adding the brightness, saturation and sharpness of the image with a first group of weighting coefficients
- the second parameter may be obtained by weighted adding the brightness, saturation and sharpness of the image with a second group of weighting coefficients, wherein the first group of weighting coefficients are different from the second group of weighting coefficients.
- the second parameter may also be other parameter or a combination of parameters reflecting features of the image.
- the second parameter may also be the same as the first parameter.
- the second parameter extraction portion 401 may directly use the first parameter as the second parameter.
- the first parameter and the second parameter may be determined according to the actual scene.
- the first parameter extraction portion 201 and the second parameter extraction portion 401 are described as above respectively, but the present disclosure is not limited thereto.
- the same member may be used to extract parameters reflecting features of the image, and then those parameters may be applied to the shoot scene determination and the image analysis, respectively, e.g., the parameters may be extracted at one time and used for several times.
- the influence degree determination portion 402 may determine a degree of influence of the shoot scene on the image according to the second parameter.
- the degree of influence of the factors such as water depth, water clarity, weather fairness on the shoot quality for example in the underwater shoot scene can be reflected comprehensively.
- the influence degree determination portion 402 may determine the degree of influence of the shoot scene on the image in multiple manners.
- the degree of influence may be quantized as influence factors of different values
- the second parameter is the width of pixel distribution on the horizontal axis in the color histogram of the R channel of the image.
- the influence factor may be determined as 1; if the value of the second parameter is between 50 and 100, the influence factor may be determined as 2; if the value of the second parameter is between 100 and 150, the influence factor may be determined as 3; if the value of the second parameter is between 150 and 200, the influence factor may be determined as 4; and if the value of the second parameter is between 200 and 256, the influence factor may be determined as 5.
- Fig. 5 is a structural diagram of an image processing portion in Embodiment 1.
- the image processing portion 103 may include a processing parameter setting portion 501 and a processing execution portion 502, wherein the processing parameter setting portion 501 sets a processing parameter required to perform a correction processing of the image according to the degree of influence; and the processing execution portion 502 performs a correction processing of the image according to the processing parameter set by the processing parameter setting portion.
- the processing parameter setting portion 501 may set the processing parameter required to perform a correction processing according to the influence factor determined by the influence degree determination portion 402.
- the set processing parameter enables a reduction or elimination of the degree of influence through the correction processing.
- the processing parameter setting portion 501 may set the processing parameter according to correspondence between the influence factor and the processing parameter.
- the function, the look-up table and the plurality of third thresholds may be preset or adjusted through an external device according to the user operation, so as to be optimized.
- the manner of setting the processing parameter is not limited thereto. Other manners are also possible, e.g., the set parameter may be adjusted according to the user's setting operation, so that the subsequent correction processing meets the user's individual needs.
- the processing parameter may be a gamma parameter for a gamma correction, and/or a parameter for a histogram adjustment (e.g., the threshold of boundary detection for the grayscale focused interval).
- the parameter for the histogram adjustment may be used in an adjustment for the grayscale image, or adjustments for RGB channels of the color image, respectively (meanwhile, it is also adaptive to color images represented with other color space, such as YUV, YCbCr, HSV and HSI). But this embodiment is not limited thereto and other parameters for the correction processing may also be used.
- the processing execution portion 502 performs a correction processing according to the processing parameter set by the processing parameter setting portion 501.
- the correction processing performed by the processing execution portion 502 at least may include a gamma correction and a histogram adjustment.
- the histogram adjustment may include an adjustment of color histogram and/or an adjustment of grayscale distribution histogram.
- the correction processing may further include one or more of an edge enhancement, a noise reduction or a dark area enhancement.
- Fig. 6 is a structural diagram of a processing execution portion in Embodiment 1.
- the processing execution portion 502 may include a gamma correction portion 601, a histogram adjustment portion 602, an edge enhancement portion 603, a noise reduction portion 604 and a dark area enhancement portion 605.
- the gamma correction portion 601 may be configured to compensate for the color attenuation effect of the water.
- a gamma correction may be performed for the R, G and B channels of the image, respectively.
- a gamma correction may be performed for the grayscale of the image.
- the gamma value may be set according to the statistical saturation of the image. For example, the underwater image is usually blue-green, and according to the statistical information of the three channels of the image, it can be found that the red channel usually has a very low saturation. Thus, during the adjustment, the gamma correction parameter of the red channel can be appropriately increased to ensure that the red information is saturated in the recovered image.
- the histogram adjustment portion 602 can improve the contrast of the image, and reflect the details of the image better.
- the histograms of the R, G and B channels thereof may be adjusted respectively.
- the grayscale image the grayscale distribution histogram thereof may be adjusted.
- the grayscale distributions of the R, G and B channels are all compressed, i.e., the higher and low orders of grayscale information is absent, and the grayscale information is focused in the middle area (the actual distribution area is influenced by the image content and the environment brightness).
- the histogram adjustment portion 602 may calculate the grayscale focused interval based on a preset threshold of boundary detection for the grayscale focused interval and information of the grayscale distribution histograms of the R, G and B channels, and then perform a histogram stretching or histogram equalization processing thereof, so as to obtain a processed image of an enhanced contrast and enriched details.
- the edge enhancement portion 603 may be configured to highlight an edge in the image where there is a large difference between the brightness of adjacent areas, so as to clearly display the boundaries of different areas.
- the noise reduction portion 604 may be configured to reduce the noise in the process of image shooting and processing. For example, a noise reduction processing may be performed by constructing a mean filter, a median filter, an adaptive filter, etc.
- the dark area enhancement portion 605 may be configured to perform a grayscale enhancement processing of a dark area (e.g., an area having a low grayscale value) in the image, so as to improve the local contrast of the image.
- a dark area enhancement may be performed for the R, G and B channels thereof, respectively; and as for the grayscale image, a dark area enhancement may be performed for the grayscale of the image.
- the processing orders of the above portions 601-605 can be adjusted upon demand.
- the processing execution portion 502 does not necessarily include all of the above portions 601-605, and for example it may only include some of them. However, in order to ensure the correction quality, the processing execution portion 502 may at least include a gamma correction portion 601 and a histogram adjustment portion 602 in any embodiment.
- the degree of influence of the underwater shoot scene on the shoot quality of the image is reduced and even eliminated through the processing by the processing execution portion 502, thereby improving the quality of the image shot underwater.
- Fig. 7 is a comparative diagram of the effects before and after a processing of an image shot in the water made by an image processing apparatus of the embodiment, wherein Fig. 7 (a) is corresponding to a display effect and a color histogram of the image before the processing, and Fig. 7(b) is corresponding to a display effect and a color histogram of the image after the processing.
- the contrast of the image after the processing is enhanced, and the details are clearer.
- the pixel grayscale distribution of each channel is widened, and the grayscales corresponding to pixel peak values of various channels are close to each other; in the image before the processing, the pixel grayscale distribution of each channel is narrower, and the grayscales corresponding to pixel peak values of various channels are inconsistent with each other.
- the image processing apparatus 100 can also perform the above image processing for each frame in the video image, thereby performing an image processing for the video image.
- the present application is also applicable to the underwater view-finding processing in real time by the photographic device, wherein a 30fps (frames per second) underwater image processed in real time may be obtained by performing a processing of less than or equal to 30ms (milliseconds) for each frame of underwater image; a 60fps underwater image processed in real time may be obtained by performing a processing of less than or equal to 16ms for each frame of underwater image; a 120fps high-speed underwater image processed in real time may be obtained by performing a processing of less than or equal to 8 ms for each frame of underwater image; and so on.
- a 30fps (frames per second) underwater image processed in real time may be obtained by performing a processing of less than or equal to 30ms (milliseconds) for each frame of underwater image
- a 60fps underwater image processed in real time may be obtained by performing a processing of less than or equal to 16ms for each frame of underwater image
- the processing algorithm may be simplified on the premise that the correction effect is sacrificed in a certain extent, so as to simplify the parameters and solidify the variable parameters.
- the present application is also applicable to the key frame processing technology, i.e., with respect to the underwater detection effect of a certain frame, the parameter calculations and settings for image enhancement and restoration can be followed in subsequent several frames, thereby reducing the whole calculation amount and improving the processing speed.
- the present disclosure is described in details by taking the underwater shoot scene as an example, but the present disclosure is not limited thereto.
- the present disclosure may also be applicable to a smoky shoot scene, an overcast and rainy shoot scene, a haze shoot scene, a sand storm shoot scene or a dim shoot scene, etc.
- the above parameters, thresholds or correction algorithms may be adaptively adjusted, so as to obtain a better processing effect.
- the image processing apparatus 100 can determine the shoot scene of the image and the degree of influence of the shoot scene on the shoot quality of the image, and perform a correction processing of the image according to the degree of influence, so as to reduce and even eliminate the degree of influence, thus improving the shoot quality of the image.
- Embodiment 2 of the present application provides an image processing method for processing an image, which is corresponding to the image processing apparatus of Embodiment 1, and the same contents are omitted herein.
- Fig. 8 is a flow diagram of an image processing method in Embodiment 2. As illustrated in Fig. 8, the image processing method includes:
- Step 701 determining a shoot scene of an image
- the shoot scene of the image may be determined by detecting the image or through a sensor detection.
- Step 702 analyzing the image to determine a degree of influence of the shoot scene on the shoot quality of the image.
- Step 703 performing a correction processing of the image according to the degree of influence.
- the shoot scene may include an underwater shoot scene, a smoky shoot scene, an overcast and rainy shoot scene, etc.
- the present disclosure will be further described by taking the underwater shoot scene as an example.
- Fig. 9 is another flow diagram of an image processing method in Embodiment 2. As illustrated in Fig. 9, the image processing method includes:
- Step 801 detecting an image to judge whether a shoot scene thereof is underwater; if so, performing step 802; and if not, the method of this embodiment may be ended, while for example the conventional image processing method may be adopted, which is not described herein.
- the detection may be performed by using the shoot scene determination portion 101 as described in Embodiment 1.
- the step may also be performed using the method for detecting hardware device, e.g., a sensor may be used to detect a potential variation of the capacitive screen in the mobile terminal, so as to judge whether the mobile terminal is in an underwater environment, and then decide whether to start the underwater mode.
- the hardware device is not limited to the sensor which detects the capacitive screen, and, for example, it also may be a proximity sensor, an ambient light sensor, etc. Through the hardware device detection, the image calculation amount can be reduced and the whole processing speed can be improved.
- the hardware detection may also serve as auxiliary mechanism (or module) and/or method to detect whether the device is underwater, so as to improve the whole detection accuracy.
- the senor may be any or a combination of an acceleration sensor, a proximity sensor, a temperature sensor, a speed sensor, a barometric pressure sensor, a geomagnetic sensor, a deformation sensor, a humidity sensor and/or a light sensor, but the present disclosure is not limited thereto.
- the electromagnetic signal may be detected whether a device is in an underwater environment by detecting an attenuation degree of the received electromagnetic signal (sent by the device or by a third party) since the electromagnetic signal has different attenuation degrees in different mediums (e.g., the attenuation degree or speed in the water is far more than that in the air), wherein the electromagnetic signal for example may be a Bluetooth signal, a WIFI signal, an NFC signal and other electromagnetic signal.
- the environment i.e., water or air
- the device may be detected since the light has different total reflection critical angles in different mediums.
- the total reflection angle may be detected using an optical fiber or other refracting medium.
- the light source may be any laser transmitting device or other light having a good directional property.
- a pressure or pressure intensity detection may be performed using the optical fiber, thus different environments where the device is located can be detected since the pressure intensity is different in the water and air.
- the mobile terminal may perform an associative detection with other apparatus, including data sharing of the sensors and communications therebetween.
- Other apparatus for example may include a wearable device, a smart watch, a bracelet, smart glasses, smart helmet, etc., but the present disclosure is not limited thereto.
- the image may be detected in real time, i.e., it is detected whether the shoot scene is underwater while the image is shot.
- the image may be detected in non-real time, i.e., it is detected whether the shoot scene is underwater after the image is shot.
- Step 802 analyzing the image to determine a degree of influence of the underwater shoot scene on the shoot quality of the image; Please refer to Embodiment 1 for the analysis and the determination of the degree of influence in this embodiment.
- Step 803 performing a correction processing of the image according to the degree of influence
- Embodiment 1 Please refer to Embodiment 1 for the correction processing in this embodiment.
- Fig. 10 is a flow diagram of step 801 in Embodiment 2. As illustrated in Fig. 10, step 801 may include:
- Step 901 extracting a first parameter reflecting features of the image
- Step 902 comparing the first parameter with a preset first threshold
- Step 903 judging a shoot scene of the image according to a comparison result.
- the first parameter may include any or a combination of a parameter reflecting color histogram features or grayscale distribution histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- Fig. 11 is a flow diagram of step 802 in Embodiment 2. As illustrated in Fig. 11, step 802 may include:
- Step 1001 extracting a second parameter reflecting features of the image.
- Step 1002 determining a degree of influence of the shoot scene on the shoot quality of the image according to the second parameter.
- the second parameter may include any or a combination of a parameter reflecting color histogram features or grayscale distribution histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- first parameter and the second parameter may be the same as or different from each other in this embodiment.
- Fig. 12 is a flow diagram of step 803 in Embodiment 2. As illustrated in Fig. 12, step 803 may include:
- Step 1101 setting a parameter required to perform a correction processing of the image according to the degree of influence; and Step 1102: performing the correction processing of the image according to the parameter.
- the performed correction processing of the image may include any or combination of a gamma correction, a color histogram adjustment and/or a grayscale distribution histogram adjustment.
- the correction processing may further include one or more of an edge enhancement, a noise reduction and/or a dark area enhancement.
- the image processing method can determine the shoot scene of the image and the degree of influence of the shoot scene on the shoot quality of the image, and perform a correction processing of the image according to the degree of influence, so as to reduce and even eliminate the degree of influence, thus improving the shoot quality of the image.
- Embodiment 3 of the present application provides an electronic device, including an image processing apparatus as described in Embodiment 1. Next, the electronic device will be described by taking a mobile terminal as an example, but the present application is not limited thereto.
- Fig. 13 is a block diagram of a system construction of an electronic device 1200 in Embodiment 3, including an image processing apparatus as described in Embodiment 1.
- Fig. 13 is exemplary, and other type of structure may also be used to supplement or replace the structure, so as to realize the telecom function or other function.
- the electronic device 1200 may include a Central Processing Unit (CPU) 1201, a communication module 1202, an input unit 1203, an audio processor 1204, a memory 1205, an image processing apparatus 1206, a photo camera 1207 and a power supply 1208, wherein the working principle of the image processing apparatus 1206 is the same as that of the image processing apparatus 100 in Embodiment 1, which is omitted herein.
- CPU Central Processing Unit
- communication module 1202 an input unit 1203, an audio processor 1204, a memory 1205, an image processing apparatus 1206, a photo camera 1207 and a power supply 1208, wherein the working principle of the image processing apparatus 1206 is the same as that of the image processing apparatus 100 in Embodiment 1, which is omitted herein.
- the image processing apparatus 1206 may be configured separately from the CPU 1200, e.g., being configured as a chip connected to the CPU 1201, so as to realize the function of the image processing apparatus 1206 under the control of the CPU.
- the image processing apparatus 1206 may not be provided individually, and instead, the functions thereof are integrated into the CPU 1201.
- the CPU 1201 may be configured to control to: determine a shoot scene of an image; analyze the image to determine a degree of influence of the shoot scene on the shoot quality of the image; and perform a correction processing of the image according to the degree of influence.
- the CPU 1201 may also be configured to control to: extract a first parameter reflecting features of the image; compare the first parameter with a preset first threshold; and judge a shoot scene of the image according to a comparison result, wherein the first parameter includes any or combination of a parameter reflecting color histogram features or grayscale distribution histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or a contrast of the image.
- the CPU 1201 may also be configured to control to: extract a second parameter reflecting features of the image; and determine a degree of influence of the shoot scene on the shoot quality of the image according to the second parameter, wherein the second parameter includes any or combination of a parameter reflecting color histogram features of the image, a brightness of the image, a sharpness of the image, a saturation of the image, and/or and a contrast of the image.
- the CPU 1201 may also be configured to control to: set a processing parameter required to perform a correction processing of the image according to the degree of influence; and perform a correction processing of the image according to the processing parameter, wherein the performed correction processing of the image at least includes a gamma correction, a color histogram adjustment and/or a grayscale distribution histogram adjustment.
- the CPU 1201 sometimes is called as controller or operation control, and it may include a microprocessor or other processor device and/or logic device.
- the CPU 1201 receives an input and controls the respective parts and operations of the electronic device 1200.
- the communication module 1202 is a transmitter/receiver which transmits and receives a signal via an antenna 12021.
- the communication module is coupled to the CPU, so as to supply an input signal and receive an output signal, which may be the same as the situation of the conventional mobile communication terminal.
- the same electronic device may be provided with a plurality of communication modules 1202, such as a cellular network module, a Bluetooth module and/or a wireless local area network (WLAN) module.
- the communication module is further coupled to a speaker 12041 via an audio processor 1204, so as to provide an audio output via the speaker 12041.
- the audio processor 1204 may include any appropriate buffer, decoder, amplifier, etc.
- the input unit 1203 provides an input to the CPU 1201.
- the input unit 1203 for example is a key or a touch input device.
- the photo camera 1207 is configured to shoot and provide image data to the CPU for a conventional usage, such as storage and transmission.
- the power supply 1208 is configured to supply electric power to the electronic device 1200.
- a display device 1209 displays objects such as images, videos and texts.
- the memory 1205 is coupled to the CPU 1201.
- the memory 1205 may be a solid state memory, such as Read Only Memory (ROM), Random Access Memory (RAM), SEVI card, etc., or a memory which stores information even if the power is off, which can be selectively erased and provided with more data, and the example of such a memory is sometimes called an EPROM, etc.
- the memory 1205 also may be a certain device of other type.
- the memory 1205 includes a buffer memory (sometimes called as buffer), and an application/function storage portion which stores application programs and function programs or performs the operation procedure of the electronic device 1200 via the CPU 1201.
- the memory 1205 may further include a data storage portion which stores data such as the preset function, look-up table, first to third thresholds, etc. in Embodiment 1.
- a drive program storage portion of the memory may include various drive programs of the electronic device for performing the communication function and/or other functions (e.g., messaging application, address book application, etc.) of the electronic device.
- the embodiment of the present disclosure further provides a computer readable program, which when being executed in an electronic device, enables a computer to perform the image processing method described in Embodiment 2 in the electronic device.
- the embodiment of the present disclosure further provides a storage medium storing a computer readable program, wherein the computer readable program enables a computer to perform the image processing method described in Embodiment 2 in an electronic device.
- each part of the present disclosure may be implemented by hardware, software, firmware, or combinations thereof.
- multiple steps or methods may be implemented by software or firmware stored in the memory and executed by an appropriate instruction executing system.
- the implementation uses hardware, it may be realized by any one of the following technologies known in the art or combinations thereof as in another embodiment: a discrete logic circuit having a logic gate circuit for realizing logic functions of data signals, application-specific integrated circuit having an appropriate combined logic gate circuit, a programmable gate array (PGA), and a field programmable gate array (FPGA), etc.
- PGA programmable gate array
- FPGA field programmable gate array
- logic and/or steps shown in the flowcharts or described in other manners here may be, for example, understood as a sequencing list of executable instructions for realizing logic functions, which may be implemented in any computer readable medium, for use by an instruction executing system, apparatus or device (such as a system based on a computer, a system including a processor, or other systems capable of extracting instructions from an instruction executing system, apparatus or device and executing the instructions), or for use in combination with the instruction executing system, apparatus or device.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Facsimile Image Signal Circuits (AREA)
- Image Processing (AREA)
Abstract
La présente invention concerne, dans ses modes de réalisation, un procédé de traitement d'images, un appareil de traitement d'images et un dispositif électronique. L'appareil de traitement d'images comprend: une partie de détermination de scènes de prise de vues configurée pour déterminer une scène de prise de vues d'un image; une partie d'analyse d'images configurée pour analyser l'image pour déterminer un degré d'influence de la scène de prise de vues sur la qualité de prise de vues de l'image; et une partie de traitement d'images configurée pour effectuer un traitement de correction de l'image en fonction du degré d'influence. Par l'intermédiaire des modes de réalisation de la présente invention, un traitement de correction de l'image peut être effectué en fonction du degré d'influence de la scène de prise de vues sur la qualité de prise de vues de l'image, de façon à réduire, voire à éliminer le degré d'influence, améliorant ainsi la qualité de prise de vues de l'image.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410498556.8A CN105450923A (zh) | 2014-09-25 | 2014-09-25 | 图像处理方法、图像处理装置以及电子设备 |
CN201410498556.8 | 2014-09-25 | ||
US14/702,823 US20160094824A1 (en) | 2014-09-25 | 2015-05-04 | Image processing method, image processing apparatus and electronic device |
US14/702,823 | 2015-05-04 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016046664A1 true WO2016046664A1 (fr) | 2016-03-31 |
Family
ID=54151349
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2015/056507 WO2016046664A1 (fr) | 2014-09-25 | 2015-08-27 | Procédé de traitement d'images, appareil de traitement d'images et dispositif électronique |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2016046664A1 (fr) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060114335A1 (en) * | 2004-11-26 | 2006-06-01 | Minoru Hara | Optical image capturing device |
US20070280538A1 (en) * | 2004-09-30 | 2007-12-06 | Fujifilm Corporation | Image Correction Apparatus And Method, And Image Correction Program |
US20070292038A1 (en) * | 2004-09-30 | 2007-12-20 | Fujifilm Corporation | Image Processing Apparatus and Method, and Image Processing Program |
US20090207281A1 (en) * | 2008-01-22 | 2009-08-20 | Sony Corporation | Image capturing apparatus, control method therefor, and program |
US20100260419A1 (en) * | 2007-10-26 | 2010-10-14 | Satoshi Katoh | Image correction method, image correction device, and program |
US20110228074A1 (en) * | 2010-03-22 | 2011-09-22 | Parulski Kenneth A | Underwater camera with presssure sensor |
-
2015
- 2015-08-27 WO PCT/IB2015/056507 patent/WO2016046664A1/fr active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070280538A1 (en) * | 2004-09-30 | 2007-12-06 | Fujifilm Corporation | Image Correction Apparatus And Method, And Image Correction Program |
US20070292038A1 (en) * | 2004-09-30 | 2007-12-20 | Fujifilm Corporation | Image Processing Apparatus and Method, and Image Processing Program |
US20060114335A1 (en) * | 2004-11-26 | 2006-06-01 | Minoru Hara | Optical image capturing device |
US20100260419A1 (en) * | 2007-10-26 | 2010-10-14 | Satoshi Katoh | Image correction method, image correction device, and program |
US20090207281A1 (en) * | 2008-01-22 | 2009-08-20 | Sony Corporation | Image capturing apparatus, control method therefor, and program |
US20110228074A1 (en) * | 2010-03-22 | 2011-09-22 | Parulski Kenneth A | Underwater camera with presssure sensor |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20160094824A1 (en) | Image processing method, image processing apparatus and electronic device | |
CN107004255B (zh) | 图像降噪方法和图像处理系统 | |
KR101762081B1 (ko) | 이미지 프로세싱을 위한 피부 톤 보정을 이용한 자동 화이트 밸런싱 | |
US8405736B2 (en) | Face detection using orientation sensor data | |
US8339506B2 (en) | Image capture parameter adjustment using face brightness information | |
US9186909B1 (en) | Method and system of lens shading color correction using block matching | |
CN110766621B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
CN108885785B (zh) | 用于时间噪声减少的运动自适应流处理 | |
CN107635103B (zh) | 一种图像处理方法及移动终端和介质产品 | |
CN107395991B (zh) | 图像合成方法、装置、计算机可读存储介质和计算机设备 | |
KR20130056442A (ko) | 화이트 밸런스 조절장치 및 방법 | |
CN107690804B (zh) | 一种图像处理方法及用户终端 | |
CN108629738B (zh) | 一种图像处理方法及装置 | |
CN114762321B (zh) | 叠加视频帧以增强图像亮度 | |
US10769416B2 (en) | Image processing method, electronic device and storage medium | |
CN108259754B (zh) | 图像处理方法及装置、计算机可读存储介质和计算机设备 | |
US9832395B2 (en) | Information processing method applied to an electronic device and electronic device having at least two image capturing units that have the same image capturing direction | |
CN114298935A (zh) | 图像增强方法、装置及计算机可读存储介质 | |
CN107277369B (zh) | 图像处理方法、装置、计算机可读存储介质和计算机设备 | |
US10068151B2 (en) | Method, device and computer-readable medium for enhancing readability | |
CN107317968B (zh) | 图像去雾方法、装置、计算机可存储介质和移动终端 | |
CN116668838A (zh) | 图像处理方法与电子设备 | |
WO2016046664A1 (fr) | Procédé de traitement d'images, appareil de traitement d'images et dispositif électronique | |
CN115527474A (zh) | 图像显示方法、装置、显示设备、投影设备及存储介质 | |
US20160292825A1 (en) | System and method to refine image data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15767315 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15767315 Country of ref document: EP Kind code of ref document: A1 |