WO2020034739A1 - 控制方法、装置、电子设备和计算机可读存储介质 - Google Patents

控制方法、装置、电子设备和计算机可读存储介质 Download PDF

Info

Publication number
WO2020034739A1
WO2020034739A1 PCT/CN2019/090628 CN2019090628W WO2020034739A1 WO 2020034739 A1 WO2020034739 A1 WO 2020034739A1 CN 2019090628 W CN2019090628 W CN 2019090628W WO 2020034739 A1 WO2020034739 A1 WO 2020034739A1
Authority
WO
WIPO (PCT)
Prior art keywords
exposure
pixel
pixels
photosensitive
medium
Prior art date
Application number
PCT/CN2019/090628
Other languages
English (en)
French (fr)
Inventor
张弓
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to EP19849429.6A priority Critical patent/EP3836532A4/en
Publication of WO2020034739A1 publication Critical patent/WO2020034739A1/zh
Priority to US17/173,762 priority patent/US11601600B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144—Devices controlled by radiation
    • H01L27/146—Imager structures
    • H01L27/14601—Structural or functional details thereof
    • H01L27/1462—Coatings
    • H01L27/14621—Colour filter arrangements
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144—Devices controlled by radiation
    • H01L27/146—Imager structures
    • H01L27/14601—Structural or functional details thereof
    • H01L27/14625—Optical elements or arrangements associated with the device
    • H01L27/14627—Microlenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation

Definitions

  • the present disclosure relates to the field of imaging technology, and in particular, to a control method, an apparatus, an electronic device, and a computer-readable storage medium.
  • the imaging device in the related art uses a pixel unit array of a fixed structure for imaging.
  • the present disclosure proposes a control method, an apparatus, an electronic device, and a computer-readable storage medium for automatically adjusting the proportion of middle-exposure pixels in each photosensitive pixel unit according to the brightness level of a shooting environment, thereby retaining a captured image
  • the imaging quality of currently captured images is limited by the imaging devices in the electronic devices, and the technical problem that the image quality cannot be improved.
  • An embodiment of one aspect of the present disclosure provides a control method applied to an imaging device, where the imaging device includes a pixel unit array composed of a plurality of photosensitive pixel units, and each photosensitive pixel unit includes at least two exposure pixels.
  • the two exposure pixels include at least one exposure pixel.
  • the method includes the following steps:
  • the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large;
  • the brightness level of the shooting environment belongs to a high brightness level or a low brightness level, adjusting the proportion of the middle exposure pixels in each photosensitive pixel unit to a first value
  • the brightness level of the shooting environment belongs to a medium brightness level, adjusting the proportion of the medium exposure pixels in each photosensitive pixel unit to a second value; wherein the first value is greater than the second value.
  • the control method of the embodiment of the present disclosure determines the brightness level of the ambient brightness, wherein the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the brightness level of the shooting environment belongs to a high brightness level or
  • the brightness level is low, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to the first value, and when the brightness level of the shooting environment belongs to the medium brightness level, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to A second value; wherein the first value is greater than the second value.
  • the proportion of the middle exposure pixels in each photosensitive pixel unit can be automatically adjusted, so that more effective information in the captured image can be retained, the brightness of the captured image can be improved, and the imaging effect and imaging can be improved. Quality to improve the user ’s shooting experience.
  • An embodiment of still another aspect of the present disclosure provides a control device applied to an imaging device, where the imaging device includes a pixel unit array composed of a plurality of photosensitive pixel units, and each photosensitive pixel unit includes at least two exposure pixels.
  • the at least two exposure pixels include at least one exposure pixel, and the device includes:
  • a determining module for determining a brightness level of ambient brightness includes a low brightness level, a medium brightness level, and a high brightness level in which brightness is arranged from small to large;
  • a first adjustment module configured to adjust the proportion of the middle exposure pixels in each photosensitive pixel unit to a first value if the brightness level of the shooting environment belongs to a high brightness level or a low brightness level;
  • a second adjustment module is configured to adjust the proportion of the middle exposure pixels in each photosensitive pixel unit to a second value if the brightness level of the shooting environment belongs to a medium brightness level; wherein the first value is greater than the first value Two values.
  • the control device of the embodiment of the present disclosure determines the brightness level of the ambient brightness, wherein the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the brightness level of the shooting environment belongs to a high brightness level or
  • the brightness level is low, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to the first value, and when the brightness level of the shooting environment belongs to the medium brightness level, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to A second value; wherein the first value is greater than the second value.
  • the proportion of the middle exposure pixels in each photosensitive pixel unit can be automatically adjusted, so that more effective information in the captured image can be retained, the brightness of the captured image can be improved, and the imaging effect and imaging can be improved. Quality to improve the user ’s shooting experience.
  • An embodiment of another aspect of the present disclosure provides an electronic device including: a pixel unit array composed of a plurality of photosensitive pixel units, each photosensitive pixel unit including at least two exposure pixels, and the at least two exposure pixels including at least one
  • the exposure pixel further includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the control method according to the foregoing embodiment of the present disclosure is implemented.
  • An embodiment of another aspect of the present disclosure provides a non-transitory computer-readable storage medium on which a computer program is stored, which is characterized in that when the program is executed by a processor, the control method as proposed in the foregoing embodiment of the present disclosure is implemented.
  • FIG. 1 is a schematic flowchart of a control method according to Embodiment 1 of the present disclosure
  • FIG. 2 is a schematic structural diagram of a portion of a pixel unit array of an imaging device in an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a grayscale histogram corresponding to a backlight scene in an embodiment of the present disclosure
  • FIG. 4 is a first schematic structural diagram of a photosensitive pixel unit according to an embodiment of the present disclosure
  • FIG. 5 is a second structural schematic diagram of a photosensitive pixel unit in an embodiment of the present disclosure.
  • FIG. 6 is a third structural schematic diagram of a photosensitive pixel unit in an embodiment of the present disclosure.
  • FIG. 7 is a schematic flowchart of a control method provided in Embodiment 2 of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a control device according to a third embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of a control device according to a fourth embodiment of the present disclosure.
  • FIG. 10 is a schematic block diagram of an electronic device according to some embodiments of the present disclosure.
  • FIG. 11 is a schematic block diagram of an image processing circuit according to some embodiments of the present disclosure.
  • the present disclosure aims at a technical problem of poor image quality in the prior art, and provides a control method.
  • the control method of the embodiment of the present disclosure determines the brightness level of the ambient brightness, wherein the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the brightness level of the shooting environment belongs to a high brightness level or
  • the brightness level is low, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to the first value, and when the brightness level of the shooting environment belongs to the medium brightness level, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to A second value; wherein the first value is greater than the second value.
  • the proportion of the middle exposure pixels in each photosensitive pixel unit can be automatically adjusted, so that more effective information in the captured image can be retained, the brightness of the captured image can be improved, and the imaging effect and imaging can be improved. Quality to improve the user ’s shooting experience.
  • FIG. 1 is a schematic flowchart of a control method according to a first embodiment of the present disclosure.
  • the control method of the embodiment of the present disclosure is applied to an imaging device, which includes a pixel unit array composed of a plurality of photosensitive pixel units, and each photosensitive pixel unit includes at least two exposure pixels, and at least one of the at least two exposure pixels includes at least one exposure. Pixels.
  • FIG. 2 is a schematic diagram of a partial structure of a pixel unit array of an imaging device in an embodiment of the present disclosure.
  • the imaging device 30 includes a pixel unit array 31 and a filter unit array 32 provided on the pixel unit array 31.
  • the pixel unit array 31 includes a plurality of photosensitive pixel units 311, and each photosensitive pixel unit 311 includes at least two exposure pixels 3111, and at least two of the exposure pixels include at least one of the exposure pixels.
  • each photosensitive pixel unit 311 includes four exposure pixels 3111.
  • the four exposure pixels may be one long exposure pixel, two medium exposure pixels, and one short exposure pixel.
  • the number of long-exposure pixels, middle-exposure pixels, and short-exposure pixels in each photosensitive pixel unit 311 may also be other values, which is not limited.
  • the filter unit array 32 includes a plurality of filter units 322 corresponding to the plurality of photosensitive pixel units 311. Each filter unit 322 covers a corresponding photosensitive pixel unit 311, that is, each exposure pixel included in the same photosensitive pixel unit. Covered by the same color filter.
  • the pixel unit array 31 may be a Bayer array.
  • the long exposure pixel refers to the exposure time corresponding to the photosensitive pixel is the long exposure time
  • the medium exposure pixel refers to the exposure time corresponding to the photosensitive pixel is the middle exposure time
  • the short exposure pixel refers to the short exposure time corresponding to the photosensitive pixel.
  • Exposure time, long exposure time> medium exposure time> short exposure time that is, the long exposure time of the long exposure pixel is greater than the middle exposure time of the middle exposure pixel
  • the middle exposure time of the middle exposure pixel is greater than the short exposure time of the short exposure pixel.
  • the synchronous exposure means that the exposure times of the middle exposure pixels and the short exposure pixels are within the exposure time of the long exposure pixels.
  • the long-exposure pixel can be controlled to start exposure first.
  • the exposure of the middle-exposure pixel and the short-exposure pixel can be controlled.
  • the exposure cut-off time of the middle-exposure pixel and the short-exposure pixel should be longer than
  • the exposure cutoff time of the exposure pixel is the same or before the exposure cutoff time of the long exposure pixel; or, the long exposure pixel, the middle exposure pixel, and the short exposure pixel are controlled to start exposure at the same time, that is, the exposure of the long exposure pixel, the middle exposure pixel, and the short exposure pixel
  • the start times are the same. In this way, there is no need to control the pixel unit array to perform long exposure, medium exposure, and short exposure in order, which can reduce the shooting time of the image.
  • control method includes the following steps:
  • Step 101 Determine a brightness level of ambient brightness; the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the ambient brightness may be divided into three brightness levels in advance, which are a low brightness level, a medium brightness level, and a high brightness level.
  • the brightness level may be set in advance by a built-in program of an electronic device, or, Set by the user, there is no restriction on this.
  • an independent light measuring device may be used to measure the ambient brightness, or the ISO value automatically adjusted by the camera may be read, and the ambient brightness may be determined according to the read ISO value, or the pixel unit may also be controlled
  • the array measures the ambient brightness value to determine the ambient brightness, which is not limited. After determining the ambient brightness, the brightness level can be determined based on the ambient brightness.
  • the above ISO value is used to indicate the sensitivity of the camera.
  • Commonly used ISO values are 50, 100, 200, 400, 1000, etc.
  • the camera can automatically adjust the ISO value according to the ambient brightness. Therefore, in this embodiment, According to the ISO value, the ambient brightness can be deduced.
  • the ISO value can be 50 or 100 in the case of sufficient light, and the ISO value can be 400 or higher in the case of insufficient light.
  • the brightness level can be set differently.
  • the ISO value is between 200 and 500, and during the day, the electronic device When the device is outdoors, the ISO value is generally lower than 200. Therefore, the size and interval of each brightness level can be set according to actual needs and specific shooting scenes.
  • step 102 if the brightness level of the shooting environment belongs to a high brightness level or a low brightness level, the proportion of the middle exposure pixels in each photosensitive pixel unit is adjusted to a first value.
  • the first value may be preset by a built-in program of the electronic device, or may be set by a user, which is not limited.
  • the long exposure pixel, the middle exposure pixel, and the short exposure pixel in each photosensitive pixel unit are adjustable.
  • the brightness level of the shooting environment belongs to a high brightness level or a low brightness level, it indicates that the shooting environment is brighter or darker. At this time, the ambient brightness is extremely extreme.
  • the pixel information output by long-exposure pixels or short-exposure pixels will overflow, and image details will be seriously lost.
  • the red, green, and blue (RGB) three-color histogram the detailed content distribution of three shades with different lightness and darkness can be displayed intuitively, and the overexposed parts will gather at the left and right ends of the histogram, which is tolerated.
  • the area outside the degree will not be brighter, but all details will be lost, and only the full white color block (255,255,255) will be displayed.
  • the underexposed part will not be darker than the tolerance level, but will lose all details and only display All black patches (0,0,0).
  • the proportion of the middle-exposed pixels can be increased.
  • a short exposure pixel in each photosensitive pixel unit may be switched to a medium exposure pixel, or a long exposure pixel in each photosensitive pixel unit may be switched to a middle exposure pixel, or a short exposure in each photosensitive pixel unit may be switched
  • the pixels and the long exposure pixels are switched to the middle exposure pixels, so that the proportion of the middle exposure pixels in the corresponding photosensitive pixel unit is increased to a first value.
  • Step 103 If the brightness level of the shooting environment belongs to a medium brightness level, adjust the proportion of the medium exposure pixels in each photosensitive pixel unit to a second value; wherein the first value is greater than the second value.
  • the second value may be preset by a built-in program of the electronic device, or may be set by a user, which is not limited.
  • the proportion of pixels in the middle exposure can be reduced. For example, one middle exposure pixel of each photosensitive pixel unit is switched to a short exposure pixel, or another middle exposure pixel is switched to a long exposure pixel, or one middle exposure pixel of each photosensitive pixel unit is switched to a short exposure. At the same time, another middle exposure pixel is switched to a long exposure pixel to reduce the proportion of the middle exposure pixel in the corresponding photosensitive pixel unit to a second value. Therefore, the long exposure pixel can correct the dark area in the image. Short exposure pixels can correct the bright areas in the image, improving the imaging effect and imaging quality.
  • the control method of the embodiment of the present disclosure determines the brightness level of the ambient brightness, wherein the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the brightness level of the shooting environment belongs to a high brightness level or
  • the brightness level is low, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to the first value, and when the brightness level of the shooting environment belongs to the medium brightness level, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to A second value; wherein the first value is greater than the second value.
  • the proportion of the middle exposure pixels in each photosensitive pixel unit can be automatically adjusted, so that more effective information in the captured image can be retained, the brightness of the captured image can be improved, and the imaging effect and imaging can be improved. Quality to improve the user ’s shooting experience.
  • the histogram of the captured preview image it is determined that the current shooting environment belongs to a backlit scene.
  • a gray value corresponding to the measured ambient brightness value according to the pixel unit array measurement may be used to generate a gray level histogram, and then the current number of photosensitive pixels in each gray level range may be used to determine the current Whether the shooting environment is a backlit scene.
  • the ratio grayRatio to all photosensitive pixels in the pixel unit array is greater than
  • the first threshold for example, the first threshold may be 0.135, and the grayscale value corresponding to the measured ambient brightness value is in the grayscale range [200,256) of the photosensitive pixels, and the ratio of grayRatio to all photosensitive pixels in the pixel unit array is greater than the second threshold
  • the second threshold may be 0.0899, it is determined that the current shooting environment is a backlit scene.
  • the ratio of grayRatio to all light-sensitive pixels in the pixel unit array is greater than The third threshold, for example, the third threshold may be 0.3, and the grayscale value corresponding to the measured ambient brightness value is in the grayscale range [200,256).
  • the ratio of grayRatio to all the photosensitive pixels in the pixel unit array is greater than the fourth threshold. For example, when the fourth threshold may be 0.003, it is determined that the current shooting environment is a backlit scene.
  • the ratio of grayRatio to all light-sensitive pixels in the pixel unit array is greater than The fifth threshold, for example, the fifth threshold may be 0.005, and the grayscale value corresponding to the measured ambient brightness value is in the grayscale range [200,256).
  • the ratio of grayRatio to all the photosensitive pixels in the pixel unit array is greater than the sixth threshold. For example, when the sixth threshold may be 0.25, it is determined that the current shooting environment is a backlit scene.
  • a grayscale histogram corresponding to a backlight scene may be shown in FIG. 3.
  • the ambient brightness value measured by each photosensitive pixel in the pixel unit array will have a high brightness difference. Therefore, as another possible implementation, It can also determine the brightness value of the imaging object and the background brightness value according to the ambient brightness value measured by the pixel unit array, and determine whether the difference between the brightness value of the imaging object and the background brightness value is greater than a preset threshold.
  • the current shooting environment is a backlit scene, and the difference between the brightness value of the imaging object and the brightness value of the background is less than or equal to the preset
  • the threshold value is determined, the current shooting environment is a non-backlit scene.
  • the preset threshold may be preset in a built-in program of the electronic device, or the preset threshold may be set by a user, which is not limited.
  • An imaging object is an object that needs to be photographed by an electronic device, such as a person (or a human face), an animal, an object, a scene, or the like.
  • each exposed pixel includes a low-exposure photosensitive layer, a medium-exposure photosensitive layer, and a high-exposure photosensitive layer corresponding to different exposures.
  • the arrangement order of the high-exposure photosensitive layer in the light incident direction is to switch the exposure pixel to a medium exposure pixel, a long exposure pixel, or a short exposure pixel.
  • the short exposure pixels and / or long exposure pixels in each photosensitive pixel unit can be switched to medium exposure pixels.
  • a photosensitive pixel unit includes 4 exposure pixels, namely 1 long exposure pixel (L), 2 middle exposure pixels (M), and 1 short exposure pixel (S).
  • the long exposure pixels and Short exposure pixels are switched to medium exposure pixels, respectively.
  • the middle-exposure photosensitive layer of the long-exposure pixel and the short-exposure pixel may be arranged before the low-exposure and high-exposure photosensitive layer to switch the long-exposure pixel and the short-exposure pixel to the middle-exposure pixel.
  • one middle exposure pixel in each photosensitive pixel unit may be switched to a short exposure pixel, and / or the other middle exposure pixel may be switched to a long exposure pixel, for example Referring to FIG. 5, a medium exposure pixel can be switched to a long exposure pixel.
  • the high-exposure photosensitive layer of the middle-exposure pixel can be arranged before the low-exposure and high-exposure photosensitive layers to switch the middle-exposure pixel to the long-exposure pixel.
  • one medium exposure pixel may be switched to a short exposure pixel.
  • the low-exposure photosensitive layer of the middle-exposure pixel can be arranged before the medium-exposure and high-exposure photosensitive layer to switch the middle-exposure pixel to a short-exposure pixel.
  • the exposure time of the low-exposure photosensitive layer is shorter than that of the medium-exposure photosensitive layer, and the exposure time of the medium-exposure photosensitive layer is shorter than that of the high-exposure photosensitive layer; or the sensitivity of the low-exposure photosensitive layer is greater than medium
  • the sensitivity of the exposure sensitivity layer, the sensitivity of the middle exposure sensitivity layer is greater than the sensitivity of the high exposure sensitivity layer.
  • control method may further include the following steps:
  • Step 201 For the pixel unit array, after adjusting the proportion of the middle exposure pixels in each photosensitive pixel unit, control the pixel unit array to output the original pixel information.
  • the pixel unit array can be controlled to output the original pixel information.
  • the pixel unit array may be controlled to output multiple pieces of original pixel information under different exposure times, for example, the long exposure pixels and middle exposure pixels in each photosensitive pixel unit in the pixel unit array may be controlled.
  • And / or, short exposure pixels are synchronously exposed.
  • the exposure time corresponding to the long exposure pixel is the initial long exposure time
  • the exposure time corresponding to the middle exposure pixel is the initial middle exposure time
  • the exposure time corresponding to the short exposure pixel is the initial short exposure time.
  • the initial long exposure time, the initial medium exposure time, and the initial short exposure time are all preset. After the exposure is over, each photosensitive pixel unit in the pixel unit array will output a plurality of original pixel information at different exposure times.
  • the pixel unit array may also be controlled to output multiple pieces of original pixel information obtained by exposure with the same exposure time.
  • the long exposure pixels, middle exposure pixels, and / or short exposure pixels in each photosensitive pixel unit in the pixel unit array can be controlled to be exposed synchronously.
  • the exposure time of each exposure pixel is the same, that is, the long exposure pixel and the middle exposure.
  • the exposure cut-off time of the pixel and / or the short exposure pixel is also the same. After the exposure is over, each photosensitive pixel unit in the pixel unit array will output multiple original pixel information obtained by exposure with the same exposure time.
  • each photosensitive pixel unit when each photosensitive pixel unit is 4 middle-exposed pixels, each photosensitive pixel unit will output 4 original pixel information, which is the original pixel information output by the 4 middle-exposed pixels.
  • each photosensitive pixel unit when each photosensitive pixel unit includes 2 long exposure pixels, 1 medium exposure pixel, and 1 short exposure pixel, each photosensitive pixel unit will output 4 original pixel information, which are 2 respectively.
  • Step 202 Calculate the combined pixel information of each photosensitive pixel unit according to the original pixel information output by at least two exposed pixels in the same photosensitive pixel unit.
  • the combined pixel information of each photosensitive pixel unit can be calculated based on the original pixel information of the same exposure time in the same photosensitive pixel unit.
  • the combined pixel information can be calculated based on the original pixel information with the same exposure time in the same photosensitive pixel unit.
  • each photosensitive pixel unit when each photosensitive pixel unit includes one long exposure pixel, two middle exposure pixels, and one short exposure pixel, the original pixel information of the only long exposure pixel is the combined pixel information of the long exposure.
  • the sum of the original pixel information of the exposed pixels is the combined pixel information of the middle exposure, and the original pixel information of the only short exposure pixel is the combined pixel information of the short exposure;
  • the photosensitive pixel unit includes 2 long exposure pixels, 4 medium
  • the sum of the original pixel information of the two long exposure pixels is the combined pixel information of the long exposure
  • the sum of the original pixel information of the four middle exposure pixels is the combined pixel information of the middle exposure.
  • the sum of the original pixel information of the two short exposure pixels is the combined pixel information of the short exposure.
  • multiple long-exposure combined pixel information, multiple medium-exposure combined pixel information, and multiple short-exposure combined pixel information of the entire pixel unit array can be obtained.
  • the original pixel information of the long-exposed pixels, the original pixel information of the short-exposed pixels, or the original pixel information of the middle-exposed pixels may be selected, and then based on the selected original pixel information, and the long exposure time, The exposure ratio between the medium exposure time and the short exposure time is calculated to obtain the combined pixel information.
  • the merged pixel information can be calculated by the selected original pixel information and the exposure ratio between the long exposure time, the middle exposure time, and the short exposure time, which can expand the dynamic range. A high dynamic range image is obtained, thereby improving the imaging effect of the imaged image.
  • an average value may be calculated for the original pixel information of the same photosensitive pixel unit to obtain merged pixel information, where: Each photosensitive pixel unit corresponds to one merged pixel information.
  • the photosensitive pixel unit when the photosensitive pixel unit includes one long exposure pixel, two middle exposure pixels, and one short exposure pixel, the original pixel information of one long exposure pixel output and two middle exposure pixel outputs are marked.
  • the original pixel information and one original pixel information output by one short exposure pixel are: R1, R2, R3, and R4, then the combined pixel information of the photosensitive pixel unit is: (R1 + R2 + R3 + R4) / 4 .
  • Step 203 Perform imaging according to the merged pixel information.
  • imaging can be performed according to the merged pixel information.
  • the pixel unit array is controlled to output multiple original pixel information under different exposure times, and the combined pixel information is calculated based on the original pixel information with the same exposure time in the same photosensitive pixel unit, it can be obtained
  • the combined pixel information of multiple long exposures, the combined pixel information of multiple middle exposures, and the combined pixel information of multiple short exposures of the entire pixel unit array, and then the long exposure sub-units are calculated based on the interpolation of the combined pixel information of multiple long exposures.
  • a mid-exposure sub-image is calculated by interpolation based on a plurality of mid-exposure merged pixel information
  • a short-exposure sub-image is obtained by interpolation based on a plurality of short-exposure merged pixel information.
  • the long exposure sub-image, the middle exposure sub-image, and the short exposure sub-image are processed by fusion to obtain a high dynamic range imaging image.
  • the long exposure sub-image, middle exposure sub-image, and short exposure sub-image are not
  • a frame image is an image portion formed by corresponding regions of long, short, and medium exposure pixels in the same frame of image.
  • the original pixel information of the short exposure pixel and the original pixel information of the middle exposure pixel may be superimposed on the original pixel information of the long exposure pixel based on the original pixel information output by the long exposure pixel.
  • three kinds of original pixel information with different exposure times can be assigned different weights. After the original pixel information corresponding to each exposure time is multiplied with the weight, the three kinds of multiplied weights are then multiplied. The original pixel information after the value is added up as the synthesized pixel information of one photosensitive pixel unit.
  • the pixel unit array after controlling the pixel unit array to output multiple original pixel information obtained by exposure with the same exposure time, and calculating the average value of the original pixel information of the same photosensitive pixel unit, after obtaining the combined pixel information, it can be determined Multiple merged pixel information of multiple photosensitive pixel units in the entire pixel unit array, and then interpolation calculation can be performed based on the multiple merged pixel information to obtain an imaging image.
  • the present disclosure also proposes a control device.
  • FIG. 8 is a schematic structural diagram of a control device according to a third embodiment of the present disclosure.
  • the control device 100 is applied to an imaging device.
  • the imaging device includes a pixel unit array composed of a plurality of photosensitive pixel units.
  • Each photosensitive pixel unit includes at least two exposure pixels, and at least two of the at least two exposure pixels include at least one.
  • the control device 100 includes a determination module 101, a first adjustment module 102, and a second adjustment module 103.
  • the determining module 101 is configured to determine a brightness level of ambient brightness; the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the first adjustment module 102 is configured to adjust the proportion of the middle exposure pixels in each photosensitive pixel unit to a first value when the brightness level of the shooting environment belongs to a high brightness level or a low brightness level.
  • the first adjustment module 102 is specifically configured to switch the short-exposure pixel and / or long-exposure pixel in each photosensitive pixel unit to a medium-exposure pixel to increase the middle of the corresponding photosensitive pixel unit.
  • the proportion of exposure pixels is the first value; wherein the exposure duration of the long exposure pixels is greater than the exposure duration of the middle exposure pixels, and the exposure duration of the middle exposure pixels is greater than the exposure duration of the short exposure pixels.
  • the second adjustment module 103 is configured to adjust the proportion of the middle exposure pixels in each photosensitive pixel unit to a second value if the brightness level of the shooting environment belongs to a medium brightness level; wherein the first value is greater than the second value.
  • the second adjustment module 103 is specifically configured to switch one of the light-exposed pixels in each of the photosensitive pixel units to a short-exposure pixel, and / or switch the other middle-exposure pixel to a long-exposure pixel. , To reduce the proportion of the middle exposure pixels in the corresponding photosensitive pixel unit as the second value; wherein the exposure duration of the long exposure pixels is greater than the exposure duration of the middle exposure pixels, and the exposure duration of the middle exposure pixels is greater than the exposure of the short exposure pixels. duration.
  • control device 100 may further include:
  • each exposed pixel includes a low-exposure photosensitive layer, a medium-exposure photosensitive layer, and a high-exposure photosensitive layer corresponding to different exposures.
  • a switching module 104 is configured to switch a corresponding exposure pixel to a middle exposure pixel, a long exposure pixel, or a short exposure pixel by switching an arrangement order of a low exposure light sensitive layer, a medium exposure light sensitive layer, and a high exposure light sensitive layer in a light incident direction. Exposure pixels.
  • the switching module 104 is specifically configured to: arrange a low-exposure photosensitive layer before a medium-exposure photosensitive layer and a high-exposure photosensitive layer to switch a corresponding exposure pixel to a short-exposure pixel;
  • the middle-exposure photosensitive layer is arranged before the low-exposure and high-exposure photosensitive layers to switch the corresponding exposure pixels to the medium-exposure pixels;
  • the high-exposure-sensitive layer is arranged to the low-exposure and middle-exposure pixels.
  • the corresponding exposure pixel is switched to a long exposure pixel.
  • the exposure time of the low-exposure photosensitive layer is shorter than that of the medium-exposure photosensitive layer, and the exposure time of the medium-exposure photosensitive layer is less than that of the high-exposure photosensitive layer; or, the low-exposure photosensitive layer
  • the sensitivity of the layer is greater than that of the medium-exposure photosensitive layer, and the sensitivity of the medium-exposure photosensitive layer is greater than that of the high-exposure photosensitive layer.
  • the control module 105 is configured to control the pixel unit array to output original pixel information after adjusting the proportion of the middle-exposed pixels in each photosensitive pixel unit.
  • the calculation module 106 is configured to calculate the combined pixel information of each photosensitive pixel unit according to the original pixel information output by at least two exposed pixels in the same photosensitive pixel unit.
  • the imaging module 107 is configured to perform imaging according to the merged pixel information.
  • the first backlight scene determination module 108 is configured to determine that the current shooting environment belongs to a backlight scene according to the histogram of the captured preview image before determining the brightness level of the environment brightness.
  • the second backlight scene determination module 109 is configured to determine the brightness value of the imaging object and the background brightness value according to the ambient brightness value measured by the pixel unit array, and determine the current shooting environment according to the brightness value of the imaging object and the background brightness value. Belongs to the backlight scene.
  • the control device of the embodiment of the present disclosure determines the brightness level of the ambient brightness, wherein the brightness level includes a low brightness level, a medium brightness level, and a high brightness level in which the brightness is arranged from small to large.
  • the brightness level of the shooting environment belongs to a high brightness level or
  • the brightness level is low, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to the first value, and when the brightness level of the shooting environment belongs to the medium brightness level, adjust the proportion of middle exposure pixels in each photosensitive pixel unit to A second value; wherein the first value is greater than the second value.
  • the proportion of the middle exposure pixels in each photosensitive pixel unit can be automatically adjusted, so that more effective information in the captured image can be retained, the brightness of the captured image can be improved, and the imaging effect and imaging can be improved. Quality to improve the user ’s shooting experience.
  • the present disclosure also provides an electronic device including a pixel unit array composed of a plurality of photosensitive pixel units.
  • Each photosensitive pixel unit includes at least two exposure pixels, and at least two exposure pixels include at least one exposure pixel. It also includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the control method proposed in the foregoing embodiment of the present disclosure is implemented.
  • the present disclosure also proposes a non-transitory computer-readable storage medium on which a computer program is stored, which is characterized in that when the program is executed by a processor, the control method as proposed in the foregoing embodiment of the present disclosure is implemented .
  • the present disclosure further provides an electronic device 200.
  • the electronic device 200 includes a memory 50 and a processor 60.
  • the memory 50 stores computer-readable instructions.
  • the processor 60 is caused to execute the control method of any one of the foregoing embodiments.
  • FIG. 10 is a schematic diagram of the internal structure of the electronic device 200 in an embodiment.
  • the electronic device 200 includes a processor 60, a memory 50 (for example, a non-volatile storage medium), an internal memory 82, a display screen 83, and an input device 84 connected through a system bus 81.
  • the memory 50 of the electronic device 200 stores an operating system and computer-readable instructions.
  • the computer-readable instructions can be executed by the processor 60 to implement the control method of the embodiment of the present disclosure.
  • the processor 60 is used to provide computing and control capabilities to support the operation of the entire electronic device 200.
  • the internal memory 50 of the electronic device 200 provides an environment for execution of computer-readable instructions in the memory 52.
  • the display screen 83 of the electronic device 200 may be a liquid crystal display or an electronic ink display.
  • the input device 84 may be a touch layer covered on the display screen 83, or may be a button, a trackball, or a touch button provided on the housing of the electronic device 200.
  • Board which can also be an external keyboard, trackpad, or mouse.
  • the electronic device 200 may be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, or a wearable device (for example, a smart bracelet, a smart watch, a smart helmet, or smart glasses).
  • Those skilled in the art can understand that the structure shown in FIG. 10 is only a schematic diagram of a part of the structure related to the solution of the present disclosure, and does not constitute a limitation on the electronic device 200 to which the solution of the present disclosure is applied.
  • the specific electronic device 200 may include more or fewer components than shown in the figure, or some components may be combined, or have different component arrangements.
  • the electronic device 200 includes an image processing circuit 90.
  • the image processing circuit 90 may be implemented by using hardware and / or software components, including various types of defining an ISP (Image Signal Processing) pipeline Processing unit.
  • FIG. 11 is a schematic diagram of an image processing circuit 90 in one embodiment. As shown in FIG. 11, for convenience of explanation, only aspects of the image processing technology related to the embodiments of the present disclosure are shown.
  • the image processing circuit 90 includes an ISP processor 91 (the ISP processor 91 may be the processor 60) and a control logic 92.
  • the image data captured by the camera 93 is first processed by the ISP processor 91.
  • the ISP processor 91 analyzes the image data to capture image statistical information that can be used to determine one or more control parameters of the camera 93.
  • the camera 93 may include one or more lenses 932 and an image sensor 934.
  • the image sensor 934 may include a color filter array (such as a Bayer filter). The image sensor 934 may obtain light intensity and wavelength information captured by each imaging pixel, and provide a set of raw image data that can be processed by the ISP processor 91.
  • the sensor 94 (such as a gyroscope) may provide parameters (such as image stabilization parameters) of the acquired image processing to the ISP processor 91 based on the interface type of the sensor 94.
  • the sensor 94 interface may be a SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the foregoing interfaces.
  • the image sensor 934 may also send the original image data to the sensor 94.
  • the sensor 94 may provide the original image data to the ISP processor 91 based on the interface type of the sensor 94, or the sensor 94 stores the original image data into the image memory 95.
  • the ISP processor 91 processes the original image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 91 may perform one or more image processing operations on the original image data and collect statistical information about the image data. The image processing operations may be performed with the same or different bit depth accuracy.
  • the ISP processor 91 may also receive image data from the image memory 95.
  • the sensor 94 interface sends the original image data to the image memory 95, and the original image data in the image memory 95 is then provided to the ISP processor 91 for processing.
  • the image memory 95 may be an independent dedicated memory in the memory 50, a part of the memory 50, a storage device, or an electronic device, and may include a DMA (Direct Memory Access) feature.
  • DMA Direct Memory Access
  • the ISP processor 91 may perform one or more image processing operations, such as time-domain filtering.
  • the processed image data may be sent to the image memory 95 for further processing before being displayed.
  • the ISP processor 91 receives processing data from the image memory 95, and performs processing on the image data in the original domain and in the RGB and YCbCr color spaces.
  • the image data processed by the ISP processor 91 may be output to a display 97 (the display 97 may include a display screen 83) for viewing by a user and / or further processing by a graphics engine or a GPU (Graphics Processing Unit).
  • the output of the ISP processor 91 can also be sent to the image memory 95, and the display 97 can read image data from the image memory 95.
  • the image memory 95 may be configured to implement one or more frame buffers.
  • the output of the ISP processor 91 may be sent to an encoder / decoder 96 to encode / decode image data.
  • the encoded image data can be saved and decompressed before being displayed on the display 97 device.
  • the encoder / decoder 96 may be implemented by a CPU or a GPU or a coprocessor.
  • the statistical data determined by the ISP processor 91 may be sent to the control logic unit 92.
  • the statistical data may include image sensor 934 statistical information such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, and lens 932 shading correction.
  • the control logic 92 may include a processing element and / or a microcontroller that executes one or more routines (such as firmware). The one or more routines may determine the control parameters of the camera 93 and the ISP processor according to the received statistical data. 91 control parameters.
  • control parameters of the camera 93 may include sensor 94 control parameters (such as gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 932 control parameters (such as focus distance for focusing or zooming), or these parameters The combination.
  • the ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and lens 932 shading correction parameters.
  • the following are the steps for implementing the control method using the processor 60 in FIG. 10 or the image processing circuit 90 (specifically, the ISP processor 91) in FIG. 11:
  • brightness levels include low brightness levels, medium brightness levels, and high brightness levels in ascending order of brightness;
  • the brightness level of the shooting environment belongs to a high brightness level or a low brightness level, adjusting the proportion of the middle exposure pixels in each photosensitive pixel unit to a first value
  • the brightness level of the shooting environment belongs to a medium brightness level, adjust the proportion of the medium exposure pixels in each photosensitive pixel unit to a second value; wherein the first value is greater than the second value.
  • the pixel unit array After adjusting the proportion of the middle exposure pixels in each photosensitive pixel unit, the pixel unit array is controlled to output the original pixel information;
  • Imaging is performed based on the merged pixel information.
  • first and second are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "a plurality” is at least two, for example, two, three, etc., unless it is specifically and specifically defined otherwise.
  • any process or method description in a flowchart or otherwise described herein can be understood as representing a module, fragment, or portion of code that includes one or more executable instructions for implementing steps of a custom logic function or process
  • the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present disclosure belong.
  • Logic and / or steps represented in a flowchart or otherwise described herein, for example, a sequenced list of executable instructions that may be considered to implement a logical function, may be embodied in any computer-readable medium, For use by, or in combination with, an instruction execution system, device, or device (such as a computer-based system, a system that includes a processor, or another system that can fetch and execute instructions from an instruction execution system, device, or device) Or equipment.
  • a "computer-readable medium” may be any device that can contain, store, communicate, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device.
  • computer-readable media include the following: electrical connections (electronic devices) with one or more wirings, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disk read-only memory (CDROM).
  • the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable Processing to obtain the program electronically and then store it in computer memory.
  • portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof.
  • multiple steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system.
  • Discrete logic circuits with logic gates for implementing logic functions on data signals Logic circuits, ASICs with suitable combinational logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.
  • a person of ordinary skill in the art can understand that all or part of the steps carried by the methods in the foregoing embodiments can be implemented by a program instructing related hardware.
  • the program can be stored in a computer-readable storage medium.
  • the program is When executed, one or a combination of the steps of the method embodiment is included.
  • each functional unit in each embodiment of the present disclosure may be integrated into one processing module, or each unit may exist separately physically, or two or more units may be integrated into one module.
  • the above integrated modules may be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
  • the aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

本公开提出一种控制方法、装置、电子设备和计算机可读存储介质，其中，方法应用于成像设备，成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括的至少两曝光像素中含至少一中曝光像素，方法包括：确定环境亮度的亮度等级；亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级；若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值；若拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。该方法能够保留拍摄图像中较多的有效信息，提升拍摄图像的亮度。

Description

控制方法、装置、电子设备和计算机可读存储介质
相关申请的交叉引用
本公开要求OPPO广东移动通信有限公司于2018年08月13日提交的、申请名称为“控制方法、装置、电子设备和计算机可读存储介质”的、中国专利申请号“201810915437.6”的优先权。
技术领域
本公开涉及成像技术领域，尤其涉及一种控制方法、装置、电子设备和计算机可读存储介质。
背景技术
随着终端技术的不断发展，越来越多的用户使用电子设备拍摄图像。相关技术中的成像设备，采用固定结构的像素单元阵列进行成像。
公开内容
本公开提出一种控制方法、装置、电子设备和计算机可读存储介质，用于根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，由此，可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度，提升成像效果和成像质量，以解决现有技术中当成像设备中的像素硬件结构确定时，则无法更改，很难适应多种不同拍摄场景，导致目前拍摄图像的成像质量受限于电子设备中的成像设备，图像质量无法提升的技术问题。
本公开一方面实施例提出了一种控制方法，应用于成像设备，所述成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素中，所述至少两曝光像素中包括至少一中曝光像素，所述方法包括以下步骤：
确定环境亮度的亮度等级；所述亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级；
若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值；
若所述拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，所述第一数值大于所述第二数值。
本公开实施例的控制方法，通过确定环境亮度的亮度等级，其中，亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级，当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值，而当拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。由此，可以根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，从而可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度，进而提升成像效果和成像质量，改善用户的拍摄体验。
本公开又一方面实施例提出了一种控制装置，应用于成像设备，所述成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素中，所述至少两曝光像素中包括至少一中曝光像素，所述装置包括：
确定模块，用于确定环境亮度的亮度等级；所述亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级；
第一调整模块，用于若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值；
第二调整模块，用于若所述拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，所述第一数值大于所述第二数值。
本公开实施例的控制装置，通过确定环境亮度的亮度等级，其中，亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级，当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值，而当拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。由此，可以根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，从而可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度，进而提升成像效果和成像质量，改善用户的拍摄体验。
本公开又一方面实施例提出了一种电子设备，包括：多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素中，所述至少两曝光像素中包括至少一中曝光像素，还包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时，实现如本公开前述实施例提出的控制方法。
本公开又一方面实施例提出了一种非临时性计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如本公开前述实施例提出的控制方法。
本公开附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本公开的实践了解到。
附图说明
为了更清楚地说明本公开实施例中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本公开实施例一所提供的控制方法的流程示意图；
图2为本公开实施例中成像设备的像素单元阵列的部分结构示意图；
图3为本公开实施例中逆光场景对应的灰度直方图示意图；
图4为本公开实施例中感光像素单元的结构示意图一；
图5为本公开实施例中感光像素单元的结构示意图二；
图6为本公开实施例中感光像素单元的结构示意图三；
图7为本公开实施例二所提供的控制方法的流程示意图；
图8为本公开实施例三所提供的控制装置的结构示意图；
图9为本公开实施例四所提供的控制装置的结构示意图；
图10是本公开某些实施方式的电子设备的模块示意图；
图11是本公开某些实施方式的图像处理电路的模块示意图。
具体实施方式
下面详细描述本公开的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，旨在用于解释本公开，而不能理解为对本公开的限制。
本公开主要针对现有技术中图像质量不佳的技术问题，提供一种控制方法。
本公开实施例的控制方法，通过确定环境亮度的亮度等级，其中，亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级，当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值，而当拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。由此，可以根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，从而可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度，进而提升成像效果和成像质量，改善用户的拍摄体验。
下面参考附图描述本公开实施例的控制方法、装置、电子设备和计算机可读存储介质。
图1为本公开实施例一所提供的控制方法的流程示意图。
本公开实施例的控制方法，应用于成像设备，该成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素，至少两曝光像素中包括至少一中曝光像素。
作为一种示例，参见图2，图2为本公开实施例中成像设备的像素单元阵列的部分结 构示意图。其中，成像设备30包括像素单元阵列31和设置在像素单元阵列31上的滤光片单元阵列32。像素单元阵列31包括多个感光像素单元311，每个感光像素单元311包括至少两个曝光像素3111，至少两个曝光像素中包括至少一个中曝光像素。例如，图2以每个感光像素单元311包括4个曝光像素3111示例，4个曝光像素可以为1个长曝光像素、2个中曝光像素、1个短曝光像素。当然，每一个感光像素单元311中的长曝光像素、中曝光像素和短曝光像素的数量也可为其他数值，对此不作限制。
滤光片单元阵列32包括与多个感光像素单元311对应的多个滤光片单元322，每个滤光片单元322覆盖对应的感光像素单元311，即同一感光像素单元内包含的各曝光像素由同色滤光片覆盖。其中，像素单元阵列31可以为拜耳阵列。
其中，长曝光像素指的是感光像素对应的曝光时间为长曝光时间，中曝光像素指的是感光像素对应的曝光时间为中曝光时间，短曝光像素指的是感光像素对应的曝光时间为短曝光时间，长曝光时间>中曝光时间>短曝光时间，即长曝光像素的长曝光时间大于中曝光像素的中曝光时间，且中曝光像素的中曝光时间大于短曝光像素的短曝光时间。在成像设备工作时，长曝光像素、中曝光像素及短曝光像素同步曝光，同步曝光指的是中曝光像素及短曝光像素的曝光时间位于长曝光像素的曝光时间以内。
具体地，可以首先控制长曝光像素最先开始曝光，在长曝光像素的曝光期间内，再控制中曝光像素以及短曝光像素曝光，其中，中曝光像素和短曝光像素的曝光截止时间应与长曝光像素的曝光截止时间相同或位于长曝光像素的曝光截止时间之前；或者，控制长曝光像素、中曝光像素以及短曝光像素同时开始曝光，即长曝光像素、中曝光像素以及短曝光像素的曝光起始时间相同。如此，无需控制像素单元阵列依次进行长曝、中曝和短曝，可减小图像的拍摄时间。
如图1所示，该控制方法包括以下步骤：
步骤101，确定环境亮度的亮度等级；亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级。
本公开实施例中，可以预先将环境亮度划分为三个亮度等级，分别为低亮度等级、中亮度等级和高亮度等级，例如，亮度等级可以由电子设备的内置程序预先设置，或者，还可以由用户进行设置，对此不作限制。
本公开实施例中，可以采用独立的测光器件，测量环境亮度，或者，还可以读取摄像头自动调节的ISO值，根据读取到的ISO值，确定环境亮度，或者，还可以控制像素单元阵列对环境亮度值进行测量，确定环境亮度，对此不作限制。在确定环境亮度后，可以根据该环境亮度，确定亮度等级。
需要说明的是，上述ISO值用来指示摄像头的感光度，常用的ISO值有50、100、200、400、1000等等，摄像头可以根据环境亮度，自动调节ISO值，从而，本实施例中，可以根据ISO值，反推出环境亮度。一般在光线充足的情况下，ISO值可以为50或100，在光 线不足的情况下，ISO值可以为400或更高。
应当理解的是，当电子设备所处的场景不同时，亮度等级可以设置不同，举例而言，当白天，且电子设备处于室内时，ISO值处于200至500之间，而当白天，且电子设备处于室外时，ISO值一般低于200。因此，可以根据实际需求以及具体的拍摄场景，设置每个亮度等级的大小和区间。
步骤102，若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值。
其中，第一数值可以为电子设备的内置程序预先设置的，或者，还可以由用户进行设置，对此不作限制。
本公开实施例中，各感光像素单元中的长曝光像素、中曝光像素、短曝光像素是可调的。当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，表明拍摄环境较亮或者较暗，此时，环境亮度比较极端，当采用长曝光像素或者短曝光像素进行拍摄时，输出的图像的噪点较高，或者，长曝光像素或者短曝光像素输出的像素信息会发生溢出，图像细节丢失的较为严重。
例如，根据红绿蓝(Red Green Blue，简称RGB)三色直方图，可以直观地显示三色不同明暗度的细节内容分布，过曝的部分就会聚集在直方图的左右两端，在容忍度以外的区域不会更亮，而是丢失全部细节，只显示全白的色块(255,255,255)，反之，欠曝的部分，容忍度以外的不会更暗，而是丢失全部细节，只显示全黑的色块(0,0,0)。
因此，本公开中，为了保留较多的图像细节，可以增大中曝光像素的占比。例如，可以将各感光像素单元中的短曝光像素切换为中曝光像素，或者，可以将各感光像素单元中的长曝光像素切换为中曝光像素，或者，可以将各感光像素单元中的短曝光像素和长曝光像素切换为中曝光像素，从而增大对应感光像素单元中的中曝光像素的占比为第一数值。
步骤103，若拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。
其中，第二数值可以为电子设备的内置程序预先设置的，或者，还可以由用户进行设置，对此不作限制。
本公开实施例中，当拍摄环境的亮度等级属于中亮度等级时，此时，拍摄图像的细节保留的较多，可以进一步改善图像的成像效果。具体地，可以减小中曝光像素的占比。例如，将各感光像素单元中的一个中曝光像素切换为短曝光像素，或者，将另一个中曝光像素切换为长曝光像素，或者，将各感光像素单元中的一个中曝光像素切换为短曝光像素，同时，将另一个中曝光像素切换为长曝光像素，以减小对应感光像素单元中的中曝光像素的占比为第二数值，由此，长曝光像素可以修正图像中的暗部区域，短曝光像素可以修正图像中的亮部区域，提升成像效果和成像质量。
本公开实施例的控制方法，通过确定环境亮度的亮度等级，其中，亮度等级包括亮度 从小到大排列的低亮度等级、中亮度等级和高亮度等级，当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值，而当拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。由此，可以根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，从而可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度，进而提升成像效果和成像质量，改善用户的拍摄体验。
需要说明的是，在逆光场景下，当用户使用电子设备的前置摄像头自拍时，由于用户处于光源和电子设备之间，容易造成人脸曝光不充分的情况发生。因此，在逆光场景下，拍摄图像的有效信息较少、亮度偏低。而本公开实施例中，通过根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度。
作为一种可能的实现方式，可以根据拍摄的预览图像的直方图，确定当前拍摄环境属于逆光场景。
具体地，在拍摄的预览图像时，可以根据像素单元阵列测量测到的环境亮度值对应的灰度值，生成灰度直方图，而后根据处于各灰度范围的感光像素数占比，判断当前拍摄环境是否为逆光场景。
例如，当根据灰度直方图，确定像素单元阵列中测量得到的环境亮度值对应的灰度值处于灰度范围[0,20]的感光像素，与像素单元阵列中所有感光像素的比值grayRatio大于第一阈值，例如第一阈值可以为0.135，且测量得到的环境亮度值对应的灰度值处于灰度范围[200,256)的感光像素，与像素单元阵列中所有感光像素的比值grayRatio大于第二阈值，例如第二阈值可以为0.0899时，则确定当前拍摄环境为逆光场景。
或者，当根据灰度直方图，确定像素单元阵列中测量得到的环境亮度值对应的灰度值处于灰度范围[0,50]的感光像素，与像素单元阵列中所有感光像素的比值grayRatio大于第三阈值，例如第三阈值可以为0.3，且测量得到的环境亮度值对应的灰度值处于灰度范围[200,256)的感光像素，与像素单元阵列中所有感光像素的比值grayRatio大于第四阈值，例如第四阈值可以为0.003时，则确定当前拍摄环境为逆光场景。
或者，当根据灰度直方图，确定像素单元阵列中测量得到的环境亮度值对应的灰度值处于灰度范围[0,50]的感光像素，与像素单元阵列中所有感光像素的比值grayRatio大于第五阈值，例如第五阈值可以为0.005，且测量得到的环境亮度值对应的灰度值处于灰度范围[200,256)的感光像素，与像素单元阵列中所有感光像素的比值grayRatio大于第六阈值，例如第六阈值可以为0.25时，则确定当前拍摄环境为逆光场景。
作为一种示例，逆光场景对应的灰度直方图可以如图3所示。
可以理解的是，一般情况下，在当前拍摄环境为逆光场景时，像素单元阵列中各感光像素测量得到的环境亮度值将存在较高的亮度差异，因此，作为另一种可能的实现方式， 还可以根据像素单元阵列测量得到的环境亮度值，确定成像对象的亮度值以及背景的亮度值，并判断成像对象的亮度值和背景的亮度值之间的差值是否大于预设阈值，在成像对象的亮度值和背景的亮度值之间的差值大于预设阈值时，确定当前拍摄环境为逆光场景，而在成像对象的亮度值和背景的亮度值之间的差值小于或者等于预设阈值时，确定当前拍摄环境为非逆光场景。
其中，预设阈值可以预设在电子设备的内置程序中，或者，预设阈值还可以由用户进行设置，对此不作限制。成像对象为需要电子设备进行拍摄的对象，例如人(或者人脸)、动物、物体、景物等对象。
作为一种可能的实现方式，各曝光像素包括对应不同曝光度的低曝光度感光层、中曝光度感光层和高曝光度感光层，可以通过切换低曝光度感光层、中曝光度感光层和高曝光度感光层的在入光方向上的排布顺序，将曝光像素切换为中曝光像素、长曝光像素或短曝光像素。
例如，当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，此时，可以将各感光像素单元中的短曝光像素和/或长曝光像素切换为中曝光像素，例如，参见图4，假设一个感光像素单元中包括4个曝光像素，分别为1个长曝光像素(L)、2个中曝光像素(M)以及1个短曝光像素(S)，此时，可以将长曝光像素和短曝光像素分别切换为中曝光像素。具体地，可以长曝光像素和短曝光像素的中曝光度感光层排布至低曝光度感光层和高曝光度感光层之前，以将长曝光像素和短曝光像素切换为中曝光像素。
当拍摄环境的亮度等级属于中亮度等级时，此时，可以将各感光像素单元中的一个中曝光像素切换为短曝光像素，和/或，将另一个中曝光像素切换为长曝光像素，例如，参见图5，可以将一个中曝光像素切换为长曝光像素。具体地，可以中曝光像素的高曝光度感光层排布至低曝光度感光层和中曝光度感光层之前，以将中曝光像素切换为长曝光像素。或者，参见图6，可以将一个中曝光像素切换为短曝光像素。具体地，可以中曝光像素的低曝光度感光层排布至中曝光度感光层和高曝光度感光层之前，以将中曝光像素切换为短曝光像素。
其中，低曝光度感光层的曝光时长小于中曝光度感光层的曝光时长，中曝光度感光层的曝光时长小于高曝光度感光层的曝光时长；或者，低曝光度感光层的感光度大于中曝光度感光层的感光度，中曝光度感光层的感光度大于高曝光度感光层的感光度。
作为一种可能的实现方式，参考图7，在图1所示实施例的基础上，调整各感光像素单元中的中曝光像素的占比后，可以根据调整后的各感光像素单元进行成像。为了清楚说明具体成像过程，如图7所示，该控制方法还可以包括以下步骤：
步骤201，对像素单元阵列，调整各感光像素单元中的中曝光像素的占比后，控制像素单元阵列输出原始像素信息。
本公开实施例中，在调整各感光像素单元中的中曝光像素的占比后，可以控制像素单 元阵列输出原始像素信息。
作为一种可能的实现方式，可以控制像素单元阵列输出分别处于不同曝光时间下的多个原始像素信息，例如，可以控制像素单元阵列中的每个感光像素单元中的长曝光像素、中曝光像素、和/或、短曝光像素同步曝光，其中长曝光像素对应的曝光时间为初始长曝光时间，中曝光像素对应的曝光时间为初始中曝光时间，短曝光像素对应的曝光时间为初始短曝光时间，初始长曝光时间、初始中曝光时间及初始短曝光时间均为预先设定好的。在曝光结束后，像素单元阵列中的每个感光像素单元将输出分别处于不同曝光时间下的多个原始像素信息。
作为另一种可能的实现方式，还可以控制像素单元阵列输出采用相同曝光时间曝光得到的多个原始像素信息。例如，可以控制像素单元阵列中的每个感光像素单元中的长曝光像素、中曝光像素、和/或、短曝光像素同步曝光，每个曝光像素的曝光时间相同，即长曝光像素、中曝光像素、和/或、短曝光像素的曝光截止时间也相同。在曝光结束后，像素单元阵列中的每个感光像素单元将输出采用相同曝光时间曝光得到的多个原始像素信息。
例如，参见图4，在每个感光像素单元均为4个中曝光像素时，每个感光像素单元将输出4个原始像素信息，分别为4个中曝光像素输出的原始像素信息。或者，参见图5，在每个感光像素单元均包括2个长曝光像素、1个中曝光像素和1个短曝光像素时，每个感光像素单元将输出4个原始像素信息，分别为2个长曝光像素输出的原始像素信息、1个中曝光像素输出的原始像素信息和1个短曝光像素输出的原始像素信息。
步骤202，根据同一感光像素单元中至少两曝光像素输出的原始像素信息，计算得到各感光像素单元的合并像素信息。
具体地，可以根据同一感光像素单元中曝光时间相同的原始像素信息，计算得到各感光像素单元的合并像素信息。
作为一种可能的实现方式，当控制像素单元阵列输出分别处于不同曝光时间下的多个原始像素信息后，可以根据同一感光像素单元中曝光时间相同的原始像素信息计算得到合并像素信息。
例如，当每个感光像素单元中包括1个长曝光像素、2个中曝光像素、1个短曝光像素时，唯一的长曝光像素的原始像素信息即为长曝光的合并像素信息，2个中曝光像素的原始像素信息之和即为中曝光的合并像素信息，唯一的短曝光像素的原始像素信息即为短曝光的合并像素信息；当感光像素单元中包括2个长曝光像素、4个中曝光像素、2个短曝光像素时，2个长曝光像素的原始像素信息之和即为长曝光的合并像素信息，4个中曝光像素的原始像素信息之和即为中曝光的合并像素信息，2个短曝光像素的原始像素信息之和即为短曝光的合并像素信息。如此，可以获得整个像素单元阵列的多个长曝光的合并像素信息、多个中曝光的合并像素信息、多个短曝光的合并像素信息。
可选地，可以在同一感光像素单元中，选取长曝光像素的原始像素信息、短曝光像素 的原始像素信息或中曝光像素的原始像素信息，而后根据选取的原始像素信息，以及长曝光时间、中曝光时间和短曝光时间之间的曝光比，计算得到合并像素信息。
例如，当一个感光像素中包括1个长曝光像素、2个中曝光像素、1个短曝光像素，且长曝光像素的原始像素信息为80，两个中曝光像素的原始像素信息为255，短曝光像素的原始像素信息为255时，由于255为原始像素信息的上限，因此，选取的可以为长曝光像素的原始像素信息：80。假设长曝光时间、中曝光时间和短曝光时间之间的曝光比为：16:4:1，则合并像素信息为：80*16＝1280。
由于现有技术中原始像素信息的上限为255，通过根据选取的原始像素信息，以及长曝光时间、中曝光时间和短曝光时间之间的曝光比，计算得到合并像素信息，可以扩展动态范围，得到高动态范围图像，从而提升成像图像的成像效果。
作为另一种可能的实现方式，在控制像素单元阵列输出采用相同曝光时间曝光得到的多个原始像素信息后，可以对同一感光像素单元的原始像素信息计算平均值，得到合并像素信息，其中，每个感光像素单元对应一个合并像素信息。
例如，当感光像素单元中包括1个长曝光像素、2个中曝光像素、1个短曝光像素时，标记1个长曝光像素输出的1个原始像素信息、2个中曝光像素输出的2个原始像素信息、以及1个短曝光像素输出的1个原始像素信息分别为：R1、R2、R3和R4，则该感光像素单元的合并像素信息为：(R1+R2+R3+R4)/4。
步骤203，根据合并像素信息进行成像。
本公开实施例中，在得到合并像素信息后，可以根据合并像素信息进行成像。
作为一种可能的实现方式，当控制像素单元阵列输出分别处于不同曝光时间下的多个原始像素信息，且根据同一感光像素单元中曝光时间相同的原始像素信息计算得到合并像素信息后，可以获得整个像素单元阵列的多个长曝光的合并像素信息、多个中曝光的合并像素信息、多个短曝光的合并像素信息，而后，再根据多个长曝光的合并像素信息插值计算得到长曝光子图像，根据多个中曝光的合并像素信息插值计算得到中曝光子图像，根据多个短曝光的合并像素信息插值计算得到短曝光子图像。最后，将长曝光子图像、中曝光子图像和短曝光子图像融合处理得到高动态范围的成像图像，其中，长曝光子图像、中曝光子图像和短曝光子图像并非为传统意义上的三帧图像，而是同一帧图像中长、短、中曝光像素对应区域形成的图像部分。
或者，在像素单元阵列曝光结束后，可以以长曝光像素输出的原始像素信息为基准，将短曝光像素的原始像素信息和中曝光像素的原始像素信息叠加到长曝光像素的原始像素信息上。具体地，针对同一感光像素单元，可以对三种不同曝光时间的原始像素信息分别赋予不同的权值，在各曝光时间对应的原始像素信息与权值相乘后，再将三种乘以权值后的原始像素信息相加作为一个感光像素单元的合成像素信息。随后，由于根据三种不同曝光时间的原始像素信息计算得到的每一个合成像素信息的灰度级别会产生变化，因此，在 得到合成像素信息后需要对每一个合成像素信息做灰度级别的压缩。压缩完毕后，可以根据多个压缩完毕后得到的合成像素信息进行插值计算即可得到成像图像。如此，成像图像中暗部已经由长曝光像素输出的原始像素信息进行补偿，亮部已经由短曝光像素输出的原始像素信息进行压制，因此成像图像不存在过曝区域及欠曝区域，具有较高的动态范围和较佳的成像效果。
作为另一种可能的实现方式，在控制像素单元阵列输出采用相同曝光时间曝光得到的多个原始像素信息，且对同一感光像素单元的原始像素信息计算平均值，得到合并像素信息后，可以确定整个像素单元阵列中多个感光像素单元的多个合并像素信息，而后可以根据多个合并像素信息进行插值计算，即可得到成像图像。
为了实现上述实施例，本公开还提出一种控制装置。
图8为本公开实施例三所提供的控制装置的结构示意图。
如图8所示，该控制装置100，应用于成像设备，成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素，至少两曝光像素中包括至少一中曝光像素，控制装置100包括：确定模块101、第一调整模块102，以及第二调整模块103。
其中，确定模块101，用于确定环境亮度的亮度等级；亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级。
第一调整模块102，用于若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值。
作为一种可能的实现方式，第一调整模块102，具体用于：将各感光像素单元中的短曝光像素和/或长曝光像素切换为中曝光像素，以增大对应感光像素单元中的中曝光像素的占比为第一数值；其中，长曝光像素的曝光时长大于中曝光像素的曝光时长，且中曝光像素的曝光时长大于短曝光像素的曝光时长。
第二调整模块103，用于若拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。
作为一种可能的实现方式，第二调整模块103，具体用于：将各感光像素单元中的一个中曝光像素切换为短曝光像素，和/或，将另一个中曝光像素切换为长曝光像素，以减小对应感光像素单元中的中曝光像素的占比为第二数值；其中，长曝光像素的曝光时长大于中曝光像素的曝光时长，且中曝光像素的曝光时长大于短曝光像素的曝光时长。
进一步地，在本公开实施例的一种可能的实现方式中，参见图9，在图8所示实施例的基础上，该控制装置100还可以包括：
作为一种可能的实现方式，各曝光像素包括对应不同曝光度的低曝光度感光层、中曝光度感光层和高曝光度感光层。
切换模块104，用于通过切换低曝光度感光层、中曝光度感光层和高曝光度感光层的 在入光方向上的排布顺序，切换对应曝光像素为中曝光像素、长曝光像素或短曝光像素。
作为一种可能的实现方式，切换模块104，具体用于：将低曝光度感光层排布至中曝光度感光层和高曝光度感光层之前，以将对应曝光像素切换为短曝光像素；将中曝光度感光层排布至低曝光度感光层和高曝光度感光层之前，以将对应曝光像素切换为中曝光像素；将高曝光度感光层排布至低曝光度感光层和中曝光度感光层之前，以将对应曝光像素切换为长曝光像素。
作为一种可能的实现方式，低曝光度感光层的曝光时长小于中曝光度感光层的曝光时长，中曝光度感光层的曝光时长小于高曝光度感光层的曝光时长；或者，低曝光度感光层的感光度大于中曝光度感光层的感光度，中曝光度感光层的感光度大于高曝光度感光层的感光度。
控制模块105，用于对像素单元阵列，调整各感光像素单元中的中曝光像素的占比后，控制像素单元阵列输出原始像素信息。
计算模块106，用于根据同一感光像素单元中至少两曝光像素输出的原始像素信息，计算得到各感光像素单元的合并像素信息。
成像模块107，用于根据合并像素信息进行成像。
第一逆光场景确定模块108，用于在确定环境亮度的亮度等级之前，根据拍摄的预览图像的直方图，确定当前拍摄环境属于逆光场景。
第二逆光场景确定模块109，用于根据像素单元阵列测量得到的环境亮度值，确定成像对象的亮度值以及背景的亮度值，以及根据成像对象的亮度值和背景的亮度值，确定当前拍摄环境属于逆光场景。
需要说明的是，前述对控制方法实施例的解释说明也适用于该实施例的控制装置100，此处不再赘述。
本公开实施例的控制装置，通过确定环境亮度的亮度等级，其中，亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级，当拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值，而当拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，第一数值大于第二数值。由此，可以根据拍摄环境的亮度等级，自动调整各感光像素单元中的中曝光像素的占比，从而可以保留拍摄图像中较多的有效信息，提升拍摄图像的亮度，进而提升成像效果和成像质量，改善用户的拍摄体验。
为了实现上述实施例，本公开还提出一种电子设备，包括多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素中，至少两曝光像素中包括至少一中曝光像素，还包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，处理器执行程序时，实现如本公开前述实施例提出的控制方法。
为了实现上述实施例，本公开还提出一种非临时性计算机可读存储介质，其上存储有 计算机程序，其特征在于，该程序被处理器执行时实现如本公开前述实施例提出的控制方法。
请参阅图10，本公开还提供一种电子设备200。电子设备200包括存储器50和处理器60。存储器50中存储有计算机可读指令。计算机可读指令被存储器50执行时，使得处理器60执行上述任一实施方式的控制方法。
图10为一个实施例中电子设备200的内部结构示意图。该电子设备200包括通过系统总线81连接的处理器60、存储器50(例如为非易失性存储介质)、内存储器82、显示屏83和输入装置84。其中，电子设备200的存储器50存储有操作系统和计算机可读指令。该计算机可读指令可被处理器60执行，以实现本公开实施方式的控制方法。该处理器60用于提供计算和控制能力，支撑整个电子设备200的运行。电子设备200的内存储器50为存储器52中的计算机可读指令的运行提供环境。电子设备200的显示屏83可以是液晶显示屏或者电子墨水显示屏等，输入装置84可以是显示屏83上覆盖的触摸层，也可以是电子设备200外壳上设置的按键、轨迹球或触控板，也可以是外接的键盘、触控板或鼠标等。该电子设备200可以是手机、平板电脑、笔记本电脑、个人数字助理或穿戴式设备(例如智能手环、智能手表、智能头盔、智能眼镜)等。本领域技术人员可以理解，图10中示出的结构，仅仅是与本公开方案相关的部分结构的示意图，并不构成对本公开方案所应用于其上的电子设备200的限定，具体的电子设备200可以包括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。
请参阅图11，本公开实施例的电子设备200中包括图像处理电路90，图像处理电路90可利用硬件和/或软件组件实现，包括定义ISP(Image Signal Processing，图像信号处理)管线的各种处理单元。图11为一个实施例中图像处理电路90的示意图。如图11所示，为便于说明，仅示出与本公开实施例相关的图像处理技术的各个方面。
如图11所示，图像处理电路90包括ISP处理器91(ISP处理器91可为处理器60)和控制逻辑器92。摄像头93捕捉的图像数据首先由ISP处理器91处理，ISP处理器91对图像数据进行分析以捕捉可用于确定摄像头93的一个或多个控制参数的图像统计信息。摄像头93可包括一个或多个透镜932和图像传感器934。图像传感器934可包括色彩滤镜阵列(如Bayer滤镜)，图像传感器934可获取每个成像像素捕捉的光强度和波长信息，并提供可由ISP处理器91处理的一组原始图像数据。传感器94(如陀螺仪)可基于传感器94接口类型把采集的图像处理的参数(如防抖参数)提供给ISP处理器91。传感器94接口可以为SMIA(Standard Mobile Imaging Architecture，标准移动成像架构)接口、其它串行或并行照相机接口或上述接口的组合。
此外，图像传感器934也可将原始图像数据发送给传感器94，传感器94可基于传感器94接口类型把原始图像数据提供给ISP处理器91，或者传感器94将原始图像数据存储到图像存储器95中。
ISP处理器91按多种格式逐个像素地处理原始图像数据。例如，每个图像像素可具有8、10、12或14比特的位深度，ISP处理器91可对原始图像数据进行一个或多个图像处理操作、收集关于图像数据的统计信息。其中，图像处理操作可按相同或不同的位深度精度进行。
ISP处理器91还可从图像存储器95接收图像数据。例如，传感器94接口将原始图像数据发送给图像存储器95，图像存储器95中的原始图像数据再提供给ISP处理器91以供处理。图像存储器95可为存储器50、存储器50的一部分、存储设备、或电子设备内的独立的专用存储器，并可包括DMA(Direct Memory Access，直接直接存储器存取)特征。
当接收到来自图像传感器934接口或来自传感器94接口或来自图像存储器95的原始图像数据时，ISP处理器91可进行一个或多个图像处理操作，如时域滤波。处理后的图像数据可发送给图像存储器95，以便在被显示之前进行另外的处理。ISP处理器91从图像存储器95接收处理数据，并对处理数据进行原始域中以及RGB和YCbCr颜色空间中的图像数据处理。ISP处理器91处理后的图像数据可输出给显示器97(显示器97可包括显示屏83)，以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit，图形处理器)进一步处理。此外，ISP处理器91的输出还可发送给图像存储器95，且显示器97可从图像存储器95读取图像数据。在一个实施例中，图像存储器95可被配置为实现一个或多个帧缓冲器。此外，ISP处理器91的输出可发送给编码器/解码器96，以便编码/解码图像数据。编码的图像数据可被保存，并在显示于显示器97设备上之前解压缩。编码器/解码器96可由CPU或GPU或协处理器实现。
ISP处理器91确定的统计数据可发送给控制逻辑器92单元。例如，统计数据可包括自动曝光、自动白平衡、自动聚焦、闪烁检测、黑电平补偿、透镜932阴影校正等图像传感器934统计信息。控制逻辑器92可包括执行一个或多个例程(如固件)的处理元件和/或微控制器，一个或多个例程可根据接收的统计数据，确定摄像头93的控制参数及ISP处理器91的控制参数。例如，摄像头93的控制参数可包括传感器94控制参数(例如增益、曝光控制的积分时间、防抖参数等)、照相机闪光控制参数、透镜932控制参数(例如聚焦或变焦用焦距)、或这些参数的组合。ISP控制参数可包括用于自动白平衡和颜色调整(例如，在RGB处理期间)的增益水平和色彩校正矩阵，以及透镜932阴影校正参数。
例如，以下为运用图10中的处理器60或运用图11中的图像处理电路90(具体为ISP处理器91)实现控制方法的步骤：
确定环境亮度的亮度等级；亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级；
若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值；
若拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占 比为第二数值；其中，第一数值大于第二数值。
再例如，以下为运用图10中的处理器或运用图11中的图像处理电路90(具体为ISP处理器)实现控制方法的步骤：
对像素单元阵列，调整各感光像素单元中的中曝光像素的占比后，控制像素单元阵列输出原始像素信息；
根据同一感光像素单元中至少两曝光像素输出的原始像素信息，计算得到各感光像素单元的合并像素信息；
根据合并像素信息进行成像。
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本公开的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外，在不相互矛盾的情况下，本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
此外，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本公开的描述中，“多个”的含义是至少两个，例如两个，三个等，除非另有明确具体的限定。
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本公开的优选实施方式的范围包括另外的实现，其中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本公开的实施例所属技术领域的技术人员所理解。
在流程图中表示或在此以其他方式描述的逻辑和/或步骤，例如，可以被认为是用于实现逻辑功能的可执行指令的定序列表，可以具体实现在任何计算机可读介质中，以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用，或结合这些指令执行系统、装置或设备而使用。就本说明书而言，"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下：具有一个或多个布线的电连接部(电子装置)，便携式计算机盘盒(磁装置)，随机存取存储器(RAM)，只读存储器(ROM)，可擦除可编辑只读存储器(EPROM或闪速存储器)，光纤装置，以及便携式光盘只读存储器(CDROM)。另外，计算机可读介质甚至可以是可在其上打印所述程序的纸 或其他合适的介质，因为可以例如通过对纸或其他介质进行光学扫描，接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序，然后将其存储在计算机存储器中。
应当理解，本公开的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如，如果用硬件来实现和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，该程序在执行时，包括方法实施例的步骤之一或其组合。
此外，在本公开各个实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。
上述提到的存储介质可以是只读存储器，磁盘或光盘等。尽管上面已经示出和描述了本公开的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本公开的限制，本领域的普通技术人员在本公开的范围内可以对上述实施例进行变化、修改、替换和变型。

Claims (20)

  1. 一种控制方法，其特征在于，应用于成像设备，所述成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素，所述至少两曝光像素中包括至少一中曝光像素，所述方法包括以下步骤：
    确定环境亮度的亮度等级；所述亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级；
    若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值；
    若所述拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，所述第一数值大于所述第二数值。
  2. 根据权利要求1所述的控制方法，其特征在于，所述调整各感光像素单元中的中曝光像素的占比为第一数值，包括：
    将各感光像素单元中的短曝光像素和/或长曝光像素切换为中曝光像素，以增大对应感光像素单元中的中曝光像素的占比为所述第一数值；
    其中，所述长曝光像素的曝光时长大于所述中曝光像素的曝光时长，且所述中曝光像素的曝光时长大于所述短曝光像素的曝光时长。
  3. 根据权利要求1或2所述的控制方法，其特征在于，所述调整各感光像素单元中的中曝光像素的占比为第二数值，包括：
    将各感光像素单元中的一个中曝光像素切换为短曝光像素，和/或，将另一个中曝光像素切换为长曝光像素，以减小对应感光像素单元中的中曝光像素的占比为第二数值；
    其中，所述长曝光像素的曝光时长大于所述中曝光像素的曝光时长，且所述中曝光像素的曝光时长大于所述短曝光像素的曝光时长。
  4. 根据权利要求2或3所述的控制方法，其特征在于，各曝光像素包括对应不同曝光度的低曝光度感光层、中曝光度感光层和高曝光度感光层；
    所述方法，还包括：
    通过切换所述低曝光度感光层、中曝光度感光层和高曝光度感光层的在入光方向上的排布顺序，切换对应曝光像素为中曝光像素、长曝光像素或短曝光像素。
  5. 根据权利要求4所述的控制方法，其特征在于，所述通过切换所述低曝光度感光层、中曝光度感光层和高曝光度感光层的在入光方向上的排布顺序，切换对应曝光像素为中曝光像素、长曝光像素或短曝光像素，包括：
    将所述低曝光度感光层排布至所述中曝光度感光层和高曝光度感光层之前，以将对应曝光像素切换为短曝光像素；
    将所述中曝光度感光层排布至所述低曝光度感光层和高曝光度感光层之前，以将对应 曝光像素切换为中曝光像素；
    将所述高曝光度感光层排布至所述低曝光度感光层和所述中曝光度感光层之前，以将对应曝光像素切换为长曝光像素。
  6. 根据权利要求4或5所述的控制方法，其特征在于，
    所述低曝光度感光层的曝光时长小于所述中曝光度感光层的曝光时长，所述中曝光度感光层的曝光时长小于所述高曝光度感光层的曝光时长；
    或者，所述低曝光度感光层的感光度大于所述中曝光度感光层的感光度，所述中曝光度感光层的感光度大于所述高曝光度感光层的感光度。
  7. 根据权利要求1-6中任一所述的控制方法，其特征在于，所述方法还包括：
    对所述像素单元阵列，调整各感光像素单元中的中曝光像素的占比后，控制所述像素单元阵列输出原始像素信息；
    根据同一感光像素单元中至少两曝光像素输出的原始像素信息，计算得到各感光像素单元的合并像素信息；
    根据所述合并像素信息进行成像。
  8. 根据权利要求1-7中任一所述的控制方法，其特征在于，所述确定环境亮度的亮度等级之前，还包括：
    根据拍摄的预览图像的直方图，确定当前拍摄环境属于逆光场景。
  9. 根据权利要求1-7中任一所述的控制方法，其特征在于，所述确定环境亮度的亮度等级之前，还包括：
    根据所述像素单元阵列测量得到的环境亮度值，确定成像对象的亮度值以及背景的亮度值；
    根据所述成像对象的亮度值和所述背景的亮度值，确定当前拍摄环境属于逆光场景。
  10. 一种控制装置，其特征在于，应用于成像设备，所述成像设备包括由多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素中，所述至少两曝光像素中包括至少一中曝光像素，所述装置包括：
    确定模块，用于确定环境亮度的亮度等级；所述亮度等级包括亮度从小到大排列的低亮度等级、中亮度等级和高亮度等级；
    第一调整模块，用于若拍摄环境的亮度等级属于高亮度等级或低亮度等级时，调整各感光像素单元中的中曝光像素的占比为第一数值；
    第二调整模块，用于若所述拍摄环境的亮度等级属于中亮度等级时，调整各感光像素单元中的中曝光像素的占比为第二数值；其中，所述第一数值大于所述第二数值。
  11. 根据权利要求10所述的控制装置，其特征在于，所述第一调整模块，具体用于：
    将各感光像素单元中的短曝光像素和/或长曝光像素切换为中曝光像素，以增大对应感光像素单元中的中曝光像素的占比为所述第一数值；
    其中，所述长曝光像素的曝光时长大于所述中曝光像素的曝光时长，且所述中曝光像素的曝光时长大于所述短曝光像素的曝光时长。
  12. 根据权利要求10或11所述的控制装置，其特征在于，所述第二调整模块，具体用于：
    将各感光像素单元中的一个中曝光像素切换为短曝光像素，和/或，将另一个中曝光像素切换为长曝光像素，以减小对应感光像素单元中的中曝光像素的占比为第二数值；
    其中，所述长曝光像素的曝光时长大于所述中曝光像素的曝光时长，且所述中曝光像素的曝光时长大于所述短曝光像素的曝光时长。
  13. 根据权利要求11或12所述的控制装置，其特征在于，各曝光像素包括对应不同曝光度的低曝光度感光层、中曝光度感光层和高曝光度感光层；
    所述装置，还包括：
    切换模块，用于通过切换所述低曝光度感光层、中曝光度感光层和高曝光度感光层的在入光方向上的排布顺序，切换对应曝光像素为中曝光像素、长曝光像素或短曝光像素。
  14. 根据权利要求13所述的控制装置，其特征在于，所述切换模块，具体用于：
    将所述低曝光度感光层排布至所述中曝光度感光层和高曝光度感光层之前，以将对应曝光像素切换为短曝光像素；
    将所述中曝光度感光层排布至所述低曝光度感光层和高曝光度感光层之前，以将对应曝光像素切换为中曝光像素；
    将所述高曝光度感光层排布至所述低曝光度感光层和所述中曝光度感光层之前，以将对应曝光像素切换为长曝光像素。
  15. 根据权利要求13或14所述的控制装置，其特征在于，
    所述低曝光度感光层的曝光时长小于所述中曝光度感光层的曝光时长，所述中曝光度感光层的曝光时长小于所述高曝光度感光层的曝光时长；
    或者，所述低曝光度感光层的感光度大于所述中曝光度感光层的感光度，所述中曝光度感光层的感光度大于所述高曝光度感光层的感光度。
  16. 根据权利要求10-15中任一所述的控制装置，其特征在于，所述装置还包括：
    控制模块，用于对所述像素单元阵列，调整各感光像素单元中的中曝光像素的占比后，控制所述像素单元阵列输出原始像素信息；
    计算模块，用于根据同一感光像素单元中至少两曝光像素输出的原始像素信息，计算得到各感光像素单元的合并像素信息；
    成像模块，用于根据所述合并像素信息进行成像。
  17. 根据权利要求10-16中任一所述的控制装置，其特征在于，所述装置还包括：
    第一逆光场景确定模块，用于根据拍摄的预览图像的直方图，确定当前拍摄环境属于逆光场景。
  18. 根据权利要求10-16中任一所述的控制装置，其特征在于，所述装置还包括：
    第二逆光场景确定模块，用于根据所述像素单元阵列测量得到的环境亮度值，确定成像对象的亮度值以及背景的亮度值，以及根据所述成像对象的亮度值和所述背景的亮度值，确定当前拍摄环境属于逆光场景。
  19. 一种电子设备，其特征在于，包括多个感光像素单元组成的像素单元阵列，每一感光像素单元包括至少两曝光像素中，所述至少两曝光像素中包括至少一中曝光像素，还包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时，实现如权利要求1-9中任一所述的控制方法。
  20. 一种非临时性计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-9中任一所述的控制方法。
PCT/CN2019/090628 2018-08-13 2019-06-11 控制方法、装置、电子设备和计算机可读存储介质 WO2020034739A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP19849429.6A EP3836532A4 (en) 2018-08-13 2019-06-11 CONTROL PROCESS AND APPARATUS, ELECTRONIC DEVICE, AND COMPUTER-READABLE STORAGE MEDIA
US17/173,762 US11601600B2 (en) 2018-08-13 2021-02-11 Control method and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810915437.6 2018-08-13
CN201810915437.6A CN109005346B (zh) 2018-08-13 2018-08-13 控制方法、装置、电子设备和计算机可读存储介质

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/173,762 Continuation US11601600B2 (en) 2018-08-13 2021-02-11 Control method and electronic device

Publications (1)

Publication Number Publication Date
WO2020034739A1 true WO2020034739A1 (zh) 2020-02-20

Family

ID=64595772

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/090628 WO2020034739A1 (zh) 2018-08-13 2019-06-11 控制方法、装置、电子设备和计算机可读存储介质

Country Status (4)

Country Link
US (1) US11601600B2 (zh)
EP (1) EP3836532A4 (zh)
CN (1) CN109005346B (zh)
WO (1) WO2020034739A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109005346B (zh) * 2018-08-13 2020-04-03 Oppo广东移动通信有限公司 控制方法、装置、电子设备和计算机可读存储介质
CN110602380B (zh) * 2019-08-15 2022-11-04 深圳壹账通智能科技有限公司 基于环境光线检测的视频拍摄方法、装置、设备及介质
CN111479072B (zh) * 2020-04-14 2021-12-17 深圳市道通智能航空技术股份有限公司 高动态范围图像合成方法、装置、图像处理芯片及航拍相机
CN112492227B (zh) * 2020-12-15 2022-02-08 维沃移动通信有限公司 曝光方法、摄像模组和电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090091645A1 (en) * 2007-10-03 2009-04-09 Nokia Corporation Multi-exposure pattern for enhancing dynamic range of images
CN105578065A (zh) * 2015-12-18 2016-05-11 广东欧珀移动通信有限公司 高动态范围图像的生成方法、拍照装置和终端
CN108200354A (zh) * 2018-03-06 2018-06-22 广东欧珀移动通信有限公司 控制方法及装置、成像设备、计算机设备及可读存储介质
CN109005346A (zh) * 2018-08-13 2018-12-14 Oppo广东移动通信有限公司 控制方法、装置、电子设备和计算机可读存储介质

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4689620B2 (ja) * 2004-11-02 2011-05-25 パナソニック株式会社 イメージセンサ
CN101472076B (zh) * 2007-12-28 2010-09-29 鸿富锦精密工业（深圳）有限公司 影像拍摄装置及其拍摄控制方法
KR101417816B1 (ko) * 2008-03-06 2014-07-09 삼성전자주식회사 디지털 이미지 촬영 장치, 상기 장치의 노출 제어 방법,디지털 이미지 촬영 방법 및 상기 디지털 이미지 촬영방법을 위한 프로그램을 기록한 컴퓨터로 읽을 수 있는매체
TWI387332B (zh) * 2009-08-26 2013-02-21 Altek Corp A method of backlighting
JP5521721B2 (ja) * 2009-08-28 2014-06-18 ソニー株式会社 撮像素子およびカメラシステム
KR101575803B1 (ko) * 2010-01-15 2015-12-09 삼성전자 주식회사 저조도 환경에서의 고감도 영상 생성 방법 및 그 장치
CN102196182A (zh) * 2010-03-09 2011-09-21 株式会社理光 逆光检测设备及逆光检测方法
KR20150033192A (ko) * 2013-09-23 2015-04-01 삼성전자주식회사 리드아웃 모드 변경 가능한 디지털 촬영 장치 및 그 제어 방법
KR102149187B1 (ko) * 2014-02-21 2020-08-28 삼성전자주식회사 전자 장치와, 그의 제어 방법
US9888198B2 (en) * 2014-06-03 2018-02-06 Semiconductor Components Industries, Llc Imaging systems having image sensor pixel arrays with sub-pixel resolution capabilities
CN104104886B (zh) * 2014-07-24 2016-07-06 努比亚技术有限公司 过曝拍摄方法及装置
US10141354B2 (en) * 2014-10-23 2018-11-27 Panasonic Intellectual Property Management Co., Ltd. Imaging device and image acquisition device
CN105592270B (zh) 2015-12-18 2018-02-06 广东欧珀移动通信有限公司 图像亮度补偿方法、装置及终端设备
CN105611185B (zh) 2015-12-18 2017-10-31 广东欧珀移动通信有限公司 图像生成方法、装置及终端设备
WO2018105474A1 (ja) * 2016-12-08 2018-06-14 パナソニックＩｐマネジメント株式会社 固体撮像装置および撮像装置
CN107463052B (zh) * 2017-08-30 2020-08-11 北京小米移动软件有限公司 拍摄曝光方法及装置
CN108322669B (zh) * 2018-03-06 2021-03-23 Oppo广东移动通信有限公司 图像获取方法及装置、成像装置和可读存储介质
CN112119502A (zh) * 2018-05-18 2020-12-22 索尼半导体解决方案公司 成像元件、电子设备和成像元件的驱动方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090091645A1 (en) * 2007-10-03 2009-04-09 Nokia Corporation Multi-exposure pattern for enhancing dynamic range of images
CN105578065A (zh) * 2015-12-18 2016-05-11 广东欧珀移动通信有限公司 高动态范围图像的生成方法、拍照装置和终端
CN108200354A (zh) * 2018-03-06 2018-06-22 广东欧珀移动通信有限公司 控制方法及装置、成像设备、计算机设备及可读存储介质
CN109005346A (zh) * 2018-08-13 2018-12-14 Oppo广东移动通信有限公司 控制方法、装置、电子设备和计算机可读存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3836532A4 *

Also Published As

Publication number Publication date
EP3836532A1 (en) 2021-06-16
CN109005346B (zh) 2020-04-03
EP3836532A4 (en) 2021-10-13
US11601600B2 (en) 2023-03-07
CN109005346A (zh) 2018-12-14
US20210168273A1 (en) 2021-06-03

Similar Documents

Publication Publication Date Title
WO2020034737A1 (zh) 成像控制方法、装置、电子设备以及计算机可读存储介质
US10630906B2 (en) Imaging control method, electronic device and computer readable storage medium
CN108322669B (zh) 图像获取方法及装置、成像装置和可读存储介质
JP6911202B2 (ja) 撮像制御方法および撮像装置
CN109005364B (zh) 成像控制方法、装置、电子设备以及计算机可读存储介质
EP3609177B1 (en) Control method, control apparatus, imaging device, and electronic device
CN109788207B (zh) 图像合成方法、装置、电子设备及可读存储介质
WO2020029732A1 (zh) 全景拍摄方法、装置和成像设备
WO2020057199A1 (zh) 成像方法、装置和电子设备
WO2020038072A1 (zh) 曝光控制方法、装置和电子设备
WO2020034701A1 (zh) 成像控制方法、装置、电子设备以及可读存储介质
WO2020034702A1 (zh) 控制方法、装置、电子设备和计算机可读存储介质
CN108632537B (zh) 控制方法及装置、成像设备、计算机设备及可读存储介质
CN109040607B (zh) 成像控制方法、装置、电子设备和计算机可读存储介质
WO2020034739A1 (zh) 控制方法、装置、电子设备和计算机可读存储介质
CN109005369B (zh) 曝光控制方法、装置、电子设备以及计算机可读存储介质
WO2020029679A1 (zh) 控制方法、装置、成像设备、电子设备及可读存储介质
CN109756680B (zh) 图像合成方法、装置、电子设备及可读存储介质
CN108900785A (zh) 曝光控制方法、装置和电子设备
CN116416122A (zh) 图像处理方法及其相关设备
CN109005363B (zh) 成像控制方法、装置、电子设备以及存储介质
CN110276730B (zh) 图像处理方法、装置、电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19849429

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019849429

Country of ref document: EP

Effective date: 20210311