WO2016202073A1

WO2016202073A1 - Image processing method and apparatus

Info

Publication number: WO2016202073A1
Application number: PCT/CN2016/079277
Authority: WO
Inventors: 李振华; 李礼
Original assignee: 乐视控股（北京）有限公司; 乐视移动智能信息技术（北京）有限公司
Priority date: 2015-06-19
Filing date: 2016-04-14
Publication date: 2016-12-22
Also published as: CN105991939A

Abstract

An image processing method and apparatus. The method comprises: respectively determining, according to brightness statistics of the multiple sub-areas in a framed area, an object-scene hierarchies of the sub-areas, the brightness statistics of the multiple sub-areas comprising a correspondence between a brightness value, the number of exposed lines, and a sensitivity value that correspond to each sub-area; determining the number of times of exposures and a current value corresponding to each exposure according to the object-scene hierarchies of the sub-areas; carrying out multiple times of exposures according to the determined number of times of exposures and the determined current value corresponding to each exposure, to obtain multiple pre-processed images matching the object-scene hierarchies; and synthesizing the multiple pre-processed images according to the object-scene hierarchies of the multiple sub-areas to obtain a target image. The embodiments of the present invention improve the definition and resolution of the entire target image, making the entire target image more vivid and more enjoyable.

Description

Image processing method and device

Technical field

The embodiments of the present application relate to the field of image technologies, and in particular, to a method and an apparatus for image processing.

Background technique

With the development of terminal technology, the camera function has become a basic configuration of a terminal, such as a mobile phone, a tablet computer or a smart wearable device, and is no longer limited to use in a camera or a video camera. More and more users choose to use the terminal equipment to take pictures, which brings great fun and convenience to people's life and work.

In order to meet the needs of the user's night shooting, an LED flash is usually set on the terminal device, and the LED flash is used to emit light and illuminate the object, thereby taking a photo with sufficient brightness. However, when shooting at night, when the scene level of the scene is relatively complicated, even if the LED flash is used, the scene behind the object to be photographed is still dark (dark), unclear, and the scene cannot be best presented.

It can be seen that the problem to be solved by those skilled in the art is how to improve the image quality at night shooting, so that the scene is perfectly presented.

Summary of the invention

The embodiment of the present application provides a method and a device for image processing, so as to solve the problem that the image quality is poor at night shooting, and the scene cannot obtain the best presentation.

An embodiment of the present application provides a method for image processing, including:

Determining a scene scene level of each sub-area according to brightness statistics of the plurality of sub-areas in the framing area; wherein the brightness statistics of the plurality of sub-areas include: brightness values, exposure lines, and sensitivities corresponding to the respective sub-areas Correspondence between values;

Determining the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area;

Multiple exposures based on the determined number of exposures and the current value corresponding to each exposure a plurality of preprocessed pictures matching the scene scene level;

Synthesizing the plurality of preprocessed pictures according to a scene scene hierarchy of a plurality of sub-areas to obtain a target picture

An embodiment of the present application provides an apparatus for image processing, including:

The level determining module is configured to determine, according to the brightness statistics of the plurality of sub-areas in the framing area, the scene scene level of each of the sub-areas, wherein the brightness statistics of the plurality of sub-areas include: brightness values corresponding to the respective sub-areas, Correspondence between the number of exposure lines and the sensitivity value;

The exposure determining module is configured to determine an exposure number and a current value corresponding to each exposure according to the determined scene scene level of each sub-area;

The pre-processing image acquisition module is configured to perform multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, to obtain a plurality of pre-processed images that match the scene scene level;

And a synthesizing module configured to synthesize the plurality of pre-processed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture.

The embodiment of the present application also provides a computer readable recording medium on which a program for executing the above method is recorded.

The embodiment of the present invention provides a method and an apparatus for image processing, which can respectively determine a scene scene level of a plurality of sub-areas in a framing area according to the brightness statistical information, and then determine the number of exposures and each time according to the determined scene scene level of the plurality of sub-areas. The current value corresponding to the exposure is subjected to multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, and multiple pre-processed pictures matching the scene scene level are obtained, and finally the scene scenes according to the plurality of sub-areas are obtained. Leveling the plurality of preprocessed pictures to obtain a target picture. It can be seen that, in the embodiment of the present application, multiple exposure shots can be performed according to the scene level of the scene in each sub-area in the entire framing area, so that each sub-area in the entire framing area obtains the required exposure value. Appropriate brightness, finally extracting the picture of the best brightness value corresponding to each sub-area from the pre-processed picture obtained by each exposure shooting, and obtaining the target picture, ensuring the image of each part in the captured target picture. It is clear that the clarity and resolution of the entire target image are improved, making the entire target image more vivid and more enjoyable.

DRAWINGS

1 is a flow chart showing the steps of a method for image processing in Embodiment 1 of the present application;

2 is a flow chart showing the steps of a method for image processing in Embodiment 2 of the present application;

3 is a flow chart showing the steps of a shooting process in Embodiment 3 of the present application;

4 is a schematic diagram of a framing area division in Embodiment 3 of the present application;

5 is a structural block diagram of an apparatus for image processing in Embodiment 4 of the present application;

FIG. 6 is a structural block diagram of an apparatus for image processing according to Embodiment 5 of the present application.

detailed description

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present application, and other drawings can be obtained according to the drawings without any creative work for those skilled in the art.

Embodiment 1

Referring to FIG. 1, a flow chart of steps of a method for image processing in Embodiment 1 of the present application is shown. In this embodiment, the method for image processing includes:

Step 102: Determine a scene scene level of each sub-area according to brightness statistical information of the plurality of sub-areas in the framing area.

In this embodiment, the framing area may be determined according to the boundary condition of the scene in the field of view of the lens (camera), and then the framing area is divided into a plurality of sub-areas according to a certain standard. It should be apparent to those skilled in the art that the framing area can be divided in any suitable manner. For example, according to the principle of division, the framing area is equally divided into 3x3 sub-areas, or 4x4 sub-areas, or 9x9 sub-areas, and the like. For another example, the framing area may be divided into a plurality of sub-areas by using a preset plurality of horizontal and vertical coordinate values (Xi, Yj) as an origin, wherein i≥1, j≥1.

In this embodiment, the brightness statistics of the plurality of sub-areas include, but are not limited to, a correspondence between a brightness value (luma), an exposure line number (linecnt), and a sensitivity value (gain) corresponding to each sub-area. .

Generally, the brightness information of a photo can be represented by a brightness value, for example, the greater the brightness value, the photo The brighter the film, the darker the photo. The brightness value can be adjusted by the number of exposure lines and/or the sensitivity. Generally, the brightness value is proportional to the number of exposure lines and the sensitivity value, that is, the number of exposure lines and/or the sensitivity value increases. Then the brightness value increases. Further, the change curve (trend, amplitude) between the brightness value and the exposure line number and/or the sensitivity value may indirectly reflect the scene scene level, for example:

1. If in the current sub-area, the brightness value changes immediately with the change of the sensitivity value (for example, the sensitivity value is increased by 1 time, the brightness value is also increased by 1 time), that is, the brightness value varies with the sensitivity value. Larger (strongly changing, the slope of the curve of brightness and sensitivity is large), it can be determined that the current sub-area is the place that can be illuminated by the flash, that is, the close-up.

2. If the brightness value does not change substantially when the sensitivity value changes in the current sub-area (the slope of the curve of brightness and sensitivity is basically 0), it can be determined that the current sub-area is not illuminated by the flash, that is, Vision.

3. If the brightness value changes slowly with the change of the sensitivity value in the current sub-area (for example, the sensitivity value is increased by 1 time, the brightness value is only increased by 0.2 times), that is, the brightness value changes with the sensitivity value. Small (smooth change, small slope of brightness and sensitivity curve), you can determine that the current sub-area is illuminable by the flash but the illumination is not strong (lighter, darker), that is, close to and far view Medium shot between.

Similarly, the curve (trend, amplitude) between the brightness value and the number of exposure lines can also indirectly reflect the scene scene level, for example, if the brightness value of the current sub-area changes greatly with the number of exposure lines, then The current sub-area is a close-up; if the brightness value of the current sub-area does not change with the change of the number of exposure lines (or the change is small), the current sub-area is a distant view; if the brightness value of the current sub-area changes with the number of exposure lines Slowly changing, the current sub-area is medium.

It can be seen from the above that in the embodiment, the scene scene level of each sub-area can be separately determined according to the brightness statistical information of the plurality of sub-areas in the framing area. Of course, it should be understood by those skilled in the art that in this embodiment, the scene scene level is not limited to the above-mentioned scenes of the far, middle, and near levels. The appropriate scene scene level can be determined according to the preset scene scene level determination rule and the brightness statistical information of each sub-area.

Step 104: Determine the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area.

In this embodiment, in order to ensure the brightness requirements of each scene scene level, different current values may be selected for exposure. For example, if it is determined that the plurality of sub-regions in the framing area correspond to three scene scene levels (far, medium, and near) respectively, at least three exposure processes may be performed, and: the corresponding selected current value may be a vista with the first exposure. The first current value adapted to the level; the corresponding current value selected in the second exposure may be a second current value adapted to the middle level; the corresponding selected current value in the third exposure may be adapted to the close-range level The third current value.

Step 106: Perform multiple exposures according to the determined number of exposures and the current value corresponding to each exposure to obtain a plurality of pre-processed pictures that match the scene scene level.

Step 108: Synthesize the plurality of pre-processed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture.

In summary, an image processing method according to an embodiment of the present application may separately determine a scene scene level of each sub-area according to brightness statistical information of a plurality of sub-areas in the framing area, and then according to the determined sub-areas The scene scene level determines the number of exposures and the current value corresponding to each exposure, and performs multiple exposures according to the determined number of exposures and the current value corresponding to each exposure to obtain a plurality of preprocessed pictures matching the scene scene level. Finally, the plurality of pre-processed pictures are synthesized according to the scene scene level of the plurality of sub-areas to obtain a target picture. It can be seen that, in the application embodiment, multiple exposure shots can be performed according to the scene level of the scene in each sub-area in the entire framing area, so that each sub-area in the entire framing area obtains the required exposure value. Appropriate brightness, finally extracting the picture of the best brightness value corresponding to each sub-area from the pre-processed picture obtained by each exposure shooting, and obtaining the target picture, ensuring the image of each part in the captured target picture. It is clear that the clarity and resolution of the entire target image are improved, making the entire target image more vivid and more enjoyable.

Embodiment 2

Referring to FIG. 2, a flow chart of steps of a method for image processing in Embodiment 2 of the present application is shown. In this embodiment, the method of image processing may be implemented by, but not limited to, by a mobile terminal, for example, by a setting module/component provided in the mobile terminal, or by setting in the mobile terminal. The application is implemented, or alternatively, it can be realized by a camera/camera such as a camera.

The method for image processing may include:

Step 202: The mobile terminal separately calculates brightness statistics according to multiple sub-areas in the framing area. Determine the scene scene hierarchy for each sub-area.

In this embodiment, the brightness statistics of the plurality of sub-areas include, but are not limited to, a correspondence between a brightness value, an exposure line number, and a sensitivity value corresponding to each sub-area.

Preferably, the step 202 may include the following sub-steps:

Sub-step 2022, the mobile terminal determines the ratio of the brightness value and the exposure line number and/or the sensitivity value under each sub-area according to the correspondence between the brightness value, the exposure line number and the sensitivity value under each sub-area. .

In the present embodiment, for convenience of description, a feasible manner can express the correspondence between the luminance value, the number of exposure lines, and the sensitivity value as follows: luma=k1·linecnt+k2·gain, where k1 And k2 can be any suitable value, which is not limited in this embodiment.

It should be noted that the values of k1 and/or k2 corresponding to each sub-area are not completely the same. For example, k1 and k2 corresponding to sub-area 1 may be 10, and k1 corresponding to sub-area 2 may be 0.5, k2 may Is 0.3. Where k1 can be used to represent the ratio result between the luminance value and the number of exposure lines; k2 can be used to represent the ratio result between the luminance value and the sensitivity value. The result of the ratio between the brightness value and the number of exposure lines, and/or the ratio between the brightness value and the sensitivity value may be used to determine a scene scene level of the sub-area, specifically referring to the following sub-steps:

Sub-step 2024, the mobile terminal compares the ratio result with a preset scene scene hierarchy criterion to determine a scene scene level of each sub-area.

For example, taking the ratio between the luminance value and the sensitivity value as an example, when the ratio (k2) between the luminance value and the sensitivity value is 10, it can be determined that the scene scene level of the current sub-region is the medium scene, when When the ratio (k2) between the brightness value and the sensitivity value is 1, it can be determined that the scene scene level of the current sub-area is the medium scene, and when the ratio (k2) between the brightness value and the sensitivity value is 0.1, it can be determined. The scene scene level of the current sub-area is a distant view. Of course, the correspondence between the above ratio and the scene scene level is merely exemplary and should not be construed as limiting the application.

In addition, it should be understood by those skilled in the art that the scene scene level can also be determined according to the ratio between the brightness value and the number of exposure lines, and details are not described herein again.

Step 204: The mobile terminal determines the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area.

For example, taking ten sub-areas as an example for description, as described in the first embodiment, According to a certain standard, the framing area is divided into a plurality of sub-areas, for example, the framing area is divided into ten sub-areas; further, according to the brightness statistics of the ten sub-areas, the scene scene level of the ten sub-areas can be determined as follows : The scene scene level of the sub-area numbered 01-03 is the close-up scene, the scene scene level of the sub-area numbered 04-08 is the medium scene, and the scene scene level of the sub-area numbered 09-10 is the distant view. According to the determined three scene scene levels (distance, medium, and close-up), three exposures can be selected (that is, the number of exposures is determined to be 3 times). Wherein, the exposure current selected by the first exposure may be a first current matched to the close-up, the exposure current selected by the second exposure may be a second current matching the medium scene, and the exposure current selected by the third exposure may be It is the third current that matches the vision.

Step 206: The mobile terminal performs multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, to obtain a plurality of preprocessed pictures that match the scene scene level.

As described above, the first current, the second current, and the third current may be used to perform three exposures, respectively, to sequentially obtain a pre-processed picture matching the close-up shot using the first current for exposure shooting, and using the second current for exposure shooting. The pre-processed picture 2 matching the medium scene, and the pre-processed picture 3 matched with the distant view using the third current for exposure shooting.

Step 208: The mobile terminal synthesizes the plurality of pre-processed pictures according to the scene scene level of the plurality of sub-areas to obtain a target picture.

In this embodiment, preferably, the foregoing step 208 may include the following sub-steps:

Sub-step 2802, the mobile terminal selects the matched pre-processed picture according to the scene level corresponding to each sub-area, and extracts the sub-picture corresponding to each sub-area from the matched pre-processed picture.

It should be noted that when the sub-pictures corresponding to the respective sub-areas are extracted in the matched pre-processed picture, the 01 sub-area is taken as an example for description. One feasible way may be as follows: First, select the 01 sub-area (close-up view) Corresponding pre-process picture 1 (pre-processed picture matching the close-up shot using the first current for exposure shooting); then, determining the position of the 01 sub-area in the pre-processed picture 1 (01 in the pre-processed picture) 'Sub-region>; Finally, the picture of the 01' sub-area in the pre-process picture 1 is intercepted as the sub-picture corresponding to the 01 sub-area. The sub-pictures corresponding to the respective sub-areas can be obtained sequentially (or asynchronously) in the above manner.

In this embodiment, the 01-03 sub-area needs to be extracted from the corresponding pre-process picture 1 The sub-picture and the 04-08 sub-area need to be extracted from the corresponding pre-processed picture 2 to obtain the corresponding sub-picture, and the 09-10 sub-area needs to extract the corresponding sub-picture from the corresponding pre-processed picture 3.

Sub-step 2084, the mobile terminal synthesizes the sub-pictures corresponding to each of the extracted sub-regions to obtain the target picture.

As described above, the sub-pictures 01-03 corresponding to the 01-03 sub-areas may be sequentially extracted from the pre-processed picture 1, and the sub-pictures 04- corresponding to the 04-08 sub-areas are sequentially extracted from the pre-processed picture 2. 08. The sub-pictures 09-10 corresponding to the 09-10 sub-areas are sequentially extracted from the pre-processed picture 3; then, the sub-pictures 01-10 are combined in the order of the ten sub-areas described above to obtain the target picture.

In a preferred embodiment of the embodiment, the brightness statistics of the plurality of sub-areas in the framing area may be determined by the following steps:

In the first step, the mobile terminal adjusts the sensitivity value and/or the number of exposure lines once according to the first setting rule.

One skilled in the art can use any suitable rule to adjust the sensitivity value and/or the number of exposure lines.

For example, preferably, the sensitivity value and/or the number of exposure lines can be adjusted by one of the following possible ways:

When the sensitivity value is less than or equal to the maximum threshold, the mobile terminal sequentially increases the magnitude of the sensitivity value according to the first set step size; and, when the sensitivity value is equal to the maximum threshold, sequentially increases the number of exposure lines according to the second set step size the size of;

and / or,

When the sensitivity value is greater than or equal to the minimum threshold, the mobile terminal sequentially decreases the magnitude of the sensitivity value according to the third set step size; and, when the sensitivity value is equal to the minimum threshold, sequentially decreases the exposure according to the fourth set step size The size of the number of rows.

It should be noted that, the first setting step, the second setting step, the third setting step, and the fourth setting step may select any appropriate value according to actual conditions, and the first The set step size, the second set step size, the third set step size, and the fourth set step size may be the same, or may be freely selected according to actual conditions. Taking the first set step as an example, the first set step can be used as the first set step with a 0.1 times reference value (a preset sensitivity value or a corresponding sensitivity value at the pre-flash). Adjustment of the degree.

Further preferably, the manner of adjusting with the reference value may be as follows:

The mobile terminal adjusts the sensitivity value and/or the number of exposure lines at least once by using the first sensitivity value obtained in advance and/or the determined first exposure line number as the adjustment initial value.

The first sensitivity value may be an adjustment initial value (reference value) corresponding to gain, and the first exposure line number may be an adjustment initial value (reference value) corresponding to the linecnt. The adjustment of the sensitivity value and/or the number of exposure lines is performed by using the first sensitivity value and/or the first exposure line number as an adjustment initial value.

Preferably, in this embodiment, a feasible manner of obtaining the first sensitivity value and/or the first exposure line number may be as follows: when the flash terminal is pre-flashed, the mobile terminal records that the pre-flash value satisfies the preset. The sensitivity value and/or the number of exposure lines corresponding to the standard brightness value; and determining the corresponding sensitivity value and/or the number of exposure lines when the pre-brightness value satisfies the preset standard brightness value as the number A sensitivity value and/or a number of first exposure lines.

In the second step, the mobile terminal separately records the adjustment results of each sub-area after each adjustment, and obtains multiple statistical results.

In this embodiment, each of the statistical results of each sub-area includes: a sensitivity value, an exposure line number, and a brightness value corresponding to each sub-area after each adjustment.

In the third step, the mobile terminal determines the brightness statistics of each sub-area according to the average of the plurality of statistical results corresponding to each sub-area.

In the present embodiment, since the adjustment of the sensitivity value and/or the number of exposure lines is performed a plurality of times, each sub-area corresponds to one statistical result for each adjustment. For example, if three adjustments are made, the 01-10 sub-regions each have three statistical results. In order to improve the accuracy of the determination, for each sub-region, the average of the plurality of statistical results corresponding to each sub-region may be used as the luminance statistical information corresponding to each sub-region.

In another preferred embodiment of the embodiment, the method may further include the following step 210. The step 210 may be performed, but not limited to, before the step 202 above.

Step 210: The mobile terminal divides the framing area determined by the lens selection into a plurality of sub-areas according to a preset division criterion.

In summary, an image processing method according to an embodiment of the present application may separately determine a scene scene level of each sub-area according to brightness statistical information of a plurality of sub-areas in the framing area, Then, according to the determined scene scene level of each sub-area, the number of exposures and the current value corresponding to each exposure are determined, and multiple exposures are performed according to the determined number of exposures and the current value corresponding to each exposure, and the scene level is obtained. Matching a plurality of pre-processed pictures, and finally synthesizing the plurality of pre-processed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture. It can be seen that, in the embodiment of the present application, multiple exposure shots can be performed according to the scene level of the scene in each sub-area in the entire framing area, so that each sub-area in the entire framing area obtains the required exposure value. Appropriate brightness, finally extracting the picture of the best brightness value corresponding to each sub-area from the pre-processed picture obtained by each exposure shooting, and obtaining the target picture, ensuring the image of each part in the captured target picture. It is clear that the clarity and resolution of the entire target image are improved, making the entire target image more vivid and more enjoyable.

Embodiment 3

In the embodiment, the method for image processing is described in detail by taking a specific processing flow of one shooting process as an example. Referring to FIG. 3, a flow chart of steps in a shooting process in Embodiment 3 of the present application is shown. In this embodiment, the steps of the shooting process may be as follows:

In step 302, the framing area in the lens is divided into 4×4 sub-areas.

Referring to FIG. 4, a schematic diagram of a framing area division in Embodiment 3 of the present application is shown. In the present embodiment, preferably, the viewfinder area may be divided into 4x4 sub-areas: sub-areas 001-016.

In step 304, the LED flash is called to perform pre-flash, and the exposure measurement is performed to determine the sensitivity value and the number of exposure lines when the pre-flash value satisfies the preset standard brightness value during the pre-flash process.

In this embodiment, the preset standard brightness value may be a preset standard brightness value (eg, luma1) set in advance, and the current brightness value may be achieved by modifying the sensitivity value (gain) and the exposure line number (linecnt). Preset standard brightness value (luma1). For example, when the current brightness value satisfies luma1, the corresponding sensitivity value and the number of exposure lines can be recorded as gain1 and linecnt1, respectively. Record the correspondence between luma1, gain1 and gain1. For example, luma1=k1·gain1+k2·linecnt1.

Preferably, the sensitivity value and the number of exposure lines can be modified by one of the following possible ways:

In the present embodiment, the adjustment of the luminance value and the number of exposure lines can be performed based on the sensitivity value and the number of exposure lines recorded in a preset standard table index table. As shown in Table 1, the implementation of the present application is shown. A schematic diagram of a preset standard table index table in Example 3:

Table 1

Preferably, the values as shown in Table 1 can be preferentially combined (gain and linecnt recorded in Table 1) to stabilize the brightness (i.e., the current brightness value and satisfy the preset standard brightness value). For example, the standard brightness value is 100, and when the current brightness value reaches 100, the corresponding sensitivity value and the number of exposure lines are correspondingly selected, for example, the corresponding sensitivity value is 50, and the number of exposure lines is 1000, that is, the following may be Correspondence relationship {100, 50, 1000}. It should be noted that the numerical values in Table 1 and the size (100) of the standard luminance values and the determined correspondence {100, 50, 1000} are merely illustrative. Of course, it should be apparent to those skilled in the art that the sensitivity values and the number of exposure lines can be modified by using the values given in the table index table to improve the efficiency and quickly adjust the brightness values to the preset standard brightness values. However, the modification of the sensitivity value and the number of exposure lines is not limited to the value given in the table index table, and any appropriate value may be selected according to the actual situation to adjust the sensitivity value and the number of exposure lines.

Step 306: Determine a scene scene level of each sub-area according to brightness statistical information of the plurality of sub-areas in the framing area.

As described above, in the pre-flash process, when the current luminance value satisfies the preset standard luminance value, the correspondence between the luminance value and the sensitivity value and the number of exposure lines is: {100, 50, 1000}. Preferably, the sensitivity value and the number of exposure lines can be adjusted with the sensitivity value 50 and the exposure line number 1000 recorded in the correspondence relationship {100, 50, 1000} as initial values.

For example, the sensitivity value can be adjusted by using 0.1 times the initial value (50) as the adjustment step size. In other words, the adjustment can be made according to the following increment/decrement rule: ... 0.8x50←0.9x50←50→1.1x50→1.2 X50.... Record the correspondence between the sensitivity value and the brightness value (corresponding value) during each adjustment. It should be noted that during the sensitivity value adjustment process, the sensitivity value reaches a maximum value (such as the maximum value max=65 described in Table 1 above) or reaches a minimum value (such as the minimum value described in Table 1 above). Before min=35), the number of exposure lines can remain unchanged. However, if sensitivity If the adjustment of the value has reached the maximum or minimum value and the brightness requirement cannot be satisfied, the size of the exposure line can be further adjusted, and the correspondence between the brightness value and the sensitivity value and the number of exposure lines in each adjustment process is recorded. (corresponding to the value). Of course, the sensitivity value and the number of exposure lines can also be adjusted at the same time, which is not limited in this embodiment.

The flow of determining the brightness statistical information of the sub-area 001 and the process of determining the scene scene level of the sub-area 001 according to the determined brightness statistical information are described as an example, and the sensitivity value and/or the number of exposure lines are multiple times. During the adjustment process, the brightness changes in the sub-area 001 after each adjustment are recorded separately. For example, the brightness change after each adjustment can be as follows:

According to the above statistical situation, in the adjustment process, the number of exposure lines (linecnt) is unchanged, that is, in the embodiment, the brightness value is changed by adjusting the sensitivity value, and therefore, This can temporarily ignore the change in the number of exposure lines (linecnt). According to the above statistical request, it can be determined that in the four adjustment processes, the ratio between the luminance value and the sensitivity value is sequentially: 10 times, 9 times, 11 times, and 10 times; preferably, four ratio results can be taken ( The average value (10 times) of 10 times, 9 times, 11 times, and 10 times) is determined as the brightness statistical information of the sub-area 001. Further, the brightness statistical information of the sub-area 001 that can be determined is compared with a preset scene scene division standard, and the scene scene level of the sub-area 001 is determined to be the medium scene (only an example description, which may be based on the actual object scene level) The division criterion determines the scene scene level of the sub-area 001).

It should be understood by those skilled in the art that the process of determining the scene scene level of other sub-areas can refer to the determination process of the scene scene level of the above sub-area 001, and will not be described one by one. For example, the final scene level of the scene can be as follows: close-up: sub-area 005-008; medium-level: sub-area 001-004; distant view: sub-area 009-012; super-distant: sub-area 013-016.

Step 308: Determine the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area.

As described above, in the present embodiment, a total of four scene scene levels are determined, then, preferably, at least four exposures can be selected: the first exposure can correspondingly select a current value of 0.9I that matches the close scene ( I is the standard current value), the second exposure can correspond to the current value of 1.0I matched with the medium scene, and the third exposure can correspond to the current value of 1.5I matched with the foreground. The fourth exposure can correspond to Select the current value of 2.0I that matches the super-distant view. Of course, it should be understood by those skilled in the art that the value of the above current is only an exemplary description, and specifically, the current value may be selected according to actual conditions.

Step 310: Perform multiple exposures according to the determined number of exposures and the current value corresponding to each exposure to obtain a plurality of preprocessed pictures that match the scene scene level.

As described above, in the present embodiment, preferably, four exposures are performed to obtain four pre-processed pictures: pre-processed picture 1 (close-up picture), pre-processed picture 2 (middle view picture), pre-processed picture 3 (distant picture) and pre-processed picture 4 (super-vision picture).

Step 312: Synthesize the plurality of preprocessed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture.

As described above, in this embodiment, the sub-pictures 005-008 corresponding to the sub-areas 005-008 (close-up area) positions can be extracted from the pre-processed picture 1 (close-up picture); In the scene picture), the sub-pictures 001 to 004 corresponding to the positions of the sub-areas 001 to 004 (middle-area area) are extracted; and the positions of the sub-areas 009 to 012 (distant areas) are extracted from the pre-processed picture 3 (distant picture) Sub-pictures 009 to 012; sub-pictures 013 to 016 corresponding to the positions of the sub-areas 013 to 016 (super-long-view areas) are extracted from the pre-processed picture 4 (super-far picture).

The extracted sub-pictures 001 to 016 are combined to obtain a composite picture, and the synthesized picture is used as a final target picture.

In summary, an image processing method according to an embodiment of the present application may separately determine a scene scene level of a plurality of sub-areas in the framing area according to the brightness statistical information, and then determine according to the determined scene scene level of the plurality of sub-areas. The number of exposures and the current value corresponding to each exposure are subjected to multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, and multiple pre-processed pictures matching the scene scene level are obtained, and finally The scene scene level of each sub-area synthesizes the plurality of pre-processed pictures to obtain a target picture. It can be seen that, in the embodiment of the present application, multiple exposures may be performed according to the scene level of the scene in each sub-area in the entire framing area. Shooting, so that each sub-area in the entire framing area obtains the required exposure value to achieve the appropriate brightness, and finally extracts the optimal brightness value corresponding to each sub-area from the pre-processed image obtained by each exposure shot. The image is synthesized to obtain the target image, which ensures that the images of the various parts in the captured target image are clear, which improves the clarity and resolution of the entire target image, making the whole target image more vivid and more enjoyable. value.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present application is not limited by the described action sequence, because In accordance with the present application, certain steps may be performed in other sequences or concurrently. Secondly, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present application.

Embodiment 4

Based on the same inventive concept as the above method embodiment, referring to FIG. 5, a block diagram of a device for image processing in Embodiment 4 of the present application is shown. In this embodiment, the apparatus for image processing includes:

The level determining module 502 is configured to determine brightness level information of the plurality of sub-areas in the framing area to determine the scene scene level of each sub-area.

The brightness statistical information of the plurality of sub-areas includes: a correspondence relationship between a brightness value, an exposure line number, and a sensitivity value corresponding to each sub-area.

The exposure determination module 504 is configured to determine the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area.

The pre-processing picture obtaining module 506 is configured to perform multiple exposures according to the determined number of exposures and the current value corresponding to each exposure to obtain a plurality of pre-processed pictures that match the scene scene level.

The synthesizing module 508 is configured to synthesize the plurality of pre-processed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture.

In summary, an image processing method according to an embodiment of the present application may separately determine a scene scene level of a plurality of sub-areas in the framing area according to the brightness statistical information, and then determine according to the determined scene scene level of the plurality of sub-areas. The number of exposures and the current value corresponding to each exposure are subjected to multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, and the scene is obtained. The plurality of pre-processed pictures matched by the scene level are finally combined with the plurality of pre-processed pictures according to the scene scene level of the plurality of sub-areas to obtain the target picture. It can be seen that, in the application embodiment, multiple exposure shots can be performed according to the scene level of the scene in each sub-area in the entire framing area, so that each sub-area in the entire framing area obtains the required exposure value. Appropriate brightness, finally extracting the picture of the best brightness value corresponding to each sub-area from the pre-processed picture obtained by each exposure shooting, and obtaining the target picture, ensuring the image of each part in the captured target picture. It is clear that the clarity and resolution of the entire target image are improved, making the entire target image more vivid and more enjoyable.

Embodiment 5

Referring to FIG. 6, a structural block diagram of an apparatus for image processing in Embodiment 5 of the present application is shown. In this embodiment, the apparatus for image processing may be, but is not limited to, being disposed in a mobile terminal. For example, it may also be disposed in a device for taking a picture, such as a camera, a video camera, or the like.

The device for image processing may include:

The level determining module 602 is configured to determine a scene scene level of each sub-area according to brightness statistics of the plurality of sub-areas in the framing area.

In this embodiment, the brightness statistical information of the plurality of sub-areas includes: a correspondence relationship between the brightness value, the number of exposure lines, and the sensitivity value corresponding to each sub-area.

Preferably, the brightness statistics of the plurality of sub-areas within the framing area may be determined by a module that is configured to adjust the sensitivity value and/or the number of exposure lines at least once according to the first setting rule. The statistical result obtaining module is configured to perform statistical recording on the adjustment result of each sub-area for each time, and obtain a plurality of statistical results, wherein each statistical result of each sub-area includes: corresponding to each sub-area after each adjustment is completed Sensitivity value, number of exposure lines, and brightness value. The statistical information determining module is configured to determine brightness statistical information of each sub-area according to an average value of the plurality of statistical results corresponding to each sub-area.

In a preferred embodiment of the present invention, the adjusting module may further include: a first adjusting module configured to sequentially increase the sensitivity value according to the first setting step when the sensitivity value is less than or equal to the maximum threshold ; and, when the sensitivity value is equal to the maximum threshold, the number of exposure lines is sequentially increased according to the second set step. And/or, the second adjusting module is configured to sequentially reduce the magnitude of the sensitivity value according to the third setting step when the sensitivity value is greater than or equal to the minimum threshold; and, in the sensitivity value, etc. At the minimum threshold, the number of exposure lines is sequentially decreased according to the fourth set step.

In another preferred embodiment of the present embodiment, the adjustment module may be configured to use a pre-processed first sensitivity value and/or a determined first exposure line as an adjustment initial value, and a sensitivity value and / or the number of exposure lines is adjusted at least once. Preferably, the first sensitivity value and/or the first exposure line number can be obtained by the following module: the recording module is configured to record, when the flash pre-flashes, the corresponding when the pre-flash value meets the preset standard brightness value Sensitivity value and / or number of exposure lines. The determining module is configured to determine the recorded sensitivity value and/or the number of exposure lines when the pre-brightness value meets the preset standard brightness value as the first sensitivity value and/or the first exposure line number.

In another preferred embodiment of the embodiment, the level determining module 602 may specifically include:

The ratio determining module 6022 is configured to determine the brightness value and the exposure line number and/or the sensitivity value in each sub-area according to the correspondence between the brightness value, the exposure line number, and the sensitivity value under each sub-area. The ratio result.

The comparison module 6024 is configured to compare the ratio result with a preset scene scene hierarchy criterion to determine a scene scene level of each sub-area.

The exposure determination module 604 is configured to determine the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area.

The pre-processing picture obtaining module 606 is configured to perform multiple exposures according to the determined number of exposures and the current value corresponding to each exposure to obtain a plurality of pre-processed pictures that match the scene scene level.

The synthesizing module 608 is configured to synthesize the plurality of pre-processed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture.

In a preferred solution of the embodiment, the synthesizing module may specifically include:

The extraction module 6082 is configured to select a matched pre-processed picture according to a scene level corresponding to each sub-area, and extract a sub-picture corresponding to each sub-area from the matched pre-processed picture.

The synthesizing module 6084 is configured to synthesize the sub-pictures corresponding to each of the extracted sub-regions to obtain the target picture.

In a preferred embodiment of the present embodiment, the apparatus for image processing may further include: a sub-area dividing module, and dividing the framing area determined by the lens selection into multiple according to a preset dividing criterion Sub-area. The sub-area partitioning module may be, but is not limited to, being executed before the level determining module 602.

In summary, an image processing method according to an embodiment of the present application may separately determine a scene scene level of a plurality of sub-areas in the framing area according to the brightness statistical information, and then determine according to the determined scene scene level of the plurality of sub-areas. The number of exposures and the current value corresponding to each exposure are subjected to multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, and multiple pre-processed pictures matching the scene scene level are obtained, and finally The scene scene level of each sub-area synthesizes the plurality of pre-processed pictures to obtain a target picture. It can be seen that, in the application embodiment, multiple exposure shots can be performed according to the scene level of the scene in each sub-area in the entire framing area, so that each sub-area in the entire framing area obtains the required exposure value. Appropriate brightness, finally extracting the picture of the best brightness value corresponding to each sub-area from the pre-processed picture obtained by each exposure shooting, and obtaining the target picture, ensuring the image of each part in the captured target picture. It is clear that the clarity and resolution of the entire target image are improved, making the entire target image more vivid and more enjoyable.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

The present application also provides a computer readable recording medium on which a program for executing the above method is recorded.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

Finally, it should be noted that the above embodiments are only used to explain the technical solutions of the present application, and are not limited thereto; although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced by the equivalents. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A method of image processing, comprising:

Determining a scene scene level of each sub-area according to brightness statistics of the plurality of sub-areas in the framing area; wherein the brightness statistics of the plurality of sub-areas include: brightness values, exposure lines, and sensitivities corresponding to the respective sub-areas Correspondence between values;

Determining the number of exposures and the current value corresponding to each exposure according to the determined scene scene level of each sub-area;

Performing multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, and obtaining a plurality of preprocessed pictures matching the scene scene level;

The plurality of pre-processed pictures are combined according to a scene scene level of the plurality of sub-areas to obtain a target picture.
The method according to claim 1, wherein the brightness statistics of the plurality of sub-areas within the framing area are determined by the following steps:

Performing at least one adjustment of the sensitivity value and/or the number of exposure lines according to the first setting rule;

The statistical results of each sub-region after each adjustment are statistically recorded, and a plurality of statistical results are obtained. Among them, each statistical result of each sub-region includes: the sensitivity value corresponding to each sub-region after each adjustment is completed, and the exposure Row number and brightness value;

The luminance statistical information of each sub-region is determined according to an average value of a plurality of statistical results corresponding to each sub-region.
The method according to claim 2, wherein the sensitivity value and/or the number of exposure lines are adjusted at least once according to the first setting rule, including:

When the sensitivity value is less than or equal to the maximum threshold, the magnitude of the sensitivity value is sequentially increased according to the first set step; and, when the sensitivity value is equal to the maximum threshold, the number of exposure lines is sequentially increased according to the second set step. ;

and / or,

When the sensitivity value is greater than or equal to the minimum threshold, the magnitude of the sensitivity value is sequentially decreased according to the third set step; and, when the sensitivity value is equal to the minimum threshold, the number of exposure lines is sequentially decreased according to the fourth set step the size of.
Method according to claim 2 or 3, characterized in that according to the first setting rule Adjust the sensitivity value and/or the number of exposure lines at least once, including:

The first sensitivity value and/or the first exposure line number obtained in advance are used as adjustment initial values, and the sensitivity value and/or the number of exposure lines are adjusted at least once.
The method according to claim 4, wherein the first sensitivity value and/or the first exposure line number are obtained by the following steps:

When the flash pre-flashes, record the corresponding sensitivity value and/or the number of exposure lines when the pre-brightness value satisfies the preset standard brightness value;

The recorded sensitivity value and/or the number of exposure lines when the pre-brightness value satisfies the preset standard brightness value is determined as the first sensitivity value and/or the first exposure line number.
The method according to claim 1, wherein determining the scene scene level of each sub-area according to the brightness statistics of the plurality of sub-areas in the framing area comprises:

Determining, according to the correspondence between the brightness value, the number of exposure lines, and the sensitivity value under each sub-area, a ratio of the brightness value under each sub-area to the exposure line number and/or the sensitivity value;

The ratio result is compared with a preset scene scene hierarchy standard to determine a scene scene level of each sub-area.
The method according to claim 1, wherein the plurality of pre-processed pictures are combined according to a scene scene level of the plurality of sub-areas to obtain a target picture, including:

Selecting a matched pre-processed picture according to a scene level corresponding to each sub-area, and extracting a corresponding sub-picture of each sub-area from the matched pre-processed picture;

The sub-pictures corresponding to each of the extracted sub-regions are combined to obtain the target picture.
The method according to claim 1, wherein before the determining the scene scene level of each sub-area according to the brightness statistics of the plurality of sub-areas in the framing area, the method further comprises:

According to the preset division standard, the framing area determined by the lens selection is divided into a plurality of sub-areas.
An apparatus for image processing, comprising:

a level determining module configured to divide the brightness statistics according to the plurality of sub-areas in the framing area The brightness scene information of each of the sub-areas includes: a correspondence between a brightness value, an exposure line number, and a sensitivity value corresponding to each sub-area;

The exposure determining module is configured to determine an exposure number and a current value corresponding to each exposure according to the determined scene scene level of each sub-area;

The pre-processing image acquisition module is configured to perform multiple exposures according to the determined number of exposures and the current value corresponding to each exposure, to obtain a plurality of pre-processed images that match the scene scene level;

And a synthesizing module configured to synthesize the plurality of pre-processed pictures according to a scene scene level of the plurality of sub-areas to obtain a target picture.
The apparatus according to claim 9, wherein the brightness statistics of the plurality of sub-areas within the framing area are determined by the following module:

The adjustment module is configured to adjust the sensitivity value and/or the number of exposure lines at least once according to the first setting rule;

The statistical result obtaining module is configured to perform statistical recording on the adjustment result of each sub-area for each time, and obtain a plurality of statistical results; wherein each statistical result of each sub-area includes: corresponding to each sub-area after each adjustment is completed Sensitivity value, number of exposure lines, and brightness value;

The statistical information determining module is configured to determine brightness statistical information of each sub-area according to an average value of the plurality of statistical results corresponding to each sub-area.
The apparatus according to claim 10, wherein the adjustment module comprises:

The first adjusting module is configured to sequentially increase the magnitude of the sensitivity value according to the first setting step when the sensitivity value is less than or equal to the maximum threshold; and, when the sensitivity value is equal to the maximum threshold, according to the second setting step Increase the size of the number of exposure lines in turn;

and / or,

The second adjustment module is configured to sequentially reduce the magnitude of the sensitivity value according to the third set step when the sensitivity value is greater than or equal to the minimum threshold; and, when the sensitivity value is equal to the minimum threshold, follow the fourth setting step The length decreases the number of exposure lines in turn.
The apparatus according to claim 10 or 11, wherein the adjustment module is configured to use the first sensitivity value obtained by the pre-processing and/or the determined first exposure line number as an adjustment initial value, and the sensitivity The value and/or the number of exposure lines are adjusted at least once.
The device according to claim 12, wherein the module is obtained by The first sensitivity value and/or the first exposure line number:

a recording module configured to record, when the flash pre-flashes, a corresponding sensitivity value and/or an exposure line number when the pre-brightness value satisfies a preset standard brightness value;

The determining module is configured to determine the recorded sensitivity value and/or the number of exposure lines when the pre-brightness value meets the preset standard brightness value as the first sensitivity value and/or the first exposure line number.
The device according to claim 9, wherein the level determining module comprises:

The ratio determining module is configured to determine, according to the correspondence between the brightness value, the number of exposure lines, and the sensitivity value in each sub-area, respectively, the brightness value under each sub-area and the number of exposure lines and/or the sensitivity value Ratio result

The comparison module is configured to compare the ratio result with a preset scene scene hierarchy standard to determine a scene scene level of each sub-area.
The apparatus according to claim 9, wherein the synthesizing module comprises:

An extraction module is configured to select a matched pre-processed picture according to a scene level corresponding to each sub-area, and extract a corresponding sub-picture of each sub-area from the matched pre-processed picture;

The compositing module is configured to synthesize the sub-pictures corresponding to each of the extracted sub-regions to obtain the target picture.
The device according to claim 9, further comprising:

The sub-area dividing module is configured to: after the layer determining module determines the scene scene level of each sub-area according to the brightness statistical information of the plurality of sub-areas in the framing area, select the framing area determined by the lens according to the preset dividing criterion Divided into multiple sub-areas.
A computer readable recording medium having recorded thereon a program for performing the method of any one of claims 1-8.