CN108320273B - Picture synthesis method and picture synthesis device - Google Patents
Picture synthesis method and picture synthesis device Download PDFInfo
- Publication number
- CN108320273B CN108320273B CN201710029451.1A CN201710029451A CN108320273B CN 108320273 B CN108320273 B CN 108320273B CN 201710029451 A CN201710029451 A CN 201710029451A CN 108320273 B CN108320273 B CN 108320273B
- Authority
- CN
- China
- Prior art keywords
- picture
- short
- integral
- long
- integral picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Abstract
The invention discloses a picture synthesis method and a device, wherein the method comprises the following steps: acquiring a long integral picture and a short integral picture; compressing the long integral picture and the short integral picture respectively to form a long integral compressed picture and a short integral compressed picture; respectively acquiring a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture; generating detail characteristics after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture; acquiring the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined; and synthesizing the long integral picture and the short integral picture according to the detail characteristics, the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined, so that all the detail characteristics of the long integral picture and the short integral picture can be obtained, the dynamic range of the synthesized picture is improved, the realization is easy, the picture noise is reduced, and the signal-to-noise ratio of the synthesized picture is improved.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to an image synthesis method and an image synthesis apparatus.
Background
With the development of image sensors, the requirements on imaging quality are higher and higher, wherein high dynamic range is an important index of imaging quality. The picture synthesis in the related art generally adopts the following two methods to improve the dynamic range of an image:
firstly, a special technology is adopted at an image acquisition end to improve the dynamic range of an image. The method has the defects that the technical means is complex, the improved dynamic range is limited, and the requirements of the market, particularly security monitoring and vehicle-mounted image market, are difficult to achieve.
And secondly, splicing two or three frames of 8-bit low dynamic range picture data into a 16-bit or even higher-bit high dynamic image. The method has the defects that the compressed picture has serious noise and low imaging precision.
Therefore, improvements are needed in the related art.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the art described above. To this end, it is an object of the present invention to propose an image synthesis method that can improve the image dynamic range.
Another object of the present invention is to provide an image synthesizing apparatus.
To achieve the above object, an embodiment of the invention provides a picture synthesis method, which includes the following steps: acquiring a long integral picture and a short integral picture; compressing the long integral picture and the short integral picture respectively to form a long integral compressed picture and a short integral compressed picture; respectively acquiring a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture; generating detail characteristics after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture; acquiring the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined; and synthesizing the long integral picture and the short integral picture according to the detail feature, the feature brightness and the target brightness after the long integral picture and the short integral picture are combined.
According to the picture synthesis method of the embodiment of the invention, the long integral picture and the short integral picture are respectively obtained, respectively acquiring a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture, and generates the detail feature after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture, and obtains the feature brightness and the target brightness after the long integral picture and the short integral picture are combined, then synthesizing the long integral picture and the short integral picture according to the detail characteristic, the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined, thereby obtaining all detail characteristics of the long integral picture and the short integral picture, improving the dynamic range of the synthetic picture, being easy to realize, and moreover, the details of dark places can be acquired, the picture noise is reduced, and the signal-to-noise ratio of the synthesized picture is improved.
To achieve the above object, an embodiment of another aspect of the present invention provides a picture synthesis apparatus, including: the first acquisition module is used for acquiring a long integral picture and a short integral picture; the compression module is connected with the first acquisition module and is used for respectively compressing the long integral picture and the short integral picture to form a long integral compressed picture and a short integral compressed picture; the second obtaining module is connected with the first obtaining module and is used for respectively obtaining a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture; the generating module is respectively connected with the first acquiring module and the second acquiring module, and is used for generating the detail characteristics after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture; the third acquisition module is respectively connected with the first acquisition module, the compression module and the second acquisition module, and is used for acquiring the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined; and the synthesis module is respectively connected with the generation module and the third acquisition module, and is used for synthesizing the long integral picture and the short integral picture according to the detail feature, the feature brightness and the target brightness after the combination of the long integral picture and the short integral picture.
According to the picture synthesis device provided by the embodiment of the invention, the long integral picture and the short integral picture are respectively obtained by the first obtaining module, the first weight value corresponding to the long integral picture and the second weight value corresponding to the short integral picture are respectively obtained by the second obtaining module, the generation module generates the detail characteristic after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture, the third obtaining module obtains the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined, then the synthesis module synthesizes the long integral picture and the short integral picture according to the detail characteristic, the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined, thereby obtaining all detail characteristics of the long integral picture and the short integral picture and improving the dynamic range of the synthesized picture, the method is easy to realize, can acquire details in dark places, reduces the noise of the picture, and improves the signal to noise ratio of the synthesized picture.
Drawings
FIG. 1 is a flow chart of a picture synthesis method according to an embodiment of the present invention;
fig. 2 is a schematic arrangement diagram of image data in a bayer format of a picture synthesis method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating compression curves of a picture synthesis method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a compression curve of a picture synthesis method according to another embodiment of the present invention; and
FIG. 5 is a block diagram of a picture synthesis apparatus according to an embodiment of the present invention.
Reference numerals:
a first obtaining module 10, a compressing module 20, a second obtaining module 30, a generating module 40, a third obtaining module 50 and a synthesizing module 60.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes a picture synthesis method and an image synthesis apparatus according to an embodiment of the present invention with reference to the drawings.
Fig. 1 is a flowchart of a picture synthesis method according to an embodiment of the present invention. As shown in fig. 1, the picture synthesis method includes the following steps:
s10: and acquiring a long integral picture pic _ l and a short integral picture pic _ s.
Specifically, the picture synthesis method according to the embodiment of the present invention may perform picture synthesis based on image data in a bayer format, as shown in fig. 2, where the image data in the bayer format is image data arranged according to BG/GR, where B represents blue among three primary colors, G represents green among the three primary colors, and R represents red among the three primary colors. Moreover, the picture synthesis method of the embodiment of the invention is suitable for synthesizing high-dynamic pictures with two or more frames.
More specifically, taking two frames as an example, a frame of long integral picture pic _ l and a frame of short integral picture pic _ s are obtained first, where the long integral picture pic _ l may represent low brightness details of the picture, and the short integral picture pic _ s may represent high brightness details of the picture, for example, a scene may be exposed for a long time to obtain the long integral picture pic _ l, and the same scene may be exposed for a short time to obtain the short integral picture pic _ s, where a scene corresponding to the long integral picture pic _ l and a scene corresponding to the short integral picture pic _ s are the same scene, and the long exposure may improve details of a dark place of the picture, and the short exposure may show details of a bright place of the picture.
Therefore, all picture details of the picture, namely the highlight details and the low highlight details of the picture, can be reserved through long-time exposure and short-time exposure processing, the picture noise is reduced, and the signal-to-noise ratio is improved.
S20: the long integral picture pic _ l and the short integral picture pic _ s are compressed to form a long integral compressed picture pic _ l1 and a short integral compressed picture pic _ s1, respectively.
In particular, a picture may be compressed by a variety of picture compression algorithms, such as a linear compression algorithm, a logarithmic compression algorithm, or a piecewise linear compression algorithm.
In one embodiment of the present invention, the long integral picture pic _ l and the short integral picture pic _ s may be compressed separately by a piecewise linear compression algorithm. As shown in fig. 3 and 4, after a frame of long-integration picture pic _ l is obtained, the long-integration picture pic _ l is compressed according to the curve shown in fig. 3 to obtain a long-integration compressed picture pic _ l1, and after a frame of short-integration picture pic _ s is obtained, the short-integration picture pic _ s is compressed according to the curve shown in fig. 4 to obtain a short-integration compressed picture pic _ s 1.
S30: a first weight value coef _ l corresponding to the long integral picture pic _ l and a second weight value coef _ s corresponding to the short integral picture pic _ s are respectively obtained.
Specifically, for example, the format of the picture data is 8bit, that is, the luminance information or detail information of the long integral picture pic _ l and the short integral picture pic _ s is represented by a variable having a bit width of 8bit, so that the luminance information or detail information of the picture can be represented by a value in a range of 0 to 255, and the closer the luminance value is to 128, the more detail information the picture contains, and based on this, the first weight value coef _ l corresponding to the long integral picture pic _ l and the second weight value coef _ s corresponding to the short integral picture pic _ s can be obtained.
According to an embodiment of the present invention, a first weight value corresponding to the long integral picture pic _ l and a second weight value corresponding to the short integral picture pic _ s may be obtained through the following formulas:
coef_l＝128-abs(128-y_l) (1)
coef_s＝128-abs(128-y_s) (2)
the image processing method comprises the steps of obtaining a long integral picture, obtaining a short integral picture, and obtaining a first brightness data of the long integral picture and a second brightness data of the short integral picture, wherein coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is a first brightness data of the long integral picture, and y _ s is a second brightness data of the short integral picture.
Specifically, the luminance data of the long integral picture pic _ l is represented by a variable with a bit width of 8bit to obtain first luminance data y _ l, and the luminance data of the short integral picture pic _ s is represented by a variable with a bit width of 8bit to obtain second luminance data y _ s, wherein the first luminance data y _ l and the second luminance data y _ s are both values in the range of 0-255, and the detail information of the local picture with a luminance value of 128 is considered to be the most, so the detail of the weight value of the long integral picture pic _ l, i.e. the first weight value coef _ l, can be calculated according to the above formula (1), i.e. the detail of the weight value of the long integral picture pic _ l, i.e. the first weight value coef _
coef_l＝128-abs(128-y_l) (1)
Moreover, a detail weight value of the short integration picture pic _ s, i.e. a second weight value coef _ s, can be calculated according to the above formula (2)
coef_s＝128-abs(128-y_s) (2)
S40: and generating a detail feature detail after the long integral picture and the short integral picture are combined according to the first weight value coef _ l, the second weight value coef _ s, the long integral picture pic _ l and the short integral picture pic _ s.
According to an embodiment of the present invention, generating the detail feature detail after combining the long integral picture and the short integral picture according to the first weight value coef _ l, the second weight value coef _ s, the long integral picture pic _ l, and the short integral picture pic _ s specifically includes: acquiring first brightness data y _ l of a long integral picture and second brightness data y _ s of a short integral picture; and generating a detail feature detail after the long integral picture and the short integral picture are combined according to the first weight value coef _ l, the second weight value coef _ s, the first brightness data y _ l, the second brightness data y _ s, the long integral picture pic _ l and the short integral picture pic _ s.
According to an embodiment of the present invention, the detail feature after the long integral picture and the short integral picture are combined can be generated by the following formula:
detail is obtained after the long integral picture and the short integral picture are combined, pic _ l is the long integral picture, pic _ s is the short integral picture, coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is first luminance data of the long integral picture, and y _ s is second luminance data of the short integral picture.
Specifically, the luminance data of the long integration picture pic _ l is represented by a variable having a bit width of 8 bits to obtain first luminance data y _ l, and the luminance data of the short integration picture pic _ s is represented by a variable having a bit width of 8 bits to obtain the second luminance data y _ s, since the closer the luminance value is to 128, the more detailed information of the picture is contained, after combining the long integration picture and the short integration picture, by calculating the weight of the first difference value (pic _ l-y _ l) of the long integration picture pic _ l and the first luminance data y _ l after combination, all color and detail information in the long integral picture pic _ l can be acquired, and all color and detail information in the short integral picture pic _ s can be acquired by calculating the weight of the combined second difference value (pic _ s-y _ s) of the short integral picture pic _ s and the second luminance data y _ s. Therefore, the detail feature detail after the long integral picture and the short integral picture are combined can be obtained through the formula (3), namely
S50: and acquiring the characteristic brightness y _ m and the target brightness y _ t after the long integral picture and the short integral picture are combined.
According to an embodiment of the present invention, the combined characteristic luminance and target luminance of the long-integration picture pic _ l and the short-integration picture pic _ s can be obtained through the following formulas:
y _ m is characteristic brightness, y _ t is target brightness, y _ l1 is image brightness after long-integration picture compression, y _ s1 is image brightness after short-integration picture compression, coef _ l is a first weight value corresponding to a long-integration picture, coef _ s is a second weight value corresponding to a short-integration picture, y _ l is first brightness data of the long-integration picture, and y _ s is second brightness data of the short-integration picture.
Specifically, after the long integration picture pic _ l and the short integration picture pic _ s are combined, the first luminance data y _ l of the long integration picture pic _ l is weighted as
The weight of the second luminance data y _ s of the short integration picture pic _ s in the composite picture is
Thus, the characteristic luminance y _ m after the long integration picture pic _ l and the short integration picture pic _ s are combined, that is, the characteristic luminance y _ m can be obtained through the formula (4)
In addition, after the long integral picture pic _ l and the short integral picture pic _ s are combined, the target brightness y _ t after the long integral picture pic _ l and the short integral picture pic _ s are combined can be obtained according to the average value of the image brightness y _ l1 after the long integral picture is compressed and the image brightness y _ s1 after the short integral picture is compressed, namely the target brightness y _ t after the long integral picture pic _ l and the short integral picture pic _ s are combined
S60: and synthesizing the long integral picture pic _ l and the short integral picture pic _ s according to the detail feature detail, the feature brightness y _ m and the target brightness y _ t after the long integral picture and the short integral picture are combined.
According to one embodiment of the present invention, the long integration picture pic _ l and the short integration picture pic _ s may be synthesized by the following formula:
the pic _ hdr is a finally synthesized high-dynamic data picture, detail is a detail feature after a long integral picture and a short integral picture are combined, y _ m is feature brightness, and y _ t is target brightness.
Specifically, when the long integral picture pic _ l and the short integral picture pic _ s are synthesized, the target luminance y _ t after the long integral picture pic _ l and the short integral picture pic _ s are combined can be obtained, and the luminance information includes luminance information in a high luminance state and luminance information in a low luminance state, so that the luminance information can be used as the luminance information of the synthesized picture. And, can pass through
And acquiring the detail information of the synthesized picture. Further, the long integral picture pic _ l and the short integral picture pic _ s may be synthesized by the above equation (6), that is:
in this way, the picture synthesis method according to the embodiment of the present invention synthesizes the high dynamic data picture finally by obtaining the detail features and the luminance features in the long integral picture and the short integral picture, respectively, and combining the detail features and the luminance features in the long integral picture and the short integral picture.
In summary, according to the image synthesis method of the embodiment of the present invention, the long integral image and the short integral image are respectively obtained, the first weight value corresponding to the long integral image and the second weight value corresponding to the short integral image are respectively obtained, the detail feature after the long integral image and the short integral image are combined is generated according to the first weight value, the second weight value, the long integral image and the short integral image, and the feature brightness and the target brightness after the long integral image and the short integral image are combined are obtained, and then the long integral image and the short integral image are synthesized according to the detail feature, the feature brightness and the target brightness after the long integral image and the short integral image are combined, so that all detail features of the long integral image and the short integral image can be basically obtained, the dynamic range of the synthesized image is improved, the implementation is easy, and the detail in a dark place can be obtained, and the image noise is reduced, the signal-to-noise ratio of the synthesized picture is improved.
Fig. 5 is a block schematic diagram of a picture synthesis apparatus according to an embodiment of the present invention. As shown in fig. 5, the picture composition apparatus includes: a first obtaining module 10, a compressing module 20, a second obtaining module 30, a generating module 40, a third obtaining module 50 and a synthesizing module 60.
The first obtaining module 10 is configured to obtain a long integral picture and a short integral picture; the compression module 20 is connected to the first obtaining module 10, and the compression module 20 is configured to compress the long integral picture and the short integral picture respectively to form a long integral compressed picture and a short integral compressed picture; the second obtaining module 30 is connected to the first obtaining module 10, and the second obtaining module 30 is configured to obtain a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture respectively; the generating module 40 is connected to the first acquiring module 10 and the second acquiring module 30, respectively, and the generating module 40 is configured to generate a detail feature after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture; the third obtaining module 50 is respectively connected to the first obtaining module 10, the compressing module 20 and the second obtaining module 30, and the third obtaining module 50 is configured to obtain the feature brightness and the target brightness after the long integral picture and the short integral picture are combined; the synthesis module 60 is connected to the generation module 40 and the third obtaining module 50, respectively, and the synthesis module 60 is configured to synthesize the long-integral picture and the short-integral picture according to the detail feature, the feature brightness, and the target brightness after the combination of the long-integral picture and the short-integral picture.
Specifically, the picture synthesis apparatus according to the embodiment of the present invention may perform picture synthesis based on image data in a bayer format, as shown in fig. 2, where B represents blue among three primary colors, G represents green among the three primary colors, and R represents red among the three primary colors, that is, image data arranged in BG/GR. Moreover, the picture synthesis method of the embodiment of the invention is suitable for synthesizing two or more frames of high-dynamic pictures
More specifically, for two frames as an example, a frame of long integral picture pic _ l and a frame of short integral picture pic _ s are first obtained through the first obtaining module 10, where the long integral picture pic _ l can represent low brightness details of the picture, and the short integral picture pic _ s can represent high brightness details of the picture, for example, a scene can be exposed for a long time to obtain the long integral picture pic _ l, and the same scene can be exposed for a short time to obtain the short integral picture pic _ s, and the scene corresponding to the long integral picture pic _ l and the scene corresponding to the short integral picture pic _ s are the same scene, and the details of the dark place of the picture can be improved by the long exposure, and the details of the bright place of the picture can be shown by the short exposure.
Therefore, all picture details of the picture, namely the highlight details and the low highlight details of the picture, can be reserved through long-time exposure and short-time exposure processing, the picture noise is reduced, and the signal-to-noise ratio is improved.
In one embodiment of the present invention, the compression module 20 may compress the picture through a plurality of picture compression algorithms, for example, a linear compression algorithm, a logarithmic compression algorithm, or a piecewise linear compression algorithm.
In one embodiment of the present invention, the compression module 20 may compress the long integral picture pic _ l and the short integral picture pic _ s respectively through a piecewise linear compression algorithm.
As shown in fig. 3 and 4, after the first obtaining module 10 obtains a frame of long-integration picture pic _ l, the compressing module 20 compresses the long-integration picture pic _ l according to the curve shown in fig. 3 to obtain a long-integration compressed picture pic _ l1, and after the first obtaining module 10 obtains a frame of short-integration picture pic _ s, the compressing module 20 compresses the short-integration picture pic _ s according to the curve shown in fig. 4 to obtain a short-integration compressed picture pic _ s 1.
According to an embodiment of the present invention, the second obtaining module 30 may obtain the first weight value corresponding to the long-integration picture and the second weight value corresponding to the short-integration picture by the following formulas:
coef_l＝128-abs(128-y_l)
coef_s＝128-abs(128-y_s)
the image processing method comprises the steps of obtaining a long integral picture, obtaining a short integral picture, and obtaining a first brightness data of the long integral picture and a second brightness data of the short integral picture, wherein coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is a first brightness data of the long integral picture, and y _ s is a second brightness data of the short integral picture.
Specifically, the luminance data of the long integration picture pic _ l is represented by a variable with a bit width of 8bit to obtain the first luminance data y _ l, and the luminance data of the short integration picture pic _ s is represented by a variable with a bit width of 8bit to obtain the second luminance data y _ s, where the first luminance data y _ l and the second luminance data y _ s are both values in the range of 0-255, and where the luminance value is considered to be 128, the detail information of the picture is the most, so the second obtaining module 30 can calculate the detail weight value of the long integration picture pic _ l, i.e. the first weight value coef _ l, according to the above formula (1), i.e. the second obtaining module 30 can calculate the detail weight value of the long integration picture pic _ l, i.e. the first weight value coe
coef_l＝128-abs(128-y_l) (1)
Moreover, the second obtaining module 30 may calculate a detail weight value of the short-integration picture pic _ s, i.e. a second weight value coef _ s, according to the above formula (2)
coef_s＝128-abs(128-y_s) (2)
According to an embodiment of the present invention, the generating module 40 is further configured to obtain first luminance data y _ l of the long-integration picture and second luminance data y _ s of the short-integration picture, and generate a detail feature detail after the long-integration picture and the short-integration picture are combined according to the first weight value coef _ l, the second weight value coef _ s, the long-integration picture pic _ l, and the short-integration picture pic _ s.
According to an embodiment of the present invention, the generating module 40 may generate the detail feature after the long integral picture and the short integral picture are combined by the following formula:
detail is obtained after the long integral picture and the short integral picture are combined, pic _ l is the long integral picture, pic _ s is the short integral picture, coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is first luminance data of the long integral picture, and y _ s is second luminance data of the short integral picture.
Specifically, for example, the format of the picture data is 8bit, that is, the luminance information or detail information of the long integral picture pic _ l and the short integral picture pic _ s is represented by a variable having a bit width of 8bit, so that the luminance information or detail information of the picture can be represented by a value in a range of 0 to 255, and the closer the luminance value is to 128, the more detail information the picture contains, and based on this, the first weight value coef _ l corresponding to the long integral picture pic _ l and the second weight value coef _ s corresponding to the short integral picture pic _ s can be obtained.
More specifically, the luminance data of the long integration picture pic _ l is represented by a variable having a bit width of 8 bits to obtain first luminance data y _ l, and the luminance data of the short integration picture pic _ s is represented by a variable having a bit width of 8 bits to obtain the second luminance data y _ s, since the closer the luminance value is to 128, the more detailed information of the picture is contained, after the long integral picture and the short integral picture are combined, the generating module 40 may obtain all the color and detail information in the long integral picture pic _ l by calculating the weight of the combined first difference value (pic _ l-y _ l) between the long integral picture pic _ l and the first luminance data y _ l, and, the generating module 40 may obtain all the color and detail information in the short integral picture pic _ s by calculating the weight of the second difference (pic _ s-y _ s) of the short integral picture pic _ s and the second luminance data y _ s after combination. Therefore, the generation module 40 can obtain the detail feature detail after the long integral picture and the short integral picture are combined through the above formula (3), that is, the detail feature detail is
According to an embodiment of the present invention, the third obtaining module 50 may obtain the combined characteristic luminance and the target luminance of the long-integration picture pic _ l and the short-integration picture pic _ s according to the following formulas:
y _ m is characteristic brightness, y _ t is target brightness, y _ l1 is image brightness after long-integration picture compression, y _ s1 is image brightness after short-integration picture compression, coef _ l is a first weight value corresponding to a long-integration picture, coef _ s is a second weight value corresponding to a short-integration picture, y _ l is first brightness data of the long-integration picture, and y _ s is second brightness data of the short-integration picture.
Specifically, after the long integration picture pic _ l and the short integration picture pic _ s are combined, the first luminance data y _ l of the long integration picture pic _ l is weighted as
The weight of the second luminance data y _ s of the short integration picture pic _ s in the composite picture is
Thus, the third obtaining module 50 can obtain the feature luminance y _ m after the long-integration picture pic _ l and the short-integration picture pic _ s are combined through the formula (4), that is, the feature luminance y _ m is obtained
In addition, after the long integral picture pic _ l and the short integral picture pic _ s are combined, the third obtaining module 50 may obtain the target brightness y _ t after the long integral picture pic _ l and the short integral picture pic _ s are combined according to the average value of the image brightness y _ l1 after the long integral picture is compressed and the image brightness y _ s1 after the short integral picture is compressed, that is, the target brightness y _ t after the long integral picture pic _ l and the short integral picture pic _ s are combined
According to an embodiment of the present invention, the synthesis module 60 may synthesize the long integral picture and the short integral picture by the following formula:
the pic _ hdr is a finally synthesized high-dynamic data picture, detail is a detail feature after a long integral picture and a short integral picture are combined, y _ m is feature brightness, and y _ t is target brightness.
Specifically, when the long integral picture pic _ l and the short integral picture pic _ s are synthesized, the third obtaining module 50 may obtain the target luminance y _ t after the long integral picture pic _ l and the short integral picture pic _ s are combined, where the luminance information includes luminance information in a high luminance state and luminance information in a low luminance state, and thus may be used as the luminance information of the synthesized picture. And, the synthesis module 60 can pass
And acquiring the detail information of the synthesized picture. Further, the synthesis module 60 may synthesize the long integral picture pic _ l and the short integral picture pic _ s by the above equation (6), i.e.
Thus, the picture synthesis device according to the embodiment of the present invention obtains the detail features and the luminance features in the long-integral picture and the short-integral picture, respectively, and combines the detail features and the luminance features in the long-integral picture and the short-integral picture to finally synthesize the high-dynamic-data picture.
In summary, according to the image synthesizing apparatus provided in the embodiment of the present invention, the first obtaining module obtains the long integral image and the short integral image, the second obtaining module obtains the first weight value corresponding to the long integral image and the second weight value corresponding to the short integral image, the generating module generates the detail feature after the long integral image and the short integral image are combined according to the first weight value, the second weight value, the long integral image and the short integral image, the third obtaining module obtains the feature brightness and the target brightness after the long integral image and the short integral image are combined, and then the synthesizing module synthesizes the long integral image and the short integral image according to the detail feature, the feature brightness and the target brightness after the long integral image and the short integral image are combined, so as to obtain all detail features of the long integral image and the short integral image, and improve the dynamic range of the synthesized image, the method is easy to realize, can acquire details in dark places, reduces the noise of the picture, and improves the signal to noise ratio of the synthesized picture.
According to the air conditioner disclosed by the embodiment of the invention, the compressor can be controlled by adopting different control strategies according to different peak values of the current input to the PFC circuit, the damage to the PFC circuit and the related input circuit caused by overlarge peak value of the input current can be effectively prevented, and the safety and reliability are improved.
In the description of the present invention, it is to be understood that the terms "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed and operated in a particular orientation, and are not to be considered limiting of the invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
In the present invention, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the present invention, unless otherwise expressly stated or limited, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through an intermediate. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (6)
1. A picture synthesis method is characterized by comprising the following steps:
acquiring a long integral picture and a short integral picture;
compressing the long integral picture and the short integral picture respectively to form a long integral compressed picture and a short integral compressed picture;
respectively acquiring a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture;
generating detail characteristics after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture; the method specifically comprises the following steps: acquiring first brightness data of the long integral picture and second brightness data of the short integral picture;
generating detail characteristics after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the first brightness data, the second brightness data, the long integral picture and the short integral picture;
generating the detail characteristics of the combined long integral picture and short integral picture by the following formula:
detail is obtained after the long-integral picture and the short-integral picture are combined, pic _ l is the long-integral picture, pic _ s is the short-integral picture, coef _ l is a first weight value corresponding to the long-integral picture, coef _ s is a second weight value corresponding to the short-integral picture, y _ l is first brightness data of the long-integral picture, and y _ s is second brightness data of the short-integral picture;
acquiring the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined; and acquiring the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined by the following formula:
wherein y _ m is the characteristic brightness, y _ t is the target brightness, y _ l1 is the image brightness after the long-integration picture is compressed, y _ s1 is the image brightness after the short-integration picture is compressed, coef _ l is a first weight value corresponding to the long-integration picture, coef _ s is a second weight value corresponding to the short-integration picture, y _ l is first brightness data of the long-integration picture, and y _ s is second brightness data of the short-integration picture;
and synthesizing the long integral picture and the short integral picture according to the detail feature, the feature brightness and the target brightness after the long integral picture and the short integral picture are combined.
2. The picture synthesis method according to claim 1, wherein a first weight value corresponding to the long-integration picture and a second weight value corresponding to the short-integration picture are obtained by the following formulas:
coef_l＝128-abs(128-y_l)
coef_s＝128-abs(128-y_s)
the image processing method comprises the steps of obtaining a long integral picture, obtaining a short integral picture, and obtaining a first brightness data of the long integral picture and a second brightness data of the short integral picture, wherein coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is a first brightness data of the long integral picture, and y _ s is a second brightness data of the short integral picture.
3. The picture synthesis method according to claim 1, wherein the long integration picture and the short integration picture are synthesized by the following formula:
and the pic _ hdr is a finally synthesized high-dynamic data picture, the detail is a detail feature after the long integral picture and the short integral picture are combined, y _ m is the feature brightness, and y _ t is the target brightness.
4. A picture composition apparatus, comprising:
the first acquisition module is used for acquiring a long integral picture and a short integral picture;
the compression module is connected with the first acquisition module and is used for respectively compressing the long integral picture and the short integral picture to form a long integral compressed picture and a short integral compressed picture;
the second obtaining module is connected with the first obtaining module and is used for respectively obtaining a first weight value corresponding to the long integral picture and a second weight value corresponding to the short integral picture;
the generating module is respectively connected with the first acquiring module and the second acquiring module, and is used for generating the detail characteristics after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the long integral picture and the short integral picture; the generation module is further configured to obtain first luminance data of the long integral picture and second luminance data of the short integral picture, and generate a detail feature after the long integral picture and the short integral picture are combined according to the first weight value, the second weight value, the first luminance data, the second luminance data, the long integral picture and the short integral picture; the generation module generates the detail characteristics of the combined long integral picture and short integral picture through the following formula:
detail is obtained after the long integral picture and the short integral picture are combined, pic _ l is the long integral picture, pic _ s is the short integral picture, coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is first brightness data of the long integral picture, and y _ s is second brightness data of the short integral picture;
the third acquisition module is respectively connected with the first acquisition module, the compression module and the second acquisition module, and is used for acquiring the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined; the third acquisition module acquires the characteristic brightness and the target brightness after the long integral picture and the short integral picture are combined through the following formula:
wherein y _ m is the characteristic brightness, y _ t is the target brightness, y _ l1 is the image brightness after the long-integration picture is compressed, y _ s1 is the image brightness after the short-integration picture is compressed, coef _ l is a first weight value corresponding to the long-integration picture, coef _ s is a second weight value corresponding to the short-integration picture, y _ l is first brightness data of the long-integration picture, and y _ s is second brightness data of the short-integration picture;
and the synthesis module is respectively connected with the generation module and the third acquisition module, and is used for synthesizing the long integral picture and the short integral picture according to the detail feature, the feature brightness and the target brightness after the combination of the long integral picture and the short integral picture.
5. The picture synthesis apparatus according to claim 4, wherein the second obtaining module obtains the first weight value corresponding to the long-integration picture and the second weight value corresponding to the short-integration picture by the following formula:
coef_l＝128-abs(128-y_l)
coef_s＝128-abs(128-y_s)
the image processing method comprises the steps of obtaining a long integral picture, obtaining a short integral picture, and obtaining a first brightness data of the long integral picture and a second brightness data of the short integral picture, wherein coef _ l is a first weight value corresponding to the long integral picture, coef _ s is a second weight value corresponding to the short integral picture, y _ l is a first brightness data of the long integral picture, and y _ s is a second brightness data of the short integral picture.
6. The picture synthesis apparatus according to claim 4, wherein the synthesis module synthesizes the long integral picture and the short integral picture by the following formula:
and the pic _ hdr is a finally synthesized high-dynamic data picture, the detail is a detail feature after the long integral picture and the short integral picture are combined, y _ m is the feature brightness, and y _ t is the target brightness.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710029451.1A CN108320273B (en) | 2017-01-16 | 2017-01-16 | Picture synthesis method and picture synthesis device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710029451.1A CN108320273B (en) | 2017-01-16 | 2017-01-16 | Picture synthesis method and picture synthesis device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108320273A CN108320273A (en) | 2018-07-24 |
| CN108320273B true CN108320273B (en) | 2020-10-23 |
Family
ID=62890867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710029451.1A Active CN108320273B (en) | 2017-01-16 | 2017-01-16 | Picture synthesis method and picture synthesis device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108320273B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101909158A (en) * | 2009-06-05 | 2010-12-08 | 比亚迪股份有限公司 | Method for acquiring high-dynamic range image in image sensor, and image sensor |
| CN101909157A (en) * | 2009-06-05 | 2010-12-08 | 比亚迪股份有限公司 | Method for acquiring highly dynamic images from image sensor, and image sensor |
| CN102420944B (en) * | 2011-04-25 | 2013-10-16 | 展讯通信（上海）有限公司 | High dynamic-range image synthesis method and device |
| CN104125408A (en) * | 2013-04-28 | 2014-10-29 | 比亚迪股份有限公司 | High dynamic range image processing method and device |
| CN105898148A (en) * | 2016-05-27 | 2016-08-24 | 深圳英飞拓科技股份有限公司 | Image synthesis method and apparatus for wide dynamic monitoring camera |
| US9438827B2 (en) * | 2013-08-27 | 2016-09-06 | Semiconductor Components Industries, Llc | Imaging systems and methods for generating binned high-dynamic-range images |
| US9485435B2 (en) * | 2014-04-22 | 2016-11-01 | Shih-Chieh Huang | Device for synthesizing high dynamic range image based on per-pixel exposure mapping and method thereof |
-
2017
- 2017-01-16 CN CN201710029451.1A patent/CN108320273B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101909158A (en) * | 2009-06-05 | 2010-12-08 | 比亚迪股份有限公司 | Method for acquiring high-dynamic range image in image sensor, and image sensor |
| CN101909157A (en) * | 2009-06-05 | 2010-12-08 | 比亚迪股份有限公司 | Method for acquiring highly dynamic images from image sensor, and image sensor |
| CN102420944B (en) * | 2011-04-25 | 2013-10-16 | 展讯通信（上海）有限公司 | High dynamic-range image synthesis method and device |
| CN104125408A (en) * | 2013-04-28 | 2014-10-29 | 比亚迪股份有限公司 | High dynamic range image processing method and device |
| US9438827B2 (en) * | 2013-08-27 | 2016-09-06 | Semiconductor Components Industries, Llc | Imaging systems and methods for generating binned high-dynamic-range images |
| US9485435B2 (en) * | 2014-04-22 | 2016-11-01 | Shih-Chieh Huang | Device for synthesizing high dynamic range image based on per-pixel exposure mapping and method thereof |
| CN105898148A (en) * | 2016-05-27 | 2016-08-24 | 深圳英飞拓科技股份有限公司 | Image synthesis method and apparatus for wide dynamic monitoring camera |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108320273A (en) | 2018-07-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107635102B (en) | Method and device for acquiring exposure compensation value of high-dynamic-range image | |
| KR101247647B1 (en) | Image synthesizing device, image synthesizing method, and recording medium | |
| CN104937921B (en) | A kind of terminal and image processing method, image-pickup method | |
| AU2014213524B2 (en) | High dynamic range image generation and rendering | |
| KR101388130B1 (en) | Image processing apparatus and image processing method | |
| CN110022469B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20030122951A1 (en) | Image processing apparatus and image processing method | |
| US9426437B2 (en) | Image processor performing noise reduction processing, imaging apparatus equipped with the same, and image processing method for performing noise reduction processing | |
| US20090102945A1 (en) | System and method for generating high dynamic range images | |
| CN112532855B (en) | Image processing method and device | |
| KR20120107429A (en) | Zone-based tone mapping | |
| US20160210717A1 (en) | Watermarking digital images to increase bit depth | |
| US8665348B2 (en) | Image processing apparatus and method using forward and inverse local adaptation processing and dynamic range processing | |
| US9087385B2 (en) | Method for improving images captured underwater | |
| US20160212441A1 (en) | Inter frame watermark in a digital video | |
| JP5457845B2 (en) | Color characteristic correction apparatus and camera | |
| US7421121B2 (en) | Spectral normalization using illuminant exposure estimation | |
| JP5804857B2 (en) | Image processing apparatus, image processing method, and program | |
| CN110047060B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| JP2013138301A5 (en) | ||
| KR20120114899A (en) | Image processing method and image processing apparatus | |
| CN108320273B (en) | Picture synthesis method and picture synthesis device | |
| KR20090111065A (en) | Apparatus for image composition | |
| JP4368127B2 (en) | Gamma correction device in imaging device | |
| JP4802333B2 (en) | Method for determining exposure ratio in image composition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210226 Address after: 518119 No.1 Yan'an Road, Kuiyong street, Dapeng New District, Shenzhen City, Guangdong Province Patentee after: BYD Semiconductor Co.,Ltd. Address before: 518118 BYD Road, Pingshan New District, Shenzhen, Guangdong 3009 Patentee before: BYD Co.,Ltd. |