CN112584055A - Brightness self-adaptive adjusting method, system, equipment and medium based on image coding - Google Patents
Brightness self-adaptive adjusting method, system, equipment and medium based on image coding Download PDFInfo
- Publication number
- CN112584055A CN112584055A CN201910931670.8A CN201910931670A CN112584055A CN 112584055 A CN112584055 A CN 112584055A CN 201910931670 A CN201910931670 A CN 201910931670A CN 112584055 A CN112584055 A CN 112584055A
- Authority
- CN
- China
- Prior art keywords
- image
- brightness
- coding
- coded
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
Abstract
The invention provides a brightness self-adaptive adjusting method, a system, equipment and a medium based on image coding, comprising the following steps: acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image; detecting a coding region in the target coding image and calculating the coding brightness of the coding region in the target coding image; and adjusting the exposure time of the further acquired other coded image according to the coding brightness of the coding region in the target coded image. According to the method, the background noise is removed through comparison of the background image and the coded image, the coding brightness of the coding region in the target coded image is further calculated, and then the exposure time of the subsequently collected coded image can be adjusted according to the coding brightness, so that the influence of strong light sources such as sunlight on the effective brightness of the image coding is effectively eliminated, and the influence of over-brightness or over-darkness of the image coding region on the identification precision of the image coding region is reduced.
Description
Technical Field
The invention relates to structured light three-dimensional reconstruction, in particular to a brightness self-adaptive adjusting method, a system, equipment and a medium based on image coding.
Background
In the structured light three-dimensional reconstruction technology, a transmitting module projects coded light with a specific shape onto an object, such as stripe coded light or point coded light, a receiving module captures an image with codes, and finally, spatial information, such as three-dimensional spatial information or depth information, of the surface of the object is calculated according to the deformation coded in the image.
However, in practical use, due to the difference of the used distance and the used scene, such as too high ambient light intensity, the encoding brightness in the acquired image will be too bright or too dark, which will cause trouble to the calculation of the object position.
The image coding which is relatively common in the prior art includes: the geometric figure that the laser sent, the specific texture that the visible light sent, character under the visible light, etc. can extract the characteristic, after these codes are projected on the object, the receiving module receives the image with code, can carry on the extraction of the characteristic. The current image brightness adaptive algorithm is to adjust the image exposure value according to the brightness of the whole picture or the brightness of several local areas, and cannot judge whether the coding area is over-exposed only according to the coding area in the image. In addition, when reconstructing, the spatial position is calculated by using the encoding region, and if the encoding region is not clear or the exposure is not proper, the calculation error of the reconstruction algorithm is increased.
In addition, the current luminance adaptive algorithm only performs adaptive adjustment on the luminance of the whole picture, and cannot judge whether overexposure exists or not for image coding in a complex light environment.
Disclosure of Invention
In view of the defects in the prior art, it is an object of the present invention to provide a method, a system, a device and a medium for adaptive luminance adjustment based on image coding, which can reduce the influence of exposure on reconstruction accuracy within a certain range
The brightness self-adaptive adjusting method based on the image coding provided by the invention comprises the following steps:
step S1: acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image;
step S2: detecting a coding region in the target coding image and calculating the coding brightness of the coding region in the target coding image;
step S3: and adjusting the exposure time of the further acquired other coded image according to the coding brightness of the coding region in the target coded image.
Preferably, the method further comprises the following steps before the step S1:
-acquiring a further background image, calculating an average brightness of the further background image, to enable an adjustment of the illumination intensity of the light source in dependence of said average brightness.
Preferably, the step S2 includes the steps of:
step S201: performing local self-adaptive binarization processing on the target coded image to generate a binarized image, wherein the target coded image comprises a coding region and a background region, the background region is set to be 0, and the coding region is set to be 1;
step S202: counting the number of pixels in a coding region in a binary image, and triggering a step S202 when the number of the pixels is greater than a preset pixel number threshold value;
step S203: and calculating the average brightness of a plurality of coding areas in the coded image according to the coding areas in the binarized image to be used as the brightness of the coding areas.
Preferably, the step S3 includes the steps of:
step S301: comparing the coded brightness with a preset brightness upper threshold and a preset brightness lower threshold, and reducing the exposure time when the coded brightness is greater than the brightness upper threshold;
step S302: when the encoding brightness is smaller than the brightness upper limit threshold value, increasing the exposure time;
step S303: when the encoded luminance is between the luminance upper threshold and the luminance lower threshold, the exposure time is kept unchanged.
Preferably, the step S3 includes the steps of:
step S301: respectively setting a severe overexposure brightness interval, a slight overexposure brightness interval, an unexposed brightness interval and an underexposure brightness interval;
step S302: when the coding brightness is within the serious overexposure brightness interval, reducing the exposure time by half;
step S303: when the coding brightness is within the slight overexposure brightness interval, reducing the exposure time by preset milliseconds;
step S304: and when the coding brightness is within the underexposure brightness interval, increasing the exposure time by preset milliseconds.
Preferably, when the encoding region is a plurality of speckle regions, the step S2 specifically includes the following steps:
step S201: extracting centers of a plurality of speckle regions in the target coded image;
step S202: determining the area occupied by the speckle area in the coded image according to the preset radius of the speckle area or the brightness of the speckle area, further setting the background area to be 0, and setting the coded area to be 1 to generate a binary image;
step S203: and calculating the average brightness of each speckle area in the coded image according to the speckle areas in the binarized image to be used as the brightness of each speckle area, and further using the average brightness of the speckle areas as the brightness of the coded area.
Preferably, the severe overexposure brightness interval is a pixel value between 240 and 255; the pixel value of the slight overexposure brightness interval is between 180 and 240; the pixel value of the non-overexposed brightness interval is between 50 and 180; the pixel value of the underexposed brightness interval is between 50 and 0.
The brightness adaptive adjustment system based on image coding provided by the invention is used for realizing the brightness adaptive adjustment method based on image coding, and is characterized by comprising the following steps:
the image acquisition module is used for acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image;
the brightness determining module is used for detecting a coding region in the target coding image and calculating the coding brightness of the coding region in the target coding image;
and the exposure control module is used for adjusting the exposure time of the further acquired other coded image according to the coding brightness of the coding area in the target coded image.
The brightness adaptive adjusting device based on image coding provided by the invention is characterized by comprising the following components:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the image coding based luma adaptive adjustment method via execution of the executable instructions.
According to the present invention, there is provided a computer-readable storage medium storing a program which, when executed, implements the steps of the image coding-based luminance adaptive adjustment method.
Compared with the prior art, the invention has the following beneficial effects:
according to the invention, the background noise is removed by comparing the background image with the coded image, so that the coding brightness of the coding region in the target coded image is calculated, and then the exposure time of the subsequently collected coded image can be adjusted according to the coding brightness, thereby effectively eliminating the influence of strong background light sources such as sunlight on the effective brightness of the image coding, and reducing the influence of over-brightness or over-darkness of the image coding region on the identification precision of the image coding region.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts. Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a flowchart illustrating the steps of a luminance adaptive adjustment method based on image coding according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating the steps of extracting a coding region in a coded image according to an embodiment of the present invention;
FIG. 3 is a flowchart of the steps for extracting the luminance of the coding region according to the variation of the present invention;
FIG. 4 is a flowchart illustrating steps for adjusting exposure time according to the encoding brightness according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating the steps of adjusting the exposure time according to the encoding brightness according to the variation of the present invention;
FIG. 6(a) is a diagram illustrating a background image according to an embodiment of the present invention;
FIG. 6(b) is a diagram illustrating image coding according to an embodiment of the present invention;
FIG. 6(c) is a diagram of a target encoded image according to an embodiment of the present invention;
FIG. 7(a) is a diagram illustrating an encoded image after exposure adjustment according to an embodiment of the present invention;
FIG. 7(b) is a diagram illustrating an encoded image after exposure adjustment and background removal according to an embodiment of the present invention;
FIG. 8 is a block diagram of an adaptive brightness adjustment system based on image coding according to an embodiment of the present invention;
FIG. 9 is a schematic structural diagram of an adaptive luminance adjusting apparatus based on image coding according to an embodiment of the present invention; and
fig. 10 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
The invention provides a brightness self-adaptive adjusting method based on image coding, and aims to solve the problems in the prior art.
The following describes the technical solutions of the present invention and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of steps of a brightness adaptive adjustment method based on image coding in an embodiment of the present invention, and as shown in fig. 1, the brightness adaptive adjustment method based on image coding provided by the present invention can be applied to a 3D camera, and includes the following steps:
step S1: acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image;
in the embodiment of the invention, the 3D camera comprises a light source, a light projection module and a receiving module, and the light projection module projects preset coded light to the target object, and then the receiving module collects a coded image of the target object.
The background image and the coded image can be collected in sequence, or a plurality of coded images can be collected within a time period, and then one background image is collected.
In the embodiment of the present invention, the coded image and the background image are equal, and the gray values of the corresponding pixels in the coded image and the background image may be subtracted to remove the background noise in the coded image.
The background image is an image generated by collecting the target object through the receiving module when preset coded light is not projected to the target object.
In the embodiment of the present invention, before the step S1, the following steps are further included:
-acquiring a further background image, calculating an average brightness of the further background image, to enable an adjustment of the illumination intensity of the light source in dependence of said average brightness.
When the average brightness of the other background image is darker, the illumination intensity of the light source is not increased; and if the average brightness of the other background image is brighter, increasing the illumination intensity of the light source.
In an embodiment of the present invention, the average brightness of another background image is
Wherein M, N is the number of rows and columns of pixels in the background image, I is the horizontal serial number of the pixels, j is the vertical serial number of the pixels, IijFor the brightness of the pixel, if L is large, such as greater than 80, the backlight ratio is strong, and the intensity of the projection light source needs to be increased, and if L is small, such as less than 80, the backlight ratio is weak, and the intensity of the projection light source does not need to be adjusted.
Step S2: detecting a coding region in the coded image and calculating the coding brightness of the coding region in the coded image;
fig. 2 is a flowchart of a step of extracting a coding region in a coded image according to an embodiment of the present invention, as shown in fig. 2, in the embodiment of the present invention, the coding region in the coded image is extracted by a local adaptive binarization method, and the step S2 includes the following steps:
step S201: performing local self-adaptive binarization processing on the target coded image to generate a binarized image, wherein the target coded image comprises a coding region and a background region, the background region is set to be 0, and the coding region is set to be 1;
in an embodiment of the present invention, the luminance threshold at point (x, y) in the encoded image is defined as: t (x, y) ═ m (x, y) + k × s (x, y), where m (x, y) is the local luminance mean at the point, s (x, y) is the local luminance variance at the point, k is a scaling factor, the window is defined as n × n, and n is the number of pixels; and selecting a window and a scale factor k to ensure that the background areas in the coded image are all background areas after local adaptive binarization, wherein the brightness of the coded area is represented by a gray value.
Step S202: counting the number of pixels in a coding region in a binary image, and triggering a step S202 when the number of the pixels is greater than a preset pixel number threshold value;
in the embodiment of the present invention, the threshold of the number of pixels is 2000, and if the number of extracted pixels is less than 2000, the angle of the object to be shot is adjusted, and the background image and the encoded image are shot again.
Step S203: and calculating the average brightness of a plurality of coding areas in the coded image according to the coding areas in the binarized image to be used as the brightness of the coding areas.
Fig. 3 is a flowchart of a step of extracting the brightness of the encoding region in the modification of the present invention, and as shown in fig. 3, in the modification of the present invention, when the encoding region is a plurality of speckle regions, the step S2 specifically includes the following steps:
step S201: extracting centers of a plurality of speckle regions in the encoded image;
step S202: determining the area occupied by the speckle area in the coded image according to the preset radius of the speckle area or the brightness of the speckle area, further setting the background area to be 0, and setting the coded area to be 1 to generate a binary image;
step S203: and calculating the average brightness of each speckle area in the coded image according to the speckle areas in the binarized image to be used as the brightness of each speckle area, and further using the average brightness of the speckle areas as the brightness of the coded area.
In the present modification, in step S201, the centers of the speckle regions are determined according to a centroid method or a local fitting method, the number of the speckle regions is determined according to the number of the centers of the speckle regions, whether the number of the speckle regions is greater than or equal to a preset first number threshold is determined, when the number of the speckle regions is greater than the preset first number threshold, step S202 is executed, and when the number of the speckle regions is less than the preset first number threshold, step S1 is executed again. In a modification of the present invention, the first number threshold may be set to 1 thousand, or may be set to 1 ten thousand or 5 thousand.
In the modified example of the present invention, the average brightness of each speckle region may be sorted, and the average brightness of a plurality of speckle regions arranged in front may be used as the brightness of the coding region, for example, the average brightness of 500 speckle regions arranged in front may be used as the brightness of the coding region.
In the modified embodiment of the present invention, the encoding region may be formed by encoding speckles, may be formed by random speckles, and may further include other types of encoding, such as encoding of stripes and specific structures.
In the embodiment of the invention, whether a speckle area exists in the image is detected according to speckle characteristics, and if the speckle cannot be detected, the whole image is oversaturated, the image is excessively underexposed, no object exists in the image area or the object is too far away, and the like.
Detecting whether the speckle area exists in the image according to the characteristic of the speckle area, if so, calculating the position of the speckle, determining the speckle area, and then calculating the brightness of the speckle area.
Step S3: and adjusting the exposure time when another coded image is acquired according to the coding brightness of the coding region in the coded image.
Fig. 4 is a flowchart illustrating steps of adjusting the exposure time according to the encoding brightness according to an embodiment of the present invention, as shown in fig. 4, in the embodiment of the present invention, the step S3 includes the following steps:
step S301: comparing the coded brightness with a preset brightness upper threshold and a preset brightness lower threshold, and reducing the exposure time when the coded brightness is greater than the brightness upper threshold;
step S302: when the encoding brightness is smaller than the brightness upper limit threshold value, increasing the exposure time;
step S303: when the coded brightness is between the brightness upper threshold and the brightness lower threshold, the exposure time is kept unchanged.
In an embodiment of the invention, the exposure time is between 1 and 10 milliseconds.
Fig. 5 is a flowchart of the step of adjusting the exposure time according to the encoding brightness in the modification of the present invention, and as shown in fig. 5, the step S3 includes the following steps:
step S301: respectively setting a severe overexposure brightness interval, a slight overexposure brightness interval, an unexposed brightness interval and an underexposure brightness interval;
step S302: when the coding brightness is within the serious overexposure brightness interval, reducing the exposure time by half;
step S303: when the coding brightness is within the slight overexposure brightness interval, reducing the exposure time by 1 millisecond;
step S304: when the encoded luminance is within the underexposed luminance interval, then the exposure time is increased by 1 millisecond.
In the modified example of the present invention, the severe overexposure luminance interval is a pixel value between 240 and 255; the pixel value of the slight overexposure brightness interval is between 180 and 240; the pixel value of the non-overexposed brightness interval is between 50 and 180; the pixel value of the underexposed brightness interval is between 50 and 0.
In the present embodiment, the present invention divides the exposure time into 10 levels, i.e., 10 ms. The invention further judges the exposure time of the next step according to the grade of the brightness value and the initial exposure time of the acquisition equipment. If the exposure time is seriously overexposed, the exposure time is greatly reduced; if slightly overexposed, the exposure time will be reduced less; if not, the exposure time will not change; if underexposed, the exposure time may increase. Wherein there is not a one-to-one correspondence between brightness values and exposure time levels.
The adjusting process in the embodiment of the invention is as follows: if the exposure time is 10ms and is in a severe overexposure brightness interval, reducing the exposure time to 5 ms; if the exposure time is 5ms and is in a slight overexposure brightness interval, reducing the exposure time to 4 ms; if the exposure time is 4ms and is in the non-overexposure brightness interval, the exposure time is kept unchanged. Further, when the exposure time is 3ms and is in the underexposure luminance section, the exposure time is increased to 4 ms.
Fig. 6(a) is a schematic diagram of a background image in an embodiment of the present invention, fig. 6(b) is a schematic diagram of an encoded image in an embodiment of the present invention, and fig. 6(c) is a schematic diagram of a target encoded image in an embodiment of the present invention, as shown in fig. 6(a), 6(b), and 6(c), background interference can be removed by subtracting gray-scale values of corresponding pixels in the background image and the encoded image, and in fig. 6(c), a plurality of pixels are stuck together, and many pixels are in an oversaturated state, which is not favorable for determining the position of each encoded point.
Fig. 7(a) is a schematic diagram of an encoded image after exposure adjustment according to an embodiment of the present invention, and as shown in fig. 7(a), each encoded point is relatively clear, most of the encoded points are not in a saturated state, and most of the encoded points are isolated and can be well positioned. The method is very favorable for identifying the position of each coding point and improving the precision of three-dimensional reconstruction. FIG. 7(b) is a diagram illustrating an encoded image after exposure adjustment and background removal according to an embodiment of the present invention; as shown in fig. 7(b), the background can be filtered out, and the image coding region of interest can be extracted, so that the exposure control is performed only for the coding region.
When the image coding brightness self-adaptive adjusting method provided by the invention is used, the light source transmitting module transmits coded light, and the image receiving module can receive a coded image formed by a coding pattern projected onto an object by the light source transmitting module; firstly, acquiring a background image without codes, and adjusting the intensity of a light source according to the brightness of the Beijing image; then, simultaneously acquiring a background image without codes and a coded image, and detecting a coding area in the coded image after removing the influence of background light; calculating the coding brightness of a coding region in a coding image; and finally, carrying out self-adaptive adjustment on the subsequent image codes according to the coding brightness. The invention can adjust the intensity and the exposure state of the light source, thereby effectively eliminating the influence of strong background light sources such as sunlight on the effective brightness of the image coding and reducing the influence of over-bright or over-dark of the image coding area on the identification precision of the image coding area.
Fig. 8 is a schematic block diagram of a brightness adaptive adjustment system based on image coding in an embodiment of the present invention, and as shown in fig. 8, the brightness adaptive adjustment system based on image coding provided in the present invention is configured to implement the brightness adaptive adjustment method based on image coding, and includes:
the image acquisition module is used for acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image;
the brightness determining module is used for detecting a coding region in the target coding image and calculating the coding brightness of the coding region in the target coding image;
and the exposure control module is used for adjusting the exposure time of the further acquired other coded image according to the coding brightness of the coding area in the target coded image.
The embodiment of the invention also provides brightness adaptive adjusting equipment based on image coding, which comprises a processor. A memory having stored therein executable instructions of the processor. Wherein the processor is configured to perform the steps of the image coding based luminance adaptive adjustment method via execution of executable instructions.
As described above, in the embodiment, the background noise can be removed by comparing the background image with the encoded image, and then the encoding brightness of the encoding region in the target encoded image is calculated, and further the exposure time of the subsequently acquired encoded image can be adjusted according to the encoding brightness, so that the influence of strong light sources such as sunlight on the effective brightness of the image encoding can be effectively eliminated, and the influence of over-brightness or over-darkness of the image encoding region on the identification precision of the image encoding region can be reduced.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" platform.
Fig. 9 is a schematic structural diagram of a luminance adaptive adjustment device based on image coding in an embodiment of the present invention. An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 9. The electronic device 600 shown in fig. 9 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 9, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one memory unit 620, a bus 630 connecting the different platform components (including the memory unit 620 and the processing unit 610), a display unit 640, etc.
Wherein the storage unit stores program code which can be executed by the processing unit 610, such that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above-mentioned adaptive luminance adjusting method based on image coding section of the present specification. For example, processing unit 610 may perform the steps as shown in fig. 1.
The storage unit 620 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)6201 and/or a cache memory unit 6202, and may further include a read-only memory unit (ROM) 6203.
The memory unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via the bus 630. It should be appreciated that although not shown in FIG. 9, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.
The embodiment of the invention also provides a computer readable storage medium for storing a program, and the program realizes the steps of the brightness adaptive adjustment method based on image coding when being executed. In some possible embodiments, aspects of the present invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the present invention described in the above-mentioned adaptive luminance adjusting method based on image coding part of the present specification, when the program product is run on the terminal device.
As shown above, when the program of the computer-readable storage medium of this embodiment is executed, the background noise is removed through comparison between the background image and the encoded image, and then the encoded brightness of the encoded region in the target encoded image is calculated, so that the exposure time of the subsequently acquired encoded image can be adjusted according to the encoded brightness, thereby effectively eliminating the influence of a strong light source such as sunlight on the effective brightness of the image encoding, and reducing the influence of over-brightness or over-darkness of the image encoded region on the identification precision of the image encoded region.
Fig. 10 is a schematic structural diagram of a computer-readable storage medium in an embodiment of the present invention. Referring to fig. 10, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In the embodiment of the invention, the background noise is removed by comparing the background image with the coded image, the coding brightness of the coding region in the target coded image is further calculated, and the exposure time of the subsequently collected coded image can be adjusted according to the coding brightness, so that the influence of strong background light sources such as sunlight on the effective brightness of the image coding is effectively eliminated, and the influence of over-brightness or over-darkness of the image coding region on the identification precision of the image coding region is reduced.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes and modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention.
Claims (10)
1. A brightness adaptive adjustment method based on image coding is characterized by comprising the following steps:
step S1: acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image;
step S2: detecting a coding region in the target coding image and calculating the coding brightness of the coding region in the target coding image;
step S3: and adjusting the exposure time of the further acquired other coded image according to the coding brightness of the coding region in the target coded image.
2. The adaptive luminance adjusting method based on image coding according to claim 1, further comprising, before the step S1, the steps of:
-acquiring a further background image, calculating an average brightness of the further background image, to enable an adjustment of the illumination intensity of the light source in dependence of said average brightness.
3. The adaptive luminance adjusting method based on image coding according to claim 1, wherein the step S2 comprises the steps of:
step S201: performing local self-adaptive binarization processing on the target coded image to generate a binarized image, wherein the target coded image comprises a coding region and a background region, the background region is set to be 0, and the coding region is set to be 1;
step S202: counting the number of pixels in a coding region in a binary image, and triggering a step S202 when the number of the pixels is greater than a preset pixel number threshold value;
step S203: and calculating the average brightness of a plurality of coding areas in the coded image according to the coding areas in the binarized image to be used as the brightness of the coding areas.
4. The adaptive luminance adjusting method based on image coding according to claim 1, wherein the step S3 comprises the steps of:
step S301: comparing the coded brightness with a preset brightness upper threshold and a preset brightness lower threshold, and reducing the exposure time when the coded brightness is greater than the brightness upper threshold;
step S302: when the encoding brightness is smaller than the brightness upper limit threshold value, increasing the exposure time;
step S303: when the encoded luminance is between the luminance upper threshold and the luminance lower threshold, the exposure time is kept unchanged.
5. The adaptive luminance adjusting method based on image coding according to claim 1, wherein the step S3 comprises the steps of:
step S301: respectively setting a severe overexposure brightness interval, a slight overexposure brightness interval, an unexposed brightness interval and an underexposure brightness interval;
step S302: when the coding brightness is within the serious overexposure brightness interval, reducing the exposure time by half;
step S303: when the coding brightness is within the slight overexposure brightness interval, reducing the exposure time by preset milliseconds;
step S304: and when the coding brightness is within the underexposure brightness interval, increasing the exposure time by preset milliseconds.
6. The adaptive brightness adjustment method according to claim 1, wherein when the encoded region is a plurality of speckle regions, the step S2 specifically includes the following steps:
step S201: extracting centers of a plurality of speckle regions in the target coded image;
step S202: determining the area occupied by the speckle area in the coded image according to the preset radius of the speckle area or the brightness of the speckle area, further setting the background area to be 0, and setting the coded area to be 1 to generate a binary image;
step S203: and calculating the average brightness of each speckle area in the coded image according to the speckle areas in the binarized image to be used as the brightness of each speckle area, and further using the average brightness of the speckle areas as the brightness of the coded area.
7. The adaptive luminance adjusting method according to claim 5, wherein the severe overexposure luminance interval is a pixel value between 240 and 255; the pixel value of the slight overexposure brightness interval is between 180 and 240; the pixel value of the non-overexposed brightness interval is between 50 and 180; the pixel value of the underexposed brightness interval is between 50 and 0.
8. An adaptive brightness adjustment system based on image coding, for implementing the adaptive brightness adjustment method based on image coding of any one of claims 1 to 7, comprising:
the image acquisition module is used for acquiring a background image and a coded image, and removing background noise in the coded image according to the background image to generate a target coded image;
the brightness determining module is used for detecting a coding region in the target coding image and calculating the coding brightness of the coding region in the target coding image;
and the exposure control module is used for adjusting the exposure time of the further acquired other coded image according to the coding brightness of the coding area in the target coded image.
9. An adaptive luminance adjusting apparatus based on image coding, comprising:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the image coding based luminance adaptive adjustment method according to any one of claims 1 to 7 via execution of the executable instructions.
10. A computer-readable storage medium storing a program, wherein the program is executed to implement the steps of the image coding-based luminance adaptive adjustment method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910931670.8A CN112584055A (en) | 2019-09-29 | 2019-09-29 | Brightness self-adaptive adjusting method, system, equipment and medium based on image coding |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910931670.8A CN112584055A (en) | 2019-09-29 | 2019-09-29 | Brightness self-adaptive adjusting method, system, equipment and medium based on image coding |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112584055A true CN112584055A (en) | 2021-03-30 |
Family
ID=75110921
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910931670.8A Pending CN112584055A (en) | 2019-09-29 | 2019-09-29 | Brightness self-adaptive adjusting method, system, equipment and medium based on image coding |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112584055A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090185800A1 (en) * | 2008-01-23 | 2009-07-23 | Sungkyunkwan University Foundation For Corporate Collaboration | Method and system for determining optimal exposure of structured light based 3d camera |
| CN106875443A (en) * | 2017-01-20 | 2017-06-20 | 深圳大学 | The whole pixel search method and device of the 3-dimensional digital speckle based on grayscale restraint |
| CN108616726A (en) * | 2016-12-21 | 2018-10-02 | 光宝电子(广州)有限公司 | Exposal control method based on structure light and exposure-control device |
| CN109510948A (en) * | 2018-09-30 | 2019-03-22 | 先临三维科技股份有限公司 | Exposure adjustment method, device, computer equipment and storage medium |
| CN109903324A (en) * | 2019-04-08 | 2019-06-18 | 京东方科技集团股份有限公司 | A kind of depth image acquisition method and device |
| CN109982011A (en) * | 2019-04-23 | 2019-07-05 | 思特威电子科技（开曼）有限公司 | Imaging method based on infrared structure light |
-
2019
- 2019-09-29 CN CN201910931670.8A patent/CN112584055A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090185800A1 (en) * | 2008-01-23 | 2009-07-23 | Sungkyunkwan University Foundation For Corporate Collaboration | Method and system for determining optimal exposure of structured light based 3d camera |
| CN108616726A (en) * | 2016-12-21 | 2018-10-02 | 光宝电子(广州)有限公司 | Exposal control method based on structure light and exposure-control device |
| CN106875443A (en) * | 2017-01-20 | 2017-06-20 | 深圳大学 | The whole pixel search method and device of the 3-dimensional digital speckle based on grayscale restraint |
| CN109510948A (en) * | 2018-09-30 | 2019-03-22 | 先临三维科技股份有限公司 | Exposure adjustment method, device, computer equipment and storage medium |
| CN109903324A (en) * | 2019-04-08 | 2019-06-18 | 京东方科技集团股份有限公司 | A kind of depth image acquisition method and device |
| CN109982011A (en) * | 2019-04-23 | 2019-07-05 | 思特威电子科技（开曼）有限公司 | Imaging method based on infrared structure light |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9288458B1 (en) | Fast digital image de-hazing methods for real-time video processing | |
| CN107404628B (en) | Image processing apparatus and method, and monitoring system | |
| US11600008B2 (en) | Human-tracking methods, systems, and storage media | |
| CN105577983B (en) | Apparatus and method for detecting motion mask | |
| US11143879B2 (en) | Semi-dense depth estimation from a dynamic vision sensor (DVS) stereo pair and a pulsed speckle pattern projector | |
| CN111667420B (en) | Image processing method and device | |
| EP3820134A1 (en) | A system for performing ambient light image correction | |
| CN116503388B (en) | Defect detection method, device and storage medium | |
| CN112819722A (en) | Infrared image face exposure method, device, equipment and storage medium | |
| CN111325698A (en) | Image processing method, device and system and electronic equipment | |
| EP2993645B1 (en) | Image processing program, information processing system, information processing apparatus, and image processing method | |
| US10748019B2 (en) | Image processing method and electronic apparatus for foreground image extraction | |
| CN117152182B (en) | Ultralow-illumination network camera image processing method and device and electronic equipment | |
| CN113379615A (en) | Image processing method and device, storage medium and electronic equipment | |
| CN112967366A (en) | Volume light rendering method and device, electronic equipment and storage medium | |
| CN112584055A (en) | Brightness self-adaptive adjusting method, system, equipment and medium based on image coding | |
| CN114255177B (en) | Exposure control method, device, equipment and storage medium in imaging | |
| CN116363027A (en) | Method, equipment and storage medium for removing rainbow-like glare of under-screen RGB image by utilizing infrared image | |
| CN112691378B (en) | Image processing method, apparatus and readable medium | |
| CN112584054A (en) | Brightness self-adaptive adjusting method, system, equipment and medium based on image coding | |
| CN114926891A (en) | Pupil detection method and device, storage medium and electronic equipment | |
| CN113706402A (en) | Neural network training method and device and electronic equipment | |
| CN112257571A (en) | Biological characteristic image acquisition method and electronic equipment | |
| CN112104815A (en) | Image brightness calculation method and device, storage medium and electronic equipment | |
| CN114219744B (en) | Image generation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210330 |
|
| RJ01 | Rejection of invention patent application after publication |