CN116416144A - Image processing method and system for parameter adjustment based on feedback - Google Patents
Image processing method and system for parameter adjustment based on feedback Download PDFInfo
- Publication number
- CN116416144A CN116416144A CN202111652935.4A CN202111652935A CN116416144A CN 116416144 A CN116416144 A CN 116416144A CN 202111652935 A CN202111652935 A CN 202111652935A CN 116416144 A CN116416144 A CN 116416144A
- Authority
- CN
- China
- Prior art keywords
- image
- width
- bit
- signal processor
- image signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 47
- 230000008447 perception Effects 0.000 claims abstract description 45
- 238000013507 mapping Methods 0.000 claims description 77
- 238000012937 correction Methods 0.000 claims description 27
- 238000000034 method Methods 0.000 claims description 17
- 230000006870 function Effects 0.000 claims description 10
- 230000000903 blocking effect Effects 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 8
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000003705 background correction Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G06T5/90—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20092—Interactive image processing based on input by user
- G06T2207/20104—Interactive definition of region of interest [ROI]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application discloses an image processing method for parameter adjustment based on feedback, and belongs to the field of image processing. Identifying a low-bit-width RGB image by a perception model, determining an interested image area, and generating image signal processor parameter adjustment feedback information which is fed back to an image signal processor and contains relevant information of the interested image area; and the image signal processor adjusts the parameters of the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by the perception model after the medium-width image is processed by the image signal processor. According to the image processing method and device, corresponding parameters are configured for the processing flow of the image according to the perception effect of the perception model on the image processed by the image signal processor, so that the image processed by the configured parameters of the image signal processor meets the requirement of the perception model.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image processing method and system for parameter adjustment based on feedback.
Background
Since the dynamic range of the bit width of the image output from the image sensor in the in-vehicle camera is relatively high in the automatic driving, ISP (image signal processor) compresses a part of the dynamic range, and thus, a loss of a part of the dynamic range, that is, a loss of contrast, is unavoidable.
For the problem of dynamic range loss, the focus of different perception models may be different, some may focus on brighter objects in the image, and some may focus on darker objects in the image. After all images are processed by the same image signal processor, there is no way to meet the ideal image state of each perception model for each target of interest. In the case that the performance of the target itself in the image is not very ideal, the effect of the recognition of the perception model is also affected.
Disclosure of Invention
Aiming at the problem that the corresponding image processing flow cannot be selected to adapt to different requirements of a perception model in the prior art, the application mainly provides an image processing method and an image processing system for parameter adjustment based on feedback.
The application adopts a technical scheme that: there is provided an image processing method for parameter adjustment based on feedback, including:
the bit width mapping logic maps the high bit width image acquired by the image sensor into a medium bit width image required to be input by the image signal processor;
processing the medium-width image by an image signal processor, and converting the medium-width image into a low-width RGB image;
identifying the low-bit-width RGB image by using a perception model, determining an interested image area, and generating image signal processor parameter adjustment feedback information which is fed back to an image signal processor and contains relevant information of the interested image area;
and the image signal processor adjusts the parameters of the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by the perception model after the medium-width image is processed by the image signal processor.
The other technical scheme adopted by the application is as follows: there is provided an image processing system for parameter adjustment based on feedback, comprising bit width mapping logic, an image signal processor, and a perceptual model, wherein:
the bit width mapping logic maps the high bit width image acquired by the image sensor into a medium bit width image required to be input by the image signal processor;
processing the medium-width image by an image signal processor, and converting the medium-width image into a low-width RGB image;
identifying the low-bit-width RGB image by using a perception model, determining an interested image area, and generating image signal processor parameter adjustment feedback information which is fed back to an image signal processor and contains relevant information of the interested image area;
and the image signal processor adjusts the parameters of the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by the perception model after the medium-width image is processed by the image signal processor.
The other technical scheme adopted by the application is as follows: a computer readable storage medium is provided that stores computer instructions operable to perform the image processing method of parameter adjustment based on feedback in scheme one.
The other technical scheme adopted by the application is as follows: there is provided a computer device comprising a processor and a memory storing computer instructions operable to perform the method of image processing of parameter adjustment based on feedback in scheme one.
The beneficial effect that this application's technical scheme can reach is: the application designs an image processing method and system for parameter adjustment based on feedback. The perception model in the application recognizes the image processed by the image signal processor ISP, and the perception model reversely configures corresponding ISP parameters to the processing flow of the image signal processor ISP according to the perception effect of the perception model, and processes the image by the configured ISP parameters, so that the perception model can better recognize the target in the processed image.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the prior art descriptions, it being obvious that the drawings in the following description are some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort to a person skilled in the art.
FIG. 1 is a schematic diagram of an embodiment of an image processing method for parameter adjustment based on feedback according to the present application;
FIG. 2 is a schematic diagram of one embodiment of an image processing system for parameter adjustment based on feedback.
Specific embodiments thereof have been shown by way of example in the drawings and will herein be described in more detail. These drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments.
Detailed Description
The preferred embodiments of the present application will be described in detail below with reference to the drawings so that the advantages and features of the present application can be more easily understood by those skilled in the art, thereby making a clearer and more definite definition of the protection scope of the present application.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
The following describes the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 1 shows a specific embodiment of an image processing method for parameter adjustment based on feedback according to the present application. In the specific embodiment shown in fig. 1, the image processing method for performing parameter adjustment based on feedback mainly includes:
in step S101, the bit width mapping logic maps the high bit width image acquired by the image sensor to the medium bit width image required to be input by the image signal processor.
In this embodiment, the original image output from the image sensor in the in-vehicle camera has a high bit width dynamic range, and although the algorithm recognition is facilitated, the data amount is too large to process because the bit width is too high, so that the dynamic range of the original image bit width having the high bit width dynamic range needs to be compressed according to the bit width mapping logic.
In one embodiment of the present application, the image signal processor chops the bit width of the high-bit-width moving image according to the ISP allowable bit width; or the bit width of the high-bit-width dynamic image is mapped according to the mapping function provided by the image signal processor. When the bit width of the high-bit-width dynamic image is larger than the ISP allowed bit width, the bit width is compressed in a manner including cutting bits and function mapping. And directly chopping the bit width of the high-bit-width dynamic image according to the back-end algorithm of the image signal processor, and chopping the low bits or the high bits. According to the mapping function fed back by the image signal processor, the details of the dark part of the image can be reserved, and the whole image can be ensured not to be overexposed.
In the specific embodiment shown in fig. 1, the image processing method for performing parameter adjustment based on feedback further includes:
step S102, the image signal processor processes the middle-width image and converts the middle-width image into a low-width RGB image.
In this embodiment, in the image signal processor, the middle-width image is processed by each parameter, and the middle-width image is converted into the low-width RGB image, so that the perception model can better perceive the target in the image.
In an alternative embodiment of the present application, processing, by an image signal processor, a medium-width image includes: the method comprises the steps of sequentially performing white balance processing, tone mapping processing, demosaicing processing and gamma correction processing on a bit-width image, wherein parameters of an image signal processor comprise white balance parameters, tone mapping parameters, demosaicing parameters and/or gamma correction parameters.
In this embodiment, the parameter processing of the Image Signal Processor (ISP) includes, but is not limited to, black level correction (black level compensation), lens correction (lens shading correction), bad pixel correction (bad pixel correction), color interpolation (demosaic), bayer noise removal (Bayer noise) white balance (AWB) correction, color correction (color correction), and gamma (gamma) correction. This results in a better image effect.
In one specific example of the application, an Image Signal Processor (ISP) performs white balance on a median width image, and reduces the pixel value of the median width image belonging to white by adjusting the proportion of RGB pixels, so as to obtain a median width image subjected to white balance; an Image Signal Processor (ISP) performs tone mapping on the white-balanced middle-width image to obtain a gray image; an Image Signal Processor (ISP) demosaices the gray-scale image to obtain a color image; an Image Signal Processor (ISP) gamma-corrects the color image and finally outputs a low-bit-width RGB image.
In one embodiment of the present application, white balance (AWB) correction, if the captured image is not white balanced, it means that the white color is not necessarily white. The proportion of red, green and blue of reflected light is different according to different scenes and different illumination. What is to be done by the white balance in the ISP module is in fact a human eye-like work. If the white of the adjusted scenery is bluish, the preset proportional relation is changed by the white balance adjustment, so that the formed image is still white. The automatic white balance has the greatest advantages that; simple and quick cleaning. Tone mapping (Tonemapping), which is a linear mapping relationship, is the result of how strong the optical signal is and how large the pixel value of the image is when converted into an electrical signal, because the image sensor outputs all the photoelectrically converted signals. But is not a linear mapping relationship to the human eye itself, it is a non-linear mapping, and it will do differently for different targets. Tone mapping is also a function of simulating the human eye to do non-linear mapping. Demosaicing (Domodaic) because the image sensor outputs pixels of the image, one pixel being R, one pixel being G and one pixel being B, it is necessary to change it to information of rgb for each pixel, which is demosaicing. Gama correction, which is also basically linear, is truly nonlinear when viewed by the human eye. This non-linearity, like a gamma curve or a reverse log curve, is re-mapped across the entire image.
In an alternative embodiment of the present application, computing, by an image signal processor, a luminance level of a bit-width image in blocks includes: and dividing the high-bit-width image into a preset number of image blocks, and respectively calculating the weighted average value of the brightness of pixels in each image block to obtain the brightness level of each image block.
In this embodiment, in the image signal processor, the median width image is segmented into a predetermined number of tiles, and the luminance value of each tile, that is, the weighted average of the luminance of the pixels, is calculated and obtained, so as to obtain the luminance level of the median width image.
In the specific embodiment shown in fig. 1, the image processing method for performing parameter adjustment based on feedback further includes:
step S103, the perception model is used for identifying the low-bit-width RGB image, determining the interested image area and generating image signal processor parameter adjustment feedback information which is fed back to the image signal processor and contains the interested image area related information.
In this embodiment, the perception model detects a target in the input low-bandwidth RGB image, and obtains perceived image signal processor parameter adjustment feedback information. The perception model may perceive objects that itself may need attention. The perception model perceives the low-bit-width RGB image processed by the image signal processor, and obtains some image signal processor parameters according to the intensity of perceived effect to adjust feedback information.
In an optional embodiment of the present application, the image signal processor calculates the brightness level of the middle-width image in a blocking manner, determines the gray scale precision required by the brightness of different areas of the middle-width image according to the interested image area fed back by the perception model and the corresponding brightness level of the interested image area in the middle-width image, and generates the bit-width mapping feedback information fed back by the middle-width mapping logic according to the gray scale precision required by the brightness of different areas of the middle-width image; and adjusting the mapping relation between the high-bit-width image and the medium-bit-width image by the bit-width mapping logic according to the bit-width mapping feedback information, so that the brightness of the image region of interest has high gray scale precision.
In this embodiment, the bit width mapping feedback information includes the gray scale precision of each tile in the bit width image. The gray scale precision is determined and bit width mapping feedback information is generated based on the brightness level corresponding to the middle bit width image of the interested image area fed back by the perception model in the image signal processor, and the image signal processor generates a mapping function according to the generated bit width mapping feedback information, so that the details of dark parts in an original image can be reserved, and the whole image can be ensured not to be overexposed. And according to the bit width mapping feedback information, the mapping relation between the high bit width image and the medium bit width image is adjusted, so that the perception model can be more easily identified to the interested image area.
In an alternative embodiment of the present application, the adjusting, by the bit width mapping logic, the mapping relationship between the high bit width image and the medium bit width image according to the bit width mapping feedback information includes: under the condition that the brightness of the interested image area is low in brightness level, the bit width mapping feedback information indicates bit width mapping logic, one bit or a plurality of continuous bits are cut off from the highest bit of the high-bit width image, and a medium-bit width image is obtained; or in the case that the brightness of the interested image area is at a high brightness level, the bit width mapping feedback information indicates the bit width mapping logic to chop one bit or continuous multiple bits from the lowest bit of the high bit width image to obtain the medium bit width image.
In the embodiment, according to the bit width mapping feedback information, the bit width image is obtained by directly cutting bits of the high bit width image; the cut bits can only cut low bits or cut high bits, and the cut bits are used for mapping the bit width, so that the details of the target with lower pixel values are reserved in the image with the highest bit width as possible.
In an alternative embodiment of the present application, the adjusting, by the bit width mapping logic, the mapping relationship between the high bit width image and the medium bit width image according to the bit width mapping feedback information includes: in the case where the luminance of the image region of interest contains a plurality of luminance levels, the bit-width mapping feedback information indicates bit-width mapping logic that obtains a bit-width image using all bits of the high bit-width image according to the bit-width mapping function specified by the image signal processor.
In this embodiment, according to the mapping relation in the bit width mapping function specified by the image signal processor, the high bit width image is used as the input of the bit width mapping function, so as to obtain the output of the bit width mapping function, that is, the bit width image.
In one embodiment of the application, the perception model detects the target in the low-bit-width RGB image and screens out the target of interest in the low-bit-width RGB image; and acquiring an interested target range in the low-bit-width RGB image according to the interested target, and finally obtaining perceived image signal processor parameter adjustment feedback information containing the interested target range in the low-bit-width RGB image. The perception model may determine an image delineating area based on the image processed by the image signal processor, and determine a modification of a parameter of the image signal processor based on a value delineated in the image.
In the specific embodiment shown in fig. 1, the image processing method for performing parameter adjustment based on feedback further includes:
step S104, the image signal processor adjusts the parameters of the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained interested image area has the characteristics required by the perception model after the middle-width image is processed by the image signal processor.
In this embodiment, the sensing model feeds back the parameter adjustment feedback information of the image signal processor to the image signal processor, and the image signal processor adjusts according to the parameter of the image signal processor, so that the image processing effect is better, and the sensing model has the characteristics required by the sensing model.
In an alternative embodiment of the present application, the adjusting, by the image signal processor, the parameter of the image signal processor according to the image signal processor parameter adjustment feedback information includes: and adjusting at least one of white balance parameters, tone mapping parameters, demosaicing parameters and/or gamma correction parameters according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by a perception model after the medium-width image is processed by the image signal processor.
In this embodiment, the feedback information is adjusted according to the parameters of the image signal processor generated by the image region of interest, and at least one parameter of the image signal processor is adjusted. The specific adjustment is performed according to the actual feedback result.
In one specific example of the application, the image signal processor identifies the perceived image signal processor parameter adjustment feedback information by using an ISP algorithm to obtain identified adjustment information; and correspondingly adjusting parameters of the image signal processor according to the identified adjustment information. The ISP algorithm at the rear end of the image signal processor can identify the parameter adjustment feedback information of the image signal processor fed back by the perception model and call the parameter of the image signal processor for modification. The image signal processor processes the next frame of high-bit-width dynamic image according to the adjusted parameters of the image signal processor, and outputs the processing result to the perception model. The adjusted parameters of the image signal processor have better effect on the processing of the next frame of high-bit-width dynamic image, so that the perception model can better perceive the target in the image.
In one embodiment of the present application, the corresponding image processing flows are selected according to different requirements of different classes of perception models on the image, wherein the image processing flows include various pipelines in the image signal processor and the processing flows without the image signal processor. According to the feedback mechanism, parameters of the image signal processor corresponding to different pipelines in the image signal processor are modified, so that the image processed by the image signal processor can better meet the perceived requirements of different categories.
Fig. 2 illustrates an embodiment of an image processing system for parameter adjustment based on feedback according to the present application. In the embodiment shown in fig. 2, the image processing system for parameter adjustment based on feedback mainly includes a module 201 bit width mapping logic, a module 202 image signal processor, and a module 203 perception model, wherein:
the module 201 bit width mapping logic maps the high bit width image acquired by the image sensor into a medium bit width image required to be input by the image signal processor;
processing the mid-width image by a module 202 image signal processor and converting the mid-width image into a low-bit-width RGB image;
the module 203 perceives the model, recognizes the low-bit-width RGB image, determines the image region of interest, and generates image signal processor parameter adjustment feedback information containing the image region of interest related information fed back to the image signal processor;
the image signal processor of the module 202 adjusts the parameters of the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by the perception model after the medium-width image is processed by the image signal processor.
In this embodiment, the perception model perceives the low-bit-width RGB image output by the image signal processor, and feeds back the parameters of different image signal processors, the image signal processor adjusts the parameters of the image signal processor, and the image of the next frame is processed in the same way, so that the image is clearer, and the perception model can identify the attention target of the image more easily.
In an alternative embodiment of the present application, computing, by an image signal processor, a luminance level of a bit-width image in blocks includes: and dividing the high-bit-width image into a preset number of image blocks, and respectively calculating the weighted average value of the brightness of pixels in each image block to obtain the brightness level of each image block.
In this embodiment, in the image signal processor, the median width image is segmented into a predetermined number of tiles, and the luminance value of each tile, that is, the weighted average of the luminance of the pixels, is calculated and obtained, so as to obtain the luminance level of the median width image.
In an alternative embodiment of the present application, processing, by an image signal processor, a medium-width image includes: the method comprises the steps of sequentially performing white balance processing, tone mapping processing, demosaicing processing and gamma correction processing on a bit-width image, wherein parameters of an image signal processor comprise white balance parameters, tone mapping parameters, demosaicing parameters and/or gamma correction parameters.
In this embodiment, the parameter processing of the Image Signal Processor (ISP) includes, but is not limited to, black level correction (black level compensation), lens correction (lens shading correction), bad pixel correction (bad pixel correction), color interpolation (demosaic), bayer noise removal (AWB) correction, color correction (color correction), gamma correction. This results in a better image effect.
In an alternative embodiment of the present application, the adjusting, by the image signal processor, the parameter of the image signal processor according to the image signal processor parameter adjustment feedback information includes: and adjusting at least one of white balance parameters, tone mapping parameters, demosaicing parameters and/or gamma correction parameters according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by a perception model after the medium-width image is processed by the image signal processor.
In this embodiment, the feedback information is adjusted according to the parameters of the image signal processor generated by the image region of interest, and at least one parameter of the image signal processor is adjusted. The specific adjustment is performed according to the actual feedback result.
The image processing system for performing parameter adjustment based on feedback provided by the application can be used for executing the image processing method for performing parameter adjustment based on feedback described in any embodiment, and the implementation principle and technical effects are similar, and are not repeated here.
In a specific embodiment of the present application, the functional modules of an image processing system for parameter adjustment based on feedback of the present application may be directly in hardware, in a software module executed by a processor, or in a combination of both.
A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium.
The processor may be a central processing unit (English: central Processing Unit; CPU; for short), or other general purpose processor, digital signal processor (English: digital Signal Processor; for short DSP), application specific integrated circuit (English: application Specific Integrated Circuit; ASIC; for short), field programmable gate array (English: field Programmable Gate Array; FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof, etc. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
In another embodiment of the present application, a computer readable storage medium stores computer instructions operable to perform the method of image processing of any of the embodiments for parameter adjustment based on feedback.
In another embodiment of the present application, a computer device includes a processor and a memory storing computer instructions that are operable to perform the feedback-based parameter adjustment image processing method of any of the embodiments.
In the several embodiments provided in this application, it should be understood that the disclosed systems and methods may be implemented in other ways. For example, the system embodiments described above are merely illustrative, e.g., the division of the elements is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interface, system or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
The foregoing description is only exemplary embodiments of the present application and is not intended to limit the scope of the present application, and all equivalent structural changes made by the present application and the accompanying drawings, or direct or indirect application in other related technical fields, are included in the scope of the present application.
Claims (10)
1. An image processing method for parameter adjustment based on feedback, comprising:
the bit width mapping logic maps the high bit width image acquired by the image sensor into a medium bit width image required to be input by the image signal processor;
processing, by the image signal processor, the mid-width image and converting the mid-width image into a low-bit-width RGB image;
identifying the low-bit-width RGB image by a perception model, determining an interested image area, and generating image signal processor parameter adjustment feedback information which is fed back by the image signal processor and contains relevant information of the interested image area;
and adjusting the parameters of the image signal processor by the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by the perception model after the medium-width image is processed by the image signal processor.
2. The image processing method for parameter adjustment based on feedback as claimed in claim 1, wherein said processing of said medium width image by said image signal processor comprises:
sequentially performing white balance processing, tone mapping processing, demosaicing processing and gamma correction processing on the medium-width image,
wherein the parameters of the image signal processor include white balance parameters, tone mapping parameters, demosaicing parameters, and/or gamma correction parameters.
3. The image processing method of claim 2, wherein the adjusting, by the image signal processor, the parameter of the image signal processor according to the image signal processor parameter adjustment feedback information, comprises:
and adjusting at least one of the white balance parameter, the tone mapping parameter, the demosaicing parameter and/or the gamma correction parameter according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest of the medium-width image after the processing performed by the image signal processor has the characteristics required by the perception model.
4. The image processing method for parameter adjustment based on feedback as claimed in claim 1, further comprising:
by means of the image signal processor,
calculating the brightness level of the medium-width image in a blocking mode, determining the gray scale precision required by the brightness of different areas of the medium-width image according to the interested image area fed back by the perception model and the corresponding brightness level of the interested image area in the medium-width image, and
generating bit width mapping feedback information fed back to the bit width mapping logic according to gray scale precision required to be possessed by brightness of different areas of the bit width image; and
and adjusting the mapping relation between the high-bit-width image and the medium-bit-width image by the bit-width mapping logic according to the bit-width mapping feedback information, so that the brightness of the image region of interest has high gray scale precision.
5. The feedback-based parameter adjustment image processing method as set forth in claim 4, wherein said adjusting, by said bit-width mapping logic, a mapping relationship between said high bit-width image and said medium bit-width image according to said bit-width mapping feedback information, comprises:
in the case that the brightness of the image region of interest is at a low brightness level, the bit width mapping feedback information indicates the bit width mapping logic to chop one or more bits from the highest bit of the high bit width image to obtain the medium bit width image; or alternatively
In the case that the brightness of the image region of interest is at a high brightness level, the bit-width mapping feedback information indicates the bit-width mapping logic to chop one or more bits from the lowest bit of the high-bit-width image to obtain the medium-bit-width image.
6. The feedback-based parameter adjustment image processing method as set forth in claim 4, wherein said adjusting, by said bit-width mapping logic, a mapping relationship between said high bit-width image and said medium bit-width image according to said bit-width mapping feedback information, comprises:
and in the case that the brightness of the image region of interest comprises a plurality of brightness levels, the bit width mapping feedback information indicates the bit width mapping logic to obtain the bit width image by utilizing all bits of the high bit width image according to the bit width mapping function specified by the image signal processor.
7. The feedback-based parameter-adjustment image processing method as set forth in claim 4, wherein the block-calculating, by the image signal processor, the luminance level of the medium-width image includes:
and dividing the high-bit wide image into a preset number of image blocks, and respectively calculating the weighted average value of the brightness of pixels in each image block to obtain the brightness level of each image block.
8. An image processing system for parameter adjustment based on feedback, comprising bit width mapping logic, an image signal processor, and a perceptual model, characterized in that,
the bit width mapping logic maps the high bit width image acquired by the image sensor into a medium bit width image required to be input by the image signal processor;
processing, by the image signal processor, the mid-width image and converting the mid-width image into a low-bit-width RGB image;
identifying the low-bit-width RGB image by the perception model, determining an interested image area, and generating image signal processor parameter adjustment feedback information which is fed back to the image signal processor and contains relevant information of the interested image area;
and adjusting the parameters of the image signal processor by the image signal processor according to the image signal processor parameter adjustment feedback information, so that the obtained image region of interest has the characteristics required by the perception model after the medium-width image is processed by the image signal processor.
9. A computer readable storage medium storing computer instructions operable to perform the method of image processing of parameter adjustment based on feedback of any one of claims 1-7.
10. A computer device comprising a processor and a memory, the memory storing computer instructions, wherein the processor operates the computer instructions to perform the feedback-based parameter adjustment image processing method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111652935.4A CN116416144A (en) | 2021-12-30 | 2021-12-30 | Image processing method and system for parameter adjustment based on feedback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111652935.4A CN116416144A (en) | 2021-12-30 | 2021-12-30 | Image processing method and system for parameter adjustment based on feedback |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116416144A true CN116416144A (en) | 2023-07-11 |
Family
ID=87054914
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111652935.4A Pending CN116416144A (en) | 2021-12-30 | 2021-12-30 | Image processing method and system for parameter adjustment based on feedback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116416144A (en) |
-
2021
- 2021-12-30 CN CN202111652935.4A patent/CN116416144A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11849224B2 (en) | Global tone mapping | |
| US8363131B2 (en) | Apparatus and method for local contrast enhanced tone mapping | |
| CN110022469B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20070047803A1 (en) | Image processing device with automatic white balance | |
| KR100983037B1 (en) | Method for controlling auto white balance | |
| US20150097985A1 (en) | Compensating for sensor saturation and microlens modulation during light-field image processing | |
| JP7343090B2 (en) | Image processing system and method | |
| FI116327B (en) | Method and system for automatically adjusting color balance in a digital image processing chain, corresponding hardware and software means for implementing the method | |
| US20070041636A1 (en) | Apparatus and method for image contrast enhancement using RGB value | |
| US9355327B2 (en) | Image processing apparatus and imaging apparatus with noise correction function and signal level correction function | |
| WO2019104047A1 (en) | Global tone mapping | |
| CN105338214A (en) | Image processing method and image processing device | |
| US20100238317A1 (en) | White balance processing apparatus, method for processing white balance, and white balance processing program | |
| CN110807735A (en) | Image processing method, image processing device, terminal equipment and computer readable storage medium | |
| JP4290965B2 (en) | How to improve the quality of digital images | |
| CN112598609A (en) | Dynamic image processing method and device | |
| JP2008305122A (en) | Image-processing apparatus, image processing method and program | |
| CN116416144A (en) | Image processing method and system for parameter adjustment based on feedback | |
| KR101131109B1 (en) | Auto white balance setting method by white detection considering sensor characteristic | |
| Garud et al. | A fast color constancy scheme for automobile video cameras | |
| US20100189350A1 (en) | Image processing apparatus, image processing method, and program | |
| CN116416146A (en) | Image processing method and system for parameter adjustment based on direct feedback | |
| GB2588616A (en) | Image processing method and apparatus | |
| JP2019040382A (en) | Image processing device | |
| US11696044B2 (en) | Image capturing apparatus, control method, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |