CN105704363B - Image data processing method and device - Google Patents
Image data processing method and device Download PDFInfo
- Publication number
- CN105704363B CN105704363B CN201410709462.0A CN201410709462A CN105704363B CN 105704363 B CN105704363 B CN 105704363B CN 201410709462 A CN201410709462 A CN 201410709462A CN 105704363 B CN105704363 B CN 105704363B
- Authority
- CN
- China
- Prior art keywords
- target pixel
- image data
- sub
- module
- pixels
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses an image data processing method and device, wherein the image data processing method comprises the following steps: searching a target pixel unit in original image data; superposing the brightness information of the sub-pixels corresponding to the target pixel in the target pixel unit; and outputting the image data superposed by the brightness information according to the pixel information of the target pixel. According to the invention, the brightness of the whole image is improved by superposing the brightness of the pixels corresponding to the target pixels of the original image data, and the image information is output through the information of the target pixels, so that the quality of image output is prevented from being reduced, and the imaging performance under low illumination is improved.
Description
Technical Field
The invention relates to the field of security monitoring, in particular to an image data processing method and device.
Background
At present, in order to make the image imaging effect under the low illumination condition better and ideal, a sensor is generally used to provide the output of a binning mode, that is, several pixels are merged and then output as one pixel. Therefore, the brightness of the image under the low illumination condition can be effectively improved, but the resolution of the image output is greatly reduced, and the mode has the following problems:
1) the size of the image output by the sensor is changed;
2) the image size related setting of the sensor and the ISP is required to be changed, and the flow is re-opened after the flow is closed and the new configuration is completed, so that at least several seconds of video interruption is caused when the image size of the sensor output and the image size of the ISP are switched;
3) when the mode is switched to the binding mode and the binding mode is switched back to the normal mode, the output clock and the time sequence of the sensor and the ISP are changed, which may cause the image data receiving abnormality and the image display abnormality of the rear-end image data receiving module or device in the mode switching process.
However, if software is adopted to perform binning and then upscale the video image to the original size after the video image is decoded, the image brightness has obvious step change, an ISP normal automatic exposure algorithm cannot be adopted, automatic exposure cannot be smooth and natural, and image processing is performed on yuv (ycbcr) processed by the ISP, so that image detail loss is caused.
Due to the above problems, the application of the sensor binding mode that can improve the sensitivity of the sensor cannot be adopted in the practical application of video monitoring.
An effective solution to the problems in the related art has not been proposed yet.
Disclosure of Invention
In view of the problems in the related art, the present invention provides an image data processing method, which can improve the performance of imaging under low illumination and can maintain the details of an image.
The technical scheme of the invention is realized as follows:
according to an aspect of the present invention, there is provided an image data processing method.
The method comprises the following steps:
searching a target pixel unit in original image data;
superposing the brightness information of the sub-pixels corresponding to the target pixel in the target pixel unit;
and outputting the image data superposed by the brightness information according to the pixel information of the target pixel.
The target pixel unit comprises at least one target pixel and a sub-pixel corresponding to the target pixel, and the sub-pixel is controlled by the sensor interface of the SIF module.
In addition, the method is realized based on the SIF module sensor interface, so that the size of the image cannot be changed, and the abnormality cannot occur when the image is output.
Wherein, the sub-pixel is controlled by SIF module sensor interface, including:
in the case of low illumination, the luminance information of the sub-pixels in the target pixel is superimposed.
According to another aspect of the present invention, there is provided an image data processing apparatus comprising:
the searching module is used for searching a target pixel unit in the original image data;
the superposition module is used for superposing the brightness information of the sub-pixels corresponding to the target pixels in the target pixel unit;
and the output module is used for outputting the image data superposed by the brightness information according to the pixel information of the target pixel.
The target pixel unit comprises at least one target pixel and a sub-pixel corresponding to the target pixel, and the sub-pixel is controlled by the sensor interface of the SIF module.
In addition, the device is realized by an SIF module sensor interface.
In addition, the superposition module of the device is further used for superposing the brightness information of the sub-pixels in the target pixel under the condition of low illumination.
According to the invention, the brightness of the whole image is improved by superposing the brightness of the pixels corresponding to the target pixels of the original image data, and the image information is output through the information of the target pixels, so that the quality of image output is prevented from being reduced, and the imaging performance under low illumination is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a flow chart of an image data processing method according to an embodiment of the present invention;
fig. 2 is a block diagram of an image data processing apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present invention.
The invention utilizes original image data obtained by the prior sensitization performance of a sensor to carry out reprocessing so as to improve the imaging performance of the image data under low illumination, and the image data processing method according to the embodiment of the invention is shown in figure 1 and comprises the following steps:
step S101, searching a target pixel unit in original image data, wherein each pixel unit comprises at least one sub-pixel;
step S103, overlapping the brightness information of the sub-pixels corresponding to the target pixel in the target pixel unit;
step S105, outputting the image data superimposed with the luminance information according to the pixel information of the target pixel itself.
According to the invention, the scheme is realized in the SIF module, the original image data output by the sensor can be utilized to keep the image details as much as possible, in the specific implementation process, the SIF module firstly detects the current shooting scene, and if the current scene is not the low illumination condition, the normal shooting mode is adopted. Specifically, the target pixel unit of the original image data is searched, the target pixel unit belongs to an area of the original image data, the size of the range of the target pixel unit can be set according to the actual shooting situation, the target pixel unit comprises at least one target pixel and a plurality of sub-pixels adjacent to the target pixel, the setting of the target pixel can also be defined by selecting a selection threshold or a selection condition of the target pixel according to the actual requirement, in the case of low lighting, an imaged image is generally dark, therefore, the brightness information of the sub-pixels is superposed, so that the brightness of the original image can be increased, and the information of the target pixel is used for outputting the image data in order to keep the details of the image.
In the SIF module, according to different color channels such as (R, Gr, Gb, B, channel) to which a target pixel point belongs, with the target pixel point as a center and n x n (such as 3x3) as a window, pixel units of the same color channel adjacent to the target pixel point are searched, and the pixel unit values are superimposed with different weights to obtain a final output value of the target pixel point. One simple example of a weight is as follows:
therefore, the high-brightness image with the similar 2x2sensor binding effect can be obtained, the characteristic information of the target pixel point can be kept as much as possible, and the method does not change the output size of the image.
In order to further obtain image data with higher quality, the inventor further performs optimization processing on the above specific embodiment, specifically, in the original image data, all pixel units included in one region are searched, and one or more pixel units are selected as target pixel units. Based on the one or more target pixel cells, pixel characteristics of pixel cells of a neighborhood of the target pixel cell are then determined, which may include: luminance values and/or chrominance values. And selecting a plurality of sub-pixels with the same or similar color types or types as the determined target pixel unit from a plurality of pixel units in the neighborhood, carrying out weighted average to obtain the pixel value of the output image, and enabling the position relationship of the selected plurality of sub-pixels and the position relationship of the determined target pixel of the target pixel unit to meet the weighted average relationship.
In addition, the invention is implemented based on the SIF module, so that the configuration of the sensor is not required to be changed, the clock of the sensor and the size of an output image can be kept unchanged, the sensor is not required to be changed along with the switching of the mode, the switching flow is not required during the mode switching, the video is continuous, and the automatic exposure algorithm can achieve natural and smooth effect by combining the mode switching.
In addition, the SIF module has a detection function, and only when the SIF module detects that the SIF module is in the low illumination mode, the SIF module controls the sub-pixels to carry out brightness information superposition, and the SIF module adopts a normal mode to shoot under other conditions, so that the resource consumption can be reduced.
There is also provided, according to an embodiment of the present invention, an image data processing apparatus, as shown in fig. 2, including:
a searching module 21, configured to search a target pixel unit in original image data;
a superimposing module 22, configured to superimpose luminance information of sub-pixels corresponding to the target pixel in the target pixel unit;
and the output module 23 is configured to output the image data obtained by superimposing the luminance information according to the pixel information of the target pixel.
The target pixel unit comprises at least one target pixel and a sub-pixel corresponding to the target pixel, and the sub-pixel is controlled by the sensor interface of the SIF module.
In addition, the device is realized by an SIF module sensor interface.
In addition, the superposition module of the device is further used for superposing the brightness information of the sub-pixels in the target pixel under the condition of low illumination.
In addition, the apparatus further includes a detection module (not shown) for detecting a current photographing environment and performing photographing mode switching according to the current environment.
In summary, the brightness of the whole image is improved by superimposing the brightness of the pixels corresponding to the target pixels of the original image data, and then the image information is output through the information of the target pixels, so that the quality of image output is prevented from being reduced, and the imaging performance under low illumination is improved.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (8)
1. An image data processing method characterized by comprising:
searching a target pixel unit in original image data according to a preset selection condition, wherein the target pixel unit comprises a target pixel and a plurality of first sub-pixels which are adjacent to the target pixel and have the same color type;
weighted average the brightness information of the first sub-pixel corresponding to the target pixel in the target pixel unit with corresponding weight,
selecting a plurality of second sub-pixels with the same color type as the target pixel unit from the neighborhood of the target pixel unit, and carrying out weighted average to obtain a pixel value of an output image, wherein the position relation between the selected second sub-pixels and the target pixel of the target pixel unit satisfies the weighted average relation; and outputting the image data superposed by the brightness information according to the pixel information of the target pixel.
2. The method according to claim 1, wherein the target pixel unit comprises at least one target pixel and a first sub-pixel corresponding to the target pixel, and the first sub-pixel is controlled by a SIF module sensor interface.
3. The image data processing method according to claim 1, wherein the image data processing is implemented by SIF module sensorinerface.
4. The method according to claim 2, wherein the first sub-pixel is controlled by a SIF module sensorinenterface, comprising:
in the case of low illumination, the luminance information of the sub-pixels in the target pixel is superimposed.
5. An image data processing apparatus characterized by comprising:
the device comprises a searching module, a selecting module and a processing module, wherein the searching module is used for searching a target pixel unit in original image data according to a preset selection condition, and the target pixel unit comprises a target pixel and a plurality of first sub-pixels which are adjacent to the target pixel and have the same color type;
a superposition module for performing weighted average on the brightness information of the first sub-pixel corresponding to the target pixel in the target pixel unit by corresponding weight,
selecting a plurality of second sub-pixels with the same color type as the target pixel unit from the neighborhood of the target pixel unit, and carrying out weighted average to obtain a pixel value of an output image, wherein the position relation between the selected second sub-pixels and the target pixel of the target pixel unit satisfies the weighted average relation;
and the output module is used for outputting the image data superposed by the brightness information according to the pixel information of the target pixel.
6. The apparatus according to claim 5, wherein the target pixel unit comprises at least one target pixel and a first sub-pixel corresponding to the target pixel, and the first sub-pixel is controlled by the SIF module sensor interface.
7. The image data processing apparatus according to claim 5, wherein the image data processing apparatus is implemented by a SIF module sensor interface.
8. The image data processing apparatus according to claim 6, wherein the superimposing module is further configured to superimpose luminance information of the sub-pixels in the target pixel in a case of low illumination.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410709462.0A CN105704363B (en) | 2014-11-28 | 2014-11-28 | Image data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410709462.0A CN105704363B (en) | 2014-11-28 | 2014-11-28 | Image data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105704363A CN105704363A (en) | 2016-06-22 |
| CN105704363B true CN105704363B (en) | 2020-12-29 |
Family
ID=56230558
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410709462.0A Active CN105704363B (en) | 2014-11-28 | 2014-11-28 | Image data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105704363B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331520A (en) * | 2016-11-18 | 2017-01-11 | 乐视控股（北京）有限公司 | Photograph method, device and electronic equipment |
| CN109863742B (en) * | 2017-01-25 | 2021-01-29 | 华为技术有限公司 | Image processing method and terminal device |
| WO2021056538A1 (en) * | 2019-09-29 | 2021-04-01 | 深圳市大疆创新科技有限公司 | Image processing method and device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024285A (en) * | 2011-09-20 | 2013-04-03 | 三菱电机株式会社 | Image processing device, image processing method and imaging device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101175219B (en) * | 2006-11-03 | 2010-11-03 | 兆宏电子股份有限公司 | Color interpolation method and image processing apparatus using the same |
| JP2008131580A (en) * | 2006-11-24 | 2008-06-05 | Olympus Imaging Corp | Imaging apparatus, and image processing method |
| CN101754027B (en) * | 2008-12-02 | 2011-09-14 | 华晶科技股份有限公司 | Image compensation method and digital camera device thereof |
| JP5044673B2 (en) * | 2010-03-25 | 2012-10-10 | 株式会社東芝 | Solid-state imaging device and image recording device |
| EP2728545B1 (en) * | 2012-08-07 | 2018-07-11 | Spreadtrum Communications (Shanghai) Co., Ltd. | Image processing method and device based on bayer format |
| CN104079848A (en) * | 2014-07-02 | 2014-10-01 | 中国科学院长春光学精密机械与物理研究所 | Numeric field L-type pixel binning method |
-
2014
- 2014-11-28 CN CN201410709462.0A patent/CN105704363B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024285A (en) * | 2011-09-20 | 2013-04-03 | 三菱电机株式会社 | Image processing device, image processing method and imaging device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105704363A (en) | 2016-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111028189B (en) | Image processing method, device, storage medium and electronic equipment | |
| EP3308537B1 (en) | Calibration of defective image sensor elements | |
| US10021313B1 (en) | Image adjustment techniques for multiple-frame images | |
| US8446481B1 (en) | Interleaved capture for high dynamic range image acquisition and synthesis | |
| US10467733B2 (en) | Multiplexed high dynamic range images | |
| US9626760B2 (en) | System and method to align and merge differently exposed digital images to create a HDR (High Dynamic Range) image | |
| WO2017214523A1 (en) | Mismatched foreign light detection and mitigation in the image fusion of a two-camera system | |
| EP2987135A2 (en) | Reference image selection for motion ghost filtering | |
| CN107395991B (en) | Image synthesis method, image synthesis device, computer-readable storage medium and computer equipment | |
| BR112013007146B1 (en) | METHOD, IMAGE SIGNAL PROCESSING SYSTEM AND ELECTRONIC DEVICE FOR FLASH SYNCHRONIZATION USING IMAGE SENSOR INTERFACE TIME SIGNAL | |
| CN108717691B (en) | Image fusion method and device, electronic equipment and medium | |
| US7796806B2 (en) | Removing singlet and couplet defects from images | |
| CN105187728B (en) | Photographic method and device | |
| CN110855958B (en) | Image adjusting method and device, electronic equipment and storage medium | |
| CN104618691A (en) | Panoramic brightness balance regulating system and regulating method | |
| CN105704363B (en) | Image data processing method and device | |
| EP3363193B1 (en) | Device and method for reducing the set of exposure times for high dynamic range video imaging | |
| CN111724448A (en) | Image super-resolution reconstruction method and device and terminal equipment | |
| CN111160340B (en) | Moving object detection method and device, storage medium and terminal equipment | |
| CN110211065B (en) | Color correction method and device for food material image | |
| CN110930340A (en) | Image processing method and device | |
| JP2015126455A5 (en) | ||
| CN116647760B (en) | Wide dynamic implementation method, device, camera and storage medium for target detection | |
| US20220138909A1 (en) | Noise processing in image frames for digital video | |
| EP2996328A1 (en) | Image processing method and apparatus, and image capturing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190314 Address after: 519031 Room 105-15070, No. 6 Baohua Road, Hengqin New District, Zhuhai City, Guangdong Province Applicant after: Guangdong Vimicro Corp Address before: 519015 room 105, 6 Baohua Road, Hengqin New District, Zhuhai, Guangdong, China 478 Applicant before: GUANGDONG ZHONGXING ELECTRONICS CO., LTD. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |