JP6073403B2 - Image data generation method and image data generation apparatus - Google Patents

Description

  The present invention relates to an image processing mechanism, and more particularly to an image data generation method and apparatus.

  With the development of science and technology, digital cameras have become indispensable electrical products in daily life. A digital camera uses a photosensitive sensor to convert a light beam into a charge signal. Since the photosensitive sensor of the digital camera performs a sampling operation on the image after the light beam passes through the lens, the target to be sampled is dense and has a pattern with overlapping figures or lines. When the spatial resolution of the sensor (Spatial Resolution) is not enough, the sampling target cannot be analyzed effectively, and as a result, image distortion phenomena such as interference fringes that are not originally found with the naked eye in the generated image. It can be seen.

  In order to solve this problem, digital camera manufacturers install a low-pass filter (LPF) in the digital camera, and light with a very high spatial frequency enters the photosensitive sensor by the low-pass filter. And the generation of interference fringes is reduced. However, the low-pass filter detracts from the details of the image, thus reducing the sharpness of the image.

JP 2009-271058 A

  The present invention provides a method and apparatus for generating image data, and reduces the phenomenon of shadows in an original image.

The present invention has the following configuration in order to solve the above-described problems.
An original image is acquired by a photosensitive sensor, the photosensitive sensor includes a plurality of photosensitive units, each of the photosensitive units includes a plurality of photosensitive pixels, and the original image is determined by a plurality of luminance values detected by each of the photosensitive units. An image data generation method for forming display pixels in
Obtaining a corresponding maximum luminance distribution range in the original image of each photosensitive unit;
By adding the luminance values within the maximum luminance distribution range to which each of a plurality of color lights corresponds, a luminance value after addition for each color light of each photosensitive unit is obtained,
The luminance value after addition for each color light of each photosensitive unit is set as pixel data of a display pixel corresponding to the adjusted image.

The colored light includes red light, green light, and blue light, each of the photosensitive units includes N1 × N2 photosensitive pixels, and N1 and N2 are positive integers,
Obtaining the corresponding maximum luminance distribution range in the original image of each photosensitive unit;
The highest M photosensitive pixel rows of the plurality of luminance values in the N1 photosensitive pixel rows of each of the photosensitive units are read, the maximum luminance distribution range is set to be the M photosensitive pixel rows, and the M Each photosensitive pixel row includes M × N2 photosensitive pixels. When N1 is a multiple of 3, M is set to N1 / 3. When N1 is not a multiple of 3, M is N1 / 3. Or M is set to an integer of x + 1.

The step of setting the maximum luminance distribution range to be the M photosensitive pixel rows,
For each color light, add the luminance value of each photosensitive pixel column in each photosensitive unit,
Setting the highest M photosensitive pixel columns in the value after adding the luminance values to be within the maximum luminance distribution range.

The step of setting the maximum luminance distribution range to be the M photosensitive pixel rows,
For each color light, after adding the luminance value of each photosensitive pixel row in each photosensitive unit, it is averaged,
Setting the highest M photosensitive pixel columns in the averaged value after adding the luminance values to be within the maximum luminance distribution range.

The step of setting the maximum luminance distribution range to be the M photosensitive pixel rows,
For each of the color lights, it is determined whether or not the luminance value that exceeds half of each photosensitive pixel column in each photosensitive unit is greater than a threshold value,
The M number of photosensitive pixel rows in which the luminance value exceeding half is larger than the threshold value is set as the maximum luminance distribution range.

In the image data generation device,
A plurality of photosensitive units, each photosensitive unit including a plurality of photosensitive pixels, and a photosensitive sensor that forms display pixels in an original image according to a plurality of luminance values detected by each of the photosensitive units;
A storage unit including a plurality of modules;
A processing unit coupled to the photosensitive sensor and the storage unit, and obtaining image data for forming the original image by the photosensitive sensor and generating an adjusted image by the plurality of modules;
The plurality of modules are:
A luminance detection module in which each photosensitive unit obtains a corresponding maximum luminance distribution range in the original image;
A luminance addition module that obtains a luminance value after addition for each color light of each of the photosensitive units by adding the plurality of luminance values within the maximum luminance distribution range to which a plurality of color lights respectively correspond;
An image generation module that sets the luminance value after addition for each color light of each of the photosensitive units as pixel data of a display pixel corresponding to the adjusted image;
Is provided.

  As described above, the adjusted image of the present invention can greatly reduce the shadow phenomenon such as interference fringes included in the original image, improve the sharpness of the adjusted image, and perform each subsequent image processing. Can support image analysis.

1 is a block diagram of an image data generation device according to an embodiment of the present invention. It is a schematic diagram of the photosensitive unit based on one Example of this invention. It is a block diagram of the storage unit based on one Example of this invention. 4 is a flowchart of a method for generating image data according to an embodiment of the present invention. FIG. 6 is a schematic diagram of a maximum luminance distribution range for a single photosensitive unit according to an embodiment of the present invention. FIG. 6 is a schematic diagram of a maximum luminance distribution range for a single photosensitive unit according to an embodiment of the present invention. FIG. 6 is a schematic diagram of a maximum luminance distribution range for a single photosensitive unit according to an embodiment of the present invention.

  In order to make the above features and advantages easier to understand, the present invention will be described in detail with reference to the following examples.

  FIG. 1 is a block diagram of an image data generation apparatus according to an embodiment of the present invention. Referring to FIG. 1, the image data generation device 100 is an electric device having an image acquisition function such as a digital camera, a digital video camera, or a smartphone. Here, the image data generation apparatus 100 includes a photosensitive sensor 110, a processing unit 120, and a storage unit 130. The processing unit 120 is coupled to the photosensitive sensor 110 and the storage unit 130. The photosensitive sensor 110 is used to capture a light beam through a lens (not shown) and convert the light beam into a charge signal. Thereafter, the processing unit 120 receives the charge signal, samples and digitizes the charge signal to obtain digitized image data, and then stores the image data in the storage unit 130.

  The photosensitive sensor 110 is, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor transistor (CMOS). The processing unit 120 is, for example, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), or the like. The storage unit 130 is a non-volatile memory, a random access memory (RAM), a hard disk drive, or the like.

  Specifically, FIG. 2 is a schematic view of a photosensitive unit based on an embodiment of the present invention. Here, the photosensitive sensor 110 includes a plurality of photosensitive units U (that is, a range indicated by a thick black line in FIG. 2). Each photosensitive unit U includes N1 × N2 photosensitive pixels SP, and an enlarged view is shown in a circular frame drawn by a broken line in FIG. N1 and N2 described above are positive integers, and N1 may be equal to N2, or N1 may be different from N2. For ease of explanation, in this embodiment, the photosensitive sensor 110 is set to include 5 × 6 sets of photosensitive units U, and one photosensitive unit U includes 5 × 5 photosensitive images SP.

  In this embodiment, one photosensitive pixel SP can detect the wavelength intensities of red, green, and blue three-color light. That is, each display pixel of the original image in the present embodiment is configured by 5 × 5 sets of RGB luminance values detected by 5 × 5 photosensitive pixels SP.

  This embodiment is realized by a program code. For example, the storage unit 130 stores a plurality of code snippets, and the code snippets described above are implemented by the processing unit 120 after being implemented. For example, the storage unit 130 includes a plurality of modules, each of which performs a plurality of functions, and each module is configured by one or a plurality of code snippets.

  FIG. 3 is a block diagram of a storage unit according to one embodiment of the invention. Referring to FIG. 3, the storage unit 130 includes a luminance detection module 301, a luminance addition module 303, and an image generation module 305. The luminance detection module 301 acquires a maximum luminance distribution range corresponding to each color light for each photosensitive unit U based on a plurality of luminance values included in each color light for each photosensitive unit U. The luminance addition module 303 adds a plurality of luminance values within the maximum luminance distribution range corresponding to each color light of each photosensitive unit U, and obtains a luminance value after addition of each color light of each photosensitive unit U. The image generation module 305 sets the luminance value after addition of each color light for each photosensitive unit U as pixel data of the display pixel corresponding to the adjusted image.

  FIG. 4 is a flowchart of a method for generating image data according to an embodiment of the present invention. 1 to 4, in this embodiment, the processing unit 120 acquires image data for forming an original image by the photosensitive sensor 110. The image data detected by the photosensitive sensor 110 includes luminance values of a plurality of color lights. The color light includes red light, green light, and blue light.

  In step S <b> 410, the processing unit 120 acquires the corresponding maximum luminance distribution range in the original image of each photosensitive unit U by the luminance detection module 301. That is, the luminance detection module 301 acquires the maximum luminance distribution range corresponding to each color light of each photosensitive unit U based on a plurality of luminance values included in each color light in each display pixel of the original image.

  Specifically, the luminance detection module 301 reads M photosensitive pixel columns having the highest luminance value among N1 photosensitive pixel columns for each photosensitive unit U, and the maximum luminance distribution range is M photosensitive pixel columns. That is, M × N2 photosensitive pixels SP. When N1 is a multiple of 3, M is set to be N1 / 3, and when N1 is not a multiple of 3, M is set to be less than the minimum integer x of N1 / 3, or M is set to x + 1 Is done.

  For example, when N1 is a multiple of 3, M is set to 2 for 6 × 6 photosensitive pixels SP. That is, the maximum luminance distribution range is set to 2 × 6 photosensitive pixels SP. When N1 is not a multiple of 3, for 5 × 5 photosensitive pixels SP, M is set not to be smaller than the minimum integer x of 5/3, that is, 2 or M is set to 3. The That is, the maximum luminance distribution range is set to 2 × 5 photosensitive pixels SP, or 3 × 5 photosensitive pixels SP.

  The luminance detection module 301 detects the maximum luminance distribution range of each photosensitive unit for each color light. For example, taking red light as an example, the luminance detection module 301 first obtains N1 × N2 luminance values of red light detected by one photosensitive unit U, and then based on these luminance values. Thus, the M photosensitive pixel rows having the maximum luminance are searched. Green light and blue light are also processed in the same manner.

  There are several methods for finding the M pixel photosensitive pixel columns having the maximum luminance as follows. The luminance detection module 301 adds the luminance value of each photosensitive pixel column to each color light for each photosensitive unit U, and maximizes the highest M photosensitive pixel columns in the value after addition of these luminance values. Set to be in the luminance distribution range. Alternatively, the luminance detection module 301 adds the maximum luminance value of each photosensitive pixel column for each color light unit after adding the maximum luminance value, and calculates the highest M photosensitive pixel columns in the averaged value after the addition. Set to be the maximum luminance distribution range. In addition, the luminance detection module 301 also determines, for each photosensitive unit U, whether or not the luminance value that exceeds half of each photosensitive pixel column is greater than the threshold for each color light, and the luminance value that exceeds half is the threshold. The larger M photosensitive pixel columns are set to be within the maximum luminance distribution range. However, the above description is only an example, and the present invention is not limited to this.

  The maximum luminance distribution range of a single photosensitive unit will be described below with an example.

  5A to 5C are schematic diagrams of a maximum luminance distribution range for a single photosensitive unit according to an embodiment of the present invention. In this embodiment, taking the photosensitive unit U1 corresponding to the display pixel in the original image as an example, the photosensitive unit U1 includes 5 × 5 photosensitive pixels. However, this is merely an example, and the present invention is not limited to this.

  Here, the maximum luminance distribution range of one kind of color light in the photosensitive unit U1 is, for example, 2 × 5 photosensitive pixels SP. For example, the maximum luminance distribution range 501 to 503 shown in FIGS. Like a kind of inside. However, this is just an example and changes according to the actual distribution situation. In other embodiments, the maximum luminance distribution may be 3 × 5 photosensitive pixels SP. The photosensitive pixel rows including the maximum luminance distribution are connected and integrated.

  After obtaining the maximum luminance distribution range of each color light for each photosensitive unit, in step S415, the processing unit 120 adds the luminance value within the maximum luminance distribution range corresponding to each color light for each photosensitive unit by the luminance addition module 303. Thus, the luminance value after addition of each color light in each photosensitive unit is obtained.

  In step S420, the processing unit 120 uses the image generation module 305 to set the luminance value after addition of each color light for each photosensitive unit as the pixel data of the display pixel corresponding to the adjusted image.

  Taking the photosensitive unit of FIGS. 5A to 5C as an example, if the maximum luminance distribution range 501 of red light is shown in FIG. 5A, the maximum luminance distribution range 502 of green light is shown in FIG. 5B. The maximum luminance distribution range 503 for blue light is shown in FIG. 5C. However, these are for ease of explanation, and the present invention is not limited to these. The luminance addition module 303 obtains the luminance value R-Sum after addition by adding the luminance values included in the maximum luminance distribution range 501 and adds the luminance value included in the maximum luminance distribution range 502 to obtain the luminance after addition. The value G-Sum is acquired, and the luminance value B-Sum after the addition is acquired by adding the luminance values included in the maximum luminance distribution range 503. For this reason, the luminance addition module 303 can acquire one set of new pixel data (R-Sum, G-Sum, B-Sum) corresponding to the photosensitive unit U1.

  Thereafter, the image generation module 305 generates an adjusted image based on the pixel dimensions of the original image, and the new pixel data (R-Sum, G-Sum, B-Sum) acquired by the luminance addition module 303 is obtained. The pixel data of the display pixel corresponding to the photosensitive unit U1 in the adjusted image is set. By analogy with this, the image data of each display pixel in the adjusted image may be set one by one by the above-described method.

  When each RGB data in the original image is displayed using 24 bits (that is, one color light uses 8 bits), one display pixel in the original image is N1 × N2 24 bits. Use memory space. For example, when each RGB data in the adjusted image is displayed using 48 bits (that is, one color light uses 16 bits), one display pixel in the adjusted image has a 48-bit memory space. Only use.

  As described above, when analyzed from the angle of energy, the difference in the size and arrangement method of the photosensitive unit is that the image data output from the photosensitive unit generates a shadow phenomenon, but depending on the entire target to be sampled, The energy projected onto the image can actually reflect the energy and brightness of the image. By finding the maximum luminance distribution of each color light, it is possible to filter the luminance values detected by scattering in the photosensitive unit, thereby restoring the luminance similarity between the image and the target to be sampled, Further, the generation of interference fringes can be reduced, and the detailed table limit of the image can be further improved.

  Although the present invention has been described as an embodiment, this embodiment does not limit the scope of the present invention, and those who have ordinary knowledge in the art will not depart from the spirit and scope of the present invention. Modifications and additions are permitted, and the protection scope of the present invention shall cover an equivalent range.

100 Image data generation device 110 Photosensitive sensor 120 Processing unit 130 Storage unit 301 Luminance detection module 303 Luminance addition module 305 Image generation modules 501 to 503 Maximum luminance distribution range SP Photosensitive pixels U and U1 Photosensitive units S410 to S420 Each of the image data generation methods Step

Claims (10)

Acquiring an original image by the photosensitive sensor, the photosensitive sensor comprises a plurality of photosensitive units, the substrates to form a display pixel in the original image by a plurality of luminance values detected by each of the photosensitive units, each of the photosensitive units N1 × includes the N2 photosensitive pixels, N1 and N2 is a positive integer der Ru image data generating method,
Obtaining a corresponding maximum luminance distribution range in the original image of each photosensitive unit;
Obtaining the corresponding maximum luminance distribution range in the original image of each photosensitive unit;
The M photosensitive pixel rows having the highest luminance value in the N1 photosensitive pixel rows of each of the photosensitive units are read, and the M photosensitive pixel rows include M × N2 photosensitive pixels, and N1 When N is a multiple of 3, M is set to be N1 / 3, and when N1 is not a multiple of 3, M is set to be an integer x or x + 1, where x is the value of the quotient obtained at N1 / 3 Equals 1 plus 1
Setting the M photosensitive pixel rows to be within the maximum luminance distribution range,
By adding the luminance values within the maximum luminance distribution range to which each of a plurality of color lights corresponds, a luminance value after addition for each color light of each photosensitive unit is obtained,
The luminance value after addition for each color light of each photosensitive unit is set as pixel data of a display pixel corresponding to the adjusted image.
An image data generation method characterized by the above. The colored light is red light, green light, and including blue light,
The image data generation method according to claim 1, wherein: The step of setting that the M photosensitive pixel rows are within the maximum luminance distribution range includes:
For each color light, add the luminance value of each photosensitive pixel column in each photosensitive unit,
Setting the highest M photosensitive pixel columns in the value after adding the luminance values to be within the maximum luminance distribution range,
The method of generating image data according to claim 1 , wherein: The step of setting that the M photosensitive pixel rows are within the maximum luminance distribution range includes:
For each color light, after adding the luminance value of each photosensitive pixel row in each photosensitive unit, it is averaged,
Setting the highest M photosensitive pixel columns in the averaged value after adding the luminance values to be the maximum luminance distribution range,
The image data generation method according to claim 1, wherein the image data generation method is an image data generation method according to claim 1 . The step of setting that the M photosensitive pixel rows are within the maximum luminance distribution range includes:
For each of the color lights, it is determined whether or not the luminance value that exceeds half of each photosensitive pixel column in each photosensitive unit is greater than a threshold value,
Setting the M photosensitive pixel rows whose luminance values exceeding half are larger than a threshold value to be within the maximum luminance distribution range;
The image data generation method according to claim 1, wherein the image data generation method is an image data generation method. In the image data generation device,
Includes a plurality of photosensitive units, to form a display pixel in the original image by a plurality of luminance values detected by each of said photosensitive units, each of the photosensitive unit includes a N1 × N2 pieces of photosensitive pixels, N1 and N2 are positive and a light-sensitive sensor Ru integer der,
A storage unit including a plurality of modules;
A processing unit coupled to the photosensitive sensor and the storage unit, and obtaining image data for forming the original image by the photosensitive sensor and generating an adjusted image by the plurality of modules;
The plurality of modules are:
A brightness detection module to acquire the maximum luminance distribution range corresponding in the original image of each of said photosensitive units,
A luminance addition module that obtains a luminance value after addition for each color light of each of the photosensitive units by adding the plurality of luminance values within the maximum luminance distribution range to which a plurality of color lights respectively correspond;
An image generation module that sets the luminance value after addition for each color light of each of the photosensitive units as pixel data of a display pixel corresponding to the adjusted image;
Equipped with a,
The luminance detection module reads the M photosensitive pixel columns having the highest luminance value in the N1 photosensitive pixel columns of each of the photosensitive units, and the maximum luminance distribution range is the M photosensitive pixel columns. The M photosensitive pixel columns include M × N2 photosensitive pixels, and when N1 is a multiple of 3, M is set to N1 / 3, and N1 is not a multiple of 3. And M is set to be an integer x or x + 1, where x is equal to the quotient obtained by N1 / 3 plus one . Wherein the plurality of color light red light, green light, and an image data generating apparatus according to the blue light in claim 6, characterized in including it. The luminance detection module adds the luminance value of each photosensitive pixel column in each photosensitive unit to each color light,
The highest M photosensitive pixel rows in the value after adding the luminance values are set as the maximum luminance distribution range;
The image data generation apparatus according to claim 6 . The luminance detection module averages the color light after adding the luminance values of the photosensitive pixel columns in the photosensitive units,
Setting the highest M photosensitive pixel rows in the value averaged after adding the luminance values as the maximum luminance distribution range;
The image data generation apparatus according to claim 6 , wherein the image data generation apparatus is an image data generation apparatus. The luminance detection module determines, for each of the color lights, whether or not the luminance value that exceeds half of each photosensitive pixel column in each photosensitive unit is greater than a threshold value.
Setting the M photosensitive pixel rows in which the plurality of luminance values exceeding half are larger than a threshold value to be within the maximum luminance distribution range;
The image data generation apparatus according to claim 6 , wherein the image data generation apparatus is an image data generation apparatus.

Images