WO2017041714A1

WO2017041714A1 - Method and device for acquiring rgb data

Info

Publication number: WO2017041714A1
Application number: PCT/CN2016/098318
Authority: WO
Inventors: 朱德志
Original assignee: 努比亚技术有限公司
Priority date: 2015-09-07
Filing date: 2016-09-07
Publication date: 2017-03-16
Also published as: CN105160628A; CN105160628B

Abstract

A method and device for acquiring RGB data. The device comprises: an acquisition module, configured to acquire a first horizontal interpolation result and a first vertical interpolation result of pixels corresponding to an R channel/B channel in an image and acquire a horizontal gradient and a vertical gradient of the pixels corresponding to the R channel/B channel in the image; a first reconstruction module, configured to determine that the absolute value of a difference between the acquired horizontal gradient and vertical gradient is greater than 0 and less than a first pre-set threshold and reconstruct a pixel value of a green G channel of the pixels corresponding to the R channel/B channel in the image according to a weighted mean of the acquired first horizontal interpolation result and first vertical interpolation result; and a second reconstruction module, configured to reconstruct a pixel value of the R channel/B channel of the pixels corresponding to the G channel in the image and reconstruct a pixel value of the B channel of the pixels corresponding to the R channel in the image and a pixel value of the R channel of the pixels corresponding to the B channel in the image according to the reconstructed pixel value of the G channel of the pixels corresponding to the R channel and the B channel in the image.

Description

Method and device for acquiring RGB data

Technical field

This document relates to, but is not limited to, image processing technology, and more particularly to a method and apparatus for acquiring data of RGB (Red Green Blue).

Background technique

Most of the existing image sensors, such as Complementary Metal Oxide Semiconductor (CMOS), in the process of acquiring images, each pixel has only one of RGB three channel data, therefore, the image needs to be demosaiced. That is, the missing data is obtained by interpolation, thereby obtaining complete RGB data.

Related methods for obtaining RGB data generally include:

First, the pixel values of the G channels of the pixels corresponding to the R channel and the B channel in the image are reconstructed. The process of reconstructing the pixel value of the G channel of the pixel corresponding to the R channel in the image is similar, and the process of reconstructing the pixel value of the G channel of the pixel corresponding to the B channel in the image is similar. Calculate the _{j1th column of the i1th row} according to the formula ΔV _i1,j1 =|G _i1-1,j1 -G _i1+1,j1 |+|2R _i1,j1 -R _i1-2,j1 -R _i1+2,j1 | The horizontal gradient of the pixel is _calculated according to the formula ΔH _i1,j1 =|G _i1,j1-1 -G _i1,j1+1 |+|2R _i1,j1 -R _i1,j1-2 -R _i1,j1+2 | The vertical gradient of the pixel in the j1th column of the i1th row; when ΔH _i1,j1 <ΔV _i1,j1 , according to the formula

Reconstructing the pixel value of the G channel of the pixel in the j1th column of the i1th row; when ΔH _i1,j1 >ΔV _i1,j1 , according to the formula

Reconstructing the pixel value of the G channel of the pixel in the j1th column of the i1th row; when ΔH _i1,j1 =ΔV _i1,j1 , according to the formula

The pixel value of the G channel of the pixel of the j1th column of the i1th row is reconstructed.

Where ΔH _i1,j1 is the vertical gradient of the pixel in the _{j1th column} of the _i1th row, ΔV _{i1, j1} is the horizontal gradient of the pixel in the _{j1th column} of the _i1th row, and G _{i1, j1-1} is the _i1th row (j1) 1) The pixel value of the G channel of the pixel of the column, G _{i1, j1+1} is the pixel value of the G channel of the pixel of the (i1+1)th column of the i1th row, and R _{i1, j1} is the j1 column of the i1th row The pixel value of the R channel of the pixel, R _{i1, j1-2} is the pixel value of the R channel of the pixel of the (i1-2)th column of the i1th row, and R _{i1, j1+2} is the i1th row (j1+2) The pixel value of the R channel of the pixel of the column, G _{i1-1, j1} is the pixel value of the G channel of the pixel of the j1th column of the (i1-1)th row, and G _{i1+1, j1} is the (i1+1)th row The pixel value of the G channel of the pixel of the _j1th column, R _{i1-2, j1} is the pixel value of the R channel of the pixel of the (j1)th row of the (i1-2)th row, and R _{i1+2, j1} is the (i1+2) The pixel value of the G channel of the pixel in the j1th column, g _{i1, j1} is the pixel value of the G channel of the pixel of the reconstructed i1th row and j1th column.

Next, the pixel values of the R channel of the pixel corresponding to the G channel and the B channel of the pixel corresponding to the G channel in the image are reconstructed. Optionally, according to the formula

Reconstructing the pixel value of the R channel of the pixel of the i2th row and the j2th column;

The pixel value of the B channel of the pixel of the i2th row and the j2th column is reconstructed.

Where r _{i2, j2} are the pixel values of the R channel of the pixel of the reconstructed i2 row and j2 column, and R _{i2-1, j2} are the pixel values of the R channel of the pixel of the (j2)th row and the j2th column, R _{i2+1, j2} is the pixel value of the R channel of the pixel of the j2th column of the (i2+1)th row, and G _{i2, j2} is the pixel value of the G channel of the pixel of the _{i2th row and the j2th} column, g _{i2-1 , j2} is the pixel value of the G channel of the pixel of the reconstructed (i2-1)th row j2 column, g _i2+1, _j2 is the pixel of the G channel of the pixel of the reconstructed (i2+1)th row j2 column The value, b _{i2, j2} is the pixel value of the B channel of the pixel of the _{reconstructed i2th} row and the j2th column, and B _{i2, j2-1} is the pixel value of the B channel of the pixel of the (i2-1)th column of the i2th row, B _{i2, j2+1} is the pixel value of the B channel of the pixel of the (i2th)th (j2+1)th column, and g _{i2, j2-1} is the G channel of the pixel of the reconstructed _i2th row (j2-1) column The pixel value, g _{i2, j2+1} is the pixel value of the G channel of the pixel of the reconstructed i2th row (j2+1) column.

Finally, reconstructing the pixel value of the B channel of the pixel corresponding to the R channel in the image, and the pixel value of the R channel of the pixel corresponding to the B channel in the image; optionally, reconstructing the pixel of the B channel of the pixel corresponding to the R channel in the image As an example, the process of reconstructing the pixel values of the R channel of the pixel corresponding to the B channel in the image is similar. According to the formula D ₄₅ (i3,j3)=|B _i3-1,j3+1 -B _i3+1,j3-1 |+|2g _i3,j3 -g _i3-1,j3+1 -g _{i3+1, J3-1} | Calculate the 45 degree gradient of the pixel in the _j3th column of the _i3rd line, according to the formula D ₁₃₅ (i3, j3)=|B _{i3-1, j3-1} -B _{i3+1, j3+1} |+|2g _I3,j3 -g _i3-1,j3-1 -g _i3+1,j3+1 |calculate the 135 degree gradient of the pixel of the _{j3th column of the i3th} row; when D ₄₅ (i3,j3)<D ₁₃₅ (i3, J3), according to the formula

Reconstruct the pixel value of the B channel of the pixel in the j3th column of the i3th row; when D ₄₅ (i3, j3) > D ₁₃₅ (i3, j3), according to the formula

Reconstruct the pixel value of the B channel of the pixel in the j3th column of the i3th row; when D ₄₅ (i3, j3)=D ₁₃₅ (i3, j3), according to the formula

The pixel value of the B channel of the pixel of the j3th column of the i3th row is reconstructed.

Where D ₄₅ (i3, j3) is the 45 degree gradient of the pixel of the _{i3th row and the j3th} column, and D ₁₃₅ (i3, j3) is the 145 degree gradient of the pixel of the _{i3th row and the j3th} column, B _{i3-1, j3 +1} is the pixel value of the B channel of the pixel of the (j3+1)th column of the (i3-1)th row, and B _{i3+1, j3-1} is the (i3+1)th row (j3-1) column of the (i3+1)th row. The pixel value of the B channel of the pixel, g _{i3, j3} is the pixel value of the G channel of the pixel of the i3th row and the j3th column of the reconstruction, and g _{i3-1, j3+1} is the reconstructed (i3-1) line ( J3+1) The pixel value of the G channel of the pixel of the column, g _i3+1, _j3-1 is the pixel value of the G channel of the pixel of the (i3+1)th row (j3-1) column of the reconstruction, B _{i3 -1, j3} _-1 is the pixel value of the B channel of the pixel of the (i3-1)th row (j3-1) column, B _{i3+1, j3+1} is the (i3+1)th row (j3+) 1) The pixel value of the B channel of the column of pixels, g _{i3-1, j3-1} is the pixel value of the G channel of the pixel of the (i3-1)th row (j3-1) column of the reconstruction, g _{i3+1 , j3+1} is the pixel value of the G channel of the pixel of the (i3+1)th column (j3+1) column of the reconstruction.

In the related method of acquiring RGB data, false color and moiré appear due to inappropriate neighborhood interpolation averaging, and this pseudo color and moiré will seriously affect the visual quality of the image.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

Embodiments of the present invention provide a method and apparatus for acquiring RGB data, which can reduce false color and moiré, thereby improving visual quality of an image.

An embodiment of the present invention provides an apparatus for acquiring red, green, and blue RGB data, including:

Obtaining a module, configured to acquire a first horizontal interpolation result and a first vertical interpolation result of pixels corresponding to a red R channel/blue B channel in the image; and acquire a level of a pixel corresponding to the R channel/B channel in the image Gradient and vertical gradients;

a first reconstruction module, configured to determine that an absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than a first preset threshold, according to the obtained first horizontal interpolation result and the first vertical difference result Weighted average reconstructed image pixel values of the green G channel of the pixel corresponding to the R channel/B channel;

a second reconstruction module, configured to reconstruct a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image; and reconstructing an R channel corresponding to the pixel value of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image The pixel value of the B channel of the pixel, and the pixel value of the R channel of the pixel corresponding to the B channel in the image.

Optional,

The first reconstruction module is further configured to: when determining that an absolute value of a difference between the horizontal gradient and the vertical gradient is equal to 0, according to the first horizontal interpolation result and the first vertical difference The average of the results reconstructs the pixel values of the G channels of the pixels corresponding to the R channel/B channel in the image.

Optional,

The first reconstruction module is further configured to: when it is determined that an absolute value of a difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is smaller than the vertical gradient And reconstructing, according to the first horizontal interpolation result, a pixel value of a G channel of a pixel corresponding to the R channel/B channel in the image;

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is greater than the vertical gradient, reconstructing according to the first vertical interpolation result The pixel value of the G channel of the pixel corresponding to the R channel/B channel in the image.

Optional,

The second reconstruction module is configured to acquire a second horizontal interpolation result or a second vertical interpolation result of the pixel corresponding to the G channel in the image, and reconstruct according to the second horizontal interpolation result or the second vertical interpolation result a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image;

Reconstructing the pixel value of the B channel of the pixel corresponding to the R channel in the image according to the pixel value of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and the pixel corresponding to the B channel in the image The pixel value of the R channel.

Optional,

The second reconstruction module is configured to reconstruct a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image;

Calculating a 45-degree interpolation result and a 135-degree interpolation result of the pixel corresponding to the R channel/B channel in the image according to pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and calculating the image a 45 degree gradient and a 135 degree gradient of pixels corresponding to the B channel/R channel;

Determining that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than 0 and less than a second predetermined threshold, according to the 45-degree interpolation result and the weighted average reconstruction of the 135-degree interpolation result The pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.

Optional,

The second reconstruction module is further configured to: when determining that the absolute value of the difference between the 45 degree gradient and the 135 degree gradient is equal to 0, according to the 45 degree interpolation result and the 135 degree interpolation result The average value reconstructs the pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.

Optional,

The second reconstruction module is further configured to: when it is determined that an absolute value of a difference between the 45 degree gradient and the 135 degree gradient is greater than the second preset threshold, and the 45 degree gradient is smaller than the a 135 degree gradient, reconstructing a pixel value of a B channel/R channel of a pixel corresponding to the R channel/B channel in the image according to the 45 degree interpolation result;

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is greater than the 135-degree gradient, according to the 135 degrees The interpolation result reconstructs the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.

Optionally, the obtaining module is configured to obtain a first horizontal interpolation result and a first vertical interpolation result of the pixel corresponding to the red R channel/blue B channel in the image by:

According to the formula

Calculating a first horizontal interpolation result of pixels corresponding to the R channel/B channel in the image;

According to the formula

Calculating a first vertical interpolation result of pixels corresponding to the R channel/B channel in the image;

Where g1 _{i1, j1} are the first horizontal interpolation result, g2 _{i1, j1} is the first vertical interpolation result, and G _{i1, j1-1} are the pixels of the G channel of the pixel of the (i1-1)th column (j1-1) column in the image. The value, G _{i1, j1+1} is the pixel value of the G channel of the pixel in the (i1+1)th column of the i1th row in the image, and A _{i1, j1} is the R channel/B of the pixel of the i1th row and the j1th column in the image. The pixel value of the channel, A _{i1, j1-2} is the pixel value of the R channel/B channel of the pixel of the (i1-2)th column in the i1th row of the image, and A _{i1, j1+2} is the i1th row of the image ( J1+2) the pixel value of the R channel/B channel of the pixel of the column; G _{i1-1, j1} is the pixel value of the G channel of the pixel of the (j1)th row and the j1th column of the image, G _{i1+1, J1} is the pixel value of the G channel of the pixel of the _j1th column of the (i1+1)th row in the image, and A _{i1-2, j1} is the R channel/B channel of the pixel of the (j1)th row of the (i1-2)th row in the image. The pixel value, A _{i1+2, j1} is the pixel value of the R channel/B channel of the pixel of the j1th column of the (i1+2)th row in the image.

Optionally, the acquiring module is configured to obtain a horizontal gradient and a vertical gradient of pixels corresponding to the R channel/B channel in the image by:

Calculate the R channel/B in the image according to the formula ΔH1 _i1,j1 =|G _i1-1,j1 -G _i1+1,j1 |+|2A _i1,j1 -G _i1-1,j1 -G _i1+1,j1 | The horizontal gradient of the pixel corresponding to the channel;

Calculate the R channel/B in the image according to the formula ΔH2 _i1,j1 =|G _i1,j1-1 -G _i1,j1+1 |+|2A _i1,j1 -G _i1,j1-1 -G _i1,j1+1 | The vertical gradient of the pixel corresponding to the channel;

Where ΔH1 _{i1, j1} is a horizontal gradient, ΔH2 _{i1, and j1} is a vertical gradient.

Optionally, the first reconstruction module is configured to implement, according to the obtained first horizontal interpolation result and the first vertical difference result, weighted average reconstructed pixels of the green channel of the pixel corresponding to the R channel/B channel in the image. value:

According to the formula

Reconstruct the pixel values of the reconstructed G channel of the pixel corresponding to the R channel/B channel in the image.

The embodiment of the invention further provides a method for acquiring red, green and blue RGB data, comprising:

Obtaining a first horizontal interpolation result and a first vertical interpolation result of the pixel corresponding to the red R channel/blue B channel in the image; acquiring a horizontal gradient and a vertical gradient of the pixel corresponding to the R channel/B channel in the image;

Judging that the absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than the first a preset threshold, and reconstructing, according to the obtained first horizontal interpolation result and the weighted average of the first vertical difference result, a pixel value of a G channel of a pixel corresponding to the R channel/B channel in the image;

Reconstructing the pixel values of the R channel/B channel of the pixel corresponding to the G channel in the image;

The pixel value of the B channel of the pixel corresponding to the R channel in the image and the pixel value of the R channel of the pixel corresponding to the B channel in the image are reconstructed according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image.

Optionally, the method further includes: when it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is equal to 0,

And reconstructing a pixel value of a G channel of a pixel corresponding to the R channel/B channel in the image according to the first horizontal interpolation result and the average value of the first vertical difference result.

Optionally, the method further includes:

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is smaller than the vertical gradient, reconstructing according to the first horizontal interpolation result a pixel value of a G channel of a pixel corresponding to the R channel/B channel in the image;

Optionally, the pixel values of the R channel/B channel of the pixel corresponding to the G channel in the reconstructed image include:

Obtaining a second horizontal interpolation result or a second vertical interpolation result of the pixel corresponding to the G channel in the image, and reconstructing a pixel corresponding to the G channel in the image according to the second horizontal interpolation result or the second vertical interpolation result The pixel value of the R channel/B channel.

Optionally, the pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image reconstructed according to the pixel value of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image include:

Determining that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than 0 and small And at a second preset threshold, reconstructing a pixel value of a B channel/R channel of a pixel corresponding to the R channel/B channel in the image according to the weighted average of the 45 degree interpolation result and the 135 degree interpolation result.

Optionally, the determining, according to the pixel value of the pixel corresponding to the G channel in the image and the pixel value of the reconstructed G channel, the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image further includes: when determining When the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is equal to 0, the R channel/B in the image is reconstructed according to the 45-degree interpolation result and the average value of the 135-degree interpolation result The pixel value of the B channel/R channel of the pixel corresponding to the channel.

Optionally, the determining, according to the pixel value of the pixel corresponding to the G channel in the image and the pixel value of the reconstructed G channel, the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image further includes:

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is smaller than the 135-degree gradient, according to the 45 degrees Interpolating results reconstructing pixel values of B channels/R channels of pixels corresponding to R channels/B channels in the image;

Optionally, obtaining a first horizontal interpolation result and a first vertical interpolation result of the pixel corresponding to the red R channel/blue B channel in the image, including:

According to the formula

Optional,

Obtaining the horizontal and vertical gradients of the pixels corresponding to the R channel/B channel in the image includes:

Optionally, the pixel value of the G channel of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the obtained first horizontal interpolation result and the weighted average of the first vertical difference result, including:

According to the formula

Compared with the related art, the technical solution of the embodiment of the present invention includes: acquiring a first horizontal interpolation result and a first vertical interpolation result of pixels corresponding to the R channel/B channel in the image; and acquiring pixels corresponding to the R channel/B channel in the image. a horizontal gradient and a vertical gradient; determining that the absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and smaller than the first predetermined threshold, according to the obtained first horizontal interpolation result and the first vertical difference result The pixel value of the G channel of the pixel corresponding to the R channel/B channel in the weighted average reconstructed image; the pixel value of the R channel/B channel of the pixel corresponding to the G channel in the reconstructed image; according to the pixel corresponding to the R channel and the B channel in the image The pixel value of the reconstructed G channel reconstructs the pixel value of the B channel of the pixel corresponding to the R channel in the image, and the pixel value of the R channel of the pixel corresponding to the B channel in the image. According to the solution of the embodiment of the present invention, when the absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than the first preset threshold, according to the obtained first horizontal interpolation result and the first vertical difference result The weighted average reconstructs the pixel values of the G channel of the pixel corresponding to the R channel or the B channel in the image, reducing the pseudo color and moiré, thereby improving the visual quality of the image.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present invention;

2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;

3 is a flowchart of a method for acquiring RGB data according to an embodiment of the present invention;

4 is a schematic diagram of an image according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an apparatus for acquiring RGB data according to an embodiment of the present invention.

Embodiments of the invention

In order to facilitate the understanding of those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings, and is not intended to limit the scope of the present invention. It should be noted that the embodiments in the present application and the various manners in the embodiments may be combined with each other without conflict.

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" set to indicate an element is merely an explanation for facilitating embodiments of the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.

The mobile terminal can be implemented in various forms. For example, the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.

FIG. 1 is a schematic diagram showing the hardware structure of a mobile terminal embodying various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, The user input unit 130, the sensing unit 140, the output unit 150, the memory 160, the interface unit 170, the controller 180, the power supply unit 190, and the like. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.

Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like. . The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems. In particular, the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H) The digital broadcasting system of the @) data broadcasting system, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .

The short range communication module 114 is a module that is configured to support short range communication. Some examples of short-range communication technology include Bluetooth ^TM, a radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. ^TM.

The location information module 115 is a module configured to check or acquire location information of the mobile terminal. A typical example of a location information module is GPS (Global Positioning System). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.

The A/V input unit 120 is arranged to receive an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 1220 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 1210 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touchpad is in the form of a layer When superimposed on the display unit 151, a touch screen can be formed.

The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. Sensing unit 140 may include proximity sensor 1410 which will be described below in connection with a touch screen.

The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 may be arranged to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 100 or may be used at the mobile terminal and external device Transfer data between.

In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in the phone call mode, the display unit 151 can display a call or other communication (eg, text) This messaging, multimedia file download, etc.) related user interface (UI) or graphical user interface (GUI). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be set to detect touch input pressure as well as touch input position and touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. The audio output module 152 can include a speaker, a buzzer, and the like.

The alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.

The memory 160 may store a software program or the like that performs processing and control operations performed by the controller 180, or may temporarily store data that has been output or is to be output (for example, a phone book, a message, Still images, videos, etc.). Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. Additionally, the controller 180 can include a multimedia module 1810 that is configured to reproduce (or play back) multimedia data, and the multimedia module 1810 can be constructed within the controller 180 or can be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.

The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.

So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, embodiments of the present invention can be applied to any type of Mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.

A communication system in which a mobile terminal is operable according to an embodiment of the present invention will now be described with reference to FIG.

Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to FIG. 2, a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 may include multiple BSC 2750s.

Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas that are set to receive diversity. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally refer to a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cellular stations.

As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In Figure 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 helps locate at least one of the plurality of mobile terminals 100.

In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.

As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals 100. Mobile terminal 100 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.

Based on the above-described mobile terminal hardware structure and communication system, various embodiments of the method of the present invention are proposed.

As shown in FIG. 3, a first embodiment of the present invention provides a method for acquiring RGB data, including:

Step 300: Acquire a first horizontal interpolation result of the pixel corresponding to the R channel/B channel in the image and a first vertical interpolation result; and obtain a horizontal gradient and a vertical gradient of the pixel corresponding to the R channel/B channel in the image.

Herein, "/" means replaceable, that is, the process of reconstructing the pixel value of the G channel of the pixel corresponding to the R channel in the reconstructed image and the pixel value of the G channel of the pixel corresponding to the B channel in the reconstructed image are the same.

In this step, the image refers to the acquired unprocessed original image. Figure 4 is a schematic illustration of an image. As shown in FIG. 4, the format of the odd lines in the image is RGRG..., and the format of the even lines is GBGB. FIG. 4 is only a schematic diagram of an image, and does not represent the format of an image that can be processed by the embodiment of the present invention. Any image in the bayer format can be interpolated by the method of the embodiment of the present invention.

In this step, the first horizontal interpolation result of the pixel corresponding to the R channel/B channel in the image is obtained. The first vertical interpolation result includes:

According to the formula

In this step, obtaining horizontal and vertical gradients of pixels corresponding to the R channel/B channel in the image includes:

Step 301: Determine that the absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than the first preset threshold, and reconstruct the image according to the obtained first horizontal interpolation result and the weighted average of the first vertical difference result. The pixel value of the G channel of the pixel corresponding to the R channel/B channel.

In this step, the pixel values of the G channel of the pixel corresponding to the R channel/B channel in the weighted average reconstructed image according to the obtained first horizontal interpolation result and the first vertical difference result include:

According to the formula

Reconstructing the pixel value of the reconstructed G channel of the pixel corresponding to the R channel/B channel in the image;

Where g _{i1, j1} is the pixel value of the reconstructed G channel of the pixel corresponding to the R channel/B channel in the image.

In this step, when it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is equal to 0, the R channel/B channel corresponding to the image is reconstructed according to the average of the first horizontal interpolation result and the first vertical difference result. The pixel value of the G channel of the pixel.

The pixel values of the G channel of the pixel corresponding to the R channel/B channel in the image are reconstructed according to the average of the first horizontal interpolation result and the first vertical difference result, including:

According to the formula

Reconstruct the pixel value of the G channel of the pixel corresponding to the R channel/B channel in the image.

In this step, when it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is smaller than the vertical gradient, the R channel/B channel corresponding to the image is reconstructed according to the first horizontal interpolation result. The pixel value of the G channel of the pixel. That is to say, the first horizontal interpolation result is directly taken as the pixel value of the reconstructed G channel.

In this step, when it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is greater than the vertical gradient, the R channel/B channel corresponding to the image is reconstructed according to the first vertical interpolation result. The pixel value of the G channel of the pixel. That is to say, the first vertical interpolation result is directly taken as the pixel value of the reconstructed G channel.

In this step, since the horizontal gradient and the vertical gradient are not much different, for example, the horizontal gradient is 10, and the vertical gradient is 13, at this time, if the two gradients can be accurately determined to be absolutely accurate, the gradient can be small. The interpolation result in the direction (ie, the edge direction) is used as the final interpolation result, so that the interpolation result is the most accurate. The problem now is that, due to other factors such as noise (main factor, noise is always present), if the calculated edge direction interpolation result is still used as the final result, the interpolation result cannot be guaranteed, so the result will be in the picture. A large number of moiré appears, which seriously affects the visual quality of the image (the actual result is also the same); when the gradient difference between the two directions is relatively small, since it is impossible to determine which direction is the final result direction (ie, the current direction cannot be judged) The edge is the actual edge), the weighted average of the interpolation results in both directions (experiment can greatly reduce the generation of moiré); and when the two gradients are relatively large, for example: horizontal gradient is 10, vertical The gradient is 130, so that even if there is noise, it can be considered that the edge direction can be accurately determined at this time, and the interpolation result of the edge direction can be used as the final result, and if the interpolation result in both directions is still used at this time, The weighted average, on the other hand, degrades the image quality (as well as the experimental results), so when the gradients are very different, the result of the small gradient (ie, the edge direction) is used as the final interpolation result.

Step 302: reconstruct a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image.

This step can be performed before or after any step, and is not affected by the order of execution of the other steps.

In this step, the pixel values of the R channel/B channel of the pixel corresponding to the G channel in the reconstructed image include:

Obtaining a second horizontal interpolation result or a second vertical interpolation result of the pixel corresponding to the G channel in the image, and reconstructing a pixel value of the R channel/B channel of the pixel corresponding to the G channel in the image according to the second horizontal interpolation result or the second vertical interpolation result .

The second horizontal interpolation result or the second vertical interpolation result of the pixel corresponding to the G channel in the image is:

According to the formula

Calculating a second horizontal interpolation result of the pixel corresponding to the G channel in the image;

Or according to the formula

Calculating a second vertical interpolation result of the pixel corresponding to the G channel in the image;

Where a1 _{i2, j2} is the second horizontal interpolation result, a2 _{i2, j2} is the second vertical interpolation result, and A _{i2-1, j2} is the R channel/B of the pixel of the (j2-1)th row j2 column in the image. The pixel value of the channel, A _{i2+1, j2} is the pixel value of the R channel/B channel of the pixel of the ( _j2 +1)th row and the j2th column in the image, and G _{i2, j2} is the i2th row and the j2th column in the image. The pixel value of the G channel of the pixel, G _{i2-2, j2} is the pixel value of the G channel of the pixel of the (j2-2)th row and the j2th column in the image, and G _{i2+2, j2} is the image (i2+2) The pixel value of the G channel of the pixel of the j2th column, A _{i2, j2-1} is the pixel value of the R channel/B channel of the pixel of the (i2-1)th column of the i2th row in the image, A _{i2, j2+ 1} is the pixel value of the R channel/B channel of the pixel of the (i2th)th column of the i2th row in the image, and G _{i2, j2-2} is the G channel of the pixel of the (i2th)th column of the i2th row in the image. The pixel value, G _{i2, j2+2} is the pixel value of the G channel of the pixel of the (i2+2)th column of the i2th row in the image.

Step 303: reconstruct, according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, the pixel value of the B channel of the pixel corresponding to the R channel in the image, and the pixel of the R channel of the pixel corresponding to the B channel in the image. value.

In this step, the pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image are reconstructed according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, including:

Calculate the 45-degree interpolation result and the 135-degree interpolation result of the pixel corresponding to the R channel/B channel in the image according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and calculate the B channel/R channel in the image. a 45-degree gradient and a 135-degree gradient of the corresponding pixel; determining that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than 0 and less than the second predetermined threshold, according to the 45-degree interpolation result and the 135-degree interpolation result The weighted average reconstructed pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.

The 45-degree interpolation result and the 135-degree interpolation result of the pixel corresponding to the R channel/B channel in the image are calculated according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and the 135 degree interpolation result includes:

According to the formula

Calculate the 45-degree interpolation result of the pixel corresponding to the R channel/B channel in the image;

Calculating a 135-degree interpolation result of pixels corresponding to the R channel/B channel in the image;

Where a1 _{i3, j3} are 45-degree interpolation results, a2 _{i3, j3} are 135-degree interpolation results, and A _{i3-1, j3+1} are pixels of the (i3-1)th row (j3+1) column in the image. The pixel value of the R channel/B channel, A _{i3+1, j3} _-1 is the pixel value of the R channel/B channel of the pixel of the (i3+1)th row (j3-1) column in the image, g _{i3, j3} The pixel value of the reconstructed G channel of the pixel of the i3th row and the j3th column in the image, g _{i3-1, j3+1} is the reconstructed pixel of the (j3+1)th column of the (i3-1)th row in the image. The pixel value of the G channel, g _{i3+1, j3-1} is the pixel value of the reconstructed G channel of the pixel of the (i3+1)th row (j3-1) column in the image, A _i3-1, _j3-1 The pixel value of the R channel/B channel of the pixel in the (j3-1)th column of the (i3-1)th line in the image, A _{i3+1, j3+1} is the (i3+1)th row in the image (j3 +1) the pixel value of the R channel/B channel of the pixel of the column, g _{i3-1, j3-1} is the pixel of the reconstructed G channel of the pixel of the (i3-1)th row (j3-1) column in the image The value, g _{i3+1, j3+1} is the pixel value of the reconstructed G channel of the pixel of the (j3+1)th column of the (i3+1)th row in the image.

Wherein, calculating a 45 degree gradient and a 135 degree gradient of the pixel corresponding to the B channel/R channel in the image include:

According to the formula D ₄₅ (i3,j3)=|A _i3-1,j3+1 -A _i3+1,j3-1 |+|2C _i3,j3 -A _i3-1,j3+1 -A _{i3+1, J3-1} | Calculate the 45-degree gradient of the pixel corresponding to the B channel/R channel in the image; according to the formula D ₁₃₅ (i3,j3)=|A _i3-1,j3-1 -A _i3+1,j3+1 |+ |2C _i3,j3 -A _i3-1,j3-1 -A _i3+1,j3+1 | Calculate the 135-degree gradient of the pixel corresponding to the B channel/R channel in the image;

Where D ₄₅ (i3, j3) is a 45 degree gradient, D ₁₃₅ (i3, j3) is a 135 degree gradient, and C _{i3, j3} are the pixel values of the B channel/R channel of the pixel of the i3th row and the j3th column in the image. .

The pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the weighted average reconstructed image according to the 45 degree interpolation result and the 135 degree interpolation result include:

According to the formula

Reconstructing the pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image;

Where a _{i3, j3} are the pixel values of the reconstructed B channel/R channel of the pixel corresponding to the R channel/B channel in the image.

Wherein, when it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is equal to 0, the B of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the average of the 45-degree interpolation result and the 135-degree interpolation result. The pixel value of the channel/R channel.

The pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image are reconstructed according to the 45-degree interpolation result and the average value of the 135-degree interpolation result, including:

According to the formula

Reconstructing the pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image; wherein a _{i3, j3} are the pixel values of the reconstructed B channel/R channel of the pixel corresponding to the R channel/B channel in the image, A1 _{i3, j3} is a 45-degree interpolation result, a2 _{i3, and j3} are 135-degree interpolation results.

When it is determined that the absolute value of the difference between the 45 degree gradient and the 135 degree gradient is greater than the second predetermined threshold, and the 45 degree gradient is less than the 135 degree gradient, the R channel in the image is reconstructed according to the 45 degree interpolation result The pixel value of the B channel/R channel of the pixel corresponding to the /B channel.

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is greater than the 135-degree gradient, the corresponding R channel/B channel in the image is reconstructed according to the 135-degree interpolation result. The pixel value of the B channel/R channel of the pixel.

In step 302, "/" means replaceable, that is, the process of reconstructing the pixel value of the B channel of the pixel corresponding to the R channel in the image, and the pixel value of the R channel of the pixel corresponding to the B channel in the image is similar. .

In this step, since the gradient between the 45-degree gradient and the 135-degree gradient is not large, for example, the gradient of 45 degrees is 10, and the gradient of 135 degrees is 13, if the two gradients can be accurately determined, it is absolutely accurate. The interpolation result in the direction in which the gradient is small (ie, the edge direction) can be used as the final interpolation result, so that the interpolation result is the most accurate. The problem now is that, due to other factors such as noise (main factor, noise is always present), if the calculated edge direction interpolation result is still used as the final result, the interpolation result cannot be guaranteed, so the result will be in the picture. A large number of moiré appears, which seriously affects the visual quality of the image (the actual result is also the same); when the gradient difference between the two directions is relatively small, since it is impossible to determine which direction is the final result direction (ie, the current edge cannot be judged as the actual edge) The weighted average of the interpolation results in both directions (the experiment can greatly reduce the generation of moiré); and when the two gradients are relatively large, for example, the gradient of 45 degrees is 10, and the gradient of 135 degrees is 130. Thus, even if there is noise, it can be considered that the edge direction can be accurately determined at this time, and the interpolation result of the edge direction can be used as the final result, and if the interpolation result of the two directions is still used for the weighted average, Decreased image quality (as well as experimental results), so gradients are used when the gradients are very different (I.e., the edge direction) as a result of the final interpolation result.

According to the solution of the embodiment of the present invention, when the absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than the first preset threshold, according to the obtained first horizontal interpolation result and the first vertical difference result The weighted average reconstructs the pixel values of the G channel of the pixel corresponding to the R channel or the B channel in the image, reducing the pseudo color and moiré, thereby improving the visual quality of the image.

Referring to FIG. 5, a second embodiment of the present invention further provides an apparatus for acquiring RGB data, including:

Obtaining a module, configured to acquire a first horizontal interpolation result and a first vertical interpolation result of pixels corresponding to the R channel/B channel in the image; and obtain a horizontal gradient of the pixel corresponding to the R channel/B channel in the image And vertical gradients;

a first reconstruction module, configured to determine that an absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than a first preset threshold, according to the obtained first horizontal interpolation result and the first vertical difference result Weighted average reconstructed image pixel values of G channels of pixels corresponding to R channels/B channels;

In the apparatus of the embodiment of the present invention, the first reconstruction module is further configured to:

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is equal to 0, the G channel of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the average of the first horizontal interpolation result and the first vertical difference result The pixel value.

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is smaller than the vertical gradient, reconstructing the G of the pixel corresponding to the R channel/B channel in the image according to the first horizontal interpolation result The pixel value of the channel.

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is greater than the vertical gradient, reconstructing the G of the pixel corresponding to the R channel/B channel in the image according to the first vertical interpolation result The pixel value of the channel.

In the apparatus of the embodiment of the present invention, the second reconstruction module is configured to:

Obtaining a second horizontal interpolation result or a second vertical interpolation result of the pixel corresponding to the G channel in the image, and reconstructing a pixel value of the R channel/B channel of the pixel corresponding to the G channel in the image according to the second horizontal interpolation result or the second vertical interpolation result ;

Calculate the 45-degree interpolation result and the 135-degree interpolation result of the pixel corresponding to the R channel/B channel in the image according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and calculate the B channel/R channel in the image. a 45 degree gradient and a 135 degree gradient of the corresponding pixel;

Determining that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than 0 and less than the second predetermined threshold, and corresponding to the R channel/B channel in the weighted average reconstructed image according to the 45-degree interpolation result and the 135-degree interpolation result The pixel value of the B channel/R channel of the pixel.

In the apparatus of the embodiment of the present invention, the second reconstruction module is further configured to:

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is equal to 0, the B channel of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the 45-degree interpolation result and the average value of the 135-degree interpolation result. The pixel value of the R channel.

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is less than the 135-degree gradient, the corresponding R channel/B channel in the image is reconstructed according to the 45-degree interpolation result. The pixel value of the B channel/R channel of the pixel.

The acquisition module, the first reconstruction module, and the second reconstruction module may all be disposed in the controller of FIG. 1.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention in essence or the contribution to the related art can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, air conditioner, or network device, etc.) to perform the methods described in various embodiments of the present invention.

The above is only an alternative embodiment of the present invention, and thus does not limit the scope of the invention, and the equivalent structure or equivalent process transformation made by using the specification and the drawings of the present invention, or directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Industrial applicability

The above technical solution reduces false color and moiré, thereby improving the visual quality of the image.

Claims

A device for obtaining red, green and blue RGB data, comprising:

Obtaining a module, configured to acquire a first horizontal interpolation result and a first vertical interpolation result of pixels corresponding to a red R channel/blue B channel in the image; and obtain a horizontal gradient and a vertical gradient of pixels corresponding to the R channel/B channel in the image;

a first reconstruction module, configured to determine that an absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and less than a first preset threshold, according to the obtained first horizontal interpolation result and the first vertical difference result Weighted average reconstructed image pixel values of the green G channel of the pixel corresponding to the R channel/B channel;

a second reconstruction module, configured to reconstruct a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image; and reconstructing an R channel corresponding to the pixel value of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image The pixel value of the B channel of the pixel, and the pixel value of the R channel of the pixel corresponding to the B channel in the image.
The device of claim 1

The first reconstruction module is further configured to: when determining that an absolute value of a difference between the horizontal gradient and the vertical gradient is equal to 0, according to the first horizontal interpolation result and the first vertical difference The average of the results reconstructs the pixel values of the G channels of the pixels corresponding to the R channel/B channel in the image.
The device of claim 1

The first reconstruction module is further configured to: when it is determined that an absolute value of a difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is smaller than the vertical gradient And reconstructing, according to the first horizontal interpolation result, a pixel value of a G channel of a pixel corresponding to the R channel/B channel in the image;

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is greater than the vertical gradient, reconstructing according to the first vertical interpolation result The pixel value of the G channel of the pixel corresponding to the R channel/B channel in the image.
The device according to claim 1 or 2 or 3, wherein

The second reconstruction module is configured to acquire a second pixel corresponding to the G channel in the image. a horizontal interpolation result or a second vertical interpolation result, and reconstructing, according to the second horizontal interpolation result or the second vertical interpolation result, a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image;

The pixel value of the B channel of the pixel corresponding to the R channel in the image and the pixel value of the R channel of the pixel corresponding to the B channel in the image are reconstructed according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image.
The device according to claim 1, wherein

The second reconstruction module is configured to reconstruct a pixel value of an R channel/B channel of a pixel corresponding to the G channel in the image;

Calculating a 45-degree interpolation result and a 135-degree interpolation result of the pixel corresponding to the R channel/B channel in the image according to pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and calculating the image a 45 degree gradient and a 135 degree gradient of pixels corresponding to the B channel/R channel;

Determining that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than 0 and less than a second predetermined threshold, according to the 45-degree interpolation result and the weighted average reconstruction of the 135-degree interpolation result The pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.
The device according to claim 5,

The second reconstruction module is further configured to: when determining that the absolute value of the difference between the 45 degree gradient and the 135 degree gradient is equal to 0, according to the 45 degree interpolation result and the 135 degree interpolation result The average value reconstructs the pixel values of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.
The device according to claim 5,

The second reconstruction module is further configured to: when it is determined that an absolute value of a difference between the 45 degree gradient and the 135 degree gradient is greater than the second preset threshold, and the 45 degree gradient is smaller than the a 135 degree gradient, reconstructing a pixel value of a B channel/R channel of a pixel corresponding to the R channel/B channel in the image according to the 45 degree interpolation result;

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is greater than the 135-degree gradient, according to the 135 degrees The interpolation result reconstructs the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.
The apparatus according to claim 1, wherein the acquisition module is set to pass the following The first horizontal interpolation result and the first vertical interpolation result of the pixel corresponding to the red R channel/blue B channel in the image are obtained:

According to the formula
Calculating a first horizontal interpolation result of pixels corresponding to the R channel/B channel in the image;

According to the formula
Calculating a first vertical interpolation result of pixels corresponding to the R channel/B channel in the image;

Where g1 i1, j1 are the first horizontal interpolation result, g2 i1, j1 is the first vertical interpolation result, and G i1, j1-1 are the pixels of the G channel of the pixel of the (i1-1)th column (j1-1) column in the image. The value, G i1, j1+1 is the pixel value of the G channel of the pixel in the (i1+1)th column of the i1th row in the image, and A i1, j1 is the R channel/B of the pixel of the i1th row and the j1th column in the image. The pixel value of the channel, A i1, j1-2 is the pixel value of the R channel/B channel of the pixel of the (i1-2)th column in the i1th row of the image, and A i1, j1+2 is the i1th row of the image ( J1+2) the pixel value of the R channel/B channel of the pixel of the column; G i1-1, j1 is the pixel value of the G channel of the pixel of the (j1)th row and the j1th column of the image, G i1+1, J1 is the pixel value of the G channel of the pixel of the j1th column of the (i1+1)th row in the image, and A i1-2, j1 is the R channel/B channel of the pixel of the (j1)th row of the (i1-2)th row in the image. The pixel value, A i1+2, j1 is the pixel value of the R channel/B channel of the pixel of the j1th column of the (i1+2)th row in the image.
The apparatus according to claim 8, wherein the obtaining module is configured to obtain a horizontal gradient and a vertical gradient of pixels corresponding to the R channel/B channel in the image by:

Calculate the R channel/B in the image according to the formula ΔH1 i1,j1 =|G i1-1,j1 -G i1+1,j1 |+|2A i1,j1 -G i1-1,j1 -G i1+1,j1 | The horizontal gradient of the pixel corresponding to the channel;

Calculate the R channel/B in the image according to the formula ΔH2 i1,j1 =|G i1,j1-1 -G i1,j1+1 |+|2A i1,j1 -G i1,j1-1 -G i1,j1+1 | The vertical gradient of the pixel corresponding to the channel;

Where ΔH1 i1, j1 is a horizontal gradient, ΔH2 i1, and j1 is a vertical gradient.
The apparatus according to claim 9, wherein the first reconstruction module is configured to implement the R channel/B channel corresponding to the weighted average reconstructed image according to the obtained first horizontal interpolation result and the first vertical difference result by: The pixel value of the green G channel of the pixel:

According to the formula
Reconstruct the pixel values of the reconstructed G channel of the pixel corresponding to the R channel/B channel in the image.
A method for obtaining red, green and blue RGB data, comprising:

Obtaining a first horizontal interpolation result and a first vertical interpolation result of the pixel corresponding to the red R channel/blue B channel in the image; acquiring a horizontal gradient and a vertical gradient of the pixel corresponding to the R channel/B channel in the image;

Determining that the absolute value of the difference between the obtained horizontal gradient and the vertical gradient is greater than 0 and smaller than the first preset threshold, and reconstructing the R channel in the image according to the obtained first horizontal interpolation result and the weighted average of the first vertical difference result The pixel value of the G channel of the pixel corresponding to the /B channel;

Reconstructing the pixel values of the R channel/B channel of the pixel corresponding to the G channel in the image;

The pixel value of the B channel of the pixel corresponding to the R channel in the image and the pixel value of the R channel of the pixel corresponding to the B channel in the image are reconstructed according to the pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image.
The method of claim 11 further comprising:

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is equal to 0, reconstructing R in the image according to the average of the first horizontal interpolation result and the first vertical difference result The pixel value of the G channel of the pixel corresponding to the channel/B channel.
The method of claim 11 further comprising:

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is smaller than the vertical gradient, reconstructing according to the first horizontal interpolation result a pixel value of a G channel of a pixel corresponding to the R channel/B channel in the image;

When it is determined that the absolute value of the difference between the horizontal gradient and the vertical gradient is greater than the first preset threshold, and the horizontal gradient is greater than the vertical gradient, reconstructing according to the first vertical interpolation result The pixel value of the G channel of the pixel corresponding to the R channel/B channel in the image.
The method according to claim 11 or 12 or 13, wherein the pixel values of the R channel/B channel of the pixel corresponding to the G channel in the reconstructed image comprise:

Obtaining a second horizontal interpolation result or a second vertical interpolation result of the pixel corresponding to the G channel in the image, and reconstructing a pixel corresponding to the G channel in the image according to the second horizontal interpolation result or the second vertical interpolation result The pixel value of the R channel/B channel.
The method according to claim 11, wherein the image corresponding to the R channel/B channel in the image is reconstructed according to the pixel value of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image. The pixel values of the B channel/R channel include:

Calculating a 45-degree interpolation result and a 135-degree interpolation result of the pixel corresponding to the R channel/B channel in the image according to pixel values of the reconstructed G channel of the pixel corresponding to the R channel and the B channel in the image, and calculating the image a 45 degree gradient and a 135 degree gradient of pixels corresponding to the B channel/R channel;

Determining that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than 0 and less than a second predetermined threshold, according to the 45-degree interpolation result and the weighted average reconstruction of the 135-degree interpolation result The pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.
The method according to claim 15, wherein the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the pixel value of the pixel corresponding to the G channel in the image and the pixel value of the reconstructed G channel. Also includes:

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is equal to 0, reconstructing the R channel in the image according to the 45-degree interpolation result and the average value of the 135-degree interpolation result The pixel value of the B channel/R channel of the pixel corresponding to the /B channel.
The method according to claim 15, wherein the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the pixel value of the pixel corresponding to the G channel in the image and the pixel value of the reconstructed G channel. Also includes:

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is smaller than the 135-degree gradient, according to the 45 degrees Interpolating results reconstructing pixel values of B channels/R channels of pixels corresponding to R channels/B channels in the image;

When it is determined that the absolute value of the difference between the 45-degree gradient and the 135-degree gradient is greater than the second predetermined threshold, and the 45-degree gradient is greater than the 135-degree gradient, according to the 135 degrees The interpolation result reconstructs the pixel value of the B channel/R channel of the pixel corresponding to the R channel/B channel in the image.
The method according to claim 11, wherein the obtaining the first horizontal interpolation result and the first vertical interpolation result of the pixel corresponding to the red R channel/blue B channel in the image comprises:

According to the formula
Calculating a first horizontal interpolation result of pixels corresponding to the R channel/B channel in the image;

According to the formula
Calculating a first vertical interpolation result of pixels corresponding to the R channel/B channel in the image;

Where g1 i1, j1 are the first horizontal interpolation result, g2 i1, j1 is the first vertical interpolation result, and G i1, j1-1 are the pixels of the G channel of the pixel of the (i1-1)th column (j1-1) column in the image. The value, G i1, j1+1 is the pixel value of the G channel of the pixel in the (i1+1)th column of the i1th row in the image, and A i1, j1 is the R channel/B of the pixel of the i1th row and the j1th column in the image. The pixel value of the channel, A i1, j1-2 is the pixel value of the R channel/B channel of the pixel of the (i1-2)th column in the i1th row of the image, and A i1, j1+2 is the i1th row of the image ( J1+2) the pixel value of the R channel/B channel of the pixel of the column; G i1-1, j1 is the pixel value of the G channel of the pixel of the (j1)th row and the j1th column of the image, G i1+1, J1 is the pixel value of the G channel of the pixel of the j1th column of the (i1+1)th row in the image, and A i1-2, j1 is the R channel/B channel of the pixel of the (j1)th row of the (i1-2)th row in the image. The pixel value, A i1+2, j1 is the pixel value of the R channel/B channel of the pixel of the j1th column of the (i1+2)th row in the image.
The method of claim 18, wherein

Obtaining the horizontal and vertical gradients of the pixels corresponding to the R channel/B channel in the image includes:

Calculate the R channel/B in the image according to the formula ΔH 1i1,j1 =|G i1-1,j1 -G i1+1,j1 |+|2A i1,j1 -G i1-1,j1 -G i1+1,j1 | The horizontal gradient of the pixel corresponding to the channel;

Calculate the R channel/B in the image according to the formula ΔH 2i1,j1 =|G i1,j1-1 -G i1,j1+1 |+|2A i1,j1 -G i1,j1-1 -G i1,j1+1 | The vertical gradient of the pixel corresponding to the channel;

Where ΔH1 i1, j1 is a horizontal gradient, ΔH2 i1, and j1 is a vertical gradient.
The method according to claim 19, wherein the pixel value of the G channel of the pixel corresponding to the R channel/B channel in the image is reconstructed according to the obtained first horizontal interpolation result and the weighted average of the first vertical difference result, including:

According to the formula
Reconstruct the pixel values of the reconstructed G channel of the pixel corresponding to the R channel/B channel in the image.