CN112188035B - Image processing method, image processor, imaging device, and electronic apparatus - Google Patents
Image processing method, image processor, imaging device, and electronic apparatus Download PDFInfo
- Publication number
- CN112188035B CN112188035B CN202011050846.8A CN202011050846A CN112188035B CN 112188035 B CN112188035 B CN 112188035B CN 202011050846 A CN202011050846 A CN 202011050846A CN 112188035 B CN112188035 B CN 112188035B
- Authority
- CN
- China
- Prior art keywords
- image
- pixel
- wide
- tele
- angle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The application discloses an image processing method, an image processor, a shooting device and electronic equipment. The image processing method comprises the following steps: acquiring a wide-angle image and a tele image; denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels; denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises pixels to be processed corresponding to the reference pixels; and obtaining the pixel value of the calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and the adjacent pixel to obtain an interpolation image. According to the image processing method, the image processor, the shooting device and the electronic equipment, the number of pixels of the interpolation image is increased by inserting the calculation pixels between the pixel to be processed and the adjacent pixels, and the interpolation image can be clearly displayed after the interpolation image is amplified.
Description
Technical Field
The present disclosure relates to the field of imaging technologies, and in particular, to an image processing method, an image processor, a shooting device, and an electronic device.
Background
With the development of mobile phones, the function of taking pictures becomes a very important part of the mobile phones, and taking pictures also becomes a part of people's daily life. In the related art, the problem of picture blurring is easy to occur after the picture is enlarged, so that the picture visual effect is poor.
Disclosure of Invention
The embodiment of the application provides an image processing method, an image processor, a shooting device and electronic equipment.
The image processing method of the embodiment of the application comprises the following steps: acquiring a wide-angle image and a tele image; denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels; denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises a pixel to be processed corresponding to the reference pixel; and obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and an adjacent pixel to obtain an interpolation image.
The image processor of the embodiment of the present application includes an image recognition processing unit configured to: acquiring a wide-angle image and a tele image; denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels; denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises pixels to be processed corresponding to the reference pixels; and obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and an adjacent pixel to obtain an interpolation image.
The shooting device of the embodiment of the application comprises the image processor and the image sensor, wherein the image sensor is connected with the image processor.
The electronic equipment of the embodiment of the application comprises the shooting device and the shell, wherein the shooting device is combined with the shell.
According to the image processing method, the image processor, the shooting device and the electronic equipment, the number of pixels of the interpolation image can be increased by inserting the calculation pixels between the pixel to be processed and the adjacent pixels, and therefore the interpolation image can still be clearly displayed after being amplified. In addition, the pixel value of the calculation pixel is obtained by calculating the pixel value of the reference pixel and the pixel value of the pixel to be processed, so that the calculation pixel can embody the color and the brightness corresponding to the wide-angle denoising image, the pixel value of the calculation pixel is more accurate, and the interpolation image is clearer and more real.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic flow chart diagram of an image processing method according to some embodiments of the present application;
FIG. 2 is a schematic diagram of an image processor according to some embodiments of the present application;
FIG. 3 is a schematic diagram of the denoising of a wide-angle image according to some embodiments;
FIG. 4 is a schematic diagram of denoising a tele image in accordance with certain embodiments;
FIG. 5 is a schematic diagram of some embodiments of interpolation of a tele de-noised image;
FIGS. 6-10 are schematic flow charts of image processing methods according to certain embodiments of the present application;
FIG. 11 is a schematic view of a camera according to certain embodiments of the present application;
FIG. 12 is a schematic plan view of an electronic device according to some embodiments of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
Referring to fig. 1, the present application discloses an image processing method, which includes:
01: acquiring a wide-angle image and a tele image;
02: denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels;
03: denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises pixels to be processed corresponding to the reference pixels;
04: and obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and the adjacent pixel to obtain an interpolation image.
Referring to fig. 2, an image processor 100 is disclosed. The image processor 100 of the embodiment of the present application includes an image recognition processing unit 10, and the image processing method of the embodiment of the present application may be implemented by the image processor 100 of the embodiment of the present application, wherein each of step 01, step 02, step 03, and step 04 may be implemented by the image recognition processing unit 10. That is, the image recognition processing unit 10 is configured to: acquiring a wide-angle image and a tele image; denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels; denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises pixels to be processed corresponding to the reference pixels; and obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and the adjacent pixel to obtain an interpolation image.
The image processor 100 and the image processing method according to the embodiment of the present application may enable the number of pixels of the interpolated image to be greater by inserting the calculation pixel between the pixel to be processed and the adjacent pixel, so that the interpolated image can still be clearly displayed after being enlarged. In addition, the pixel value of the calculation pixel is obtained by calculating the pixel value of the reference pixel and the pixel value of the pixel to be processed, so that the calculation pixel can embody the color and the brightness corresponding to the wide-angle denoising image, the pixel value of the calculation pixel is more accurate, and the interpolation image is clearer and more real.
Referring to fig. 3 and 4 together, the wide-angle image may be an image having a large field angle, and the wide-angle image may be captured by a wide-angle camera. The tele image may be an image taken after zooming in from a distance, and the tele image may be taken by a tele camera. After the wide-angle image and the tele image are obtained, denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels; and denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises pixels to be processed corresponding to the reference pixels. The denoising process is to reduce the influence of noise interference between the imaging device and the external environment on the digital image in the real world during the digitization and transmission processes, and in some embodiments, the denoising process may be a filtering process on the image.
Referring to fig. 5, fig. 5 is a block diagram illustrating a pixel to be processed and an adjacent pixel in a line-by-line manner to obtain an interpolated image. In other embodiments, the calculation pixels may be inserted between the pixel to be processed and the adjacent pixels in a column manner to obtain the interpolated image, or may be inserted between the pixel to be processed and the adjacent pixels in a row and column manner to obtain the interpolated image.
Referring to fig. 6, in some embodiments, step 01 includes:
012: acquiring a wide-angle image;
014: a tele image is acquired upon receiving a zoom command.
In some embodiments, step 012 and step 014 may both be implemented by the image recognition processing unit 10. That is, the image recognition processing unit 10 is configured to: acquiring a wide-angle image; a tele image is acquired upon receiving a zoom command.
Specifically, the tele image is acquired when a zoom command is received, and the zoom command may be that the user uses a zoom function, or may be that the user zooms in a certain picture of the image during the photographing process.
Referring to fig. 7, in some embodiments, step 02 includes:
022: and taking a first preset number of adjacent pixels in the wide-angle image as a first pixel combination, and calculating to obtain a reference pixel according to all pixels in the first pixel combination.
In certain embodiments, step 022 may be implemented by image recognition processing unit 10. That is, the image recognition processing unit 10 is configured to: and taking a first preset number of adjacent pixels in the wide-angle image as a first pixel combination, and calculating to obtain a reference pixel according to all pixels in the first pixel combination.
Referring to fig. 3 again, in an example, the first predetermined number may be 9, and the adjacent 9 pixels in the wide-angle image are used as a first pixel combination, and the first pixel combination includes, for example: a33, a34, a35, a43, a44, a45, a53, a54, a55, the reference pixel is calculated from all the pixels in the first pixel combination. For example, the reference pixel may be a44', and the reference pixel a44' may be obtained by calculating a33, a34, a35, a43, a44, a45, a53, a54, and a55 in the first pixel combination. It should be noted that the above examples and specific numbers are provided for convenience of description of the embodiments of the present application and should not be construed as limiting the scope of the present application.
Specifically, the wide-angle image is filtered to obtain a wide-angle de-noised image (as shown in fig. 3), and the wide-angle de-noised image is composed of a plurality of reference pixels. The image recognition processing unit 10 may determine a first pixel combination 112 of the wide-angle image. It should be noted that the shape of the window of the first pixel combination 112 may be a square, a rectangle, or other shapes, and is not limited herein; the first pixel combination 112 may have a size of 3x3, 4x4, 5x5, 3x5, 5x7, 7x7, 9x5, etc., and is not limited herein. The image recognition processing unit 10 may determine the first pixel combination 112 of the wide-angle image, and calculate a pixel average value for pixels in the first pixel combination 112 of the wide-angle image, and a window of the first pixel combination 112 of the wide-angle image may traverse each pixel in the wide-angle image to filter the wide-angle image, so as to obtain the wide-angle de-noising image.
Referring to fig. 8, in some embodiments, step 03 includes:
032: and taking a second preset number of adjacent pixels in the tele image as a second pixel combination, and calculating according to all pixels in the second pixel combination to obtain the pixels to be processed.
In some embodiments, step 032 may be implemented by image recognition processing unit 10. That is, the image recognition processing unit 10 is configured to: and taking a second preset number of adjacent pixels in the tele image as a second pixel combination, and calculating according to all pixels in the second pixel combination to obtain the pixels to be processed.
Referring again to fig. 4, in an example, the second predetermined number may be 9, and the adjacent 9 pixels in the tele image are taken as a second pixel combination, where the second pixel combination includes: b33, B34, B35, B43, B44, B45, B53, B54 and B55, and obtaining the pixel to be processed according to all the pixel calculation in the second pixel combination. For example, the pixel to be processed may be B44', and the pixel to be processed B44' may be obtained by calculating B33, B34, B35, B43, B44, B45, B53, B54, and B55 in the second pixel combination. It should be noted that the above-mentioned examples and specific quantities are provided for convenience of describing the implementation of the present application and should not be construed as limiting the scope of the present application.
The tele image is filtered to obtain a long Jiao Quzao image (as shown in fig. 4), and the tele de-noised image is composed of a plurality of pixels to be processed. The image recognition processing unit 10 may determine a second pixel combination 114 of the long focus image. It should be noted that the shape of the window of the second pixel combination 114 may be a square, a rectangle, or other shapes, and is not limited herein; the second pixel combination size may be 3x3, 4x4, 5x5, 3x5, 5x7, 7x7, 9x5, etc., and is not limited herein. The image recognition processing unit 10 may determine the second pixel combination 114 of the tele image, and calculate a pixel average value for pixels in the second pixel combination 114 of the tele image, and a window of the second pixel combination 114 of the tele image may traverse each pixel in the tele image to filter the tele image, so as to obtain the tele de-noised image.
Referring to fig. 5 again, the wide-angle denoised image includes a reference pixel, and the tele-image includes a pixel to be processed corresponding to the reference pixel. The pixel to be processed corresponding to the reference pixel may be determined by the image recognition processing unit 10 according to the similarity of the display screen, and the reference pixel and the corresponding pixel to be processed can be used to represent the same scene. And obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and the adjacent pixel to obtain an interpolation image. As shown in fig. 3, the reference pixels may be represented by a11', a12', a13', a14', etc.; the pixels to be processed in the tele de-noised image are obtained by combining and filtering every 9 pixels in the tele image, and as shown in fig. 4, the pixels to be processed are represented by B11', B12', B13', B14', and the like. The pixel values of the calculation pixels may be obtained as: (B + A)/2. For example: if the calculation pixel is inserted between the pixel to be processed B11 'and the adjacent pixel B12', the pixel value of the calculation pixel may be: (B11 ' + A11 ')/2, the pixel value of the calculated pixel may be represented by C11 '; if the calculation pixel is inserted between the pixel to be processed B12 'and the adjacent pixel B13', the pixel value of the calculation pixel may be: (B12 ' + A12 ')/2, the pixel value of the calculated pixel may be represented by C12 '. And the calculation pixel is inserted between the pixel to be processed and the adjacent pixel to obtain an interpolation image.
Referring to fig. 9, in some embodiments, an image processing method includes:
05: determining the zoom multiple of the long-focus image relative to the wide-angle image;
06: determining the repetition times according to the zooming times;
07: the image processing method is repeatedly executed according to the number of repetitions to obtain an interpolated image, wherein the interpolated image acquired in the last execution is taken as the tele image in the current execution.
In some embodiments, step 05, step 06, and step 07 may all be implemented by the image recognition processing unit 10. That is, the image recognition processing unit 10 is configured to: determining the zoom multiple of the long-focus image relative to the wide-angle image; determining the repetition times according to the zooming times; the image processing method is repeatedly executed according to the number of repetitions to obtain an interpolated image, wherein the interpolated image acquired in the last execution is taken as the tele image in the current execution.
Specifically, it is determined that the zoom multiple of the tele image with respect to the wide image is n times (n is greater than or equal to 1), and the number of repetitions may be determined according to the zoom multiple, for example, the zoom multiple minus one, that is, the number of repetitions is n-1, the image processing method is repeated n-1 times to obtain an interpolated image, and the interpolated image obtained in the last execution is taken as the tele image in the current execution. In one example, the image recognition processing unit 10 determines that the zoom factor of the long-focus image is 3 times with respect to the wide-angle image, determines that the repetition number is 2 according to the zoom factor, executes the image processing method 2 times to obtain an interpolation image, and performs second interpolation on the interpolation image subjected to the first interpolation using the interpolation image subjected to the first interpolation as the long-focus image when executing the image processing method for the second time. Specifically, taking the wide-angle denoised image of fig. 3 and the interpolated image of fig. 5 as an example, the second-order image processing method is performed on the interpolated image. The reference pixel corresponding to the pixel to be processed B11 'is a11', and the pixel value of the calculation pixel inserted between B11 'and C11' may be (B11 '+ a 11')/2; the reference pixel corresponding to the pixel to be processed C11 'is a12', and the pixel value of the calculation pixel inserted between C11 'and B12' may be (C11 '+ a 12')/2; the reference pixel corresponding to the pixel to be processed B12 'is a12', and the pixel value of the calculation pixel inserted between B12 'and C12' may be (B12 '+ a 12')/2, so as to perform the second interpolation on the interpolated image after the first interpolation to obtain the interpolated image.
In some embodiments, if the zoom factor of the tele image relative to the wide image is not an integer multiple, the zoom factor may be rounded up, the number of repetitions may be determined according to the zoom factor, and the image processing method may be repeatedly performed according to the number of repetitions to obtain the interpolated image. For example: if the zoom multiple of the long-focus image relative to the wide-angle image is determined to be 3.8 times, the zoom multiple of the long-focus image relative to the wide-angle image can be considered to be 4 times, the repetition frequency is determined to be 3, the image processing method is executed for 3 times to obtain an interpolation image, and the interpolation image obtained in the last execution process is used as the long-focus image in the current execution process. In some embodiments, if the zoom factor of the tele image relative to the wide image is not an integer multiple, the zoom factor may be rounded down or rounded, and the method is not limited herein. The image processing method is repeatedly executed by the repetition times to obtain the interpolation image, so that the interpolation image can still be clearly displayed after being amplified, and the interpolation image is clearer and more real.
Referring to fig. 10, in some embodiments, the image processing method further includes:
08: the corresponding area of the wide-angle image is replaced with the interpolated image to obtain a composite image.
In some embodiments, step 08 may be implemented by the image recognition processing unit 10. That is, the image recognition processing unit 10 is configured to: the corresponding area of the wide-angle image is replaced with the interpolated image to obtain a composite image.
The interpolation image is an image formed by inserting the calculation pixel between the pixel to be processed and the adjacent pixel, and therefore, the number of pixels of the interpolation image is larger. The corresponding area of the wide-angle image can be replaced by the interpolation image to obtain a composite image, so that a user can watch the wide-angle image while watching the interpolation image of the corresponding area in an enlarged mode, and the interpolation image can still be displayed clearly after being enlarged.
Referring again to fig. 2, in some embodiments, the image processor 100 includes a hardware abstraction module 20 and an application module 30, the application module 30 is configured to send an image capture request, and the image sensor captures a wide image and a tele image according to the image capture request and transmits the wide image and the tele image to the hardware abstraction module 20.
In some embodiments, the Hardware abstraction module 20 may be a Hardware Abstraction Layer (HAL), which is an interface Layer between the operating system kernel and the Hardware circuitry that abstracts the Hardware. The hardware abstraction layer can coordinate functional interfaces among all modules, and real-time and reliable data transmission is guaranteed. The Application module 30 may be an Application (APP), such as: the electronic device 1000 is a smart phone, the application program may be a photographing system of the electronic device 1000, the user may use the photographing system to send an image capturing request, and the image sensor captures the wide-angle image and the tele image according to the image capturing request and transmits the wide-angle image and the tele image to the hardware abstraction layer.
Referring again to fig. 2, in some embodiments, the image processor 100 further includes an image recognition processing unit 10, the hardware abstraction module 20 is configured to transmit the wide-angle image and the tele image to the image recognition processing unit 10, and the image recognition processing unit 10 is configured to process the wide-angle image and the tele image to obtain an interpolated image and replace a corresponding region of the wide-angle image with the interpolated image to obtain a composite image.
Specifically, the hardware abstraction module 20 transmits the wide-angle image and the tele image to the image recognition processing unit 10, so that the image recognition processing unit 10 processes the wide-angle image and the tele image, the image recognition processing unit 10 uses the wide-angle image and the tele image to obtain an interpolated image, and the image recognition processing unit 10 may replace a corresponding region of the wide-angle image with the interpolated image to obtain a composite image. After the image recognition processing unit 10 obtains the image through the hardware abstraction module 20, the image can be efficiently recognized and processed, so as to obtain a clearer and more realistic composite image.
In some embodiments, the image recognition processing unit 10 is configured to transmit the composite image to the hardware abstraction module 20, and the hardware abstraction module 20 is configured to transmit the composite image to the application module 30.
Specifically, the image recognition processing unit 10 may transmit the composite image to the hardware abstraction module 20, and the hardware abstraction module 20 may coordinate the functional interface between the image recognition processing unit 10 and the application module 30 to ensure that the composite image is reliably transmitted to the application module 30 in real time. The application module 30 may be an application for storing images, and the composite image is transmitted to the application module 30 for viewing by a user. The application module 30 may also be an application for modifying and beautifying the composite image, and transmitting the composite image to the application module 30 may satisfy the user's requirement, so as to modify the composite image again and improve the user's experience.
In some embodiments, the application module 30 is configured to modify information of the composite image and store the composite image in a gallery. The information of the synthesized image may be EXIF information, and the EXIF information may record attribute information and photographing data of the synthesized image. Specifically, the information of the synthesized image includes information such as the resolution of the synthesized image, the last transaction time, the image capturing time, the image storing time, and the image size. The application module 30 may modify the information of the composite image and store the composite image in a gallery for viewing by a user.
Referring to fig. 11, the present application discloses a camera 500, wherein the camera 500 includes an image processor 100 and an image sensor 200, and the image sensor 200 is connected to the image processor 100.
Specifically, the image sensor 200 is used for receiving light to form an electrical signal, and the image sensor may be a Metal Oxide Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.
In some embodiments, the camera 500 further includes a lens module, a voice coil motor, an infrared cut filter, and the like. The voice coil motor can be mechanical energy with electric energy transformation, and the camera lens module can realize zooming function through the voice coil motor. The infrared cut filter may be a filter for filtering an infrared band, and the filter for filtering the infrared band may prevent the lens module 200 through which infrared rays pass from causing imaging distortion.
Referring to fig. 12, the present application discloses an electronic device 1000, wherein the electronic device 1000 includes a camera 500 and a housing 600. The case 600 is combined with the photographing device 500. The electronic device 1000 may be a terminal device having a photographing function. For example, the electronic device 1000 may include a smart phone, a tablet computer, and a digital camera or other terminal devices having a photographing function. The electronic device 1000 according to the embodiment of the present application is illustrated by taking a smart phone as an example, and should not be construed as limiting the present application.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (13)
1. An image processing method, characterized in that the image processing method comprises:
acquiring a wide-angle image and a tele image;
denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels;
denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises a pixel to be processed corresponding to the reference pixel;
and obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and an adjacent pixel to obtain an interpolation image, wherein the pixel value of the calculation pixel is an average value of the pixel value of the reference pixel and the pixel value of the pixel to be processed.
2. The image processing method of claim 1, wherein the acquiring the wide image and the tele image comprises:
acquiring the wide-angle image;
acquiring the tele image upon receiving a zoom command.
3. The image processing method according to claim 1, wherein the denoising the wide-angle image to obtain a wide-angle denoised image comprises:
and taking a first preset number of adjacent pixels in the wide-angle image as a first pixel combination, and calculating according to all pixels in the first pixel combination to obtain the reference pixel.
4. The method of claim 1, wherein the denoising the tele image to obtain a long Jiao Quzao image comprises:
and taking a second preset number of adjacent pixels in the tele image as a second pixel combination, and calculating according to all pixels in the second pixel combination to obtain the pixel to be processed.
5. The image processing method according to claim 1, characterized in that the image processing method comprises:
determining a zoom factor of the tele image relative to the wide image;
determining the repetition times according to the zooming times;
and repeatedly executing the image processing method according to the repeated times to obtain the interpolation image, wherein the interpolation image acquired in the last execution process is used as the tele image in the current execution process.
6. The image processing method according to claim 1, characterized in that the image processing method further comprises:
replacing a corresponding region of the wide-angle image with the interpolated image to obtain a composite image.
7. The image processing method according to claim 1, wherein the image processing method is applied to an image processor, the image processor comprises a hardware abstraction module and an application module, the application module is used for sending an image acquisition request, and an image sensor acquires the wide image and the tele image according to the image acquisition request and transmits the wide image and the tele image to the hardware abstraction module.
8. The image processing method of claim 7, wherein the image processor further comprises an image recognition processing unit, wherein the hardware abstraction module is configured to transmit the wide image and the tele image to the image recognition processing unit, and wherein the image recognition processing unit is configured to process the wide image and the tele image to obtain the interpolated image and to replace a corresponding region of the wide image with the interpolated image to obtain a composite image.
9. The image processing method according to claim 8, wherein the image recognition processing unit is configured to transmit the composite image to the hardware abstraction module, and the hardware abstraction module is configured to transmit the composite image to the application module.
10. The image processing method of claim 9, wherein the application module is configured to modify information of the composite image and store the composite image in a gallery.
11. An image processor, characterized in that the image processor comprises an image recognition processing unit for: acquiring a wide-angle image and a tele image; denoising the wide-angle image to obtain a wide-angle denoised image, wherein the wide-angle denoised image comprises reference pixels; denoising the tele image to obtain a long Jiao Quzao image, wherein the tele denoised image comprises pixels to be processed corresponding to the reference pixels; and obtaining a pixel value of a calculation pixel according to the pixel value of the reference pixel and the pixel value of the pixel to be processed, and inserting the calculation pixel between the pixel to be processed and an adjacent pixel to obtain an interpolation image, wherein the pixel value of the calculation pixel is an average value of the pixel value of the reference pixel and the pixel value of the pixel to be processed.
12. A photographing apparatus, characterized by comprising:
the image processor of claim 11; and
an image sensor connected with the image processor.
13. An electronic device, characterized in that the electronic device comprises:
the camera of claim 12; and
a housing, the photographing device being combined with the housing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011050846.8A CN112188035B (en) | 2020-09-29 | 2020-09-29 | Image processing method, image processor, imaging device, and electronic apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011050846.8A CN112188035B (en) | 2020-09-29 | 2020-09-29 | Image processing method, image processor, imaging device, and electronic apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112188035A CN112188035A (en) | 2021-01-05 |
| CN112188035B true CN112188035B (en) | 2023-02-17 |
Family
ID=73946277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011050846.8A Active CN112188035B (en) | 2020-09-29 | 2020-09-29 | Image processing method, image processor, imaging device, and electronic apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112188035B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6710801B1 (en) * | 1999-03-29 | 2004-03-23 | Minolta Co., Ltd. | Image taking and processing device for a digital camera and method for processing image data |
| JP2005191867A (en) * | 2003-12-25 | 2005-07-14 | Olympus Corp | Imaging apparatus and electronic zooming method |
| JP2005303694A (en) * | 2004-04-13 | 2005-10-27 | Konica Minolta Holdings Inc | Compound eye imaging device |
| CN110290299A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | Imaging method, device, storage medium and electronic equipment |
| CN111563552A (en) * | 2020-05-06 | 2020-08-21 | 浙江大华技术股份有限公司 | Image fusion method and related equipment and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8824833B2 (en) * | 2008-02-01 | 2014-09-02 | Omnivision Technologies, Inc. | Image data fusion systems and methods |
| US20150145958A1 (en) * | 2013-11-22 | 2015-05-28 | Canon Kabushiki Kaisha | Multi-lens image capturing apparatus |
-
2020
- 2020-09-29 CN CN202011050846.8A patent/CN112188035B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6710801B1 (en) * | 1999-03-29 | 2004-03-23 | Minolta Co., Ltd. | Image taking and processing device for a digital camera and method for processing image data |
| JP2005191867A (en) * | 2003-12-25 | 2005-07-14 | Olympus Corp | Imaging apparatus and electronic zooming method |
| JP2005303694A (en) * | 2004-04-13 | 2005-10-27 | Konica Minolta Holdings Inc | Compound eye imaging device |
| CN110290299A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | Imaging method, device, storage medium and electronic equipment |
| CN111563552A (en) * | 2020-05-06 | 2020-08-21 | 浙江大华技术股份有限公司 | Image fusion method and related equipment and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112188035A (en) | 2021-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9633417B2 (en) | Image processing device and image capture device performing restoration processing using a restoration filter based on a point spread function | |
| US8238695B1 (en) | Data reduction techniques for processing wide-angle video | |
| CN107948505B (en) | Panoramic shooting method and mobile terminal | |
| US20110149098A1 (en) | Image processing apparutus and method for virtual implementation of optical properties of lens | |
| EP2731325A1 (en) | Imaging device and recording medium | |
| US9881362B2 (en) | Image processing device, image-capturing device, image processing method, and program | |
| WO2006079963A2 (en) | Device for registering images | |
| JP2012195668A (en) | Image processing device, image processing method, and program | |
| CN113850367A (en) | Network model training method, image processing method and related equipment thereof | |
| US10559068B2 (en) | Image processing device, image processing method, and program processing image which is developed as a panorama | |
| CN115546043B (en) | Video processing method and related equipment thereof | |
| CN103430531A (en) | Video processing apparatus, video processing system, and video processing method | |
| US10567647B2 (en) | Image processing apparatus and image processing method | |
| CN108810326B (en) | Photographing method and device and mobile terminal | |
| CN112188035B (en) | Image processing method, image processor, imaging device, and electronic apparatus | |
| JP2011199407A (en) | Imaging device, image processor, and image processing method | |
| CN103780829A (en) | Integrated processing system of multiple cameras and method thereof | |
| EP1551169A2 (en) | Image processing apparatus and method | |
| EP4280154A1 (en) | Image blurriness determination method and device related thereto | |
| JP2020009099A (en) | Image processing device, image processing method, and program | |
| JP2015026891A (en) | Image processing device and storage medium | |
| CN115546042B (en) | Video processing method and related equipment thereof | |
| CN115086558B (en) | Focusing method, image pickup apparatus, terminal apparatus, and storage medium | |
| CN109862286B (en) | Image display method, device, equipment and computer storage medium | |
| CN113132614B (en) | Camera optical zooming electronic device, method, unit and memory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |