WO2020125203A1

WO2020125203A1 - Image processing method, electronic device and medium

Info

Publication number: WO2020125203A1
Application number: PCT/CN2019/113733
Authority: WO
Inventors: 张弓
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-12-20
Filing date: 2019-10-28
Publication date: 2020-06-25
Also published as: CN109639997A; CN109639997B

Abstract

An image processing method, electronic device (1000) and medium. The image processing method is used for the electronic device (1000), and the electronic device (1000) comprises a wide-angle camera (30), a plurality of telephoto cameras (20), a pre-processing chip (101) and a processor (10). The image processing method comprises: controlling the wide-angle camera (30) and the plurality of telephoto cameras (20) to collect images respectively according to a photographing instruction; caching a first image collected by the wide-angle camera (30) and second images collected by the telephoto cameras (20) respectively by means of the pre-processing chip (101); and transmitting the cached first image and plurality of second images together to the processor (10). The image processing method according to the embodiments of the present application not only can support multiple cameras working at the same time by means of the pre-processing chip (101), but may also fully utilize the computing processing ability of the processor (10) to process the first image and the second images, thus saving costs.

Description

Image processing method, electronic device and medium

Priority information

This application requests the priority and rights of the patent application with the patent application number 201811564721.X, which was submitted to the State Intellectual Property Office of China on December 20, 2018, and the full text of which is incorporated herein by reference.

Technical field

The present application relates to the field of imaging technology, and in particular, to an image processing method, an electronic device, and a medium.

Background technique

With the continuous development of mobile phone technology, people are increasingly demanding mobile phone cameras. From the beginning of the single camera, to the later dual camera, triple camera and even multiple camera solutions.

Summary of the invention

In view of this, the present application needs to provide an image processing method, an electronic device, and a medium.

An image processing method according to an embodiment of the present application is used in an electronic device. The electronic device includes a wide-angle camera, a plurality of telephoto cameras, a preprocessing chip, and a processor. The image processing method includes:

Controlling the wide-angle camera and the plurality of telephoto cameras to respectively acquire images according to the photographing instructions;

Cache the first image collected by the wide-angle camera and the second images collected by the multiple telephoto cameras through the preprocessing chip;

The cached first image and the plurality of second images are sent to the processor together.

The electronic device in the embodiment of the present application includes a wide-angle camera, a plurality of telephoto cameras, a pre-processing chip, and a processor; the processor is used to control the wide-angle camera and the plurality of telephoto cameras to respectively capture images according to photographing instructions The pre-processing chip is used to cache the first image collected by the wide-angle camera and the second images respectively collected by the multiple telephoto cameras through the pre-processing chip; and the first image to be cached Sent to the processor together with a plurality of the second images.

The electronic device in the embodiments of the present application includes a wide-angle camera, a plurality of telephoto cameras, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory, And is executed by the one or more processors, and the program includes instructions for performing the above image processing method.

A non-volatile computer-readable storage medium containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, cause the processors to perform the image processing method described above.

The advantages of additional aspects of the present application will be partially given in the following description, and some will become apparent from the following description, or be learned through the practice of the present application.

BRIEF DESCRIPTION

The above and/or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

1 is a schematic plan view of an electronic device according to an embodiment of the present application;

2 is a schematic perspective view of a first telephoto camera according to an embodiment of the present application;

FIG. 3 is an exploded schematic diagram of the first telephoto camera according to an embodiment of the present application;

4 is a schematic cross-sectional view of a first telephoto camera according to an embodiment of the present application;

5 is a partial cross-sectional schematic diagram of a first telephoto camera according to an embodiment of the present application;

6 is a schematic cross-sectional view of a first telephoto camera according to another embodiment of the present application;

7 is a schematic perspective view of a reflective element according to an embodiment of the present application.

8 is a schematic diagram of light reflection imaging of a first telephoto camera according to an embodiment of the present application;

9 is a schematic structural diagram of an imaging module in the related art;

10 is a schematic structural diagram of a first telephoto camera according to an embodiment of the present application;

11 is a schematic cross-sectional view of a wide-angle camera according to an embodiment of the present application;

12 is a schematic flowchart of an image processing method according to an embodiment of the present application;

13 is a schematic diagram of an image processing method according to an embodiment of the present application;

14 is a schematic block diagram of an electronic device according to an embodiment of the present application;

15 is a schematic flowchart of an image processing method according to another embodiment of the present application;

16 is a schematic diagram of an image processing method according to another embodiment of the present application;

17 is a schematic flowchart of an image processing method according to another embodiment of the present application;

18 is a schematic diagram of a scene of an image processing method according to another embodiment of the present application.

19 is a schematic flowchart of an image processing method according to still another embodiment of the present application;

20-21 are schematic diagrams of scenes of an image processing method according to an embodiment of the present application.

detailed description

The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the drawings, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary, and are only used to explain the embodiments of the present application, and cannot be construed as limiting the embodiments of the present application.

In the related art, portable electronic devices such as mobile phones are equipped with cameras, and the imaging principles of the cameras are all based on the convex lens principle. Due to the limitations of the convex lens imaging principle itself, the resulting image center has the best effect, and its effect gradually deteriorates from the image center to the surroundings.

Please refer to FIG. 12 and FIG. 13, an embodiment of the present application provides an image processing method. The image processing method is used in the electronic device 1000. The electronic device 1000 includes a wide-angle camera 30, a plurality of telephoto cameras 20, a preprocessing chip 101, and a processor 10. The image processing method includes the following steps:

Step S10: Control the wide-angle camera 30 and the multiple telephoto cameras 20 to collect images according to the photographing instructions;

Step S20, the pre-processing chip 101 buffers the first image P1 collected by the wide-angle camera 30 and the second images P2 collected by the multiple telephoto cameras 20, respectively;

In step S30, the cached first image P1 and the plurality of second images P2 are sent to the processor 10 together.

Referring to FIG. 14, the electronic device according to the embodiment of the present application includes a wide-angle camera 30, a plurality of telephoto cameras 20, a preprocessing chip 101, and a processor 10. The processor 10 is used to control the wide-angle camera 30 and a plurality of telephotos according to a photographing instruction The camera 20 collects images separately;

The preprocessing chip 101 is used to cache the first image P1 collected by the wide-angle camera 30 and the second image P2 collected by the multiple telephoto cameras 20 through the preprocessing chip 101; and used to store the cached first image P1 and the multiple first The two images P2 are sent to the processor 10 together.

Please refer to FIG. 15 and FIG. 16, in some embodiments, before step S10, the image processing method includes:

Step S08: Control the wide-angle camera 30 to collect images and use the image collected by the wide-angle camera 30 as a preview image;

Step S09: Process the preview image and display the processed preview image.

In some embodiments, the processor 10 is used to control the wide-angle camera 30 to acquire an image and use the image acquired by the wide-angle camera 30 as a preview image; process the preview image and display the processed preview image.

In some embodiments, step S09 includes:

The processor 10 processes the preview image, and displays the processed preview image through the display screen 110 of the electronic device.

In some embodiments, the processor 10 is used to control the wide-angle camera 30 to acquire an image and use the image collected by the wide-angle camera 30 as a preview image; and to process the preview image, and the display screen 110 of the electronic device is used to display the processed preview image.

In some embodiments, the pre-processing chip 101 includes a cache area 102, and step S20 includes:

The first image P1 and the second image P2 are cached in the cache area 102.

In some embodiments, the preprocessing chip 101 includes a cache area 102, and the preprocessing chip 101 is used to cache the first image P1 and the second image P2 in the cache area.

In some embodiments, the pre-processing chip 101 includes an application specific integrated circuit.

Please refer to FIGS. 17 and 18. In some embodiments, the image processing method includes:

Step S40, the first image P1 and the plurality of second images P2 are synthesized by the processor 10 to obtain a target image, wherein the first image P1 includes an intermediate region and an edge region, and the field of view region of the plurality of second images P2 includes an edge region Field of view.

In some embodiments, the processor 10 is used to synthesize the first image P1 and the plurality of second images P2 to obtain the target image, wherein the first image P1 includes an intermediate area and an edge area, and the view of the plurality of second images P2 The field area includes the field of view area of the edge area.

Referring to FIG. 19, in some embodiments, the field of view areas of the plurality of second images P2 have overlapping areas in the field of view area of the middle area, and step S40 includes:

Step S41, synthesizing a plurality of second images P2 according to the images of the overlapping area to form a to-be-processed image P23;

In step S42, the image to be processed and the first image P1 are synthesized to obtain the target image P3.

In some embodiments, the field of view areas of the plurality of second images P2 have overlapping areas in the field of view area of the middle area, and the processor 10 is used to synthesize the plurality of second images P2 according to the images of the overlapping areas to form a to-be-processed Image P23; and for synthesizing the image to be processed and the first image P1 to obtain the target image P3.

In some embodiments, the number of the second image P2 is four, and the field of view areas of the four second images P2 are respectively from one of the corner positions of the field of view area of the first image P1 to the view of the first image P1 The middle of the field region extends, and the ratio of the area of the field of view of each second image P2 to the area of the field of view of the first image P1 is 1/2-2/3.

In some embodiments, the focus position P22 of the second image P2 is located within the overlapping area P21.

In some embodiments, step S10 includes:

Control multiple telephoto cameras 20 to focus at the same position;

The multiple telephoto cameras 20 are controlled to acquire images to obtain the second image P2. In some embodiments, the processor 10 is used to control the plurality of telephoto cameras 20 to focus at the same position, and to control the plurality of telephoto cameras 20 to separately acquire images to obtain the second image P2.

Embodiments of the present application also provide an electronic device 1000, which includes a wide-angle camera 30, a plurality of telephoto cameras 20, one or more processors 10, a memory 50, and one or more programs, one or more of which The program is stored in the memory 50 and executed by the one or more processors 10, and the program includes instructions for executing the image processing method of any of the above embodiments.

Embodiments of the present application also provide a non-volatile computer-readable storage medium containing computer-executable instructions. When the computer-executable instructions are executed by one or more processors 10, the processor 10 is caused to perform any of the foregoing implementations Image processing method.

Referring to FIG. 1, the electronic device 1000 according to the embodiment of the present application includes a casing 200 and a camera assembly 100. The camera assembly 100 is exposed through the casing 200.

Exemplarily, the electronic device 1000 may be any of various types of computer system devices that are mobile or portable and perform wireless communication (only one form is exemplarily shown in FIG. 1 ). Specifically, the electronic device 1000 may be a mobile phone or a smart phone (for example, an iPhone based on TM, an Android-based phone), a portable game device (for example, Nintendo DS, TM, PlayStation Portable TM, Gameboy Advance TM, iPhone TM), laptop Computer, PDA, portable Internet device, music player and data storage device, other handheld devices and such as watches, earphones, pendants, headphones, etc., the electronic device 100 can also be other wearable devices (for example, Head-mounted devices (HMD) such as electronic glasses, electronic clothes, electronic bracelets, electronic necklaces, electronic tattoos, electronic devices or smart watches).

The camera assembly 100 includes a telephoto camera 20 and a wide-angle camera 30. The number of telephoto cameras 20 is plural. For example, the number of telephoto cameras 20 is 2, 3, 4 and so on. In this embodiment, the number of telephoto cameras 20 is 4 as an example. The number of wide-angle cameras 30 is one.

It can be understood that the angle of view of the wide-angle camera 30 is greater than that of the telephoto camera 20. For example, the wide-angle camera 30 has a viewing angle range of 80-110 degrees, while the telephoto camera 20 has a viewing angle range of 10-40 degrees.

Therefore, the field of view area of the wide-angle camera 30 is large, and the field of view area of the telephoto camera 20 is small. Therefore, the telephoto camera 20 has a better advantage for shooting the local position of the scene.

In this embodiment, a plurality of telephoto cameras 20 and a wide-angle camera 30 are arranged in a matrix, as shown in FIG. 1. Of course, in other embodiments, the multiple telephoto cameras 20 and the wide-angle camera 30 may be arranged in any shape.

The telephoto cameras 20 may all be vertical cameras, or may be periscope cameras, and the wide-angle camera 30 may be a vertical camera. The vertical lens module means that the optical axis of the lens module is a straight line, or that the incident light is transmitted to the photosensitive device of the lens module along the direction of the linear optical axis. In this embodiment, the telephoto camera 20 is a periscope camera as an example for further description.

Referring to FIGS. 2-4, in this embodiment, the telephoto camera 20 includes a housing 21, a reflective element 22, a mounting base 23, a first lens assembly 24, a moving element 25, a first image sensor 26, and a driving mechanism 27.

The reflective element 22, the mount 23, the first lens assembly 24, and the moving element 25 are all disposed in the housing 21. The reflective element 22 is disposed on the mounting base 23, and the first lens assembly 24 is fixed on the moving element 25. The moving element 25 is provided on the first image sensor 26 side. Further, the moving element 25 is located between the reflective element 22 and the first image sensor 26.

The driving mechanism 27 connects the moving element 25 and the housing 21. After the incident light enters the housing 21, it is turned by the reflective element 22, and then reaches the first image sensor 26 through the first lens assembly 24, so that the first image sensor 26 obtains an external image. The driving mechanism 27 is used to drive the moving element 25 to move along the optical axis of the first lens assembly 24.

The housing 21 has a substantially square shape, and the housing 21 has a light inlet 211 from which incident light enters the telephoto camera 20. In other words, the reflective element 22 is used to divert the incident light incident from the light entrance 211 and pass through the first lens assembly 24 to the first image sensor 26 so that the first image sensor 26 senses the exterior of the telephoto camera 20 Incident light.

It can be understood that the light inlet 211 is exposed through the through hole 11 so that external light passes through the through hole 11 and enters the telephoto camera 20 from the light inlet 211.

Specifically, referring to FIG. 3, the housing 21 includes a top wall 213 and a side wall 214. The side wall 214 extends from the side 2131 of the top wall 213. The top wall 213 includes two opposite sides 2131, and the number of side walls 214 is two. Each side wall 214 extends from a corresponding side 2131, or the side walls 214 are respectively connected to the top wall 213 On both sides. The light inlet 211 is formed on the top wall 213.

The reflective element 22 is a prism or a plane mirror. For more details, please refer to FIGS. 4 and 7. The reflective element 22 has a light incident surface 222, a backlight surface 224, a reflective surface 226 and a light exit surface 228. The light incident surface 222 approaches and faces the light entrance 211. The backlight surface 224 is away from the light entrance 211 and opposite to the light entrance surface 222. The reflective surface 226 is connected to the light incident surface 222 and the backlight surface 224. The light exit surface 228 is connected to the light entrance surface 222 and the backlight surface 224. The light exit surface 228 faces the first image sensor 26. The reflective surface 226 is inclined relative to the light incident surface 222. The light emitting surface 228 is opposite to the light reflecting surface 226.

Specifically, during the light conversion process, the light passes through the light inlet 211 and enters the light reflecting element 22 from the light incident surface 222, then reflects through the light reflecting surface 226, and finally reflects the light reflecting element 22 from the light emitting surface 228 to complete the light conversion During the process, the backlight surface 224 and the mounting base 23 are fixedly arranged, so that the reflective element 22 remains stable.

Therefore, referring to FIG. 8, the reflective element 22 of the embodiment of the present application cuts off the corner away from the light entrance relative to the reflective element in the related art, which not only does not affect the reflected light effect of the reflective element 22, but also reduces the reflective element The overall thickness of 22.

Referring to FIG. 4, in some embodiments, the angle α of the reflective surface 226 relative to the light incident surface 222 is inclined at 45 degrees. In this way, the incident light is better reflected and converted, and has a better light conversion effect.

The reflective element 22 can be made of glass, plastic, or other materials with relatively good light transmittance. In one embodiment, a reflective material such as silver may be coated on one surface of the reflective element 22 to reflect incident light.

The mounting base 23 is used for mounting the reflective element 22, or the mounting base 23 is a carrier of the reflective element 22, and the reflective element 22 is fixed on the mounting base 23. This allows the position of the reflective element 22 to be determined, which is advantageous for the reflective element 22 to reflect or refract incident light. The reflective element 22 may be fixed on the mounting base 23 by viscose to achieve a fixed connection with the mounting base 23.

Specifically, in the present embodiment, the mounting base 23 is provided with a limiting structure 232, and the limiting structure 232 is connected to the reflective element 22 to limit the position of the reflective element 22 on the mounting base 23.

In this way, the position-limiting structure 232 restricts the position of the reflective element 22 on the mounting base 23, so that the reflective element 22 will not be displaced in the event of an impact, which is beneficial to the normal use of the telephoto camera 20.

It can be understood that in one example, the reflective element 22 is fixed on the mounting base 23 by means of bonding. If the limit structure 232 is omitted, then, when the telephoto camera 20 is impacted, if the reflective element 2222 and the mounting base 23 The adhesive force is insufficient, and the reflective element 22 is easily detached from the mount 23.

In this embodiment, the mounting base 23 is formed with a mounting groove 233, the reflective element 22 is disposed in the mounting groove 233, and the limiting structure 232 is disposed at the edge of the mounting groove 233 and abuts against the reflective element 22.

In this way, the mounting groove 233 can make the reflective element 22 easily mounted on the mounting base 23. The limiting structure 232 is disposed at the edge of the mounting groove 233 and abuts the edge of the reflective element 22, which not only restricts the position of the reflective element 22 but also prevents the reflective element 22 from emitting incident light to the first image sensor 26.

Further, the limiting structure 232 includes a protrusion 234 protruding from the edge of the mounting groove 233, and the protrusion 234 abuts the edge of the light emitting surface 228. Since the reflective element 22 is mounted on the mounting base 23 through the reflective surface 226, the light exit surface 228 is disposed opposite to the reflective surface 226. Therefore, when the light reflecting element 22 is impacted, it is more likely that the light generating surface 228 is located on the side where the light emitting surface 228 is located. In this embodiment, the limit structure 232 abuts against the edge of the light emitting surface 228 can not only prevent the reflective element 22 from shifting to the light emitting surface 228 side, but also ensure that the light exits the light emitting surface 228 normally.

Of course, in other embodiments, the limiting structure 232 may include other structures as long as the position of the reflective element 22 can be limited. For example, the limiting structure 232 is formed with a clamping slot, and the reflective element 22 forms a limiting column, and the limiting column is engaged in the clamping slot to limit the position of the reflective element 22.

In some embodiments, the protrusion 234 is strip-shaped and extends along the edge of the light exit surface 228. In this way, the contact area between the protrusion 234 and the edge of the light exit surface 228 is large, so that the reflective element 22 can be more firmly located on the mounting base 23.

Of course, in other embodiments, the protrusion 234 may also have a block-like structure.

Please refer to FIG. 3 again. In one example, the mounting base 23 can be movably disposed in the housing 21, and the mounting base 23 can rotate relative to the housing 21 to adjust the direction in which the reflective element 22 turns the incident light.

The mounting base 23 can drive the reflective element 22 to rotate in the opposite direction of the shake of the telephoto camera 20 together, so as to compensate the incident deviation of the incident light of the light inlet 211 and achieve the effect of optical anti-shake.

The first lens assembly 24 is accommodated in the moving element 25. Further, the first lens assembly 24 is disposed between the reflective element 22 and the first image sensor 26. The first lens assembly 24 is used to image incident light on the first image sensor 26. This allows the first image sensor 26 to obtain an image with better quality.

When the first lens assembly 24 moves integrally along its optical axis, it can image on the first image sensor 26, so that the telephoto camera 20 can focus. The first lens assembly 24 includes a plurality of lenses 241. When at least one lens 241 moves, the overall focal length of the first lens assembly 24 changes, thereby realizing the zoom function of the telephoto camera 20. More, the driving mechanism 27 drives the moving element 25 moves in the housing 21 for zooming purposes.

In the example of FIG. 4, in some embodiments, the moving element 25 is cylindrical, and the plurality of lenses 241 in the first lens assembly 24 are fixed in the moving element 25 along the axial interval of the moving element 25. As shown in the example of FIG. 6, the moving element 25 includes two clips 252 that sandwich the lens 241 between the two clips 252.

It can be understood that, since the moving element 25 is used to fix a plurality of lenses 241, the length of the required moving element 25 is large, and the moving element 25 may be cylindrical, square, etc., having a shape of a certain cavity. The element 25 is arranged in a tube, so that a plurality of lenses 241 can be better arranged, and the lens 241 can be better protected in the cavity, so that the lens 241 is less likely to shake.

In addition, in the example of FIG. 6, the moving element 25 sandwiches the plurality of lenses 241 between the two clips 252, which not only has a certain stability, but also reduces the weight of the moving element 25, and can reduce the driving of the driving mechanism 27. The power required by the moving element 25, and the design difficulty of the moving element 25 is also relatively low, and the lens 241 is also easier to set on the moving element 25.

Of course, the moving element 25 is not limited to the cylindrical shape and the two clips 252 mentioned above. In other embodiments, the moving element 25 may include three or four clips 252 to form a more stable structure. , Or a simpler structure such as a clip 252; or a rectangular body, a circular body, etc. having a cavity to accommodate various regular or irregular shapes of the lens 241. On the premise of ensuring the normal imaging and operation of the imaging module 10, specific selection is sufficient.

The first image sensor 26 may use a complementary metal oxide semiconductor (CMOS) complementary photosensitive element or a charge-coupled device (CCD) charge-coupled device (CCD) photosensitive element.

In some embodiments, the driving mechanism 27 is an electromagnetic driving mechanism, a piezoelectric driving mechanism, or a memory alloy driving mechanism.

Specifically, the electromagnetic drive mechanism includes a magnetic field and a conductor. If the magnetic field moves relative to the conductor, an induced current is generated in the conductor. The induced current causes the conductor to be subjected to an ampere force, which causes the conductor to move. The conductor here is electromagnetic. The part of the drive mechanism that moves the moving element 25; the piezoelectric drive mechanism is based on the inverse piezoelectric effect of the piezoelectric ceramic material: if a voltage is applied to the piezoelectric material, mechanical stress is generated, that is, electrical energy and mechanical energy are converted, through Controlling its mechanical deformation to produce rotation or linear motion has the advantages of simple structure and low speed.

The drive of the memory alloy drive mechanism is based on the characteristics of the shape memory alloy: the shape memory alloy is a special alloy. Once it remembers any shape, even if it deforms, it can be restored to a certain temperature when heated The shape before deformation achieves the purpose of driving, and has the characteristics of rapid displacement and free direction.

Please refer to FIG. 4 again. Further, the telephoto camera 20 further includes a driving device 28. The driving device 28 is used to drive the mounting base 23 with the reflective element 22 to rotate around the rotation axis 29. The driving device 28 is used to drive the mounting base 23 to move in the axial direction of the rotation axis 29. The rotation axis 29 is perpendicular to the optical axis of the light inlet 211 and the photosensitive direction of the first image sensor 26, so that the telephoto camera 20 realizes optical image stabilization in the optical axis of the light inlet 211 and the axial direction of the rotation axis 29.

In this way, since the volume of the reflective element 22 is smaller than that of the lens barrel, the driving device 28 drives the mounting base 23 to move in two directions, which not only can realize the optical anti-shake effect of the telephoto camera 20 in two directions, but also can make the long The focal camera 20 has a small volume.

Please refer to FIGS. 3 to 4. For convenience of description, the width direction of the telephoto camera 20 is defined as the X direction, the height direction is defined as the Y direction, and the length direction is defined as the Z direction. Thus, the optical axis of the light inlet 211 is in the Y direction, the light receiving direction of the first image sensor 26 is in the Z direction, and the axial direction of the rotation axis 29 is in the X direction.

The driving device 28 drives the mounting base 23 to rotate, so that the reflective element 22 rotates around the X direction, so that the telephoto camera 20 realizes the Y-direction optical image stabilization effect. In addition, the driving device 28 drives the mounting base 23 to move in the axial direction of the rotation axis 29, so that the telephoto camera 20 achieves the X-direction optical image stabilization effect. In addition, the first lens assembly 24 may be along the Z direction to enable the first lens assembly 24 to focus on the first image sensor 26.

Specifically, when the reflective element 22 rotates in the X direction, the light reflected by the reflective element 22 moves in the Y direction, so that the first image sensor 26 forms a different image in the Y direction to achieve the anti-shake effect in the Y direction. When the reflective element 22 moves in the X direction, the light reflected by the reflective element 22 moves in the X direction, so that the first image sensor 26 forms a different image in the X direction to achieve the anti-shake effect in the X direction.

In some embodiments, the driving device 28 is formed with an arc-shaped guide rail 281, and the drive device 28 is used to drive the mounting base 23 to rotate along the arc-shaped guide rail 281 about the central axis 282 of the arc-shaped guide rail 281 and the axis along the central axis 282 Moving toward, the central axis 2282 coincides with the rotation axis 29.

It can be understood that the driving device 28 is used to drive the mounting base 23 to rotate along the arc guide rail 281 about the central axis 282 of the arc guide rail 281 and move axially along the central axis 282.

In this way, since the driving device 28 uses the curved guide rail 281 to drive the mounting base 23 with the reflective element 22 to rotate together, the friction between the driving device 28 and the mounting base 23 is small, which is conducive to the smooth rotation of the mounting base 23 , The optical image stabilization effect of the telephoto camera 20 is improved.

Specifically, please refer to FIG. 9. In the related art, the mounting base (not shown) is rotatably connected to the rotating shaft 23 a, and the mounting base rotates around the rotating shaft 23 a to drive the reflective element 22 a to rotate together. Assume that the friction force is f1, the radius of the rotating shaft 23a is R1, the thrust force is F1, and the radius of rotation is A. Then the friction torque to thrust torque ratio K1 is K1=f1R1/F1A. Because the reflective element 22a only needs to rotate slightly when performing anti-shake, F1 cannot be too large, because the excessive rotation of F1 will cause the rotation of the reflective element 22a to be too large to achieve the anti-shake function; and the imaging module itself needs to be light and short to cause reflective The size of the element 22a cannot be too large, so the space for the enlargement of A is also limited, so that the influence of friction cannot be further eliminated.

Referring to FIG. 10, in this application, the mounting base 23 rotates along an arc-shaped guide rail 281, and the arc-shaped guide rail 281 may be formed by arranging a plurality of rolling bodies 2811. The radius of the rolling element 2811 is R2, and the turning radius of the reflective element 22 is B. At this time, the ratio K2 of the friction torque and the turning torque is K2=f2R2/F2B. In the case where f1 is not significantly changed compared to f2, R1 is compared to R2, and F1 is compared to F2, due to the adoption of The orbital swing method rotates, and the corresponding turning radius becomes B, and B can not be limited by the size of the reflective element 22, and can even be more than a multiple of A. Therefore, in this case, the influence of friction on the rotation of the reflective element 22 can be greatly reduced (the size of K2 is reduced), thereby improving the rotational accuracy of the reflective element 22, and making the optical image stabilization effect of the first imaging module 20 more good.

Please refer to FIG. 4. In some embodiments, the mounting base 23 includes an arc-shaped surface 231. The arc-shaped surface 231 is concentrically arranged with the arc-shaped guide rail 281 and cooperates with the arc-shaped guide rail 281. In other words, the center of the curved surface 231 coincides with the center of the curved guide 281. This makes the mounting base 23 and the driving device 28 more compact.

In some embodiments, the central axis 282 is located outside the telephoto camera 20. In this way, the radius R2 of the arc-shaped guide 281 is large, which can reduce the adverse effect of friction on the rotation of the mounting base 23.

In some embodiments, the driving device 28 electromagnetically drives the mounting base 23 to rotate. In one example, the driving device 28 is provided with a coil, and an electromagnetic sheet is fixed on the mounting base 23. After the coil is energized, the coil can generate a magnetic field to drive the movement of the electromagnetic sheet, thereby driving the mounting base 23 and the reflective element to rotate together.

Of course, in other embodiments, the driving device 28 may drive the mounting base 23 by piezoelectric driving or memory alloy driving. For the piezoelectric driving method and the memory alloy driving method, please refer to the above description, which will not be repeated here.

Please refer to FIGS. 2-5 again. The telephoto camera 20 further includes a chip circuit board 201 and a driving chip 202. The chip circuit board 201 is fixed on the side of the driving mechanism 27, and the driving chip 202 is fixed on the chip circuit board 201 and the driving mechanism 27. On the back side, the driving chip 202 is electrically connected to the driving mechanism 27 through the chip circuit board 201.

In this way, the driving chip 202 is fixed to the side of the driving mechanism 27 through the chip circuit board 201, and is electrically connected to the driving mechanism 27 through the chip circuit board 201, which makes the structure between the driving chip 202 and the driving mechanism 27 more compact, which is beneficial to Reduce the volume of the telephoto camera 20.

Specifically, the driving chip 202 is used to control the driving mechanism 27 to drive the moving element 25 to move along the optical axis of the first lens assembly 24, so that the first lens assembly 24 is focused and imaged on the first image sensor 26. The driving chip 202 is used to control the driving device 28 according to the feedback data of the gyroscope 120 to drive the mounting base 23 with the reflective element 22 to rotate around the rotation axis 29. The driving chip 202 is also used to control the driving device 28 to drive the mounting base 23 to move along the axis of the rotation axis 29 according to the feedback data of the gyroscope 120.

The driving chip 202 is also used to control the driving device 28 according to the feedback data of the gyroscope 120 to drive the mounting base 23 to rotate around the central axis 282 of the arc guide 281 along the arc guide 281 and move axially along the center axis 282.

In some embodiments, the telephoto camera 20 includes a sensor circuit board 203, the first image sensor 26 is fixed to the sensor circuit board 203, the chip circuit board 201 includes a mounting portion 2011 and a connecting portion 2022, and the mounting portion 2011 is fixed to the driving mechanism 27 On the side, the driving chip 202 is fixed to the mounting portion 2011, and the connecting portion 2022 connects the mounting portion 2011 and the sensor circuit board 203.

In this way, the driving chip 202 can be electrically connected to the first image sensor 26 through the sensor circuit board 203. Specifically, the connecting portion 2022 may be fixedly connected to the sensor circuit board 203 by soldering.

In one example, when assembling the telephoto camera 20, the driver chip 202 may be first fixed on the chip circuit board 201, and then the chip circuit board 201 with the driver chip 202 and the sensor circuit board 203 may be connected by soldering. Finally, the chip circuit board 201 with the driving chip 202 is fixed on the side of the driving mechanism 27.

The chip circuit board 201 may be fixedly connected to the driving mechanism 27 by soldering, bonding, or the like.

It should be noted that fixing the chip circuit board 201 on the side of the driving mechanism 27 may mean that the chip circuit board 201 is in contact with and fixed to the side of the driving mechanism 27, or may mean that the chip circuit board 201 is fixedly connected to the side of the driving mechanism 27 through other components.

In this embodiment, the mounting portion 2011 is a rigid circuit board, the connecting portion 2022 is a flexible circuit board, and the mounting portion 2011 is attached to the side surface of the drive mechanism 27.

In this way, the mounting portion 2011 is a rigid circuit board so that the mounting portion 2011 has good rigidity and is not easily deformed, which is beneficial to the fixed connection between the mounting portion 2011 and the side surface of the driving mechanism 27. The mounting portion 2011 can be attached to the side surface of the drive mechanism 27 by adhesion. In addition, the connection portion 2022 is a flexible circuit board so that the chip circuit board 201 is easily deformed, so that the chip circuit board 201 is easily mounted on the side of the driving mechanism 27.

Of course, in other embodiments, the mounting portion 2011 may also be a flexible circuit board.

In some embodiments, the housing 21 is formed with an escape hole 215, and the driving chip 202 is at least partially located in the escape hole 215 so as to be exposed to the housing 21. In this way, the driving chip 202 penetrates the housing 21 so that there is an overlapping portion between the driving chip 202 and the housing 21, which makes the structure between the driving chip 202 and the housing 21 more compact, which can further reduce the volume of the telephoto camera 20.

It can be understood that when there is a gap between the side of the driving mechanism 27 and the housing 21, the driving chip 202 is partially located in the escape hole 215.

Preferably, the shape and size of the avoidance hole 215 match the shape and size of the driving chip 202 respectively. For example, the size of the avoidance hole 215 is slightly larger than the size of the driving chip 202, and the shape of the avoidance hole 215 is the same as the shape of the driving chip 202.

In this embodiment, the escape hole 215 is formed on the side wall 214 of the housing 21. It can be understood that the escape hole 215 penetrates the inside and outside of the side wall 214. Of course, in other embodiments, the escape hole 215 may also be formed on the top wall 213 of the housing 21.

In one embodiment, the telephoto camera 20 further includes a shielding cover 204 that is fixed to the chip circuit board 201 and covers the driving chip 202. In this way, the shielding cover 204 can protect the driving chip 202 and prevent the driving chip 202 from being physically impacted. In addition, the shielding cover 204 can also reduce the electromagnetic influence on the driving chip 202.

The shield 204 may be made of metal material. For example, the material of the shield 204 is stainless steel. In this embodiment, the chip circuit board 201 is fixed to the mounting portion 2011. At this time, the mounting portion 2011 is preferably a rigid circuit board or a plate material combining a flexible circuit board and a reinforcement board.

Referring to FIG. 11, in this embodiment, the wide-angle camera 30 is a vertical lens module. Of course, in other embodiments, the wide-angle camera 30 may also be a periscope lens module.

The wide-angle camera 30 includes a second lens assembly 31 and a second image sensor 32. The second lens assembly 31 is used to image light on the second image sensor 32. The incident optical axis of the wide-angle camera 30 and the optical axis of the second lens assembly 31 coincide.

In this embodiment, the wide-angle camera 30 may be a fixed-focus lens module. Therefore, the second lens assembly 31 has fewer lenses 241, so that the height of the wide-angle camera 30 is lower, which is beneficial to reducing the thickness of the electronic device 1000. The type of the second image sensor 32 may be the same as the type of the first image sensor 26, which will not be repeated here.

12 and 13, the image processing method according to the embodiment of the present application can be applied to the above electronic device 1000. The electronic device 1000 includes a wide-angle camera 30, a plurality of telephoto cameras 20, a preprocessing chip 101, and a processor 10, specifically The image processing method includes the following steps:

In the related art multiple camera solution, the electronic device cannot support multiple cameras to work simultaneously. The image processing method and the electronic device 1000 of the embodiment of the present application can not only support multiple cameras to work simultaneously through the preprocessing chip 101, but also make full use of the computing and processing capabilities of the processor 10 to perform the first image P1 and the second image P2 Processing, which can save costs. In addition, sending the first image P1 and the plurality of second images P2 to the processor 10 together can improve the efficiency of image transmission.

It can be understood that the electronic device 1000 usually only includes 1-2 image signal processors (ISPs). Therefore, the electronic device 1000 cannot support more than two cameras to work at the same time. Moreover, the cost of ISP is higher. Therefore, the image processing method and the electronic device 1000 according to the embodiments of the present application support the simultaneous operation of the wide-angle camera 30 and the multiple telephoto cameras 20 through the preprocessing chip 101, and can realize the simultaneous operation of multiple cameras at a low cost. Moreover, in general, the ability of the processor 10 to process data is stronger than the ability of the pre-processing chip 101 to process data. Therefore, the first image P1 and the plurality of second images P2 can be simply preprocessed by the preprocessing chip 101, and the first image P1 and the plurality of second images P2 can be more complicatedly processed by the processor 10, so The calculation processing capabilities of the pre-processing chip 101 and the processor 10 can be fully utilized.

In the embodiment of the present application, the preprocessing chip 101 performs simple preprocessing on the first image P1 and the plurality of second images P2, including but not limited to: automatic white balance (Auto White Balance, AWB), automatic exposure (Auto Exposure (AE), Automatic Focus (AF). The relatively complicated processing performed by the processor 10 on the first image P1 and the plurality of second images P2 may refer to stitching and synthesizing the images.

In addition, as shown in FIG. 13, the preprocessing chip 101 may include a controller 103, and the controller 103 may control the preprocessing chip 101 to cache and preprocess the first image P1 and the plurality of second images P2. Please note that in the examples of FIGS. 13 and 14, the number of wide-angle cameras 30 is 2 and the number of telephoto cameras 20 is 4, but this does not mean that the number of wide-angle cameras 30 and telephoto cameras 20 is limited. . In other embodiments, the number of wide-angle cameras 30 may be one, and the number of telephoto cameras 20 may be four; in other embodiments, the number of wide-angle cameras 30 may be three, telephoto The number of cameras 20 may be three.

In step S10, the photographing instruction may be triggered by the user touching the display screen 110 of the electronic device 1000; it may also be triggered by the user pressing a key of the electronic device 1000; or may be triggered by the user by operating a device connected to the electronic device 1000. The specific trigger form of the photographing instruction is not limited here.

In step S20, the first image P1 and the second image P2 may be cached by the preprocessing chip 101 in time sequence. It can be understood that the wide-angle camera 30 and the multiple telephoto cameras 20 can collect images at different times, and after the images are collected, the images can be output at different times. Therefore, the preprocessing chip 101 can be transmitted to the preprocessing chip 101 according to the images Timing, to sequentially cache images.

However, it is worth noting that in step S30 of the embodiment of the present application, the cached first image P1 and the plurality of second images P2 are sent to the processor 10 together rather than separately. Of course, in other embodiments, the cached first image P1 and the plurality of second images P2 may be sent to the processor 10 respectively.

In addition, the pre-processing chip 101 and the wide-angle camera 30 and the telephoto camera 20 can be connected through a mobile industry processor interface (Mobile Industry Interface) (MIPI), so that the first image P1 and the second image P2 pass the MIPI from the wide-angle camera 30 and The telephoto camera 20 is transferred to the preprocessing chip 101. Similarly, the preprocessing chip 101 and the processor 10 can also be connected through a mobile industry processor interface (Mobile Industry Interface, MIPI).

In addition, the pre-processing chip 101 may include an application specific integrated circuit (Application Specific Integrated Circuit, ASIC). ASIC is an integrated circuit designed for specific purposes, and is characterized by the needs of specific users. Compared with general-purpose integrated circuits, ASICs have the advantages of smaller size, lower power consumption, improved reliability, improved performance, enhanced confidentiality, and lower costs, and are applied to the image processing method and method of the embodiment of the present application. In the electronic device 1000, it is possible to meet functional requirements and reduce costs.

Step S09: Process the preview image and display the processed preview image.

In this way, the image collected by the wide-angle camera 30 is displayed as a preview image. Specifically, in the example shown in FIG. 16, the user turns on the photographing function of the electronic device 1000, and the electronic device 1000 is in a preview state of photographing. At this time, the preview image of the photograph displayed on the display screen 110 of the electronic device 1000 is wide-angle. Based on the camera 30, the user can adjust the posture of the electronic device 1000 according to the preview image, so as to take a satisfactory image.

Generally, in the preview state, the electronic device 1000 cannot and does not need to output the final synthesized target image. Moreover, on the display screen 110 of the existing electronic device 1000, the difference between the final composite target image and the image collected by the wide-angle camera 30 in detail resolution cannot be distinguished without being enlarged. Therefore, in the preview state, the image collected by the wide-angle camera 30 can be directly obtained as the preview image.

Of course, in step S09, the processed preview image may be displayed on the display screen 110 of the electronic device 1000, or may be displayed on a display device that communicates with the electronic device 1000, and the device that displays the processed preview image is not performed here limited.

In addition, in step S09, processing the preview image may refer to interpolating the raw data in the RAW format output from the wide-angle camera 30 to obtain a preview image in the RGB format. Processing the preview image may also refer to processing such as denoising or white balance on the preview image. Here, the specific method of processing the preview image is not limited.

In some embodiments, step S09 includes:

In this way, the preview image is processed and the processed preview image is displayed.

The first image P1 and the second image P2 are cached in the cache area 102.

In this way, the pre-processing chip 101 caches the first image P1 and the second image P2. Specifically, the cache area 102 may be a synchronous dynamic random access memory (SDRAM) using low power consumption technology (Low Power Double Data Rate (LPDDR)). Further, the cache area 102 can use the third-generation low-power memory technology (LPDDR3).

In addition, the cache area 102 may be packaged and reintegrated through package-on-package (PoP) technology.

In this way, the second image P2 captured by the telephoto camera 20 can compensate the sharpness of the edge area P12 of the first image P1 captured by the wide-angle camera 30. In addition, the focus position P22 of the second image P2 is located in the overlapping area P21, so that the focus positions P22 of the plurality of second images P2 are substantially the same, the consistency of the target image P3 obtained by fusion is good, and the quality of the target image P3 is improved.

Specifically, the middle area P11 of the first image P1 refers to the area located at the center of the first image P1 (as shown in FIG. 18 within the dotted frame in the first image P1), and the edge area P12 refers to the first image P1 is the area other than the middle area P11 (the portion other than the dotted frame in FIG. 18). In one example, the first image P1 has a center point, and the middle area P11 is an area distributed around the center point. The area of the intermediate area P11 is 1/5-2/3 of the total area of the first image P1. For example, the area of the intermediate area P11 is 1/5, 1/4, 1/3, or 2/3 of the total area of the first image P1.

Since the first image P1 is captured by the wide-angle camera 30, the image in the middle area P11 has higher definition and better quality, and the image quality in the edge area P12 is worse than the image quality in the middle area P11.

The field of view area refers to the range of the field of view acquired by the camera corresponding to the image. For example, the size of a scene is 4*6m, and the size of the target object in the scene is 2*3m. If the wide-angle camera 30 can capture an image of a scene, and the telephoto camera 20 can only capture an image of a target object, then the field of view area of the scene image includes the field of view area of the target object.

In this embodiment, the field of view area of the plurality of second images P2 including the edge area P12 means that the field of view area of the plurality of second images P2 may cover the field of view area of the edge area P12, or The field of view areas of the edge area P12 coincide. Thus, the image content after the stitching of the plurality of second images P2 includes the image content of the edge area P12 of the first image P1. That is to say, the image after the stitching of the plurality of second images P2 has the same shape as the image of the edge area P12.

For example, when the first image P1 includes a human body image, the edge area P12 of the first image P1 may include a human head image. At this time, the image after the stitching of the plurality of second images P2 includes the human head image, and may further include a human chest image.

In this embodiment, the number of telephoto cameras 20 is four, so the number of second images P2 is also four. In one example, the field of view areas of the four second images P2 extend from one of the corner positions of the field of view area of the first image P1 to the middle position of the field of view area of the first image P1, each second image The ratio of the area of the field of view of P2 to the area of the field of view of the first image P1 is (1/2, 2/3). The ratio is, for example, 1/2, 3/5, or 2/3. In this embodiment, the ratio of the area of the field of view of each second image P2 to the area of the field of view of the first image is 2/3.

In this embodiment, the field of view areas of the four second images P2 are respectively located in the upper left area, the upper right area, the lower left area, and the lower right area of the field of view area of the first image P1. At this time, the stitched image content of the four second images P2 has not only the image content of the edge area P12 of the first image P1 but also the image content of the middle area P11 of the first image P1.

In addition, by setting a plurality of telephoto cameras 20 to respectively face different shooting directions, the second image P2 in different fields of view can be obtained. The focus position P22 of the second image P2 is located in the overlapping area P21. At this time, it can be understood that the focus position P22 of the second image P2 has better quality such as sharpness, and each second image P2 is centered on the focus position P22 The image clarity and other qualities in the surrounding area are approximately the same, so that the consistency of the target image P3 obtained after fusion is better.

As in the example of FIG. 18, the focus position P22 of the second image P2 is located at the position of the circle area. It should be noted that, for ease of understanding, the overlapping area P21 and the focus position P22 are shown in the processed image P2.

In addition, the obtained target image P3 has a high-definition quality. In an example, when the number of the second image P2 is four, the images of the upper left, upper right, lower left, and lower right areas of the target image P3 are acquired by different telephoto cameras 20 respectively. Therefore, these four The image quality of the area is better, so that the quality of the target image P3 is better.

It should be noted that the image content of the target image P3 includes the background image P1 and the second image P2.

In some embodiments, multiple telephoto cameras 20 can be controlled to acquire images simultaneously to obtain the second image P2. In this way, multiple second images P2 can be acquired at the same time, so that images of the object at the same time can be taken, which is convenient for post-image stitching and other processing to obtain a target image P3 with better quality. Further, preferably, the first image P1 and the plurality of second images P2 are collected simultaneously. In other words, the wide-angle camera 30 and the telephoto camera 20 can be controlled to be exposed simultaneously to acquire the first image P1 and the plurality of second images P2 simultaneously.

In some embodiments, step S10 includes:

Control multiple telephoto cameras 20 to focus at the same position;

The multiple telephoto cameras 20 are controlled to acquire images to obtain the second image P2.

In some embodiments, the processor 10 is used to control the plurality of telephoto cameras 20 to focus at the same position, and to control the plurality of telephoto cameras 20 to separately acquire images to obtain the second image P2.

In this way, the quality of the obtained second image P2 such as sharpness is substantially the same, which is beneficial to improve the quality of the target image P3 obtained by fusion.

In this way, according to the image of the overlapping area P21, a plurality of second images P2 are fused, so that any two second images P2 have more feature points when they are fused, so that the boundary portions of the two second images P2 can be better fused to obtain The to-be-processed image P23 with better quality can further obtain the target image P3 with better quality.

In some embodiments, step S31 includes:

A plurality of second images P2 are sequentially stitched in a predetermined direction according to the images of the overlapping area P21 to form an image to be processed P23.

In some embodiments, the processor 10 is configured to sequentially splice a plurality of second images P2 in a predetermined direction according to the images of the overlapping area P21 to form an image to be processed P23.

Specifically, the predetermined direction is, for example, a clockwise direction, a counterclockwise direction, or other directions. As in the example of FIG. 20, four second images P2 are sequentially stitched in a clockwise direction to obtain an image to be processed P23. In the example of FIG. 21, four second images P2 are stitched in order from left to right to obtain an image P23 to be processed.

In this way, the processing efficiency of the image P23 to be processed is high, and the power consumption of the electronic device 1000 can be reduced.

As shown in FIG. 15, the electronic device 1000 includes a processor 10 and a memory 60 (for example, a non-volatile storage medium) connected through a system bus 50. Among them, the memory 60 stores an operating system and computer readable instructions. The computer readable instructions can be executed by the processor 10 to implement the image processing method of any of the above embodiments. The processor 10 can be used to provide computing and control capabilities to support the operation of the entire electronic device 1000. The internal memory 60 of the electronic device 1000 provides an environment for the execution of computer-readable instructions in the memory 60.

In addition, the terms "first" and "second" are used for description purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "plurality" is two or more, unless otherwise specifically limited.

In the description of this specification, reference to the descriptions of the terms "one embodiment", "certain embodiments", "schematic embodiments", "examples", "specific examples" or "some examples" is meant to be combined with the The specific features, structures, materials, or characteristics described in the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic expression of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Any process or method description in a flowchart or otherwise described herein may be understood as representing a module, segment, or portion of code that includes one or more executable instructions for implementing specific logical functions or steps of a process , And the scope of the preferred embodiments of the present application includes additional implementations, in which the functions shown may not be in the order shown or discussed, including performing the functions in a substantially simultaneous manner or in reverse order according to the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present application belong.

A person of ordinary skill in the art can understand that all or part of the steps carried in the method of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When executed, it includes one of the steps of the method embodiment or a combination thereof.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk.

Although the embodiments of the present application have been shown and described above, it can be understood that the above-mentioned embodiments are exemplary and cannot be construed as limitations to the present application. Those of ordinary skill in the art can The embodiments are changed, modified, replaced, and modified.

Claims

An image processing method for an electronic device, characterized in that the electronic device includes a wide-angle camera, a plurality of telephoto cameras, a preprocessing chip, and a processor, and the image processing method includes:

Controlling the wide-angle camera and the plurality of telephoto cameras to respectively acquire images according to the photographing instructions;

Cache the first image collected by the wide-angle camera and the second images collected by the multiple telephoto cameras through the preprocessing chip;

The cached first image and the plurality of second images are sent to the processor together.
The image processing method according to claim 1, wherein before the step of controlling the wide-angle camera and the plurality of telephoto cameras to respectively capture images according to a photographing instruction, the image processing method includes:

Controlling the wide-angle camera to collect images and using the image collected by the wide-angle camera as a preview image;

Process the preview image and display the processed preview image.
The image processing method according to claim 2, wherein the processing the preview image and displaying the processed preview image includes:

The preview image is processed by the processor, and the processed preview image is displayed on the display screen of the electronic device.
The image processing method according to claim 1, wherein the pre-processing chip includes a cache area, and the first image collected by the wide-angle camera and the plurality of telephoto cameras are respectively cached by the pre-processing chip Of the second image, including:

Cache the first image and the second image in the cache area.
The image processing method according to claim 1, wherein the preprocessing chip includes an application specific integrated circuit.
The image processing method according to claim 1, wherein the image processing method comprises:

Synthesizing the first image and the plurality of second images by the processor to obtain a target image, wherein the first image includes an intermediate region and an edge region, and the field of view region of the plurality of second images includes The field of view area of the edge area.
The image processing method according to claim 6, wherein the field of view areas of the plurality of second images have overlapping areas within the field of view area of the intermediate area, and the processor synthesizes the The first image and the plurality of the second images to obtain the target image include:

Synthesize a plurality of the second images according to the images of the overlapping area to form an image to be processed;

Synthesize the image to be processed and the first image to obtain the target image.
The image processing method according to claim 7, wherein the number of the second images is four, and the field of view areas of the four second images are respectively selected from the field of view areas of the first image One corner position extends toward the middle position of the field of view of the first image, and the ratio of the area of the field of view of each second image to the area of the field of view of the first image is 1/2 -2/3.
The image processing method according to claim 7, wherein the focus position of the second image is located in the overlapping area.
The image processing method according to claim 1, wherein controlling the wide-angle camera and the plurality of telephoto cameras to capture images respectively according to a photographing instruction includes:

Controlling the multiple telephoto cameras to focus at the same position;

Controlling the plurality of telephoto cameras to separately acquire images to obtain the second image.
An electronic device, characterized in that the electronic device includes a wide-angle camera, a plurality of telephoto cameras, a preprocessing chip and a processor;

The processor is used to control the wide-angle camera and the multiple telephoto cameras to collect images respectively according to a photographing instruction;

The pre-processing chip is used to cache the first image collected by the wide-angle camera and the second images respectively collected by the multiple telephoto cameras through the pre-processing chip; and used to cache the first image and A plurality of the second images are sent to the processor together.
The electronic device according to claim 11, wherein the processor is used to control the wide-angle camera to collect images and use the images collected by the wide-angle camera as preview images; and to process the preview images, the The display screen of the electronic device is used to display the processed preview image.
The electronic device according to claim 11, wherein the preprocessing chip includes a buffer area, and the preprocessing chip is used to buffer the first image and the second image in the buffer area.
The electronic device of claim 11, wherein the preprocessing chip includes an application specific integrated circuit.
The electronic device of claim 11, wherein the processor is configured to synthesize the first image and a plurality of the second images to obtain a target image, wherein the first image includes an intermediate region and an edge Area, the field of view area of the plurality of second images includes the field of view area of the edge area.
The electronic device according to claim 15, wherein the field of view areas of the plurality of second images have an overlapping area within the field of view area of the intermediate area, and the processor is configured to Image synthesizing a plurality of the second images to form an image to be processed; and for synthesizing the image to be processed and the first image to obtain the target image.
The electronic device of claim 16, wherein the number of the second images is four, and the field of view areas of the four second images are respectively selected from one of the field of view areas of the first image The corner position extends toward the middle position of the field of view of the first image, and the ratio of the area of the field of view of each second image to the area of the field of view of the first image is 1/2- 2/3.
The electronic device of claim 16, wherein the focus position of the second image is within the overlapping area.
The electronic device according to claim 11, wherein the processor is used to control the plurality of telephoto cameras to focus at the same position; and to control the plurality of telephoto cameras to separately acquire images to obtain the The second image.
An electronic device characterized by including a wide-angle camera, a plurality of telephoto cameras, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory, And is executed by the one or more processors, the program includes instructions for executing the image processing method according to any one of claims 1-10.
A non-volatile computer-readable storage medium containing computer-executable instructions, which when executed by one or more processors, causes the processor to perform any one of claims 1-10 The image processing method.