CN115802133A - Camera module, electronic equipment, image acquisition method and device and storage medium - Google Patents

Camera module, electronic equipment, image acquisition method and device and storage medium Download PDF

Info

Publication number
CN115802133A
CN115802133A CN202111063723.2A CN202111063723A CN115802133A CN 115802133 A CN115802133 A CN 115802133A CN 202111063723 A CN202111063723 A CN 202111063723A CN 115802133 A CN115802133 A CN 115802133A
Authority
CN
China
Prior art keywords
light
image
camera module
image sensor
light sources
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111063723.2A
Other languages
Chinese (zh)
Inventor
王文涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202111063723.2A priority Critical patent/CN115802133A/en
Publication of CN115802133A publication Critical patent/CN115802133A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

The application provides a camera module, an electronic device, an image acquisition method, an image acquisition device and a computer-readable storage medium; this camera module includes: the lens module comprises a shell, a lens assembly, an image sensor and a light supplementing device; the shell is provided with an accommodating space; the lens assembly is connected with the shell; the image sensor is arranged in the accommodating space; the light supplementing device is arranged on one side of the lens assembly, which is far away from the image sensor; the light supplementing device comprises a plurality of light sources which can be independently controlled to be lightened, and the light sources are used for emitting light rays towards the shooting target; the image sensor is used for receiving reflected light of light rays emitted by different light sources of the light supplementing device at intervals on a shooting target so as to form a multi-frame initial image. The camera module can realize the function of the super-resolution macro lens with a large imaging field of view, obtain a target image with high resolution in a full field of view, solve the problem of mutual contradiction between the photographing field angle and the resolution in the traditional macro lens, and improve the photographing experience of the macro lens of the electronic equipment.

Description

Camera module, electronic equipment, image acquisition method and device and storage medium
Technical Field
The invention relates to the technical field of cameras, in particular to a camera module, electronic equipment, an image acquisition method, an image acquisition device and a computer-readable storage medium.
Background
Most of the existing micro-lenses used in electronic devices such as mobile phones and tablet computers are geometrical optical structures composed of a plurality of refractive lenses.
The conventional ultra-macro lens can realize high-magnification object imaging, but the imaging mode is still based on the principle of traditional lens imaging. Therefore, when an object with small details needs to be photographed, the numerical aperture Of the lens needs to be increased, but the resolution needs to be improved at the expense Of the imaging Field Of View (generally described in terms Of the imaging Field angle FOV).
Disclosure of Invention
The first aspect of the embodiments of the present application provides a camera module, the camera module includes:
a housing formed with an accommodating space;
the lens assembly is connected with the shell;
the image sensor is arranged in the accommodating space;
the light supplementing device is arranged on one side of the lens assembly, which is far away from the image sensor; the light supplementing device comprises a plurality of light sources which can be independently controlled to be lightened, and the light sources are used for emitting light rays towards a shooting target;
the image sensor is used for receiving light reflected by the shooting target from different light sources of the light supplementing device at intervals so as to form a multi-frame initial image.
In a second aspect, an embodiment of the present application provides an electronic device, where the electronic device includes a control circuit board and the camera module in any one of the foregoing embodiments; the control circuit board is electrically connected with the camera module and is used for controlling the light source of the light supplementing device, processing the received multi-frame initial image and obtaining a target image; and the field angle and the resolution of the target image are greater than those of each frame of initial image.
In a third aspect, an embodiment of the present application provides an image acquisition method, which is applied to an electronic device, where the electronic device includes a control circuit board and a camera module, and the control circuit board is electrically connected to the camera module; the camera module comprises a light supplementing device and an image sensor, wherein the light supplementing device comprises a plurality of light sources which can be independently controlled to be lightened;
the image acquisition method comprises the following steps:
the control circuit board controls the light sources of the light supplementing device to emit light rays towards the same shooting target at intervals;
the control circuit board is used for controlling the image sensor to collect at least one frame of initial image with a local clear shooting target in the light emitting interval of each light source;
processing the multi-frame initial image collected by the image sensor through the control circuit board, and obtaining a target image; and the field angle and the resolution of the target image are larger than those of each frame of initial image.
In a fourth aspect, an embodiment of the present application provides an image acquisition device applied to an electronic device, where the electronic device includes a camera module, the camera module includes a light supplement device and an image sensor, and the light supplement device includes a plurality of light sources that can be independently controlled to be turned on;
the image acquisition apparatus includes:
the control module is used for controlling the light sources of the light supplementing device to emit light rays towards the same shooting target at intervals;
the acquisition module is used for controlling the image sensor to acquire at least one frame of initial image with a locally clear shooting target in the light emitting interval of each light source;
and the image processing module is used for processing the multi-frame initial images acquired by the image sensor and obtaining target images, wherein the field angle and the resolution of each target image are larger than those of each frame of initial image.
In a fifth aspect, an embodiment of the present application provides an electronic device, where the electronic device includes a processor and a memory, which are connected to each other, where the memory is used to store program data, and the processor is used to execute the program data to implement the obtaining method according to any one of the foregoing embodiments.
In addition, an embodiment of the present application further provides a computer-readable storage medium, where program data are stored, and when the program data are executed by a processor, the program data are used to implement the obtaining method as described in any one of the above embodiments.
The camera module that this application embodiment provided is through the structure of design light filling device to a plurality of light sources through control light filling device light in proper order and acquire multiframe initial image, and the processing algorithm of reunion image, thereby realize the super-resolution macro lens function of big formation of image visual field, can obtain the target image of full field of view high resolution, solved the problem of the mutual contradiction between angle of vision and the resolution ratio of shooing among the traditional super macro lens, promote the shooting experience of electronic equipment super macro lens.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic overall structure diagram of an embodiment of a camera module according to the present application;
FIG. 2 is a schematic side view of the camera module shown in FIG. 1;
FIG. 3 isbase:Sub>A schematic sectional view of the camera module in the embodiment of FIG. 2 at A-A;
fig. 4 is a schematic structural disassembly diagram of the camera module in the embodiment of fig. 2;
FIG. 5 is a schematic cross-sectional view of an embodiment of a lens assembly in an embodiment of the present application;
fig. 6 is a schematic front view illustrating a structure of an embodiment of a light supplement device in the embodiment of the present application;
FIG. 7 is a schematic cross-sectional view of the light supplement device at a position B-B in the embodiment of FIG. 6;
FIG. 8 is a schematic diagram of a shooting optical path of the camera module in the embodiment of the present application;
FIG. 9 is a schematic front view of an embodiment of an electronic device of the present application;
FIG. 10 is a schematic diagram of a back structure of the electronic device in the embodiment of FIG. 9;
FIG. 11 is a block diagram illustrating the structure of an embodiment of the electronic device of the present application;
FIG. 12 is a block diagram of the structure of yet another embodiment of the electronic device of the present application;
FIG. 13 is a schematic flowchart of an embodiment of an image obtaining method of an electronic device according to the foregoing embodiment;
FIG. 14 is a schematic view of a position of a photographic view with four different position light sources illuminated;
FIG. 15 is a schematic diagram of a different phase sub-surface reduction high definition image;
FIG. 16 is a block diagram of an embodiment of an apparatus for acquiring an image according to the present application;
FIG. 17 is a schematic view of a structure of still another embodiment of an image pickup apparatus according to the present application;
fig. 18 is a block diagram schematically illustrating a structure of a computer storage medium in an embodiment of the present application.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be noted that the following examples are only illustrative of the present invention, and do not limit the scope of the present invention. Likewise, the following examples are only some examples, not all examples, and all other examples obtained by those skilled in the art without any inventive work are within the scope of the present invention.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
As used herein, an "electronic device" (or simply "terminal") includes, but is not limited to, an apparatus that is configured to receive/transmit communication signals via a wireline connection, such as via a public-switched telephone network (PSTN), a Digital Subscriber Line (DSL), a digital cable, a direct cable connection, and/or another data connection/network, and/or via a wireless interface (e.g., for a cellular network, a Wireless Local Area Network (WLAN), a digital television network such as a DVB-H network, a satellite network, an AM-FM broadcast transmitter, and/or another communication terminal). A communication terminal arranged to communicate over a wireless interface may be referred to as a "wireless communication terminal", "wireless terminal" or "mobile terminal". Examples of mobile terminals include, but are not limited to, satellite or cellular telephones; a Personal Communications System (PCS) terminal that may combine a cellular radiotelephone with data processing, facsimile and data communications capabilities; a PDA that can include a radiotelephone, pager, internet/intranet access, web browser, memo pad, calendar and/or Global Positioning System (GPS) receiver; and conventional laptop and/or palmtop receivers or other electronic devices that include a radiotelephone transceiver. A cellular phone is an electronic device equipped with a cellular communication module.
Referring to fig. 1 to 4, fig. 1 is a schematic overall structure diagram of a camera module according to an embodiment of the present application; FIG. 2 is a schematic side view of the camera module shown in FIG. 1; FIG. 3 isbase:Sub>A schematic sectional view of the camera module in the embodiment of FIG. 2 at A-A; FIG. 4 is a schematic diagram illustrating a structure of the camera module shown in FIG. 2; it should be noted that the camera module in the present application is used for an electronic device, and the electronic device may include a mobile phone, a tablet computer, a notebook computer, a wearable device, and the like. The camera module 10 includes, but is not limited to, the following structure: the lens module comprises a housing 100, a lens assembly 200, an image sensor 300 and a light supplement device 400. It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the embodiments of the present application, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or may alternatively include other steps or elements inherent to such process, method, article, or apparatus.
Specifically, the housing 100 may include a base 110 and a front shell 120, which cooperate to form an accommodating space 1000. The lens assembly 200 is coupled to the front case 110 of the housing 100. The image sensor 300 is disposed in the accommodating space 1000. The light supplement device 400 is disposed on a side of the lens assembly 200 away from the image sensor 300. The light supplement device 400 may be connected to the lens assembly 200 or the housing 100.
Referring to fig. 5, fig. 5 is a schematic cross-sectional structural view of an embodiment of a lens assembly in an embodiment of the present application, and optionally, the lens assembly 200 includes a lens holder 210, a lens mirror 220, and a filter mirror 230, where the lens mirror 220 and the filter mirror 230 are stacked and connected to the lens holder 210 respectively. Optionally, in some other embodiments, the lens holder 210 may also be a part of the housing 100.
Optionally, the lens optics 220 in this embodiment may include a plurality of combined optics (combination of a plurality of positive and negative power optics) structures, which are not limited herein. The filter lens 230 may be an IR filter, i.e. an infrared filter, blue glass. In addition, in some other embodiments, the filter lens 230 may not be disposed in the lens assembly, and may be a separate structure disposed between the lens assembly 200 and the image sensor 300.
Referring to fig. 6 and 7 together, fig. 6 is a schematic structural front view of a light supplement device according to an embodiment of the present disclosure; FIG. 7 is a schematic cross-sectional view of the light supplement device at a position B-B in the embodiment of FIG. 6; optionally, the light supplement device 400 in this embodiment includes a back plate 410 and a plurality of light sources 420 disposed on the back plate 410. Wherein the plurality of light sources 420 may be LED lamps, and each light source 420 may be independently controlled to be turned on and off and adjusted in brightness. It should be noted that the terms "first", "second" and "third" in the embodiments of the present application are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include at least one of the feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless explicitly specified otherwise.
Optionally, the back plate 410 may be made of an opaque material or a black coating may be coated on the back plate 410 for blocking the light emitted from the light source 420 and avoiding interference with the lens assembly 200. Ensuring that light is only emitted in a direction away from the lens assembly 200. The back plate 410 may be a circuit board, and the light source 420 may be a plurality of LED lamps connected to the circuit board. The back plate 410 may be connected to the lens holder 210.
Optionally, a through hole 411 may be formed in the middle of the back plate 410, and the plurality of light sources 420 are disposed around the through hole 411; the lens assembly 200 is opposite to the through hole 411 (i.e. the light source 420 is disposed around the lighting area of the lens assembly 200), and the lens assembly 200 can take light through the through hole 411.
With reference to fig. 3 and fig. 4, the camera module in this embodiment further includes a connection circuit board 150, the connection circuit board 150 is electrically connected to the circuit 112 on the base 110 through a flexible circuit board 160, and the connection circuit board 150 is further provided with a connector 170 for connecting with an external control circuit. Optionally, the image sensor 300 may also be connected to the connection circuit board 150 through the flexible circuit board 160, so as to be electrically connected to an external control circuit. Other features of the camera module (e.g., focus motor, etc.) are within the purview of one skilled in the art and will not be described in detail herein. It should be noted that all directional indicators (such as up, down, left, right, front, back, 8230) \8230;) in the embodiments of the present application are only used to explain the relative positional relationship between the components in a specific posture (as shown in the attached drawings), the motion situation, etc., and if the specific posture is changed, the directional indicators are correspondingly changed.
Referring to fig. 8, fig. 8 is a schematic diagram of a shooting optical path of a camera module according to an embodiment of the present disclosure, in which the light supplement device 400 is configured to emit light toward a shooting target 88, and the image sensor 300 is configured to receive light reflected by the shooting target from light sources 420 of the light supplement device 400 at intervals so as to form multiple initial images. Specifically, the light sources 420 are sequentially turned on in a predetermined orderIncident and emergent light field
Figure BDA0003257556100000081
The emergent light irradiates on the shooting target 88 (O (x, y)) to obtain a light field P modulated by the shooting target 88 i (x, y) = O (xy), the light reflected by the photographed target 88 enters the lens assembly 200, the light passes through the lens assembly 200 and is modulated into P (x, y) · O (x, y) · PSF, wherein the PSF is a point spread function of the imaging lens system, and finally, the light intensity distribution acquired by the imaging detector is I (x, y) = | P (x, y) · O (x, y) · PSF ∑ component 2 . The arrangement and lighting sequence of the light sources 420 can be implemented in any form, and the more light sources are used in a shooting process, the better, and the whole light sources 420 are preferably traversed. The light sources 420 may be lit up one by one, may be lit up ring by ring, or may be lit up column by column, etc.
The following embodiments will describe an image processing process after the image sensor 300 receives a plurality of initial images formed by the reflected lights of the light emitted by the light supplement device at different light source intervals on the shooting target.
The camera module in this embodiment obtains multiple frames of initial images by designing the structure of the light supplement device and sequentially lighting a plurality of light sources of the light supplement device, and combines with an image processing algorithm, thereby realizing the function of the super-resolution macro lens with a large imaging field of view, and obtaining a target image with a high resolution in a full field of view (namely, the field angle and the resolution of the target image are larger than those of each frame of initial image), solving the problem of mutual contradiction between the field angle and the resolution of a photographing in the conventional macro lens, and improving the photographing experience of the macro lens of the electronic device.
Further, an electronic device is provided in an embodiment of the present application, please refer to fig. 9 and fig. 10 together, where fig. 9 is a schematic front structure diagram of an embodiment of the electronic device of the present application, and fig. 10 is a schematic back structure diagram of the electronic device in the embodiment of fig. 9, and the electronic device in the embodiment of the present application may include a mobile phone, a tablet computer, a notebook computer, a wearable device, and the like. The present embodiment is described with reference to a mobile phone as an example.
Specifically, the electronic apparatus may include a display screen 30, a housing 20, a control circuit board 40, a battery 50, and a camera module 10. The electronic device in this embodiment may include a plurality of camera modules 10. Please refer to the related description of the foregoing embodiments for the structure of the camera module 10.
The camera module 10 may be connected to the housing 20 or the display screen 30 (to form a front-facing and a rear-facing camera structure); the shell 20 with the cooperation of display screen 30 forms accommodation space, control circuit board 40 and battery 50 locate in the accommodation space, control circuit board 40 with camera module 10 battery 50 and display screen 30 electricity is connected. The battery 50 is used for supplying power, and the control circuit board 40 is used for controlling the camera module 10, the battery 50 and the working state of the display screen 30. The detailed technical features of other parts of the electronic device are within the understanding of those skilled in the art, and are not described herein.
Referring to fig. 11, fig. 11 is a block diagram illustrating a structure of an embodiment of an electronic device according to the present application, where the structure of the electronic device may include an RF circuit 910, a memory 920, an input unit 930, a display unit 940 (which may be the display screen 30 in the foregoing embodiment), a sensor 950, an audio circuit 960, a camera 970 (i.e., the camera module 10 in the foregoing embodiment), a processor 980 (which may be the control circuit board 40 in the foregoing embodiment), and a power supply 990 (which may be the battery 50 in the foregoing embodiment). The RF circuit 910, the memory 920, the input unit 930, the display unit 940, the sensor 950, the audio circuit 960, and the camera 970 are respectively connected to the processor 980; the power supply 990 is used to supply power to the entire electronic device.
Specifically, the RF circuit 910 is used for transmitting and receiving signals; the memory 920 is used for storing data instruction information; the input unit 930 is used for inputting information, and may specifically include a touch panel 931 and other input devices 932 such as operation keys; the display unit 940 may include a display panel 941; the sensor 950 includes an infrared sensor, a laser sensor, etc. for detecting a user approach signal, a distance signal, etc.; a speaker 961 and a microphone 962 are connected to the processor 980 through an audio circuit 960 for emitting and receiving sound signals; the camera 970 is used for image acquisition (including photographing, video and face recognition functions), and the processor 980 is used for processing data information of the electronic device. In addition, the electronic device may further include a wifi module (not shown), and the wifi module is configured to receive and transmit wifi signals. For the specific structural features of the camera module of the electronic device, please refer to the related description of the foregoing embodiments, and detailed description thereof will not be provided herein.
The electronic equipment that this application embodiment provided, its camera module is through the structure of design light filling device to light in proper order and acquire multiframe initial image through a plurality of light sources of control light filling device, and the image processing algorithm that combines again, thereby realize the super-resolution macro lens function of big formation of image visual field, can obtain the target image of full visual field high resolution, solved the problem of mutual contradiction between angle of field of the taking a picture and the resolution ratio in the traditional super macro lens, promote the shooting experience of electronic equipment super macro lens.
Referring to fig. 12, fig. 12 is a block diagram of a structure of another embodiment of an electronic device according to the present application, where the electronic device in the present embodiment includes a control circuit board 40 and a camera module 10. The control circuit board 40 is electrically connected to the camera module 10. For detailed structural features of the camera module 10, refer to the related description of the foregoing embodiments. The control circuit board 40 is configured to control a light source of the light supplement device of the camera module 10, and receive an initial image obtained by the image sensor, and the control circuit board is configured to process the received multiple frames of initial images and obtain a target image, where a field angle and a resolution of the target image are greater than those of each frame of initial image, that is, the target image is an image with a full field of view and a high resolution. The electronic device in this embodiment may be a camera or a camera module integrated with a control chip.
Referring to fig. 13, fig. 13 is a schematic flowchart illustrating an embodiment of an image obtaining method for an electronic device according to the foregoing embodiment of the present application; the method includes, but is not limited to, the following steps. It should be noted that, in the flow method in this embodiment, the order of each step does not represent that there is a certain sequential execution relationship, and some steps without a causal relationship may be performed synchronously or sequentially.
The method comprises the following steps: and S100, controlling a plurality of light sources of the light supplementing device to emit light rays towards the same shooting target at intervals through a control circuit board.
In step S100, please refer to the structural embodiment of the foregoing camera module in combination, the arrangement structure and the lighting sequence of the light sources may be implemented in any form, and the more light sources are used in a shooting process, the better is to traverse all light sources, and the light sources may be lit one by one, or may be lit ring by ring or column by column.
And step S200, the control circuit board is used for controlling the image sensor to collect at least one frame of initial image with local clear shooting target in the light-emitting interval of each light source.
In this step, the image sensor may collect one or more frames of locally sharp images of the photographic target as an initial image within the light emitting interval of each light source. The light emitting interval of each light source refers to a process of lighting each light source. Referring to fig. 14, fig. 14 is a schematic diagram of a shooting view position with four different positions of light sources turned on. In the figure, different apertures 14a, 14b, 14c, 14d are shown as clear positions of the photographic subject photographed under different light sources. Light sources 420a, 420b, 420c, 420d at the four corners of the figure indicate that the light sources are illuminated at different positions. The light sources 420a, 420b, 420c, 420d may be apertures 14a, 14b, 14c, 14d, respectively. Optionally, in the image acquired when each light source emits light, the clear positions of the targets are not completely the same, and in the initial image acquired when the adjacent light sources emit light, the clear positions of the targets partially overlap.
And step S300, processing the multi-frame initial image acquired by the image sensor through the control circuit board, and acquiring a target image.
In step S300, specifically, multiple frames of initial images acquired by the image sensor may be sequentially iterated to obtain a target image. The field angle and the resolution of the target image are larger than those of each frame of initial image, namely the target image is a full-field high-resolution image.
The specific process is as follows:
different regions of the photographic subject under overlapping illumination will be defined as vectors R l This defines the amount of movement of the ith sample position relative to the arbitrarily selected area. The number of iterations can be written as n and the scan position as r j Then the flow of the stacking algorithm can proceed as follows.
1. At the time of the nth iteration, when the position of the probe is r j The result of the interaction between the object transmission function at this position and the unknown illumination function at the corresponding scanning position is expressed as: u shape j (r)=P(r-r j )O n (r)。
2. For far field diffraction patterns, we can here obtain by fourier transforming the outgoing light field:
Figure BDA0003257556100000121
3. the amplitude of the obtained diffraction field is constrained, for example, the square root of the measured intensity replaces the amplitude of the diffraction pattern obtained by fourier transform and keeps the phase unchanged (which is consistent with the conventional phase recovery algorithm), and then the obtained diffraction field is inversely transformed into the real space to obtain an updated emergent light field U':
Figure BDA0003257556100000122
4. updating the equation for the object thus yields:
Figure BDA0003257556100000123
where ε is an arbitrary constant, typically a small value, which avoids the numerator being zero, α is a constant between 0 and 1, which controls the feedback process of the update equation, | P (r-r) j )|/|P(r-r j )| max Is to perform normalized amplitude processing on the illuminating light wave. This normalization process makes the radiation intensity in P (r) greater whereIn this way, high errors caused by weak incident light can be greatly suppressed.
And for the next probe, repeating the steps 1-4 until all probe positions are traversed, and thus completing a complete iteration process. As a basis for measuring convergence, the measure can be taken from the difference between the measured intensity value and a function guessed from the object
Figure BDA0003257556100000124
This summation is a mean calibration of the positions and pixel points for the entire sample.
When the illumination function is a sharp aperture with only one scan position, the overlay imaging becomes an error reduction algorithm.
By using the algorithm, on one hand, the problem of mutual contradiction between the photographing field angle and the resolution in the traditional super-macro lens can be solved, and a target image with high resolution in a full view field can be obtained. On the other hand, high-definition images can be obtained on non-standard phase surfaces, and the Gaussian formula does not need to be strictly executed. The requirements for focusing can be reduced. Referring to fig. 15, fig. 15 is a schematic diagram of restoring a high definition image under different phase planes. Wherein, b1 can be represented as an initial image obtained by a standard phase plane image sensor, and b2 is represented as a high-definition image obtained after algorithm processing. a1 can be expressed as an initial image obtained by a front phase surface image sensor, and a2 is expressed as a high-definition image obtained after algorithm processing; c1 can be expressed as an initial image obtained by a back phase surface image sensor, and c2 is expressed as a high-definition image obtained after algorithm processing; as can be seen from comparison in the figure, the differences in the sharpness of the high-definition images a2, b2, and c2 obtained after the algorithm processing are very small, that is, the algorithm in this embodiment can restore the sharpness effect almost the same as that of the standard phase plane regardless of the front phase plane or the rear phase plane.
The image acquisition method provided by the embodiment of the application comprises the steps of firstly controlling a plurality of light sources of a light supplementing device to emit light towards the same shooting target at intervals, then controlling an image sensor to collect at least one initial image with a locally clear shooting target in a light emitting interval of each light source, and finally processing a plurality of frames of initial images collected by the image sensor to obtain a target image with a full view field and high resolution; the function of the super-resolution macro lens with a large imaging field of view can be achieved, a target image with a full field of view and a high resolution can be obtained, the problem that the photographing field angle and the resolution are mutually inconsistent in a traditional super-macro lens is solved, and the photographing experience of the super-macro lens of the electronic equipment is improved.
Fig. 16 shows a block diagram of an embodiment of the image capturing apparatus according to the present application, where fig. 16 is a schematic block diagram of the image capturing apparatus according to the present application. The acquiring device includes a control module 160a, an acquisition module 160b, and an image processing module 160c. The control module 160a is configured to control a plurality of light sources of the light supplement device to emit light rays towards the same shooting target at intervals; the collecting module 160b is configured to control the image sensor to collect at least one frame of initial image with a locally clear shooting target in the light emitting interval of each light source; the image processing module 160c is configured to process multiple frames of initial images collected by the image sensor, and obtain a target image, where an angle of view and a resolution of the target image are greater than those of each frame of initial image. For detailed working processes of each module, reference is made to the detailed description of the foregoing method embodiment, which is not repeated herein.
The image acquisition device provided by the embodiment of the application can realize the function of the super-resolution macro lens with a large imaging field of view, obtains the target image with high resolution in the full field of view, solves the problem of mutual contradiction between the photographing field angle and the resolution in the traditional macro lens, and improves the photographing experience of the super-resolution lens of the electronic equipment.
Referring to fig. 17, fig. 17 is a schematic structural diagram of another embodiment of the image capturing apparatus of the present application, where the image capturing apparatus 80 includes a processor 81 and a memory 82 connected to each other, the memory 82 is used for storing program data, and the processor 81 is used for executing the program data to implement the following methods:
the control circuit board controls the light sources of the light supplementing device to emit light rays towards the same shooting target at intervals;
the control circuit board is used for controlling the image sensor to collect at least one frame of initial image with a local clear shooting target in the light emitting interval of each light source;
processing the multi-frame initial image acquired by the image sensor through the control circuit board, and acquiring a target image; and the field angle and the resolution of the target image are larger than those of each frame of initial image.
Optionally, in the step of controlling the image sensor to collect at least one frame of initial image with locally clear shooting targets in the light emitting interval of each light source through the control circuit board, in the initial image collected when each light source emits light, the clear positions of the shooting targets are not completely the same, and in the initial images collected when adjacent light sources emit light, the clear positions of the shooting targets are partially overlapped.
Optionally, the step of processing the multiple frames of initial images collected by the image sensor through the control circuit board and obtaining the target image includes: sequentially iterating the multiple frames of initial images acquired by the image sensor to obtain a target image; the field angle and the resolution of the target image are larger than those of each frame of initial image, and the target image is a full-field high-resolution image.
For details of the above steps, reference is made to the related description of the foregoing method embodiments, and details are not described here.
An embodiment of the present application further provides a computer storage medium, please refer to fig. 18, where fig. 18 is a schematic block diagram of a structure of the computer storage medium in the embodiment of the present application; the computer storage medium 90 has stored therein program data 91, which program data 91, when executed by a processor, is adapted to implement the method of:
the control circuit board controls the light sources of the light supplementing device to emit light rays towards the same shooting target at intervals;
the control circuit board is used for controlling the image sensor to collect at least one frame of initial image with a local clear shooting target in the light emitting interval of each light source;
processing the multi-frame initial image collected by the image sensor through the control circuit board, and obtaining a target image; and the field angle and the resolution of the target image are greater than those of each frame of initial image.
For details of the above steps, reference is made to the related description of the foregoing method embodiments, and details are not repeated here.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units may be integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated units in the other embodiments described above may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only a part of the embodiments of the present invention, and not intended to limit the scope of the present invention, and all equivalent devices or equivalent processes performed by the present invention through the contents of the specification and the drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (11)

1. The utility model provides a camera module which characterized in that, camera module includes:
a housing formed with an accommodating space;
the lens assembly is connected with the shell;
the image sensor is arranged in the accommodating space;
the light supplementing device is arranged on one side of the lens assembly, which is far away from the image sensor; the light supplementing device comprises a plurality of light sources which can be independently controlled to be lightened, and the light sources are used for emitting light rays towards a shooting target;
the image sensor is used for receiving reflected light of light rays emitted by different light sources of the light supplementing device at intervals on a shooting target so as to form a multi-frame initial image.
2. The camera module according to claim 1, wherein a through hole is formed in a middle portion of the light supplement device, and the plurality of light sources are arranged around the through hole; the lens assembly is opposite to the through hole and can take light through the through hole.
3. The camera module according to claim 2, wherein the light supplement device further comprises a back plate, and the plurality of light sources are disposed on the back plate.
4. The camera module of claim 3, wherein the through hole is formed in a middle portion of the back plate, the plurality of light sources are disposed around the through hole, and the back plate is made of an opaque material.
5. An electronic device, comprising a control circuit board and the camera module of any one of claims 1-4; the control circuit board is electrically connected with the camera module and is used for controlling the light source of the light supplementing device, processing the received multiple frames of initial images and obtaining a target image; and the field angle and the resolution of the target image are larger than those of each frame of initial image.
6. The image acquisition method is applied to electronic equipment, and is characterized in that the electronic equipment comprises a control circuit board and a camera module, wherein the control circuit board is electrically connected with the camera module; the camera module comprises a light supplementing device and an image sensor, wherein the light supplementing device comprises a plurality of light sources which can be independently controlled to be lightened;
the image acquisition method comprises the following steps:
the control circuit board controls the light sources of the light supplementing device to emit light rays towards the same shooting target at intervals;
the control circuit board is used for controlling the image sensor to collect at least one frame of initial image with a locally clear shooting target in the light-emitting interval of each light source;
processing the multi-frame initial image collected by the image sensor through the control circuit board, and obtaining a target image; and the field angle and the resolution of the target image are larger than those of each frame of initial image.
7. The method according to claim 6, wherein in the step of controlling the image sensor to capture at least one initial image of the shot object with local clearness within the light-emitting interval of each light source through the control circuit board, the clear positions of the shot object are not completely the same in the initial image captured when each light source emits light, and the clear positions of the shot object partially overlap in the initial images captured when adjacent light sources emit light.
8. The method according to claim 7, wherein the step of processing, by the control circuit board, the plurality of frames of initial images collected by the image sensor and obtaining the target image comprises: and sequentially iterating the multiple frames of initial images acquired by the image sensor to obtain a target image.
9. An image acquisition device applied to electronic equipment is characterized in that the electronic equipment comprises a camera module, the camera module comprises a light supplementing device and an image sensor, and the light supplementing device comprises a plurality of light sources which can be independently controlled to be lightened;
the image acquisition apparatus includes:
the control module is used for controlling the light sources of the light supplementing device to emit light rays towards the same shooting target at intervals;
the acquisition module is used for controlling the image sensor to acquire at least one frame of initial image with a locally clear shooting target in the light emitting interval of each light source;
the image processing module is used for processing the multiple frames of initial images acquired by the image sensor and obtaining a target image, wherein the field angle and the resolution of the target image are larger than those of the initial images.
10. An electronic device, characterized in that the electronic device comprises a processor and a memory connected to each other, the memory being adapted to store program data, the processor being adapted to execute the program data to implement the acquisition method according to any of claims 6-8.
11. A computer-readable storage medium, in which program data are stored, which program data, when being executed by a processor, are adapted to carry out the acquisition method according to any one of claims 6 to 8.
CN202111063723.2A 2021-09-10 2021-09-10 Camera module, electronic equipment, image acquisition method and device and storage medium Pending CN115802133A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111063723.2A CN115802133A (en) 2021-09-10 2021-09-10 Camera module, electronic equipment, image acquisition method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111063723.2A CN115802133A (en) 2021-09-10 2021-09-10 Camera module, electronic equipment, image acquisition method and device and storage medium

Publications (1)

Publication Number Publication Date
CN115802133A true CN115802133A (en) 2023-03-14

Family

ID=85416851

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111063723.2A Pending CN115802133A (en) 2021-09-10 2021-09-10 Camera module, electronic equipment, image acquisition method and device and storage medium

Country Status (1)

Country Link
CN (1) CN115802133A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090111512A1 (en) * 2007-10-31 2009-04-30 Randolph Cary Demuynck Portable electronic device having high-resolution camera with tunable sensor auto focus
CN107959801A (en) * 2017-12-18 2018-04-24 广州大学 A kind of light-source brightness control system and control method
WO2019051683A1 (en) * 2017-09-13 2019-03-21 深圳传音通讯有限公司 Fill light photography method, mobile terminal and computer-readable storage medium
CN109788207A (en) * 2019-01-30 2019-05-21 Oppo广东移动通信有限公司 Image composition method, device, electronic equipment and readable storage medium storing program for executing
JP2019103066A (en) * 2017-12-06 2019-06-24 キヤノン株式会社 Electronic device, control method of the same, and imaging device
CN111314586A (en) * 2020-02-19 2020-06-19 北京小米移动软件有限公司 Light supplementing assembly, control method thereof, camera module and mobile terminal
WO2020220973A1 (en) * 2019-04-29 2020-11-05 维沃移动通信有限公司 Photographing method and mobile terminal
CN112017137A (en) * 2020-08-19 2020-12-01 深圳市锐尔觅移动通信有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium
CN112751999A (en) * 2019-10-31 2021-05-04 北京小米移动软件有限公司 Electronic device, shooting method and shooting device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090111512A1 (en) * 2007-10-31 2009-04-30 Randolph Cary Demuynck Portable electronic device having high-resolution camera with tunable sensor auto focus
WO2019051683A1 (en) * 2017-09-13 2019-03-21 深圳传音通讯有限公司 Fill light photography method, mobile terminal and computer-readable storage medium
JP2019103066A (en) * 2017-12-06 2019-06-24 キヤノン株式会社 Electronic device, control method of the same, and imaging device
CN107959801A (en) * 2017-12-18 2018-04-24 广州大学 A kind of light-source brightness control system and control method
CN109788207A (en) * 2019-01-30 2019-05-21 Oppo广东移动通信有限公司 Image composition method, device, electronic equipment and readable storage medium storing program for executing
WO2020220973A1 (en) * 2019-04-29 2020-11-05 维沃移动通信有限公司 Photographing method and mobile terminal
CN112751999A (en) * 2019-10-31 2021-05-04 北京小米移动软件有限公司 Electronic device, shooting method and shooting device
CN111314586A (en) * 2020-02-19 2020-06-19 北京小米移动软件有限公司 Light supplementing assembly, control method thereof, camera module and mobile terminal
CN112017137A (en) * 2020-08-19 2020-12-01 深圳市锐尔觅移动通信有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium

Similar Documents

Publication Publication Date Title
US10523872B2 (en) Methods and apparatus for implementing zoom using one or more moveable camera modules
WO2018225967A1 (en) Device having cameras with different focal lengths and method of implementing cameras
US7196728B2 (en) Method and apparatus for displaying images in combination with taking images
KR20200132986A (en) Mobile terminal
CN114693569A (en) Method for fusing videos of two cameras and electronic equipment
CN210381052U (en) Electronic device
US11954833B2 (en) Electronic device for supporting machine learning-based image processing
US20220321748A1 (en) Electronic device including camera module
KR102214199B1 (en) Mobile communication terminal
KR20210138483A (en) Method or electronic device providing image shooting guide
CN115802133A (en) Camera module, electronic equipment, image acquisition method and device and storage medium
US20230074962A1 (en) Electronic device including a plurality of cameras and operating method thereof
CN116993835A (en) Camera calibration method, camera calibration device, electronic equipment and storage medium
WO2022211249A1 (en) Machine learning-based electronic device for supporting image processing
KR100736565B1 (en) Method of taking a panorama image and mobile communication terminal thereof
CN114203062A (en) Display module, display screen assembly, electronic equipment and camera shooting method
CN117135420B (en) Image synchronization method and related equipment thereof
CN114286072A (en) Color restoration device and method, image processor
CN115049816A (en) Target identification method and device, electronic equipment and storage medium
US20190253590A1 (en) Camera Module
CN217508811U (en) Electronic device
US20230388648A1 (en) Electronic device including camera module and control method thereof
CN215340618U (en) Display device and electronic apparatus
KR20190137653A (en) Biometric authentication device
US11991446B2 (en) Method of image stabilization and electronic device therefor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination