WO2021093502A1

WO2021093502A1 - Phase difference obtaining method and apparatus, and electronic device

Info

Publication number: WO2021093502A1
Application number: PCT/CN2020/120847
Authority: WO
Inventors: 贾玉虎
Original assignee: Oppo广东移动通信有限公司
Priority date: 2019-11-12
Filing date: 2020-10-14
Publication date: 2021-05-20
Also published as: CN112866548B; CN112866548A

Abstract

Embodiments of the present application relate to a phase difference obtaining method and apparatus, an electronic device, and a computer readable storage medium. The phase difference obtaining method comprises: performing scene detection on a captured image to obtain a scene type; and obtaining, by means of an image sensor, a phase difference value corresponding to the scene type, the phase difference valve being a phase difference value in a first direction or a phase difference value in a second direction, and the first direction and the second direction forming a preset angle.

Description

Method and device for obtaining phase difference, and electronic equipment

Cross-references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 2019111014227, and the invention title is "phase difference acquisition method and device, electronic equipment" on November 12, 2019, the entire content of which is incorporated herein by reference Applying.

Technical field

This application relates to the field of imaging, in particular to a method and device for obtaining phase difference, electronic equipment, and computer-readable storage media.

Background technique

With the development of electronic device technology, more and more users take images through electronic devices. In order to ensure that the captured image is clear, it is usually necessary to focus on the camera module of the electronic device, that is, by adjusting the distance between the lens and the image sensor, so that the subject is on the focal plane. Traditional focusing methods include phase detection auto focus (English: phase detection auto focus; referred to as PDAF).

The traditional phase detection autofocus is to set phase detection pixel points in pairs in the pixel points included in the image sensor, where one phase detection pixel point of each phase detection pixel point pair is shielded on the left side, and the other phase detection pixel point The pixel points are shielded on the right side, so that the imaging beam directed at each phase detection pixel point pair can be separated into two parts, the left and right parts of the imaging beam, the phase difference can be obtained by comparing the images formed by the left and right parts of the imaging beam. After the phase difference is obtained, focusing can be performed according to the phase difference, where the phase difference refers to the difference in the imaging position of the imaging light incident from different directions.

However, the above method of setting phase detection pixels in the image sensor does not have high accuracy in obtaining the phase difference.

Summary of the invention

The embodiments of the present application provide a method and device for acquiring a phase difference, electronic equipment, and a computer-readable storage medium, which can improve the accuracy of acquiring the phase difference.

A method for obtaining a phase difference is applied to an electronic device. The electronic device includes an image sensor. The image sensor includes a plurality of pixel point groups arranged in an array, and each of the pixel point groups includes M* arranged in an array. N pixels; each pixel corresponds to a photosensitive unit, where M and N are both natural numbers greater than or equal to 2; the method includes:

Perform scene detection on the captured image to obtain the scene type;

Obtain a phase difference value corresponding to the scene type through the image sensor, where the phase difference value is a phase difference value in a first direction or a phase difference value in a second direction; the first direction and the second direction Into a preset angle.

A phase difference acquisition device, applied to an electronic device, the electronic device includes an image sensor, the image sensor includes a plurality of pixel point groups arranged in an array, and each of the pixel point groups includes M* arranged in an array N pixels; each pixel corresponds to a photosensitive unit, where M and N are both natural numbers greater than or equal to 2; the device includes:

The scene detection module is used to perform scene detection on the captured image to obtain the scene type;

A phase difference acquisition module, configured to acquire a phase difference value corresponding to the scene type through the image sensor, where the phase difference value is a phase difference value in a first direction or a phase difference value in a second direction; the first The direction forms a preset angle with the second direction.

An electronic device includes a memory and a processor, and a computer program is stored in the memory. When the computer program is executed by the processor, the operation of the method is realized.

A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the operation of the method is realized.

The above-mentioned phase difference acquisition method and device, electronic equipment, and computer-readable storage medium are used to detect the scene of the image to obtain the scene type, and calculate the corresponding phase difference according to the scene type. The phase difference value may be the phase difference in the first direction. Value or the phase difference value in the second direction, and the first direction and the second direction are at a preset angle, that is, the phase difference of each pixel can be accurately obtained, and after scene detection, only the phase difference in one direction needs to be calculated , There is no need to calculate the phase difference between the two directions, which greatly saves the calculation time, improves the calculation speed, and further improves the focusing speed.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic diagram of the principle of phase detection autofocus in an embodiment;

FIG. 2 is a schematic diagram of phase detection pixel points arranged in pairs in the pixel points included in the image sensor; FIG.

FIG. 3 is a schematic diagram of a part of the structure of an image sensor in an embodiment;

4 is a schematic diagram of the structure of pixels in an embodiment;

Figure 5 is a schematic structural diagram of an imaging device in an embodiment;

Fig. 6 is a schematic diagram of a filter set on a pixel point group in an embodiment;

FIG. 7A is a flowchart of a method for acquiring a phase difference in an embodiment;

Fig. 7B is a schematic diagram of a horizontal texture scene in an embodiment;

FIG. 7C is a schematic diagram of a circular scene in an embodiment;

FIG. 8 is a flowchart of calculating the phase difference corresponding to the scene type in an embodiment;

Fig. 9 is a schematic diagram of a pixel point group in an embodiment;

FIG. 10 is a schematic diagram of a sub-luminance map of an embodiment;

FIG. 11 is a flowchart of obtaining a target brightness map in an embodiment;

FIG. 12 is a schematic diagram of generating a sub-brightness map corresponding to the pixel point group according to the brightness value of the sub-pixel points included in the target pixel point in the pixel point group in an embodiment;

FIG. 13 is a flowchart of obtaining a target brightness map in another embodiment;

FIG. 14 is a schematic diagram of determining pixel points at the same position from each pixel point group in an embodiment;

15 is a schematic diagram of determining pixels at the same position from each intermediate phase difference map in an embodiment;

FIG. 16 is a schematic diagram of a target phase difference diagram in an embodiment;

FIG. 17 is a flowchart of a method for performing segmentation processing on a target brightness map to obtain a first segmented brightness map and a second segmented brightness map in an embodiment;

18 is a schematic diagram of generating a first segmented brightness map and a second segmented brightness map according to the target brightness map in an embodiment;

19 is a schematic diagram of generating a first segmented brightness map and a second segmented brightness map according to the target brightness map in another embodiment;

20 is a flowchart of determining the phase difference of mutually matched pixels according to the position difference of the pixels that match each other in the first split brightness map and the second split brightness map in an embodiment;

21 is a flowchart of determining the phase difference of the pixels that match each other according to the position difference of the pixels that match each other in the first split brightness map and the second split brightness map in another embodiment;

FIG. 22 is a structural block diagram of an apparatus for acquiring a phase difference in an embodiment;

FIG. 23 is a block diagram of a computer device provided by an embodiment of this application.

Detailed ways

In order to make the purpose, technical solutions, and advantages of this application clearer, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the application, and not used to limit the application.

Figure 1 is a schematic diagram of the principle of phase detection auto focus (PDAF). As shown in FIG. 1, M1 is the position of the image sensor when the imaging device is in the in-focus state, where the in-focus state refers to the state of successful focusing. When the image sensor is at the M1 position, the imaging light g reflected by the object W toward the lens Lens in different directions converges on the image sensor, that is, the imaging light g reflected by the object W toward the lens Lens in different directions is in the image The image is imaged at the same position on the sensor. At this time, the image of the image sensor is clear.

M2 and M3 are the possible positions of the image sensor when the imaging device is not in focus. As shown in Figure 1, when the image sensor is at the M2 position or the M3 position, the object W is reflected in different directions of the lens Lens. The imaging light g will be imaged at different positions. Please refer to Figure 1. When the image sensor is at the M2 position, the imaging light g reflected by the object W in different directions to the lens Lens is imaged at the position A and the position B respectively. When the image sensor is at the M3 position, the object W is reflected toward the lens. The imaging light g in different directions of the lens Lens is imaged at the position C and the position D respectively. At this time, the image of the image sensor is not clear.

In PDAF technology, the difference in position of the image formed by the imaging light entering the lens from different directions in the image sensor can be obtained. For example, as shown in Figure 1, the difference between position A and position B can be obtained, or, Obtain the difference between position C and position D; after obtaining the difference in position of the image formed by the imaging light entering the lens from different directions in the image sensor, the difference and the difference between the lens and the image sensor in the camera The geometric relationship is used to obtain the defocus distance. The so-called defocus distance refers to the distance between the current position of the image sensor and the position where the image sensor should be in the in-focus state; the imaging device can focus according to the obtained defocus distance.

It can be seen that when focusing, the calculated PD value is 0. On the contrary, the larger the calculated value, the farther the position of the clutch focal point is, and the smaller the value, the closer the clutch focal point. When using PDAF to focus, by calculating the PD value, and then obtaining the corresponding relationship between the PD value and the defocusing distance according to the calibration, the defocusing distance can be obtained, and then controlling the lens to move to the focal point according to the defocusing distance to achieve focusing.

In the related art, some phase detection pixel points may be provided in pairs in the pixel points included in the image sensor. As shown in FIG. 2, a phase detection pixel point pair (hereinafter referred to as a pixel point pair) A may be provided in the image sensor. Pixel point pair B and pixel point pair C. Among them, in each pixel point pair, one phase detection pixel is subjected to left shielding (English: Left Shield), and the other phase detection pixel is subjected to right shielding (English: Right Shield).

For the phase detection pixel point that has been blocked on the left, only the right beam of the imaging beam directed to the phase detection pixel point can be in the photosensitive part of the phase detection pixel point (that is, the part that is not blocked). ). For the phase detection pixel that has been occluded on the right, only the left beam of the imaging beam directed at the phase detection pixel can be in the photosensitive part of the phase detection pixel (that is, not The occluded part) is imaged. In this way, the imaging beam can be divided into left and right parts, and the phase difference can be obtained by comparing the images formed by the left and right parts of the imaging beam.

However, since the phase detection pixels set in the image sensor are usually blocked on the left and right sides respectively, for scenes with horizontal texture, the PD value cannot be calculated by the phase detection pixels. For example, the shooting scene is a horizontal line, and the left and right images will be obtained according to the PD characteristics, but the PD value cannot be calculated.

In order to solve the situation that the phase detection autofocus cannot calculate the PD value to achieve focus for some horizontal texture scenes, an imaging component is provided in the embodiment of the application, which can be used to detect the phase difference value in the first direction and the second The phase difference value of the direction, for a horizontal texture scene, the phase difference value of the second direction can be used to achieve focusing.

In one embodiment, the present application provides an imaging assembly. The imaging component includes an image sensor. The image sensor may be a metal oxide semiconductor device (English: Complementary Metal Oxide Semiconductor; abbreviation: CMOS) image sensor, a charge-coupled device (English: Charge-coupled Device; abbreviation: CCD), a quantum thin film sensor, or an organic sensor.

FIG. 3 is a schematic diagram of a part of the image sensor in an embodiment. The image sensor includes a plurality of pixel point groups Z arranged in an array, each pixel point group Z includes a plurality of pixel points D arranged in an array, and each pixel point D corresponds to a photosensitive unit. The multiple pixels include M*N pixels, where both M and N are natural numbers greater than or equal to 2. Each pixel point D includes a plurality of sub-pixel points d arranged in an array. That is, each photosensitive unit can be composed of a plurality of photosensitive elements arranged in an array. Among them, the photosensitive element is an element that can convert light signals into electrical signals. Referring to FIG. 3, a plurality of sub-pixel points d arranged in an array in each pixel point D collectively cover a microlens W. In one embodiment, the photosensitive element may be a photodiode. In this embodiment, each pixel point group Z includes 4 pixel points D arranged in a 2*2 array, and each pixel point D may include 4 sub-pixel points d arranged in a 2*2 array. The four sub-pixel points d jointly cover a microlens W. Among them, each pixel point D includes 2*2 photodiodes, and the 2*2 photodiodes are arranged correspondingly to the 4 sub-pixel points d arranged in a 2*2 array. Each photodiode is used to receive optical signals and perform photoelectric conversion, thereby converting the optical signals into electrical signals for output. The 4 sub-pixels d included in each pixel D are set corresponding to the same color filter, so each pixel D corresponds to a color channel, such as the red R channel, or the green channel G, or the blue channel B .

As shown in Figure 4, taking each pixel D including sub-pixel 1, sub-pixel 2, sub-pixel 3, and sub-pixel 4 as an example, the signals of sub-pixel 1 and sub-pixel 2 can be combined and output, and sub-pixel The signals of point 3 and sub-pixel point 4 are combined and output, thereby constructing two PD pixel pairs along the second direction (ie the vertical direction). According to the phase value of the two PD pixel pairs, each sub-pixel point in pixel point D can be determined The PD value (phase difference value) in the second direction. The signals of sub-pixel point 1 and sub-pixel point 3 are combined and output, and the signals of sub-pixel point 2 and sub-pixel point 4 are combined and output, thereby constructing two PD pixel pairs along the first direction (ie, horizontal direction). According to the two PD pixel pairs The phase value of can determine the PD value (phase difference value) of each sub-pixel point in the pixel point D along the first direction.

Fig. 5 is a schematic structural diagram of an imaging device in an embodiment. As shown in FIG. 5, the imaging device includes a lens 50, a filter 52 and an imaging component 54. The lens 50, the filter 52 and the imaging component 54 are sequentially located on the incident light path, that is, the lens 50 is disposed on the filter 52, and the filter 52 is disposed on the imaging component 54.

The imaging component 54 includes the image sensor in FIG. 3. The image sensor includes a plurality of pixel point groups Z arranged in an array. Each pixel point group Z includes a plurality of pixel points D arranged in an array. Each pixel point D corresponds to a photosensitive unit, and each photosensitive unit can consist of multiple arrays. It is composed of arranged photosensitive elements. In this embodiment, each pixel point D includes 4 sub-pixel points d arranged in a 2*2 array, and each sub-pixel point d corresponds to a light spot diode 542, that is, 2*2

photodiodes

542 and 2*2 arrays. The 4 sub-pixel points d of the cloth are correspondingly arranged. The 4 sub-pixel points d share one lens.

The filter 52 can include three types of red, green, and blue, and can only transmit light of corresponding wavelengths of red, green, and blue, respectively. The four sub-pixel points d included in one pixel point D are arranged corresponding to the filters of the same color. In other embodiments, the filter may also be white, which facilitates the passage of light in a larger spectrum (wavelength) range and increases the luminous flux passing through the white filter.

The lens 50 is used to receive incident light and transmit the incident light to the filter 52. After the filter 52 performs filtering processing on the incident light, the filtered light is incident on the imaging component 54 on a pixel basis.

The photosensitive unit in the image sensor included in the imaging component 54 converts the light incident from the filter 52 into a charge signal through the photoelectric effect, and generates a pixel signal consistent with the charge signal. The charge signal is consistent with the received light intensity.

It can be seen from the above description that the pixels included in the image sensor and the pixels included in the image are two different concepts. The pixels included in the image refer to the smallest component unit of the image, which is generally represented by a sequence of numbers. In the following, the sequence of numbers can be referred to as the pixel value of a pixel. The embodiments of the present application involve both concepts of "pixels included in an image sensor" and "pixels included in an image". To facilitate readers' understanding, a brief explanation is provided here.

Fig. 6 is a schematic diagram of a filter set on a pixel point group in an embodiment. The pixel group Z includes 4 pixels D arranged in an array arrangement of two rows and two columns, wherein the color channel of the pixels in the first row and the first column is green, that is, the first row and the first row The filter set on the pixels in one column is a green filter; the color channel of the pixels in the first row and second column is red, that is, the filter set on the pixels in the first row and second column The filter is a red filter; the color channel of the pixel in the second row and the first column is blue, that is, the filter set on the pixel in the second row and the first column is a blue filter; The color channel of the pixel points in the second row and second column is green, that is, the filter set on the pixel points in the second row and second column is a green filter.

Fig. 7A is a flowchart of a method for acquiring a phase difference in an embodiment. The method for acquiring the phase difference in this embodiment is described by taking the imaging device in FIG. 5 as an example. As shown in FIG. 7, the focusing method includes operation 702 to operation 706.

In operation 702, scene detection is performed on the captured image to obtain the scene type.

Specifically, when an image is captured by an imaging device of an electronic device, the captured image contains scene information, and different shooting objects may have different scene information. For example, when shooting a cuboid box, the horizontal direction is a straight line, as shown in FIG. 7B, the phase difference value in the horizontal direction cannot be calculated, and the phase difference value in the vertical direction needs to be calculated to facilitate subsequent focusing. If you are shooting a basketball and the horizontal direction is not a straight line, as shown in Figure 7C, you can calculate the phase difference value in the horizontal direction. It is not necessary to calculate the phase difference value in the vertical direction, and it can also facilitate subsequent focusing. This scenario does not need to calculate the phase difference value in the vertical direction, which saves the time consumed in the calculation.

It is understandable that an artificial intelligence model or an edge operator can be used to detect the scene of the captured image to obtain the scene type.

The scene types may include horizontal texture scenes, vertical texture scenes, circular texture scenes, and so on.

Operation 704: Obtain a phase difference value corresponding to the scene type through an image sensor, where the phase difference value is a phase difference value in a first direction or a phase difference value in a second direction; Set the angle.

Specifically, the phase difference value corresponding to the scene type refers to the phase difference value that can be used for focusing for the scene type. For example, in a horizontal texture scene, the phase difference value in the horizontal direction cannot be calculated. In order to accurately focus, it is necessary Data is collected by the above-mentioned image sensor including M*N pixel points arranged in an array, and then the phase difference value in the vertical direction is calculated. The first direction and the second direction may form a preset angle, and the preset angle may be any angle other than 0 degrees, 180 degrees, and 360 degrees. In this embodiment, the first direction may be a horizontal direction, and the second direction may be a vertical direction.

In the above phase difference acquisition method, scene detection is performed on the image to obtain the scene type, and the corresponding phase difference is calculated according to the scene type. The phase difference value can be the phase difference value in the first direction or the phase difference value in the second direction, and the first One direction and the second direction are at a preset angle, that is, the phase difference of each pixel can be accurately obtained, and after the scene detection, only the phase difference of the corresponding one direction needs to be calculated, and the phase difference of the two directions is not required to be calculated. This saves calculation time, increases the calculation speed, and further improves the speed of focusing.

In one embodiment, performing scene detection on the captured image to obtain the scene type includes: performing scene detection on the captured image through an artificial intelligence model to obtain the scene type, and the artificial intelligence model is trained by using a sample image containing the scene type owned.

Specifically, sample images containing scene types can be collected in advance, and then the artificial intelligence model can be trained to obtain artificial intelligence models that can detect different scene types. The trained artificial intelligence model is stored in the electronic device, and scene detection is performed on the captured image during shooting to obtain the scene type. The artificial intelligence model can efficiently and accurately detect the scene type.

In one embodiment, the scene detection performed on the captured image to obtain the scene type includes: detecting the total number of edge points in the scene of the captured image, the number of edge points in the first direction, and the number of edge points in the second direction through an edge operator Determine the scene type of the captured image according to the ratio of the number of edge points in the first direction to the total number of edge points, and the ratio of the number of edge points in the second direction to the total number of edge points.

Specifically, the edge operator can be configured according to actual conditions. The edge operators include discrete gradient operator, Roberts operator, Laplacian operator, gradient operator and Sobel operator. Sobel's horizontal edge operator is

The vertical edge operator can be

The total number of edge points in the scene of the captured image, the number of edge points in the first direction and the number of edge points in the second direction can be counted. When the ratio of edge points in the first direction to the total number of edge points exceeds the threshold, it indicates the scene It is a horizontal texture scene, and when the ratio of the number of edge points in the second direction to the total number of edge points exceeds a threshold, it indicates that the scene is a vertical texture scene. When the ratio of edge points in the first direction to the total number of edge points exceeds the threshold, and the ratio of the number of edge points in the second direction to the total number of edge points exceeds the threshold, it indicates that the scene includes a horizontal texture scene and a vertical texture scene. For horizontal texture scenes, calculate the PD value in the vertical direction, and for vertical texture scenes, calculate the PD value in the horizontal direction.

Through the edge operator for scene detection, the scene type can be quickly detected.

In one embodiment, calculating the phase difference value corresponding to the scene type includes: when the scene type is a horizontal texture scene, acquiring the phase difference value in the second direction through the image sensor; when the scene type is vertical For straight texture scenes, the phase difference value in the first direction is obtained through the image sensor.

In an embodiment, the above method further includes: determining a defocus distance value according to the phase difference value; and controlling the lens to move to focus according to the defocus distance value.

The corresponding relationship between the phase difference value and the defocus distance value can be obtained through calibration.

The correspondence between the defocus distance value and the phase difference value is as follows:

defocus=PD*slope(DCC), where DCC (Defocus Conversion Coefficient) is obtained by calibration, defocus is the defocus distance value, slope is the slope function; PD is the phase difference value.

The calibration process of the corresponding relationship between the phase difference value and the defocus distance value includes: dividing the effective focus stroke of the camera module into 10 equal parts, namely (near focus DAC-far focus DAC)/10, so as to cover the focus of the motor Range; focus at each focus DAC (DAC can be 0 to 1023) position, and record the phase difference of the current focus DAC position; after completing the motor focus stroke, take a group of 10 focus DACs and compare the obtained PD value ; Generate 10 similar ratios K, fit the two-dimensional data composed of DAC and PD to obtain a straight line with slope K.

The direction of movement can be determined according to the positive or negative value of the defocus distance.

During the focusing process, through scene detection, the phase difference value in the first direction or the phase difference value in the second direction can be quickly obtained, and the defocus distance can be determined according to the phase difference value in the first direction or the phase difference value in the second direction According to the value of the defocus distance, the lens movement is controlled to realize the phase detection autofocus. Because the phase difference value in the first direction or the phase difference value in the second direction can be output according to the scene, it can effectively target horizontal or vertical texture scenes. The scene uses the phase difference value to focus, which improves the accuracy and stability of focusing, and only needs to calculate the phase difference value in one direction, which can save the time of calculating the phase difference value and increase the focusing speed, which can be applied to the focusing of moving objects.

In an embodiment, the above method further includes: correcting the calculated phase difference value by using a gain map.

Specifically, the gain map can be pre-calibrated. The gain graph contains the gain coefficient of the PD value corresponding to each pixel, and the calculated PD value is multiplied by the corresponding gain coefficient to obtain the corrected PD value. By correcting the PD value, the calculated PD value is more accurate.

Generally, the frequency domain algorithm and the space domain algorithm can be used to obtain the phase difference value. Among them, the frequency domain algorithm is to use the characteristics of Fourier displacement to calculate, the collected target brightness map is converted from the spatial domain to the frequency domain using the Fourier transform, and then the phase correlation is calculated. When the correlation calculates the maximum value (peak), it means that it has the maximum value. Displacement, at this time, do the inverse Fourier to know the maximum displacement in the space domain. The spatial domain algorithm is to find out the feature points, such as edge features, DoG (difference of Gaussian), Harris corner points and other features, and then use these feature points to calculate the displacement.

Fig. 8 is a flow chart of obtaining the phase difference in an embodiment. As shown in Figure 8, the acquisition of the phase difference includes:

In operation 802, a target brightness map is obtained according to the brightness values of the pixel points included in each of the pixel point groups.

Generally, the brightness value of the pixel of the image sensor can be characterized by the brightness value of the sub-pixel included in the pixel. The imaging device may obtain the target brightness map according to the brightness values of the sub-pixel points in the pixel points included in each pixel point group. Wherein, the brightness value of a sub-pixel point refers to the brightness value of the light signal received by the photosensitive element corresponding to the sub-pixel point.

As mentioned above, the sub-pixel included in the image sensor is a photosensitive element that can convert light signals into electrical signals. Therefore, the light signal received by the sub-pixel can be obtained according to the electrical signal output by the sub-pixel. Intensity, the brightness value of the sub-pixel can be obtained according to the intensity of the light signal received by the sub-pixel.

The target brightness map in the embodiment of the present application is used to reflect the brightness value of the sub-pixels in the image sensor. The target brightness map may include multiple pixels, wherein the pixel value of each pixel in the target brightness map is based on the image sensor Obtained from the brightness value of the neutron pixel.

Operation 804: Perform segmentation processing on the target brightness map to obtain a first segmented brightness map and a second segmented brightness map, and compare the first segmented brightness map and the second segmented brightness map to each other. The position difference of the matched pixel points determines the phase difference value of the mutually matched pixel points.

In one embodiment, the imaging device may perform segmentation processing on the target luminance map along the column direction (the y-axis direction in the image coordinate system). In the process of segmenting the target luminance map along the column direction, Each dividing line of the segmentation process is vertical to the direction of the column.

In another embodiment, the imaging device may perform segmentation processing on the target brightness map along the row direction (the x-axis direction in the image coordinate system), and in the process of segmenting the target brightness map along the row direction , Each dividing line of the segmentation process is vertical to the direction of the row.

The first segmented brightness map and the second segmented brightness map obtained after the target brightness map is segmented along the column direction can be referred to as the upper image and the lower image, respectively. The first segmented brightness map and the second segmented brightness map obtained after the target brightness map is segmented along the row direction can be called the left image and the right image, respectively.

Among them, "mutually matched pixels" means that the pixel matrix composed of the pixel itself and the surrounding pixels are similar to each other. For example, the pixel a and its surrounding pixels in the first segmented brightness map form a pixel matrix with 3 rows and 3 columns, and the pixel value of the pixel matrix is:

2 15 70

1 35 60

0 100 1

The pixel b and the surrounding pixels in the second segmented brightness map also form a pixel matrix with 3 rows and 3 columns, and the pixel value of the pixel matrix is:

1 15 70

1 36 60

0 100 2

It can be seen from the above that the two matrices are similar, and it can be considered that the pixel a and the pixel b match each other. There are many ways to judge whether the pixel matrix is similar. Usually, the pixel value of each corresponding pixel in the two pixel matrices can be calculated, and then the absolute value of the difference obtained is added, and the result of the addition is used to determine Whether the pixel matrix is similar, that is, if the result of the addition is less than a preset threshold, the pixel matrix is considered to be similar; otherwise, the pixel matrix is considered to be dissimilar.

For example, for the above two pixel matrices with 3 rows and 3 columns, the difference of 1 and 2, the difference of 15 and 15, the difference of 70 and 70, ..., and then the absolute difference Values are added, and the result of the addition is 3. If the result of the addition of 3 is less than the preset threshold, it is considered that the two pixel matrices with 3 rows and 3 columns are similar.

Another way to judge whether the pixel matrix is similar is to use the Sobel convolution kernel calculation method or the high Laplacian calculation method to extract the edge characteristics, and judge whether the pixel matrix is similar by the edge characteristics.

In the embodiments of the present application, "the positional difference of pixels that match each other" refers to the positions of the pixels in the first split brightness map and the positions of the pixels in the second split brightness map among the matched pixels. The difference. As in the above example, the position difference between the pixel a and the pixel b that are matched with each other refers to the difference between the position of the pixel a in the first split brightness map and the position of the pixel b in the second split brightness map.

The pixels that match each other correspond to different images in the image sensor formed by the imaging light entering the lens from different directions. For example, the pixel a in the first split brightness map and the pixel b in the second split brightness map match each other, where the pixel a may correspond to the image formed at position A in FIG. 1, and the pixel b may correspond to The image formed at position B in Figure 1.

Since the matched pixels correspond to the different images in the image sensor formed by the imaging light entering the lens from different directions, the phase difference of the matched pixels can be determined according to the position difference of the matched pixels. .

Operation 806: Determine the phase difference value in the first direction or the phase difference value in the second direction according to the phase difference values of the mutually matched pixels.

When the first split brightness map includes even-numbered rows of pixels, the second split brightness map includes odd-numbered rows, pixel a in the first split brightness map and pixel b in the second split brightness map Mutual matching, the phase difference value in the first direction can be determined according to the phase difference of the pixel a and the pixel b that are matched with each other.

When the first split brightness map includes even-numbered columns, the second split brightness map includes odd-numbered columns, pixel a in the first split brightness map and pixel b in the second split brightness map Mutual matching, based on the phase difference between the matched pixel a and the pixel b, the phase difference value in the second direction can be determined.

The brightness value of the pixel points in the above pixel point group obtains the target brightness map. After the target brightness map is divided into two segmented brightness maps, through pixel matching, the phase difference value of the matching pixels can be quickly determined, and the phase difference value of the matching pixels can be quickly determined. The rich phase difference value can improve the accuracy of the phase difference value and improve the accuracy and stability of the focus.

In an embodiment, each of the pixel points includes a plurality of sub-pixel points arranged in an array, and obtaining a target brightness map according to the brightness value of the pixel points included in each pixel point group includes: According to the pixel point group, according to the brightness value of the sub-pixel point at the same position of each pixel point in the pixel point group, the sub-brightness map corresponding to the pixel point group is obtained; The sub-luminance map generates the target luminance map.

Wherein, the sub-pixel points at the same position of each pixel point refer to the sub-pixel points that are arranged in the same position in each pixel point.

Fig. 9 is a schematic diagram of a pixel point group in an embodiment. As shown in Fig. 9, the pixel point group includes 4 pixels arranged in an array arrangement of two rows and two columns. D1 pixel, D2 pixel, D3 pixel and D4 pixel, where each pixel includes 4 sub-pixels arranged in an array arrangement of two rows and two columns, where the sub-pixels are respectively d11, d12, d13, d14, d21, d22, d23, d24, d31, d32, d33, d34, d41, d42, d43, and d44.

As shown in Figure 9, the sub-pixels d11, d21, d31, and d41 are arranged in the same position in each pixel, and they are all in the first row and first column. The sub-pixels d12, d22, d32, and d42 are in each pixel. The arrangement positions in are the same in the first row and second column, and the sub-pixels d13, d23, d33, and d43 are arranged in the same position in each pixel, and they are all in the second row and first column, and the sub-pixel d14 , D24, d34 and d44 are arranged in the same position in each pixel, and they are all in the second row and second column.

In an embodiment, obtaining the sub-brightness map corresponding to the pixel point group according to the brightness value of the sub-pixel point at the same position of each pixel point in the pixel point group may include operations A1 to A3.

In operation A1, the imaging device determines a sub-pixel point at the same position from each pixel point to obtain a plurality of sub-pixel point sets.

Wherein, the positions of the sub-pixels included in each sub-pixel set are the same in the pixel points.

The imaging device determines the sub-pixels at the same position from D1 pixel, D2 pixel, D3 pixel and D4 pixel respectively, and can obtain 4 sub-pixel sets J1, J2, J3, and J4, among which, the sub-pixel set J1 includes sub-pixels d11, d21, d31, and d41. The positions of the sub-pixels included in the pixel are all the same in the first row and first column. The sub-pixel set J2 includes sub-pixels d12, d22, and d32. And d42, the positions of the sub-pixels included in it are the same in the first row and second column. The sub-pixel set J3 includes sub-pixels d13, d23, d33 and d43, and the sub-pixels included are The positions of the pixels are all the same, which is the second row and the first column. The sub-pixel set J4 includes sub-pixels d14, d24, d34, and d44. The positions of the sub-pixels included in the pixel are all the same. Two rows and second column.

Operation A2, for each sub-pixel point set, the imaging device obtains the brightness value corresponding to the sub-pixel point set according to the brightness value of each sub-pixel point in the sub-pixel point set.

Optionally, in operation A2, the imaging device may determine a color coefficient corresponding to each sub-pixel point in the sub-pixel point set, where the color coefficient is determined according to the color channel corresponding to the sub-pixel point.

For example, the sub-pixel point d11 belongs to the D1 pixel point, and the filter included in the D1 pixel point may be a green filter, that is, if the color channel of the D1 pixel point is green, then the sub-pixel point d11 included The color channel is also green, and the imaging device can determine the color coefficient corresponding to the sub-pixel d11 according to the color channel (green) of the sub-pixel d11.

After determining the color coefficient corresponding to each sub-pixel in the sub-pixel set, the imaging device can multiply the color coefficient corresponding to each sub-pixel in the sub-pixel set by the brightness value to obtain each sub-pixel in the sub-pixel set The weighted brightness value of the point.

For example, the imaging device may multiply the brightness value of the sub-pixel point d11 by the color coefficient corresponding to the sub-pixel point d11 to obtain the weighted brightness value of the sub-pixel point d11.

After obtaining the weighted brightness value of each sub-pixel point in the sub-pixel point set, the imaging device may add the weighted brightness value of each sub-pixel point in the sub-pixel point set to obtain the brightness value corresponding to the sub-pixel point set.

For example, for the sub-pixel point set J1, the brightness value corresponding to the sub-pixel point set J1 can be calculated based on the following first formula.

Y_TL=Y_21*C_R+(Y_11+Y_41)*C_G/2+Y_31*C_B.

Among them, Y_TL is the brightness value corresponding to the sub-pixel point set J1, Y_21 is the brightness value of the sub-pixel point d21, Y_11 is the brightness value of the sub-pixel point d11, Y_41 is the brightness value of the sub-pixel point d41, and Y_31 is the sub-pixel point The brightness value of d31, C_R is the color coefficient corresponding to the sub-pixel point d21, C_G/2 is the color coefficient corresponding to the sub-pixel point d11 and d41, and C_B is the color coefficient corresponding to the sub-pixel point d31, where Y_21*C_R is the sub-pixel The weighted brightness value of the point d21, Y_11*C_G/2 is the weighted brightness value of the sub-pixel point d11, Y_41*C_G/2 is the weighted brightness value of the sub-pixel point d41, and Y_31*C_B is the weighted brightness value of the sub-pixel point d31.

For the sub-pixel point set J2, the brightness value corresponding to the sub-pixel point set J2 can be calculated based on the following second formula.

Y_TR=Y_22*C_R+(Y_12+Y_42)*C_G/2+Y_32*C_B.

Among them, Y_TR is the brightness value corresponding to the sub-pixel point set J2, Y_22 is the brightness value of the sub-pixel point d22, Y_12 is the brightness value of the sub-pixel point d12, Y_42 is the brightness value of the sub-pixel point d42, and Y_32 is the sub-pixel point The brightness value of d32, C_R is the color coefficient corresponding to sub-pixel point d22, C_G/2 is the color coefficient corresponding to sub-pixel point d12 and d42, C_B is the color coefficient corresponding to sub-pixel point d32, where Y_22*C_R is the sub-pixel The weighted brightness value of the point d22, Y_12*C_G/2 is the weighted brightness value of the sub-pixel point d12, Y_42*C_G/2 is the weighted brightness value of the sub-pixel point d42, and Y_32*C_B is the weighted brightness value of the sub-pixel point d32.

For the sub-pixel point set J3, the brightness value corresponding to the sub-pixel point set J3 can be calculated based on the following third formula.

Y_BL=Y_23*C_R+(Y_13+Y_43)*C_G/2+Y_33*C_B.

Among them, Y_BL is the brightness value corresponding to the sub-pixel point set J3, Y_23 is the brightness value of the sub-pixel point d23, Y_13 is the brightness value of the sub-pixel point d13, Y_43 is the brightness value of the sub-pixel point d43, and Y_33 is the sub-pixel point The brightness value of d33, C_R is the color coefficient corresponding to the sub-pixel point d23, C_G/2 is the color coefficient corresponding to the sub-pixel point d13 and d43, and C_B is the color coefficient corresponding to the sub-pixel point d33, where Y_23*C_R is the sub-pixel The weighted brightness value of the point d23, Y_13*C_G/2 is the weighted brightness value of the sub-pixel point d13, Y_43*C_G/2 is the weighted brightness value of the sub-pixel point d43, and Y_33*C_B is the weighted brightness value of the sub-pixel point d33.

For the sub-pixel point set J4, the brightness value corresponding to the sub-pixel point set J4 can be calculated based on the following fourth formula.

Y_BR=Y_24*C_R+(Y_14+Y_44)*C_G/2+Y_34*C_B.

Among them, Y_BR is the brightness value corresponding to the sub-pixel point set J4, Y_24 is the brightness value of the sub-pixel point d24, Y_14 is the brightness value of the sub-pixel point d14, Y_44 is the brightness value of the sub-pixel point d44, and Y_34 is the sub-pixel point The brightness value of d34, C_R is the color coefficient corresponding to sub-pixel point d24, C_G/2 is the color coefficient corresponding to sub-pixel points d14 and d44, C_B is the color coefficient corresponding to sub-pixel point d34, where Y_24*C_R is the sub-pixel The weighted brightness value of the point d24, Y_14*C_G/2 is the weighted brightness value of the sub-pixel point d14, Y_44*C_G/2 is the weighted brightness value of the sub-pixel point d44, and Y_34*C_B is the weighted brightness value of the sub-pixel point d34.

In operation A3, the imaging device generates a sub-brightness map according to the brightness value corresponding to each sub-pixel set.

The sub-luminance map includes a plurality of pixels, each pixel in the sub-luminance map corresponds to a sub-pixel set, and the pixel value of each pixel is equal to the brightness value corresponding to the corresponding sub-pixel set.

Fig. 10 is a schematic diagram of a sub-luminance map in an embodiment. As shown in Fig. 10, the sub-luminance map includes 4 pixels. Among them, the pixels in the first row and the first column correspond to the sub-pixel set J1, and the pixel value is Y_TL, and the pixels in the first row and the second column correspond to the sub-pixels. Set J2 corresponds to the pixel value Y_TR, the pixel in the second row and first column corresponds to the sub-pixel set J3, and its pixel value is Y_BL, and the pixel in the second row and second column corresponds to the sub-pixel set J4, which The pixel value is Y_BR.

Fig. 11 is a flowchart of obtaining a target brightness map in an embodiment. As shown in FIG. 11, the method of obtaining the target brightness map may include the following operations:

In operation 1102, a target pixel is determined from each pixel group to obtain multiple target pixels.

The pixel point group may include a plurality of pixel points arranged in an array, and the imaging device may determine a target pixel point from the plurality of pixel points included in each pixel point group, so as to obtain a plurality of target pixel points.

Optionally, the imaging device may determine a pixel with a green color channel from each pixel group (that is, a pixel with a green filter included), and then, the color channel is a green The pixel is determined as the target pixel.

Since the pixels with the green color channel have better light sensitivity, the pixels with the green color channel in the pixel group are determined as the target pixel, and the target brightness map generated according to the target pixel in the subsequent operation is of higher quality .

In operation 1104, a sub-brightness map corresponding to each pixel point group is generated according to the brightness value of the sub-pixel points included in each target pixel point.

Wherein, the sub-luminance map corresponding to each pixel point group includes a plurality of pixels, and each pixel in the sub-luminance map corresponding to each pixel point group corresponds to a sub-pixel point included in the target pixel point in the pixel point group. The pixel value of each pixel in the sub-luminance map corresponding to each pixel point group is the brightness value of the corresponding sub-pixel point.

FIG. 12 is a schematic diagram of generating the sub-luminance map L corresponding to the pixel point group Z1 according to the brightness values of the sub-pixel points included in the target pixel point DM in the pixel point group Z1 in an embodiment.

As shown in FIG. 12, the sub-luminance map L includes 4 pixels, where each pixel corresponds to a sub-pixel included in the target pixel DM, and the pixel value of each pixel is the value of the corresponding sub-pixel. The brightness value, where the pixels in the first row and first column of the sub-luminance map L correspond to the sub-pixels in the first row and first column included in the target pixel point DM, and the first row and first column in the sub-luminance map L The pixel value Gr_TL of the pixel in the target pixel DM includes the brightness value Gr_TL of the sub-pixel in the first row and the first column of the target pixel DM, and the pixel in the first row and second column in the sub-luminance map L and the pixel in the first row and second column of the target pixel DM include the first The sub-pixels in one row and the second column correspond, and the pixel value Gr_TR of the pixel in the first row and second column in the sub-luminance map L is the brightness value Gr_TR of the sub-pixel in the first row and second column included in the target pixel DM , The pixels in the second row and first column of the sub-luminance map L correspond to the sub-pixels in the second row and first column included in the target pixel point DM, and the pixels in the second row and first column of the sub-luminance map L The value Gr_BL is the brightness value Gr_BL of the sub-pixels in the second row and the first column of the target pixel DM. The pixels in the second row and the second column of the sub-brightness map L and the target pixel DM include the second row of the second pixel. The sub-pixels in the column correspond to the pixel value Gr_BR of the pixel in the second row and second column of the sub-brightness map L as the brightness value Gr_BR of the sub-pixel in the second row and second column included in the target pixel DM.

In operation 1106, a target brightness map is generated according to the sub-brightness map corresponding to each pixel point group.

The imaging device can splice the sub-luminance maps corresponding to each pixel point group according to the array arrangement of each pixel point group in the image sensor to obtain the target luminance map.

Fig. 13 is a flowchart of obtaining a target brightness map in another embodiment. As shown in FIG. 13, the method of obtaining the target brightness map may include the following operations:

In operation 1302, a pixel point at the same position is determined from each pixel point group to obtain a plurality of pixel point sets.

Wherein, the positions of the pixels included in each pixel point set in the pixel point group are all the same.

As shown in Figure 14, the imaging device determines the pixel points at the same position from the pixel point group Z1, the pixel point group Z2, the pixel point group Z3, and the pixel point group Z4, and four pixel point sets P1, P2, P3 can be obtained. And P4, where the pixel point set P1 includes pixels D11, D21, D31, and D41, the positions of the pixels included in the pixel point group are all the same in the first row and the first column, and the pixel point set P2 includes pixels D12, D22, D32 and D42, the positions of the pixels included in the pixel group are all the same in the first row and second column. The pixel set P3 includes sub-pixels D13, D23, D33 and D43, which include The positions of the pixels in the pixel group are the same, which is the second row and the first column. The pixel group P4 includes the pixels D14, D24, D34 and D44, and the positions of the pixels included in the pixel group are all the same. For the second row and second column.

In operation 1304, the imaging device generates a plurality of target brightness maps corresponding to the plurality of pixel point sets one-to-one according to the brightness values of the pixels in the plurality of pixel point sets.

As mentioned above, the brightness value of the pixel of the image sensor can be characterized by the brightness value of the sub-pixels included in the pixel. Therefore, for each pixel set, the imaging device can be based on each pixel in the pixel set. The brightness value of each sub-pixel included in the pixel generates a target brightness map corresponding to the set of pixel points.

Wherein, the target brightness map corresponding to a certain pixel point set includes a plurality of pixels, each pixel in the target brightness map corresponds to a sub-pixel point of the pixel points included in the pixel point set, and the target brightness map The pixel value of each pixel is the brightness value of the corresponding sub-pixel.

In the method of obtaining the target brightness map in FIG. 11, the imaging device determines a pixel point (that is, the target pixel point) from each pixel point group, and generates the target brightness map according to the determined pixel point, in other words, In the second method of acquiring the target brightness map, the imaging device generates a target brightness map according to one pixel in each pixel point group.

In the method of obtaining the target brightness map in FIG. 13, the imaging device generates a target brightness map according to one pixel in each pixel point group, and generates another one according to another pixel point in each pixel point group. The target brightness map, and at the same time, another target brightness map is generated according to another pixel in each pixel point group, and so on. Wherein, in the method of acquiring the target brightness map in FIG. 13, the number of target brightness maps acquired by the imaging device is the same as the number of pixel points included in the pixel point group.

After obtaining multiple target brightness maps, for each target brightness map, the imaging device performs segmentation processing on the target brightness map, and obtains the first segmented brightness map and the second segmented brightness map according to the segmentation processing results. The first segment brightness map and the second segment brightness map corresponding to each target brightness map, according to the position difference of the matching pixels in the first segment brightness map and the second segment brightness map, determine the matching pixels Phase difference.

For each target brightness map, the imaging device can obtain the intermediate phase difference map according to the phase difference of the matching pixels in the first segment brightness map and the second segment brightness map corresponding to the target brightness map, and then the imaging device The target phase difference map can be obtained according to the intermediate phase difference map corresponding to each target brightness map. In this way, the accuracy of obtaining the target phase difference map is relatively high. In the case that the pixel point group includes 4 pixels, the accuracy of the target phase difference map obtained in this way is obtained by the second method of obtaining the target brightness map. 4 times the accuracy of the target phase difference map.

Hereinafter, the embodiment of the present application will describe the technical process of obtaining the target phase difference map according to the intermediate phase difference map corresponding to each target brightness map, and the technical process may include operation B1 to operation B3.

In operation B1, the imaging device determines pixels at the same position from each intermediate phase difference map to obtain a plurality of phase difference pixel sets.

Wherein, the positions of the pixels included in each phase difference pixel set in the intermediate phase difference map are all the same.

15, the imaging device determines the pixels at the same position from the intermediate phase difference diagram 1, the intermediate phase difference diagram 2, the intermediate phase difference diagram 3, and the intermediate phase difference diagram 4 respectively, and can obtain 4 phase difference pixel sets Y1, Y2 , Y3, and Y4, where the phase difference pixel set Y1 includes the pixel PD_Gr_1 in the intermediate phase difference diagram 1, the pixel PD_R_1 in the intermediate phase difference diagram 2, the pixel PD_B_1 in the intermediate phase difference diagram 3, and the pixel PD_B_1 in the intermediate phase difference diagram 4 The pixel PD_Gb_1, the phase difference pixel set Y2 includes the pixel PD_Gr_2 in the intermediate phase difference diagram 1, the pixel PD_R_2 in the intermediate phase difference diagram 2, the pixel PD_B_2 in the intermediate phase difference diagram 3, and the pixel PD_Gb_2 in the intermediate phase difference diagram 4. The difference pixel set Y3 includes the pixel PD_Gr_3 in the intermediate phase difference diagram 1, the pixel PD_R_3 in the intermediate phase difference diagram 2, the pixel PD_B_3 in the intermediate phase difference diagram 3, and the pixel PD_Gb_3 in the intermediate phase difference diagram 4, and the phase difference pixel set Y4 It includes the pixel PD_Gr_4 in the intermediate phase difference diagram 1, the pixel PD_R_4 in the intermediate phase difference diagram 2, the pixel PD_B_4 in the intermediate phase difference diagram 3, and the pixel PD_Gb_4 in the intermediate phase difference diagram 4.

In operation B2, for each phase difference pixel set, the imaging device stitches the pixels in the phase difference pixel set to obtain a sub-phase difference map corresponding to the phase difference pixel set.

Wherein, the sub-phase difference map includes a plurality of pixels, each pixel corresponds to a pixel in the phase difference pixel set, and the pixel value of each pixel is equal to the pixel value of the corresponding pixel.

In operation B3, the imaging device stitches the obtained multiple sub-phase difference maps to obtain the target phase difference map.

Referring to FIG. 16, FIG. 16 is a schematic diagram of a target phase difference diagram, where the target phase difference diagram includes subphase difference diagram 1, subphase difference diagram 2, subphase difference diagram 3, and subphase difference diagram 4, where the subphase difference diagram Figure 1 corresponds to the phase difference pixel set Y1, the sub phase difference diagram 2 corresponds to the phase difference pixel set Y2, the sub phase difference diagram 3 corresponds to the phase difference pixel set Y3, and the sub phase difference diagram 4 corresponds to the phase difference pixel set Y4 Corresponding.

FIG. 17 is a flowchart of a method of performing segmentation processing on the target brightness map to obtain the first segmented brightness map and the second segmented brightness map in an embodiment, which can be applied to the imaging device shown in FIG. 3, as shown in FIG. As shown in 17, this method can include the following operations:

In operation 1702, segmentation processing is performed on the target luminance map to obtain multiple luminance map regions.

Wherein, each brightness map area includes a row of pixels in the target brightness map, or each brightness map area includes a column of pixels in the target brightness map.

Optionally, the imaging device may segment the target brightness map column by column along the row direction to obtain multiple pixel columns of the target brightness map (that is, the brightness map area described above).

Optionally, the imaging device may segment the target brightness map row by row along the column direction to obtain multiple pixel rows of the target brightness map (that is, the brightness map area described above).

In operation 1704, a plurality of first brightness map regions and a plurality of second brightness map regions are obtained from the plurality of brightness map regions.

Wherein, the first luminance map area includes pixels in even-numbered rows in the target luminance map, or the first luminance map area includes pixels in even-numbered columns in the target luminance map.

The second brightness map area includes pixels in odd rows in the target brightness map, or the second brightness map area includes pixels in odd columns in the target brightness map.

In other words, in the case of segmenting the target luminance map column by column, the imaging device may determine the even-numbered columns as the first luminance map area and the odd-numbered columns as the second luminance map area.

In the case of segmenting the target luminance map row by row, the imaging device may determine even-numbered rows as the first luminance map area, and odd-numbered rows as the second luminance map area.

Operation 1706, using a plurality of first brightness map regions to form a first segmented brightness map, and using a plurality of second brightness map regions to form a second segmented brightness map.

Referring to FIG. 18, assuming that the target brightness map includes 6 rows and 6 columns of pixels, in the case of segmenting the target brightness map column by column, the imaging device can divide the first column pixel, the third column pixel, and the fifth column of the target brightness map. The column of pixels is determined as the second luminance map area, and the second, fourth, and sixth column pixels of the target luminance map can be determined as the first luminance map area, and then the imaging device can perform the first luminance map area Splicing to obtain the first sub-brightness map T1, the first sub-brightness map T1 includes the second, fourth, and sixth columns of the target brightness map, and the imaging device can splice the second brightness map area , A second segmented brightness map T2 is obtained, and the second segmented brightness map T2 includes the first column of pixels, the third column of pixels, and the fifth column of pixels of the target brightness map.

19, assuming that the target brightness map includes 6 rows and 6 columns of pixels, in the case of segmenting the target brightness map row by row, the imaging device can divide the first row of pixels, the third row of pixels, and the fifth row of the target brightness map. Row pixels are determined as the second luminance map area, and the second row of pixels, the fourth row of pixels, and the sixth row of pixels of the target luminance map can be determined as the first luminance map area. Then, the imaging device can perform the first luminance map area. Splicing to obtain the first sub-brightness map T3, the first sub-brightness map T3 includes the second row of pixels, the fourth row of pixels, and the sixth row of pixels of the target brightness map, and the imaging device can splice the second brightness map area , A second segmented brightness map T4 is obtained, and the second segmented brightness map T4 includes the first row of pixels, the third row of pixels, and the fifth row of pixels of the target brightness map.

Referring to FIG. 20, there is provided a method for determining the phase difference of mutually matched pixels based on the position difference of the pixels matching each other in the first split brightness map and the second split brightness map, which can be applied to the method shown in FIG. 3 In the imaging device, as shown in FIG. 20, this method may include the following operations:

In operation 2002, when the luminance map area includes a row of pixels in the target luminance map, a first set of neighboring pixels is determined in each row of pixels included in the first partial luminance map.

Wherein, the pixels included in the first adjacent pixel set correspond to the same pixel point group in the image sensor.

Please refer to the sub-luminance map shown in FIG. 10 above. When the luminance map area includes a row of pixels in the target luminance map, that is, when the imaging device divides the target luminance map row by row along the column direction, After segmentation, since the two pixels in the first row of the sub-luminance map are located in the same row of pixels in the target brightness map, the two pixels in the first row of the sub-luminance map will be located in the same brightness map area. And will be located in the same sub-brightness map. Similarly, the two pixels in the second row of the sub-brightness map will also be located in the same brightness area, and will be located in another sub-brightness map, assuming this sub-brightness map The first row of is located in the even-numbered pixel row of the target brightness map, then the two pixels in the first row of the sub-brightness map are located in the first sub-brightness map, and the two pixels in the second row of the sub-brightness map are located in the first sub-brightness map. Two-division brightness map.

The imaging device can determine the two pixels in the first row of the sub-brightness map as the first adjacent pixel set, because the two pixels in the first row of the sub-brightness map are the same pixel group in the image sensor (Fig. The pixel point group shown in 8) corresponds.

In operation 2004, for each first set of neighboring pixels, the imaging device searches for a first set of matching pixels corresponding to the first set of neighboring pixels in the second segmented luminance map.

For each first set of neighboring pixels, the imaging device may obtain a plurality of pixels around the first set of neighboring pixels in the first sub-brightness map, and determine the number of pixels around the first set of neighboring pixels and the set of neighboring pixels. A plurality of pixels form a search pixel matrix. For example, the search pixel matrix may include 9 pixels in 3 rows and 3 columns. Then, the imaging device may search for a pixel matrix similar to the search pixel matrix in the second segmented brightness map. As for how to determine whether the pixel matrices are similar, it has been described above, and the details of the embodiment of the present application are not repeated here.

After searching for a pixel matrix similar to the searched pixel matrix in the second segmented brightness map, the imaging device may extract the first matching pixel set from the searched pixel matrix.

The pixels in the first matching pixel set and the pixels in the first adjacent pixel set obtained through the search respectively correspond to different images in the image sensor formed by imaging light entering the lens from different directions.

In operation 2006, according to the position difference between each first adjacent pixel set and each first matched pixel set, determine the phase difference between the first adjacent pixel set and the first matched pixel set corresponding to each other to obtain the phase difference value in the second direction .

The position difference between the first set of adjacent pixels and the first set of matched pixels refers to the difference between the position of the first set of adjacent pixels in the first segmented luminance map and the position of the first set of matched pixels in the second segmented luminance map. difference.

When the obtained first segmented brightness map and second segmented brightness map can be called the upper image and the lower image, respectively, the phase difference obtained through the upper and lower images can reflect the difference in the imaging position of the object in the vertical direction. .

Please refer to 21, which shows a method of determining the phase difference of the matching pixels according to the position difference of the matching pixels in the first split brightness map and the second split brightness map, which can be applied to FIG. 3 In the illustrated imaging device, as shown in FIG. 21, this method may include the following operations:

In operation 2102, when the luminance map area includes a column of pixels in the target luminance map, a second set of neighboring pixels is determined in each column of pixels included in the first partial luminance map, wherein the pixels included in the second set of neighboring pixels are the same The pixel point group corresponds.

Operation 2104, for each second set of neighboring pixels, search for a second set of matching pixels corresponding to the second set of neighboring pixels in the second segmented brightness map.

Operation 2106: Determine the phase difference between the second adjacent pixel set and the second matched pixel set corresponding to each other according to the position difference between each second adjacent pixel set and each second matched pixel set, to obtain a phase difference value in the first direction .

The technical process from operation 2102 to operation 2104 is the same as the technical process from operation 2002 to operation 2006, and details are not described herein again in the embodiment of the present application.

When the brightness map area includes a column of pixels in the target brightness map, the obtained first segmented brightness map and the second segmented brightness map can be called the left image and the right image, respectively, and the phase obtained by the left image and the right image The difference can reflect the difference in the imaging position of the object in the horizontal direction.

Since when the luminance map area includes a column of pixels in the target luminance map, the acquired phase difference can reflect the difference in the imaging position of the object in the horizontal direction. When the luminance map area includes a row of pixels in the target luminance map, the acquired phase difference The difference can reflect the difference in the imaging position of the object in the vertical direction. Therefore, the phase difference obtained according to the embodiment of the present application can reflect the difference in the imaging position of the object in the vertical direction as well as the imaging position of the object in the horizontal direction. Difference, so its accuracy is higher.

In an embodiment, the aforementioned focusing method may further include: generating a depth value according to the defocus distance value. The defocus distance value can calculate the image distance in the in-focus state, and the object distance can be obtained according to the image distance and the focal length. The object distance is the depth value.

It should be understood that although the various operations in the flowcharts of Figures 7, 11, 13, 16, and 17 to 21 are displayed in sequence as indicated by the arrows, these operations are not necessarily performed in sequence in the order indicated by the arrows. . Unless there is a clear description in this article, there is no strict order restriction on the execution of these operations, and these operations can be executed in other orders. Moreover, at least a part of the operations in FIGS. 7, 11, 13, 16, and 17 to 21 may include multiple sub-operations or multiple stages, and these sub-operations or stages are not necessarily executed at the same time. They can be executed at different moments, and the execution order of these sub-operations or stages is not necessarily performed sequentially, but may be executed alternately or alternately with other operations or at least a part of the sub-operations or stages of other operations.

Fig. 22 is a structural block diagram of an apparatus for obtaining a phase difference according to an embodiment. As shown in FIG. 22, the phase difference acquisition device is applied to electronic equipment. The electronic equipment includes an image sensor. The image sensor includes a plurality of pixel point groups arranged in an array, and each of the pixel point groups includes an array array. Each pixel corresponds to a photosensitive unit, where M and N are both natural numbers greater than or equal to 2; the phase difference acquisition device includes a scene detection module 2210 and a phase difference acquisition module 2212.

The scene detection module 2210 is used to perform scene detection on the captured image to obtain the scene type;

The phase difference obtaining module 2212 is configured to obtain a phase difference value corresponding to the scene type through the image sensor, where the phase difference value is a phase difference value in a first direction or a phase difference value in a second direction; the first The direction forms a preset angle with the second direction.

In an embodiment, the scene detection module 2210 is further configured to perform scene detection on the captured image through an artificial intelligence model to obtain the scene type, and the artificial intelligence model is obtained by training using sample images containing the scene type.

In an embodiment, the scene detection module 2210 is further configured to detect the total number of edge points, the number of edge points in the first direction, and the number of edge points in the second direction in the scene of the captured image through an edge operator; The ratio of the number of points to the total number of edge points and the ratio of the number of edge points in the second direction to the total number of edge points determine the scene type of the captured image.

In one embodiment, the phase difference obtaining module 2212 is further configured to obtain the phase difference value in the second direction through the image sensor when the scene type is a horizontal texture scene; when the scene type is a vertical texture scene, Then, the phase difference value in the first direction is obtained by the image sensor.

In one embodiment, the phase difference acquisition module 2212 includes a brightness determination unit and a phase difference determination unit.

The brightness determining unit is configured to obtain a target brightness map according to the brightness value of the pixel points included in each pixel point group.

The phase difference determining unit is configured to perform segmentation processing on the target brightness map to obtain a first segmented brightness map and a second segmented brightness map, and according to the first segmented brightness map and the second segmented brightness map Determine the phase difference value of the mutually matched pixels in the brightness map to determine the phase difference value of the mutually matched pixels; determine the phase difference value in the first direction or the phase difference value in the second direction according to the phase difference value of the mutually matched pixels .

In an embodiment, the brightness determining unit is further configured to, for each pixel point group, obtain the pixel point group according to the brightness value of the sub-pixel point at the same position of each pixel point in the pixel point group Corresponding sub-brightness map; generating the target brightness map according to the sub-brightness map corresponding to each pixel point group.

In an embodiment, the brightness determining unit is further configured to determine the sub-pixel points at the same position from each of the pixel points to obtain a plurality of sub-pixel point sets, wherein the sub-pixel points included in each sub-pixel point set are The positions of the points in the pixel points are all the same; for each sub-pixel point set, according to the brightness value of each sub-pixel point in the sub-pixel point set, the brightness value corresponding to the sub-pixel point set is obtained; The brightness values corresponding to the sub-pixel sets generate the sub-brightness map.

In an embodiment, the brightness determination unit is further configured to determine a color coefficient corresponding to each sub-pixel point in the sub-pixel point set, and the color coefficient is determined according to the color channel corresponding to the sub-pixel point; Multiply the color coefficient corresponding to each sub-pixel point in the point set by the brightness value to obtain the weighted brightness of each sub-pixel point in the sub-pixel point set; add the weighted brightness of each sub-pixel point in the sub-pixel point set To obtain the brightness value corresponding to the set of sub-pixel points.

In an embodiment, each of the pixel points includes a plurality of sub-pixel points arranged in an array;

The brightness determining unit is further configured to determine a target pixel point from each of the pixel point groups to obtain a plurality of the target pixel points; generate each of the target pixel points according to the brightness value of the sub-pixel points included in each target pixel point A sub-luminance map corresponding to the pixel point group; generating the target brightness map according to the sub-luminance map corresponding to each pixel point group.

In an embodiment, the brightness determining unit is further configured to determine a pixel with a green color channel from each of the pixel point groups; and determine a pixel with a green color channel as the target pixel.

In one embodiment, the brightness determining unit is further configured to determine the pixel points at the same position from each of the pixel point groups to obtain a plurality of pixel point sets, wherein the pixel points included in each pixel point set are The positions in the pixel point groups are all the same; according to the brightness values of the pixel points in the plurality of pixel point sets, generating a plurality of the target brightness maps corresponding to the plurality of pixel point sets one-to-one;

The phase difference determining unit is further configured to generate an intermediate phase difference map corresponding to the target brightness map according to the phase difference of the mutually matched pixels for each of the target brightness maps; The intermediate phase difference map generates the phase difference value in the first direction and the phase difference value in the second direction.

In an embodiment, the phase difference determining unit is further configured to determine pixels at the same position from each of the intermediate phase difference maps to obtain a plurality of phase difference pixel sets, wherein each of the phase difference pixel sets includes The positions of the pixels in the intermediate phase difference diagram are all the same;

For each phase difference pixel set, splicing pixels in the phase difference pixel set to obtain a sub-phase difference map corresponding to the phase difference pixel set;

The obtained multiple sub-phase difference maps are spliced to obtain a target phase difference map, and the target phase difference map includes a phase difference value in a first direction and a phase difference value in a second direction.

In an embodiment, the phase difference determining unit is further configured to perform segmentation processing on the target brightness map to obtain multiple brightness map regions, each of the brightness map regions includes a row of pixels in the target brightness map, or , Each of the brightness map regions includes a column of pixels in the target brightness map;

Acquire a plurality of first brightness map regions and a plurality of second brightness map regions from the plurality of brightness map regions, where the first brightness map region includes pixels in even rows of the target brightness map, or the first brightness map region A luminance map area includes pixels in even-numbered columns in the target luminance map, the second luminance map area includes pixels in odd rows in the target luminance map, or the second luminance map area includes the target luminance map Pixels in odd columns;

The multiple first brightness map regions are used to form the first split brightness map, and the multiple second brightness map regions are used to form the second split brightness map.

In an embodiment, the phase difference determining unit is further configured to determine the first neighboring pixel in each row of pixels included in the first divided brightness map when the brightness map area includes a row of pixels in the target brightness map. A pixel set, the pixels included in the first adjacent pixel set correspond to the same pixel point group;

For each of the first neighboring pixel sets, searching for a first matching pixel set corresponding to the first neighboring pixel set in the second segmented brightness map;

According to the position difference between each of the first adjacent pixel set and each of the first matched pixel set, determine the phase difference between the first adjacent pixel set and the first matched pixel set corresponding to each other to obtain the second The phase difference of the direction.

In an embodiment, the phase difference determining unit is further configured to determine a second neighboring pixel in each column of pixels included in the first divided brightness map when the brightness map area includes a column of pixels in the target brightness map. A pixel set, the pixels included in the second adjacent pixel set correspond to the same pixel point group;

For each of the second adjacent pixel sets, searching for a second matching pixel set corresponding to the second adjacent pixel set in the second segmented brightness map;

According to the position difference between each second adjacent pixel set and each second matched pixel set, determine the phase difference between the second adjacent pixel set and the second matched pixel set corresponding to each other to obtain the first The phase difference of the direction.

In an embodiment, the apparatus for acquiring the phase difference further includes a processing module and a control module.

The processing module is configured to determine the defocus distance value and the moving direction according to the phase difference value;

The control module is used for controlling the movement of the lens to focus according to the defocus distance value and the moving direction.

In an embodiment, the apparatus for acquiring the phase difference further includes a correction module. The correction module is used for correcting the calculated phase difference value by using a gain diagram.

The division of the modules in the above-mentioned phase difference acquisition device is only for illustration. In other embodiments, the phase difference acquisition device can be divided into different modules as needed to complete all or part of the above-mentioned phase difference acquisition device. Features.

FIG. 23 is a schematic diagram of the internal structure of an electronic device in an embodiment. As shown in FIG. 23, the electronic device includes a processor and a memory connected through a system bus. Among them, the processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The memory may include a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program can be executed by a processor to implement a focusing method provided in the following embodiments. The internal memory provides a cached operating environment for the operating system computer program in the non-volatile storage medium. The electronic device can be a mobile phone, a tablet computer, or a personal digital assistant or a wearable device.

The implementation of each module in the focusing device provided in the embodiment of the present application may be in the form of a computer program. The computer program can be run on a terminal or a server. The program module composed of the computer program can be stored in the memory of the terminal or the server. When the computer program is executed by the processor, the operation of the method described in the embodiment of the present application is realized.

The embodiment of the present application also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, cause the processors to perform the operations of the phase difference acquisition method .

A computer program product containing instructions, when it runs on a computer, causes the computer to execute the phase difference acquisition method.

Any reference to memory, storage, database, or other media used in the embodiments of the present application may include non-volatile and/or volatile memory. Suitable non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which acts as external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The above-mentioned embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation to the patent scope of the present application. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can be made, and these all fall within the protection scope of this application. Therefore, the scope of protection of the patent of this application shall be subject to the appended claims.

Claims

A method for obtaining a phase difference, characterized in that it is applied to an electronic device, the electronic device includes an image sensor, the image sensor includes a plurality of pixel point groups arranged in an array, each of the pixel point group includes an array array M*N pixels of the cloth; each pixel corresponds to a photosensitive unit, where M and N are both natural numbers greater than or equal to 2; the method includes:

Perform scene detection on the captured image to obtain the scene type; and

Obtain a phase difference value corresponding to the scene type through the image sensor, where the phase difference value is a phase difference value in a first direction or a phase difference value in a second direction; the first direction and the second direction Into a preset angle.
The method according to claim 1, wherein said performing scene detection on the captured image to obtain the scene type comprises:

The scene type is obtained by performing scene detection on the captured image through an artificial intelligence model, and the artificial intelligence model is obtained by training using a sample image containing the scene type.
The method according to claim 1, wherein said performing scene detection on the captured image to obtain the scene type comprises:

Detecting the total number of edge points, the number of edge points in the first direction, and the number of edge points in the second direction in the scene of the captured image by an edge operator; and

The scene type of the captured image is determined according to the ratio of the number of edge points in the first direction to the total number of edge points and the ratio of the number of edge points in the second direction to the total number of edge points.
The method according to claim 1, wherein acquiring the phase difference value corresponding to the scene type by the image sensor comprises:

When the scene type is a horizontal texture scene, acquiring the phase difference value in the second direction through the image sensor; and

When the scene type is a vertical texture scene, the phase difference value in the first direction is acquired by the image sensor.
The method according to claim 1, wherein the obtaining the phase difference value corresponding to the scene type by the image sensor comprises:

Acquiring a target brightness map according to the brightness value of the pixel points included in each pixel point group;

Perform segmentation processing on the target brightness map to obtain a first segmented brightness map and a second segmented brightness map, and pixels matching each other according to the first segmented brightness map and the second segmented brightness map Determine the phase difference value of the mutually matched pixels; and determine the phase difference value in the first direction or the phase difference value in the second direction according to the phase difference value of the mutually matched pixels.
The method according to claim 5, wherein the segmentation processing on the target brightness map to obtain a first segmented brightness map and a second segmented brightness map comprises:

The target brightness map is segmented to obtain multiple brightness map regions, each of the brightness map regions includes a row of pixels in the target brightness map, or each of the brightness map regions includes the target brightness A column of pixels in the picture;

Acquire a plurality of first brightness map regions and a plurality of second brightness map regions from the plurality of brightness map regions, where the first brightness map region includes pixels in even rows of the target brightness map, or the first brightness map region A luminance map area includes pixels in even-numbered columns in the target luminance map, the second luminance map area includes pixels in odd rows in the target luminance map, or the second luminance map area includes the target luminance map Pixels in odd columns; and

The multiple first brightness map regions are used to form the first split brightness map, and the multiple second brightness map regions are used to form the second split brightness map.
The method according to claim 6, wherein the phases of the pixels that match each other are determined according to the position difference of the pixel points that match each other in the first split brightness map and the second split brightness map Poor, including:

When the brightness map area includes a row of pixels in the target brightness map, a first set of neighboring pixels is determined in each row of pixels included in the first split brightness map, and the pixels included in the first neighboring pixel set Correspond to the same pixel group;

For each of the first neighboring pixel sets, searching for a first matching pixel set corresponding to the first neighboring pixel set in the second segmented brightness map; and

According to the position difference between each of the first adjacent pixel set and each of the first matched pixel set, determine the phase difference between the first adjacent pixel set and the first matched pixel set corresponding to each other to obtain the second The phase difference of the direction.
The method according to claim 6, wherein the phase difference of the pixels that match each other is determined based on the position difference of the pixels that match each other in the first split brightness map and the second split brightness map ,include:

When the brightness map area includes a column of pixels in the target brightness map, a second set of neighboring pixels is determined in each column of pixels included in the first split brightness map, and the pixels included in the second set of neighboring pixels Correspond to the same pixel group;

For each of the second adjacent pixel sets, searching for a second matching pixel set corresponding to the second adjacent pixel set in the second segmented luminance map; and

According to the position difference between each second adjacent pixel set and each second matched pixel set, determine the phase difference between the second adjacent pixel set and the second matched pixel set corresponding to each other to obtain the first The phase difference of the direction.
The method according to claim 5, wherein each pixel point includes a plurality of sub-pixel points arranged in an array, and the target brightness map is obtained according to the brightness value of the pixel points included in each pixel point group ,include:

For each pixel point group, obtain the sub-luminance map corresponding to the pixel point group according to the brightness value of the sub-pixel point at the same position of each pixel point in the pixel point group; and

The target brightness map is generated according to the sub-brightness map corresponding to each pixel point group.
The method according to claim 9, wherein the obtaining the sub-luminance map corresponding to the pixel point group according to the brightness value of the sub-pixel point at the same position of each pixel point in the pixel point group, include:

Determine the sub-pixel points at the same position from each of the pixel points to obtain a plurality of sub-pixel point sets, wherein the positions of the sub-pixel points included in each of the sub-pixel point sets in the pixel points are all the same;

For each set of sub-pixel points, obtaining a brightness value corresponding to the set of sub-pixel points according to the brightness value of each sub-pixel point in the set of sub-pixel points; and

The sub-brightness map is generated according to the brightness value corresponding to each of the sub-pixel sets.
The method according to claim 10, wherein the obtaining the brightness value corresponding to the sub-pixel point set according to the brightness value of each sub-pixel point in the sub-pixel point set comprises:

Determining a color coefficient corresponding to each sub-pixel point in the sub-pixel point set, where the color coefficient is determined according to a color channel corresponding to the sub-pixel point;

Multiply the color coefficient corresponding to each sub-pixel point in the sub-pixel point set by the brightness value to obtain the weighted brightness of each sub-pixel point in the sub-pixel point set; and

The weighted brightness of each sub-pixel in the set of sub-pixels is added to obtain the brightness value corresponding to the set of sub-pixels.
The method according to claim 5, wherein each of the pixel points comprises a plurality of sub-pixel points arranged in an array;

The acquiring the target brightness map according to the brightness value of the pixel points included in each pixel point group includes:

Determining a target pixel point from each of the pixel point groups to obtain a plurality of the target pixel points;

Generating a sub-brightness map corresponding to each pixel point group according to the brightness value of the sub-pixel points included in each target pixel point; and

The target brightness map is generated according to the sub-brightness map corresponding to each pixel point group.
The method according to claim 12, wherein said determining a target pixel point from each of said pixel point groups comprises:

Determining a pixel with a green color channel from each of the pixel groups; and

A pixel with a green color channel is determined as the target pixel.
The method according to claim 5, wherein the obtaining a target brightness map according to the brightness value of the pixel points included in each pixel point group comprises:

Determining the pixel points at the same position from each of the pixel point groups to obtain a plurality of pixel point sets, wherein the positions of the pixels included in each pixel point set in the pixel point group are all the same;

Generating, according to the brightness values of the pixel points in the plurality of pixel point sets, a plurality of the target brightness maps one-to-one corresponding to the plurality of pixel point sets;

The generating the phase difference value in the first direction or the phase difference value in the second direction according to the phase difference of the mutually matched pixels includes:

For each target brightness map, generate an intermediate phase difference map corresponding to the target brightness map according to the phase difference of the mutually matched pixels;

Generate the phase difference value in the first direction or the phase difference value in the second direction according to the intermediate phase difference map corresponding to each target brightness map.
The method according to claim 14, wherein the phase difference value in the first direction or the phase difference value in the second direction is generated according to an intermediate phase difference map corresponding to each of the target brightness maps ,include:

Determining the pixels at the same position from each of the intermediate phase difference maps to obtain a plurality of phase difference pixel sets, wherein the positions of the pixels included in each of the phase difference pixel sets are all the same in the intermediate phase difference map;

For each of the phase difference pixel sets, splicing pixels in the phase difference pixel set to obtain a sub-phase difference map corresponding to the phase difference pixel set; and

The obtained multiple sub-phase difference maps are spliced to obtain a target phase difference map, and the target phase difference map includes the phase difference value in the first direction or the phase difference value in the second direction.
The method according to claim 1, wherein the method further comprises:

Determining the defocus distance value according to the phase difference value; and

The lens is controlled to move to focus according to the defocus distance value.
The method according to claim 1, wherein the method further comprises:

The phase difference value obtained by the calculation is corrected by using a gain map.
A phase difference acquisition device, which is characterized in that it is applied to an electronic device, the electronic device includes an image sensor, the image sensor includes a plurality of pixel point groups arranged in an array, and each of the pixel point groups includes an array array M*N pixel points of the cloth; each pixel point corresponds to a photosensitive unit, where M and N are both natural numbers greater than or equal to 2; the device includes:

The scene detection module is used to perform scene detection on the captured image to obtain the scene type;

The phase difference acquisition module is configured to acquire the phase difference value corresponding to the scene type through the image sensor, where the phase difference value is a phase difference value in a first direction or a phase difference value in a second direction; the first direction It forms a preset angle with the second direction.
An electronic device comprising a memory and a processor, and a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 17 are realized.
A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1 to 17 when the computer program is executed by a processor.