WO2022227893A1 - Image photographing method and device, terminal and storage medium - Google Patents

Abstract

The present application relates to the technical field of image processing, and provides an image photographing method and device, a terminal and a storage medium. The method is applied to a terminal, and the terminal comprises a lens module provided under a screen glass cover plate, and the method comprises: acquiring surface type information of the screen glass cover plate; on the basis of the surface type information of the screen glass cover plate, performing image correction on the original image captured by the lens module; and outputting the corrected image obtained after the original image correction. According to the method provided by embodiments of the present application, on one hand, the imaging quality of image photographing can be improved by means of image correction, and on the other hand, when the hardware design of the terminal is not needed, due to the influence of the bending degree of the screen glass cover plate on the setting position of a camera assembly, the arrangement of the original components of the terminal is influenced, such that the implementation complexity of the terminal is reduced.

Description

Image capturing method, device, terminal and storage medium

This application claims the priority of the Chinese patent application with the application number 202110478495.9 and the invention title "image capturing method, device, terminal and storage medium" filed on April 30, 2021, the entire contents of which are incorporated into this application by reference .

technical field

The present application relates to the technical field of image processing, and in particular, to an image capturing method, device, terminal and storage medium.

Background technique

With the development of terminal technology, many mobile phones choose to configure a curved screen, a type of screen glass cover.

Two sides or four sides of the curved screen are curved, and this kind of uneven screen glass cover may easily affect the image capture of the front camera disposed under the curved screen.

In the related art, the front camera is placed below a relatively flat area in the curved screen as much as possible, so as to avoid the influence of the curved screen on the image capture of the front camera.

SUMMARY OF THE INVENTION

The embodiments of the present application provide an image capturing method, device, terminal and storage medium, which can improve the imaging quality of image capturing through image correction. The technical solution is as follows.

According to an aspect of the present application, an image capturing method is provided, which is applied to a terminal, where the terminal includes a lens module disposed under a screen glass cover, and the method includes:

obtaining the surface shape information of the screen glass cover;

Perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover;

A corrected image obtained after the original image is corrected is output.

According to an aspect of the present application, an image capturing device is provided, the device comprising: a face shape information acquisition module, an image correction module, and an image output module;

The surface shape information acquisition module is used to obtain the surface shape information of the screen glass cover;

The image correction module is used to perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover;

The image output module is configured to output the corrected image obtained after the original image is corrected.

According to another aspect of the present application, a computer device is provided, the computer device comprising: a processor and a memory, wherein the memory stores at least one instruction, at least a piece of program, a code set or an instruction set, the at least one The instructions, the at least one piece of program, the code set or the instruction set are loaded and executed by the processor to implement the image capturing method as described above.

According to another aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, at least one piece of program, code set or instruction set, the at least one instruction, the at least one piece of program , The code set or the instruction set is loaded and executed by the processor to implement the image capturing method described in the above aspect.

According to another aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the image capturing method provided in the foregoing optional implementation manner.

According to another aspect of the embodiments of the present application, a chip is provided, the chip includes a programmable logic circuit and/or program instructions, and when the chip runs, it is used to implement the image capturing method described in the above aspect.

The beneficial effects brought by the technical solutions provided in the embodiments of the present application include at least:

Through the obtained surface shape information of the screen glass cover, image correction is performed on the original image captured by the lens module under the screen glass cover, so as to avoid the influence of the curved screen on the image capture of the lens module, and on the one hand, it can improve the image capture. On the other hand, when designing the hardware of the terminal, it is not necessary to consider the influence of the bending degree of the screen glass cover on the setting position of the camera components, which affects the arrangement of the original components in the terminal, thus reducing the realization of the terminal. the complexity.

Description of drawings

FIG. 1 is a schematic diagram of an image capturing method provided by an exemplary embodiment of the present application;

FIG. 2 is a flowchart of an image capturing method provided by an exemplary embodiment of the present application;

FIG. 3 is a schematic diagram of storing surface type information of a screen glass cover plate provided by an exemplary embodiment of the present application;

4 is a flowchart of an image capturing method provided by an exemplary embodiment of the present application;

FIG. 5 is a schematic diagram of fringe light detection provided by an exemplary embodiment of the present application;

6 is a flowchart of an image capturing method provided by an exemplary embodiment of the present application;

7 is a flowchart of an image capturing method provided by an exemplary embodiment of the present application;

8 is a schematic diagram of a lens module provided by an exemplary embodiment of the present application;

FIG. 9 is a block diagram of an image capturing apparatus provided by an exemplary embodiment of the present application;

FIG. 10 is a schematic structural diagram of a terminal provided by an exemplary embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

In recent years, the use of curved screens has become a standard in the mobile phone industry. In addition to side curvature, the curved screen of mobile phones has a four-curved trend. The uneven glass cover of the screen has caused great difficulty in focusing and shooting of the front camera below it. Large influence, such as imaging remote focus, the picture is not clear and so on.

In order to avoid the influence of the curved screen on the image capture of the front camera, the related technology solves the problem from the perspective of hardware design, for example, the front camera is designed below a relatively flat area in the curved screen.

In the embodiment of the present application, by obtaining the surface shape information of the screen glass cover, image correction is performed on the original image captured by the lens module under the screen glass cover, so as to avoid the influence of the curved screen on the image capturing of the lens module. Hereinafter, with reference to the following FIG. 1 , the image capturing method provided by the embodiment of the present application will be exemplarily described.

In this embodiment, the lens module includes: a stripe emitting end, a front camera and an image sensor. The front camera is used for front image shooting; the stripe transmitter and the image sensor are used for stripe light detection. Specifically, the stripe transmitter is used to transmit the detection stripe emission signal, the image sensor is used to receive the detection stripe reflection signal, and the image sensor is used to receive the detection stripe reflection signal. It can be a complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor, CMOS) receiver.

As shown in Figure 1, when the terminal uses the lens module to capture images, the image sensor can obtain the detection fringe reflection signal, and feed back the detection fringe reflection signal to the Central Processing Unit (CPU) processor in the terminal. Exemplarily, under the condition that the detection fringe emission signal emitted by the fringe emission end is fixed, the image sensor receives the detection fringe reflection signal formed by the reflection of the object to be photographed, and sends the detection fringe reflection signal to the CPU processor, and the CPU processor Based on the detection stripe emission signal and the detection stripe reflection signal, the stripe state change can be determined, and the stripe state change includes: the change of the stripe width, the change of the stripe spacing, and the like.

The CPU processor calculates the shooting distance from the object to the front camera by obtaining the time difference between the detection stripe emission signal emitted by the stripe transmitter and the detection stripe reflection signal received by the image sensor, and feeds back the shooting distance to the front camera. The front camera adjusts the focus based on the shooting distance fed back by the CPU processor, takes a picture after focusing, and feeds back the original image captured to the CPU processor.

The CPU processor calculates the depth information of the captured original image through the change of the stripe state, and performs image segmentation on the original image based on the depth information. Exemplarily, the CPU processor first divides the person and the background in the original image based on the depth information, and then divides the person into different regions based on the depth information, and the precision of the segmentation may be higher than 1 mm.

After the image segmentation is completed, the CPU processor calls the surface type information of the screen glass cover stored in the Electrically Erasable Programmable Read-Only Memory (EEPROM) of the front camera, based on the screen glass cover The surface shape information of the board performs deconvolution processing on each segmented area, so that the influence of the curvature of the screen glass cover on the image is eliminated in each area. After the deconvolution processing is completed, the CPU processor processes the image. Synthesis, so as to obtain a complete image corrected image, and image output of the corrected image.

Next, the image capturing method provided by the embodiment of the present application will be further described.

Fig. 2 shows the flow chart of the image capturing method provided by an exemplary embodiment of the present application, and the method can be applied in a terminal, and the terminal includes a lens module arranged under a screen glass cover, and the method includes:

In step 201, the surface shape information of the screen glass cover is obtained.

In a possible implementation manner, the terminal obtains the pre-stored surface shape information of the screen glass cover in front of the lens module, or obtains the surface shape information of the screen glass cover by real-time detection.

Exemplarily, when the lens module in the terminal is in a shooting state, the terminal performs real-time detection to obtain the surface shape information of the screen glass cover. The lens module is in the shooting state refers to the state that the lens module is in the process of framing and has not yet completed the shooting. Exemplarily, the user enters the camera function page, clicks the icon of camera conversion, switches the terminal to use the front camera, the terminal uses the front camera to view the scene, and obtains the current face shape information of the screen glass cover.

Exemplarily, the terminal reads the pre-stored surface shape information of the screen glass cover from a memory (eg, EEPROM). The surface shape information of the screen glass cover in the memory may be pre-stored before the terminal is assembled, or may be stored after the screen glass cover is detected after the terminal is assembled.

In the embodiment of the present application, the lens module is disposed under the screen glass cover, and the lens module passes through the screen glass cover to receive light from the area in front of the screen glass cover, and performs optical imaging on the image in the area. That is, the lens module in the embodiment of the present application is not a lens module in the following form: a design such as lifting is adopted, and light can be received without passing through the screen glass cover.

Exemplarily, in the case that the screen glass cover plate does not cover the two opposite planes of the terminal, but only covers the front side of the terminal, the lens module can be understood as a lens module for front-facing camera.

The surface shape information of the screen glass cover is information for indicating the surface shape of the screen glass cover. In the embodiments of the present application, the surface shape information of the screen glass cover can also be understood as the curvature information of the screen glass cover, the influence information of the screen glass cover on imaging, and the like.

Step 202: Perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover.

In a possible implementation manner, the terminal uses the lens module to capture the original image, and invokes the obtained surface shape information of the screen glass cover to perform image correction on the original image.

Optionally, if the terminal device obtains the surface shape information of the screen glass cover through real-time detection, the terminal stores the surface shape information of the screen glass cover in the lens module after obtaining the surface shape information of the screen glass cover. The corresponding memory, such as EEPROM, calls the surface shape information of the screen glass cover from the memory corresponding to the lens module after capturing the original image.

Exemplarily, referring to FIG. 3 , the lens module includes an image sensor and a front-facing camera, the image sensor feeds back the received detection reflection signal to the CPU processor, and the CPU processor calculates based on the detection reflection signal fed back by the image sensor. The surface shape information of the screen glass cover plate is transmitted to the front camera EEPROM and stored in the front camera EEPROM.

Optionally, after acquiring the surface shape information of the screen glass cover through one detection, the terminal may use the surface shape information of the screen glass cover to perform image correction on the original image captured within a period of time, that is, The surface type information of the screen glass cover is updated at a fixed frequency. Exemplarily, after acquiring the surface shape information of the screen glass cover once, the terminal stores the surface shape information of the screen glass cover, and uses the surface shape information of the screen glass cover in the next month. Image rectification is performed on the captured original image.

Optionally, the surface shape information of the screen glass cover is automatically updated every time the terminal performs image capture. Exemplarily, the terminal uses the lens module to capture images, obtains the surface shape information of the screen glass cover during framing, captures the image after the framing is completed, and obtains the original image, and uses the surface of the screen glass cover obtained this time. The original image is corrected using the type information. Exemplarily, before the image is taken, the screen glass cover of the terminal is filmed, and the optical structure (material/thickness) of the screen glass cover changes, then the terminal detects the curvature of the screen glass cover after filming. , get the latest face shape information and apply it to image correction in actual photography.

Step 203 , output the corrected image obtained after the original image is corrected.

In a possible implementation manner, the terminal rectifies the original image into a rectified image, and outputs the rectified image.

In summary, the method provided in this embodiment performs image correction on the original image captured by the lens module under the screen glass cover by obtaining the surface shape information of the screen glass cover, so as to avoid the lens module being affected by the curved screen. On the one hand, it can improve the image quality of image shooting. On the other hand, when designing the hardware of the terminal, it is not necessary to consider the influence of the bending degree of the screen glass cover on the setting position of the camera assembly, which will affect the central plain of the terminal. There are components arranged, thereby reducing the implementation complexity of the terminal.

In an exemplary embodiment, the terminal performs image correction on the original image based on the depth information of the original image, so as to obtain a better image correction effect.

4 shows a flowchart of an image capturing method provided by an exemplary embodiment of the present application. The method can be applied to a terminal. The terminal includes a lens module disposed under a screen glass cover, and the method includes:

In step 401, the surface shape information of the screen glass cover is obtained.

For the implementation manner of this step, refer to the above-mentioned step 201, which will not be repeated here.

Step 402, acquiring depth information of the original image.

The depth information of the original image refers to the three-dimensional information of the photographed object in the original image in the three-dimensional world.

Optionally, the lens module in the terminal uses machine vision technology to obtain depth information of the original image. The machine vision technology may include: structured light (Structured-light) detection technology and time of flight (Time of Flight, ToF) method, this The application embodiments do not limit this.

The time-of-flight method of light refers to a detection method that obtains the depth information of the photographed object by measuring the time when the light irradiates the photographed object and returns.

Among them, the structured light detection technology refers to a detection method in which depth information is obtained by projecting a specific coding pattern onto the object to be photographed, converting the depth information into the change of the coding pattern, and detecting the change of the coding pattern. Optionally, the structured light detection technology includes: fringe light detection and speckle pattern detection. The coding pattern projected in the fringe light detection is a fringe pattern, and the coding pattern projected in the speckle pattern detection is a speckle pattern. In a possible implementation, the terminal obtains the depth information of the original image through the following stripe light detection methods:

S11, the lens module sends a first detection stripe emission signal.

Optionally, the lens module includes a stripe transmitting end, and the terminal calls the stripe transmitting end to transmit the first detection stripe transmitting signal.

S12, the lens module receives a first detection fringe reflection signal, where the first detection fringe reflection signal is a signal formed by the reflection of the first detection fringe emission signal by the object to be photographed.

Optionally, the lens module includes an image sensor, and the first detection fringe emission signal transmits through the screen glass cover and is projected onto the surface of the object to be photographed, and is reflected by the object to form a first detection fringe reflection signal, and the first detection fringe emits a signal. The signal is received by the image sensor.

S13: Obtain depth information of the original image based on the change between the reflection signal of the first detection fringe and the emission signal of the first detection fringe.

In a possible implementation manner, the spacing and width of the stripes between the reflected signal of the first detection stripe and the emission signal of the first detection stripe change, and the terminal calculates and obtains the depth information of the original image based on the above changes.

Exemplarily, referring to FIG. 5, the fringe pattern 501 (ie, the first detection fringe emission signal) is projected onto the object 502, and it can be found that the original vertical fringe pattern in the fringe pattern 501 is distorted, and the spacing and width of the fringes, etc. When the change occurs, the fringe pattern 501 is modulated by the height of the object 502 , and the distorted fringe shape of the fringe pattern 503 (ie, the reflection signal of the first detection fringe) contains the depth information of the object 502 .

Optionally, the terminal obtains the depth information of the original image based on the change between the first detection fringe reflection signal and the first detection fringe emission signal: the terminal obtains the depth information of the original image based on the first detection fringe reflection signal and the first detection fringe emission signal. The changes between them are fitted and calculated to obtain the depth information of the original image. Optionally, the fitting method used in the fitting calculation may be Gaussian polynomial fitting or other fitting scheme, which is not limited in this embodiment of the present application.

Step 403: Segment the original image into at least one image area based on the depth information.

Optionally, the terminal divides pixels with similar depths into an image area based on the depth information of the image.

In a possible implementation manner, the terminal divides a part of the original image into at least one image area based on the depth information. In another possible implementation manner, the terminal divides the entire original image into at least one image area based on the depth information.

Exemplarily, the original image includes a person and a background. The terminal first divides the person and the background based on the depth information, and then further divides the person and the background into smaller image areas based on the depth information.

Exemplarily, the original image includes a person and a background, the terminal first divides the person and the background based on the depth information, and then divides the person part in the original image into at least one image area based on the depth information.

Step 404: Perform image correction on at least one image area based on the surface shape information of the screen glass cover.

In a possible implementation manner, the terminal uses the surface shape information of the screen glass cover to perform deconvolution processing on at least one image area to perform image correction.

The original image output by the lens module can be regarded as the result of convolution of the real image and the surface of the screen glass cover. Therefore, deconvolution processing is performed on the original image corresponding to at least one image area by using the surface shape information of the screen glass cover, and the real image corresponding to the image area can be obtained.

Optionally, the deconvolution process is based on a cross-channel prior. Cross-channel prior refers to sharing the information of different channels during the deconvolution process, so that the frequency information retained by one channel can help other channels to reconstruct and eliminate chromatic aberration. The chromatic aberration correction is added to the cross-channel prior to reduce the blurring and color fringing caused by the chromatic aberration during the image correction process, so as to achieve high-quality imaging.

Step 405, synthesizing the original image and at least one image area after image correction to obtain a corrected image.

In a possible implementation manner, after performing image correction on at least one image area respectively, the terminal performs image synthesis on the uncorrected part of the original image and at least one image area after image correction, thereby obtaining a corrected image.

Exemplarily, the terminal divides the character part in the original image into an image area, performs image correction on the image area corresponding to the character part, and then combines the corrected character part with other parts in the original image to obtain a corrected image. .

It can be understood that, if the entire original image is divided into at least one image area, the terminal synthesizes the at least one image area after image correction to obtain a corrected image.

Step 406, output the corrected image.

To sum up, in the method provided in this embodiment, the terminal obtains the depth information of the original image, divides the original image into multiple image areas based on the depth information of the original image, and then corrects each image area separately. The correction method for correcting the original image can improve the accuracy of image correction due to the smaller granularity of the calculation.

In an exemplary embodiment, the surface shape information of the glass cover plate of the screen is acquired by the terminal based on the detection of the machine vision technology. The machine vision technology may include: structured light detection technology and light time-of-flight method, which are not limited in this embodiment of the present application. Optionally, the structured light detection technology includes: fringe light detection and speckle pattern detection. In the following, an exemplary description will be given of obtaining the surface shape information of the screen glass cover plate by means of stripe light detection by the terminal.

FIG. 6 shows a flowchart of an image capturing method provided by an exemplary embodiment of the present application. The method can be applied to a terminal. The terminal includes a lens module disposed under a screen glass cover, and the method includes:

In step 601, the lens module is called to perform stripe light detection, and the surface shape information of the screen glass cover is obtained.

The fringe light detection refers to the detection method in which the reflection test is carried out through the detection fringe signal with the determined fringe information. Determining the fringe information means that in the fringe pattern corresponding to the detection fringe signal, the spacing and width of the fringes are fixed.

In a possible implementation manner, the terminal performs fringe light detection in the following manner:

S21, the lens module sends a second detection stripe emission signal.

Optionally, the lens module includes a stripe transmitting end, and the terminal invokes the stripe transmitting end to transmit the second detection stripe transmitting signal.

In this embodiment of the present application, the second detection fringe emission signal and the first detection fringe emission signal described in the above embodiments may be two different parts of the detection fringe emission signal emitted by the fringe emission end at the same time point: the first part That is, the first detection stripe emits signal, and this part of the signal passes through the screen glass cover and is projected onto the surface of the object to be photographed; the second part is the second detection stripe emission signal, and this part of the signal does not pass through the screen glass cover.

S22, the lens module receives a second detection stripe reflection signal, where the second detection stripe reflection signal is a signal formed by the second detection stripe emission signal reflected by the screen glass cover.

Optionally, the lens module includes an image sensor, the second detection stripe emission signal is reflected by the screen glass cover to form a second detection stripe reflection signal, and the second detection stripe reflection signal is received by the image sensor.

S23 , based on the change between the reflection signal of the second detection stripe and the emission signal of the second detection stripe, obtain the surface shape information of the glass cover plate of the screen.

In a possible implementation manner, the spacing and width of the stripes between the reflection signal of the second detection stripe and the emission signal of the second detection stripe change, and the terminal calculates the surface shape information of the screen glass cover based on the above changes.

Optionally, the terminal acquires the surface shape information of the screen glass cover based on the change between the second detection stripe reflection signal and the second detection stripe emission signal as follows: the terminal is based on the second detection stripe reflection signal and the second detection stripe reflection signal. The variation between the fringe emission signals is fitted and calculated to obtain the surface shape information of the screen glass cover. Optionally, the fitting method used in the fitting calculation may be Gaussian polynomial fitting or other fitting scheme, which is not limited in this embodiment of the present application.

Step 602: Perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover.

For the implementation manner of this step, refer to the above-mentioned step 202, which will not be repeated here.

Step 603, output the corrected image obtained after the original image is corrected.

For the implementation of this step, refer to the above-mentioned step 203, which will not be repeated here.

To sum up, in the method provided in this embodiment, the terminal obtains accurate surface shape information of the screen glass cover by detecting the stripe light detection and detecting the change between the stripe reflection signal and the detection stripe emission signal. When the face shape information of the screen glass cover is used for image correction, it is beneficial to improve the effect of image correction.

In an exemplary embodiment, the terminal adjusts the focus of the lens module before capturing the image, thereby improving the imaging quality of the image.

7 shows a flowchart of an image capturing method provided by an exemplary embodiment of the present application. The method can be applied to a terminal. The terminal includes a lens module disposed under a screen glass cover, and the method includes:

Step 701: Obtain the surface shape information of the screen glass cover.

For the implementation manner of this step, refer to the above-mentioned step 201, which will not be repeated here.

Step 702: Obtain a reference distance, where the reference distance is the distance between the object to be photographed and the lens module.

When the lens module is framing, the terminal obtains the distance between the photographed object and the lens module, and performs focusing based on the distance.

Optionally, the reference distance is detected by the terminal based on machine vision technology. The machine vision technology may include: structured light detection technology and light time-of-flight method, which are not limited in this embodiment of the present application. Optionally, the structured light detection technology includes: fringe light detection and speckle pattern detection.

In a possible implementation, the terminal obtains the reference distance through stripe light detection:

S31, calling the lens module to send a third detection stripe emission signal.

Optionally, the lens module includes a stripe transmitting end, and the terminal calls the stripe transmitting end to transmit a third detection stripe transmitting signal.

In this embodiment of the present application, the third detection fringe emission signal and the first detection fringe emission signal described in the above embodiments may be the same signal.

S32, the lens module is called to receive the reflection signal of the third detection stripe, and the reflection signal of the third detection stripe is a signal formed by the emission signal of the third detection stripe reflected by the object to be photographed.

Optionally, the lens module includes an image sensor, and the third detection stripe emission signal transmits through the screen glass cover and is projected onto the surface of the object to be photographed, and is reflected by the object to form a third detection stripe reflection signal, and the third detection stripe reflection signal. received by the image sensor.

In the embodiment of the present application, the reflection signal of the third detection fringe and the emission signal of the first detection fringe described in the above embodiments may be the same signal.

S33, based on the first round-trip time, determine a reference distance.

The first round-trip time is the difference between the time point when the lens module transmits the emission signal of the third detection stripe and the time point when the reflection signal of the third detection stripe is received.

Since the emission signal of the third detection fringe is emitted by the lens module, the reflection signal of the third detection fringe is formed by the reflection of the emission signal of the third detection fringe by the object to be photographed, and the reflection signal of the third detection fringe is also received by the lens module. The time difference between transmission and reception (ie, the first round-trip time) and the propagation speed of the signal can be used to calculate the distance between the object to be photographed and the lens module.

It can be understood that, if the third detection fringe emission signal and the second detection fringe emission signal are different parts of a signal transmitted by the terminal at the same time point, the first round-trip time can receive the reflection of the third detection fringe through the lens module. It is measured by the difference between the time point of the signal and the time point when the second detection stripe reflection signal is received, wherein the second detection stripe reflection signal is a signal formed by the second detection stripe emission signal reflected by the screen glass cover. This is because the distance between the screen glass cover and the lens module is very close, and this distance has little effect on the value of the reference distance, so the terminal transmits the third detection stripe transmission signal and the second detection stripe transmission signal at the same time. In this case, the terminal may equate the difference between the time point when the lens module receives the reflection signal of the third detection fringe and the time point when the reflection signal of the second detection stripe is received as the first round-trip time.

Step 703, focusing on the lens module based on the reference distance.

In a possible implementation manner, the lens module adopts a zoom lens, and after obtaining the reference distance, the terminal uses a focusing motor to drive the lens in the lens module to an ideal position to complete focusing, wherein the ideal position is when the lens supports The position of the lens when the object to be photographed at the current reference distance achieves the ideal focusing effect.

It can be understood that if the lens module adopts a fixed-focus lens, after obtaining the reference distance, the terminal will compare the reference distance with the ideal reference distance range. If the reference distance is not within the ideal reference distance range, it will be displayed on the terminal. Prompt information. The prompt information is used to prompt the user to adjust the distance between the object to be photographed and the terminal. The ideal reference distance range is the distance between the object to be photographed and the lens module when the lens module achieves an ideal focusing effect. corresponding distance range. Exemplarily, if the reference distance is greater than the ideal reference distance range, the terminal prompts the user to shorten the distance between the photographed object and the terminal; if the reference distance is less than the ideal reference distance range, the terminal prompts the user to increase the distance between the photographed object and the terminal. distance.

Optionally, the reference distance can be one value or multiple values. When the reference distance is one value, the reference distance is the distance between a point of the object to be photographed and the lens module; when the reference distance is multiple values, the reference distance is the distance between multiple points of the object to be photographed and the lens module. the distance.

Optionally, in response to obtaining the at least two reference distances, the terminal processes the at least two reference distances based on the attention mechanism to obtain the target reference distance; and adjusts the focus of the lens module based on the target reference distance.

Processing at least two reference distances based on the attention mechanism refers to a processing method of assigning different weights to at least two reference distances, and then performing weighting.

Optionally, the terminal assigns weights to different reference distances based on the positions of the points of the photographed objects corresponding to the reference distances in the image. For example, if the point corresponding to the first reference distance is in the middle of the image, and the point corresponding to the second reference distance is at the edge of the image, the weight of the first reference distance is higher than that of the second reference distance.

Optionally, the terminal assigns weights to different reference distances based on properties of points of the object to be photographed corresponding to the reference distances. For example, if the point corresponding to the first reference distance belongs to a person, and the point corresponding to the second reference distance belongs to the background, the weight of the first reference distance is higher than that of the second reference distance.

Optionally, the terminal assigns weights to different reference distances based on whether the object to be photographed corresponding to the reference distance is selected by the user. For example, if the object to be photographed corresponding to the first reference distance is selected by the user, and the object to be photographed corresponding to the second reference distance is not selected by the user, the weight of the first reference distance is higher than that of the second reference distance.

Step 704, using the adjusted lens module to capture an image to obtain an original image.

In a possible implementation manner, after the terminal adjusts the focus based on the reference distance, the lens module is used to capture the image, and the original image captured at this time corresponds to a better focusing effect.

Step 705: Perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover.

For the implementation manner of this step, refer to the above-mentioned step 202, which will not be repeated here.

Step 706 , output the corrected image obtained after the original image is corrected.

For the implementation of this step, refer to the above-mentioned step 203, which will not be repeated here.

To sum up, in the method provided in this embodiment, the terminal obtains the reference distance between the object to be photographed and the lens module before capturing the image, and uses the reference distance to adjust the focus of the lens module, thereby providing an auxiliary focusing method. implementation, thereby improving the imaging quality of the image.

Hereinafter, the lens module of the above-mentioned embodiment will be exemplarily described. FIG. 8 shows a schematic diagram of a lens module provided by an exemplary embodiment of the present application. The lens module includes a camera 801 , a detection signal transmitting end 802 and an image sensor 803 .

As shown in Fig. 8, the detection signal transmitting end 802 and the image sensor 803 are symmetrically arranged with the optical axis of the camera 801 as the axis of symmetry. Optionally, the optical axis of the detection signal emitting end 802 and the central axis of the photosensitive surface of the image sensor 803 are symmetrically arranged with the optical axis of the camera 801 as the axis of symmetry.

Optionally, the detection signal transmitter 802 and the image sensor 803 can be set independently, and there is no fixed connection between the two devices; the detection signal transmitter 802 and the image sensor 803 can also be set in a unified manner, and the two devices are fixedly connected. For example, the two devices form a U-shaped structure and surround both sides of the camera 801 .

The camera 801 is used for image capturing. Optionally, the camera 801 is a front camera.

The sounding signal transmitting end 802 is used for transmitting sounding and transmitting signals. Optionally, the detection signal transmitter 802 is used for transmitting detection stripe transmission signals, and the detection signal transmitter 802 is a kind of stripe transmitter. Optionally, the detection signal transmitter 802 is configured to transmit a detection speckle transmitter signal, and the detection signal transmitter 802 is a speckle pattern transmitter.

Optionally, the detection signal transmitting end 802 is a liquid crystal display (Liquid Crystal Display, LCD) screen. Optionally, the wavelength of the detection signal emitted by the detection signal transmitting end 802 is in the non-visible light range, such as infrared light.

The image sensor 803 is used to receive the detection reflection signal, and the detection reflection signal is a signal formed by the reflection of the detection emission signal. Optionally, the detection reflection signal received by the image sensor 803 is a detection fringe reflection signal. Optionally, the detection reflection signal received by the image sensor 803 is a detection speckle reflection signal. Optionally, the pixels of the detection target surface of the image sensor 803 are not less than 2000*2000, and the size of a single pixel is 2um-4um. Optionally, the image sensor 803 is an area array image sensor, and the area array image sensor supports detecting the distances between multiple points of the photographed object and the lens module, that is, the area array image sensor supports obtaining multiple reference distances.

Referring to FIG. 8 , taking the detection signal transmitting end 802 as the stripe transmitting end as an example, an exemplary description will be given of the stripe light detection performed by the lens module.

The probe signal transmitter 802 transmits a probe fringe transmission signal with the determined fringe information. The detection stripe reflection signal corresponding to the detection stripe emission signal is absorbed by the image sensor 803 .

A part of the detection fringe emission signal (that is, the second detection fringe emission signal) is reflected by the screen glass cover 804 of the terminal to form a second detection fringe reflection signal. The second detection fringe reflection signal is absorbed by the image sensor 803 and sent to the terminal in the terminal. The CPU processor calculates the surface shape information of the screen glass cover 804 according to the stripe changes, mainly including the curvatures in the X and Y directions, thereby constructing a three-dimensional model of the screen glass cover 804 .

The other part of the detection fringe emission signal (ie the first detection fringe emission signal) passes through the screen glass cover 804, transmits to the surface of the object to be photographed 805, and is reflected to form the first detection fringe reflection signal, and the first detection fringe reflection signal Absorbed by the image sensor 803 and sent to the CPU processor in the terminal, the CPU processor also calculates the depth information of the photographed object 805 according to the change of the stripes. The CPU processor can also calculate the reference distance between the photographed object 805 and the lens module according to the time difference between the first detection fringe reflection signal and the second detection fringe reflection signal received by the image sensor 803 .

In the embodiment of the present application, the screen glass cover 804 is a curved screen glass cover, and the above-mentioned lens module is disposed under the curved screen glass cover. Correspondingly, the terminal may be a curved screen terminal.

It can be understood that, if the screen glass cover 804 in the terminal is a rolling screen glass cover or a folding screen glass cover, the image capturing method shown in this application can also be applied to the terminal of this type.

To sum up, in the lens module shown in the embodiment of the present application, the lens module can perform stripe light detection through symmetrically arranged stripe emitters and image sensors, and the stripe light detection scheme can be applied to the front of mobile phones. Calculate the surface information of the screen glass cover above the lens module, compensate and correct the aberration through the algorithm, and correct the original image obtained by shooting; the second is to detect and calculate the distance and depth information of the photographed object to achieve more accurate Facial recognition and focus.

It can be understood that, the foregoing method embodiments may be implemented independently or in combination, which are not limited in the embodiments of the present application.

The following is an apparatus embodiment of the present application. For details that are not described in detail in the apparatus embodiment, reference may be made to the corresponding records in the foregoing method embodiment, which will not be repeated herein.

FIG. 9 shows a schematic structural diagram of an image capturing apparatus provided by an exemplary embodiment of the present application. The device can be implemented as all or a part of the terminal through software, hardware or a combination of the two, and the device includes: a face shape information acquisition module 901, an image correction module 902 and an image output module 903;

The surface type information acquisition module 901 is used to acquire the surface type information of the screen glass cover;

The image correction module 902 is configured to perform image correction on the original image captured by the lens module based on the face shape information of the screen glass cover;

The image output module 903 is configured to output the corrected image obtained after the original image is corrected.

In an optional embodiment, the image correction module 902 is configured to acquire depth information of the original image; based on the depth information, segment the original image into at least one image area; based on the screen glass The face shape information of the cover plate is used to perform image correction on the at least one image area; the image output module 903 is used for synthesizing the original image and the corrected at least one image area to obtain the corrected image ; output the corrected image.

In an optional embodiment, the image correction module 902 is used for the lens module to obtain the depth information of the original image based on the structured light detection technology; or, the image correction module 902 is used for all The lens module obtains the depth information of the original image based on the time-of-flight method of light.

In an optional embodiment, the image correction module 902 is used for the lens module to send a first detection fringe emission signal; the lens module receives a first detection fringe reflection signal, the first detection fringe The reflected signal is a signal formed by the reflection of the first detection fringe emission signal by the object to be photographed; the original image is acquired based on the change between the first detection fringe reflection signal and the first detection fringe emission signal depth information.

In an optional embodiment, the image correction module 902 is configured to perform deconvolution processing on the at least one image area by using the face shape information of the screen glass cover to perform image correction.

In an optional embodiment, the surface type information acquisition module 901 is used for the lens module to acquire the surface type information of the screen glass cover plate based on the structured light detection technology; or, the surface type information The obtaining module 901 is used for the lens module to obtain the surface shape information of the screen glass cover based on the time-of-flight method of light.

In an optional embodiment, the surface information acquisition module 901 is used for the lens module to send the second detection fringe emission signal; the lens module receives the second detection fringe reflection signal, the second detection fringe reflection signal, the second detection fringe reflection signal. The detection stripe reflection signal is a signal formed by the reflection of the second detection stripe emission signal by the screen glass cover; based on the change between the second detection stripe reflection signal and the second detection stripe emission signal, Obtain the surface shape information of the screen glass cover.

In an optional embodiment, the device further includes a focusing module; the focusing module is configured to obtain a reference distance, where the reference distance is the distance from the object to be photographed to the lens module; based on the Focusing on the lens module with reference to the distance; using the focus-adjusted lens module to capture an image to obtain the original image.

In an optional embodiment, the focusing module is used for the lens module to obtain the reference distance based on structured light detection technology; or, the focusing module is used for the lens module to obtain the reference distance based on The time-of-flight method is used to obtain the reference distance.

In an optional embodiment, the focusing module is used for the lens module to send a third detection fringe emission signal; the lens module receives a third detection fringe reflection signal, and the third detection fringe reflects The signal is a signal formed by the reflection of the third detection stripe emission signal by the object to be photographed; the reference distance is determined based on the first round-trip time; wherein, the first round-trip time is the transmission time of the lens module. The difference between the time point when the third detection stripe transmits the signal and the time point when the third detection stripe reflection signal is received.

In an optional embodiment, the focusing module is configured to, in response to obtaining the at least two reference distances, process the at least two reference distances based on an attention mechanism to obtain the target reference distance; According to the target reference distance, focus on the lens module.

FIG. 10 shows a structural block diagram of a terminal 1000 provided by an exemplary embodiment of the present application. The terminal 1000 may be a portable mobile terminal, such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, a moving picture expert compression standard audio layer 3), an MP4 (Moving Picture Experts Group Audio Layer IV, a dynamic image expert Video Expert Compresses Standard Audio Layer 4) Player, Laptop or Desktop. Terminal 1000 may also be called user equipment, portable terminal, laptop terminal, desktop terminal, and the like by other names.

In this embodiment of the present application, the terminal 1000 includes: a processor 1001 , a memory 1002 , a peripheral device interface 1003 and a lens module 1006 .

The processor 1001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1001 can use at least one hardware form among DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish. The processor 1001 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake-up state, also called CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor for processing data in a standby state. In some embodiments, the processor 1001 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 1001 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.

Memory 1002 may include one or more computer-readable storage media, which may be non-transitory. Memory 1002 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1002 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 1001 to realize the image capturing provided by the method embodiments in this application. method.

The peripheral device interface 1003 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1001 and the memory 1002 . In some embodiments, processor 1001, memory 1002, and peripherals interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one of processor 1001, memory 1002, and peripherals interface 1003 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The processor 1001, the memory 1002 and the peripheral device interface 1003 may be connected through a bus or a signal line. The lens module 1006 can be connected to the peripheral device interface 1003 through a bus, a signal line or a circuit board.

The lens module 1006 is used to capture images or videos. Optionally, the lens module 1006 includes: a camera, a detection signal transmitter and an image sensor that are symmetrically arranged with the optical axis of the camera as an axis of symmetry; the camera is used for image capturing; the detection signal transmitter is used for The image sensor is used to receive a detection reflection signal, and the detection reflection signal is a signal formed by the reflection of the detection transmission signal. The cameras include a front-facing camera and a rear-facing camera. Usually, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, the main camera It is integrated with the wide-angle camera to achieve panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions or other integrated shooting functions. In some embodiments, the lens module 1006 may also include a flash. The flash can be a single color temperature flash or a dual color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

In some embodiments, the terminal 1000 further includes other peripheral devices other than the lens module 1006 . Each peripheral device can be connected to the peripheral device interface 1003 through a bus, a signal line or a circuit board. Specifically, other peripheral devices include: at least one of a radio frequency circuit 1004 , a display screen 1005 , an audio circuit 1007 , a positioning component 1008 and a power supply 1009 .

The radio frequency circuit 1004 is used for receiving and transmitting RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 1004 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 1004 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 1004 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: World Wide Web, Metropolitan Area Network, Intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), wireless local area network and/or WiFi (Wireless Fidelity, Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1004 may further include a circuit related to NFC (Near Field Communication, short-range wireless communication), which is not limited in this application.

The display screen 1005 is used for displaying UI (User Interface, user interface). The UI can include graphics, text, icons, video, and any combination thereof. When the display screen 1005 is a touch display screen, the display screen 1005 also has the ability to acquire touch signals on or above the surface of the display screen 1005 . The touch signal can be input to the processor 1001 as a control signal for processing. At this time, the display screen 1005 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, there may be one display screen 1005, which is arranged on the front panel of the terminal 1000; in other embodiments, there may be at least two display screens 1005, which are respectively arranged on different surfaces of the terminal 1000 or in a folded design; In other embodiments, the display screen 1005 may be a flexible display screen, which is disposed on a curved surface or a folding surface of the terminal 1000 . Even, the display screen 1005 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 1005 can be prepared by using materials such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light emitting diode).

Audio circuitry 1007 may include a microphone and speakers. The microphone is used to collect the sound waves of the user and the environment, convert the sound waves into electrical signals, and input them to the processor 1001 for processing, or to the radio frequency circuit 1004 to realize voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively disposed in different parts of the terminal 1000 . The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 1001 or the radio frequency circuit 1004 into sound waves. The loudspeaker can be a traditional thin-film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for distance measurement and other purposes. In some embodiments, the audio circuit 1007 may also include a headphone jack.

The positioning component 1008 is used to locate the current geographic location of the terminal 1000 to implement navigation or LBS (Location Based Service). The positioning component 1008 may be a positioning component based on the GPS (Global Positioning System, Global Positioning System) of the United States, the Beidou system of China or the Galileo system of Russia.

The power supply 1009 is used to power various components in the terminal 1000 . The power source 1009 may be alternating current, direct current, disposable batteries or rechargeable batteries. When the power source 1009 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. Wired rechargeable batteries are batteries that are charged through wired lines, and wireless rechargeable batteries are batteries that are charged through wireless coils. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the terminal 1000 further includes one or more sensors 1010 . The one or more sensors 1010 include, but are not limited to, an acceleration sensor 1011 , a gyro sensor 1012 , a pressure sensor 1013 , a fingerprint sensor 1014 , an optical sensor 1015 and a proximity sensor 1016 .

The acceleration sensor 1011 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 1000 . For example, the acceleration sensor 1011 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 1001 can control the display screen 1005 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1011 . The acceleration sensor 1011 can also be used for game or user movement data collection.

The gyroscope sensor 1012 can detect the body direction and rotation angle of the terminal 1000 , and the gyroscope sensor 1012 can cooperate with the acceleration sensor 1011 to collect 3D actions of the user on the terminal 1000 . The processor 1001 can implement the following functions according to the data collected by the gyro sensor 1012: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 1013 may be disposed on the side frame of the terminal 1000 and/or the lower layer of the display screen 1005 . When the pressure sensor 1013 is disposed on the side frame of the terminal 1000, the user's holding signal of the terminal 1000 can be detected, and the processor 1001 performs left and right hand identification or shortcut operations according to the holding signal collected by the pressure sensor 1013. When the pressure sensor 1013 is disposed on the lower layer of the display screen 1005, the processor 1001 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 1005. The operability controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

The fingerprint sensor 1014 is used to collect the user's fingerprint, and the processor 1001 identifies the user's identity according to the fingerprint collected by the fingerprint sensor 1014, or the fingerprint sensor 1014 identifies the user's identity according to the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 1001 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 1014 may be disposed on the front, back or side of the terminal 1000 . When the terminal 1000 is provided with physical buttons or a manufacturer's logo, the fingerprint sensor 1014 may be integrated with the physical buttons or the manufacturer's logo.

The optical sensor 1015 is used to collect ambient light intensity. In one embodiment, the processor 1001 can control the display brightness of the display screen 1005 according to the ambient light intensity collected by the optical sensor 1015 . Specifically, when the ambient light intensity is high, the display brightness of the display screen 1005 is increased; when the ambient light intensity is low, the display brightness of the display screen 1005 is decreased. In another embodiment, the processor 1001 may also dynamically adjust the shooting parameters of the camera assembly 1006 according to the ambient light intensity collected by the optical sensor 1015 .

A proximity sensor 1016 , also called a distance sensor, is usually disposed on the front panel of the terminal 1000 . The proximity sensor 1016 is used to collect the distance between the user and the front of the terminal 1000 . In one embodiment, when the proximity sensor 1016 detects that the distance between the user and the front of the terminal 1000 gradually decreases, the processor 1001 controls the display screen 1005 to switch from the bright screen state to the off screen state; when the proximity sensor 1016 detects When the distance between the user and the front of the terminal 1000 gradually increases, the processor 1001 controls the display screen 1005 to switch from the screen-off state to the screen-on state.

Those skilled in the art can understand that the structure shown in FIG. 10 does not constitute a limitation on the terminal 1000, and may include more or less components than the one shown, or combine some components, or adopt different component arrangements.

The present application also provides a computer-readable storage medium, which stores at least one instruction, at least one piece of program, code set or instruction set, and the at least one instruction, at least one piece of program, code set or instruction set is loaded by a processor And execute the image capturing method provided by the above method embodiments.

The present application also provides a computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the image capturing method provided in the foregoing optional implementation manner.

It should be understood that references herein to "a plurality" means two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium can be read-only memory, magnetic disk or optical disk, etc.

The above are only optional embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application. Inside.

Claims (19)

1. An image capturing method, wherein, when applied to a terminal, the terminal includes a lens module disposed under a screen glass cover, and the method includes:

   obtaining the surface shape information of the screen glass cover;

   Perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover;

   A corrected image obtained after the original image is corrected is output.
2. The method according to claim 1, wherein the performing image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover plate comprises:

   obtain the depth information of the original image;

   dividing the original image into at least one image region based on the depth information;

   performing image correction on the at least one image area based on the surface shape information of the screen glass cover;

   The outputting the corrected image obtained after the original image is corrected, including:

   Combining the original image and the corrected at least one image region to obtain the corrected image;

   The corrected image is output.
3. The method according to claim 2, wherein the acquiring the depth information of the original image comprises:

   The lens module obtains the depth information of the original image based on the structured light detection technology;

   or,

   The lens module obtains the depth information of the original image based on the time-of-flight method of light.
4. The method according to claim 3, wherein the lens module obtains the depth information of the original image based on a structured light detection technology, comprising:

   the lens module sends a first detection stripe emission signal;

   The lens module receives a first detection fringe reflection signal, and the first detection fringe reflection signal is a signal formed by the first detection fringe emission signal reflected by the object to be photographed;

   The depth information of the original image is acquired based on the change between the reflection signal of the first detection fringe and the emission signal of the first detection fringe.
5. The method according to claim 2, wherein the performing image correction on the at least one image area based on the surface shape information of the screen glass cover plate comprises:

   Deconvolution processing is performed on the at least one image area to perform image correction using the surface shape information of the screen glass cover.
6. The method according to any one of claims 1 to 5, wherein the acquiring the surface shape information of the screen glass cover plate comprises:

   The lens module obtains the surface shape information of the screen glass cover plate based on the structured light detection technology;

   or,

   The lens module obtains the surface shape information of the screen glass cover plate based on the time-of-flight method of light.
7. The method according to claim 6, wherein the lens module obtains the surface shape information of the screen glass cover plate based on a structured light detection technology, comprising:

   The lens module sends a second detection stripe emission signal;

   The lens module receives a second detection fringe reflection signal, and the second detection fringe reflection signal is a signal formed by the reflection of the second detection fringe emission signal by the screen glass cover;

   Based on the change between the reflection signal of the second detection stripe and the emission signal of the second detection stripe, the surface shape information of the screen glass cover is acquired.
8. The method according to any one of claims 1 to 7, wherein the method further comprises:

   Obtain a reference distance, where the reference distance is the distance from the object to be photographed to the lens module;

   Focusing on the lens module based on the reference distance;

   The original image is obtained by using the lens module after focusing to capture an image.
9. The method according to claim 8, wherein the obtaining the reference distance comprises:

   The lens module obtains the reference distance based on the structured light detection technology;

   or,

   The lens module obtains the reference distance based on the time-of-flight method of light.
10. The method according to claim 9, wherein the lens module obtains the reference distance based on a structured light detection technology, comprising:

    The lens module sends a third detection stripe emission signal;

    The lens module receives a third detection fringe reflection signal, and the third detection fringe reflection signal is a signal formed by the reflection of the third detection fringe emission signal by the object to be photographed;

    determining the reference distance based on the first round trip time;

    The first round-trip time is a difference between a time point when the lens module transmits the third detection stripe emission signal and a time point when the third detection stripe reflection signal is received.
11. The method according to claim 8, wherein, based on the reference distance, adjusting the focus of the lens module comprises:

    In response to obtaining at least two of the reference distances, processing at least two of the reference distances based on an attention mechanism to obtain a target reference distance;

    Focusing on the lens module based on the target reference distance.
12. A terminal, wherein the terminal includes: a processor, a memory, and a lens module disposed under a screen glass cover;

    At least one instruction, at least one piece of program, code set or instruction set is stored in the memory, and the at least one instruction, the at least one piece of program, the code set or the instruction set is loaded and executed by the processor to achieve The image capturing method according to any one of claims 1 to 11.
13. The terminal of claim 12, wherein,

    The screen glass cover is a curved screen glass cover.
14. The terminal according to claim 12 or 13, wherein the lens module comprises: a camera, a detection signal transmitter and an image sensor symmetrically arranged with an optical axis of the camera as a symmetry axis;

    The camera is used for image capturing;

    The detection signal transmitter is used for transmitting a detection transmission signal;

    The image sensor is used for receiving a detection reflection signal, and the detection reflection signal is a signal formed by reflecting the detection emission signal.
15. The terminal of claim 14, wherein,

    The detection emission signals include detection fringe emission signals, and the detection reflection signals include detection fringe reflection signals.
16. An image capturing device, wherein the device comprises: a face shape information acquisition module, an image correction module and an image output module;

    The surface shape information acquisition module is used to obtain the surface shape information of the screen glass cover;

    The image correction module is used to perform image correction on the original image captured by the lens module based on the surface shape information of the screen glass cover;

    The image output module is configured to output the corrected image obtained after the original image is corrected.
17. A computer-readable storage medium, wherein the storage medium stores at least one instruction, at least one piece of program, code set or instruction set, the at least one instruction, the at least one piece of program, the code set or the instruction set Loaded and executed by the processor to realize the image capturing method according to any one of claims 1 to 11.
18. A chip, wherein the chip includes a programmable logic circuit and/or program instructions, which are used to implement the image capturing method according to any one of claims 1 to 11 when the chip runs.
19. A computer program product, wherein the computer program product includes computer instructions stored in a computer-readable storage medium from which a processor reads and executes the computer instructions to The image capturing method according to any one of claims 1 to 11 is realized.

Images