WO2019223521A1

WO2019223521A1 - Imaging module, electronic device, image processing method and storage medium

Info

Publication number: WO2019223521A1
Application number: PCT/CN2019/085609
Authority: WO
Inventors: 张磊; 孙景阳; 杨乐
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-05-23
Filing date: 2019-05-06
Publication date: 2019-11-28

Abstract

Provided are an imaging module, an electronic device, an image processing method and a storage medium. The imaging module is arranged below a display screen of an electronic device, at a position that corresponds to a light-transmitting region of the display screen. The imaging module comprises: a concave lens, an imaging lens group and an image sensor. The concave lens is arranged at a position corresponding to the light-transmitting region of the display screen, and is used for diverging light passing through the light-transmitting region. The imaging lens group is arranged at a side of a light emergent face of the concave lens and is used for conducting optical transformation on the light diverged by the concave lens. The image sensor is arranged at a side of a light emergent face of the imaging lens group, and is used for collecting an imaged image according to light emitted from the imaging lens group. By means of the imaging module, a larger viewfinder coverage can be displayed in the same imaging region, effectively enhancing the photography experience of a user.

Description

Imaging module, electronic device, image processing method and storage medium

Cross-reference to related applications

This disclosure claims the priority of China Patent Application No. “201810500609.3” filed by OPPO Guangdong Mobile Communication Co., Ltd. on May 23, 2018, with the application name “Imaging Module, Electronic Equipment, Image Processing Method and Storage Medium”, And the priority of the Chinese patent application number "201820778482.7", filed on May 23, 2018, with the application name "Imaging Module and Electronic Equipment".

Technical field

The present disclosure relates to the technical field of mobile terminals, and in particular, to an imaging module, an electronic device, an image processing method, and a storage medium.

Background technique

At present, when designing a full-screen electronic device, a preset position of the display screen is hollowed out, or a preset position of the display screen is set to transmit light, and then the front camera is set below the preset position of the display screen, thereby The front camera can capture images through hollowed out positions or light-transmitting areas.

Public content

The present disclosure provides an imaging module, an electronic device, an image processing method, and a storage medium, so as to display a larger framing range in the same imaging area, which can effectively improve the user's photographing experience, and is used to solve the problems in the prior art. The technical problem that the front camera is set below the light-transmitting area of the display screen and the viewfinder range of the front camera is small.

An embodiment of one aspect of the present disclosure proposes an imaging module. The imaging module is disposed below a display screen of an electronic device and corresponds to a light-transmitting area of the display screen. The imaging module includes: a concave lens, and an imaging module. Lens group and image sensor;

The concave lens is disposed at a position corresponding to the light-transmitting area of the display screen, and is used to diffuse the light passing through the light-transmitting area;

The imaging lens group is disposed on one side of the light-emitting surface of the concave lens, and is used for optically transforming the light diffused by the concave lens;

The image sensor is disposed on one side of a light emitting surface of the imaging lens group, and is configured to collect an imaging image according to light emitted from the imaging lens group.

The imaging module in the embodiment of the present disclosure uses a concave lens at a position corresponding to the light-transmitting area of the display screen to diffuse the light transmitted through the light-transmitting area, and then uses an imaging lens group disposed on the light-emitting surface side of the concave lens to The divergent light is optically transformed, and then an image sensor is used to acquire an imaged image based on the light emitted from the imaging lens group by using an image sensor disposed on the light emitting surface side of the imaging lens group. In the present disclosure, by setting a concave lens at a position corresponding to the light-transmitting area of the display screen, a larger framing range can be displayed in the same imaging area, which can effectively improve the photographing experience of the user.

An embodiment of another aspect of the present disclosure provides an electronic device, where the electronic device includes a display screen and an imaging module;

The display screen includes a light-transmitting area and a non-light-transmitting area, wherein the light-transmitting area is provided with a concave lens for diverging light;

The imaging module is disposed on one side of the light-emitting surface of the concave lens, and is configured to perform imaging according to the light emitted by the concave lens.

The electronic device according to the embodiment of the present disclosure diffuses light by providing a concave lens in a light-transmitting area of a display screen of the electronic device, and then uses an imaging module on the light emitting surface side of the concave lens to perform imaging based on the light emitted by the concave lens. Therefore, a larger framing range can be displayed in the same imaging area, which can effectively improve the user's photographing experience.

An embodiment of another aspect of the present disclosure provides an image processing method, where the method includes:

Acquiring imaging images acquired by an image sensor;

Performing interpolation processing on the gray values of at least two adjacent pixels in the imaging image to obtain the gray values of the interpolated pixels;

Performing correction processing on the imaging image according to the gray value of the interpolation pixel point.

The image processing method according to the embodiment of the present disclosure includes acquiring an imaging image acquired by an image sensor; performing interpolation processing on gray values of at least two adjacent pixel points in the imaging image to obtain gray values of the interpolation pixel points; and according to the interpolation pixels The gray value of the point is used to correct the image. In the present disclosure, by inserting interpolation pixels between at least two adjacent pixels, correction of the compressed imaging image can be achieved, distortion of the imaging image can be reduced, and the imaging effect can be effectively improved, which can be beneficial to overall Development of display electronic equipment.

An embodiment of yet another aspect of the present disclosure provides another electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the processor implements the present invention. The image processing method proposed by the foregoing embodiment is disclosed.

An embodiment of still another aspect of the present disclosure provides a computer-readable storage medium on which a computer program is stored, which is characterized in that when the program is executed by a processor, the image processing method according to the foregoing embodiment of the present disclosure is implemented.

Additional aspects and advantages of the present disclosure will be given in part in the following description, and part of them will become apparent from the following description, or be learned through the practice of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to explain the technical solutions in the embodiments of the present disclosure more clearly, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present disclosure. Those of ordinary skill in the art can obtain other drawings based on these drawings without paying creative labor.

FIG. 1 is a schematic diagram of a light path when a conventional front camera collects an imaging image; FIG.

2 is a schematic structural diagram of an imaging module according to a first embodiment of the present disclosure;

3 is a schematic diagram of an optical path when an imaging module collects an imaging image in an embodiment of the present disclosure;

4 is a schematic structural diagram of an electronic device according to a second embodiment of the present disclosure;

5 is a schematic structural diagram of an electronic device according to a third embodiment of the present disclosure;

6 is a schematic flowchart of an image processing method according to a fourth embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a correspondence relationship between a gray value and brightness of a pixel in an embodiment of the present disclosure; FIG.

FIG. 8 is a schematic diagram of determining interpolation pixels in an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary and are intended to explain the present disclosure, and should not be construed as limiting the present disclosure.

For example, refer to FIG. 1, which is a schematic diagram of an optical path when a conventional front camera collects an imaging image. Among them, 11 indicates a non-transparent area of the display screen, and the front camera includes: an imaging lens group 12 and an image sensor 13. The imaging lens group 12 receives light from a light-transmitting area in the middle of the non-light-transmitting area 11 of the display screen, and emits the light to the image sensor 13 so that the image sensor 13 can collect an imaging image.

Among them, the image sensor 13 in FIG. 1 is a complementary metal oxide semiconductor device (Complementary Metal Oxide Semiconductor) (CMOS for short), and the CMOS collects an imaging image according to the light emitted from the imaging lens group 12.

As can be seen from Figure 1, when the front camera is set under the light-transmitting area of the display screen, when there are 10 image points in the framing screen, CMOS can only capture 4 image points, resulting in the framing screen not being fully displayed. The front-facing camera has a smaller viewing range.

The present disclosure is mainly directed to the technical problem that the front camera is set under the light-transmitting area of the display screen, which causes the viewfinder image to be incompletely displayed, that is, the front camera has a small viewfinder range, and proposes an imaging module.

In the embodiment of the present disclosure, a concave lens is provided at a position corresponding to the light transmitting area of the display screen to diffuse the light transmitted through the light transmitting area, and then the imaging lens group provided on the light emitting surface side of the concave lens is used to diffuse the concave lens. The light is optically transformed, and then an image sensor disposed on the light emitting surface side of the imaging lens group is used to acquire an imaging image according to the light emitted from the imaging lens group. In the present disclosure, by setting a concave lens at a position corresponding to the light-transmitting area of the display screen, a larger framing range can be displayed in the same imaging area, which can effectively improve the photographing experience of the user.

Hereinafter, an imaging module, an electronic device, an image processing method, and a storage medium according to embodiments of the present disclosure will be described with reference to the drawings.

FIG. 2 is a schematic structural diagram of an imaging module provided in Embodiment 1 of the present disclosure. The connection relationship between the concave lens 110, the imaging lens group 120, and the image sensor 130 in FIG. 2 represents a light transmission sequence, and light passes from the concave lens 110 to the imaging lens. The group 120 is incident on the image sensor 130 to form an image.

As shown in FIG. 2, the imaging module 100 is disposed below a display screen of an electronic device and corresponds to a transparent area of the display screen. The imaging module 100 includes a concave lens 110, an imaging lens group 120, and an image sensor 130. among them,

The concave lens 110 is disposed at a position corresponding to the light-transmitting area of the display screen, and is used to diffuse the light passing through the light-transmitting area.

In the embodiment of the present disclosure, in order to expand the framing range, a concave lens 110 may be provided at a position corresponding to the light-transmitting area of the display screen, so that the light passing through the light-transmitting area can be diffused by the concave lens 110.

As a possible implementation manner, in the present disclosure, the concave lens 110 may be a plano-concave lens, a light incident surface side of the concave lens 110 is a concave surface, and a light emitting surface side of the concave lens 120 is a flat surface.

As a possible implementation manner, the non-light-transmitting area of the display screen may be covered with a cover plate, and the light-transmitting area of the display screen may not be covered with the cover plate. Further, in order to ensure that the light path is clean, the edge of the concave lens 110 may be connected to the edge of the cover plate.

Optionally, in order to ensure the aesthetic appearance of the electronic device, the thickness of the concave lens 110 may match the thickness of the cover plate, and the upper edge of the concave lens 110 is flush with the upper edge of the cover plate.

As another possible implementation manner, both the light-transmitting area 220 and the non-light-transmitting area 210 of the display screen 200 may cover the cover plate, and the light incident side of the concave lens 110 is adhered to the surface of the cover plate, or the light output of the concave lens 110 is One side of the surface is in contact with the cover surface.

The imaging lens group 120 is disposed on the light-emitting surface side of the concave lens 110 and is used for optically transforming the light emitted by the concave lens 110.

In general, a single lens may not meet the requirements for correcting aberrations. Therefore, the imaging lens group 120 may be set to meet the imaging requirements and achieve the specified optical performance such as relative aperture and field of view. Specifically, in the embodiment of the present disclosure, the imaging lens group 120 may be disposed on the light emitting surface side of the concave lens 110 to perform optical conversion on the light emitted by the concave lens 110. Specifically, the optical conversion process here is mainly used for clear imaging at the image sensor 130, including focus adjustment, depth of field adjustment, and the like.

As a possible implementation manner, in order to reduce imaging distortion and ensure a good imaging effect, in the embodiment of the present disclosure, the optical axis of the concave lens 110 may be coaxial with the optical axis of the imaging lens group 120.

The image sensor 130 is disposed on a light emitting surface side of the imaging lens group 120, and is configured to collect an imaging image according to light emitted from the imaging lens group 120.

In the embodiment of the present disclosure, the image sensor 130 may be used to acquire images for imaging. The image sensor 130 may be a charge coupled device (CCD) or a CMOS, which is not limited.

Specifically, the image sensor 130 may be disposed on the light-emitting surface side of the imaging lens group 120, and the image sensor 130 acquires an imaging image according to light emitted from the imaging lens group 120.

As an example, refer to FIG. 3, which is a schematic diagram of an optical path when an imaging module collects an imaging image in an embodiment of the present disclosure. Among them, 210 represents a non-light-transmitting area of the display screen. It should be noted that FIG. 3 only uses the concave lens 110 as a plano-concave lens, and the image sensor 130 is a CMOS example.

The non-light-transmitting area 210 of the display screen is covered with a cover plate. In order to increase the light flux incident on the image sensor 130, the light-transmitting area of the display screen does not cover the cover plate, and the edge of the concave lens 110 may be connected to the edge of the cover plate. For the convenience of analysis and expression, FIG. 3 is only an example in which the edge of the concave lens 110 is not in contact with the edge of the cover plate.

It can be seen from FIG. 3 that when the concave lens 110 is provided on the electronic device, the concave lens 110 diffuses the light transmitted through the light-transmitting area, and can display 8 image points on 4 CMOS, that is, when set on the electronic device After the concave lens 110, a larger framing range can be displayed in the same imaging area.

The imaging module 100 according to the embodiment of the present disclosure provides a concave lens 110 at a position corresponding to a light-transmitting area of a display screen to diffuse light transmitted through the light-transmitting area, and then uses an imaging lens group provided on the light-emitting surface side of the concave lens 110 120. Optically transform the light diffused by the concave lens 110, and then use the image sensor 130 disposed on the light-emitting surface side of the imaging lens group 120 to acquire an imaging image according to the light emitted from the imaging lens group 120. In the present disclosure, by setting the concave lens 110 at a position corresponding to the light-transmitting area of the display screen, a larger framing range can be displayed in the same imaging area, which can effectively improve the photographing experience of the user.

In order to implement the above embodiments, the present disclosure also proposes an electronic device.

FIG. 4 is a schematic structural diagram of an electronic device according to a second embodiment of the present disclosure.

As shown in FIG. 4, the electronic device includes a display screen 200 and an imaging module 100. among them,

The display screen 200 includes a non-light-transmitting area 210 and a light-transmitting area 220. The light-transmitting area 220 is provided with a concave lens 110 for diverging light.

In the embodiment of the present disclosure, in order to expand the framing range, a concave lens 110 may be provided at a position corresponding to the light-transmitting area 220 of the display screen 200, so that the light passing through the light-transmitting area 220 can be diffused by the concave lens 110.

As a possible implementation manner, the non-light-transmitting area 210 of the display screen 200 may be covered with a cover plate, and the light-transmitting area 220 of the display screen 200 may not cover the cover plate. Further, in order to ensure that the light path is clean, the edge of the concave lens 110 may be connected to the edge of the cover plate.

In the embodiment of the present disclosure, only the non-light-transmitting area 210 of the display screen 200 is covered with the cover plate, and the light-transmitting area 220 is not covered with the cover plate, and the upper edge of the concave lens 110 is flush with the upper edge of the cover plate.

The imaging module 100 is disposed on one side of the light-emitting surface of the concave lens 110, and is configured to perform imaging according to the light emitted by the concave lens 110.

It should be noted that the explanation of the imaging module 100 in the embodiment of FIG. 2 is also applicable to the imaging module 100 in this embodiment, and details are not described herein again.

As a possible implementation manner, in order to reduce imaging distortion and thereby ensure a better imaging effect, in the embodiment of the present disclosure, the optical axis of the concave lens 110 may be coaxial with the optical axis of the imaging module 100.

In the electronic device according to the embodiment of the present disclosure, a concave lens 110 is provided on the light-transmitting area 220 of the display screen 200 of the electronic device to diffuse the light, and then the imaging module 100 on the light emitting surface side of the concave lens 110 is used to diffuse the light according to the concave lens 110. Light for imaging. Therefore, a larger framing range can be displayed in the same imaging area, which can effectively improve the user's photographing experience.

In the embodiment of the present disclosure, when the framing range is enlarged by setting the concave lens 110, a larger framing range will be displayed in the same imaging area, thereby causing the imaging image to be compressed. For example, referring to FIGS. 1 and 3, when the concave lens 110 is not provided on the electronic device, it can be known from FIG. 1 that 4 image points are displayed on 4 CMOS, and when the concave lens 110 is provided on the electronic device, the 8 image points are displayed on each CMOS, that is, after the concave lens 110 is set on the electronic device, a larger framing range can be displayed in the same imaging area, which results in the imaging image being compressed, which may cause the imaging image Distortion. Therefore, in the present disclosure, in order to correct the imaged image and reduce the distortion of the imaged image, thereby improving the imaging effect, referring to FIG. 5, the electronic device may further include a processor 300, wherein the imaging module 100 and the processor 300 Electrical connection.

The processor 300 is configured to obtain an imaging image from the imaging module 100, perform interpolation processing on at least two adjacent pixel points in the imaging image according to the gray values of the prime points of the at least two adjacent images, and obtain interpolation pixel points. The gray value of the image is corrected according to the gray value of the interpolation pixel. For the specific execution process, refer to the execution process of the image processing method in the subsequent embodiments, and details are not described herein.

The electronic device according to the embodiment of the present disclosure obtains an imaging image from an imaging module through a processor in the electronic device, and determines at least two adjacent pixel points in the imaging image according to the gray values of the prime points of the at least two adjacent images. Interpolation processing is performed to obtain the gray value of the interpolated pixel; according to the gray value of the interpolated pixel, the imaging image is corrected. In the present disclosure, by inserting interpolation pixel points between at least two adjacent pixel points, it is possible to correct the compressed imaged image, reduce distortion of the imaged image, and thereby improve the imaging effect.

In order to implement the above embodiments, the present disclosure also proposes an image processing method.

FIG. 6 is a schematic flowchart of an image processing method according to a fourth embodiment of the present disclosure.

As shown in FIG. 6, the image processing method may include the following steps:

Step 101: Acquire an imaging image collected by an image sensor.

In the embodiment of the present disclosure, the image sensor is a photosensitive element, such as a CCD or a CMOS, which is not limited.

Specifically, the image sensor may collect an imaging image according to the light emitted from the imaging lens group.

Step 102: Interpolate the gray values of at least two adjacent pixels in the imaging image to obtain the gray values of the interpolated pixels.

In the embodiment of the present disclosure, when the framing range is enlarged by setting a concave lens, a larger framing range will be displayed in the same imaging area, resulting in compression of the imaged image, which may cause distortion of the imaged image. Therefore, in the present disclosure, in order to correct the compressed image and reduce the distortion of the image, thereby improving the imaging effect, the gray values of at least two adjacent pixels in the image can be interpolated. Get the gray value of the interpolated pixel.

As a possible implementation manner, a mapping relationship between the gray value of at least two adjacent pixel points and the gray value of the interpolated pixel point may be established in advance, and at least two adjacent pixel points in the imaging image may be determined. When querying the grayscale value, the grayscale value of the interpolated pixel point corresponding to the grayscale value of at least two adjacent pixel points can be obtained by querying the above mapping relationship, and the operation is simple and easy to implement.

As another possible implementation manner, a grayscale value and a brightness value of a pixel have a non-linear relationship. For example, a correspondence between the grayscale value and the brightness value may be a gamma curve as shown in FIG. 7. The gray value of the interpolated pixel point can be determined according to the non-linear relationship between the gray value and the brightness value of the pixel point.

Specifically, a correspondence relationship between a gray value and a brightness value of a pixel can be established in advance. After determining a gray value of at least two adjacent pixels, a correspondence relationship between the gray value and the brightness value can be queried. To determine a brightness value corresponding to each pixel of at least two adjacent pixels. Then, the brightness value of the interpolated pixel point is determined according to the brightness value query of at least two adjacent pixel points. For example, the average value of the brightness value query of at least two adjacent pixel points may be calculated, and the average value may be used as Interpolate the brightness values of pixels. For example, see 8. When the gray values of two adjacent pixels are determined as A and B, according to the gamma curve, the brightness value corresponding to A can be determined as S ₁ , and B corresponds to luminance value S _2, the luminance value of the pixel is interpolated points may be _{_{(S 1 + S 2) /}} 2.

Alternatively, any brightness value between the brightness values queried by at least two adjacent pixel points may be used as the brightness value of the interpolated pixel point. For example, when the gray values of two adjacent pixels are determined as A and B, according to the corresponding relationship between the gray values of the pixels and the brightness value, the brightness value corresponding to A can be determined as S ₁ , The brightness value corresponding to B is S ₂ , then the brightness value of the interpolation pixel can be

Alternatively, the brightness value between the brightness values queried by at least two adjacent pixel points may be determined according to any other algorithm, which is not limited.

After the brightness value of the interpolation pixel is determined, the corresponding relationship between the gray value and the brightness can be queried according to the brightness value of the interpolation pixel to obtain the gray value of the interpolation pixel. For example, referring to FIG. 8, the gray value of the interpolation pixel point can be determined according to the gamma curve.

Step 103: Perform correction processing on the imaged image according to the gray value of the interpolation pixel point.

In the embodiment of the present disclosure, after determining the gray value of the interpolation pixel point, a correction process may be performed on the imaging image according to the gray value of the interpolation pixel point. Specifically, an interpolation pixel point may be inserted between at least two adjacent pixel points to obtain a corrected imaging image.

Taking the above example as an example, the gray value c corresponding to the interpolation pixel point can be inserted between a and b.

The image processing method of this embodiment obtains an imaging image collected by an image sensor; performs interpolation processing on the gray values of at least two adjacent pixels in the imaging image to obtain the gray values of the interpolation pixels; and according to the interpolation pixels The gray value of the image is corrected for the image. In the present disclosure, by inserting interpolation pixels between at least two adjacent pixels, correction of the compressed imaging image can be achieved, distortion of the imaging image can be reduced, and the imaging effect can be effectively improved, which can be beneficial to overall Development of display electronic equipment.

In order to implement the above embodiments, the present disclosure also proposes another electronic device.

As shown in FIG. 9, the electronic device includes: a memory 401, a processor 402, and a computer program stored on the memory 401 and executable on the processor 402. When the processor 402 executes the program, the implementation as proposed in the foregoing embodiment of the present disclosure Image processing method.

In order to implement the above embodiments, the present disclosure also proposes a computer-readable storage medium on which a computer program is stored, which is characterized in that when the program is executed by a processor, the image processing method as proposed in the foregoing embodiment of the present disclosure is implemented.

In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structure, material, or characteristic is included in at least one embodiment or example of the present disclosure. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.

In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "plurality" is at least two, for example, two, three, etc., unless it is specifically and specifically defined otherwise.

Any process or method description in a flowchart or otherwise described herein can be understood as representing a module, fragment, or portion of code that includes one or more executable instructions for implementing steps of a custom logic function or process And, the scope of the preferred embodiments of the present disclosure includes additional implementations in which the functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present disclosure belong.

The logic and / or steps represented in the flowchart or otherwise described herein, for example, a sequenced list of executable instructions that can be considered to implement a logical function, can be embodied in any computer-readable medium, For the instruction execution system, device, or device (such as a computer-based system, a system including a processor, or other system that can fetch and execute instructions from the instruction execution system, device, or device), or combine these instruction execution systems, devices, or devices Or equipment. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) with one or more wirings, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable Processing to obtain the program electronically and then store it in computer memory.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it may be implemented using any one or a combination of the following techniques known in the art: Discrete logic circuits with logic gates for implementing logic functions on data signals Logic circuits, ASICs with suitable combinational logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGAs), etc.

A person of ordinary skill in the art can understand that all or part of the steps carried by the methods in the foregoing embodiments may be implemented by a program instructing related hardware. The program may be stored in a computer-readable storage medium. The program is When executed, one or a combination of the steps of the method embodiment is included.

In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing module, or each unit may exist separately physically, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

The aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present disclosure. Those skilled in the art can understand the above within the scope of the present disclosure. Embodiments are subject to change, modification, substitution, and modification.

Claims

An imaging module, characterized in that the imaging module is disposed below a display screen of an electronic device and corresponds to a light-transmitting area of the display screen. The imaging module includes a concave lens, an imaging lens group, and an image. sensor;

The concave lens is disposed at a position corresponding to the light-transmitting area of the display screen, and is used to diffuse the light passing through the light-transmitting area;

The imaging lens group is disposed on one side of the light-emitting surface of the concave lens, and is used for optically transforming the light diffused by the concave lens;

The image sensor is disposed on one side of a light emitting surface of the imaging lens group, and is configured to collect an imaging image according to light emitted from the imaging lens group.
The imaging module according to claim 1, wherein:

A non-light-transmitting area of the display screen is covered with a cover plate, and the light-transmitting area of the display screen does not cover the cover plate;

An edge of the concave lens is in contact with an edge of the cover plate.
The imaging module according to claim 2, wherein:

The thickness of the concave lens matches the thickness of the cover plate;

The upper edge of the concave lens is flush with the upper edge of the cover plate.
The imaging module according to claim 1, wherein:

Both the transparent and non-transparent areas of the display screen cover the cover;

One side of the light-incident surface of the concave lens is bonded to the surface of the cover plate, or one side of the light-emitting surface of the concave lens is bonded to the surface of the cover plate.
The imaging module according to any one of claims 1-4, wherein:

The concave lens is a plano-concave lens;

The light incident surface side of the concave lens is a concave surface, and the light emitting surface side of the concave lens is a flat surface.
The imaging module according to any one of claims 1 to 5, wherein:

The optical axis of the concave lens is coaxial with the optical axis of the imaging lens group.
The imaging module according to any one of claims 1-6, wherein the optical transformation includes focus adjustment and / or depth of field adjustment.
An electronic device, characterized in that the electronic device includes a display screen and an imaging module;

The display screen includes a light-transmitting area and a non-light-transmitting area, wherein the light-transmitting area is provided with a concave lens for diverging light;

The imaging module is disposed on one side of the light-emitting surface of the concave lens, and is configured to perform imaging according to the light emitted by the concave lens.
The electronic device according to claim 8, wherein:

The light-transmitting area of the display screen does not cover the cover;

The non-light-transmitting area of the display screen covers the cover plate;

An edge of the concave lens is in contact with an edge of the cover plate.
The electronic device according to claim 9, wherein:

The thickness of the concave lens matches the thickness of the cover plate;

The upper edge of the concave lens is flush with the upper edge of the cover plate.
The electronic device according to claim 8, wherein:

Both the transparent and non-transparent areas of the display screen cover the cover;

One side of the light-incident surface of the concave lens is bonded to the surface of the cover plate, or one side of the light-emitting surface of the concave lens is bonded to the surface of the cover plate.
The electronic device according to any one of claims 8 to 11, wherein:

The concave lens is a plano-concave lens;

The light incident surface side of the concave lens is a concave surface, and the light emitting surface side of the concave lens is a flat surface.
The electronic device according to any one of claims 8 to 12, wherein:

The optical axis of the concave lens is coaxial with the optical axis of the imaging module.
The electronic device according to any one of claims 8 to 13, wherein:

The imaging module is electrically connected to the processor;

The processor is configured to obtain an imaging image from the imaging module, and perform interpolation on at least two adjacent pixel points in the imaging image according to a gray value of a prime point of the at least two adjacent images. Processing to obtain the gray value of the interpolation pixel point; and performing correction processing on the imaging image according to the gray value of the interpolation pixel point.
An image processing method, wherein the method includes:

Acquiring imaging images acquired by an image sensor;

Performing interpolation processing on the gray values of at least two adjacent pixels in the imaging image to obtain the gray values of the interpolated pixels;

Performing correction processing on the imaging image according to the gray value of the interpolation pixel point.
The image processing method according to claim 15, wherein the performing interpolation processing on the gray values of at least two adjacent pixel points in the imaging image to obtain the gray values of the interpolated pixel points comprises:

Querying the corresponding relationship between the gray value and the brightness according to the gray values of the at least two adjacent pixels to obtain the corresponding brightness value;

Determining the brightness value of the interpolated pixel point according to the brightness value queried by the at least two adjacent pixel points;

According to the brightness value of the interpolated pixel, query the correspondence between the gray value and the brightness to obtain the gray value of the interpolated pixel.
The image processing method according to claim 16, wherein determining the brightness value of the interpolated pixel based on the brightness value queried by the at least two adjacent pixel points comprises:

An average value is calculated for the brightness values queried for the at least two adjacent pixel points, and the average value is used as the brightness value of the interpolation pixel point.
The image processing method according to any one of claims 15 to 17, wherein the performing a correction process on the imaging image according to a gray value of the interpolation pixel point comprises:

Inserting the interpolation pixel point between the at least two adjacent pixel points to obtain a corrected imaging image.
An electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the program, the method according to any one of claims 15 to 18 is implemented. An image processing method.
A computer-readable storage medium having stored thereon a computer program, characterized in that when the program is executed by a processor, the image processing method according to any one of claims 15-18 is implemented.