WO2023116307A1

WO2023116307A1 - Photographic terminal, photographing method and computer-readable storage medium

Info

Publication number: WO2023116307A1
Application number: PCT/CN2022/133238
Authority: WO
Inventors: 吴宏超
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-12-22
Filing date: 2022-11-21
Publication date: 2023-06-29
Also published as: CN116405759A

Abstract

Provided in the embodiments of the present disclosure are a photographic terminal, a photographing method and a computer-readable storage medium. At least two photographing regions are formed on a display screen, and the diameters of light-transmitting array apertures of the photographing regions are different. Each of the light-transmitting array apertures comprises several apertures, which are formed by the arrangement of circuits and pixel arrays in the display screen. A camera is provided under each photographing region. When the camera is arranged under each photographing region, the camera captures an image to form captured images corresponding to the photographing regions. Denoising and fusion are performed on the captured images corresponding to the photographing regions, so as to form a target image. In some implementations, the effects of improving the imaging quality of an image and improving the selfie experience of a user are achieved.

Description

Camera terminal, camera method, and computer-readable storage medium

Cross References to Related Applications

This disclosure is based on the Chinese patent application CN2021111576619.3 filed on December 22, 2021 with the title of "a camera terminal, camera method, and computer-readable storage medium", and claims the priority of this patent application, which is incorporated by reference The disclosed content is incorporated in this disclosure in its entirety.

technical field

Embodiments of the present disclosure relate to but are not limited to the field of terminals, and specifically, relate to but are not limited to a camera terminal, a camera method, and a computer-readable storage medium.

Background technique

With the rapid development of terminals, more and more terminals adopt full screens, and setting cameras under the screen has become a mainstream setting. However, in order to ensure that the corresponding areas can still be displayed normally, the display pixels (RGB pixel array) and the lines that drive the pixel display are What must be kept is that only the through-hole array between the pixel array and the circuit can pass light normally and shine on the camera, but the pixel array and the driving circuit block most of the light from the scene, and the light wave will be more or less when it encounters an obstacle. If it deviates from the law of straight line propagation in geometric optics, the light passing through the through-hole array will cause diffraction problems, resulting in bright spots or bright lines in the image received by the camera, and the image quality of the camera will be affected.

Contents of the invention

The embodiments of the present disclosure provide a camera terminal, a camera method, and a computer-readable storage medium, which solve the technical problem that the imaging quality is affected by light diffraction.

An embodiment of the present disclosure provides a camera terminal, including: a display screen and a camera; at least two camera areas are formed on the display screen, and the apertures of the light-transmitting array holes in each of the camera areas are different; the light-transmitting array holes include : a plurality of holes formed by the arrangement of lines and pixel arrays in the display screen; the camera is arranged under each of the imaging areas for photographing the light passing through the light-transmitting array holes of the imaging area.

An embodiment of the present disclosure also provides a camera method, which is applied to the above-mentioned camera terminal. The camera method includes: when the camera is set under each of the camera areas, the camera captures an image to form an image corresponding to each of the camera areas. Taking images: performing noise reduction fusion on the taken images corresponding to each of the shooting areas to form a target image.

An embodiment of the present disclosure also provides a computer storage medium, the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors, so as to realize the above-mentioned Steps of the imaging method.

Other features and corresponding beneficial effects of the present disclosure are explained in the following part of the description, and it should be understood that at least part of the beneficial effects become obvious from the description in the present disclosure.

Description of drawings

FIG. 1 is a cross-sectional view of an off-screen camera area in Example 1 of a camera terminal according to Embodiment 1 of the present disclosure;

2 is a cross-sectional view of an off-screen camera area in Example 2 of a camera terminal according to Embodiment 1 of the present disclosure;

FIG. 3 is a schematic diagram of a first camera area in Example 2 of a camera terminal according to Embodiment 1 of the present disclosure;

FIG. 4 is a schematic diagram of a second camera area in Example 2 of a camera terminal according to Embodiment 1 of the present disclosure;

5 is a cross-sectional view of an off-screen camera area in Example 3 of a camera terminal according to Embodiment 1 of the present disclosure;

FIG. 6 is a basic flowchart of an imaging method according to Embodiment 2 of the present disclosure;

FIG. 7 is a detailed flow chart of an imaging method according to Embodiment 3 of the present disclosure;

FIG. 8 is a detailed flow chart of an imaging method according to Embodiment 4 of the present disclosure;

Reference signs:

Display screen 1, first camera 2, second camera 3, first camera area 4, second camera area 5, slider 6, groove 7.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the embodiments of the present disclosure will be further described in detail below through specific implementation manners in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present disclosure, not to limit the present disclosure.

Embodiment one:

To solve the technical problem that imaging quality is affected by light diffraction, the present disclosure provides a camera terminal, and the camera terminal proposed in the present disclosure will be described below with reference to embodiments.

The camera terminal provided by this embodiment of the present disclosure includes: a display screen and a camera, at least two camera areas are formed on the display screen, and the apertures of the light-transmitting arrays in each camera area are different; the light-transmitting array holes include: lines and pixels in the display screen The arrangement of the array forms a number of wells. Wherein the camera is arranged under each imaging area for photographing the light passing through the light-transmitting array holes of the imaging area. Where the apertures of the light-transmitting arrays in each imaging region are different, the apertures of the light-transmitting array holes in each imaging region can be changed in at least one of the following ways: by adjusting voltage; by adjusting current; by mechanical adjustment. Among them, for the uniformity of the display, the light-emitting pixels and lines are evenly distributed at present, that is, the size and shape of the light-transmitting holes are consistent.

In some examples, at least two imaging areas are formed on the display screen, and the apertures of the light-transmitting array holes of each imaging area are different may include: forming at least two imaging areas on the display screen at different times, and each imaging area is located at the first preset Setting the position, the apertures of the light-transmitting array holes formed at different times at the first preset position on the display screen are different; setting the camera under each imaging area includes: fixedly setting the camera under the first preset position.

In some examples, forming at least two camera areas on the display screen may include: at least two preset positions on the display screen corresponding to at least two camera areas; fixedly arranged below at least two preset positions.

In some examples, the camera terminal can also include a sliding connection part, and the sliding connection part includes a slider and a groove. When at least two preset positions on the display screen correspond to at least two camera areas respectively, the camera is arranged under each camera area. It may include: a camera is arranged under any one of the at least two preset positions, the camera is fixedly connected with the slider, and the camera slides along the groove to the bottom of each camera area according to the preset control instruction. The path in which the grooves pass passes directly below each imaging area. Of course, in other examples, if there are more than 2 camera areas, such as three camera areas, setting the camera below each camera area may also include: a camera is set below any one of the three preset positions, and the camera and The slider is fixedly connected, and the camera slides along the groove to the bottom of another camera area according to preset control instructions. The path in which the grooves pass passes directly below the two camera areas. A camera can also be arranged separately under another camera area.

In the imaging terminal provided by the embodiments of the present disclosure, at least two imaging areas are formed on the display screen, and the apertures of the light-transmitting array holes in each imaging area are different; several holes. The camera is arranged under each imaging area for photographing the light passing through the light-transmitting array holes of the imaging area. It solves the technical problem that the imaging quality is affected by light diffraction, reduces the abnormal imaging caused by the diffraction phenomenon, and improves the imaging quality of the image.

For ease of understanding, this embodiment will exemplarily describe the camera terminal provided by this embodiment below with reference to the accompanying drawings.

Please refer to the example shown in FIG. 1. FIG. 1 is a cross-sectional view of an off-screen camera area of a camera terminal provided in Embodiment 1 of the present disclosure. The camera terminal includes a display screen 1, a first camera 2, a second camera 3, and a display screen 1 The upper two preset positions correspond to two camera areas, i.e. the first camera area 4 and the second camera area 5. The apertures of the light-transmitting array holes in the two camera areas are different; the light-transmitting array holes include: The arrangement of lines and pixel arrays forms several holes. The first camera 2 is arranged directly under the first imaging region 4 , and the second camera 3 is arranged directly under the second imaging region 5 .

Please refer to the example shown in FIG. 2. FIG. 2 is a cross-sectional view of the off-screen camera area of another camera terminal provided in Embodiment 1 of the present disclosure. Each of the two imaging areas is located at a first preset position, and the apertures of the light-transmitting array holes formed on the display screen at the first preset position at different times are different. The camera is fixedly arranged below the first preset position. Wherein the imaging areas of different apertures at the same position, at the first time, the aperture of the first imaging area 4 can be set as the first preset aperture, as shown in Figure 3, which is to enlarge the first imaging area In the schematic diagram, the black line area is the pixel array and circuit, and the white area is the light transmission hole. At the second time, the aperture of the second imaging area 5 can be set as a second preset aperture. As shown in Figure 4. The only difference between the first imaging area 4 and the second imaging area 5 is the size of the light-transmitting aperture, and the other designs are the same. The setting of the first time and the second time can be preset by a developer of the camera terminal or by a user. The first preset aperture and the second preset aperture can be set as required, and the apertures generally range from several microns to hundreds of microns (not exceeding 0.0001 meter).

Please refer to the example shown in FIG. 5 . FIG. 5 is a cross-sectional view of the off-screen camera area in Example 3 of the camera terminal provided in Embodiment 1 of this transmission. The camera terminal includes a display screen 1 , a first camera 2 , and a slider connecting part. Its sliding connection part comprises slide block 6 and groove 7, when three preset positions on the display screen respectively correspond to three camera areas, the first camera 2 is arranged below each camera area and can include: the first camera 2 is arranged on the first Below the preset position of the imaging area, the first camera 2 is fixedly connected to the slider 6, and the first camera 2 slides along the groove 7 to the bottom of each imaging area according to the preset control instruction. The path through which the groove passes passes right below each imaging area.

Embodiment two:

In order to solve the technical problem that the imaging quality is affected by light diffraction, the present disclosure also provides an imaging method. The imaging method proposed in the present disclosure will be described below in conjunction with embodiments.

Please refer to FIG. 6. FIG. 6 is a basic flowchart of the camera method in Embodiment 2 of the present disclosure. This method is applied to the camera terminal in Embodiment 1 above. The method includes:

S601. When the camera is set under each imaging area, the camera captures an image to form a captured image corresponding to each imaging area.

Since the apertures of the light-transmitting array holes in each imaging area are different, the distribution of diffraction spots is also different. The light intensity distribution of the diffracted light on the image plane can be expressed as:

Where k is a constant, a is the radius of the small hole, J1(x) is the first-order Bessel function, and θp is the corner radius.

S602. Perform noise reduction fusion on the captured images corresponding to the respective imaging areas to form a target image.

Wherein, in some examples, performing noise reduction fusion on the captured images corresponding to each imaging area to form the target image may include: comparing the captured images corresponding to each imaging area, determining the overlapped photo imaging range in each captured image, and combining the overlapping Each photo within the imaging range of the photo is denoised and fused to form the target image. Performing noise reduction fusion on each photo within the imaging range of the overlapping photos to form a target image may include: dividing each photo within the imaging range of the overlapping photos into several image units, and the division positions of each image unit of each photo are the same . Compare the image units at the same position in each photo, output the image unit with the smallest spot area or no spot, and fuse the output images to form the target image. Since pictures are taken under each imaging area under different apertures, the distribution of diffraction spots on the same image in the pictures of different imaging areas is different. By comparing multiple photos, the same image unit may have diffraction spots in some photos, and some photos have no spots but normal images. Select normal images to replace the spots, or replace some spots (only some of the spots were found). Normal image covered by light spots). All image units are processed in the same way, and a new photo with diffraction spot eliminated is synthesized.

In some other examples, performing noise reduction fusion on the captured images corresponding to each imaging area to form the target image may include: comparing the captured images corresponding to each imaging area to obtain overlapping photo areas and non-overlapping photo areas within the imaging range. Each photo area in the imaging range of the photo; the noise reduction fusion of each photo area in the overlapping photo imaging range to form a noise reduction fusion image; the non-overlapping photo imaging range of each photo area and the noise reduction fusion image are stitched to form target image. And the denoising and fusion of each photo area in the overlapping photo imaging range to form a noise reduction fusion image may include: dividing each photo in the overlapping photo imaging range into several image units respectively, and the segmentation of each image unit of each photo same location. Compare the image units at the same position in each photo, output the image unit with the smallest spot area or no spot, and fuse the output images to form a noise-reduced fusion image.

For example: you can first put photos taken through different display areas on the same image plane (the following two groups of photos taken through two display areas are taken as an example), and the definition of the same image plane is to zoom in or out on the subject Imaging planes with the same magnification. On the image plane, the imaging ranges of the two sets of photos may be completely overlapped or may have deviations. First determine the overlapping area of the two sets of photos, and perform fusion processing on the overlapping area. The image information outside the overlapping area does not need to be processed and directly stitched into the final photo or discarded Get rid of this part of the information. As for the image in the overlapping area of the two groups of photos, the image is divided into several minimum image units. The minimum number of image units can be determined according to the processing capability of the system, and the shape can be rectangular or other shapes. Generally, all image units can be stitched together to cover the overlapping area of two sets of photos. The distribution position and shape of the diffraction spots in the overlapping area of the two groups of photos are different, and the shape and size of the diffraction spots in the smallest image unit at the same position of the two groups of photos are different. Compare the two sets of images in the smallest image unit with the same position in the two groups of photos with the system’s stored spot images, and keep the image with the smallest spot area or no spot as the output image of the smallest image unit. Traverse all the smallest image units in the overlapping area, perform the same comparison process, stitch all the output images into a complete output photo of the overlapping area and save it.

In the imaging method provided by the embodiments of the present disclosure, when the camera is arranged under each imaging area, the camera captures an image to form an imaging image corresponding to each imaging area, and performs noise reduction and fusion on the imaging images corresponding to each imaging area to form a target image. It solves the technical problem that the imaging quality is affected by light diffraction, reduces the imaging abnormality caused by the diffraction phenomenon, improves the imaging quality of the image, and can improve the user's Selfie experience.

Embodiment three:

The imaging method of the present disclosure reduces imaging abnormalities caused by diffraction phenomena and improves the imaging quality of images. For ease of understanding, the imaging method of the present disclosure will be specifically described below in conjunction with an application scenario.

Please refer to FIG. 7. FIG. 7 is a detailed flow chart of the camera method in Embodiment 3 of the present disclosure. This method is applied to the camera terminal in Embodiment 1 above. The method includes:

S701. When the camera is set under each imaging area, the camera captures an image to form a captured image corresponding to each imaging area.

S702. Determine overlapping photo imaging ranges in each captured image according to the captured images corresponding to each captured image.

S703. Divide each photo within the imaging range of the overlapped photos into several image units.

S704. Compare the image units at the same position in each photo, output the image unit with the smallest spot area or no spot, and fuse the output images to form a target image.

In the imaging method provided by the embodiments of the present disclosure, when the camera is arranged under each imaging area, the camera captures an image to form an imaging image corresponding to each imaging area, and determines the overlapped photo imaging range of each imaging area according to the imaging image corresponding to each imaging area . Each photo within the overlapping photo imaging range is divided into several image units respectively. The image units at the same position in each photo are compared, the image unit with the smallest spot area or no spot is output, and the output images are fused to form the target image. It solves the technical problem that the imaging quality is affected by light diffraction, reduces the abnormal imaging caused by the diffraction phenomenon, and improves the imaging quality of the image.

Embodiment four:

Please refer to FIG. 8. FIG. 8 is a detailed flow chart of the camera method in Embodiment 4 of the present disclosure. This method is applied to the camera terminal in Embodiment 1 above. The method includes:

S801. When the camera is set under each imaging area, the camera captures an image to form a captured image corresponding to each imaging area.

S802. Comparing the captured images corresponding to the respective imaging areas, and obtaining each photo area within the overlapped photo imaging range and each photo area within the non-overlapping photo imaging range.

S803. Divide each photo within the overlapping photo imaging range into several image units.

S804. Comparing the image units at the same position in each photo, outputting the image unit with the smallest spot area or no spot, and fusing the output images to form a noise-reduced fusion image.

S805. Stitch each photo area in the non-overlapping photo imaging range with the noise reduction fusion image to form a target image.

In the imaging method provided by the embodiments of the present disclosure, when the camera is arranged under each imaging area, the camera captures an image to form an imaging image corresponding to each imaging area, and determines the overlapped photo imaging range of each imaging area according to the imaging image corresponding to each imaging area . Each photo within the overlapping photo imaging range is divided into several image units respectively. Compare the image units at the same position of each photo, output the image unit with the smallest spot area or no spot, fuse each output image to form a noise-reduction fusion image, and then combine the non-overlapping photo imaging range of each photo area with the noise-reduction fusion image Stitching is performed to form the target image. It solves the technical problem that the imaging quality is affected by light diffraction, reduces the imaging abnormality caused by the diffraction phenomenon, improves the imaging quality of the image, and obtains the off-screen camera pictures with more information and higher image quality.

Embodiment five:

The present embodiment also provides a computer-readable storage medium, including any method or technology for storing information, such as computer-readable instructions, data structures, computer program modules, or other data. volatile or nonvolatile, removable or non-removable media. Computer-readable storage media include but are not limited to RAM (Random Access Memory, random access memory), ROM (Read-Only Memory, read-only memory), EEPROM (Electrically Erasable Programmable read only memory, electrically erasable programmable read-only memory ), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory, compact disk read-only memory), digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tapes, magnetic disk storage or other magnetic storage devices, Or any other medium that can be used to store desired information and that can be accessed by a computer.

The computer-readable storage medium in this embodiment can be used to store one or more computer programs, and the one or more computer programs stored therein can be executed by a processor, so as to realize the imaging methods in the second to fourth embodiments above. at least one step.

It can be seen that those skilled in the art should understand that all or some of the steps in the methods disclosed above, the functional modules/units in the system and the device can be implemented as software (the computer program code executable by the computing device can be used to realize ), firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components. Components cooperate to execute. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit .

In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, computer program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery medium. Therefore, the present disclosure is not limited to any specific combination of hardware and software.

The above content is a further detailed description of the embodiments of the present disclosure in conjunction with specific implementation modes, and it cannot be assumed that the specific implementation of the present disclosure is limited to these descriptions. For those of ordinary skill in the technical field to which the present disclosure belongs, without departing from the concept of the present disclosure, some simple deductions or substitutions can be made, which should be deemed to belong to the protection scope of the present disclosure.

Claims

An imaging terminal, the imaging terminal comprising: a display screen and a camera; at least two imaging areas are formed on the display screen, and the apertures of the light-transmitting array holes in each of the imaging areas are different; the light-transmitting array holes include: A plurality of holes formed by the arrangement of lines and pixel arrays in the display screen;

The cameras are arranged under each of the imaging areas for photographing the light passing through the light-transmitting array holes of the imaging areas.
The imaging terminal according to claim 1, wherein at least two imaging areas are formed on the display screen, and the apertures of the light-transmitting array holes in each imaging area are different comprising: at least two imaging areas are formed at different times on the display screen. Each of the imaging areas is located at a first preset position, and the apertures of the light-transmitting array holes formed at different times at the first preset position on the display screen are different;

The arranging the cameras under each of the imaging areas includes: fixedly arranging the cameras under the first preset position.
The imaging terminal according to claim 1, wherein forming at least two imaging areas on the display screen comprises: at least two preset positions on the display screen respectively corresponding to at least two imaging areas;

The arrangement of the cameras under each of the imaging areas includes: at least two cameras are fixedly arranged under the at least two preset positions respectively.
The camera terminal according to claim 1, wherein the camera terminal further comprises a sliding connection part, and the sliding connection part comprises a slider and a groove;

At least two imaging areas are formed on the display screen, including: at least two preset positions on the display screen respectively correspond to at least two imaging areas;

The camera is arranged below each of the camera areas and includes:

One camera is arranged below any one of the at least two preset positions, the one camera is fixedly connected to the slider, and the one camera slides along the groove to each below the camera area.
The imaging terminal according to any one of claims 1-4, wherein the different apertures of the light transmission array holes in each of the imaging areas include: changing the light transmission arrays of each of the imaging areas in at least one of the following ways Hole diameter:

By adjusting the voltage;

By adjusting the current;

Adjusted mechanically.
A camera method, the camera method is applied to the camera terminal according to any one of claims 1-5, the camera method comprising:

When the camera is arranged below each of the imaging areas, the camera captures an image to form an image corresponding to each of the imaging areas;

The captured images corresponding to each of the captured areas are subjected to noise reduction fusion to form a target image.
The imaging method according to claim 6, wherein the denoising and fusion of the captured images corresponding to each of the imaging areas to form the target image comprises: comparing the captured images corresponding to each of the imaging areas to determine the The overlapped photo imaging range in the image; performing noise reduction fusion on each photo within the overlapped photo imaging range to form the target image.
The imaging method according to claim 7, wherein said denoising and fusing each photo within the imaging range of the overlapped photos to form the target image comprises: dividing each photo into several image units, so The segmentation positions of each image unit of each photo are the same;

The image units at the same position in each photo are compared, the image unit with the smallest spot area or no spot is output, and the output images are fused to form the target image.
The imaging method according to claim 6, wherein the denoising and fusion of the captured images corresponding to each of the imaging areas to form the target image comprises: comparing the captured images corresponding to each of the imaging areas to obtain the overlapped Each photo area within the photo imaging range and each photo area within the non-overlapping photo imaging range;

Noise reduction and fusion of each photo area within the overlapping photo imaging range to form a noise reduction fusion image;

Stitching each photo region of the non-overlapping photo imaging range with the noise reduction fusion image to form the target image.
A computer-readable storage medium, the computer-readable storage medium stores one or more computer programs, and the one or more computer programs can be executed by one or more processors, so as to realize claims 6 to 9 The steps of any one of the imaging methods.