CN115379078A

CN115379078A - Under-screen camera shooting structure, image shooting method and device, terminal and storage medium

Info

Publication number: CN115379078A
Application number: CN202110559188.3A
Authority: CN
Inventors: 陈朝喜
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2021-05-21
Filing date: 2021-05-21
Publication date: 2022-11-22

Abstract

The disclosure relates to an off-screen camera structure, an image shooting method, an image shooting device, a terminal and a storage medium. The structure of making a video recording under the screen includes the display screen subassembly and the subassembly of making a video recording, the subassembly of making a video recording is located the below of display screen subassembly, the regional optical micropore that is provided with corresponding to between the pixel on the region of making a video recording of display screen subassembly, wherein, the region of making a video recording is for the region that corresponds the subassembly of making a video recording on the display screen subassembly, the display screen subassembly includes luminescent layer and bottom basic layer, the bottom basic layer is located between luminescent layer and the subassembly of making a video recording, the optical micropore sets up at the bottom basic layer. In this structure of making a video recording under screen, can ensure to make a video recording the subassembly and respond to external light well, can not influence the regional demonstration function of making a video recording again, can realize the full-screen display of real meaning, ensured the integrality of display screen subassembly, promoted user's use and experienced.

Description

Under-screen camera shooting structure, image shooting method and device, terminal and storage medium

Technical Field

The present disclosure relates to the field of terminal technologies, and in particular, to an off-screen camera structure, an image capturing method and apparatus, a terminal, and a storage medium.

Background

The display screens of the existing mobile phones and other terminals comprise a water drop screen, liu Haibing, a folding screen and the like, but the display screens are not comprehensive screens in a real sense, and an area for realizing an image shooting function is still arranged in the display screen of the terminal, and holes are generally formed in the area so as to realize the image shooting function of a camera under the screen.

However, since the area has openings, it cannot be generally used for displaying a screen, that is, the area cannot be used as a display screen.

Disclosure of Invention

To overcome the problems in the related art, the present disclosure provides an off-screen camera structure, an image capturing method, an apparatus, a terminal, and a storage medium.

According to a first aspect of the embodiments of the present disclosure, there is provided an under-screen camera structure applied to a terminal, the under-screen camera structure includes a display screen component and a camera component, the camera component is located below the display screen component, an area on a camera area of the display screen component corresponding to an area between pixel points is provided with optical micro-holes,

the camera shooting area is the area corresponding to the camera shooting assembly on the display screen assembly, the display screen assembly comprises a light emitting layer and a bottom base layer, the bottom base layer is located between the light emitting layer and the camera shooting assembly, and the optical micropores are arranged on the bottom base layer.

Optionally, the display screen assembly comprises a top light-transmitting layer, the light-transmitting intensity of the first region of the top light-transmitting layer is greater than the light-transmitting intensity of the second region,

the first region is a region corresponding to the optical micropore, and the second region is a region outside the first region in the top light-transmitting layer.

Optionally, the thickness of the first region is less than the thickness of the second region.

Optionally, the top light transmitting layer comprises a plurality of structural layers,

in the top light-transmitting layer, the number of layers of the structural layer in the first region is smaller than that of the structural layer in the second region, and/or the thickness of at least part of the structural layer in the first region is smaller than that of at least part of the structural layer in the second region.

Optionally, the camera assembly includes a photosensitive element, and the photosensitive element is disposed corresponding to the optical micro-hole.

Optionally, a black coating layer is disposed on the bottom base layer at a position corresponding to the imaging region.

Optionally, the under-screen image pickup structure includes a first driving chip and a second driving chip, and the display screen assembly further includes a non-image pickup region except for the image pickup region, wherein the first driving chip is electrically connected to a driving circuit of the image pickup region, and the second driving chip is electrically connected to a driving circuit of the non-image pickup region;

the under-screen camera structure is configured such that, in a process of image capture by the camera assembly, a refresh rate of the first driver chip is less than a refresh rate of the second driver chip.

Optionally, the display screen assembly further includes a non-image-pickup region other than the image-pickup region, and in the display screen assembly, the density of the pixels in the image-pickup region is greater than the density of the pixels in the non-image-pickup region.

According to a second aspect of the embodiments of the present disclosure, a terminal is provided, where the terminal includes the under-screen camera structure according to the first aspect, and a display screen component of the under-screen camera structure constitutes a full-screen of the terminal.

According to a third aspect of the embodiments of the present disclosure, there is provided an image capturing method applied to a terminal, where the terminal includes the under-screen image capturing structure according to the first aspect, the method including:

collecting multi-frame image frames through a camera assembly of the under-screen camera structure, wherein when each frame of image frame is collected, a camera area of a display screen assembly of the under-screen camera structure is controlled to display black;

receiving the multi-frame image frames collected by the camera assembly;

and processing the multi-frame image frame to determine a target image.

Optionally, the controlling the image pickup area of the display screen assembly of the under-screen image pickup structure to display black includes:

and sending black non-luminous frames or blank frames to a first driving chip corresponding to the camera shooting area of the display screen assembly.

Optionally, the display screen assembly further includes a non-image pickup area except for the image pickup area, and the controlling the image pickup area of the display screen assembly of the under-screen image pickup structure to display black includes:

and controlling the refresh rate of the image pickup area to be smaller than that of the non-image pickup area.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an image capturing apparatus applied to a terminal including the under-screen image capturing structure according to the first aspect, the apparatus including:

the control module is used for collecting a plurality of frames of image frames through the camera assembly of the under-screen camera structure, wherein when each frame of image frame is collected, the control module controls the camera area of the display screen assembly of the under-screen camera structure to display black;

the receiving module is used for receiving the multi-frame image frames acquired by the camera shooting assembly;

and the processing module is used for processing the multi-frame image frames to determine a target image.

According to a fifth aspect of embodiments of the present application, there is provided a terminal, including:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to perform the method according to the third aspect.

According to a sixth aspect of embodiments herein, there is provided a non-transitory computer readable storage medium having instructions which, when executed by a processor of a terminal, enable the terminal to perform the method according to the third aspect.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: in this structure of making a video recording under screen, the subassembly of making a video recording is located the below of display screen subassembly. And set up the optics micropore at the regional of making a video recording of display screen subassembly, optics micropore is located the regional between the pixel on the region of making a video recording, from this, can ensure that the subassembly of making a video recording responds to external light well, can not influence the regional display function of making a video recording again, has realized the full screen display of true meaning, has ensured the integrality of display screen subassembly. Promptly, this structure of making a video recording under screen can ensure good image capture effect, can realize full-screen display again, has promoted user's use and has experienced.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Fig. 1 is a schematic cross-sectional arrangement of an under-screen camera structure shown according to an exemplary embodiment.

Fig. 2 is a schematic plan layout of an off-screen camera structure according to an exemplary embodiment.

Fig. 3 is a schematic diagram illustrating the structure of an off-screen camera structure according to an exemplary embodiment.

FIG. 4 is a schematic illustration of a display area of a display screen assembly shown in accordance with an exemplary embodiment.

Fig. 5 is a flowchart illustrating an image capturing method according to an exemplary embodiment.

Fig. 6 is a block diagram illustrating an image capturing apparatus according to an exemplary embodiment.

Fig. 7 is a block diagram of a terminal shown in accordance with an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

In addition, in the present disclosure, in the use state of the terminal, a side of the display panel assembly where the user views the display screen is referred to as an outer side or an upper side, and a side of the display panel assembly away from the outer side or the upper side is referred to as an inner side or a lower side.

The utility model provides a structure of making a video recording under screen is applied to the terminal. In this structure of making a video recording under screen, the subassembly of making a video recording is located the below of display screen subassembly. And, set up the optics micropore at the regional of making a video recording of display screen subassembly, optics micropore is located the regional between the corresponding pixel on the region of making a video recording, from this, can ensure to make a video recording the subassembly and respond to external light well, can not influence the regional display function of making a video recording again, has realized the full screen display of real meaning, has ensured the integrality of display screen subassembly. Namely, the under-screen camera shooting structure can ensure good image shooting effect, can realize full-screen display, and improves the use experience of users.

In one exemplary embodiment, an off-screen camera structure is provided for use in a terminal. Referring to fig. 1 to 4, the under-screen camera structure includes a display screen assembly 1 and a camera assembly 2, and the camera assembly 2 is located below the display screen assembly 1, that is, the camera assembly 2 is located inside the terminal, that is, the camera assembly 2 is located on a side of the display screen assembly 1 facing the inside of the terminal. The image pickup region 1a of the display screen assembly 1 is provided with optical micro-holes 14 corresponding to regions between the pixel points.

The image pickup area 1a is an area on the display screen assembly 1 corresponding to the image pickup assembly 2, that is, the image pickup assembly 2 forms the image pickup area 1a in a projection area of the display screen assembly 1. The imaging module 2 can complete the image capturing through the imaging area 1a. Display screen subassembly 1 includes luminescent layer 12 and bottom basic unit 13, bottom basic unit 13 is located luminescent layer 12 and camera subassembly 2 between, optics micropore 14 sets up at bottom basic unit 13, bottom basic unit 13 can include TFT (Thin Film Transistor) layer and base plate etc. the base plate mainly provides the supporting role to whole display screen subassembly 1, optics micropore 14 can set up on the TFT layer, also can set up on the base plate, still can set up in other structural layers in bottom basic unit 13. This structure of making a video recording under screen can ensure to make a video recording subassembly 2 and can respond to external light well, can avoid display screen subassembly 1's luminescent layer 12 to suffer destruction again, ensures that display screen subassembly 1 has good display effect.

In addition, the optical micro-holes 14 may be through holes of micrometer scale or smaller unit scale, i.e. the optical micro-holes 14 are through holes invisible to the naked eye, and the display screen assembly 1 still appears intact. In addition, the optical micro-holes 14 are arranged in the regions between the pixel points, so that the display screen assembly 1 cannot be influenced to display the content, namely, the whole screen can display the picture when the display screen assembly 1 is in a normal use state, the completeness of screen display is ensured, and the real comprehensive screen is realized.

It should be noted that the display panel assembly 1 may be an OLED (Organic Light-Emitting Diode) display panel, which generally includes three large layers, namely, a top transparent layer 11, a Light-Emitting layer 12 and a bottom base layer 13, wherein the display panel assembly 1 realizes display of a picture through the Light-Emitting layer 12. The light emitting layer 12 may generally include a cathode layer, an electron injection layer, an electron transport layer, an organic light emitting layer 12, a hole transport layer, a hole injection layer, an anode layer, and the like, and the above layers are sequentially arranged from near the top light transmitting layer 11 to near the bottom base layer 13.

The light emitting layer 12 forms a plurality of pixel points, the optical micro-holes 14 are located in the image pickup region 1a corresponding to the region between the pixel points, and the optical micro-holes 14 are not formed in the light emitting layer 12, and the optical micro-holes 14 are located in the lower layer of the light emitting layer 12, that is, the optical micro-holes 14 are located in the bottom base layer 13, so as to ensure the normal use of the whole light emitting layer 12.

In this under-screen image pickup structure, the image pickup unit 2 is located on the lower side of the display screen unit 1, and the optical microhole 14 is provided in the image pickup area 1a of the display screen unit 1. When shooting images, the optical micropores 14 sense external light to complete image shooting and realize the function of camera shooting under the screen.

In one exemplary embodiment, an off-screen camera structure is provided for use in a terminal. In the under-screen camera structure, the camera assembly 2 may include a photosensitive element 21, and the photosensitive element 21 and the optical micro-hole 14 may be disposed correspondingly. The correspondence setting here includes correspondence of position and correspondence of number.

For example, the light sensing element 21 may include a Photo Diode (PD), and each photo diode PD (PD) is disposed at a position corresponding to each optical micropore 14, so as to increase the sensing range of the light sensing element 21 and increase the viewing angle of the camera module 2, as shown in fig. 1, in the thickness direction of the display screen module 1, the closer the light sensing element 21 is disposed to the optical micropore 14, the larger the sensing range is, the less the attenuation of the light flux is, and the larger the viewing angle of the camera module 2 is. The camera module 2 senses external light through the photosensitive element 21 to complete image shooting.

This structure of making a video recording under screen can ensure good image shooting effect, can realize full-screen display again, has promoted user's use and has experienced.

In one exemplary embodiment, an off-screen camera structure is provided for use in a terminal. Referring to fig. 1-4, in the under-screen camera structure, the display screen assembly 1 may further include a top transparent layer 11, where the top transparent layer 11 is located on a side of the light-emitting layer 12 away from the bottom base layer 13, that is, the light-emitting layer 12 is located between the top transparent layer 11 and the bottom base layer 13.

The light transmission intensity of the first region 11a of the top light-transmitting layer 11 is greater than the light transmission intensity of the second region 11b, the first region 11a is a region corresponding to the optical microhole 14, and the second region 11b is a region of the light-transmitting layer other than the first region 11 a.

That is, the light transmission intensity of the region corresponding to the vertical projection of the optical micropore 14 on the light transmission layer is large, and the light transmission is good, so that the camera shooting assembly 2 can sense external light through the optical micropore 14, and the shooting effect is improved.

The top transparent layer 11 includes a plurality of structural layers. In the top light-transmitting layer 11, the number of layers of the structural layer of the first region 11a is smaller than that of the structural layer of the second region 11b, and/or the thickness of at least part of the structural layer of the first region 11a is smaller than that of at least part of the structural layer of the second region 11 b.

Illustratively, the top light-transmitting layer 11 may include a protective layer, which may be a glass plate, and a touch layer. In the under-screen image pickup structure, the light transmission intensity of the first region 11a can be greater than that of the second region 11b by reducing the thickness of at least part of the structural layer in the top light-transmitting layer 11 of the first region 11a and/or removing at least part of the structural layer in the top light-transmitting layer 11 of the first region 11 a.

For example, in the under-screen image capture structure, the thickness of the protective layer in the first region 11a is smaller than that of the second region 11b, so that the light transmission intensity of the first region 11a of the display screen assembly 1 is greater than that of the second region 11 b.

For another example, in the under-screen image capturing structure, the optical micro-holes 14 are also disposed at positions of the protective layer corresponding to the optical micro-holes 14, that is, the structure of the protective layer corresponding to the first region 11a is removed, so that the light transmission intensity of the first region 11a of the display screen assembly 1 is greater than the light transmission intensity of the second region 11 b.

For another example, in the under-screen image capture structure, the optical micro-holes 14 are also disposed at positions of the protective layer corresponding to the optical micro-holes 14, and the thickness of the touch layer in the first area 11a is smaller than that in the second area 11b, so that the light transmission intensity of the first area 11a of the display screen assembly 1 is greater than that of the second area 11 b.

In this structure of making a video recording under screen, the printing opacity intensity of the first region 11a of display screen subassembly 1 is greater than the printing opacity intensity of the second region 11b to make subassembly 2 of making a video recording can better respond to external light, realize better image shooting effect.

In addition, it should be noted that, in the structure of making a video recording under this screen, camera assembly 2 can include infrared camera and RGB camera, and infrared camera includes infrared sensor and constitutes, and RGB camera includes RGB sensor (also called the color sensor) and constitutes, gathers the distance information of shooing the target through infrared camera, accomplishes the processing of multiframe image according to distance information to this improves final image effect.

In one exemplary embodiment, an off-screen camera structure is provided for use in a terminal. Referring to fig. 1-4, in the under-screen camera structure, a black coating (not shown in the figure) is disposed on the bottom base layer 13 corresponding to the camera area 1a to reduce the influence of light emitted by the display screen assembly 1 on the imaging effect of the camera assembly 2, and further improve the image capturing effect of the camera assembly 2.

It should be noted that, the length-width ratio of the display screen assembly 1 of a general terminal is 16 or 17, and the camera assembly 2 is generally located at the top of the terminal, that is, at one end in the length direction of the display screen assembly 1, so that the black coating layer is disposed at the position corresponding to the camera area 1a, which has little influence on the display effect of the display screen assembly 1 and is generally not noticed by the user.

It should be noted that, the positions in the bottom base layer 13 corresponding to the optical micro-holes 14 may not be blackened, so as to better ensure that the light-sensing element 21 detects external light, and improve the image capturing effect of the image capturing assembly 2.

This structure of making a video recording under screen can compromise the display effect of display screen subassembly 1 and the image shooting effect of subassembly 2 of making a video recording, can guarantee better image shooting effect, can guarantee certain display effect again, has promoted user and has used experience.

In one exemplary embodiment, an off-screen camera structure is provided for use in a terminal. The structure of taking a picture under this screen still includes first driver chip (not shown in the figure) and second driver chip (not shown in the figure), refer to fig. 1-4, the display screen assembly 1 still includes the area 1b of taking a picture, the area 1b of taking a picture refers to the area except area 1a of taking a picture in the display screen assembly 1, namely, area 1a and area 1b of taking a picture constitute the complete display area of the display screen assembly 1.

The display screen assembly 1 further comprises two driving circuits, which are respectively marked as a first driving circuit and a second driving circuit, wherein the first driving circuit is located in the image pickup area 1a and is used for driving the display of the image pickup area 1 a; the second drive circuit is located in the non-imaging region 1b and drives display in the non-imaging region 1 b.

The first driver chip is electrically connected to a driver circuit (i.e., a first driver circuit) in the imaging region 1a, and the second driver chip is electrically connected to a driver circuit (i.e., a second driver circuit) in the non-imaging region 1 b.

The under-screen camera structure may be configured such that, during image capture by the camera assembly 2, the refresh rate of the first driver chip is less than the refresh rate of the second driver chip. That is, at the time of image capturing, the refresh rate of the image capturing area 1a is smaller than that of the non-image capturing area 1 b.

In this structure of making a video recording under screen, when using subassembly 2 of making a video recording to carry out image shooting, the demonstration of the regional 1a of making a video recording of first driver chip drive is synchronous with the demonstration of the regional 1b of making a video recording of second driver chip drive, and the refresh rate of first driver chip is less than the refresh rate of second driver chip, so, alright make the regional 1a of making a video recording have certain non-to show for a long time, also there is certain black screen to show for a long time exactly, carry out the shooting of image in this time, in order to avoid display screen subassembly 1 to send out the influence of light to the shooting effect, further promote the image shooting effect. Moreover, since the non-display duration is generally very short, the display area of the camera area 1a is relatively small compared with the display area of the whole display screen assembly 1, so that the user cannot perceive the transient display difference, and a good display effect can be ensured.

In one exemplary embodiment, an off-screen camera structure is provided for use in a terminal. Referring to fig. 1 to 4, in the under-screen image capture structure, the density of pixels in the image capture region 1a is greater than the density of pixels in the non-image capture region 1 b.

Assuming that the density of the pixels in the image pickup region 1a is the same as the density of the pixels in the non-image pickup region 1b, after the image pickup region 1a is provided with the optical microholes 14, the light transmission amount of the image pickup region 1a increases, and the light emitting area of the corresponding region of each pixel needs to be reduced, so that the image pickup region 1a and the non-image pickup region 1b have an obvious display difference. Therefore, in the present application, the density of the pixels in the image pickup region 1a needs to be reduced, so that the light emitting area corresponding to each pixel is reduced, and the light transmitting area of the optical micro-hole 14 can be ensured not to be reduced, thereby ensuring good display effect and good image shooting effect.

In this structure of making a video recording under screen, the pixel density of the region of making a video recording 1a is greater than the pixel density of the region of making a video recording 1b, can guarantee good display effect, avoids making a video recording regional 1a and the region of making a video recording 1b shows obvious difference, can guarantee good image shooting effect again, satisfies user's shooting demand.

In one exemplary embodiment, a terminal is also provided. The terminal can be a mobile phone, a tablet computer, a notebook computer, a camera and other equipment with display and camera shooting functions. The terminal comprises the screen lower camera shooting structure, and a display screen assembly of the screen lower camera shooting structure forms a comprehensive screen of the terminal.

This terminal is through setting up foretell structure of making a video recording under the screen, can guarantee good image shooting effect, can ensure normally display effect again, realizes the most genuine screen, promotes user's use and experiences.

In one exemplary embodiment, an image photographing method is provided, which is applied to the above-described terminal. Referring to fig. 5, the method includes:

s110, collecting multi-frame image frames through a camera assembly of the under-screen camera structure, wherein when each frame of image frame is collected, a camera area of a display screen assembly of the under-screen camera structure is controlled to display black;

s120, receiving a plurality of frames of image frames collected by the camera assembly;

and S130, processing the multi-frame image frame to determine a target image.

In step S110, a user may input a control command through the display screen assembly of the terminal, and after receiving the control command, the processor of the terminal may start the camera assembly to capture an image of the shooting target.

Of course, the user can also physically press keys to output a control instruction to the terminal, and the terminal can start the camera shooting assembly to collect the image of the shooting target after receiving the control instruction.

It should be noted that, the image capturing module may be controlled to capture an image, and may also be implemented in other manners, which is not described herein.

In the step, when each frame of image is shot, the shooting area of the display screen component of the under-screen shooting structure is controlled to display black, so that the influence of light emitted by the display screen component on image shooting is eliminated or reduced, the final imaging effect is further improved, and the use experience of a user is improved.

In step S120, after the image is captured by the camera module, the captured image may be directly and actively sent to the processor of the terminal, and the processor may receive the image. Of course, the processor may also send a request to the camera assembly to obtain an image, and the camera assembly sends the captured image to the processor in response to the request. And will not be described herein.

In step S130, the multi-frame images may be subjected to a synthesizing process to determine a target image, so as to better improve the signal-to-noise ratio of the target image.

For example, in each frame of image frame, the gray value corresponding to the position of the same pixel point is n, and m frames of image frames are synthesized into a target image, and the gray value corresponding to the position of the corresponding pixel point in the target image is n × m, so that the signal-to-noise ratio of the final target image can be improved, and the imaging effect can be improved.

In addition, before the target image is determined, the multi-frame image frames can be synthesized to obtain an original image, then any pixel point corresponding to the image pickup area in the original image is determined, then all pixel points in the preset range of the any pixel point are determined, and then the average value of the original gray values (namely the gray value of the original image) of all the pixel points is determined as the target gray value of the any pixel point. The target gray values of all pixel points corresponding to the image pickup area in the original image are determined through the method, then the original gray values of all pixel points of the image pickup area in the original image are replaced by the target gray values, and the replaced image is the target image, so that the final imaging effect is better improved.

The preset range may be a circular range, a rectangular range or a range with other shapes, for example, a range formed by drawing a circle with any one of the pixel points as a center and a preset number of pixel points as a radius is not described herein.

According to the method, when each frame of image is shot, the shooting area of the display screen assembly of the under-screen shooting structure is controlled to display black, so that the influence of light emitted by the display screen assembly on image shooting is eliminated or reduced, then the multi-frame image frames are processed to obtain a final target image, and the imaging effect is further improved.

In one exemplary embodiment, an image photographing method is provided, which is applied to the above-described terminal. This method is an improvement over step S110 in the above method.

The method for controlling the image pickup area of the display screen assembly of the under-screen image pickup structure to display black comprises at least one of the following two modes:

in the manner 1, the first and second embodiments are described,

and S111, sending a black non-luminous frame or a blank frame to a first driving chip corresponding to the image pickup area of the display screen assembly.

The terminal applied in the mode comprises an under-screen camera shooting structure provided with a first driving chip. The structure of making a video recording under this screen includes first driver chip and second driver chip, and the display area of display screen subassembly divide into the region of making a video recording and the region of making a video recording of non-, and wherein, first driver chip is used for driving the regional demonstration of making a video recording, and the second driver chip is used for driving the regional demonstration of making a video recording.

When the image is shot, the processor of the terminal can send black matte frames or blank frames to the first driving chip, and the first driving chip can drive the shooting area to display black, so that the influence of light emitted by the display screen assembly on the image shooting is eliminated or reduced.

The processor sends the frame rate of black matte frames or blank frames to the first driving chip, and the frame rate of the black matte frames or blank frames is the same as the frame rate of images shot by the shooting component, so that when the shooting component collects the images of a certain frame, the shooting area displays black; when the camera shooting assembly does not collect images, the camera shooting area is displayed normally as the non-camera shooting area so as to better ensure the display effect of the display screen assembly.

For example, if the frame rate of the image captured by the image capturing module is a (e.g., 85Hz (hertz)), the frame rate of the black non-emission frame or the blank frame sent by the processor to the first driver chip is also a.

When the display state of the imaging region is controlled, the processor first sends corresponding display data to the first driving chip, and the first driving chip controls the display of the imaging region through the driving circuit according to the display data. Therefore, there may be a certain delay time period from the transmission of the display data from the processor to the first driver chip to the display of the content corresponding to the display data in the image pickup region. In this scheme, according to the delay time length, an interval time length between a time when the camera shooting component shoots each frame of image and a time when the processor sends the display data to the first driving chip can be controlled, so that the interval time length is the same as the delay time length.

For example, the delay time is 0.01 second, the image pickup assembly picks up a first frame image in 0.02 second, the processor can be controlled to send a blank frame (or a black non-light-emitting frame) to the first driving chip in 0.01 second, so that the image pickup area displays black in 0.02 second, and the image pickup assembly is ensured to display black when picking up the first frame image frame, so as to better eliminate or weaken the influence of light emitted by the display assembly on the shooting.

In the manner 2, the first step is to perform the following operation,

s11-1, controlling the refresh rate of the image pickup area to be smaller than that of the non-image pickup area.

In the terminal applied in this mode, the display area of the display screen assembly may be composed of a camera area and a non-camera area.

The refresh rate is the rate of scanning a frame, and determines the synchronization of the display signals and the flickering of the screen. The refresh rate, also called frame rate, refers to the frequency (rate) at which bitmap images appear continuously on the display in units of frames.

In the method, when refreshing the content displayed in the image pickup area, a first waiting time length for not displaying any content exists between two adjacent frames, and the image pickup area displays black within the first waiting time length; when the content displayed in the non-image-pickup region is refreshed, a second waiting time length for not displaying any content exists between two adjacent frames. If the display synchronization of the image pickup area and the non-image pickup area is controlled during image pickup, and the frame rate of the image pickup area is smaller than that of the non-image pickup area, the first waiting time is longer than the second waiting time, the first waiting time and the second waiting time have certain difference duration, and image pickup is completed within the difference duration, so that the influence of light emitted by the display screen assembly on the image pickup effect is avoided, and the image pickup effect of the image pickup assembly is improved.

It should be noted that, generally, the time period required for capturing one frame of image is short, so setting the difference time period has little influence on the display effect of the image capturing area, and a user generally does not perceive the display difference between the image capturing area and the non-image capturing area, and can also ensure a good display effect.

According to the method, the influence of light emitted by the display screen assembly on image shooting can be eliminated or reduced, the display screen assembly can be ensured to keep a good display effect to a certain extent, and the use experience of a user is better improved.

In one exemplary embodiment, an image photographing apparatus is provided that is applied to a terminal. The terminal comprises the under-screen camera structure. The image capturing apparatus is used for implementing the image capturing method.

Illustratively, referring to fig. 6, the apparatus includes a control module 101, a receiving module 102 and a processing module 103, and in the process of implementing the method:

the control module 101 is used for collecting multi-frame image frames through a camera assembly of the under-screen camera structure, wherein when each frame of image frame is collected, a camera area of a display screen assembly of the under-screen camera structure is controlled to display black;

the receiving module 102 is configured to receive the multiple frames of image frames acquired by the camera component;

and the processing module 103 is used for processing the multi-frame image frames to determine a target image.

In one exemplary embodiment, an image photographing apparatus is provided that is applied to a terminal. The apparatus is an improvement of the above apparatus, and exemplarily, referring to fig. 6, in the apparatus, the control module 101 is further configured to:

and sending black non-luminous frames or blank frames to a first driving chip corresponding to a camera shooting area of the display screen assembly.

In one exemplary embodiment, an image photographing apparatus is provided that is applied to a terminal. The apparatus is an improvement of the above apparatus, and exemplarily, as shown in fig. 6, in the apparatus, the display screen assembly further includes a non-image-pickup region except for the image-pickup region, and the control module 101 is further configured to:

the frame rate of the imaging region is controlled to be smaller than the frame rate of the non-imaging region.

In one exemplary embodiment, a terminal is provided, and the terminal may be a mobile phone, a tablet computer, a notebook computer, a camera and other devices with display and camera functions. The terminal comprises the screen lower camera shooting structure, and a display screen assembly of the screen lower camera shooting structure forms a comprehensive screen of the terminal.

Referring to fig. 7, terminal 400 may include one or more of the following components: a processing component 402, a memory 404, a power component 406, a multimedia component 408, an audio component 410, an interface for input/output (I/O) 412, a sensor component 414, and a communication component 416.

The processing component 402 generally controls overall operation of the terminal 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 402 can include one or more modules that facilitate interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate interaction between the multimedia component 408 and the processing component 402.

The memory 404 is configured to store various types of data to support operations at the terminal 400. Examples of such data include instructions for any application or method operating on the terminal 400, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 404 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power components 406 provide power to the various components of the terminal 400. The power components 406 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal 400.

The multimedia component 408 includes a screen providing an output interface between the terminal 400 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera module and/or a rear camera module. The front camera module and/or the rear camera module can receive external multimedia data when the terminal 400 is in an operation mode, such as a shooting mode or a video mode. Each front camera module and rear camera module may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 410 is configured to output and/or input audio signals. For example, the audio component 410 includes a Microphone (MIC) configured to receive external audio signals when the terminal 400 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 404 or transmitted via the communication component 416. In some embodiments, audio component 410 also includes a speaker for outputting audio signals.

The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 414 includes one or more sensors for providing various aspects of status assessment for the terminal 400. For example, the sensor assembly 414 can detect an open/closed state of the terminal 400, relative positioning of components, such as a display and keypad of the terminal 400, the sensor assembly 414 can also detect a change in position of the terminal 400 or a component of the terminal 400, the presence or absence of user contact with the terminal 400, orientation or acceleration/deceleration of the terminal 400, and a change in temperature of the terminal 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 416 is configured to facilitate communications between the terminal 400 and other devices in a wired or wireless manner. The device 700 may access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the terminal 400 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 404 comprising instructions, executable by the processor 420 of the terminal 400 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The instructions in the storage medium, when executed by a processor of the terminal, enable the terminal to perform the methods shown in the above-described embodiments.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A structure of making a video recording under screen, apply to the terminal, characterized by that, the structure of making a video recording under screen includes the display screen assembly and makes a video recording the assembly, make a video recording the assembly to locate under the assembly of said display screen, the area corresponding to between the pixel points on the area of making a video recording of the assembly of said display screen has optical microholes,

2. The under-screen camera structure of claim 1, wherein the display screen assembly comprises a top light transmissive layer having a first region with a light transmission intensity greater than a light transmission intensity of a second region,

3. The structure of claim 2, wherein the first region has a thickness less than a thickness of the second region.

4. The structure of claim 2, wherein the top light transmitting layer comprises a plurality of structural layers,

5. The structure of any one of claims 1-4, wherein the camera assembly comprises a photosensitive element, and the photosensitive element is disposed corresponding to the optical micro-hole.

6. The structure of any one of claims 1 to 4, wherein the bottom base layer is provided with a black coating layer at a position corresponding to the imaging region.

7. The structure of any one of claims 1 to 4, wherein the structure comprises a first driving chip and a second driving chip, and the display panel assembly further comprises a non-imaging region except the imaging region, wherein the first driving chip is electrically connected to a driving circuit of the imaging region, and the second driving chip is electrically connected to a driving circuit of the non-imaging region;

8. The structure of any one of claims 1 to 4, wherein the display panel assembly further includes a non-imaging region other than the imaging region, and in the display panel assembly, the density of pixels in the imaging region is greater than the density of pixels in the non-imaging region.

9. A terminal, characterized in that the terminal comprises an under-screen camera structure according to any of claims 1-8, the display screen components of the under-screen camera structure constituting the full screen of the terminal.

10. An image photographing method applied to a terminal including the under-screen camera structure according to any one of claims 1 to 8, the method comprising:

receiving the multi-frame image frames collected by the camera assembly;

and processing the multi-frame image frame to determine a target image.

11. The image capture method of claim 10, wherein controlling the camera area of the display screen assembly of the off-screen camera structure to display black comprises:

12. The image capturing method of claim 10, wherein the display screen assembly further includes a non-image capturing region other than the image capturing region, and the controlling the image capturing region of the display screen assembly of the off-screen image capturing structure to display black includes:

and controlling the refresh rate of the image pickup area to be smaller than the refresh rate of the non-image pickup area.

13. An image photographing apparatus applied to a terminal including the under-screen camera structure according to any one of claims 1 to 8, the apparatus comprising:

14. A terminal, characterized in that the terminal comprises:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to perform the image capturing method of any one of claims 10-12.

15. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of a terminal, enable the terminal to perform the image capturing method of any one of claims 10 to 12.