CN109327576B

CN109327576B - Electronic device, control method thereof and control device thereof

Info

Publication number: CN109327576B
Application number: CN201811368402.1A
Authority: CN
Inventors: 张学勇
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-11-16
Filing date: 2018-11-16
Publication date: 2021-02-02
Anticipated expiration: 2038-11-16
Also published as: CN109327576A

Abstract

The application discloses an electronic device, a control method and a control device. The electronic device comprises a display screen and a structured light assembly. The display screen is provided with a front side and a back side which are back to back, and light rays emitted by the display screen are emitted to the outside along the direction of the back side pointing to the front side. The display screen comprises a first sub-screen and a second sub-screen, and the types of the first sub-screen and the second sub-screen are the same. The structured light camera in the structured light assembly is arranged on one side of the back of the display screen and corresponds to the first sub-screen. The structured light camera is used for receiving the laser light which is reflected and passes through the first sub-screen. When the structured light camera is started, the first sub-screen and the second sub-screen are displayed in different display states. The electronic device controls the display states of the first sub-screen and the second sub-screen to be displayed in different states when the structured light camera is opened, so that the display states of the first sub-screen and the second sub-screen meet the use requirements of the structured light camera and the watching requirements of a user respectively, and the accuracy of the acquired depth information and the use experience of the user are improved.

Description

Electronic device, control method thereof and control device thereof

Technical Field

The present disclosure relates to the field of consumer electronics technologies, and in particular, to an electronic device, a control method of the electronic device, and a control apparatus of the electronic device.

Background

A mobile terminal configured with both a depth camera and a display screen typically windows the display screen so that the depth camera can transmit and/or receive optical signals through the window on the display screen to measure depth information of a scene. However, opening the window on the display screen may reduce the screen occupation ratio of the mobile terminal. In order to improve the screen occupation ratio of the mobile terminal, the depth camera can be directly arranged below the display screen when the display screen is not windowed, but in the arrangement, light emitted by the display screen can affect a light receiving and emitting signal of the depth camera, and further the accuracy of the acquired depth image can be affected.

Disclosure of Invention

The embodiment of the application provides an electronic device, a control method of the electronic device and a control device of the electronic device.

The electronic device of the embodiment of the application comprises a display screen and a structured light assembly, wherein the display screen is used for displaying images. The display screen is provided with a front side and a back side which are opposite to each other, light emitted by the display screen is emitted to the outside along the direction of the back side pointing to the front side, the display screen comprises a first sub-screen and a second sub-screen, the types of the first sub-screen and the second sub-screen are the same, the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the back side of the display screen, the structured light camera corresponds to the first sub-screen, and the structured light camera is used for receiving laser which is reflected and penetrates through the first sub-screen; when the structured light camera is started, the first sub-screen and the second sub-screen are displayed in different display states.

The control method of the embodiment of the application is used for the electronic device. The electronic device comprises a display screen and a structured light assembly, the display screen is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display screen comprises a first sub-screen and a second sub-screen, the types of the first sub-screen and the second sub-screen are the same, the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the display screen where the back surface is located, the structured light camera corresponds to the first sub-screen, and the structured light camera is used for receiving laser which is reflected and passes through the first sub-screen; the control method comprises the following steps: judging whether the structured light camera is started or not; and when the structured light camera is started, controlling the first sub-screen and the second sub-screen to display in different display states.

The control device of the embodiment of the application is used for an electronic device. The electronic device comprises a display screen and a structured light assembly, the display screen is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display screen comprises a first sub-screen and a second sub-screen, the types of the first sub-screen and the second sub-screen are the same, the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the display screen where the back surface is located, the structured light camera corresponds to the first sub-screen, and the structured light camera is used for receiving laser which is reflected and passes through the first sub-screen; the control device comprises a judgment module and a control module. The judging module is used for judging whether the structured light camera is started or not, and the control module is used for controlling the first sub-screen and the second sub-screen to display in different display states when the structured light camera is started.

According to the electronic device, the control method of the electronic device and the control device of the electronic device, when the structured light camera is started, the first sub-screen and the second sub-screen can be controlled to display in different display states, a user can control the display state of the first sub-screen to adapt to the use requirement of the structured light camera, the accuracy of the acquired depth information is improved, and meanwhile, the display state of the second sub-screen is controlled to adapt to the watching requirement of the user, so that the use experience of the user is improved.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic structural diagram of an electronic device according to some embodiments of the present disclosure.

Fig. 2 is a schematic view of a portion of an electronic device according to some embodiments of the present disclosure.

FIG. 3 is a schematic cross-sectional view of the electronic device of some embodiments of the present application along line A-A of FIG. 2.

FIG. 4 is an exploded view of a display screen of an electronic device according to some embodiments of the present disclosure

FIG. 5 is a schematic diagram of a structured light projector according to certain embodiments of the present application.

FIG. 6 is a schematic cross-sectional view of an electronic device according to some embodiments of the present application taken along a line A-A as shown in FIG. 2.

Fig. 7 and 8 are schematic views of partial structures of electronic devices according to some embodiments of the present disclosure.

FIG. 9 is a schematic cross-sectional view of an electronic device according to some embodiments of the present application taken along a line A-A as shown in FIG. 2.

Fig. 10 and 11 are schematic views of partial structures of electronic devices according to some embodiments of the present disclosure.

Fig. 12-16 are schematic cross-sectional views of an electronic device according to some embodiments of the present application taken along a position corresponding to line a-a shown in fig. 2.

FIG. 17 is a flow chart illustrating a control method according to some embodiments of the present application.

FIG. 18 is a block schematic diagram of a control device according to certain embodiments of the present application.

Fig. 19-22 are flow diagrams illustrating a control acquisition method according to some embodiments of the present disclosure.

FIG. 23 is a schematic diagram of an LCD display according to some embodiments of the present application.

FIG. 24 is a schematic structural diagram of an OLED display panel according to certain embodiments of the present application.

FIGS. 25 and 26 are schematic views of the structure of a Micro LED display screen according to certain embodiments of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.

In this application, unless expressly stated or limited otherwise, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through intervening media. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.

Referring to fig. 1 and fig. 2, an electronic device 1000 according to an embodiment of the present disclosure includes a display screen 10 and a structured light assembly 20. The electronic device 1000 may further include a housing 30, where the housing 30 may be used to mount functional devices such as the display screen 10 and the structured light assembly 20, and the functional devices may also be a main board, a dual camera module, a telephone receiver, and the like. The specific form of the electronic device 1000 may be a mobile phone, a tablet computer, a smart watch, a head display device, etc., and the electronic device 1000 is used as a mobile phone for description in this application, it is understood that the specific form of the electronic device 1000 is not limited to a mobile phone, and is not limited herein.

The display screen 10 may be mounted on the housing 30, and specifically, the display screen 10 may be mounted on one surface of the housing 30 or both surfaces of the housing 30 opposite to each other. In the example shown in fig. 1, the display screen 10 is mounted on the front face of the housing 30, and the area of the display screen 10 that can cover the front face is 85% or more, for example, 85%, 86%, 87%, 88%, 89%, 90%, 91%, 92%, 93%, 95% or even 100%. The display screen 10 may be used to display images, which may be text, images, video, icons, etc. information. Specific types of the Display screen 10 may be a Liquid Crystal Display (LCD) screen 93, an Organic Light-Emitting Diode (OLED) Display screen 95, a Micro LED Display screen 97, and the like.

Referring to fig. 23, the LCD panel 93 may include a backlight module 931, a lower polarizer 932, a Thin-film transistor (TFT) substrate 933, a liquid crystal layer 934, a color filter 935, and an upper polarizer 936 sequentially arranged along a light emitting direction. The backlight module 931 may be regarded as a backlight source. The lower polarizer 932 and the upper polarizer 936 are used for controlling the passing or not of the light, and specifically, the upper polarizer 936 and the lower polarizer 932 form a barrier angle respectively, block the component perpendicular to the barrier in the light, and only allow the component parallel to the barrier to pass. TFT substrate 933 is used to provide a conductive path to generate a voltage. The color filter 935 is used to form a color image. The liquid crystal layer 934 includes liquid crystal molecules, and the electro-optic effect caused by the anisotropy of the liquid crystal molecule structure, that is, the anisotropy of the dielectric coefficient and the refractive index of the liquid crystal molecules, is different due to the different directions. The LCD panel 93 generates a voltage through the TFT substrate 933 according to the characteristics of the liquid crystal itself to form an electric field between the upper polarizer 936 and the lower polarizer 932, and controls the rotation of liquid crystal molecules by the electric field to change the traveling direction of light so that the light passes through or is blocked by the lower polarizer 932 and the upper polarizer 936, so that different gray-scale brightness can be formed by different electric fields. The LCD panel 93 can display images by controlling the backlight module 931 to emit light, wherein the backlight module 931 of the LCD panel 93 can only be controlled as a whole, i.e., emit light as a whole or emit no light as a whole.

Referring to fig. 24, the OLED display 95 includes a substrate 951, an anode 952, a hole transport layer 953, a light emitting layer 954, an electron transport layer 955, and a cathode 956. Wherein the substrate 951 is used to support the entire OLED display 95. When a voltage is applied to the anode 952 and the cathode 956 of the OLED, electrons and holes are injected from the cathode 956 and the anode 952, respectively, into the organic functional layer sandwiched between the two electrodes. The injected electrons and holes migrate from the electron transport layer 955 and the hole transport layer 953, respectively, to the light emitting layer 954. After the electrons and holes are injected into the light-emitting layer 954, they are bound together by coulomb force to form hole pairs, i.e., excitons. The excitons migrate under the influence of the electric field, transferring energy to the dopant material in the light-emitting layer 954. Electrons in the dopant material of the light-emitting layer 954 absorb energy and then transition from a ground state to an excited state. Since the excited state is unstable, the electron transits from the excited state back to the ground state again, releasing energy in the form of a photon. Depending on the excited state energy level of the luminescent material, the electrons release photons of different energies during the transition back to the ground state, the energy determining the wavelength of the light, the different wavelengths meaning different colors of the light. Thus, the OLED display 95 can emit light of different colors in a self-luminous manner. The luminance or intensity of light emitted by the OLED display 95 depends on the properties of the light-emitting material and the amount of current applied. For the same OLED display screen 95, the greater the current, the higher the brightness of the light. Each pixel (composed of a plurality of sub-pixels that can self-emit light) in the OLED display screen 95 may be controlled to be on/off by an independent thin film transistor, so that each pixel may continuously and independently emit light. Thus, the OLED display 95 can display images by independently controlling the light emitting layers 954 of the pixels to emit light with different colors and brightnesses.

Referring to fig. 25 and 26, the Micro LED display 97 may include a driving substrate 971, an encapsulation substrate 972, a support 973, and a plurality of pixels 974. The driving substrate 971 and the package substrate 972 are disposed opposite to each other, and a plurality of pixels 974 are arranged between the driving substrate 971 and the package substrate 972. A visible light source 9741 is disposed in each pixel 974.

A display driving circuit (not shown) is disposed in the driving substrate 971, and the driving substrate 971 can control on/off and brightness of the light source in each pixel 974. The package substrate 972 is used for protecting the light source, and the material of the package substrate 972 may be plastic with certain hardness, such as polyethylene terephthalate (PET) or Polycarbonate (PC), or may be glass. The support 973 is used to keep a certain distance between the driving substrate 971 and the encapsulation substrate 972 and prevent excessive compression on the pixel 974.

Each pixel 974 further includes a lower pixel electrode 9742 and an upper pixel electrode 9743, the lower pixel electrode 9742 is disposed on the driving substrate 971, the upper pixel electrode 9743 is disposed under the encapsulation substrate 972, and the visible light source 9741 is sandwiched between the lower pixel electrode 9742 and the upper pixel electrode 9743. The material of the pixel electrode may be indium tin oxide or a conductive metal.

As shown in fig. 25, in one example, the plurality of visible light sources 9741 includes a red light source, a green light source, and a blue light source, and each visible light source 9741 and the corresponding pixel electrode form a pixel 974, so that the pixels 974 including different light sources emit light of different colors.

Referring to fig. 26, in another example, the structure of the pixel 974 may also include a visible light source 9741 and a color conversion layer 9744. For example, the plurality of visible light sources 9741 includes a red light source and a blue light source, and each of the visible light sources 9741 emits light of a corresponding color with the pixel 974 formed by the corresponding pixel electrode. The pixel 974 with the red light source emits red light, the pixel 974 with the blue light source emits blue light, and the pixel 974 with the blue light source and the color conversion layer 9744 emits green light. The pixels 974 also include a spacer layer 9745, the spacer layer 9745 facilitating height uniformity between the pixels 974.

The Micro LED display 97 can display images by independently controlling the visible light sources 9741 to emit light with different brightness and different colors.

Referring to fig. 3, the display screen 10 is formed with a front surface 12 and a back surface 13, which are opposite to each other, and the light is emitted outward along a direction from the back surface 13 to the front surface 12 and received by the user after passing through the front surface 12, that is, the user can view the image displayed on the display screen 10 from the front surface 12. Both the front surface 12 and the back surface 13 may be flat or curved.

Referring to fig. 1, the display screen 10 includes a display area 11, and the display area 11 can be used for displaying images. The method is suitable for different types of electronic devices 1000 and different user requirements. The shape of the display area 11 may be circular, oval, racetrack, rounded rectangle, etc. The display region 11 includes a first sub display region 111 and a second sub display region 112, and the first sub display region 111 and the second sub display region 112 may be independently controlled to exhibit the same or different display states.

In some embodiments, the display screen 10 is a stand-alone screen structure, i.e., the display screen 10 is a unitary body. In this case, the display screen 10 is a self-luminous display screen, and the display screen 10 includes a plurality of pixels that can be independently controlled. The first sub-display area 111 includes a first set of pixels formed by a plurality of pixels, and the second sub-display area 112 includes a second set of pixels formed by a plurality of pixels. In use, a plurality of pixels in the first set of pixels and a plurality of pixels in the second set of pixels may each be independently controlled such that the first sub-display region 111 and the second sub-display region 112 are displayed in the same or different display states. For example, the image is displayed by controlling the pixels at different positions in the first pixel set to emit light to control different areas of the first sub-display area 111, the image is displayed by controlling the pixels at different positions in the second pixel set to emit light to control different areas of the second sub-display area 112, the display brightness of the first sub-display area 111 is controlled by controlling the light emission brightness of the pixels in the first pixel set, the display brightness of the second sub-display area 112 is controlled by controlling the light emission brightness of the pixels in the second pixel set, the refresh frequency of the first sub-display area 111 is controlled by controlling the light emission frequency of the pixels in the first pixel set, and the refresh frequency of the second sub-display area 112 is controlled by controlling the light emission frequency of the pixels in the second pixel set. When the display screen 10 is a separate screen structure, the display screen 10 may be an OLED display screen 95 or a Micro LED display screen.

In some embodiments, please refer to fig. 4, the display screen 10 is composed of two independent sub-display screens, and specifically, the display screen 10 is composed of a first sub-screen 16 and a second sub-screen 17, wherein the first sub-screen 16 forms a first sub-display area 111, and the second sub-screen 17 forms a second sub-display area 112. When the first sub-screen 16 and the second sub-screen 17 are combined into the display screen 10, human eyes cannot easily perceive the boundary line between the first sub-screen 16 and the second sub-screen 17, and when the first sub-screen 16 and the second sub-screen 17 display images, human eyes cannot perceive the boundary line between the images displayed by the first sub-screen 16 and the second sub-screen 17 even though the first sub-screen 16 and the second sub-screen 17 display one frame of image together. The first sub-screen 16 and the second sub-screen 17 can be independently controlled, and when in use, the first sub-screen 16 and the second sub-screen 17 can be independently controlled to display in the same or different display states, wherein the different display states can be that one sub-screen is lighted and the other sub-screen is extinguished, or that two sub-screens are displayed at different brightness, or that two sub-screens are displayed at different refresh frequencies, and the like.

The specific shapes of the first sub-screen 16 and the second sub-screen 17 can be set according to the requirement, for example, as shown in fig. 1, the first sub-screen (the portion corresponding to the first sub-display region 111) is substantially rectangular, the second sub-screen (the portion corresponding to the second sub-display region 112) is also substantially rectangular, and the first sub-screen 16 and the second sub-screen 17 are connected to form a substantially rectangular display screen 10; for example, as shown in fig. 4, the second sub-screen 17 may have a rounded rectangular shape with perforations 172, the first sub-screen 16 may have the same shape as the perforations 172, the perforations 172 may have a racetrack shape, a drop shape, etc., and the first sub-screen 16 and the second sub-screen 17 have complementary shapes and may together form the display screen 10 having a rounded rectangular shape. Of course, the final shape of the display screen 10, the shape of the first sub-screen 16 or the second sub-screen 17 may also be circular, oval, racetrack, etc., without limitation. The first sub-screen 16 may be located at an edge position of the whole display screen 10, and the second sub-screen 17 may be located at a middle position of the whole display screen 10. The first sub-screen 16 may be used to display status icons of the electronic device 1000, such as battery level, network connection status, system time, etc. of the electronic device 1000.

In some embodiments, first sub-panel 16 may be a self-emissive display panel, with first sub-panel 16 including a plurality of pixels that may be independently controlled. The display state of the first sub-screen 16 can be controlled by controlling the light emitting state of the pixels, for example, by controlling the light emitting of the pixels at different positions to control different areas of the first sub-screen 16 to display images, by controlling the light emitting brightness of the pixels to control the display brightness of the first sub-screen 16, and by controlling the light emitting frequency of the pixels to control the refresh frequency of the first sub-screen 16. Specifically, the first sub-screen 16 may be one or more of an OLED display screen 95 and a Micro LED display screen 97.

In some embodiments, second sub-screen 17 may also be a self-emissive display screen, and second sub-screen 17 includes a plurality of pixels that may be independently controlled. The display state of the second sub-screen 17 can be controlled by controlling the light emitting state of the pixels, for example, by controlling the light emission of the pixels at different positions to control different areas of the second sub-screen 17 to display images, by controlling the light emitting brightness of the pixels to control the display brightness of the second sub-screen 17, and by controlling the light emitting frequency of the pixels to control the refresh frequency of the second sub-screen 17. Specifically, the second sub-screen 17 may be one or more of an OLED display screen 95 and a Micro LED display screen 97.

In some embodiments, the first sub-panel 16 may also be a display panel that is illuminated by a backlight. The display state of the first sub-screen 16 can be controlled by controlling the light emitting state of the backlight of the first sub-screen 16, for example, by controlling the backlight to be turned off to control the first sub-screen 16 to be turned off, by controlling the light emitting brightness of the backlight to control the display brightness of the first sub-screen 16, and by controlling the light emitting frequency of the backlight to control the refresh frequency of the first sub-screen 16. Specifically, the first sub-panel 16 may be a liquid crystal display panel 93 or the like that emits light by a backlight.

In some embodiments, the second sub-panel 17 may also be a display panel that is illuminated by a backlight. The display state of the second sub-screen 17 can be controlled by controlling the light emitting state of the backlight of the second sub-screen 17, for example, by controlling the backlight to be turned off to control the second sub-screen 17 to be turned off, by controlling the light emitting brightness of the backlight to control the display brightness of the second sub-screen 17, and by controlling the light emitting frequency of the backlight to control the refresh frequency of the second sub-screen 17. Specifically, the second sub-panel 17 may be a liquid crystal display panel 93 or the like that emits light by a backlight.

When the display screen 10 is composed of the first sub-screen 16 and the second sub-screen 17 which are independently controlled, the types of the first sub-screen 16 and the second sub-screen 17 may be the same. For example, the first sub-screen 16 and the second sub-screen 17 are both self-luminous display screens (such as an OLED display screen 95, a Micro LED display screen, etc.), and specifically, for example, the first sub-screen 16 and the second sub-screen 17 may be both OLED display screens 95; alternatively, the first sub-screen 16 and the second sub-screen 17 may both be Micro LED display screens 97; or the first sub-screen 16 is an OLED display screen 95, and the second sub-screen 17 is a Micro LED display screen 97; or, the first sub-screen 16 is a Micro LED display screen 97, and the second sub-screen 17 is an OLED display screen 95. Alternatively, the first sub-panel 16 and the second sub-panel 17 are both display panels (for example, the liquid crystal display panel 93) that emit light by a backlight.

When the display screen 10 is composed of the first sub-screen 16 and the second sub-screen 17 which are independently controlled, the types of the first sub-screen 16 and the second sub-screen 17 may be different. For example, the first sub-screen 16 may be a self-luminous display screen (such as an OLED display screen 95, a Micro LED display screen 97, and the like), and the second sub-screen 17 may be a display screen (such as a liquid crystal display screen 93, and the like) which emits light through a backlight source, specifically, for example, the first sub-screen 16 is the OLED display screen 95, the second sub-screen 17 is the liquid crystal display screen 93, or the first sub-screen 16 is the Micro LED display screen 97, the second sub-screen 17 is the liquid crystal display screen 93, and the like. Alternatively, the first sub-screen 16 may be a display screen (such as a liquid crystal display 93) emitting light through a backlight source, and the second sub-screen 17 may be a display screen (such as an OLED display 95, a Micro LED display 97, etc.) emitting light, specifically, for example, the first sub-screen 16 is the liquid crystal display 93, the second sub-screen 17 is the OLED display 95, or the first sub-screen 16 is the liquid crystal display 93, and the second sub-screen 17 is the Micro LED display 97, etc.

In some embodiments, when the display panel 10 is a separate panel structure, the pixel density of the first sub-display region 111 and the pixel density of the second sub-display region 112 may be the same or different. When the pixel density of the first sub-display area 111 is different from the pixel density of the second sub-display area 112, the pixel density of the first sub-display area 111 may be smaller than the pixel density of the second sub-display area 112, so that the micro-gap of the first sub-display area 111 is larger than the micro-gap of the second sub-display area 112, the blocking effect of the first sub-display area 111 on light is small, and the transmittance of light passing through the first sub-display area 111 is high.

In some embodiments, when the display panel 10 is composed of the first sub-panel 16 and the second sub-panel 17 which are independently controlled, the pixel density of the first sub-panel 16 and the pixel density of the second sub-panel 17 may be the same or different. When the pixel density of the first sub-screen 16 is different from the pixel density of the second sub-screen 17, the pixel density of the first sub-screen 16 may be smaller than the pixel density of the second sub-screen 17, so that the micro-gap of the first sub-screen 16 is larger than the micro-gap of the second sub-screen 17, the first sub-screen 16 has a small blocking effect on light, and the transmittance of light passing through the first sub-screen 16 is high. For example, when the second sub-panel 17 is an OLED display panel 95 or a Micro LED display panel 97 and the first sub-panel 16 is an LCD display panel 93, generally, the pixel density of the LCD display panel 93 is lower than that of the OLED display panel 95 or the Micro LED display panel, and the transmittance of the LCD display panel 93 is higher.

In some embodiments, the display screen 10 may further include a non-display area, and the non-display area may be formed at the periphery of the display area 11. The non-display area may not be used for display, and the non-display area may be used for bonding with the housing 30 or for wiring, for example, the non-display area may be bonded with the housing 30 by an adhesive without affecting the display function of the display area 11. The display screen 10 may also be a touch display screen integrated with a touch function, and after obtaining image information displayed on the display screen 10, a user may perform touch on the display screen 10 to implement a predetermined interactive operation.

Continuing with fig. 1, the structured light assembly 20 may utilize structured light to obtain depth information of a target object for three-dimensional modeling, generating three-dimensional images, ranging, and the like. The structured light assembly 20 may be installed in the housing 30 of the electronic device 1000, and specifically, after being installed on a bracket, the bracket and the structured light assembly 20 may be installed in the housing 30 together. The structured light assembly 20 can include a structured light projector 21, a structured light camera 22, and a floodlight 23.

Referring to fig. 1 to 3 and fig. 5, the structured light projector 21 is disposed on a side of the display screen 10 where the back surface 13 is located, or the structured light projector 21 is disposed below the first sub-display area 111, and the structured light projector 21 is used for emitting laser light passing through the first sub-display area 111 (when the display screen 10 is composed of the first sub-screen 16 and the second sub-screen 17, the structured light projector 21 is disposed below the first sub-screen 16, and the structured light projector 21 is used for emitting laser light passing through the first sub-screen 16). Specifically, the structured light projector 21 may include a light source 211, a collimating element 212, and a diffractive optical element 213, wherein laser light (e.g., infrared laser light) emitted from the light source 211 is collimated by the collimating element 212, diffracted by the diffractive optical element 213, emitted from the structured light projector 21, and then passes through the first sub-display area 111 to be projected to the outside. The micro-gaps of the first sub-display section 111 and the diffractive structures on the diffractive optical element 213 have a diffractive effect on the light emitted from the light source 211.

The laser light passing through the first sub-display region 111 and entering the outside may include both a pattern formed by diffraction by the diffractive optical element 213 (the pattern includes a plurality of spots diffracted by the diffractive optical element 213) and a pattern formed by diffraction by the microscopic gaps of the display screen 10 (the pattern includes a plurality of spots diffracted by the diffractive optical element 213 and diffracted by the display screen 10), so that the speckle pattern passing through the first sub-display region 111 has high irrelevance, and the obtained speckle pattern is convenient to be processed subsequently. In one example, the transmittance of the first sub-display region 111 can reach 60% or more, so that the structured light emitted from the structured light projector 21 has less loss when passing through the first sub-display region 111.

The structured light camera 22 can be an infrared camera, laser is emitted to a target object, and after the laser is modulated by the target object, the laser can be acquired by the structured light camera 22, the structured light camera 22 receives the modulated laser to acquire a speckle image, and the speckle image is processed to acquire depth data of the target object. The structured light camera 22 may also be disposed on the side of the back surface 13 of the display screen 10, i.e. under the display screen 10, and specifically may be disposed on the same bracket as the structured light projector 21, or the structured light camera 22 may be directly mounted on the housing 30. At this time, the light incident surface of the structured light camera 22 may be aligned with the first sub-display region 111, and the laser modulated by the target object passes through the first sub-display region 111 and then is received by the structured light camera 22, specifically, the laser modulated by the target object may be diffracted by the micro-gaps of the display screen 10 and then is received by the structured light camera 22.

The floodlight 23 can be used to emit supplemental light outwardly, which can be used to supplement the light intensity in the environment when the ambient light is weak. In one example, the supplemental light may be infrared light. The supplemental light rays are emitted onto the target object and reflected by the target object, and then can be acquired by the structured light camera 22 to obtain a two-dimensional image of the target object, and the two-dimensional image information can be used for identification. The floodlight 23 can also be arranged on the side of the back 13 of the display screen 10, i.e. under the display screen 10, and in particular can be arranged on the same support as the structured light projector 21 and the structured light camera 22. At this time, the supplementary light emitted from the floodlight 23 passes through the micro-gap of the first sub-display section 111 and enters the external environment, and the reflected supplementary light may pass through the micro-gap again to be received by the structured light camera 22.

In summary, since the structured light camera 22 is disposed on the side where the back surface 13 of the display screen 10 is located, and the structured light camera 22 receives the laser light passing through the first sub-display area 111, an opening aligned with the structured light camera 22 does not need to be formed on the display screen 10, and the screen ratio of the electronic device 1000 is high. In addition, in the embodiment of the present invention, the structured light camera 22 is disposed below the display screen 10, and compared with a time-of-flight component capable of acquiring depth information, the depth image acquired by the structured light component 20 has a higher resolution, and the accuracy of face recognition can be improved by using the depth image with the higher resolution in face recognition, and the matching degree between the modeled three-dimensional scene and the actual scene can be improved by using the depth image with the higher resolution in three-dimensional scene modeling.

When the structured light camera 22 is disposed below the display screen 10, the structured light camera 22 receives the laser light after passing through the first sub-display area 111.

At this time, if the structured light projector 21 is disposed below the display screen 10, the structured light camera 10 receives the laser light diffracted by the display screen 10 when the laser light passes through the display screen 10 after being reflected by the target object, and at this time, the speckle in the speckle image collected by the structured light camera 22 includes a speckle formed by the laser light being once diffracted by the diffractive optical element 213 and reflected by the target object, a speckle formed by the laser light being once diffracted by the diffractive optical element 213 and secondarily diffracted by the display screen 10 and reflected by the target object, and a speckle formed by the laser light being once diffracted by the diffractive optical element 213 and secondarily diffracted by the display screen 10 and reflected by the target object and thirdly diffracted by the display screen 10. When the depth image is calculated, the following two calculation modes are included:

(1) depth calculations are made directly from all the spots in the speckle image. At this time, the reference spots in the reference image simultaneously include a reference spot formed by laser light being diffracted by the diffractive optical element 213 for the first time and being reflected by the calibration object, a reference spot formed by laser light being diffracted by the diffractive optical element 213 for the first time and being diffracted by the display screen 10 for the second time and being reflected by the calibration object, and a reference spot formed by laser light being diffracted by the diffractive optical element 213 for the first time and being diffracted by the display screen 10 for the second time and being reflected by the calibration object for the third time and being diffracted by the display screen 10 for the third time.

(2) Only the spot formed by the laser light once diffracted by the optical element 213 and reflected by the target object is left and the remaining spots are filtered out to make a depth calculation from the remaining spots. At this time, the reference spots in the reference image include only the reference spots formed by the laser light being diffracted once by the optical element 213 and reflected by the calibration object. The brightness of the spots formed after diffraction of different diffraction orders is different, so that various spots can be distinguished through the brightness, and the spots which are not needed can be filtered.

If the structured light projector 21 is disposed below the display screen 10 and the display screen 10 is formed with the through grooves 14 shown in fig. 6 at positions corresponding to the structured light projector 21, the spots in the speckle image collected by the structured light camera 22 include both spots formed by the laser light being once diffracted by the diffractive optical element 213 and reflected by the target object and secondarily diffracted by the display screen 10. When the depth image is calculated, the following two calculation modes are included:

(1) depth calculations are made directly from all the spots in the speckle image. At this time, the reference spots in the reference image include both the reference spot formed by the laser light being once diffracted by the diffractive optical element 213 and reflected by the calibration object, and the spot formed by the laser light being once diffracted by the diffractive optical element 213 and reflected by the calibration object and secondarily diffracted by the display screen 10.

(2) Only the spot formed by the laser light once diffracted by the optical element 213 and reflected by the target object is left and the remaining spots are filtered out to make a depth calculation from the remaining spots. At this time, the reference spots in the reference image include only the reference spots formed by the laser light being diffracted once by the diffractive optical element 213 and reflected by the calibration object. The brightness of the spots formed after diffraction of different diffraction orders is different, so that various spots can be distinguished through the brightness, and the spots which are not needed can be filtered.

Referring to fig. 6, in some embodiments, the display screen 10 is formed with through slots 14, and the through slots 14 do not have a display function. The through-groove 14 penetrates the front surface 12 and the back surface 13. The structured light projector 21 is disposed on the side of the rear surface 13 of the display screen 10, and the structured light projector 21 emits laser light passing through the through-groove 14.

At this time, the light incident surface of the structured light projector 21 may be aligned with the through groove 14, and the laser light emitted from the structured light projector 21 passes through the through groove 14, is emitted to the outside, is modulated by the target object, passes through the first sub-display region 111, and is received by the structured light camera 22. In this embodiment, since the laser light emitted by the structured light projector 21 does not need to pass through the microscopic gap of the first sub-display area 111 and is not diffracted again by the microscopic gap, the speckle image acquired by the structured light camera 22 includes two types of spots, i.e., a spot formed by the laser light being diffracted once by the diffractive optical element 213 and being reflected by the target object and a spot formed by the laser light being reflected by the target object after being diffracted once by the diffractive optical element 213 and being diffracted twice by the display screen 10, and the processing difficulty in calculating the depth image based on the speckle image can be reduced.

Specifically, in the example shown in fig. 7, the through-groove 14 includes a notch 141 formed on an edge of the display screen 10, or the through-groove 14 intersects the edge of the display screen 10. The notch 141 may be formed on any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the notch 141 may be any shape such as triangle, semicircle, rectangle, racetrack, etc., and is not limited herein.

In the example shown in fig. 8, the through-groove 14 includes a through-hole 142 spaced from the edge of the display screen 10, or the through-groove 14 opens within the range enclosed by the edge of the display screen 10. The through holes 142 may be disposed near any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the through hole 142 may be any shape such as triangle, circle, rectangle, racetrack, etc., and is not limited herein.

In some examples, the through slot 14 may also include the notch 141 and the through hole 142. The number of the notches 141 and the through holes 142 may be equal or unequal.

Referring to fig. 9, in some embodiments, the floodlight 23 is disposed on the side of the back surface 13 of the display screen 10, and the floodlight 23 is used for emitting the supplementary light through the through-slot 14.

At this time, the supplementary light passes through the through-groove 14 and is directly emitted to the outside, and the supplementary light is not weakened in the process of passing through the display region 11, so that the target object can receive a large amount of supplementary light.

Similar to the structured light projector 21, as shown in FIG. 10, the through-slots 14 include notches 141 formed on the edges of the display screen 10, or the through-slots 14 intersect the edges of the display screen 10. The notch 141 may be formed on any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the notch 141 may be any shape such as triangle, semicircle, rectangle, racetrack, etc., and is not limited herein.

Alternatively, as shown in fig. 11, the through-groove 14 includes a through-hole 142 spaced apart from the edge of the display screen 10, or the through-groove 14 is opened within a range surrounded by the edge of the display screen 10. The through holes 142 may be disposed near any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the through hole 142 may be any shape such as triangle, circle, rectangle, racetrack, etc., and is not limited herein.

In addition, in the example shown in fig. 9 to 11, the floodlight 23 and the structured light projector 21 may correspond to the same through-slot 14. In the example shown in fig. 12, the floodlight 23 and the structured light projector 21 may correspond to different through slots 14.

Referring to fig. 3, 6, 9 and 12, in some embodiments, the electronic device 1000 further includes a cover 40, and the cover 40 is disposed on a side of the front 12 of the display screen 10. When the display screen 10 is provided with the through groove 14, the infrared transmitting layer 50 is disposed on the region of the cover plate 40 corresponding to the through groove 14.

The cover plate 40 may be made of a material having a good light transmission property, such as glass or sapphire. The infrared-transmitting layer 50 may be an infrared-transmitting ink or an infrared-transmitting film, and the infrared-transmitting layer 50 has a high transmittance, for example, a transmittance of 85% or more, to infrared light (for example, light having a wavelength of 940 nm), and has a low transmittance to light other than infrared light or is completely opaque to light other than infrared light. Therefore, it is difficult for the user to see the structured-light projector 21 or the floodlight 23 aligned with the through-slot 14 through the cover plate 40, and the appearance of the electronic device 1000 is beautiful.

Referring to fig. 13, in some embodiments, the electronic device 1000 further includes a cover plate 40, the cover plate 40 is disposed on a side of the front surface 12 of the display screen 10, and an infrared reflection reducing coating 60 is formed on a region of the cover plate 40 corresponding to the structured light projector 21.

The infrared antireflection film 60 may increase the transmittance of infrared light, and when the structured light projector 21 projects infrared laser light, the infrared antireflection film 60 may increase the transmittance of the infrared laser light passing through the cover plate 40, so as to reduce the loss of the infrared laser light passing through the cover plate 40, thereby reducing the power consumption of the electronic device 1000. Specifically, the infrared reflection reducing coating 60 may be coated on the upper surface, the lower surface, or both the upper surface and the lower surface of the cover plate 40.

Of course, an infrared reflection reducing coating 60 may also be formed on the cover plate 40 in the region corresponding to the structured light camera 22, so as to reduce the loss of the external infrared light passing through the cover plate 40 before reaching the structured light camera 22. An infrared reflection reducing coating 60 may also be formed on the cover plate 40 in the area corresponding to the floodlight 23 to reduce the loss of the supplementary light emitted from the floodlight 23 when passing through the cover plate 40. At this time, the visible light antireflection film 80 may be formed on the cover plate 40 in the regions not corresponding to the structured light projector 21, the structured light camera 22 and the floodlight 23, so as to improve the transmittance of the visible light emitted from the display screen 10 when passing through the cover plate 40.

Referring to fig. 14, in some embodiments, an infrared antireflection film 60 is formed on the display screen 10 in the region corresponding to the structured light camera 22.

The infrared antireflection film 60 can increase the transmittance of infrared light, and when the structured light camera 22 receives infrared laser light, the infrared antireflection film 60 can increase the transmittance of the infrared laser light passing through the display screen 10, so as to reduce the loss of the infrared laser light passing through the display screen 10, so that the collected speckle patterns are clearer, and the accuracy of depth measurement is favorably improved. Specifically, infrared antireflection film 60 may be formed on front surface 12, or on back surface 13 of display screen 10, or on both front surface 12 and back surface 13 of display screen 10. In one example, infrared antireflection film 60 may also be formed inside display panel 10, for example, when display panel 10 is a liquid crystal display panel, infrared antireflection film 60 may be formed on a polarizer in display panel 10, or on an electrode plate of display panel 10, etc. Of course, when the through groove 14 is not formed at the position of the display screen 10 corresponding to the structured light projector 21, the infrared antireflection film 60 may be formed in the area of the display screen 10 corresponding to the structured light projector 21. When the through groove 14 is not formed in the position of the display screen 10 corresponding to the floodlight 23, the infrared antireflection film 60 may also be formed in the area of the display screen 10 corresponding to the floodlight 23.

Referring to fig. 15, in some embodiments, an infrared transparent layer 50 is formed on the area of the display screen 10 corresponding to the structured light camera 22. As described above, the infrared-transmitting layer 50 has a high transmittance for infrared light, but has a low transmittance for light other than infrared light (e.g., visible light) or is completely opaque to light other than infrared light (e.g., visible light), and thus the influence of light other than infrared light passing through the display screen 10 on the structured light camera 22 can be reduced.

Meanwhile, when the through groove 14 is not formed at the position of the display screen 10 corresponding to the structured light projector 21, the infrared transmitting layer 50 may be formed in the region of the display screen 10 corresponding to the structured light projector 21, so as to prevent the energy loss of the laser emitted to the outside from being too large. When the through groove 14 is not formed at the position of the display screen 10 corresponding to the floodlight 23, the infrared transmitting layer 50 can also be formed at the area of the display screen 10 corresponding to the floodlight 23.

Referring to fig. 16, in some embodiments, the display screen 10 is formed with a through-slot 14 extending through the front surface 12 and the back surface 13. The electronic device 1000 also includes a visible light camera 70, the visible light camera 70 being disposed in alignment with the through slots 14. The cover plate 40 has a visible light reflection reducing film 80 and/or an infrared cut-off film 90 formed in a region corresponding to the through groove 14.

The visible light camera 70 may be used to receive visible light through the cover plate 40 and the through slot 14 to capture images. Forming the visible light antireflection film 80 on the cover plate 40 in the region corresponding to the through groove 14 can increase the transmittance of visible light when the visible light passes through the cover plate 40, so as to improve the imaging quality of the visible light camera 70. Forming the infrared cut film 90 on the cover plate 40 in the region corresponding to the through-groove 14 can reduce the transmittance of infrared light when the infrared light passes through the cover plate 40, or completely prevent the infrared light from entering the visible light camera 70, to reduce the influence of the infrared light on imaging of the visible light camera 70.

Referring to fig. 1 and 17, the present application further provides a control method, which can be used in the electronic device 1000 according to any of the above embodiments. Wherein the first sub display region 111 and the second sub display region 112 can be independently controlled. The structured light camera 22 corresponds to the first sub-display area 111. The structured light camera 22 may be used to receive the laser light that is reflected and passes through the first sub-display area. The control method comprises the following steps:

01: judging whether the structured light camera 22 is turned on; and

02: when the structured light camera 22 is turned on, the first sub display area 111 and the second sub display area 112 are controlled to display in different display states.

Referring to fig. 18, the present application further provides a control device 400. The control method of the present application can be implemented by the control device 400 of the present application. The control device comprises a judging module 401 and a control module 402. Step 01 may be implemented by the decision block 401. Step 02 may be implemented by control module 402. That is, the determining module 401 can be used to determine whether the structured light camera 22 is turned on. The control module 402 can be used to control the first sub-display area 111 and the second sub-display area 112 to display in different display states when the structured light camera 22 is turned on.

Referring to fig. 1, the control method of the present application can also be implemented by the electronic device 1000 of the present application, that is, when the structured light camera 22 is turned on, the first sub-display area 111 and the second sub-display area 112 are displayed in different display states. In some embodiments, the electronic device 1000 further comprises a processor 200, wherein step 01 and step 02 can both be implemented by the processor 200.

Specifically, when the structured light camera 22 is turned on, the structured light camera 22 receives the modulated laser light passing through the first sub-display area 111, and at this time, the light used by the first sub-display area 111 to display an image interferes with the structured light camera 22, so that a large error exists in a speckle image obtained by the structured light camera 22, and the depth information of the target object cannot be accurately obtained. Then, when the structured light camera 22 is turned on, the first sub-display area 111 and the second sub-display area 112 are controlled to display in different display states, and a user can control the display state of the first sub-display area 111 to meet the requirement of the structured light camera 22, so as to improve the accuracy of the acquired depth image, and simultaneously control the display state of the second sub-display area 112 to meet the viewing requirement of the user, so as to improve the use experience of the user.

It will be appreciated that in use, the structured light camera 22 and the structured light projector 21 may be turned on simultaneously, or at very small intervals, so that the above-mentioned time when the structured light camera 22 is turned on, i.e. the time when the structured light projector 21 is turned on, can be regarded as the time when the structured light projector 21 is turned on.

Referring to fig. 1, in some embodiments, when the display screen 10 is an independent screen structure (the display screen 10 may be an OLED display screen 95 or a Micro LED display screen 97), or the display screen 10 includes two independent sub-display screens, and both the first sub-screen 16 and the second sub-screen 17 are self-luminous display screens (both the first sub-screen 16 and the second sub-screen 17 are the OLED display screen 95, or both the first sub-screen 16 and the second sub-screen 17 are the Micro LED display screen 97), if the structured light camera 22 is turned on, the first sub-display area 111 is turned off, and the second sub-display area 112 is turned on.

At this time, referring to fig. 19, when the structured light camera 22 is turned on, the step 02 of controlling the first sub-display area 111 and the second sub-display area 112 to display in different display states includes:

021: when the structured light camera 22 is turned on, the first sub-display area 111 is controlled to be closed, and the second sub-display area 112 is controlled to be opened.

Referring back to FIG. 18, step 021 can be implemented by control module 402. That is, the control module 402 can also be used to control the first sub-display area 111 to be closed and the second sub-display area 112 to be opened when the structured light camera 22 is opened.

Referring to fig. 1, in some embodiments, step 021 can also be implemented by processor 200.

When the structured light camera 22 receives the reflected laser light, if the first sub-display area 111 is in the on state, the light emitted from the first sub-display area 111 or the light existing inside the first sub-display area 111 may interfere with the structured light camera 22, which affects the accuracy of the structured light assembly 20 in detecting the depth information of the target object. In this embodiment, when the structured light camera 22 is turned on, the first display area 111 is turned off, that is, the first sub-display area 111 does not display an image, so as to prevent the first sub-display area 111 from interfering with the structured light camera 22, and meanwhile, the second sub-display area 112 is turned on, so that a user can still obtain information or perform interaction by using an image displayed by the second sub-display area 112, without affecting the use of other functions of the electronic device 1000.

Referring to fig. 1, in some embodiments, when the display screen 10 is an independent screen structure (the display screen 10 may be an OLED display screen 95 or a Micro LED display screen 97), or the display screen 10 includes two independent sub-display screens, and the first sub-screen 16 and the second sub-screen 17 are both self-luminous display screens (the first sub-screen 16 and the second sub-screen 17 are both the OLED display screen 95 or the first sub-screen 16 and the second sub-screen 17 are both the Micro LED display screen 97), if the structured light camera 22 is turned on, the first sub-display area 111 displays at a first brightness, and the second sub-display area 112 displays at a second brightness.

At this time, referring to fig. 20, when the structured light camera 22 is turned on, the step 02 of controlling the first sub-display area 111 and the second sub-display area 112 to display in different display states includes:

022: when the structured light camera 22 is turned on, the first sub-display area 111 is controlled to display at a first brightness, and the second sub-display area 112 is controlled to display at a second brightness.

Referring to FIG. 18, in certain embodiments, step 022 can be implemented by the control module 402. That is, the control module 402 is further configured to control the first sub-display area 111 to display at a first brightness and the second sub-display area 112 to display at a second brightness when the structured light camera 22 is turned on.

Referring to fig. 1, in some embodiments, step 022 can also be implemented by processor 200.

When the structured light camera 22 is turned on, both the first sub-display area 111 and the second sub-display area 112 can be turned on, so that the integrity of the display effect of the display screen 10 is not affected, and meanwhile, the brightness of the first sub-display area 111 is smaller than the display brightness of the second sub-display area 112, so that the intensity of light rays emitted by the first sub-display area 111 is reduced, and the interference on the structured light camera 22 is reduced.

Furthermore, in some examples, when the structured light camera 22 is turned on, the first sub-display area 111 may be controlled by the processor 200 to be displayed at the lowest brightness, while the display brightness of the second sub-display area 112 is unchanged; or according to different usage scenarios, when the structured light camera 22 is turned on, the first sub-display area 111 may be controlled to display at different brightness, for example, when the payment scenario has a high requirement on the accuracy of depth information acquisition, and when the structured light camera 22 is turned on, the first sub-display area 111 displays at the lowest brightness; in the unlocking scene, the accuracy requirement for acquiring the depth information is lower than that in the payment scene, and when the structured light camera 22 is turned on, the first sub-display area 111 displays the depth information at a brightness higher than the lowest brightness.

Referring to fig. 1, in some embodiments, when the display screen 10 is an independent screen structure (the display screen 10 may be an OLED display screen 95 or a Micro LED display screen 97), or the display screen 10 includes two independent sub-display screens, and both the first sub-screen 16 and the second sub-screen 17 are self-luminous display screens (both the first sub-screen 16 and the second sub-screen 17 are the OLED display screen 95, or both the first sub-screen 16 and the second sub-screen 17 are the Micro LED display screen 97), if the structural camera 22 is turned off, both the first sub-display area 22 and the second sub-display area 22 are turned on.

At this time, referring to fig. 17 again, the control method further includes:

03: when the structured light camera 22 is turned off, the first sub display area 22 and the second sub display area 22 are controlled to be turned on.

Referring back to fig. 18, in some embodiments, step 03 can be implemented by the control module 402. That is, the control module 402 can also be used to control the first sub-display area 22 and the second sub-display area 22 to be turned on when the structured light camera 22 is turned off.

Referring to fig. 1, in some embodiments, step 03 can also be implemented by the processor 200.

When the structure light camera 22 is turned off, that means the user does not need to use the structure light camera 22 at this time, that is, the structure light camera 22 does not need to receive the laser light reflected by and passing through the first sub-display area 111 at this time, and therefore, the first sub-display area 111 and the second sub-display area 112 are controlled to be turned on, so that the whole display screen 10 is used for displaying images, and the appearance of the user when using the electronic device 1000 is improved.

Referring to fig. 1, it can be understood that when the first sub-display area 111 and the second sub-display area 112 are both turned on or displayed at different brightness levels, the picture displayed in the first sub-display area 111 and the picture displayed in the second sub-display area 112 may form a complete display picture together, for example, when the electronic device 1000 is playing a movie, the display screen 10 displays one frame of movie picture, where the movie picture has a tree, a man, and a woman, and the man may be located in the second sub-display area 112, and most of the woman is located in the second sub-display area 112, and the arm is located in the first sub-display area 111. Or; the frame displayed in the first sub-display area 111 and the frame displayed in the second sub-display area 112 are two independent display frames, for example, when the electronic device 1000 is currently performing a task of playing a movie, the movie frame is displayed in the second sub-display area 112, and the first sub-display area 111 may synchronously display the battery power, the network connection status, the system time, and the like of the electronic device 1000, or synchronously display an instant messaging message or a message notification of each application program, and the like.

Referring to fig. 1 and 4, in some embodiments, when the display screen 10 is composed of a first sub-screen 16 and a second sub-screen 17 which are independently controlled, and the first sub-screen 16 and the second sub-screen 17 are both display screens which emit light through a backlight, or when one of the first sub-screen 16 and the second sub-screen 17 is a display screen which emits light through a backlight, if the structured light camera 22 is turned on, the first sub-screen 16 is turned off, and the second sub-screen 17 is turned on.

At this time, referring to fig. 21, when the structured light camera 22 is turned on, the step 02 of controlling the first sub-display area 111 and the second sub-display area 112 to display in different display states includes:

023: when the structured light camera 22 is turned on, the first sub-screen 16 is controlled to be closed, and the second sub-screen 17 is controlled to be opened.

Referring back to fig. 18, step 023 may be implemented by the control module 402. That is, the control module 402 can also be used to control the first sub-screen 16 to be closed and the second sub-screen 17 to be opened when the structured light camera 22 is opened.

Referring to fig. 1, in some embodiments, step 023 may also be implemented by processor 200.

When the structured light camera 22 receives the reflected laser light, if the first sub-screen 16 is in the open state, the light emitted by the first sub-screen 16 or the light existing inside the first sub-screen 16 may interfere with the structured light camera 22, which affects the accuracy of the structured light assembly 20 in detecting the depth information of the target object. In this embodiment, when the structured light camera 22 is turned on, the first sub-screen 16 is turned off, that is, the first sub-screen 16 does not display an image, so that the first sub-screen 16 is prevented from interfering with the structured light camera 22, and meanwhile, the second sub-screen 17 is turned on, so that the user can still obtain information or perform interaction by using the image displayed by the second sub-screen 17, without affecting the use of other functions of the electronic device 1000.

Referring to fig. 1 and 4, in some embodiments, when the display screen 10 is composed of a first sub-screen 16 and a second sub-screen 17 which are independently controlled, and the first sub-screen 16 and the second sub-screen 17 are both display screens which emit light through a backlight, or when one of the first sub-screen 16 and the second sub-screen 17 is a display screen which emits light by itself and the other is a display screen which emits light through a backlight, if the structured light camera 22 is turned on, the first sub-screen 16 is displayed at a first brightness and the second sub-screen 17 is displayed at a second brightness.

At this time, referring to fig. 22, when the structured light camera 22 is turned on, the step 02 of controlling the first sub-display area 111 and the second sub-display area 112 to display in different display states includes:

024: when the structured light camera 22 is turned on, the first sub-screen 16 is controlled to display at a first brightness, and the second sub-screen 17 is controlled to display at a second brightness.

Referring back to fig. 18, in certain embodiments, step 024 may be implemented by the control module 402. That is, the control module 402 is further configured to control the first sub-screen 16 to display at a first brightness and the second sub-screen 17 to display at a second brightness when the structured light camera 22 is turned on.

Referring to fig. 1, in some embodiments, step 024 may also be implemented by processor 200.

When the structure light camera 22 is opened, the first sub-screen 16 and the second sub-screen 17 can both be in an open state to not influence the integrity of the influence that the display screen 10 shows, simultaneously, the luminance of the first sub-screen 16 is less than the display luminance of the second sub-screen 17, so as to reduce the intensity of the light that the first sub-screen 16 sent, and then reduce the interference to the structure light camera 22.

Furthermore, in some examples, when the structured light camera 22 is turned on, the first sub-screen 16 may be controlled by the processor 200 to be displayed at the lowest brightness, while the display brightness of the second sub-screen 17 is unchanged; or according to different usage scenarios, when the structured light camera 22 is turned on, the first sub-screen 16 may be controlled to display at different brightness, for example, when the payment scenario has a high requirement on the accuracy of depth information acquisition, and when the structured light camera 22 is turned on, the first sub-screen 16 displays at the lowest brightness; in the unlocked scene, the accuracy requirement for depth information acquisition is lower than that in the paid scene, and when the structured light camera 22 is turned on, the first sub-screen 16 displays at a brightness higher than the lowest brightness.

Referring to fig. 1 and 4, in some embodiments, when the display screen 10 is composed of a first sub-screen 16 and a second sub-screen 17 which are independently controlled, and the first sub-screen 16 and the second sub-screen 17 are both display screens which emit light through a backlight, or when one of the first sub-screen 16 and the second sub-screen 17 is a self-luminous display screen and the other is a display screen which emits light through a backlight, if the structured light camera 22 is turned off, both the first sub-screen 16 and the second sub-screen 17 are turned on.

At this time, referring to fig. 21, the control method further includes:

04: when the structured light camera 22 is closed, the first sub-screen 16 and the second sub-screen 17 are controlled to be opened.

Referring back to fig. 18, in some embodiments, step 04 may be implemented by the control module 402. That is, the control module 402 may also be used to control both the first sub-screen 16 and the second sub-screen 17 to be turned on when the structured light camera 22 is turned off.

Referring to fig. 1, in some embodiments, step 04 may also be implemented by the processor 200.

When the structure light camera 22 is closed, it means that the user does not need to use the structure light camera 22 at this time, that is, the structure light camera 22 does not need to receive the laser reflected by and passing through the first sub-screen 16 at this time, and therefore, the first sub-screen 16 and the second sub-screen 17 are controlled to be both opened, so that the whole display screen 10 is used for displaying images, and the appearance of the user when using the electronic device 1000 is improved.

Referring to fig. 1 and fig. 4, it can be understood that when the first sub-screen 16 and the second sub-screen 17 are both turned on or displayed at different brightness, the picture displayed by the first sub-screen 16 and the picture displayed by the second sub-screen 17 may together form a complete display picture, for example, when the electronic device 1000 is playing a movie, the display screen 10 displays one frame of movie picture, where the movie picture has a tree, a man, and a woman, and may be the man who is located in the second sub-screen 17, the woman who is located in the second sub-screen 17 mostly has his/her body, and the arm is located in the first sub-screen 16. Alternatively, the screen displayed by the first sub-screen 16 and the screen displayed by the second sub-screen 17 are two independent display screens, for example, when the electronic device 1000 is currently executing a task of playing a movie, the movie screen is displayed on the second sub-screen 17, and the first sub-screen 16 may synchronously display the battery power, the network connection status, the system time, and the like of the electronic device 1000, or synchronously display an instant messaging message or a message notification of each application program, and the like.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. An electronic device, comprising:

the display screen is used for displaying images, the front side and the back side which are opposite to each other are formed on the display screen, light rays emitted by the display screen are emitted to the outside along the direction of the back side pointing to the front side, the display screen comprises a first sub-screen and a second sub-screen, and the types of the first sub-screen and the second sub-screen are the same;

the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the display screen where the back surface is located, the structured light camera corresponds to the first sub-screen, and the structured light camera is used for receiving laser which is reflected and penetrates through the first sub-screen;

when the structured light camera is started, the first sub-screen is displayed at a first brightness, the second sub-screen is displayed at a second brightness, the first brightness is smaller than the second brightness, the first brightness is determined according to an application scene of the structured light camera, and when the structured light camera is started in a payment scene, the first sub-screen is displayed at a lowest brightness; and when the structured light camera is started in an unlocked scene, the first sub-screen is displayed at the brightness higher than the lowest brightness.

2. The electronic device according to claim 1, wherein the first sub-screen and the second sub-screen are both self-luminous display screens; or

The first sub-screen and the second sub-screen are both display screens which emit light through a backlight source.

3. A control method is used for an electronic device, and the electronic device comprises a display screen and a structured light assembly, wherein the display screen is used for displaying images, the display screen is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of pointing the back surface to the front surface, the display screen comprises a first sub-screen and a second sub-screen, the first sub-screen and the second sub-screen are of the same type, the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the back surface of the display screen, the structured light camera corresponds to the first sub-screen, and the structured light camera is used for receiving laser which is reflected and passes through the first sub-screen; the control method comprises the following steps:

judging whether the structured light camera is started or not; and

when the structured light camera is started, controlling the first sub-screen to display at a first brightness, and controlling the second sub-screen to display at a second brightness, wherein the first brightness is smaller than the second brightness, and the first brightness is determined according to an application scene of the structured light camera; and when the structured light camera is started in an unlocked scene, the first sub-screen is displayed at the brightness higher than the lowest brightness.

4. The control method according to claim 3, wherein the first sub-screen and the second sub-screen are both self-luminous display screens; or

5. A control device is used for an electronic device and is characterized in that the electronic device comprises a display screen and a structured light assembly, the display screen is used for displaying images, a front face and a back face which are opposite to each other are formed on the display screen, light rays emitted by the display screen are emitted to the outside along the direction of pointing to the front face from the back face, the display screen comprises a first sub-screen and a second sub-screen, the first sub-screen and the second sub-screen are of the same type, the structured light assembly comprises a structured light camera, the structured light camera is arranged on one side of the back face of the display screen, the structured light camera corresponds to the first sub-screen, and the structured light camera is used for receiving laser which is reflected and passes through the first sub-screen; the control device includes:

the judging module is used for judging whether the structured light camera is started or not; and

the control module is used for controlling the first sub-screen to be displayed at a first brightness when the structured light camera is started, controlling the second sub-screen to be displayed at a second brightness, wherein the first brightness is smaller than the second brightness, and is determined according to an application scene of the structured light camera; and when the structured light camera is started in an unlocked scene, the first sub-screen is displayed at the brightness higher than the lowest brightness.