CN111200671A

CN111200671A - Electronic device, control method thereof and control device thereof

Info

Publication number: CN111200671A
Application number: CN201811368395.5A
Authority: CN
Inventors: 杨鑫; 袁石林
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-11-16
Filing date: 2018-11-16
Publication date: 2020-05-26

Abstract

The application discloses an electronic device, a control method and a control device. The electronic device comprises a display screen and a time-of-flight component. The display screen comprises a display area with a front surface and a back surface which are back to back, and light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface. The display area comprises a first pixel set and a second pixel set which can be independently controlled, the first pixel set and the second pixel set respectively comprise a plurality of pixels which can be independently controlled, the time-of-flight component comprises a light receiver, the light receiver is arranged on one side where the back face of the display screen is located, and the light receiver corresponds to the first pixel set and is used for receiving laser pulses which are reflected and pass through the first pixel set. The first set of pixels and the second set of pixels are displayed in different display states when the light receiver is turned on. The electronic device of the application can independently control the display states of the first pixel set and the second pixel set when the light receiver is turned on so as to adapt to the use requirement of the light receiver and the viewing requirement of a user.

Description

Electronic device, control method thereof and control device thereof

Technical Field

The present invention relates to the field of consumer electronics, and more particularly, to an electronic device, a control method of the electronic device, and a control apparatus of the electronic device.

Background

The mobile terminal can be configured with a depth camera and a display screen, the depth camera can be used for acquiring depth information of an object, the display screen can be used for displaying contents such as characters and patterns, and generally, a window needs to be opened on the display screen, for example, a bang screen is formed, so that a display area of the display screen is staggered from the position of the depth camera, and the display screen is arranged in a manner that the screen occupation ratio of the mobile terminal is low. And if set up the degree of depth camera under the display screen, the light that sends when the display screen shows can cause the influence to the degree of depth camera again, and the user can't acquire the image that shows again when closing the display screen, is difficult to compromise the user to the demonstration demand of display screen and the demand that the degree of depth camera acquireed the degree of depth simultaneously.

Disclosure of Invention

The embodiment of the application provides an electronic device, a control method of the electronic device and a control device of the electronic device.

The electronic device of this application embodiment includes display screen and time of flight subassembly, the display screen includes the display area, the display area is formed with the front and the back that carry on the back mutually, and the light that the display screen sent is along the directional front direction of the back to external emission, the display area is including first pixel set and the second pixel set that can independently control, first pixel set with the second pixel set all includes a plurality of pixels that can independently control, light receiver with first pixel set corresponds, light receiver sets up the display screen one side at the back place, light receiver is used for receiving by the reflection and passes the laser pulse of first pixel set. When the light receiver is switched on, the first pixel set and the second pixel set are displayed in different display states.

The control method of the embodiment of the application is used for the electronic device. The electronic device comprises a display screen and a time-of-flight assembly, wherein the display screen comprises a display area, the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display area comprises a first pixel set and a second pixel set which can be independently controlled, the first pixel set and the second pixel set respectively comprise a plurality of pixels which can be independently controlled, the time-of-flight assembly comprises a light receiver, the light receiver is arranged on one side of the back surface of the display screen, the light receiver corresponds to the first pixel set, and the light receiver is used for receiving laser pulses which are reflected and pass through the first pixel set; the control method comprises the following steps: judging whether the optical receiver is started; when the light receiver is switched on, the first pixel set and the second pixel set are controlled to be displayed in different display states.

The control device of the embodiment of the application is used for an electronic device, the electronic device comprises a display screen and a time-of-flight assembly, the display screen comprises a display area, the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display area comprises a first pixel set and a second pixel set which can be independently controlled, the first pixel set and the second pixel set both comprise a plurality of pixels which can be independently controlled, the time-of-flight assembly comprises a light receiver, the light receiver corresponds to the first pixel set, the light receiver is arranged on one side of the back surface of the display screen, and the light receiver is used for receiving laser pulses which are reflected and pass through the first pixel set; the control device comprises a judgment module and a control module. The judging module is used for judging whether the optical receiver is started or not. The control module is used for controlling the first pixel set and the second pixel set to display in different display states when the light receiver is started.

In the electronic device, the control method, and the control device according to the embodiments of the application, when the optical receiver is turned on, the first pixel set and the second pixel set may be controlled to display in different display states, and a user may control the display state of the first pixel set to adapt to a usage requirement of the optical receiver, so as to improve accuracy of the acquired depth information, and control the display state of the second sub-pixel set to adapt to a viewing requirement of the user, so as to improve usage experience of the user.

Additional aspects and advantages of embodiments of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the present application.

Drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic structural diagram of an electronic device according to some embodiments of the present disclosure.

Fig. 2 is a schematic view of a portion of an electronic device according to some embodiments of the present disclosure.

FIG. 3 is a schematic cross-sectional view of the electronic device of some embodiments of the present application along line A-A of FIG. 2.

FIG. 4 is a schematic cross-sectional view of an electronic device according to some embodiments of the present application taken along a line A-A as shown in FIG. 2.

Fig. 5 and 6 are schematic views of partial structures of electronic devices according to some embodiments of the present disclosure.

Fig. 7 to 10 are schematic cross-sectional views of an electronic device according to some embodiments of the present application along a position corresponding to the line a-a shown in fig. 2.

Fig. 11 is a schematic view of a portion of an electronic device according to some embodiments of the present application.

FIG. 12 is an exploded view of a display screen according to some embodiments of the present application.

Fig. 13 is a flowchart illustrating a control method of an electronic device according to some embodiments of the present disclosure.

FIG. 14 is a block diagram of a control device of an electronic device according to some embodiments of the present disclosure.

Fig. 15 and 16 are schematic flow charts of a control method of an electronic device according to some embodiments of the present disclosure.

FIG. 17 is a schematic diagram of an LCD display according to some embodiments of the present application.

FIG. 18 is a schematic structural diagram of an OLED display panel according to certain embodiments of the present application.

FIGS. 19 and 20 are schematic views of the structure of a Micro LED display screen according to certain embodiments of the present application.

Detailed Description

Embodiments of the present application will be further described below with reference to the accompanying drawings. The same or similar reference numbers in the drawings identify the same or similar elements or elements having the same or similar functionality throughout.

In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary and are only for the purpose of explaining the embodiments of the present application, and are not to be construed as limiting the present application.

In this application, unless expressly stated or limited otherwise, the first feature "on" or "under" the second feature may be directly contacting the first and second features or indirectly contacting the first and second features through intervening media. Also, a first feature "on," "over," and "above" a second feature may be directly or diagonally above the second feature, or may simply indicate that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature may be directly under or obliquely under the first feature, or may simply mean that the first feature is at a lesser elevation than the second feature.

Referring to fig. 1 and fig. 2, an electronic device 1000 according to an embodiment of the present disclosure includes a display screen 10 and a time-of-flight component 20. The electronic device 1000 may further include a housing 30, where the housing 30 may be used to mount functional devices such as the display screen 10 and the time-of-flight assembly 20, and the functional devices may also be a main board, a dual camera module, a receiver, and the like. The specific form of the electronic device 1000 may be a mobile phone, a tablet computer, a smart watch, a head display device, etc., and the electronic device 1000 is used as a mobile phone for description in this application, it is understood that the specific form of the electronic device 1000 is not limited to a mobile phone, and is not limited herein.

The display screen 10 may be mounted on the housing 30, and specifically, the display screen 10 may be mounted on one surface of the housing 30 or both surfaces of the housing 30 opposite to each other. In the example shown in fig. 1, where the display screen 10 is mounted on the front face of the housing 30, the display screen 10 may cover 85% or more of the area of the front face, for example, up to 85%, 86%, 87%, 88%, 89%, 90%, 91%, 92%, 93%, 95% or even 100%. The display screen 10 may be used to display images, which may be text, images, video, icons, etc. information. Specific types of the display screen 10 may be a Liquid Crystal Display (LCD) 93, an Organic Light-Emitting Diode (OLED) display screen 95, a micro led display screen 97, and the like.

Referring to fig. 17, the LCD panel 93 may include a backlight module 931, a lower polarizer 932, a Thin-film transistor (TFT) substrate 933, a liquid crystal layer 934, a color filter 935, and an upper polarizer 936 sequentially arranged along a light emitting direction. The backlight module 931 may be regarded as a backlight source. The lower polarizer 932 and the upper polarizer 936 are used for controlling the passing or not of the light, and specifically, the upper polarizer 936 and the lower polarizer 932 form a barrier angle respectively, block the component perpendicular to the barrier in the light, and only allow the component parallel to the barrier to pass. TFT substrate 933 is used to provide a conductive path to generate a voltage. The color filter 935 is used to form a color image. The liquid crystal layer 934 includes liquid crystal molecules, and the electro-optic effect caused by the anisotropy of the liquid crystal molecule structure, that is, the anisotropy of the dielectric coefficient and the refractive index of the liquid crystal molecules, is different due to the different directions. The LCD panel 93 generates a voltage through the TFT substrate 933 according to the characteristics of the liquid crystal itself to form an electric field between the upper polarizer 936 and the lower polarizer 932, and controls the rotation of liquid crystal molecules by the electric field to change the traveling direction of light so that the light passes through or is blocked by the lower polarizer 932 and the upper polarizer 936, so that different gray-scale brightness can be formed by different electric fields. The LCD panel 93 can display images by controlling the backlight module 931 to emit light, wherein the backlight module 931 of the LCD panel 93 can only be controlled as a whole, i.e., emit light as a whole or emit no light as a whole.

Referring to fig. 18, the OLED display 95 includes a substrate 951, an anode 952, a hole transport layer 953, a light emitting layer 954, an electron transport layer 955, and a cathode 956. Wherein the substrate 951 is used to support the entire OLED display 95. When a voltage is applied to the anode 952 and the cathode 956 of the OLED, electrons and holes are injected from the cathode 956 and the anode 952, respectively, into the organic functional layer sandwiched between the two electrodes. The injected electrons and holes migrate from the electron transport layer 955 and the hole transport layer 953, respectively, to the light emitting layer 954. After the electrons and holes are injected into the light-emitting layer 954, they are bound together by coulomb force to form hole pairs, i.e., excitons. The excitons migrate under the influence of the electric field, transferring energy to the dopant material in the light-emitting layer 954. Electrons in the dopant material of the light-emitting layer 954 absorb energy and then transition from a ground state to an excited state. Since the excited state is unstable, the electron transits from the excited state back to the ground state again, releasing energy in the form of a photon. Depending on the excited state energy level of the luminescent material, the electrons release photons of different energies during the transition back to the ground state, the energy determining the wavelength of the light, the different wavelengths meaning different colors of the light. Thus, the OLED display 95 can emit light of different colors in a self-luminous manner. The luminance or intensity of light emitted by the OLED display 95 depends on the properties of the light-emitting material and the amount of current applied. For the same OLED display screen 95, the greater the current, the higher the brightness of the light. Each pixel (composed of a plurality of sub-pixels that can self-emit light) in the OLED display screen 95 may be controlled to be on/off by an independent thin film transistor, so that each pixel may continuously and independently emit light. Thus, the OLED display 95 can display images by independently controlling the light emitting layers 954 of the pixels to emit light with different colors and brightnesses.

Referring to fig. 19 and 20, the Micro LED display 97 may include a driving substrate 971, an encapsulation substrate 972, a support 973, and a plurality of pixels 974. The driving substrate 971 and the package substrate 972 are disposed opposite to each other, and a plurality of pixels 974 are arranged between the driving substrate 971 and the package substrate 972. A visible light source 9741 is disposed in each pixel 974.

A display driving circuit (not shown) is disposed in the driving substrate 971, and the driving substrate 971 can control on/off and brightness of the light source in each pixel 974. The package substrate 972 is used for protecting the light source, and the material of the package substrate 972 may be plastic with certain hardness, such as polyethylene terephthalate (PET) or Polycarbonate (PC), or may be glass. The support 973 is used to keep a certain distance between the driving substrate 971 and the encapsulation substrate 972 and prevent excessive compression on the pixel 974.

Each pixel 974 further includes a lower pixel electrode 9742 and an upper pixel electrode 9743, the lower pixel electrode 9742 is disposed on the driving substrate 971, the upper pixel electrode 9743 is disposed under the encapsulation substrate 972, and the visible light source 9741 is sandwiched between the lower pixel electrode 9742 and the upper pixel electrode 9743. The material of the pixel electrode may be indium tin oxide or a conductive metal.

As shown in fig. 19, in one example, the plurality of visible light sources 9741 includes a red light source, a green light source, and a blue light source, and each visible light source 9741 and the corresponding pixel electrode form a pixel 974, so that the pixels 974 including different light sources emit light of different colors.

Referring to fig. 20, in another example, the structure of the pixel 974 may also include a visible light source 9741 and a color conversion layer 9744. For example, the plurality of visible light sources 9741 includes a red light source and a blue light source, and each of the visible light sources 9741 emits light of a corresponding color with the pixel 974 formed by the corresponding pixel electrode. The pixel 974 with the red light source emits red light, the pixel 974 with the blue light source emits blue light, and the pixel 974 with the blue light source and the color conversion layer 9744 emits green light. The pixels 974 also include a spacer layer 9745, the spacer layer 9745 facilitating height uniformity between the pixels 974.

The Micro LED display 97 can display images by independently controlling the visible light sources 9741 to emit light with different brightness and different colors.

The display screen 10 includes a display area 11, and the display area 11 can be used for displaying images. The shape of the display area 11 may be circular, elliptical, racetrack, rectangular with rounded corners, rectangular, etc. to adapt to different types of electronic devices 1000 and different user requirements.

Referring to fig. 3, the display area 11 is formed with a front surface 12 and a back surface 13 opposite to each other, the front surface 12 can be used for displaying images, and light is emitted outward along a direction from the back surface 13 to the front surface 12 and received by a user after passing through the front surface 12. Both the front surface 12 and the back surface 13 may be flat or curved.

In some examples, the display screen 10 may further include a non-display area, and the non-display area may be formed at a periphery of the display area 11. The non-display area may not be used for display, and the non-display area may be used for bonding with the housing 30 or for wiring, for example, the non-display area may be bonded with the housing 30 by an adhesive without affecting the display function of the display area 11. The display screen 10 may also be a touch display screen integrated with a touch function, and after obtaining image information displayed on the display screen 10, a user may perform touch on the display screen 10 to implement a predetermined interactive operation.

The time-of-flight component 20 may utilize the principles of time-of-flight ranging to obtain depth information of a target object for three-dimensional modeling, generating three-dimensional images, ranging, and the like. The time of flight module 20 may be mounted in the housing 30 of the electronic device 1000, and specifically, after being mounted on a rack, the rack and the time of flight module 20 may be mounted in the housing 30 together. Time of flight component 20 may include an optical transmitter 21 and an optical receiver 22.

Referring to fig. 1 to 3, the light emitter 21 is disposed on a side of the display screen 10 where the back surface 13 is located, or the light emitter 21 is disposed below the display area 11, and the light emitter 21 is used for emitting laser pulses passing through the display area 11. Specifically, the light emitter 21 may include a light source and an optical element, and light (for example, infrared laser light) emitted from the light source passes through the optical element, is expanded, is emitted, and then passes through the display area 11 to be projected to the outside. In one example, the transmittance of the display area 11 may be 60% or more, so that the laser pulses emitted by the light emitter 21 are less lossy when passing through the display area 11.

The light receiver 22 may include an infrared sensor, the laser pulse is emitted to the target object, and after being reflected by the target object, the laser pulse can be obtained by the light receiver 22, and the light receiver 22 receives the laser pulse reflected by the target object, and the depth data of the target object can be obtained by combining the time when the light emitter 21 emits the laser pulse. The light receiver 22 may also be arranged on the side of the display screen 10 where the back surface 13 is located, i.e. under the display screen 10, and in particular may be arranged on the same support as the light emitter 21, or the light receiver 22 may be mounted directly on the housing 30. At this time, the light incident surface of the light receiver 22 may be aligned with the display region 11, and the laser pulse reflected by the target object passes through the display region 11 and is received by the light receiver 22.

In summary, since the light receiver 22 is disposed on the side of the display screen 10 where the back surface 13 is located, and the light receiver 22 can receive the laser pulses passing through the display area 11, there is no need to provide an opening aligned with the light emitter 21 on the display screen 10, and the screen ratio of the electronic device 1000 is high. In addition, the optical receiver 22 according to the embodiment of the present invention is disposed below the display screen 10, and the display screen 10 has less influence on the acquisition depth of the time-of-flight module 20 than a structured light module that acquires depth information using structured light. Specifically, when the structured light emitted by the structured light assembly passes through the display screen 10, the structured light may be diffracted by the display screen 10, so that the structured light pattern actually emitted into the environment is inconsistent with the structured light pattern emitted by the structured light assembly, which may affect the accuracy of the depth information subsequently acquired according to the structured light pattern 40 reflected back by the target object. Since the time-of-flight assembly 20 of the embodiment of the present invention obtains the depth information of the target object by the time-of-flight ranging principle, even if the laser pulse emitted by the light emitter 21 is diffracted by the display screen 10, the time difference between the emission and the reception of the laser will not be affected, i.e., the accuracy of the depth information obtained by the time-of-flight assembly 20 is high.

Referring to fig. 4, in some embodiments, the display screen 10 is formed with through slots 14, and the through slots 14 do not have a display function. The through-groove 14 penetrates the front surface 12 and the back surface 13. The light emitter 21 is arranged on the side of the rear surface 13 of the display screen 10, while the light emitter 21 is arranged to emit laser light pulses through the through slot 14.

At this time, the light incident surface of the light emitter 21 may be aligned with the through groove 14, and the laser pulse emitted by the light emitter 21 passes through the through groove 14 and then exits to the outside. In this embodiment, since the laser pulse emitted to the outside does not need to pass through the solid portion of the display area 11, the intensity of the laser pulse is not weakened or affected by refraction or the like of the solid portion of the display area 11, and the depth detection is accurate.

Specifically, in the example shown in fig. 5, the through-groove 14 includes a notch 141 formed on an edge of the display screen 10, or the through-groove 14 intersects the edge of the display screen 10. The notch 141 may be formed on any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the notch 141 may be any shape such as triangle, semicircle, rectangle, racetrack, etc., and is not limited herein.

In the example shown in fig. 6, the through-groove 14 includes a through-hole 142 spaced from the edge of the display screen 10, or the through-groove 14 opens within the range enclosed by the edge of the display screen 10. The through holes 142 may be disposed near any one or more of the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10. The shape of the through hole 142 may be any shape such as triangle, circle, rectangle, racetrack, etc., and is not limited herein.

In some examples, the through slot 14 may also include the notch 141 and the through hole 142. The number of the notches 141 and the through holes 142 may be equal or unequal.

Referring to fig. 4, in some embodiments, the electronic device 1000 further includes a cover 40, and the cover 40 is disposed on a side of the front 12 of the display screen 10. When the display screen 10 is provided with the through groove 14, the infrared transmitting layer 50 is disposed on the region of the cover plate 40 corresponding to the through groove 14.

The cover plate 40 may be made of a material having a good light transmission property, such as glass or sapphire. The infrared-transmitting layer 50 may be an infrared-transmitting ink or an infrared-transmitting film, and the infrared-transmitting layer 50 has a high transmittance, for example, a transmittance of 85% or more, to infrared light (for example, light having a wavelength of 940 nm), and has a low transmittance to light other than infrared light or is completely opaque to light other than infrared light. Therefore, it is difficult for a user to see the light emitter 21 aligned with the through-groove 14 through the cover plate 40, and the electronic device 1000 has a good appearance.

Referring to fig. 7, in some embodiments, the electronic device 1000 further includes a cover plate 40, the cover plate 40 is disposed on a side of the front surface 12 of the display screen 10, and an infrared antireflection film 60 is formed on a region of the cover plate 40 corresponding to the light emitter 21.

The infrared antireflection film 60 may increase the transmittance of infrared light, and when the light emitter 21 emits infrared laser light (i.e., infrared laser pulses), the infrared antireflection film 60 may increase the transmittance of the infrared laser light passing through the cover plate 40, so as to reduce the loss of the infrared laser light passing through the cover plate 40, thereby reducing the power consumption of the electronic device 1000. Specifically, the infrared reflection reducing coating 60 may be coated on the upper surface, the lower surface, or both the upper surface and the lower surface of the cover plate 40.

Of course, an infrared reflection reducing coating 60 may also be formed on the cover plate 40 in the region corresponding to the light receiver 22 to reduce the loss of the external infrared light passing through the cover plate 40 before reaching the light receiver 22. At this time, the visible light antireflection film 80 may be formed on the cover plate 40 in the region not corresponding to the light emitter 21 and the light receiver 22, so as to improve the transmittance of the visible light emitted from the display screen 10 when passing through the cover plate 40.

Referring to fig. 8, in some embodiments, an infrared antireflection film 60 is formed on the area of the display screen 10 corresponding to the light receiver 22.

The infrared antireflection film 60 may increase the transmittance of infrared light, and when the light receiver 21 receives infrared laser light, the infrared antireflection film 60 may increase the transmittance of the infrared laser light passing through the display screen 10, so as to reduce the loss of the infrared laser light passing through the display screen 10, thereby reducing the power consumption of the electronic device 1000. Specifically, infrared antireflection film 60 may be formed on front surface 12 or rear surface 13 of display region 11, or on both front surface 12 and rear surface 13 of display region 11. In one example, infrared antireflection film 60 may also be formed inside display panel 10, for example, when display panel 10 is a liquid crystal display panel 93, infrared antireflection film 60 may be formed on a polarizer in display panel 10, or on an electrode plate of display panel 10, or the like.

Of course, when the through groove 14 is not formed at the position of the display screen 10 corresponding to the light emitter 21, the infrared antireflection film 60 may also be formed in the area of the display screen 10 corresponding to the light emitter 21.

Referring to fig. 9, in some embodiments, an infrared-transmitting layer 50 is formed on a region of the display screen 10 corresponding to the light receiver 22. As described above, the infrared transmitting layer 50 has a high transmittance to infrared light, but has a low transmittance to light other than infrared light (e.g., visible light) or is completely opaque to light other than infrared light (e.g., visible light), so that the user cannot easily see the light receiver 22, and the influence of light other than infrared light passing through the display screen 10 on the light receiver 22 can be reduced.

Meanwhile, when the through groove 14 is not formed in the position of the display screen 10 corresponding to the light emitter 21, the infrared transmitting layer 50 may also be formed in the area of the display screen 10 corresponding to the light emitter 21, so that the loss of the infrared laser light when passing through the display screen 10 may be reduced.

Referring to fig. 10, in some embodiments, the display screen 10 is formed with a through-slot 14 penetrating the front surface 12 and the back surface 13. The electronic device 1000 also includes a visible light camera 70, the visible light camera 70 being disposed in alignment with the through slots 14. The cover plate 40 has a visible light reflection reducing film 80 and/or an infrared cut-off film 90 formed in a region corresponding to the through groove 14.

The visible light camera 70 may be used to receive visible light through the cover plate 40 and the through slot 14 to capture images. Forming the visible light antireflection film 80 on the cover plate 40 in the region corresponding to the through groove 14 can increase the transmittance of visible light when the visible light passes through the cover plate 40, so as to improve the imaging quality of the visible light camera 70. Forming the infrared cut film 90 on the cover plate 40 in the region corresponding to the through-groove 14 can reduce the transmittance of infrared light when the infrared light passes through the cover plate 40, or completely prevent the infrared light from entering the visible light camera 70, to reduce the influence of the infrared light on imaging of the visible light camera 70.

Referring to fig. 1 and 11, in some embodiments, the display area 11 includes a first sub-display area 111 and a second sub-display area 112. The light emitter 21 emits laser light pulses through the first sub-display area 111. In one example, when the through slot 14 corresponding to the light emitter 21 is not opened, the laser pulse firstly passes through the first sub-display area 111, then is reflected by the target object, and passes through the first sub-display area 111 to reach the light receiver 22; in another example, when the through-groove 14 corresponding to the light emitter 21 needs to be opened, the through-groove 14 may be opened on the first sub-display region 111, and the laser pulse first passes through the through-groove 14, then is reflected by the target object and passes through the first sub-display region 111 to reach the light receiver 22.

The display region 11 includes a plurality of pixels 15, the plurality of pixels 15 being arranged in a predetermined manner with a microscopic gap between adjacent pixels 15. The pixels 15 may self-emit light to assume corresponding colors; the pixels 15 may also exhibit a corresponding color under the influence of the backlight. In one embodiment, the pixel density of the first sub-display region 111 is less than that of the second sub-display region 112, that is, the micro-gap between the pixels 15 of the first sub-display region 111 is greater than that between the pixels 15 of the second sub-display region 112, the blocking effect of the first sub-display region 111 on light is small, and the transmittance of light passing through the first sub-display region 111 is high. Therefore, the transmittance of the laser pulse emitted from the light emitter 21 through the first sub-display section 111 is high, and the transmittance of the reflected laser pulse through the first sub-display section 111 is high before being received by the light receiver 22. Of course, in other embodiments, the pixel density of the first sub-display area 111 may be greater than or equal to the pixel density of the second sub-display area 112.

The shapes of the first sub-display area 111 and the second sub-display area 112 may be set according to specific requirements, and are not limited herein, for example, the first sub-display area 111 may be set to be racetrack shaped (as shown in fig. 11), drop shaped, etc., and the second sub-display area 112 and the first sub-display area 111 may be complementary and together form the display area 11 with a rectangular shape or a rounded rectangle shape, etc. The first sub display region 111 may be located near an edge of the display region 11, and the second sub display region 112 may be located at a middle position of the display region 11. The first sub-display area 111 may be used for displaying status icons of the electronic device 1000, for example, for displaying battery level, network connection status, system time, and the like of the electronic device 1000.

Specifically, referring to fig. 11, in one example, the display screen 10 is an independent screen structure, that is, the display screen 10 is an integral body, and each pixel 15 of the plurality of pixels 15 of the display screen 10 can be independently controlled. The first sub-display area 111 includes a first set of pixels 15, and the second sub-display area 112 includes a second set of pixels 15. It will be appreciated that the plurality of pixels 15 within the first set of pixels and the plurality of pixels 15 within the second set of pixels may each be independently controlled. At this time, the display screen 10 is a self-luminous display screen, the type of the display screen 10 may be an OLED display screen 95 or a Micro LED display screen 97, and each pixel 15 of the display screen 10 may be independently controlled to emit light or not emit light or emit light with different light emitting brightness. When the display panel 10 is an independent panel structure, the pixel density of the first sub-display area 111 is less than that of the second sub-display area 112, which means that the pixel density of the first pixel set is less than that of the second pixel set.

Referring to fig. 12, in another example, the display screen 10 includes a first sub-screen 16 and a second sub-screen 17, that is, the display screen 10 may be composed of two independent sub-screens (the first sub-screen 16 and the second sub-screen 17), and the first sub-screen 16 and the second sub-screen 17 may be independently controlled. The first sub screen 16 may form a first sub display region 111, and the second sub screen 17 may form a second sub display region 112. At this time, the types of the first sub-screen 16 and the second sub-screen 17 may be the same, for example, the first sub-screen 16 and the second sub-screen 17 are both display screens that emit light through a backlight, such as the liquid crystal display screen 93; or the first sub-screen 16 and the second sub-screen 17 are both self-luminous display screens, for example, both are OLED display screens 95, or both are Micro LED display screens 97, or one is OLED display screen 95 and the other is Micro LED display screen 97. The types of the first sub-screen 16 and the second sub-screen 17 may also be different, for example, the first sub-screen 16 is a display screen (such as a liquid crystal display 93) that emits light by a backlight, and the second sub-screen 17 is a display screen that emits light by itself (such as an OLED display 95 or a Micro LED display 97); alternatively, the first sub-panel 16 is a self-luminous display panel (such as an OLED display panel 95 or a Micro LED display panel 97), and the second sub-panel 17 is a display panel (such as a liquid crystal display panel 93) which emits light through a backlight source. The specific selection manner of the first sub-screen 16 and the second sub-screen 17 is not limited to the above-described example.

In actual use, the first sub display area 111 and the second sub display area 112 can be independently controlled and displayed in different display states. Wherein the different display states may be on or off, displayed at different brightness, displayed at different refresh frequencies, etc. The display states of the first sub-display area 111 and the second sub-display area 112 can be controlled independently, so that the user can control the second sub-display area 112 to display normally according to actual requirements, and the first sub-display area 111 is used in cooperation with the light emitter 21 or the light receiver 22. For example, when the light emitter 21 emits the laser pulse or the light receiver 22 receives the reflected laser pulse, the first sub-display area 111 may be turned off, or the display brightness of the first sub-display area 111 may be reduced, or the refresh frequency of the first sub-display area 111 may be adjusted to shift the on time of the first sub-display area 111 from the on time of the light emitter 21 or the light receiver 22, so as to reduce the influence of the light emitter 21 emitting the laser pulse to the scene or the light receiver 22 receiving the reflected laser pulse when the first sub-display area 111 displays. When the optical transmitter 21 or the optical receiver 22 is not activated, the first sub-display area 111 and the second sub-display area 112 may both be turned on and displayed at the same refresh frequency.

Referring to fig. 13, a control method according to an embodiment of the invention can be used for controlling the electronic device 1000. The display area 11 of the electronic device 1000 is not provided with the through slot 14, and the light receiver 22 and the light emitter 21 are disposed corresponding to the first sub-display area 111 (as shown in fig. 1 and fig. 11). In this case, the display screen 10 may be a whole, and the display screen 10 is a self-luminous display screen. The display screen 10 comprises a plurality of pixels 15, each pixel 15 being capable of being independently controlled, wherein the plurality of pixels 15 form a first set of pixels, the remaining plurality of pixels 15 form a second set of pixels, the first set of pixels forms a first sub-display area 111, the second set of pixels forms a second sub-display area 112, the first set of pixels and the second set of pixels are independently controllable, and correspondingly, the first sub-display area 111 and the second sub-display area 112 are independently controllable; alternatively, the display panel 10 includes two separate sub-display panels (e.g., a first sub-panel 16 and a second sub-panel 17), both of which are self-luminous display panels. Each sub-display panel comprises a plurality of pixels 15, wherein the plurality of pixels 15 in one sub-display panel (e.g. the first sub-panel 16) form a first set of pixels, the first set of pixels forms the first sub-display area 111, the plurality of pixels 15 in the other sub-display panel (e.g. the second sub-panel 17) form a second set of pixels, the second set of pixels forms the second sub-display area 112, the first set of pixels and the second set of pixels can be independently controlled, and correspondingly, the first sub-display area 111 and the second sub-display area 112 can be independently controlled. The control method comprises the following steps:

00: determining whether the optical receiver 22 is on; and

01: when the light receiver 22 is turned on, the first pixel set and the second pixel set are controlled to display in different display states.

Referring to fig. 14, a control device 400 according to an embodiment of the present invention can be used to implement a control method according to an embodiment of the present invention. The control device 400 includes a determination module 401 and a control module 402. The determining module 401 may be configured to perform step 00, that is, the determining module 401 may be configured to determine whether the optical receiver 22 is turned on. The control module 402 may be configured to perform step 01, that is, the control module 402 may be configured to control the first set of pixels and the second set of pixels to be displayed in different display states when the optical receiver 22 is turned on.

Referring to fig. 1 again, in some embodiments, when the light receiver 22 is turned on, the first pixel set and the second pixel set are displayed in different display states.

Referring to fig. 1, in some embodiments, the electronic device 1000 further includes a processor 200, and the processor 200 is configured to perform the

steps

00 and 01, that is, the processor 200 is configured to determine whether the optical receiver 22 is turned on and control the first pixel set and the second pixel set to display in different display states when the optical receiver 22 is turned on.

When the optical receiver 22 is turned on, that is, when the optical receiver 22 receives the reflected laser pulse, the first pixel set and the second pixel set may be controlled to be displayed in different display states, and a user may control the display state of the first pixel set to adapt to the use requirement of the optical receiver 22 to improve the accuracy of the acquired depth information, and simultaneously control the display state of the second pixel set to adapt to the viewing requirement of the user to improve the use experience of the user.

It will be appreciated that, in use, the light emitter 21 and the light receiver 22 may be turned on simultaneously, or the time interval between the turning on of the light emitter 21 and the turning on of the light receiver 22 is very small, so that the above-mentioned time when the light receiver 22 is turned on, i.e. the time when the light emitter 21 is turned on, can be considered.

Referring to fig. 15, in some embodiments, step 01 includes step 011: when the light receiver 22 is turned on, the first set of pixels is controlled to be turned off, and the second set of pixels is controlled to be turned on.

Referring to fig. 14 again, in some embodiments, the control module 402 can be configured to perform step 011, i.e., the control module 402 can be configured to control the first set of pixels to be turned off and the second set of pixels to be turned on when the optical receiver 22 is turned on.

Referring back to fig. 1, in some embodiments, when the light receiver 22 is turned on, the first set of pixels is turned off and the second set of pixels is turned on.

Continuing to refer to FIG. 1, in some embodiments, processor 200 may be configured to perform step 011.

When the light receiver 22 receives the reflected laser pulse, if the first pixel set is in the on state at this time, that is, the first sub-display area 111 displays an image, light emitted by the pixels 15 in the first pixel set may interfere with the light receiver 22, which affects the accuracy of the time-of-flight component 20 in detecting the depth. In this embodiment, when the optical receiver 22 is turned on, the first pixel set is controlled to be turned off, the pixels 15 in the first pixel set do not emit light, and at this time, the first sub-display area 111 does not display an image, so as to prevent the first sub-display area 111 from interfering with the optical receiver 22, and meanwhile, the second pixel set is turned on, that is, the second sub-display area 112 is turned on, so that a user can still obtain information or perform interaction according to the image displayed by the second sub-display area 112, without affecting the use of other functions of the electronic device 1000.

Referring to fig. 16, in some embodiments, step 01 includes step 012: when the light receiver 22 is turned on, the first set of pixels is controlled to display at a first brightness, and the second set of pixels is controlled to display at a second brightness, wherein the first brightness is smaller than the second brightness.

Referring to fig. 14 again, in some embodiments, the control module 402 may be further configured to perform step 012, that is, the control module 402 may be configured to control the first set of pixels to be displayed at a first brightness and the second set of pixels to be displayed at a second brightness when the optical receiver 22 is turned on, where the first brightness is smaller than the second brightness.

Referring to fig. 1 again, in some embodiments, when the light receiver 22 is turned on, the first set of pixels is displayed at a first brightness, and the second set of pixels is displayed at a second brightness, where the first brightness is less than the second brightness.

Continuing to refer to fig. 1, in some embodiments, the processor 200 may be configured to perform step 012.

When the light receiver 22 is turned on, both the first pixel set and the second pixel set may be in an on state so as not to affect the integrity of the image displayed in the display area 11, and meanwhile, the display brightness of the first pixel set is less than that of the second pixel set so as to reduce the intensity of the light emitted by the pixels 15 in the first pixel set, thereby reducing the interference with the light receiver 22.

In addition, in some examples, the first set of pixels may be controlled to be displayed at the lowest brightness while the display brightness of the second set of pixels is unchanged when the light receiver 22 is turned on; or depending on different usage scenarios, when the optical receiver 22 is turned on, the first set of pixels may be controlled to be displayed at different brightness, for example, when the payment scenario has a high requirement on accuracy of depth information acquisition, and when the optical receiver 22 is turned on, the first set of pixels is controlled to be displayed at the lowest brightness; when the scene is unlocked, the accuracy requirement on the acquisition of the depth information is low, and when the light receiver 22 is turned on, the first pixel set is controlled to display at a brightness higher than the lowest brightness.

Referring to fig. 13, 15 and 16, in some embodiments, the control method further includes step 02: when the light receiver 22 is turned off, the first set of pixels and the second set of pixels are both controlled to be turned on.

Referring to fig. 14, in some embodiments, the control module 402 may be further configured to perform step 02, that is, the control module 402 may be configured to control both the first set of pixels and the second set of pixels to be turned on when the optical receiver 22 is turned off.

Referring back to fig. 1, in some embodiments, the first set of pixels and the second set of pixels are both turned on when the light receiver 22 is turned off.

Continuing to refer to fig. 1, in some embodiments, processor 200 may be configured to perform step 02.

When the light receiver 22 is turned off, that means, the user does not need to use the light receiver 22 at this time, that is, the light receiver 22 does not need to receive the reflected laser pulses passing through the first set of pixels, so that the first set of pixels and the second set of pixels are controlled to be turned on, so that the whole display area 11 is used for displaying images, thereby improving the user's appearance when using the electronic device 1000.

With reference to fig. 11 and 12, it can be understood that, in combination with the above description of the display panel 10, when the display panel 10 is an independent display panel 10 including a plurality of pixels 15, controlling the turn-off, turn-on and display brightness of the first sub-display area 111 can be implemented by controlling the turn-off, turn-on and light-emitting brightness of the first pixel set; controlling the turn-off, turn-on and display brightness of the second sub-display area 112 can be realized by controlling the turn-off, turn-on and light-emitting brightness of the second pixel set. When the display panel 10 includes two independent sub-display panels, and each sub-display panel is composed of a plurality of independently controllable pixels 15, controlling the turning-off, turning-on and displaying brightness of the first sub-display region 111 can be realized by controlling the turning-off, turning-on and displaying brightness of the first pixel set in the first sub-panel 16; controlling the turn-off, turn-on and display brightness of the second sub-display area 112 can be achieved by controlling the turn-off, turn-on and display brightness of the second set of pixels in the second sub-screen 17. When the first sub-display area 111 and the second sub-display area 112 are both opened, the picture displayed in the first sub-display area 111 and the picture displayed in the second sub-display area 112 may together form a complete display picture, for example, when the electronic device 1000 is playing a movie, the display area 11 displays one frame of movie picture, where the movie picture has one tree, one man, and one woman, and then the man and the woman may all be located in the first sub-display area 111, most of the woman is in the first sub-display area 111, and the arm is in the second sub-display area 112; alternatively, the frame displayed in the first sub-display area 111 and the frame displayed in the second sub-display area 112 are two separate display frames, for example, when the electronic device 1000 is currently performing a task of playing a movie, the movie frame is displayed in the first sub-display area 111, and the second sub-display area 112 may synchronously display the battery power, the network connection status, the system time, and the like of the electronic device 1000, or synchronously display an instant messaging message or a message notification of each application program. Similarly, when the display screen 10 includes the first sub-screen 16 and the second sub-screen 17, and both the first sub-screen 16 and the second sub-screen 17 are turned on, the picture displayed by the first sub-screen 16 and the picture displayed by the second sub-screen 17 may also form a complete display picture together, or the picture displayed by the first sub-screen 16 and the picture displayed by the second sub-screen 17 are two independent display pictures.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. An electronic device is characterized by comprising a display screen and a time-of-flight component, wherein the display screen comprises a display area, the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display area comprises a first pixel set and a second pixel set which can be independently controlled, the first pixel set and the second pixel set both comprise a plurality of pixels which can be independently controlled, a light receiver corresponds to the first pixel set, the light receiver is arranged on one side of the back surface of the display screen, and the light receiver is used for receiving laser pulses which are reflected and pass through the first pixel set; when the light receiver is switched on, the first pixel set and the second pixel set are displayed in different display states.

2. The electronic device of claim 1, wherein the first set of pixels is off and the second set of pixels is on when the light receiver is on.

3. The electronic device of claim 2, wherein the first set of pixels and the second set of pixels are both on when the light receiver is off.

4. The electronic device of claim 1, wherein the processor is further configured to:

when the light receiver is switched on, the first pixel set is controlled to be displayed at a first brightness, the second pixel set is controlled to be displayed at a second brightness, and the first brightness is smaller than the second brightness.

5. The electronic device of claim 1, wherein a pixel density of the first set of pixels is less than a pixel density of the second set of pixels.

6. A control method is used for an electronic device, and the electronic device comprises a display screen and a time-of-flight assembly, wherein the display screen comprises a display area, the display area is provided with a front surface and a back surface which are opposite to each other, light emitted by the display screen is emitted to the outside along the direction of the back surface pointing to the front surface, the display area comprises a first pixel set and a second pixel set which can be independently controlled, the first pixel set and the second pixel set both comprise a plurality of pixels which can be independently controlled, the time-of-flight assembly comprises a light receiver, the light receiver is arranged on one side of the back surface of the display screen, the light receiver corresponds to the first pixel set, and the light receiver is used for receiving laser pulses which are reflected and pass through the first pixel set; the control method comprises the following steps:

judging whether the optical receiver is started; and

when the light receiver is switched on, the first pixel set and the second pixel set are controlled to be displayed in different display states.

7. The control method according to claim 6, wherein the controlling the first set of pixels and the second set of pixels to be displayed in different display states when the light receiver is turned on comprises:

and when the light receiver is switched on, controlling the first pixel set to be switched off and controlling the second pixel set to be switched on.

8. The control method according to claim 7, characterized by further comprising:

and when the light receiver is switched off, controlling the first pixel set and the second pixel set to be switched on.

9. The control method according to claim 6, wherein the controlling the first set of pixels and the second set of pixels to be displayed in different display states when the light receiver is turned on comprises:

10. A control device is used for an electronic device and is characterized in that the electronic device comprises a display screen and a time-of-flight assembly, the display screen comprises a display area, the display area is provided with a front surface and a back surface which are opposite to each other, light rays emitted by the display screen are emitted to the outside along the direction of the back surface pointing to the front surface, the display area comprises a first pixel set and a second pixel set which can be independently controlled, the first pixel set and the second pixel set both comprise a plurality of pixels which can be independently controlled, the time-of-flight assembly comprises a light receiver, the light receiver corresponds to the first pixel set, the light receiver is arranged on one side of the back surface of the display screen, and the light receiver is used for receiving laser pulses which are reflected and pass through the first pixel set; the control device includes:

the judging module is used for judging whether the optical receiver is started or not; and

a control module, configured to control the first pixel set and the second pixel set to be displayed in different display states when the light receiver is turned on.