WO2020098331A1 - 电子装置及其控制方法和控制装置 - Google Patents

电子装置及其控制方法和控制装置 Download PDF

Info

Publication number
WO2020098331A1
WO2020098331A1 PCT/CN2019/102700 CN2019102700W WO2020098331A1 WO 2020098331 A1 WO2020098331 A1 WO 2020098331A1 CN 2019102700 W CN2019102700 W CN 2019102700W WO 2020098331 A1 WO2020098331 A1 WO 2020098331A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
sub
structured light
display area
screen
Prior art date
Application number
PCT/CN2019/102700
Other languages
English (en)
French (fr)
Inventor
杨鑫
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2020098331A1 publication Critical patent/WO2020098331A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/40Transceivers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0264Details of the structure or mounting of specific components for a camera module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0266Details of the structure or mounting of specific components for a display module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0277Details of the structure or mounting of specific components for a printed circuit board assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene

Definitions

  • the present application relates to the field of consumer electronics technology, and more specifically, to an electronic device, a control method of the electronic device, and a control device of the electronic device.
  • the electronic device in order to make the functions of the electronic device more diversified, the electronic device is provided with a depth image acquisition module to acquire depth information of the scene.
  • Embodiments of the present application provide an electronic device, a control method of the electronic device, and a control device of the electronic device.
  • the electronic device includes a display screen and a structured light component.
  • the display screen includes a display area for displaying images, and the display area is formed with opposite front and back surfaces, and light emitted from the display screen is emitted to the outside world in a direction in which the back surface is directed to the front surface, and the display
  • the area includes a first sub-display area and a second sub-display area.
  • the structured light component includes a structured light camera, the structured light camera is disposed on the side of the back side of the display screen, the structured light camera corresponds to the first sub-display area, and the structured light camera is used Receiving the modulated laser light passing through the first sub-display area.
  • the structured light camera When the structured light camera is turned on, the display area displays the image with a first display timing, the structured light camera exposes with an exposure timing, the effective working state corresponding to the first display timing and the exposure timing The corresponding valid working status is staggered.
  • the control method in the embodiments of the present application may be used in an electronic device, and the electronic device includes a display screen and a structured light component.
  • the display screen includes a display area for displaying images, and the display area is formed with opposite front and back surfaces, and light emitted from the display screen is emitted to the outside world in a direction in which the back surface is directed to the front surface, and the display
  • the area includes a first sub-display area and a second sub-display area.
  • the structured light component includes a structured light camera, the structured light camera is disposed on the side of the back side of the display screen, the structured light camera corresponds to the first sub-display area, and the structured light camera is used Receiving the modulated laser light passing through the first sub-display area.
  • the control method includes: determining whether the structured light camera is turned on; when the structured light camera is turned on, controlling the display area to display the image at a first display timing, and the structured light camera to expose at an exposure timing,
  • the effective working state corresponding to the first display timing is staggered from the effective working state corresponding to the exposure timing.
  • the control device of the embodiment of the present application may be used in an electronic device, and the electronic device includes a display screen and a structured light component.
  • the display screen includes a display area for displaying images, and the display area is formed with opposite front and back surfaces, and light emitted from the display screen is emitted to the outside world in a direction in which the back surface is directed to the front surface, and the display
  • the area includes a first sub-display area and a second sub-display area.
  • the structured light component includes a structured light camera, the structured light camera is disposed on the side of the back side of the display screen, the structured light camera corresponds to the first sub-display area, and the structured light camera is used Receiving the modulated laser light passing through the first sub-display area.
  • the control device includes a judgment module and a control module.
  • the judgment module is used to judge whether the structured light camera is turned on.
  • the control module is used to control the display area to display the image with a first display timing when the structured light camera is turned on, and the structured light camera to expose with an exposure timing, and the first display timing corresponds to the effective The working state and the effective working state corresponding to the exposure timing are staggered.
  • FIG. 1 is a schematic structural diagram of an electronic device according to some embodiments of the present application.
  • FIG. 2 is a partial structural diagram of an electronic device according to some embodiments of the present application.
  • FIG. 3 is a schematic cross-sectional view of the electronic device of some embodiments of the present application taken along line A-A shown in FIG. 2.
  • FIG. 4 is a schematic diagram of a structured light projector according to some embodiments of the present application.
  • FIG. 5 is a schematic cross-sectional view of an electronic device according to certain embodiments of the present application taken along the line A-A shown in FIG. 2.
  • FIGS. 6 and 7 are schematic diagrams of partial structures of electronic devices according to certain embodiments of the present application.
  • FIG. 8 is a schematic cross-sectional view of an electronic device according to some embodiments of the present application along a position corresponding to line A-A shown in FIG. 2.
  • 9 and 10 are schematic diagrams of partial structures of electronic devices according to some embodiments of the present application.
  • 11 to 15 are schematic cross-sectional views of the electronic device of certain embodiments of the present application along the position corresponding to line A-A shown in FIG. 2.
  • 16 is a schematic flowchart of a control method of an electronic device according to some embodiments of the present application.
  • 17 is a schematic block diagram of a control device of an electronic device according to some embodiments of the present application.
  • 18 is a schematic flowchart of a control method of an electronic device according to some embodiments of the present application.
  • FIG. 19 is a partial structural diagram of an electronic device according to some embodiments of the present application.
  • FIG. 20 is an exploded schematic diagram of a display screen in some embodiments of the present application.
  • 21 to 24 are schematic diagrams of the first display timing, the second display timing, and the exposure timing of some embodiments of the present application.
  • 25 and 26 are schematic flowcharts of a control method of an electronic device according to some embodiments of the present application.
  • FIG. 27 is a partial structural diagram of an LCD display screen according to some embodiments of the present application.
  • FIG. 28 is a partial structural diagram of an OLED display screen according to some embodiments of the present application.
  • 29 and 30 are schematic diagrams of partial structures of Micro LED display screens according to some embodiments of the present application.
  • the first feature is “on” or “under” the second feature may be that the first and second features are in direct contact, or the first and second features are indirectly through an intermediary contact.
  • the first feature is “above”, “above” and “above” the second feature may be that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature.
  • the first feature is "below”, “below”, and “below” the second feature may be that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is less horizontal than the second feature.
  • the electronic device 1000 includes a display screen 10 and a structured light component 20.
  • the electronic device 1000 may further include a housing 30, which may be used to install functional devices such as the display screen 10, the structured light assembly 20, and the functional device may also be a main board, a dual camera module, a receiver, and so on.
  • the specific form of the electronic device 1000 may be a mobile phone, a tablet computer, a smart watch, a head-mounted display device, etc. This application uses the electronic device 1000 as a mobile phone for illustration. It can be understood that the specific form of the electronic device 1000 is not limited to a mobile phone, and is not limited herein.
  • the display screen 10 may be installed on the housing 30. Specifically, the display screen 10 may be installed on one surface of the housing 30 or on both opposite surfaces of the housing 30 at the same time. In the example shown in FIG. 1, the display screen 10 is installed in front of the housing 30, and the display screen 10 can cover 85% or more of the area of the front, for example, 85%, 86%, 87%, 88%, 89%, 90%, 91%, 92%, 93%, 95% and even 100%.
  • the display screen 10 can be used to display images, and the images can be text, images, videos, icons, and other information.
  • the display screen 10 includes a display area 11, which can be used to display images.
  • the shape of the display area 11 may be circular, elliptical, racetrack, rounded rectangle, rectangular, etc.
  • the display area 11 is formed with a front surface 12 and a back surface 13 that are opposite to each other.
  • the display area 11 can be used to display images.
  • the light emitted by the display screen 10 is emitted in the direction of the back surface 13 pointing to the front surface 12, and the light passes through It is received by the user after passing through the front side 12, that is, the user can observe the image displayed on the display screen 10 from the front side 12.
  • the front surface 12 is a display surface
  • the back surface 13 is a surface opposite to the display surface. Both the front surface 12 and the back surface 13 may be flat or curved.
  • the display screen 10 may further include a non-display area, and the non-display area may be formed on the periphery of the display area 11.
  • the non-display area may not be used for display, and the non-display area may be used for combining with the housing 30 or for wiring.
  • the non-display area may be combined with the housing 30 by viscose without affecting the display function of the display area 11.
  • the display screen 10 may also be a touch display screen integrated with a touch control function. After the user obtains the image information displayed on the display screen 10, the user may perform touch control on the display screen 10 to achieve a predetermined interactive operation.
  • the display area 11 includes a plurality of pixels, the plurality of pixels are arranged in a predetermined manner, and there is a microscopic gap between adjacent pixels.
  • the display area 11 includes a first sub-display area 111 and a second sub-display area 112.
  • the pixel density of the first sub-display area 111 is smaller than the pixel density of the second sub-display area 112.
  • the pixel density of the first sub-display area 111 is less than the pixel density of the second sub-display area 112, that is, the micro-gap of the first sub-display area 111 is greater than the micro-gap of the second sub-display area 112.
  • the blocking effect of light is small, and the transmittance of light passing through the first sub-display area 111 is high.
  • the pixel density of the first sub-display area 111 is greater than the pixel density of the second sub-display area 112, or the pixel density of the first sub-display area 111 is equal to the pixel density of the second sub-display area 112.
  • the shapes of the first sub-display area 111 and the second sub-display area 112 can be set according to specific requirements, which is not limited herein, for example, the first sub-display area 111 can be set to a track shape or a water drop shape In other words, the second sub-display area 112 and the first sub-display area 111 may be complementary and together form a rectangular or rounded rectangular display area 11 or the like.
  • the first sub-display area 111 may be located near the edge of the display area 11, and the second sub-display area 112 may be located in the middle of the display area 11.
  • the first sub-display area 111 may be used to display the status icon of the electronic device 1000, for example, to display the battery level, network connection status, system time, etc. of the electronic device 1000.
  • the structured light component 20 can use the structured light to obtain the depth information of the target object for three-dimensional modeling, three-dimensional image generation, distance measurement, and the like.
  • the structured light assembly 20 may be installed in the housing 30 of the electronic device 1000, specifically after being installed on the bracket, and then the support and the structured light assembly 20 are installed in the housing 30 together.
  • the structured light assembly 20 may include a structured light projector 21, a structured light camera 22 and a floodlight 23.
  • the structured light projector 21 is arranged on the side where the back 13 of the display screen 10 is located, or the structured light projector 21 is arranged below the display area 11 (for example, it may be arranged in the first sub-display area 111 below), the structured light projector 21 is used to emit laser light passing through the display area 11.
  • the structured light projector 21 may include a light source 211, a collimating element 212, and a diffractive optical element 213.
  • the light (such as infrared laser light) emitted by the light source 211 is first collimated by the collimating element 212, and then diffracted by the diffractive optical element 213 It is emitted from the structured light projector 21 and then passes through the display area 11 to project to the outside world.
  • the light diffracts when passing through the micro gap, that is, the micro gap of the display area 11 and the diffractive structure on the diffractive optical element 213 have a diffractive effect on the light emitted by the light source 211.
  • the laser light that passes through the display area 11 and enters the outside world may contain both a pattern diffracted by the diffractive optical element 213 (the pattern includes a plurality of spots diffracted by the diffractive optical element 213) and a microscopic gap diffraction formed by the display screen 10
  • the pattern (the pattern includes a plurality of spots diffracted by the diffractive optical element 213 and diffracted by the display screen 10), so that the speckle pattern after passing through the display area 11 has a high irrelevance, which is beneficial to the subsequent dispersion
  • the spot pattern is processed.
  • the transmittance of the display area 11 can reach 60% or more, so that the laser light emitted by the structured light projector 21 passes through the display area 11 with less loss.
  • the structured light camera 22 may be an infrared camera, and the laser is emitted to the target object, and after being modulated by the target object, it may be acquired by the structured light camera 22, and the structured light camera 22 receives the modulated laser to obtain a speckle image, and the speckle image is processed Get the depth data of the target object.
  • the structured light camera 22 may also be arranged on the side of the back surface 13 of the display screen 10, that is, under the display screen 10 (for example, it may be arranged under the first sub-display area 111), and specifically may be arranged with the structured light projector 21 at The same bracket, or the structured light camera 22 is directly mounted on the housing 30.
  • the light incident surface of the structured light camera 22 can be aligned with the display area 11, and the laser light modulated by the target object passes through the display area 11 and then received by the structured light camera 22.
  • the laser light modulated by the target object can be adjusted by After the microscopic gap of the display screen 10 is diffracted, it is received by the structured light camera 22 again.
  • the floodlight 23 can be used to emit supplementary light outward, and the supplementary light can be used to supplement the light intensity in the environment when the ambient light is weak.
  • the supplementary light may be infrared light.
  • the floodlight 23 can also be arranged on the side where the back 13 of the display screen 10 is located, that is, under the display screen 10 (for example, it can be arranged under the first sub-display area 111), which can be specifically connected with the structured light projector 21 and structure
  • the optical camera 22 is arranged on the same bracket. At this time, the supplementary light emitted by the floodlight 23 passes through the microscopic gap of the display area 11 and enters the external environment. The reflected supplementary light can again pass through the microscopic gap to be received by the structured light camera 22.
  • the depth image acquisition module when the depth image acquisition module is disposed on the front side of the electronic device (the side with the display screen), the screen ratio of the electronic device is reduced.
  • the electronic device 1000 of the present application since the structured light camera 22 is disposed on the side where the back 13 of the display screen 10 is located, there is no need to provide an opening aligned with the structured light camera 22 on the display screen 10, and the screen share of the electronic device 1000 is compared high.
  • the structured light component 20 is disposed below the display screen 10, and compared with the flight time when the depth information can be collected, the resolution of the depth image acquired by the structured light component 20 is higher, and in face recognition Using a depth image with a higher resolution can improve the accuracy of face recognition, and using a depth image with a higher resolution in 3D scene modeling can improve the matching degree between the modeled 3D scene and the actual scene.
  • the laser light projected by the structured light projector 21 will be affected by the microscopic gap in the display screen 10 when passing through the first sub-display area 111, that is, the scattered light projected into the scene
  • the speckles in the speckle image simultaneously include speckles formed by laser light diffracted only once by the diffractive optical element 213 of the structured light projector 21, and speckles formed by laser light diffracted once by the diffractive optical element 213 and secondarily diffracted by the display screen 10.
  • the structured light camera 22 is arranged below the display screen 10, and the structured light camera 10 receives the laser light diffracted by the display screen 10 after being reflected by the target object and passing through the display screen 10, then the speckle image collected by the structured light camera 22
  • the speckles also include speckles where the laser light is diffracted only once by the diffractive optical element 213 and reflected by the target object, specks formed by the laser light diffracted once by the diffractive optical element 213 and then diffracted again by the display screen 10 and reflected by the target object, and diffracted by the laser light
  • the optical element 213 is diffracted once and then diffracted again by the display screen 10 and reflected by the target object.
  • the reference spot in the reference image also includes a reference spot formed by laser light diffracted only once by the diffractive optical element 213 and reflected by the calibrated object.
  • the reference spots in the reference image only include reference spots formed by laser light diffracted only once by the emitting optical element 213 and reflected by the calibration object. Among them, the brightness of the spots formed after different diffraction orders is different. Therefore, various types of spots can be distinguished by brightness, so that unnecessary spots can be filtered out.
  • the speckles in the speckle image collected by the structured light camera 22 provided below the display screen 10 also include speckles formed by the laser diffracted only once by the diffractive optical element 213 and reflected by the target object, and the laser passes through the diffractive optics
  • the element 213 is diffracted once and reflected by the target object.
  • the reference spots in the reference image also include the reference spots formed by laser light diffracted only once by the diffractive optical element 213 and reflected by the calibration object, and the laser light diffracted once by the diffractive optical element 213 and reflected by the calibration object by the display screen 10 Reference spots formed by secondary diffraction.
  • the reference spots in the reference image only include reference spots formed by laser light diffracted only once by the emitting optical element 213 and reflected by the calibration object. Among them, the brightness of the spots formed after different diffraction orders is different. Therefore, various types of spots can be distinguished by brightness, so that unnecessary spots can be filtered out.
  • the display screen 10 is formed with a through slot 14, and the through slot 14 does not have a display function.
  • the through groove 14 penetrates the front surface 12 and the rear surface 13.
  • the structured light projector 21 is arranged on the side where the back surface 13 of the display screen 10 is located, and the structured light projector 21 is used to emit laser light passing through the through slot 14.
  • the through slot 14 may be opened on the first sub-display area 111.
  • the light exit surface of the structured light projector 21 can be aligned with the through slot 14, and the laser light emitted by the structured light projector 21 passes through the through slot 14 and enters the outside world.
  • the laser light entering the outside does not need to pass through the microscopic gap of the display area 11 and will not be diffracted again by the microscopic gap, so that after the speckle image is acquired by the structured light camera 22, the subsequent calculation of the depth image based on the speckle image Difficulty of processing.
  • the through slot 14 includes a notch 141 formed on the edge of the display screen 10, or in other words, the through slot 14 intersects the edge of the display screen 10.
  • the notch 141 may be specifically formed on any one or more edges such as the upper edge, the lower edge, the left edge, and the right edge of the display screen 10.
  • the shape of the notch 141 may be any shape such as a triangle, a semicircle, a rectangle, a track shape, etc., which is not limited herein.
  • the through slot 14 includes a through hole 142 spaced from the edge of the display screen 10, or the through slot 14 is opened within a range enclosed by the edge of the display screen 10.
  • the through hole 142 may specifically be close to any one or more edges such as the upper edge, the lower edge, the left edge, and the right edge of the display screen 10.
  • the shape of the through hole 142 may be any shape such as a triangle, a circle, a rectangle, and a racetrack, which is not limited herein.
  • the through slot 14 may also include the aforementioned notch 141 and the through hole 142 at the same time.
  • the number of the notch 141 and the through hole 142 may be equal or unequal.
  • the floodlight 23 is disposed on the side where the back 13 of the display screen 10 is located, and the floodlight 23 is used to emit supplementary light passing through the through slot 14.
  • the supplementary light is directly emitted to the outside after passing through the through slot 14, and the supplementary light will not be weakened in the process of passing through the display area 11 to ensure that the target object receives a large amount of supplementary light.
  • the through slot 14 includes a notch 141 formed on the edge of the display screen 10, or the through slot 14 intersects the edge of the display screen 10.
  • the notch 141 may be specifically formed on any one or more edges such as the upper edge, the lower edge, the left edge, and the right edge of the display screen 10.
  • the shape of the notch 141 may be any shape such as a triangle, a semicircle, a rectangle, a track shape, etc., which is not limited herein.
  • the through slot 14 includes a through hole 142 spaced from the edge of the display screen 10, or the through slot 14 is opened within a range enclosed by the edge of the display screen 10.
  • the through hole 142 may be close to any one or more edges such as the upper edge, the lower edge, the left edge, the right edge, and the like of the display screen 10.
  • the shape of the through hole 142 may be any shape such as a triangle, a circle, a rectangle, and a racetrack, which is not limited herein.
  • the floodlight 23 and the structured light projector 21 may correspond to the same through slot 14.
  • the floodlight 23 and the structured light projector 21 may correspond to different through slots 14.
  • the electronic device 1000 further includes a cover 40.
  • the cover 40 is disposed on the side where the front surface 12 of the display screen 10 is located.
  • an infrared transmission layer 50 is provided on the area of the cover plate 40 corresponding to the through slot 14.
  • the cover plate 40 may be made of a material with good light transmission performance, such as glass or sapphire.
  • the infrared transmission layer 50 may be an infrared transmission ink or an infrared transmission film.
  • the infrared transmission layer 50 has a high transmittance for infrared light (for example, light with a wavelength of 940 nanometers), for example, the transmittance can reach 85% Or more, and the transmittance of light other than infrared light is low or makes light other than infrared light completely impermeable. Therefore, it is difficult for the user to see the structured light projector 21 or the floodlight 23 aligned with the through slot 14 through the cover plate 40, and the appearance of the electronic device 1000 is more beautiful.
  • the infrared transmission layer 50 is formed in the area of the cover plate 40 corresponding to the first sub-display area 111.
  • the electronic device 1000 further includes a cover plate 40.
  • the cover plate 40 is disposed on the side of the front surface 12 of the display screen 10.
  • the area of the cover plate 40 corresponding to the structured light projector 21 The infrared antireflection film 60 is formed.
  • the infrared anti-reflection film 60 can increase the transmittance of infrared light.
  • the infrared anti-reflection film 60 can increase the transmittance of the infrared laser through the cover plate 40 to reduce the infrared laser penetration
  • the loss of the cover 40 reduces the power consumption of the electronic device 1000.
  • the infrared antireflection film 60 may be plated on the upper surface, or the lower surface of the cover plate 40, or on both the upper surface and the lower surface.
  • the area on the cover plate 40 corresponding to the structured light camera 22 may also be formed with an infrared antireflection film 60 to reduce the loss of external infrared light passing through the cover plate 40 before reaching the structured light camera 22.
  • the area corresponding to the floodlight 23 on the cover plate 40 may also be formed with an infrared antireflection film 60 to reduce the loss of supplementary light emitted by the floodlight 23 when passing through the cover plate 40.
  • the area on the cover 40 that does not correspond to the structured light projector 21, the structured light camera 22, and the floodlight 23 may be formed with a visible light antireflection film 80 to improve the visible light emitted by the display screen 10 when passing through the cover 40 Transmittance.
  • an infrared anti-reflection film 60 is formed in the area of the display screen 10 corresponding to the structured light projector 21.
  • the infrared antireflection film 60 can increase the transmittance of infrared light.
  • the infrared antireflection film 60 can increase the transmittance of the infrared laser through the display screen 10 to reduce the infrared laser penetration
  • the loss of the display screen 10 further reduces the power consumption of the electronic device 1000.
  • the infrared antireflection film 60 may be formed on the front surface 12 or the back surface 13 of the display area 11, or simultaneously form the front surface 12 or the back surface 13 of the display area 11.
  • the infrared antireflection film 60 may also be formed inside the display screen 10, for example, when the display screen 10 is a liquid crystal display, the infrared antireflection film 60 may be formed on the polarizer in the display screen 10, or formed on The electrode plate of the display screen 10 and the like.
  • the through slot 14 when the through slot 14 is not provided at the position corresponding to the display screen 10 and the structured light projector 21, the area corresponding to the display screen 10 and the structured light projector 21 may also be formed with an infrared antireflection film 60.
  • the through slot 14 is not provided at the position corresponding to the display screen 10 and the floodlight 23, the area corresponding to the display screen 10 and the floodlight 23 may also form an infrared antireflection film 60.
  • an infrared transmission layer 50 is formed in the area of the display screen 10 corresponding to the structured light camera 22.
  • the infrared transmission layer 50 has a high transmittance for infrared light, and a low transmittance for light other than infrared light (such as visible light) or makes light other than infrared light (such as visible light) completely impermeable.
  • the infrared transmission layer 50 may also be formed in the area corresponding to the display screen 10 and the structured light projector 21, making it difficult for the user to see the structure Light projector 21.
  • the infrared transmission layer 50 may also be formed in the area corresponding to the display screen 10 and the floodlight 23.
  • an area of the display screen 10 corresponding to the first sub-display area 111 is formed with an infrared transmission layer 50.
  • the display screen 10 is formed with a through slot 14 penetrating the front surface 12 and the back surface 13.
  • the electronic device 1000 further includes a visible light camera 70 that is aligned with the through slot 14.
  • a visible light antireflection film 80 and / or an infrared cutoff film 90 are formed in the region of the cover plate 40 corresponding to the through groove 14.
  • the visible light camera 70 can be used to receive visible light passing through the cover plate 40 and the through slot 14 to obtain images.
  • Forming a visible light antireflection film 80 on the area of the cover plate 40 corresponding to the through groove 14 can increase the transmittance of visible light when passing through the cover plate 40, so as to improve the imaging quality of the visible light camera 70.
  • the formation of the infrared cut-off film 90 on the area of the cover plate 40 corresponding to the through slot 14 can reduce the transmittance of infrared light when passing through the cover plate 40, or completely prevent infrared light from entering the visible light camera 70 to reduce infrared light to the visible light camera 70 The impact of imaging.
  • an embodiment of the present application provides a control method, which can be used in the electronic device 1000 in any of the above embodiments.
  • the first sub-display area 111 and the second sub-display area 112 can be independently controlled.
  • the structured light camera 22 corresponds to the first sub-display area 111.
  • the control method includes:
  • the first sub-display area 111 is controlled to display images at the first display timing, and the structured light camera 22 is exposed at the exposure timing, and the effective working state corresponding to the first display timing is corresponding to the effective corresponding to the exposure timing
  • the working state is staggered.
  • control method in the embodiment of the present application may be implemented by the control device 400 in the embodiment of the present application, and the control device 400 may be used in the electronic device 1000.
  • the control device 400 includes a judgment module 401 and a control module 402. Among them, step 01 may be implemented by the judgment module 401, and step 02 may be implemented by the control module 402. That is to say, the determination module 401 can be used to determine whether the structured light camera 22 is turned on.
  • the control module 402 can be used to control the first sub-display area 111 to display images with the first display timing when the structured light camera 22 is turned on, and to expose the structured light camera 22 with the exposure timing.
  • the effective working state and exposure timing corresponding to the first display timing The corresponding valid working status is staggered.
  • the control method in the embodiment of the present application may be implemented by the electronic device 1000 in the embodiment of the present application, that is, when the structured light camera 22 is turned on, the first sub-display area 111 displays images at the first display timing, and the structured light camera 22 Exposure is performed at the exposure timing, and the effective working state corresponding to the first display timing is staggered from the effective working state corresponding to the exposure timing.
  • the electronic device 1000 may further include a processor 200, where Step 01 and Step 02 may be implemented by the processor 200.
  • the structured light camera 22 When the structured light camera 22 is turned on, the structured light camera 22 receives the modulated laser light passing through the first sub-display area 111. At this time, the light used for displaying images in the first sub-display area 111 may interfere with the structured light camera 22, thereby As a result, the speckle image obtained by the structured light camera 22 has a large error, and the depth information of the target object cannot be accurately obtained.
  • the effective working state corresponding to the exposure timing of the structured light camera 22 and the effective working state corresponding to the first display timing of the first sub-display area 111 can be staggered from each other, that is, when the first sub-display area 111 displays an image, the structured light camera 22 does not During exposure, the structured light camera 22 does not display an image when the structured light camera 22 performs exposure, thereby reducing or avoiding interference to the structured light camera 22 when the first sub-display area 111 displays an image.
  • the structured light projector 21 and the structured light camera 22 can be turned on at the same time, or the time interval between the two is turned on is very small, so the time when the structured light camera 22 is turned on can also be regarded as a structure The moment when the light projector 21 is turned on.
  • the electronic device 1000 when the first sub-display area 111 displays an image, the electronic device 1000 generates a first interrupt signal to stop the structured light camera 22 from being exposed; and / or, on the structured light camera 22 During exposure, the electronic device 1000 generates a second interrupt signal to stop the first sub-display area 111 from displaying images.
  • step 02 includes:
  • a first interrupt signal is generated to stop the exposure of the structured light camera 22; and / or
  • a second interrupt signal is generated to stop the first sub-display area 111 from displaying images.
  • step 021 and step 022 may be implemented by the control module 402, that is, the control module 402 may be used to generate a first interrupt when displaying images in the first sub-display area 111 A signal to cause the structured light camera 22 to stop exposure; and / or, when the structured light camera 22 is exposed, a second interrupt signal is generated to stop the first sub-display area 111 from displaying images.
  • step 021 and step 022 may also be implemented by the processor 200.
  • the frame rate of the image displayed by the first sub-display area 111 may be determined first, for example, the first sub-display area 111 is displayed at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc.
  • the first display timing of the first sub-display area 111 can be determined according to the frame rate of the image displayed by the first sub-display area 111.
  • the control signal corresponding to the first display timing may be at a high level.
  • a first interrupt signal may be generated to stop the exposure of the structured light camera 22, and the exposure timing of the structured light camera 22 corresponds to The control signal of can be low; when the first sub-display area 111 does not display images, the control signal corresponding to the first display timing can be low, and the structured light camera 22 can determine whether to perform exposure according to the frame rate of the acquired image
  • the control signal corresponding to the exposure timing of the structured light camera 22 may be high, and when the structured light camera 22 does not perform exposure, the control signal corresponding to the exposure timing of the structured light camera 22 may be Low level, so that the exposure timing of the structured light camera 22 can be obtained and the effective working state corresponding to the first display timing (ie, the corresponding control signal is high level) and the effective working state corresponding to the exposure timing (ie, the corresponding control signal Is high) staggered from each other.
  • the structured light camera 22 stops the exposure, so as to reduce or avoid
  • the frame rate of the structured light camera 22 to acquire an image may be determined first, for example, the structured light camera 22 performs exposure at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc., depending on the structure
  • the frame rate of the image acquired by the optical camera 22 can determine the exposure timing of the structured optical camera 22.
  • the control signal corresponding to the exposure timing may be a high level.
  • a second interrupt signal may be generated to stop the first sub-display area 111 from displaying an image.
  • the control signal corresponding to the display timing can be at a low level; when the structured light camera 22 does not perform exposure, the control signal corresponding to the exposure timing can be at a low level, and the first sub-display area 111 can determine whether to display according to the frame rate of the displayed image For images, when the first sub-display area 111 displays an image, the control signal corresponding to the first display timing of the first sub-display area 111 may be a high level.
  • the first sub-display area 111 When the first sub-display area 111 does not display an image, the first sub-display The control signal corresponding to the first display timing of the area 111 may be a low level, so that the first display timing of the first sub-display area 111 may be obtained and the effective working state corresponding to the first display timing (ie, the corresponding control signal is high (Level) The effective working state corresponding to the exposure timing (that is, the corresponding control signal is high) is staggered from each other.
  • the first sub-display area 111 stops displaying images, thereby reducing or avoiding interference to the structured light camera 22 when the first sub-display area 111 displays images.
  • the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the display screen 10 is an independent screen structure, that is, the display screen 10 is a whole, Each pixel of the plurality of pixels of the display screen 10 can be independently controlled.
  • the first sub-display area 111 includes a first pixel set composed of multiple pixels
  • the second sub-display area 112 includes a second pixel set composed of multiple pixels. It can be understood that multiple pixels in the first pixel set and multiple pixels in the second pixel set can be independently controlled.
  • the type of the display screen 10 may be a self-luminous display screen, such as an OLED display screen or a Micro LED display screen, etc.
  • Each pixel of the self-luminous display screen may be independently controlled to emit light or not to emit light or to different
  • the display timing of the first sub display area 111 and / or the second sub display area 112 can be controlled by controlling the light emission timing of the pixels.
  • the pixels of the self-luminous display screen can self-illuminate to present corresponding colors.
  • the first sub-display area 111 and the second sub-display area 112 can be independently controlled.
  • the display screen 10 includes a first sub-screen 16 and a second sub-screen 17, that is, the display screen 10 It may be composed of two independent sub-display screens (first sub-screen 16 and second sub-screen 17), and the first sub-screen 16 and the second sub-screen 17 may be independently controlled.
  • the first sub-screen 16 may form a first sub-display area 111
  • the second sub-screen 17 may form a second sub-display area 112.
  • the types of the first sub-screen 16 and the second sub-screen 17 may be the same, for example, they are both liquid crystal display screens, both OLED display screens, or both Micro LED display screens; the first sub-screen 16 and the second sub-screen 17
  • the type can also be different, for example, the first sub-screen 16 is a display screen (such as a liquid crystal display) that emits light through a backlight, and the second sub-screen 17 is a self-luminous display screen (such as an OLED display or a Micro LED display, etc. ).
  • the first sub-screen 16 is a self-luminous display (such as an OLED display or a Micro LED display, etc.), and the second sub-screen 17 is a display that emits light through a backlight (such as a liquid crystal display).
  • a backlight such as a liquid crystal display
  • the first sub-screen 16 may be an OLED display screen
  • the second sub-screen 17 may be a Micro LED display screen, etc.
  • the specific selection method is not limited to the above example.
  • the display screen that emits light through the backlight can control the display timing of the first sub-display area 111 and / or the second sub-display area 112 by controlling the lighting timing of the backlight.
  • the pixels of the display screen that emits light through the backlight can also display corresponding colors under the effect of the backlight.
  • the human eye when the first sub-screen 16 and the second sub-screen 17 are combined into the display screen 10, it is difficult for human eyes to perceive the boundary between the first sub-screen 16 and the second sub-screen 17, and When the first sub-screen 16 and the second sub-screen 17 display images, even if the first sub-screen 16 and the second sub-screen 17 display the same frame of images together, the human eye will not perceive the first sub-screen 16 and the second sub-screen 17 The boundary line between the displayed images.
  • the specific shapes of the first sub-screen 16 and the second sub-screen 17 can be set according to requirements.
  • the second sub-screen 17 is generally rectangular
  • the first sub-screen 16 is also generally rectangular
  • the first sub-screen 16 and the second The sub-screens 17 are connected to form a substantially rectangular display screen 10; for example, as shown in FIG. 20, the shape of the second sub-screen 17 may be a rounded rectangle with a perforation 172, and the shape of the first sub-screen 16 may be in accordance with the perforation 172
  • the shape of the perforation 172 may be a racetrack shape, a drop shape, etc.
  • the shapes of the first sub-screen 16 and the second sub-screen 17 are complementary and may jointly form a display screen 10 with a rounded rectangular shape.
  • the final shape of the display screen 10, the shape of the first sub-screen 16 or the second sub-screen 17 may also be circular, elliptical, racetrack, etc., which is not limited herein.
  • the first sub-screen 16 may be located at an edge position of the entire display screen 10, and the second sub-screen 17 may be located at an intermediate position of the entire display screen 10.
  • the first sub-screen 16 may be used to display a status icon of the electronic device 1000, for example, to display the battery level, network connection status, system time, etc. of the electronic device 1000.
  • the second sub-display area 112 displays an image with a second display timing T1, and the period of the first display timing T2 is greater than the period of the second display timing T1 .
  • control method further includes:
  • the second sub-display area 112 is controlled to display an image at the second display timing T1, and the period of the first display timing T2 is greater than the period of the second display timing T1.
  • step 03 may be implemented by the control module 402, that is, the control module 402 may be used to control the second sub-display area 112 to control the second sub-display area 112 when the structured light camera 22 is turned on.
  • the display timing T1 displays images, and the period of the first display timing T2 is greater than the period of the second display timing T1.
  • step 03 can also be implemented by the processor 200.
  • the second display timing T1 may be a more commonly used display timing.
  • the frame rate corresponding to the second display timing T1 is, for example, 60 frames per second, 72 frames per second, or 75 frames per second.
  • the period of the first display timing T2 may be greater than the period of the second display timing T1, where the period may refer to the reciprocal of the frame rate, that is, when the structured light camera 22 is turned on, the first sub-display area 111
  • the frame rate of the displayed image may be smaller than the frame rate of the displayed image of the second sub-display area 112.
  • the first display timing T2 and the exposure timing T3 may be interleaved (see FIG.
  • the first sub-display area 111 displays the image
  • the frame rate is equal to the frame rate of the image acquired by the structured light camera 22, and the frame rate of the image acquired by the structured light camera 22 is generally less than the frame rate of the image displayed by the second sub-display area 112, so that the frame rate of the image displayed by the first sub-display area 111 is also It is smaller than the frame rate of the image displayed by the second sub-display area 112, that is, the period of the first display timing T2 is greater than the period of the second display timing T1.
  • the period of the first display timing T2 is greater than the period of the second display timing T1, and the power consumption of displaying images in the first sub-display area 111 can also be reduced.
  • the first display timing T2, the second display timing T1, and the exposure timing T3 may also be set according to requirements.
  • the period of the first display timing T2 may also be shorter than that of the second display
  • both the first sub-display area 111 and the second sub-display area 112 display images at the second display timing.
  • control method further includes:
  • both the first sub-display area 111 and the second sub-display area 112 are controlled to display images at the second display timing.
  • step 04 may be implemented by the control module 402, that is, the control module 402 may be used to control the first sub-display area 111 and the second when the structured light camera 22 is turned off The sub-display areas 112 all display images at the second display timing.
  • step 04 may also be implemented by the processor 200.
  • the structured light camera 22 When the structured light camera 22 is turned off, it means that the user does not need to use the structured light camera 22 at this time, that is, the structured light camera 22 does not need to receive the modulated laser light passing through the first sub-display area 111 at this time. There is no problem that the image displayed by the first sub-display area 111 causes interference to the structured light camera 22, therefore, the first sub-display area 111 and the second sub-display area 112 can be controlled to display images at the second display timing, so that the entire display All of the areas 11 can clearly and stably display images to enhance the user's perception when using the electronic device 1000.
  • the electronic device 1000 includes a hardware clock, and both the first display timing and the exposure timing are determined by the hardware clock.
  • the first display timing and exposure timing can be accurately determined through the same hardware clock, so that the first display timing and exposure timing are on the same timeline, thereby accurately staggering the effective working state corresponding to the first display timing and the effective working corresponding to the exposure timing
  • the state reduces or avoids interference with the structured light camera 22 when the first sub-display area 111 displays an image.
  • the second display timing can also be determined by the hardware clock.
  • the first display timing and the exposure timing can also be determined by the same system clock, etc., as long as the first display timing and the exposure timing are on the same timeline to accurately stagger the corresponding validity of the first display timing
  • the working state and the effective working state corresponding to the exposure time sequence may be sufficient, which is not specifically limited here.
  • the display timing of the first sub-display area 111 can be controlled by controlling the first pixel The light emission timing of the set is realized; controlling the display timing of the second sub-display area 112 can be realized by controlling the light emission timing of the second pixel set.
  • controlling the display timing of the first sub-display area 111 can be achieved by controlling the display timing of the first sub-screen 16; controlling the second sub-display area 112
  • the display timing of can be achieved by controlling the display timing of the second sub-screen 17.
  • the picture displayed in the first sub-display area 111 and the picture displayed in the second sub-display area 112 can form a complete display screen together.
  • the display area 11 is to display one of the movie frames.
  • There is a tree, a man, and a woman in the movie screen it can be that the man and the woman are all located in the second sub-display area 112, most of the woman's body is in the second sub-display area 112, and the arm is displayed in the first sub Within area 111.
  • the screen displayed in the first sub-display area 111 and the screen displayed in the second sub-display area 112 are two independent display screens, for example, if the electronic device 1000 is currently performing a task of playing a movie, the movie screen is displayed in the second sub-display
  • the area 112 displays, and the first sub-display area 111 can simultaneously display the battery power of the electronic device 1000, the network connection status, the system time, etc., or simultaneously display instant messaging messages or message notifications of various applications.
  • the display screen 10 includes the first sub-screen 16 and the second sub-screen 17
  • the screen displayed by the first sub-screen 16 and the screen displayed by the second sub-screen 17 may also form a complete display screen, or the first The screen displayed by the sub-screen 16 and the screen displayed by the second sub-screen 17 are two independent display screens.
  • the first sub-display area 111 and the second sub-display area 112 can also be controlled to display in different display states.
  • different display states may be on or off, display with different brightness, and the like.
  • the display states of the first sub-display area 111 and the second sub-display area 112 can be independently controlled. The user can control the normal display of the second sub-display area 112 according to actual needs, and the first sub-display area 111 is used in conjunction with the structured light camera 22 .
  • the first sub-display area 111 may be turned off, or the display brightness of the first sub-display area 111 may be reduced to reduce the A sub-display area 111 displays the influence on the laser light emitted by the structured light projector 21 to the scene, or the structured light camera 22 receiving the modulated laser light.
  • the embodiment of the present application also provides another control method, in which the first sub-display area 111 and the second sub-display area 112 jointly emit light or can be independently controlled, and the structured light camera 22 and the first sub-display area Corresponding to 111, the control methods include:
  • the display area 11 is controlled to display images at the first display timing, and the structured light camera 22 is exposed at the exposure timing.
  • the effective working state corresponding to the first display timing is staggered from the effective working state corresponding to the exposure timing .
  • the control method in the embodiment of the present application may be implemented by the control device 400 in the embodiment of the present application.
  • the control device 400 may be used in the electronic device 1000.
  • the control device 400 includes a judgment module 401 and a control module 402. Among them, step 05 may be implemented by the judgment module 401, and step 06 may be implemented by the control module 402. That is to say, the determination module 401 can be used to determine whether the structured light camera 22 is turned on.
  • the control module 402 can be used to control the display area 11 to display images with the first display timing when the structured light camera 22 is turned on, and to expose the structured light camera 22 with the exposure timing.
  • the effective working state corresponding to the first display timing corresponds to the effective time
  • the working state is staggered.
  • the control method in the embodiment of the present application may be implemented by the electronic device 1000 in the embodiment of the present application. That is, when the structured light camera 22 is turned on, the display area 11 displays images at the first display timing, and the structured light camera 22 The exposure timing performs exposure, and the effective working state corresponding to the first display timing is staggered from the effective working state corresponding to the exposure timing.
  • the electronic device 1000 may further include a processor 200, where step 05 and step 06 may be implemented by the processor 200.
  • the structured light camera 22 When the structured light camera 22 is turned on, the structured light camera 22 receives the modulated laser light passing through the first sub-display area 111. At this time, the light used for displaying images in the first sub-display area 111 may interfere with the structured light camera 22, thereby As a result, the speckle image obtained by the structured light camera 22 has a large error, and the depth information of the target object cannot be accurately obtained.
  • the effective working state corresponding to the exposure timing of the structured light camera 22 and the effective working state corresponding to the first display timing of the display area 11 can be staggered from each other, that is, the structured light camera 22 does not expose when the display area 11 displays an image, During the exposure, the display area 11 does not display an image, so as to reduce or avoid interference with the structured light camera 22 when the first sub-display area 111 displays an image.
  • the structured light projector 21 and the structured light camera 22 can be turned on at the same time, or the time interval between the two is turned on is very small, so the time when the structured light camera 22 is turned on can also be regarded as a structure The moment when the light projector 21 is turned on.
  • the electronic device 1000 when the display area 11 displays an image, the electronic device 1000 generates a first interrupt signal to stop the structured light camera 22 from being exposed; and / or, when the structured light camera 22 is exposed, The electronic device 1000 generates a second interrupt signal to stop the display area 11 from displaying images.
  • step 06 includes:
  • a first interrupt signal is generated to stop the exposure of the structured light camera 22; and / or
  • step 061 and step 062 may be implemented by the control module 402, that is to say, the control module 402 may be used to generate a first interrupt signal when the image is displayed in the display area 11 to enable The structured light camera 22 stops exposure; and / or, when the structured light camera 22 is exposed, a second interrupt signal is generated to stop the display area 11 from displaying images.
  • Step 061 and Step 062 may also be implemented by the processor 200.
  • the frame rate of the image displayed in the display area 11 may be determined first, for example, the display area 11 displays the image at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc., according to the display area 11
  • the frame rate of the displayed image can determine the first display timing of the display area 11.
  • the control signal corresponding to the first display timing may be high, at this time, a first interrupt signal may be generated to stop the exposure of the structured light camera 22, and the control signal corresponding to the exposure timing of the structured light camera 22 It can be low level; when the display area 11 does not display images, the control signal corresponding to the first display timing can be low level, the structured light camera 22 can determine whether to perform exposure according to the frame rate of the acquired image, and the structured light camera 22
  • the control signal corresponding to the exposure timing of the structured light camera 22 may be high, and when the structured light camera 22 is not performing exposure, the control signal corresponding to the exposure timing of the structured light camera 22 may be low, so that Obtain the exposure timing of the structured light camera 22 and make the effective working state corresponding to the first display timing (that is, the corresponding control signal is high level) and the effective working state corresponding to the exposure timing (that is, the corresponding control signal is high level) mutually Staggered.
  • the structured light camera 22 When the image is displayed in the display area 11, the structured
  • the frame rate of the structured light camera 22 to acquire an image may be determined first, for example, the structured light camera 22 performs exposure at a frame rate of 30 frames per second, 40 frames per second, or 60 frames per second, etc., depending on the structure
  • the frame rate of the image acquired by the optical camera 22 can determine the exposure timing of the structured optical camera 22.
  • the control signal corresponding to the exposure timing may be high, at this time a second interrupt signal may be generated to stop the display area 11 from displaying images, and the control signal corresponding to the first display timing of the display area 11 It can be low level; when the structured light camera 22 is not exposed, the control signal corresponding to the exposure timing can be low level, the display area 11 can determine whether to display the image according to the frame rate of the displayed image, when the display area 11 displays the image , The control signal corresponding to the first display timing of the display area 11 may be high, and when the display area 11 is not displaying an image, the control signal corresponding to the first display timing of the display area 11 may be low, so that the display can be obtained
  • the first display timing of area 11 makes the effective working state corresponding to the first display timing (that is, the corresponding control signal is high level) and the effective working state corresponding to the exposure timing (that is, the corresponding control signal is high level) staggered from each other .
  • the display timing of area 11 makes the effective working state corresponding to the first
  • the first sub-display area 111 and the second sub-display area 112 emit light together, and the display screen 10 is an independent screen structure, that is, the display screen 10 is a whole.
  • the type of the display screen 10 may be a display screen that emits light through a backlight, such as a liquid crystal display screen.
  • the first sub-display area 111 and the second sub-display area 112 can be independently controlled, and the display screen 10 is an independent screen structure, that is, the display screen 10 is a whole, Each pixel of the plurality of pixels of the display screen 10 can be independently controlled.
  • the first sub-display area 111 includes a first pixel set composed of multiple pixels
  • the second sub-display area 112 includes a second pixel set composed of multiple pixels. It can be understood that multiple pixels in the first pixel set and multiple pixels in the second pixel set can be independently controlled.
  • the type of the display screen 10 may be a self-luminous display screen, such as an OLED display screen or a Micro LED display screen, etc.
  • Each pixel of the self-luminous display screen may be independently controlled to emit light or not to emit light or to different
  • the display timing of the first sub display area 111 and / or the second sub display area 112 can be controlled by controlling the light emission timing of the pixels.
  • the pixels of the self-luminous display screen can self-illuminate to present corresponding colors.
  • the display area 11 can be easily controlled, and the processes required for manufacturing the electronic device 1000 can be reduced, thereby reducing the cost of the electronic device 1000.
  • the first sub-display area 111 and the second sub-display area 112 can be independently controlled.
  • the display screen 10 includes a first sub-screen 16 and a second sub-screen 17, that is, the display screen 10 It may be composed of two independent sub-display screens (first sub-screen 16 and second sub-screen 17), and the first sub-screen 16 and the second sub-screen 17 may be independently controlled.
  • the first sub-screen 16 may form a first sub-display area 111
  • the second sub-screen 17 may form a second sub-display area 112.
  • the types of the first sub-screen 16 and the second sub-screen 17 may be the same, for example, they are both liquid crystal display screens, both OLED display screens, or both Micro LED display screens; the first sub-screen 16 and the second sub-screen 17
  • the type can also be different, for example, the first sub-screen 16 is a display screen (such as a liquid crystal display) that emits light through a backlight, and the second sub-screen 17 is a self-luminous display screen (such as an OLED display or a Micro LED display, etc. ).
  • the first sub-screen 16 is a self-luminous display (such as an OLED display or a Micro LED display, etc.), and the second sub-screen 17 is a display that emits light through a backlight (such as a liquid crystal display).
  • a backlight such as a liquid crystal display
  • the first sub-screen 16 may be an OLED display screen
  • the second sub-screen 17 may be a Micro LED display screen, etc.
  • the specific selection method is not limited to the above example.
  • the display screen that emits light through the backlight can control the display timing of the first sub-display area 111 and / or the second sub-display area 112 by controlling the lighting timing of the backlight.
  • the pixels of the display screen that emits light through the backlight can also display corresponding colors under the effect of the backlight.
  • the human eye when the first sub-screen 16 and the second sub-screen 17 are combined into the display screen 10, it is difficult for human eyes to perceive the boundary between the first sub-screen 16 and the second sub-screen 17, and When the first sub-screen 16 and the second sub-screen 17 display images, even if the first sub-screen 16 and the second sub-screen 17 display the same frame of images together, the human eye will not perceive the first sub-screen 16 and the second sub-screen 17 The boundary line between the displayed images.
  • the specific shapes of the first sub-screen 16 and the second sub-screen 17 can be set according to requirements.
  • the second sub-screen 17 is generally rectangular
  • the first sub-screen 16 is also generally rectangular
  • the first sub-screen 16 and the second The sub-screens 17 are connected to form a substantially rectangular display screen 10; for example, as shown in FIG. 20, the shape of the second sub-screen 17 may be a rounded rectangle with a perforation 172, and the shape of the first sub-screen 16 may be in accordance with the perforation 172
  • the shape of the perforation 172 may be a racetrack shape, a drop shape, etc.
  • the shapes of the first sub-screen 16 and the second sub-screen 17 are complementary and may jointly form a display screen 10 with a rounded rectangular shape.
  • the final shape of the display screen 10, the shape of the first sub-screen 16 or the second sub-screen 17 may also be circular, elliptical, racetrack, etc., which is not limited herein.
  • the first sub-screen 16 may be located at an edge position of the entire display screen 10, and the second sub-screen 17 may be located at an intermediate position of the entire display screen 10.
  • the first sub-screen 16 may be used to display a status icon of the electronic device 1000, for example, to display the battery level, network connection status, system time, etc. of the electronic device 1000.
  • the display area 11 displays images at the second display timing T1.
  • control method further includes:
  • step 07 may be implemented by the control module 402, that is, the control module 402 may be used to control the display area 11 to display the second display timing T1 when the structured light camera 22 is turned off. Display the image.
  • step 07 may also be implemented by the processor 200.
  • the structured light camera 22 When the structured light camera 22 is turned off, it means that the user does not need to use the structured light camera 22 at this time, that is, the structured light camera 22 does not need to receive the modulated laser light passing through the first sub-display area 111 at this time , There is no problem that the image displayed by the first sub-display area 111 causes interference to the structured light camera 22, therefore, the display area 11 can be controlled to display the image at the second display timing T1, so that the entire display area 11 can be displayed clearly and stably Images to enhance the user's perception when using the electronic device 1000.
  • the second display timing T1 may be a more commonly used display timing.
  • the frame rate corresponding to the second display timing T1 is, for example, 60 frames per second, 72 frames per second, or 75 frames per second.
  • the period of the first display timing T2 may be greater than the period of the second display timing T1, where the period may refer to the reciprocal of the frame rate, that is, the display area 11 displays the frame of the image when the structured light camera 22 is turned on
  • the rate may be less than the frame rate of the display area 11 when displaying the image when the structured light camera 22 is turned off.
  • the first display timing T2 and the exposure timing T3 may be interleaved (see FIG.
  • the frame rate of the displayed image is equal to the frame rate of the image obtained by the structured light camera 22, and the frame rate of the image obtained by the structured light camera 22 is usually less than the frame rate of the display image commonly used in the display area 11 (the display area 11 is when the structured light camera 22 is turned off Frame rate of the displayed image), so that the frame rate of the display area 11 when the structured light camera 22 is turned on is smaller than the frame rate of the display area 11 when the structured light camera 22 is turned off, that is, the period of the first display timing T2 is greater than The period of the second display timing T1.
  • the period of the first display timing T2 is greater than the period of the second display timing T1, which can also reduce the power consumption of the display area 11
  • the first display timing T2, the second display timing T1, and the exposure timing T3 may also be set according to requirements.
  • the period of the first display timing T2 may also be shorter than that of the second display
  • the electronic device 1000 includes a hardware clock, and both the first display timing and the exposure timing are determined by the hardware clock.
  • the first display timing and exposure timing can be accurately determined through the same hardware clock, so that the first display timing and exposure timing are on the same timeline, thereby accurately staggering the effective working state corresponding to the first display timing and the effective working corresponding to the exposure timing
  • the state reduces or avoids interference with the structured light camera 22 when the first sub-display area 111 displays an image.
  • the second display timing can also be determined by the hardware clock.
  • the first display timing and the exposure timing can also be determined by the same system clock, etc., as long as the first display timing and the exposure timing are on the same timeline to accurately stagger the corresponding validity of the first display timing
  • the working state and the effective working state corresponding to the exposure time sequence may be sufficient, which is not specifically limited here.
  • the display screen 10 is a whole LCD display screen 93, or the first sub-screen 16 is the LCD display screen 93, or the second sub-screen 17 is the LCD display screen 93, or
  • the LCD screen 93 may include a backlight module 931, a lower polarizer 932, and a thin-film transistor (TFT )
  • the backlight module 931 can be regarded as a backlight.
  • the lower polarizer 932 and the upper polarizer 936 are used to control the passage of light.
  • the upper polarizer 936 and the lower polarizer 932 form a fence angle, respectively, to block the component perpendicular to the fence in the light, and only allowed to be parallel to the fence Of the weight.
  • the TFT substrate 933 is used to provide a conductive path to generate voltage.
  • the color filter 935 is used to form a color image.
  • the liquid crystal layer 934 includes liquid crystal molecules. Due to the anisotropy of the structure of the liquid crystal molecules, that is, the dielectric constant and refractive index of the liquid crystal molecules have anisotropy, the photoelectric effect caused by the direction may vary.
  • the LCD screen 93 generates a voltage through the TFT substrate 933 to form an electric field between the upper polarizer 936 and the lower polarizer 932, and uses the electric field to control the rotation of the liquid crystal molecules to change the direction of light travel so that the light By or being blocked by the lower polarizer 932 and the upper polarizer 936, different electric fields can form different gray-scale brightness.
  • the display screen 10 is a whole OLED display 95, or the first sub-screen 16 is an OLED display 95, or the second sub-screen 17 is an OLED display 95, or
  • the OLED display 95 may include a substrate 951, an anode 952, a hole transport layer 953, a light emitting layer 954, an electron transport layer 955, and a cathode 956.
  • the substrate 951 is used to support the entire OLED display 95.
  • the electrons in the doped material of the light-emitting layer 954 absorb energy and then transition from the ground state to the excited state. Since the excited state is unstable, the electron will transition back from the excited state back to the ground state, and at the same time release energy in the form of photons. Depending on the energy level of the excited state of the luminescent material, electrons release photons of different energy during the transition back to the ground state. The energy determines the wavelength of light. Different wavelengths mean different colors of light. In this way, the OLED display 95 can emit various colors of light in a self-luminous manner. The brightness or intensity of the light emitted by the OLED display 95 depends on the performance of the light-emitting material and the magnitude of the applied current.
  • Each pixel in the OLED display 95 (composed of multiple sub-pixels that can emit light by itself) can be turned on / off by an independent thin film transistor, so that each pixel can emit light continuously and independently.
  • the display screen 10 is a whole Micro LED display 97, or the first sub-screen 16 is Micro LED display 97, or the second sub-screen 17 is Micro
  • the Micro LED display 97 may include a driving substrate 971, a packaging substrate 972, a support 973 and a plurality of pixels 974.
  • the driving substrate 971 and the packaging substrate 972 are oppositely arranged, and a plurality of pixels 974 are arranged between the driving substrate 971 and the packaging substrate 972.
  • Each pixel 974 is correspondingly provided with a visible light source 9741.
  • the driving substrate 971 is provided with a display driving circuit (not shown).
  • the driving substrate 971 can control the turning on, turning off and light emitting brightness of the light source in each pixel 974.
  • the packaging substrate 972 is used to encapsulate and protect the light source.
  • the material of the packaging substrate 972 may be polyethylene terephthalate (PET), polycarbonate (PC) or other plastic with a certain hardness, or glass.
  • the supporter 973 is used to maintain a certain distance between the driving substrate 971 and the packaging substrate 972, and to prevent excessive compression of the pixels 974.
  • Each pixel 974 also includes a lower pixel electrode 9742 and an upper pixel electrode 9723.
  • the lower pixel electrode 9742 is disposed on the driving substrate 971
  • the upper pixel electrode 9723 is disposed under the packaging substrate 972
  • the visible light source 9741 is sandwiched between the lower pixel electrode 9742 and the upper pixel Between electrodes 9742.
  • the material of the pixel electrode may be indium tin oxide or conductive metal.
  • multiple visible light sources 9741 include a red light source, a green light source, and a blue light source.
  • Each visible light source 9741 and the corresponding pixel electrode form a pixel 974, so that pixels 974 containing different light sources emit Different colors of light.
  • the structure of the pixel 974 may also include a visible light source 9741 and a color conversion layer 9744.
  • the plurality of visible light sources 9741 includes a red light source and a blue light source, and each visible light source 9741 and a pixel 974 composed of a corresponding pixel electrode emit light of a corresponding color.
  • pixels 974 containing a red light source emit red light
  • pixels 974 containing a blue light source emit blue light
  • pixels 974 containing a blue light source and color conversion layer 9744 emit green light.
  • the pixel 974 further includes a spacer layer 9745. The spacer layer 9745 facilitates the uniformity of the height between the pixels 974.
  • the LCD display 93 can control the backlight module 931 to emit light to display images.
  • the backlight module 931 of the LCD display 93 can only perform overall control, that is, to emit light as a whole or not to emit light;
  • the OLED display 95 can pass
  • the light-emitting layer 954 of each pixel is independently controlled to emit light of different colors and brightness to display images;
  • the Micro LED display 97 can emit light of different brightness and different colors to display images by independently controlling each visible light source 9741.
  • first and second are used for description purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
  • the features defined with “first” and “second” may include at least one of the features either explicitly or implicitly.
  • the meaning of “plurality” is at least two, such as two, three, etc., unless otherwise specifically limited.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种电子装置(1000)及其控制方法和控制装置(400)。电子装置(1000)包括显示屏(10)和结构光组件(20)。显示屏(10)包括用于显示影像的显示区(11),显示区(11)包括第一子显示区(111)及第二子显示区(112)。结构光组件(20)包括设置在显示屏(10)的背面(13)并与第一子显示区(111)对应的结构光摄像头(22),结构光摄像头(22)用于接收穿过第一子显示区(111)的被调制后的激光。在结构光摄像头(22)开启时,显示区(11)以第一显示时序显示影像,结构光摄像头(22)以曝光时序进行曝光,第一显示时序与曝光时序对应的有效工作状态错开。

Description

电子装置及其控制方法和控制装置
优先权信息
本申请请求2018年11月16日向中国国家知识产权局提交的、专利申请号为201811369338.9的专利申请的优先权和权益,并且通过参照将其全文并入此处。
技术领域
本申请涉及消费性电子技术领域,更具体而言,涉及一种电子装置、电子装置的控制方法和电子装置的控制装置。
背景技术
在相关技术中,为了使得电子装置的功能更加多样化,电子装置设置有深度图像获取模组以获取场景的深度信息。
发明内容
本申请实施方式提供一种电子装置、电子装置的控制方法和电子装置的控制装置。
本申请实施方式的电子装置包括显示屏和结构光组件。所述显示屏包括用于显示影像的显示区,所述显示区形成有相背的正面及背面,所述显示屏发出的光线沿所述背面指向所述正面的方向向外界发射,所述显示区包括第一子显示区及第二子显示区。所述结构光组件包括结构光摄像头,所述结构光摄像头设置在所述显示屏的所述背面所在一侧,所述结构光摄像头与所述第一子显示区对应,所述结构光摄像头用于接收穿过所述第一子显示区的被调制后的激光。在所述结构光摄像头开启时,所述显示区以第一显示时序显示所述影像,所述结构光摄像头以曝光时序进行曝光,所述第一显示时序对应的有效工作状态与所述曝光时序对应的有效工作状态错开。
本申请实施方式的控制方法可以用于电子装置,所述电子装置包括显示屏和结构光组件。所述显示屏包括用于显示影像的显示区,所述显示区形成有相背的正面及背面,所述显示屏发出的光线沿所述背面指向所述正面的方向向外界发射,所述显示区包括第一子显示区及第二子显示区。所述结构光组件包括结构光摄像头,所述结构光摄像头设置在所述显示屏的所述背面所在一侧,所述结构光摄像头与所述第一子显示区对应,所述结构光摄像头用于接收穿过所述第一子显示区的被调制后的激光。所述控制方法包括:判断所述结构光摄像头是否开启;在所述结构光摄像头开启时,控制所述显示区以第一显示时序显示所述影像、所述结构光摄像头以曝光时序进行曝光,所述第一显示时序对应的有效工作状态与所述曝光时序对应的有效工作状态错开。
本申请实施方式的控制装置可以用于电子装置,所述电子装置包括显示屏和结构光组件。所述显示屏包括用于显示影像的显示区,所述显示区形成有相背的正面及背面,所述显示屏发出的光线沿所述背面指向所述正面的方向向外界发射,所述显示区包括第一子显示区及第二子显示区。所述结构光组件包括结构光摄像头,所述结构光摄像头设置在所述显示屏的所述背面所在一侧,所述结构光摄像头与所述第一子显示区对应,所述结构光摄像头用于接收穿过所述第一子显示区的被调制后的激光。所述控制装置包括判断模块和控制模块。所述判断模块用于判断所述结构光摄像头是否开启。所述控制模块用于在所述结构光摄像头开启时,控制所述显示区以第一显示时序显示所述影像、所述结构光摄像头以曝光时序进行曝光,所述第一显示时序对应的有效工作状态与所述曝光时序对应的有效工作状态错开。
本申请的实施方式的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实施方式的实践了解到。
附图说明
本申请的上述和/或附加的方面和优点从结合下面附图对实施方式的描述中将变得明显和容易理解,其中:
图1是本申请某些实施方式的电子装置的结构示意图。
图2是本申请某些实施方式的电子装置的部分结构示意图。
图3是本申请某些实施方式的电子装置沿图2所示的A-A线的截面示意图。
图4是本申请某些实施方式的结构光投射器的结构示意图。
图5是本申请某些实施方式的电子装置沿与图2所示的A-A线对应位置的截面示意图。
图6和图7是本申请某些实施方式的电子装置的部分结构示意图。
图8是本申请某些实施方式的电子装置沿与图2所示的A-A线对应位置的截面示意图。
图9和图10是本申请某些实施方式的电子装置的部分结构示意图。
图11至图15是本申请某些实施方式的电子装置沿与图2所示的A-A线对应位置的截面示意图。
图16是本申请某些实施方式的电子装置的控制方法的流程示意图。
图17是本申请某些实施方式的电子装置的控制装置的模块示意图。
图18是本申请某些实施方式的电子装置的控制方法的流程示意图。
图19是本申请某些实施方式的电子装置的部分结构示意图。
图20是本申请某些实施方式的显示屏的分解示意图。
图21至图24是本申请某些实施方式的第一显示时序、第二显示时序及曝光时序的示意图。
图25和图26是本申请某些实施方式的电子装置的控制方法的流程示意图。
图27是本申请某些实施方式的LCD显示屏的部分结构示意图。
图28是本申请某些实施方式的OLED显示屏的部分结构示意图。
图29和图30是本申请某些实施方式的Micro LED显示屏的部分结构示意图。
具体实施方式
以下结合附图对本申请的实施方式作进一步说明。附图中相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。
另外,下面结合附图描述的本申请的实施方式是示例性的,仅用于解释本申请的实施方式,而不能理解为对本申请的限制。
在本申请中,除非另有明确的规定和限定,第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触,或第一和第二特征通过中间媒介间接接触。而且,第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方,或仅仅表示第一特征水平高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”可以是第一特征在第二特征正下方或斜下方,或仅仅表示第一特征水平高度小于第二特征。
请参阅图1及图2,本申请实施方式的电子装置1000包括显示屏10及结构光组件20。电子装置1000还可以包括壳体30,壳体30可用于安装显示屏10、结构光组件20等功能器件,功能器件还可以是主板、双摄模组、受话器等。电子装置1000的具体形式可以是手机、平板电脑、智能手表、头显设备等,本申请以电子装置1000为手机进行说明,可以理解,电子装置1000的具体形式不限于手机,在此不作限制。
显示屏10可以安装在壳体30上,具体地,显示屏10可以安装在壳体30的一个面上,或者同时安装在壳体30的相背的两个面上。在如图1所示的例子中,显示屏10安装在壳体30的前面,显示屏10可以覆盖该前面的面积的85%及以上,例如达到85%、86%、87%、88%、89%、90%、91%、92%、93%、95%甚至是100%。显示屏10可以用于显示影像,影像可以是文字、图像、视频、图标等信息。
显示屏10包括显示区11,显示区11可用于显示影像。适配不同类型的电子装置1000及不同用户的需求,显示区11的形状可以呈圆形、椭圆形、跑道形、圆角矩形、矩形等形状。
请结合图3,显示区11形成有相背的正面12及背面13,显示区11可以用于显示影像,显示屏10发出的光线沿背面13指向正面12的方向向外发射,且在光线穿过正面12后由用户接收,即,用户可从正面12观察显示屏10显示的影像。请结合图1,可以理解,正面12为显示面,背面13为与显示面相背的面。正面12及背面13均可以是平面或曲面。
在某些例子中,显示屏10还可包括非显示区,非显示区可以形成在显示区11的周缘。非显示区可以不用于显示,非显示区可用于与壳体30结合或用于走线,例如可以将非显示区与壳体30通过粘胶结合,而不会影响显示区11的显示功能。显示屏10还可以是集成有触控功能的触控显示屏,用户获取显示屏10显示的影像信息后,可以在显示屏10上进行触控以实现预定的交互操作。
请再参阅图1,在某些实施方式中,显示区11包括多个像素,多个像素按照预定的方式排列,相邻的像素之间存在微观间隙。显示区11包括第一子显示区111及第二子显示区112。第一子显示区111的像素密度小于第二子显示区112的像素密度。
第一子显示区111的像素密度小于第二子显示区112的像素密度,也就是第一子显示区111的微观间隙要大于第二子显示区112的微观间隙,第一子显示区111对光线的阻隔作用较小,穿过第一子显示区111的光线的透过率较高。
在某些实施方式中,第一子显示区111的像素密度大于第二子显示区112的像素密度,或者第一子显示区111的像素密度等于第二子显示区112的像素密度。
在某些实施方式中,第一子显示区111与第二子显示区112的形状可以依据具体的需求进行设置,在此不作限制,例如第一子显示区111可以设置成跑道形、水滴状等,第二子显示区112与第一子显示区111可以互补并共同形成矩形或圆角矩形等形状的显示区11。第一子显示区111可以位于显示区11的靠近边缘的位置,第二子显示区112可以位于显示区11的中间位置。第一子显示区111可以用于显示电子装置1000的状态图标,例如用于显示电子装置1000的电池电量、网络连接状态、系统时间等。
结构光组件20可以利用结构光获取目标物体的深度信息,以用于三维建模、生成三维图像、测距等。结构光组件20可以安装在电子装置1000的壳体30内,具体可以安装在支架上后,再将支架及结构光组件20一同安装在壳体30内。结构光组件20可以包括结构光投射器21、结构光摄像头22及泛光灯23。
请参阅图1至图4,结构光投射器21设置在显示屏10的背面13所在的一侧,或者说,结构光投射器21设置在显示区11下方(例如可以设置在第一子显示区111下方),结构光投射器21用于发射穿过显示区11的激光。具体地,结构光投射器21可以包括光源211、准直元件212及衍射光学元件213,光源211发出的光(例如红外激光)先经过准直元件212准直,再经衍射光学元件213衍射后从结构光投射器21中发出,然后再穿过显示区11以投射到外界。光线穿过微观间隙时会发生衍射,即显示区11的微观间隙与衍射光学元件213上的衍射结构对光源211发出的光均具有衍射作用。
穿过显示区11并进入外界的激光中,可能同时包含由衍射光学元件213衍射形成的图案(图案中包括多个由衍射光学元件213衍射的斑点),以及由显示屏10的微观间隙衍射形成的图案(图案中包括多个由衍射光学元件213衍射又被显示屏10衍射的斑点),以使穿过显示区11后的散斑图案具有较高的不相关性,利于后续对获得的散斑图案进行处理。在一个例子中,显示区11的透过率可以达到60%或以上,以使结构光投射器21发出的激光穿过显示区11时损耗较小。
结构光摄像头22可以是红外摄像头,激光发射到目标物体,由目标物体调制后,可以由结构光摄像头22获取,结构光摄像头22接收被调制的激光后得到散斑图像,散斑图像被处理后得到目标物体的深度数据。结构光摄像头22也可以设置在显示屏10的背面13所在的一侧,即设置在显示屏10下(例如可以设置在第一子显示区111下方),具体可以与结构光投射器21设置在同一个支架上,或者结构光摄像头22直接安装在壳体30上。此时,结构光摄像头22的入光面可以对准显示区11,被目标物体调制后的激光穿过显示区11后再由结构光摄像头22接收,具体地,被目标物体调的激光可以由显示屏10的微观间隙衍射后,再由结构光摄像头22接收。
泛光灯23可以用于向外发射补充光线,补充光线可以用于在环境光线较弱时补充环境中的光线强度。在一个例子中,补充光线可以是红外光。补充光线发射到目标物体上被目标物体反射后,可以由结构光摄像头22获取以得到目标物体的二维图像,二维图像信息可用于身份识别。泛光灯23也可以设置在显示屏10的背面13所在的一侧,即设置在显示屏10下(例如可以设置在第一子显示区111下方),具体可以与结构光投射器21及结构光摄像头22设置在同一个支架上。此时,泛光灯23发出的补充光线穿过显示区11的微观间隙后进入外界环境,被反射后的补充光线可以再次穿过微观间隙以被结构光摄像头22接收。
在相关技术中,在深度图像获取模组设置在电子装置的正面(有显示屏的一面)时,会降低电子装置的屏占比。本申请的电子装置1000中,由于结构光摄像头22设置在显示屏10的背面13所在的一侧,显示屏10上不需要开设与结构光摄像头22对准的开口,电子装置1000的屏占比较高。另外,本申请实施方式将结构光组件20设置在显示屏10下方,相较于可以采集深度信息的飞行时间而言,结构光组件20获取的深度图像的分辨率较高,在人脸识别中使用分辨率较高的深度图像可以提高人脸识别的准确率,在三维场景建模中使用分辨率较高的深度图像可以提高建模的三维场景与实际场景之前的匹配度。
若结构光投射器21设置在显示屏10下方时,结构光投射器21投射的激光穿过第一子显示区111时会受到显示屏10中的微观间隙的影响,即投射到场景中的散斑图像中的斑点同时包括激光仅被结构光投射器21的衍射光学元件213一次衍射形成的斑点、以及激光经过衍射光学元件213一次衍射再由显示屏10二次衍射形成的斑点。结构光摄像头22设置在显示屏10下方,且结构光摄像头10接收的是被目标物体反射后穿过显示屏10时被显示屏10衍射的激光,则结构光摄像头22采集的散斑图像中的斑点同时包括激光仅被衍射光学元件213一次衍射并被目标物体反射形成的斑点、激光经过衍射光学元件213一次衍射再由显示屏10二次衍射并被目标物 体反射形成的斑点、以及激光经过衍射光学元件213一次衍射再由显示屏10二次衍射并被目标物体反射后又一次由显示屏10三次衍射形成的斑点。在计算深度图像时,包括以下两种计算方式:
(1)直接根据散斑图像中的所有斑点做深度计算。此时,参考图像中的参考斑点同时包括激光仅被衍射光学元件213一次衍射并被标定物体反射形成的参考斑点、激光经过衍射光学元件213一次衍射再由显示屏10二次衍射并被标定物体反射形成的参考斑点、以及激光经过衍射光学元件213一次衍射再由显示屏10二次衍射并被标定物体反射后又一次由显示屏10三次衍射形成的参考斑点。
(2)仅留下激光仅被射光学元件213一次衍射并被目标物体反射形成的斑点并滤掉其余斑点,以根据剩余的斑点做深度计算。此时,参考图像中的参考斑点仅包括激光仅被射光学元件213一次衍射并被标定物体反射形成的参考斑点。其中,经过不同衍射次数衍射后形成的斑点的亮度不同,因此,各类斑点可以通过亮度来区分,从而可以滤掉无需用到的斑点。
若结构光投射器21设置在显示屏10下方,且结构光投射器21投射的激光穿过显示屏10时未受到显示屏10的微观间隙的影响(即显示屏10形成有图5所示的通槽14),则设置在显示屏10下方的结构光摄像头22采集的散斑图像中的斑点同时包括激光仅被衍射光学元件213一次衍射并被目标物体反射形成的斑点、以及激光经过衍射光学元件213一次衍射并被目标物体反射后由显示屏10二次衍射形成的斑点。在计算深度图像时,包括以下两种计算方式:
(1)直接根据散斑图像中的所有斑点做深度计算。此时,参考图像中的参考斑点同时包括激光仅被衍射光学元件213一次衍射并被标定物体反射形成的参考斑点、以及激光经过衍射光学元件213一次衍射并被标定物体反射后由显示屏10二次衍射形成的参考斑点。
(2)仅留下激光仅被射光学元件213一次衍射并被目标物体反射形成的斑点并滤掉其余斑点,以根据剩余的斑点做深度计算。此时,参考图像中的参考斑点仅包括激光仅被射光学元件213一次衍射并被标定物体反射形成的参考斑点。其中,经过不同衍射次数衍射后形成的斑点的亮度不同,因此,各类斑点可以通过亮度来区分,从而可以滤掉无需用到的斑点。
请参阅图5,在某些实施方式中,显示屏10形成有通槽14,通槽14不具有显示功能。通槽14贯穿正面12及背面13。结构光投射器21设置在显示屏10的背面13所在的一侧的同时,结构光投射器21用于发射穿过通槽14的激光。在一个实施例中,通槽14可以开设在第一子显示区111上。
此时,结构光投射器21的出光面可以对准通槽14,结构光投射器21发射的激光穿过通槽14后进入外界。本实施方式中,进入外界的激光不需要穿过显示区11的微观间隙,不会由微观间隙再次衍射,从而在结构光摄像头22获取散斑图像后,可以降低后续基于散斑图像计算深度图像的处理难度。
具体地,在如图6所示的例子中,通槽14包括形成在显示屏10的边缘上的缺口141,或者说,通槽14与显示屏10的边缘相交。缺口141具体可以形成在显示屏10的上边缘、下边缘、左边缘、右边缘等任意一个或多个边缘上。缺口141的形状可以是三角形、半圆形、矩形、跑道形等任意形状,在此不作限制。
在如图7所示的例子中,通槽14包括与显示屏10的边缘间隔的通孔142,或者说,通槽14开设在显示屏10的边缘围成的范围内。通孔142具体可以靠近显示屏10的上边缘、下边缘、左边缘、右边缘等任意一个或多个边缘上。通孔142的形状可以是三角形、圆形、矩形、跑道形等任意形状,在此不作限制。
在一些例子中,通槽14也可以同时包括上述的缺口141及通孔142。缺口141及通孔142的数量可以相等或不相等。
请参阅图8,在某些实施方式中,泛光灯23设置在显示屏10的背面13所在的一侧的同时,泛光灯23用于发射穿过通槽14的补充光线。
此时,补充光线穿过通槽14后直接发射到外界,补充光线不会在穿过显示区11的过程中被削弱,保证目标物体接收到较多的补光量。
与结构光投射器21类似,如图9所示,通槽14包括形成在显示屏10的边缘上的缺口141,或者说,通槽14与显示屏10的边缘相交。缺口141具体可以形成在显示屏10的上边缘、下边缘、左边缘、右边缘等任意一个或多个边缘上。缺口141的形状可以是三角形、半圆形、矩形、跑道形等任意形状,在此不作限制。
或者,如图10所示,通槽14包括与显示屏10的边缘间隔的通孔142,或者说,通槽14开设在显示屏10的边缘围成的范围内。通孔142具体可以靠近显示屏10的上边缘、下边缘、左边 缘、右边缘等任意一个或多个边缘上。通孔142的形状可以是三角形、圆形、矩形、跑道形等任意形状,在此不作限制。
另外,在图8至图10所示的例子中,泛光灯23与结构光投射器21可以对应同一个通槽14。在图11所示例子中,泛光灯23与结构光投射器21可以对应不同的通槽14。
请参阅图3、图5、图8及图11,在某些实施方式中,电子装置1000还包括盖板40,盖板40设置在显示屏10的正面12所在的一侧。当显示屏10开设有通槽14时,盖板40的与通槽14对应的区域上设置有红外透过层50。
盖板40可以由玻璃或者蓝宝石等透光性能较好的材料制成。红外透过层50可以是红外透过油墨或红外透过膜,红外透过层50对红外光(例如波长为940纳米的光)具有较高的透过率,例如透过率可以达到85%或以上,而对红外光以外的光线的透过率较低或者使得红外光以外的光线完全不能透过。因此,用户难以通过盖板40看到与通槽14对准的结构光投射器21或者泛光灯23,电子装置1000的外观较美观。
在某些实施方式中,盖板40的与第一子显示区111对应的区域形成有红外透过层50。
请参阅图12,在某些实施方式中,电子装置1000还包括盖板40,盖板40设置在显示屏10的正面12所在的一侧,盖板40的与结构光投射器21对应的区域形成有红外增透膜60。
红外增透膜60可以增加红外光的透过率,当结构光投射器21投射红外激光时,红外增透膜60可以增加红外激光穿过盖板40的透过率,以减少红外激光穿过盖板40时的损耗,进而降低电子装置1000的功耗。具体地,红外增透膜60可以镀在盖板40的上表面、或下表面、或同时镀在上表面及下表面。
当然,盖板40上与结构光摄像头22对应的区域也可以形成有红外增透膜60,以减少外界的红外光到达结构光摄像头22前穿过盖板40的损耗。盖板40上与泛光灯23对应的区域也可以形成有红外增透膜60,以减少泛光灯23发出的补充光线在穿过盖板40时的损耗。此时盖板40上未与结构光投射器21、结构光摄像头22及泛光灯23对应的区域可以形成有可见光增透膜80,以提高显示屏10发出的可见光穿过盖板40时的透过率。
请参阅图13,在某些实施方式中,显示屏10的与结构光投射器21对应的区域形成有红外增透膜60。
红外增透膜60可以增加红外光的透过率,当结构光投射器21投射红外激光时,红外增透膜60可以增加红外激光穿过显示屏10的透过率,以减少红外激光穿过显示屏10时的损耗,进而降低电子装置1000的功耗。具体地,红外增透膜60可以形成在显示区11的正面12、或背面13、或同时形成显示区11的正面12或背面13。在一个例子中,红外增透膜60还可以形成在显示屏10的内部,例如当显示屏10为液晶显示屏时,红外增透膜60可以形成在显示屏10内的偏光片上、或者形成在显示屏10的电极板上等。
当然,当显示屏10与结构光投射器21对应的位置未开设通槽14时,显示屏10与结构光投射器21对应的区域也可以形成红外增透膜60。当显示屏10与泛光灯23对应的位置未开设通槽14时,显示屏10与泛光灯23对应的区域也可以形成红外增透膜60。
请参阅图14,在某些实施方式中,显示屏10的与结构光摄像头22对应的区域形成有红外透过层50。如上所述,红外透过层50对红外光具有较高的透过率,而对红外光以外的光线(如可见光)透过率较低或者使得红外光以外的光线(如可见光)完全不能透过,用户难以看到结构光摄像头22。
同时,当显示屏10与结构光投射器21对应的位置未开设通槽14时,显示屏10与结构光投射器21对应的区域也可以形成红外透过层50,以使得用户难以看到结构光投射器21。当显示屏10与泛光灯23对应的位置未开设通槽14时,显示屏10与泛光灯23对应的区域也可以形成红外透过层50。在一个实施方式中,显示屏10的与第一子显示区111对应的区域形成有红外透过层50。
请参阅图15,在某些实施方式中,显示屏10形成有贯穿正面12及背面13的通槽14。电子装置1000还包括可见光摄像头70,可见光摄像头70与通槽14对准设置。盖板40上与通槽14对应的区域形成有可见光增透膜80、及/或红外截止膜90。
可见光摄像头70可用于接收穿过盖板40和通槽14的可见光以获取影像。在盖板40上与通槽14对应的区域形成可见光增透膜80可以增加可见光穿过盖板40时的透过率,以便于提高可见光摄像头70的成像质量。在盖板40上与通槽14对应的区域形成红外截止膜90可以降低红外光穿过盖板40时的透过率,或者完全阻止红外光进入可见光摄像头70,以减少红外光对可见光摄像头70成像时的影响。
请参阅图16,本申请实施方式提供一种控制方法,可以用于上述任意一种实施方式的电子装置1000。其中,第一子显示区111及第二子显示区112能够被独立控制,结构光摄像头22与第一子显示区111对应,控制方法包括:
01:判断结构光摄像头22是否开启;
02:在结构光摄像头22开启时,控制第一子显示区111以第一显示时序显示影像、结构光摄像头22以曝光时序进行曝光,第一显示时序对应的有效工作状态与曝光时序对应的有效工作状态错开。
请结合图17,本申请实施方式的控制方法可以由本申请实施方式的控制装置400实现,控制装置400可用于电子装置1000。控制装置400包括判断模块401和控制模块402。其中,步骤01可以由判断模块401实现,步骤02可以由控制模块402实现。也即是说,判断模块401可用于判断结构光摄像头22是否开启。控制模块402可用于在结构光摄像头22开启时,控制第一子显示区111以第一显示时序显示影像、结构光摄像头22以曝光时序进行曝光,第一显示时序对应的有效工作状态与曝光时序对应的有效工作状态错开。
请结合图1,本申请实施方式的控制方法可以由本申请实施方式的电子装置1000实现,即,在结构光摄像头22开启时,第一子显示区111以第一显示时序显示影像,结构光摄像头22以曝光时序进行曝光,第一显示时序对应的有效工作状态与曝光时序对应的有效工作状态错开。在某些实施方式中,电子装置1000还可以包括处理器200,其中,步骤01和步骤02可以由处理器200实现。
在结构光摄像头22开启时,结构光摄像头22接收穿过第一子显示区111的被调制后的激光,此时第一子显示区111用于显示影像的光线会干扰结构光摄像头22,从而导致结构光摄像头22获得的散斑图像存在较大的误差,无法准确地获得目标物体的深度信息。因此,结构光摄像头22的曝光时序对应的有效工作状态与第一子显示区111的第一显示时序对应的有效工作状态可以相互错开,即第一子显示区111显示影像时结构光摄像头22不进行曝光,结构光摄像头22进行曝光时第一子显示区111不显示影像,从而能够减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。
可以理解,在使用中,结构光投射器21与结构光摄像头22可以是同时开启,或者二者开启的时间间隔非常小,所以上述的结构光摄像头22开启的时刻,也即可以看作是结构光投射器21开启的时刻。
请再次参阅图1,在某些实施方式中,在第一子显示区111显示影像时,电子装置1000产生第一中断信号以使结构光摄像头22停止曝光;和/或,在结构光摄像头22曝光时,电子装置1000产生第二中断信号以使第一子显示区111停止显示影像。
请参阅图18,在某些实施方式中,步骤02包括:
021:在第一子显示区111显示影像时,产生第一中断信号以使结构光摄像头22停止曝光;和/或
022:在结构光摄像头22曝光时,产生第二中断信号以使第一子显示区111停止显示影像。
请再次参阅图17,在某些实施方式中,步骤021、步骤022可以由控制模块402实现,也即是说,控制模块402可用于在第一子显示区111显示影像时,产生第一中断信号以使结构光摄像头22停止曝光;和/或,在结构光摄像头22曝光时,产生第二中断信号以使第一子显示区111停止显示影像。另外,步骤021、步骤022也可以由处理器200实现。
在某些实施方式中,可以先确定第一子显示区111显示影像的帧率,例如第一子显示区111以30帧每秒、40帧每秒、或60帧每秒等的帧率显示影像,根据第一子显示区111显示影像的帧率可以确定第一子显示区111的第一显示时序。在第一子显示区111显示影像时,第一显示时序对应的控制信号可以为高电平,此时可以产生第一中断信号以使结构光摄像头22停止曝光,结构光摄像头22的曝光时序对应的控制信号可以为低电平;在第一子显示区111不显示影像时,第一显示时序对应的控制信号可以为低电平,结构光摄像头22可以根据获取图像的帧率确定是否进行曝光,在结构光摄像头22进行曝光时,结构光摄像头22的曝光时序对应的控制信号可以为高电平,在结构光摄像头22不进行曝光时,结构光摄像头22的曝光时序对应的控制信号可以为低电平,从而可以得到结构光摄像头22的曝光时序并使得第一显示时序对应的有效工作状态(即对应的控制信号为高电平)与曝光时序对应的有效工作状态(即对应的控制信号为高电平)相互错开。在第一子显示区111显示影像时,结构光摄像头22停止曝光,从而能够减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。
在某些实施方式中,可以先确定结构光摄像头22获取图像的帧率,例如结构光摄像头22以 30帧每秒、40帧每秒、或60帧每秒等的帧率进行曝光,根据结构光摄像头22获取图像的帧率可以确定结构光摄像头22的曝光时序。在结构光摄像头22进行曝光时,曝光时序对应的控制信号可以为高电平,此时可以产生第二中断信号以使第一子显示区111停止显示影像,第一子显示区111的第一显示时序对应的控制信号可以为低电平;在结构光摄像头22不进行曝光时,曝光时序对应的控制信号可以为低电平,第一子显示区111可以根据显示影像的帧率确定是否显示影像,在第一子显示区111显示影像时,第一子显示区111的第一显示时序对应的控制信号可以为高电平,在第一子显示区111不显示影像时,第一子显示区111的第一显示时序对应的控制信号可以为低电平,从而可以得到第一子显示区111的第一显示时序并使得第一显示时序对应的有效工作状态(即对应的控制信号为高电平)与曝光时序对应的有效工作状态(即对应的控制信号为高电平)相互错开。在结构光摄像头22进行曝光时,第一子显示区111停止显示影像,从而能够减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。
具体地,请参阅图19,在一个例子中,第一子显示区111及第二子显示区112能够被独立控制,显示屏10为一个独立的屏结构,即,显示屏10为一个整体,显示屏10的多个像素中的每个像素均能够被独立控制。其中,第一子显示区111包括由多个像素组成的第一像素集合,第二子显示区112包括多个像素组成的第二像素集合。可以理解,第一像素集合内的多个像素与第二像素集合内的多个像素均可以被独立控制。此时,显示屏10的类型可以是自发光的显示屏,例如OLED显示屏或Micro LED显示屏等,自发光的显示屏的每个像素均可以独立地被控制发光或者不发光或者以不同的发光亮度发光,可以通过控制像素的发光时序以控制第一子显示区111和/或第二子显示区112的显示时序。另外,自发光的显示屏的像素可以自发光以呈现对应的颜色。
请参阅图20,在另一个例子中,第一子显示区111及第二子显示区112能够被独立控制,显示屏10包括第一子屏16及第二子屏17,即,显示屏10可以由两个独立的子显示屏(第一子屏16及第二子屏17)组成,第一子屏16与第二子屏17可以被独立控制。第一子屏16可以形成第一子显示区111,第二子屏17可以形成第二子显示区112。此时,第一子屏16与第二子屏17的类型可以相同,例如均为液晶显示屏、均为OLED显示屏或均为Micro LED显示屏;第一子屏16与第二子屏17的类型也可以不同,例如第一子屏16为通过背光源发光的显示屏(比如液晶显示屏)、而第二子屏17为自发光的显示屏(比如OLED显示屏或Micro LED显示屏等)。又例如第一子屏16为自发光的显示屏(比如OLED显示屏或Micro LED显示屏等)、而第二子屏17为通过背光源发光的显示屏(比如液晶显示屏)。当然,也可以是第一子屏16为OLED显示屏、而第二子屏17为Micro LED显示屏等,具体选择方式不限于上述的举例。通过背光源发光的显示屏可以通过控制背光源的发光时序以控制第一子显示区111和/或第二子显示区112的显示时序。通过背光源发光的显示屏的像素也可以在背光的作用下呈现对应的颜色。
在某些实施方式中,第一子屏16与第二子屏17在结合成显示屏10时,人眼难以察觉到第一子屏16与第二子屏17之间的交界线,且在第一子屏16及第二子屏17显示影像时,即使第一子屏16与第二子屏17共同显示同一帧影像,人眼也不会察觉到第一子屏16与第二子屏17显示的影像之间的边界线。
第一子屏16与第二子屏17的具体形状可以依据需求进行设定,例如,第二子屏17大致呈矩形,第一子屏16也大致呈矩形,第一子屏16与第二子屏17相接并形成大致呈矩形的显示屏10;例如如图20所示,第二子屏17的形状可以是带穿孔172的圆角矩形,第一子屏16的形状可以与穿孔172的形状相同,穿孔172的形状可以是跑道形、水滴状等,第一子屏16与第二子屏17的形状互补并可共同形成呈圆角矩形状的显示屏10。当然,显示屏10的最终形状、第一子屏16或第二子屏17的形状还可以是圆形、椭圆形、跑道形等形状,在此不作限制。第一子屏16可以位于显示屏10整体的边缘位置,第二子屏17可以位于显示屏10整体的中间位置。第一子屏16可以用于显示电子装置1000的状态图标,例如用于显示电子装置1000的电池电量、网络连接状态、系统时间等。
请结合图21,在某些实施方式中,在结构光摄像头22开启时,第二子显示区112以第二显示时序T1显示影像,第一显示时序T2的周期大于第二显示时序T1的周期。
请再次参阅图16,在某些实施方式中,控制方法还包括:
03:在结构光摄像头22开启时,控制第二子显示区112以第二显示时序T1显示影像,第一显示时序T2的周期大于第二显示时序T1的周期。
请再次参阅图17,在某些实施方式中,步骤03可以由控制模块402实现,也即是说,控制模块402可用于在结构光摄像头22开启时,控制第二子显示区112以第二显示时序T1显示影像,第一显示时序T2的周期大于第二显示时序T1的周期。另外,步骤03也可以由处理器200实现。
在某些实施方式中,第二显示时序T1可以是比较常用的显示时序,第二显示时序T1对应的帧率例如为60帧每秒、72帧每秒、或75帧每秒等,在结构光摄像头22开启时,第二子显示区112显示影像通常不会对结构光摄像头22造成干扰,因此,第二子显示区112可以以第二显示时序T1显示影像,从而第二子显示区112能够清晰地、稳定地显示影像。
在某些实施方式中,第一显示时序T2的周期可以大于第二显示时序T1的周期,其中,周期可以是指帧率的倒数,即在结构光摄像头22开启时,第一子显示区111显示影像的帧率可以小于第二子显示区112显示影像的帧率。具体地,为了便于控制,在结构光摄像头22开启时,第一显示时序T2与曝光时序T3可以是相互交错的(请参阅图21,在第一显示时序T2对应的控制信号为高电平时,曝光时序T3对应的控制信号为低电平,在第一显示时序T2对应的控制信号为低电平时,曝光时序T3对应的控制信号为高电平),即第一子显示区111显示影像的帧率等于结构光摄像头22获取图像的帧率,而结构光摄像头22获取图像的帧率通常小于第二子显示区112显示影像的帧率,从而第一子显示区111显示影像的帧率也小于第二子显示区112显示影像的帧率,即,第一显示时序T2的周期大于第二显示时序T1的周期。另外,第一显示时序T2的周期大于第二显示时序T1的周期,还可以减少第一子显示区111显示影像的功耗。
当然,在其他实施方式中,第一显示时序T2、第二显示时序T1和曝光时序T3也可以根据需求进行其他设置,例如请结合图22,第一显示时序T2的周期也可以小于第二显示时序T1的周期;请结合图23,第一显示时序T2与第二显示时序T1相同;请结合图24,第一显示时序T2的周期可以小于曝光时序T3的周期;第一显示时序T2的周期可以大于曝光时序T3的周期等,只要满足第一显示时序T2对应的有效工作状态与曝光时序T3对应的有效工作状态错开即可,在此不做具体限定。
在某些实施方式中,在结构光摄像头22关闭时,第一子显示区111和第二子显示区112均以第二显示时序显示影像。
请再次参阅图16,在某些实施方式中,控制方法还包括:
04:在结构光摄像头22关闭时,控制第一子显示区111和第二子显示区112均以第二显示时序显示影像。
请再次参阅图17,在某些实施方式中,步骤04可以由控制模块402实现,也即是说,控制模块402可用于在结构光摄像头22关闭时,控制第一子显示区111和第二子显示区112均以第二显示时序显示影像。另外,步骤04也可以由处理器200实现。
在结构光摄像头22关闭时,也就意味着用户此时并不需要使用结构光摄像头22,即,此时结构光摄像头22并不需要接收穿过第一子显示区111的被调制后的激光,不存在第一子显示区111显示影像对结构光摄像头22造成干扰的问题,因此,可以控制第一子显示区111和第二子显示区112均以第二显示时序显示影像,使整个显示区11均能够清晰地、稳定地显示影像,以提升用户使用电子装置1000时的观感。
在某些实施方式中,电子装置1000包括硬件时钟,第一显示时序及曝光时序均通过硬件时钟确定。通过同一硬件时钟可以准确地确定第一显示时序和曝光时序,使得第一显示时序及曝光时序处于同一时间线上,从而准确地错开第一显示时序对应的有效工作状态及曝光时序对应的有效工作状态,减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。第二显示时序也可以通过该硬件时钟确定。
在某些实施方式中,也可以通过同一系统时钟等方式确定第一显示时序和曝光时序,只需要满足第一显示时序和曝光时序处于同一时间线上以准确地错开第一显示时序对应的有效工作状态及曝光时序对应的有效工作状态即可,在此不做具体限定。
请结合图19及图20,可以理解,结合上述对显示屏10的介绍,当显示屏10为一个独立的显示屏10时,控制第一子显示区111的显示时序,可以通过控制第一像素集合的发光时序来实现;控制第二子显示区112的显示时序,可以通过控制第二像素集合的发光时序来实现。当显示屏10包括第一子屏16及第二子屏17时,控制第一子显示区111的显示时序,可以通过控制第一子屏16的显示时序来实现;控制第二子显示区112的显示时序,可以通过控制第二子屏17的显示时序来实现。第一子显示区111显示的画面和第二子显示区112显示的画面可以共同形成完整的显示画面,例如,电子装置1000正在播放电影的过程中,显示区11要显示其中一帧电影画面,该电影画面中有一颗树、一个男人、一个女人,则可以是男人和女人全部位于第二子显示区112内,女人的大部分身子在第二子显示区112内,手臂在第一子显示区111内。或者;第一子显示区111显示的画面和第二子显示区112显示的画面为两个独立的显示画面,例如,电子装置1000当前正在执行播放电影的任务,则电影画面在第二子显示区112显示,而第一子显示区111 可以同步显示电子装置1000的电池电量、网络连接状态、系统时间等,或者同步显示即时通讯的消息或各应用程序的消息通知等。同样地,当显示屏10包括第一子屏16及第二子屏17时,第一子屏16显示的画面和第二子屏17显示的画面也可以共同形成完整的显示画面,或者第一子屏16显示的画面和第二子屏17显示的画面为两个独立的显示画面。
在某些实施方式中,在结构光摄像头22开启时,也可以控制第一子显示区111与第二子显示区112以不同的显示状态显示。其中,不同的显示状态可以是点亮或熄灭、以不同的亮度显示等。第一子显示区111与第二子显示区112的显示状态可以被独立控制,用户可以依据实际需求控制第二子显示区112正常显示,且第一子显示区111与结构光摄像头22配合使用。例如,结构光投射器21在发射激光时或者结构光摄像头22在接收被调制的结构光时,第一子显示区111可以熄灭、或者调低第一子显示区111的显示亮度,以减少第一子显示区111显示时对结构光投射器21向场景发射的激光、或结构光摄像头22接收被调制的激光的影响。
请参阅图25,本申请实施方式还提供另一种控制方法,其中,第一子显示区111及第二子显示区112共同发光或能够被独立控制,结构光摄像头22与第一子显示区111对应,控制方法包括:
05:判断结构光摄像头22是否开启;
06:在结构光摄像头22开启时,控制显示区11以第一显示时序显示影像、结构光摄像头22以曝光时序进行曝光,第一显示时序对应的有效工作状态与曝光时序对应的有效工作状态错开。
请再次参阅图17,本申请实施方式的控制方法可以由本申请实施方式的控制装置400实现,控制装置400可用于电子装置1000。控制装置400包括判断模块401和控制模块402。其中,步骤05可以由判断模块401实现,步骤06可以由控制模块402实现。也即是说,判断模块401可用于判断结构光摄像头22是否开启。控制模块402可用于在结构光摄像头22开启时,控制显示区11以第一显示时序显示影像、结构光摄像头22以曝光时序进行曝光,第一显示时序对应的有效工作状态与曝光时序对应的有效工作状态错开。
请再次参阅图1,本申请实施方式的控制方法可以由本申请实施方式的电子装置1000实现,即,在结构光摄像头22开启时,显示区11以第一显示时序显示影像,结构光摄像头22以曝光时序进行曝光,第一显示时序对应的有效工作状态与曝光时序对应的有效工作状态错开。在某些实施方式中,电子装置1000还可以包括处理器200,其中,步骤05和步骤06可以由处理器200实现。
在结构光摄像头22开启时,结构光摄像头22接收穿过第一子显示区111的被调制后的激光,此时第一子显示区111用于显示影像的光线会干扰结构光摄像头22,从而导致结构光摄像头22获得的散斑图像存在较大的误差,无法准确地获得目标物体的深度信息。因此,结构光摄像头22的曝光时序对应的有效工作状态与显示区11的第一显示时序对应的有效工作状态可以相互错开,即显示区11显示影像时结构光摄像头22不进行曝光,结构光摄像头22进行曝光时显示区11不显示影像,从而能够减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。
可以理解,在使用中,结构光投射器21与结构光摄像头22可以是同时开启,或者二者开启的时间间隔非常小,所以上述的结构光摄像头22开启的时刻,也即可以看作是结构光投射器21开启的时刻。
请再次参阅图1,在某些实施方式中,在显示区11显示影像时,电子装置1000产生第一中断信号以使结构光摄像头22停止曝光;和/或,在结构光摄像头22曝光时,电子装置1000产生第二中断信号以使显示区11停止显示影像。
请参阅图26,在某些实施方式中,步骤06包括:
061:在显示区11显示影像时,产生第一中断信号以使结构光摄像头22停止曝光;和/或
062:在结构光摄像头22曝光时,产生第二中断信号以使显示区11停止显示影像。
请再次参阅图17,在某些实施方式中,步骤061、步骤062可以由控制模块402实现,也即是说,控制模块402可用于在显示区11显示影像时,产生第一中断信号以使结构光摄像头22停止曝光;和/或,在结构光摄像头22曝光时,产生第二中断信号以使显示区11停止显示影像。另外,步骤061、步骤062也可以由处理器200实现。
在某些实施方式中,可以先确定显示区11显示影像的帧率,例如显示区11以30帧每秒、40帧每秒、或60帧每秒等的帧率显示影像,根据显示区11显示影像的帧率可以确定显示区11的第一显示时序。在显示区11显示影像时,第一显示时序对应的控制信号可以为高电平,此时可以产生第一中断信号以使结构光摄像头22停止曝光,结构光摄像头22的曝光时序对应的控制信号可以为低电平;在显示区11不显示影像时,第一显示时序对应的控制信号可以为低电平, 结构光摄像头22可以根据获取图像的帧率确定是否进行曝光,在结构光摄像头22进行曝光时,结构光摄像头22的曝光时序对应的控制信号可以为高电平,在结构光摄像头22不进行曝光时,结构光摄像头22的曝光时序对应的控制信号可以为低电平,从而可以得到结构光摄像头22的曝光时序并使得第一显示时序对应的有效工作状态(即对应的控制信号为高电平)与曝光时序对应的有效工作状态(即对应的控制信号为高电平)相互错开。在显示区11显示影像时,结构光摄像头22停止曝光,从而能够减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。
在某些实施方式中,可以先确定结构光摄像头22获取图像的帧率,例如结构光摄像头22以30帧每秒、40帧每秒、或60帧每秒等的帧率进行曝光,根据结构光摄像头22获取图像的帧率可以确定结构光摄像头22的曝光时序。在结构光摄像头22进行曝光时,曝光时序对应的控制信号可以为高电平,此时可以产生第二中断信号以使显示区11停止显示影像,显示区11的第一显示时序对应的控制信号可以为低电平;在结构光摄像头22不进行曝光时,曝光时序对应的控制信号可以为低电平,显示区11可以根据显示影像的帧率确定是否显示影像,在显示区11显示影像时,显示区11的第一显示时序对应的控制信号可以为高电平,在显示区11不显示影像时,显示区11的第一显示时序对应的控制信号可以为低电平,从而可以得到显示区11的第一显示时序并使得第一显示时序对应的有效工作状态(即对应的控制信号为高电平)与曝光时序对应的有效工作状态(即对应的控制信号为高电平)相互错开。在结构光摄像头22进行曝光时,显示区11停止显示影像,从而能够减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。
具体地,请参阅图19,在一个例子中,第一子显示区111及第二子显示区112共同发光,显示屏10为一个独立的屏结构,即,显示屏10为一个整体。此时,显示屏10的类型可以是通过背光源发光的显示屏,例如液晶显示屏等。
具体地,请参阅图19,在一个例子中,第一子显示区111及第二子显示区112能够被独立控制,显示屏10为一个独立的屏结构,即,显示屏10为一个整体,显示屏10的多个像素中的每个像素均能够被独立控制。其中,第一子显示区111包括由多个像素组成的第一像素集合,第二子显示区112包括多个像素组成的第二像素集合。可以理解,第一像素集合内的多个像素与第二像素集合内的多个像素均可以被独立控制。此时,显示屏10的类型可以是自发光的显示屏,例如OLED显示屏或Micro LED显示屏等,自发光的显示屏的每个像素均可以独立地被控制发光或者不发光或者以不同的发光亮度发光,可以通过控制像素的发光时序以控制第一子显示区111和/或第二子显示区112的显示时序。另外,自发光的显示屏的像素可以自发光以呈现对应的颜色。
在显示屏10为一个整体、独立的屏结构时,可以便于对显示区11进行控制,并且能够减少制造电子装置1000所需的工序,从而能够降低电子装置1000的成本。
请参阅图20,在另一个例子中,第一子显示区111及第二子显示区112能够被独立控制,显示屏10包括第一子屏16及第二子屏17,即,显示屏10可以由两个独立的子显示屏(第一子屏16及第二子屏17)组成,第一子屏16与第二子屏17可以被独立控制。第一子屏16可以形成第一子显示区111,第二子屏17可以形成第二子显示区112。此时,第一子屏16与第二子屏17的类型可以相同,例如均为液晶显示屏、均为OLED显示屏或均为Micro LED显示屏;第一子屏16与第二子屏17的类型也可以不同,例如第一子屏16为通过背光源发光的显示屏(比如液晶显示屏)、而第二子屏17为自发光的显示屏(比如OLED显示屏或Micro LED显示屏等)。又例如第一子屏16为自发光的显示屏(比如OLED显示屏或Micro LED显示屏等)、而第二子屏17为通过背光源发光的显示屏(比如液晶显示屏)。当然,也可以是第一子屏16为OLED显示屏、而第二子屏17为Micro LED显示屏等,具体选择方式不限于上述的举例。通过背光源发光的显示屏可以通过控制背光源的发光时序以控制第一子显示区111和/或第二子显示区112的显示时序。通过背光源发光的显示屏的像素也可以在背光的作用下呈现对应的颜色。
在某些实施方式中,第一子屏16与第二子屏17在结合成显示屏10时,人眼难以察觉到第一子屏16与第二子屏17之间的交界线,且在第一子屏16及第二子屏17显示影像时,即使第一子屏16与第二子屏17共同显示同一帧影像,人眼也不会察觉到第一子屏16与第二子屏17显示的影像之间的边界线。
第一子屏16与第二子屏17的具体形状可以依据需求进行设定,例如,第二子屏17大致呈矩形,第一子屏16也大致呈矩形,第一子屏16与第二子屏17相接并形成大致呈矩形的显示屏10;例如如图20所示,第二子屏17的形状可以是带穿孔172的圆角矩形,第一子屏16的形状可以与穿孔172的形状相同,穿孔172的形状可以是跑道形、水滴状等,第一子屏16与第二子屏17的形状互补并可共同形成呈圆角矩形状的显示屏10。当然,显示屏10的最终形状、第一子 屏16或第二子屏17的形状还可以是圆形、椭圆形、跑道形等形状,在此不作限制。第一子屏16可以位于显示屏10整体的边缘位置,第二子屏17可以位于显示屏10整体的中间位置。第一子屏16可以用于显示电子装置1000的状态图标,例如用于显示电子装置1000的电池电量、网络连接状态、系统时间等。
请结合图21,在某些实施方式中,在结构光摄像头22关闭时,显示区11以第二显示时序T1显示影像。
请再次参阅图25,在某些实施方式中,控制方法还包括:
07:在结构光摄像头22关闭时,控制显示区11以第二显示时序T1显示影像。
请再次参阅图17,在某些实施方式中,步骤07可以由控制模块402实现,也即是说,控制模块402可用于在结构光摄像头22关闭时,控制显示区11以第二显示时序T1显示影像。另外,步骤07也可以由处理器200实现。
在结构光摄像头22关闭时,也就意味着用户此时并不需要使用结构光摄像头22,即,此时结构光摄像头22并不需要接收穿过第一子显示区111的被调制后的激光,不存在第一子显示区111显示影像对结构光摄像头22造成干扰的问题,因此,可以控制显示区11以第二显示时序T1显示影像,使整个显示区11均能够清晰地、稳定地显示影像,以提升用户使用电子装置1000时的观感。
在某些实施方式中,第二显示时序T1可以是比较常用的显示时序,第二显示时序T1对应的帧率例如为60帧每秒、72帧每秒、或75帧每秒等。
在某些实施方式中,第一显示时序T2的周期可以大于第二显示时序T1的周期,其中,周期可以是指帧率的倒数,即显示区11在结构光摄像头22开启时显示影像的帧率可以小于显示区11在结构光摄像头22关闭时显示影像的帧率。具体地,为了便于控制,在结构光摄像头22开启时,第一显示时序T2与曝光时序T3可以是相互交错的(请参阅图21,在第一显示时序T2对应的控制信号为高电平时,曝光时序T3对应的控制信号为低电平,在第一显示时序T2对应的控制信号为低电平时,曝光时序T3对应的控制信号为高电平),即显示区11在结构光摄像头22开启时显示影像的帧率等于结构光摄像头22获取图像的帧率,而结构光摄像头22获取图像的帧率通常小于显示区11常用的显示影像的帧率(显示区11在结构光摄像头22关闭时显示影像的帧率),从而显示区11在结构光摄像头22开启时显示影像的帧率小于显示区11在结构光摄像头22关闭时显示影像的帧率,即,第一显示时序T2的周期大于第二显示时序T1的周期。另外,第一显示时序T2的周期大于第二显示时序T1的周期,还可以减少显示区11在结构光摄像头22开启时显示影像的功耗。
当然,在其他实施方式中,第一显示时序T2、第二显示时序T1和曝光时序T3也可以根据需求进行其他设置,例如请结合图22,第一显示时序T2的周期也可以小于第二显示时序T1的周期;请结合图23,第一显示时序T2与第二显示时序T1相同;请结合图24,第一显示时序T2的周期可以小于曝光时序T3的周期;第一显示时序T2的周期可以大于曝光时序T3的周期等,只要满足第一显示时序T2对应的有效工作状态与曝光时序T3对应的有效工作状态错开即可,在此不做具体限定。
在某些实施方式中,电子装置1000包括硬件时钟,第一显示时序及曝光时序均通过硬件时钟确定。通过同一硬件时钟可以准确地确定第一显示时序和曝光时序,使得第一显示时序及曝光时序处于同一时间线上,从而准确地错开第一显示时序对应的有效工作状态及曝光时序对应的有效工作状态,减少或避免第一子显示区111显示影像时对结构光摄像头22造成干扰。第二显示时序也可以通过该硬件时钟确定。
在某些实施方式中,也可以通过同一系统时钟等方式确定第一显示时序和曝光时序,只需要满足第一显示时序和曝光时序处于同一时间线上以准确地错开第一显示时序对应的有效工作状态及曝光时序对应的有效工作状态即可,在此不做具体限定。
请参阅图27,在某些实施方式中,在显示屏10为一整块LCD显示屏93、或第一子屏16为LCD显示屏93、或第二子屏17为LCD显示屏93、或第一子屏16和第二子屏17均为LCD显示屏93时,LCD显示屏93可以包括沿发光方向依次设置的背光模组931、下偏光片932、薄膜晶体管(Thin-film transistor,TFT)基板933、液晶层934、彩色滤光片935和上偏光片936。背光模组931可视作背光源。下偏光片932和上偏光片936用于控制光线的通过与否,具体地,上偏光片936和下偏光片932分别形成栅栏角度,阻隔掉光线中与栅栏垂直的分量,只准许与栅栏平行的分量通过。TFT基板933用于提供导电通路以产生电压。彩色滤光片935用于形成彩色影像。液晶层934中包括液晶分子,由于液晶分子结构的异方性,也即是液晶分子的介电系数及折射系 数等均具有异方性,所引起的光电效应会因为方向不同而有所差异。LCD显示屏93根据液晶本身的这些特性,通过TFT基板933产生电压,以在上偏光片936和下偏光片932之间形成电场,并利用电场控制液晶分子转动,来改变光的行进方向使光线通过或被下偏光片932和上偏光片936阻隔,从而不同的电场能够形成不同灰阶亮度。
请参阅图28,在某些实施方式中,在显示屏10为一整块OLED显示屏95、或第一子屏16为OLED显示屏95、或第二子屏17为OLED显示屏95、或第一子屏16和第二子屏17均为OLED显示屏95时,OLED显示屏95可以包括基板951、阳极952、空穴传输层953、发光层954、电子传输层955和阴极956。其中,基板951用来支撑整个OLED显示屏95。当给OLED的阳极952和阴极956施加电压时,电子和空穴分别从阴极956和阳极952向夹在两电极之间的有机功能层注入。注入的电子和空穴分别从电子传输层955和空穴传输层953向发光层954迁移。电子和空穴注入到发光层954后,由于库仑力的作用束缚在一起形成空穴对,即激子。激子在电场的作用下迁移,将能量转移给发光层954中的掺杂材料。发光层954的掺杂材料中的电子吸收能量后,从基态跃迁到激发态。由于激发态是不稳定的,电子会从激发态再次跃迁回基态,同时以光子的形式释放能量。根据发光材料激发态能级的不同,电子在跃迁回基态的过程中释放出不同能量的光子,能量决定光的波长,波长不同意味着光的颜色不同。如此,OLED显示屏95即可以自发光的形式发出各种不同颜色的光。OLED显示屏95发出的光亮度或强度取决于发光材料的性能以及施加电流的大小。对于同一OLED显示屏95,电流越大,光的亮度越高。OLED显示屏95中的每个像素(由多个可以自发光的次像素组成)可以由独立的薄膜晶体管来控制开/关,从而使得每个像素可以连续且独立地发光。
请参阅图29和图30,在某些实施方式中,在显示屏10为一整块Micro LED显示屏97、或第一子屏16为Micro LED显示屏97、或第二子屏17为Micro LED显示屏97、或第一子屏16和第二子屏17均为Micro LED显示屏97时,Micro LED显示屏97可以包括驱动基板971、封装基板972、支撑物973及多个像素974。驱动基板971与封装基板972相对设置,多个像素974排布在驱动基板971与封装基板972之间。每个像素974内对应设置一个可见光源9741。
驱动基板971内设有显示驱动电路(图未示),驱动基板971能够控制每个像素974内光源的开启、关闭及发光亮度。封装基板972用于将光源封装保护,封装基板972的材料可为聚对苯二甲酸乙二醇酯(PET)、或聚碳酸酯(PC)等有一定硬度的塑料,也可以是玻璃。支撑物973用于使驱动基板971与封装基板972之间保持一定的间距,并防止对像素974造成过度的挤压。
每个像素974还包括下像素电极9742和上像素电极9743,下像素电极9742设置在驱动基板971上,上像素电极9743设置在封装基板972下,可见光源9741夹设在下像素电极9742和上像素电极9743之间。像素电极的材料可以为氧化铟锡或导电金属。
如图29所示,一个例子中,多个可见光源9741包括红色光源、绿色光源及蓝色光源,每个可见光源9741与对应的像素电极组成一个像素974,从而使得含有不同光源的像素974发出不同颜色的光。
请参阅图30,另一个例子中,像素974的结构也可以包括可见光源9741及色彩转换层9744。例如,多个可见光源9741包括红色光源及蓝色光源,每个可见光源9741与对应的像素电极组成的像素974发出相应颜色的光。其中,含有红色光源的像素974发出红光,含有蓝色光源的像素974发出蓝光,含有蓝色光源及色彩转换层9744的像素974发出绿光。像素974还包括间隔层9745,间隔层9745有利于像素974之间的高度一致。
综上,LCD显示屏93可以通过控制背光模组931发光以显示影像,其中,LCD显示屏93的背光模组931只能进行整体控制,即整体发光或整体不发光;OLED显示屏95可以通过独立控制各个像素的发光层954发出不同颜色和亮度的光以显示影像;Micro LED显示屏97可以通过独立控制各个可见光源9741发出不同亮度、不同颜色的光以显示影像。
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本申请的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明 确具体的限定。
尽管上面已经示出和描述了本申请的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本申请的限制,本领域的普通技术人员在本申请的范围内可以对上述实施例进行变化、修改、替换和变型。

Claims (20)

  1. 一种电子装置,其特征在于,所述电子装置包括:
    显示屏,所述显示屏包括用于显示影像的显示区,所述显示区形成有相背的正面及背面,所述显示屏发出的光线沿所述背面指向所述正面的方向向外界发射,所述显示区包括第一子显示区及第二子显示区;
    结构光组件,所述结构光组件包括结构光摄像头,所述结构光摄像头设置在所述显示屏的所述背面所在一侧,所述结构光摄像头与所述第一子显示区对应,所述结构光摄像头用于接收穿过所述第一子显示区的被调制后的激光;
    在所述结构光摄像头开启时,所述显示区以第一显示时序显示所述影像,所述结构光摄像头以曝光时序进行曝光,所述第一显示时序对应的有效工作状态与所述曝光时序对应的有效工作状态错开。
  2. 根据权利要求1所述的电子装置,其特征在于,所述显示屏为OLED显示屏或Micro LED显示屏。
  3. 根据权利要求1所述的电子装置,其特征在于,所述显示屏包括第一子屏及第二子屏,所述第一子屏形成所述第一子显示区,所述第二子屏形成所述第二子显示区。
  4. 根据权利要求3所述的电子装置,其特征在于,所述第一子屏为OLED显示屏、Micro LED显示屏或LCD显示屏;和/或
    所述第二子屏为OLED显示屏、Micro LED显示屏或LCD显示屏。
  5. 根据权利要求1所述的电子装置,其特征在于,在所述结构光摄像头关闭时,所述显示区以第二显示时序显示所述影像,所述第一显示时序的周期大于所述第二显示时序的周期。
  6. 根据权利要求1所述的电子装置,其特征在于,所述电子装置包括硬件时钟,所述第一显示时序及所述曝光时序均通过所述硬件时钟确定。
  7. 根据权利要求1所述的电子装置,其特征在于,在所述显示区显示所述影像时,所述电子装置产生第一中断信号以使所述结构光摄像头停止曝光;和/或
    在所述结构光摄像头曝光时,所述电子装置产生第二中断信号以使所述显示区停止显示所述影像。
  8. 根据权利要求1所述的电子装置,其特征在于,所述结构光组件包括结构光投射器,所述结构光投射器设置在所述显示屏的所述背面所在的一侧,所述结构光投射器与所述第一子显示区对应,所述结构光投射器用于发射穿过所述第一子显示区的激光。
  9. 根据权利要求1所述的电子装置,其特征在于,所述电子装置还包括盖板,所述盖板设置在所述显示屏的所述正面所在的一侧,所述盖板的与所述第一子显示区对应的区域上设置有红外透过层。
  10. 根据权利要求1所述的电子装置,其特征在于,所述显示屏包括多个像素,所述第一子显示区的像素密度小于所述第二子显示区的像素密度。
  11. 一种电子装置的控制方法,其特征在于,所述电子装置包括显示屏和结构光组件,所述显示屏包括用于显示影像的显示区,所述显示区形成有相背的正面及背面,所述显示屏发出的光线沿所述背面指向所述正面的方向向外界发射,所述显示区包括第一子显示区及第二子显示区;所述结构光组件包括结构光摄像头,所述结构光摄像头设置在所述显示屏的所述背面所在一侧,所述结构光摄像头与所述第一子显示区对应,所述结构光摄像头用于接收穿过所述第一子显示区的被调制后的激光;所述控制方法包括:
    判断所述结构光摄像头是否开启;
    在所述结构光摄像头开启时,控制所述显示区以第一显示时序显示所述影像、所述结构光摄 像头以曝光时序进行曝光,所述第一显示时序对应的有效工作状态与所述曝光时序对应的有效工作状态错开。
  12. 根据权利要求11所述的控制方法,其特征在于,所述显示屏为OLED显示屏或Micro LED显示屏。
  13. 根据权利要求11所述的控制方法,其特征在于,所述显示屏包括第一子屏及第二子屏,所述第一子屏形成所述第一子显示区,所述第二子屏形成所述第二子显示区。
  14. 根据权利要求13所述的控制方法,其特征在于,所述第一子屏为OLED显示屏、Micro LED显示屏或LCD显示屏;和/或
    所述第二子屏为OLED显示屏、Micro LED显示屏或LCD显示屏。
  15. 根据权利要求11所述的控制方法,其特征在于,所述控制方法还包括:
    在所述结构光摄像头关闭时,控制所述显示区以第二显示时序显示所述影像,所述第一显示时序的周期大于所述第二显示时序的周期。
  16. 根据权利要求11所述的控制方法,其特征在于,所述电子装置包括硬件时钟,所述第一显示时序及所述曝光时序均通过所述硬件时钟确定。
  17. 根据权利要求11所述的控制方法,其特征在于,所述控制所述显示区以第一显示时序显示所述影像、所述结构光摄像头以曝光时序进行曝光包括:
    在所述显示区显示所述影像时,产生第一中断信号以使所述结构光摄像头停止曝光;和/或
    在所述结构光摄像头曝光时,产生第二中断信号以使所述显示区停止显示所述影像。
  18. 根据权利要求11所述的控制方法,其特征在于,所述结构光组件包括结构光投射器,所述结构光投射器设置在所述显示屏的所述背面所在的一侧,所述结构光投射器与所述第一子显示区对应,所述结构光投射器用于发射穿过所述第一子显示区的激光。
  19. 根据权利要求11所述的控制方法,其特征在于,所述电子装置还包括盖板,所述盖板设置在所述显示屏的所述正面所在的一侧,所述盖板的与所述第一子显示区对应的区域上设置有红外透过层。
  20. 一种电子装置的控制装置,其特征在于,所述电子装置包括显示屏和结构光组件,所述显示屏包括用于显示影像的显示区,所述显示区形成有相背的正面及背面,所述显示屏发出的光线沿所述背面指向所述正面的方向向外界发射,所述显示区包括第一子显示区及第二子显示区;所述结构光组件包括结构光摄像头,所述结构光摄像头设置在所述显示屏的所述背面所在一侧,所述结构光摄像头与所述第一子显示区对应,所述结构光摄像头用于接收穿过所述第一子显示区的被调制后的激光;所述控制装置包括:
    判断模块,用于判断所述结构光摄像头是否开启;
    控制模块,用于在所述结构光摄像头开启时,控制所述显示区以第一显示时序显示所述影像、所述结构光摄像头以曝光时序进行曝光,所述第一显示时序对应的有效工作状态与所述曝光时序对应的有效工作状态错开。
PCT/CN2019/102700 2018-11-16 2019-08-27 电子装置及其控制方法和控制装置 WO2020098331A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811369338.9A CN109348012B (zh) 2018-11-16 2018-11-16 电子装置及其控制方法和控制装置
CN201811369338.9 2018-11-16

Publications (1)

Publication Number Publication Date
WO2020098331A1 true WO2020098331A1 (zh) 2020-05-22

Family

ID=65316076

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/102700 WO2020098331A1 (zh) 2018-11-16 2019-08-27 电子装置及其控制方法和控制装置

Country Status (2)

Country Link
CN (1) CN109348012B (zh)
WO (1) WO2020098331A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109348012B (zh) * 2018-11-16 2020-04-03 Oppo广东移动通信有限公司 电子装置及其控制方法和控制装置
CN111698415B (zh) * 2019-03-14 2022-04-08 北京小米移动软件有限公司 图像采集控制方法和图像采集控制装置
EP3931877A1 (en) * 2019-04-23 2022-01-05 Apple Inc. Methods and configurations for improving the performance of sensors under a display
NL2024302B1 (en) * 2019-11-25 2021-08-26 Microsoft Technology Licensing Llc Image sharpening for subjects imaged through display

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105094307A (zh) * 2014-05-23 2015-11-25 宇龙计算机通信科技(深圳)有限公司 一种具有前置摄像头的移动设备
US20150381780A1 (en) * 2013-12-24 2015-12-31 Kyocera Corporation Electronic apparatus
CN108200238A (zh) * 2017-12-26 2018-06-22 广东欧珀移动通信有限公司 电子装置
CN108369471A (zh) * 2015-10-30 2018-08-03 精华产品公司 具有被至少光传感器覆盖的显示器的移动装置
CN108376696A (zh) * 2017-09-30 2018-08-07 云谷(固安)科技有限公司 终端及显示屏
CN109348012A (zh) * 2018-11-16 2019-02-15 Oppo广东移动通信有限公司 电子装置及其控制方法和控制装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2014116610A (ru) * 2014-04-24 2015-10-27 ЭлЭсАй Корпорейшн Генерирование изображений глубины с использованием псевдокадров, каждый из которых содержит множество фазовых изображений
KR20170123125A (ko) * 2016-04-28 2017-11-07 엘지전자 주식회사 이동단말기 및 그 제어방법
CN107911584A (zh) * 2017-11-28 2018-04-13 信利光电股份有限公司 一种图像采集设备和一种终端
CN108650343A (zh) * 2018-04-11 2018-10-12 深圳市海派通讯科技有限公司 一种智能终端前摄像头隐藏的结构及隐藏方法
CN108600472A (zh) * 2018-07-18 2018-09-28 苏州天为幕烟花科技有限公司 一种点阵互补式实现的手机全面屏技术

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150381780A1 (en) * 2013-12-24 2015-12-31 Kyocera Corporation Electronic apparatus
CN105094307A (zh) * 2014-05-23 2015-11-25 宇龙计算机通信科技(深圳)有限公司 一种具有前置摄像头的移动设备
CN108369471A (zh) * 2015-10-30 2018-08-03 精华产品公司 具有被至少光传感器覆盖的显示器的移动装置
CN108376696A (zh) * 2017-09-30 2018-08-07 云谷(固安)科技有限公司 终端及显示屏
CN108200238A (zh) * 2017-12-26 2018-06-22 广东欧珀移动通信有限公司 电子装置
CN109348012A (zh) * 2018-11-16 2019-02-15 Oppo广东移动通信有限公司 电子装置及其控制方法和控制装置

Also Published As

Publication number Publication date
CN109348012A (zh) 2019-02-15
CN109348012B (zh) 2020-04-03

Similar Documents

Publication Publication Date Title
WO2020098331A1 (zh) 电子装置及其控制方法和控制装置
CN109327576B (zh) 电子装置及其控制方法和控制装置
CN109348011B (zh) 电子装置及其控制方法和控制装置
WO2020098344A1 (zh) 电子装置
JP5195719B2 (ja) 液晶表示装置
CN111200672B (zh) 电子装置及其控制方法和控制装置
WO2020088043A1 (zh) 图像获取方法、图像获取装置、结构光组件及电子装置
WO2020088045A1 (zh) 图像获取方法、图像获取装置、结构光组件及电子装置
CN110618557A (zh) 一种显示面板和显示装置
CN105929602B (zh) 一种背光模组及其制作方法、显示面板和显示装置
WO2020088063A1 (zh) 电子装置
CN111158188B (zh) 一种显示面板及显示装置
EP3567632A1 (en) Display panel and manufacturing method thereof, and display device display
CN109218482B (zh) 电子装置及其控制方法和控制装置
WO2020088044A1 (zh) 图像获取方法、图像获取装置、结构光组件及电子装置
CN111200671A (zh) 电子装置及其控制方法和控制装置
CN109413238B (zh) 电子装置及其控制方法和控制装置
CN109327575B (zh) 电子装置、电子装置的控制方法及控制装置
WO2020098330A1 (zh) 电子装置及其控制方法和控制装置
US20220011611A1 (en) Display panel and display device
CN212181215U (zh) 背光模组及液晶显示装置
CN109327578B (zh) 电子装置及其控制方法和控制装置
CN109413237B (zh) 电子装置、电子装置的控制方法及控制装置
CN109361793B (zh) 电子装置、电子装置的控制方法及控制装置
CN109167861B (zh) 控制方法、控制装置及电子装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19883941

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19883941

Country of ref document: EP

Kind code of ref document: A1