WO2020057206A1 - 屏下光学系统及电子设备 - Google Patents
屏下光学系统及电子设备 Download PDFInfo
- Publication number
- WO2020057206A1 WO2020057206A1 PCT/CN2019/092165 CN2019092165W WO2020057206A1 WO 2020057206 A1 WO2020057206 A1 WO 2020057206A1 CN 2019092165 W CN2019092165 W CN 2019092165W WO 2020057206 A1 WO2020057206 A1 WO 2020057206A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- filter
- display screen
- screen
- light
- optical
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B11/00—Filters or other obturators specially adapted for photographic purposes
- G03B11/04—Hoods or caps for eliminating unwanted light from lenses, viewfinders or focusing aids
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
Definitions
- the invention belongs to the field of electronic technology, and particularly relates to an optical system and electronic equipment under a screen.
- Photographing and display are a must-have function of many electronic devices.
- a front camera and a display are simultaneously set on the front of the electronic device to meet a variety of needs, such as selfies, content display, and touch interaction.
- full-screen electronic devices such as full-screen mobile phones
- full-screen mobile phones have gradually become the new direction of mobile phone innovation, because full-screen mobile phones have a high screen ratio, are easy to manipulate, and have great aesthetics.
- the current challenge for full-screen electronic devices is the conflict between the front camera and the display. The presence of the front camera makes it difficult for the display to truly fill the entire front of the phone in order to achieve a high screen ratio.
- a flip or lift hidden camera design solution uses a flip or lift-type mechanical structure to flip or lift the camera located behind or inside the electronic device to the front when needed; the latter opens in the display and hides the camera in the opening.
- These solutions have problems.
- the mechanical structure in the flip or lift hidden camera solution is easy to damage and the user experience is not perfect.
- the special-shaped screen solution is not a true full-screen solution, and the special-shaped screen will affect the display effect to a certain extent. In short, there is currently a lack of a better full-screen solution.
- the present invention provides an under-screen optical system including a transparent display screen composed of a plurality of periodically arranged pixel units for display.
- An optical module and a filter wherein the optical module is configured to receive a light beam from the transparent display screen or emit a light beam outward through the transparent display screen, and the filter is disposed on the transparent display
- the screen and the optical module are configured to reduce visible light transmission from one side of the transparent display screen.
- the filter includes an optical switch that operates in a transparent or non-transparent state to allow or prevent light from passing through.
- the filter includes a one-way see-through film, and a side surface of the one-way see-through film facing the display screen has a transmittance of visible light greater than a reflectance, and the one-way see-through film is far away from all The transmittance of visible light on one side of the display screen is less than the reflectance.
- a side surface of the unidirectional see-through film corresponding to the optical module facing the display screen faces the non-visible light beam.
- the transmittance of visible light is greater than the reflectance; or when the light beam emitted by the optical module is a non-visible light beam, the one-way perspective film corresponding to the optical module faces a portion of the optical module.
- the transmittance of the side surface to the invisible light is greater than the reflectance.
- the filter includes a filter for blocking visible light and allowing only light beams in a non-visible wavelength range to pass through.
- the filter includes a filter, and the filter has a lower transmittance for visible light than a transmittance for non-visible light.
- the optical module includes a non-visible light receiving module and a non-visible light emitting module
- the filter includes first filters corresponding to the non-visible light receiving module and the non-visible light emitting module, respectively.
- a third filter, the first filter and the third filter include one or more of an optical switch, a unidirectional see-through film, and a filter.
- the optical module further includes a visible light camera
- the filter further includes a second filter corresponding to the visible light camera.
- the second filter includes an optical switch and a unidirectional perspective.
- the filter includes at least a first filter and a second filter superposed along a beam direction, and the first filter and the second filter include an optical switch and a unidirectional perspective.
- the present invention also provides an electronic device including the under-screen optical system described in the above embodiments.
- the improvement of the under-screen optical system provided by the present invention over the prior art lies in that: by providing a filter between the transparent display screen and the optical module, the filter is configured to reduce the number of light coming from one side of the transparent display screen. The visible light is transmitted, which can realize the concealment and visibility of the optical module, so as to achieve a full screen, and its mechanical structure is not easy to be damaged. Compared with the prior art special-shaped screen, it is a true full screen and improves the display effect. And user experience.
- FIG. 1 is a schematic front view of an electronic device according to an embodiment of the present invention.
- FIG. 2 is a schematic structural composition diagram of an electronic device according to an embodiment of the present invention.
- FIG. 3 is a schematic structural diagram of an under-screen optical system according to a first embodiment of the present invention.
- FIG. 4 is a schematic structural diagram of an under-screen optical system according to a second embodiment of the present invention.
- FIG. 5 is a schematic structural diagram of an under-screen optical system according to a third embodiment of the present invention.
- FIG. 6 is a schematic structural diagram of an under-screen optical system according to a fourth embodiment of the present invention.
- FIG. 7 is a schematic structural diagram of an under-screen optical system according to a fifth embodiment of the present invention.
- FIG. 8 is a schematic structural diagram of an under-screen optical system according to a sixth embodiment of the present invention.
- FIG. 9 is a schematic structural diagram of an under-screen optical system according to a seventh embodiment of the present invention.
- FIG. 10 is a schematic structural diagram of an under-screen optical system according to an eighth embodiment of the present invention.
- FIG. 11 is a schematic structural diagram of an under-screen optical system according to a ninth embodiment of the present invention.
- FIG. 12 is a schematic diagram of an electronic device including a spliced display screen according to an embodiment of the present invention.
- FIG. 1 is a schematic front view of an electronic device according to an embodiment of the present invention.
- the electronic device 10 includes a housing 105, a display screen 106 provided on the front, and a sensor on the top.
- the sensor on the top includes a light emitting module 101, a camera 102, and a light receiving module 103, and may further include a speaker, ambient light / proximity, etc.
- the sensor 104 is a sensor.
- the display screen 106 may be a plasma display screen, a liquid crystal display (Liquid Crystal Display, LCD), a light emitting diode display (Light-Emitting Diode, LED), an organic light emitting diode display (Organic Light-Emitting Diode, OLED), etc.
- the display screen 106 may also include a touch function.
- a capacitive touch electrode is provided in the display screen 106 as an input device for human-computer interaction.
- sensors can be placed on the top, can also be placed in other parts, or can be distributed in different parts of the electronic device. In some embodiments, the sensor may also be disposed on the back of the electronic device.
- Sensors are used to send or receive external information from electronic devices, such as light and sound.
- the camera 102 may be a visible light camera (color camera or grayscale camera), which is used to collect images of external objects, a speaker is used to convert electrical signals into sound signals and send them out, and an ambient light sensor is used to obtain external ambient light intensity information
- the proximity sensor is used to detect whether an external object approaches the electronic device.
- the transmitting module 101 and the light receiving module 103 can form a depth camera module for collecting depth image information of the external object. It can be understood that the type of the sensor is not limited to this, and different types of sensors can be provided in the electronic device according to actual needs.
- the sensor further includes a flood light illumination module and the like.
- FIG. 2 is a schematic structural composition diagram of an electronic device according to an embodiment of the present invention.
- the electronic device also includes a processor 206 and a microphone 202, a radio frequency and baseband processor 203 connected thereto.
- Interface 204, memory 205, battery 207, MEMS (Microelectromechanical Systems) sensor 208, audio device 209, etc. different units can realize data transmission and signal communication through circuit connection.
- MEMS Microelectromechanical Systems
- the electronic device may include fewer structures or include more other composition structures.
- the electronic device may be a mobile phone, a computer, a game console, a tablet, a television, a wearable device, a smart watch, or the like.
- the processor 206 is configured to perform overall control on the entire electronic device.
- the processor 206 may be a single processor or may include multiple processor units, such as being composed of processor units with different functions.
- the processor 206 may also be an integrated system on chip (SOC, System On Chip), which includes a central processing unit, an on-chip memory, a controller, a communication interface, and the like.
- the processor 206 is an application processor, such as a mobile application processor, and is mainly responsible for implementing functions other than communication in the electronic device, such as text processing, image processing, and the like.
- the display screen 106 is used to display images under the control of the processor 206 to present applications and the like to the user.
- the display screen 106 may also include a touch function.
- the display also serves as a human-computer interaction interface for receiving user input.
- the microphone 202 is used to receive voice information and can be used to implement voice interaction with a user.
- the radio frequency and baseband processor 203 is responsible for communication functions of the electronic device, such as receiving and translating signals such as voice or text to realize information exchange between remote users.
- the interface 204 is used to connect the electronic device with the outside to further realize functions such as data transmission and power transmission.
- the interface 204 is controlled by a communication interface in the processor 206.
- the interface 204 may include a USB interface, a WIFI interface, and the like.
- the memory 205 is configured to store data, such as application data, system data, and temporary code and data stored by the processor 206 during execution.
- the memory 205 may be composed of a single or multiple memories, and may be any form of memory such as RAM (Random Access Memory), FLASH flash memory, and the like, which can be used to save data. It can be understood that the memory can be used as a part of the electronic device or can exist independently of the electronic device, such as cloud storage, and the data stored in it can communicate with the electronic device through the interface 204 and the like.
- An application program such as a face recognition application is generally stored in a non-volatile readable storage medium. When the application is executed, the processor will call a corresponding program from the storage medium for execution.
- the ambient light / proximity sensor 201 may be an integrated single sensor or an independent ambient light sensor and a proximity sensor.
- the ambient light sensor is used to obtain the lighting information of the current environment where the electronic device is located.
- the screen brightness can be automatically adjusted to provide a more comfortable display brightness for the human eye;
- the proximity sensor can measure whether Some objects are close to the electronic device. Based on this, some functions can be implemented, such as turning off the touch function of the screen when a human face is close enough to prevent accidental touch when receiving a call.
- the proximity sensor can also quickly determine the approximate distance between a human face and the electronic device.
- the battery 207 is used to provide power.
- the speaker 209 is used for voice output.
- the MEMS sensor 208 is used to obtain the current state information of the electronic device, such as position, direction, acceleration, gravity, etc. Therefore, the MEMS sensor 208 may include sensors such as an accelerometer, a gravimeter, and a gyroscope. In one embodiment, the MEMS sensor 208 can be used to activate some face recognition applications. For example, when a user picks up an electronic device, the MEMS sensor 208 can obtain this change and transmit this change to the processor 206. The processor 206 Call the stored face recognition application to perform a face recognition application.
- the camera 102 is used for capturing images.
- the processor controls the camera 102 to capture images and transmit the images to a display for display.
- an unlocking program based on face recognition when the unlocking program is activated, the camera captures an image, and the processor processes the image, including face detection and recognition, and performs an unlocking task according to the recognition result.
- the camera 102 may be a single camera or multiple cameras; in some embodiments, the camera 102 may include an RGB camera or a grayscale camera for collecting visible light information, or an infrared or ultraviolet camera for collecting invisible light information. In some embodiments, the camera 102 may include a light field camera, a wide-angle camera, a telephoto camera, and the like.
- the camera 102 can be set at any position of the electronic device, such as the top or bottom of the front surface (same as the surface on which the display is located), the rear surface, etc.
- the camera is set on the front of the electronic device 102 is used to collect a user's face image; the camera 102 is also disposed on the rear surface for taking pictures of the scene and the like.
- the camera 102 is disposed on the front and rear surfaces, both of which can acquire images independently or can be controlled by the processor 102 to acquire images synchronously; in some embodiments, the camera 102 can also be a depth camera 210 For example, as a light receiving module or a color camera in the depth camera 210.
- the depth camera 210 includes a light transmitting module 101 and a light receiving module 103, which are respectively responsible for transmitting and receiving signals of the depth camera.
- the depth camera may further include a depth calculation processor for processing the received signals to obtain depth image information.
- the deep computing processor may be a dedicated processor, such as an ASIC chip, or the processor 206 in an electronic device.
- the light emitting module 101 and the light receiving module 103 may be an infrared laser speckle pattern projector and a corresponding infrared camera, respectively.
- the infrared laser speckle pattern projector is used to emit to the surface of a space object. A preset speckle pattern of a specific wavelength.
- the preset speckle pattern is reflected on the surface of an object and imaged in an infrared camera.
- the infrared camera can obtain an infrared speckle image modulated by the object. Further, the infrared speckle image will be processed by depth calculation.
- the calculator calculates to generate a corresponding depth image.
- the light source in the projector can be selected from near-infrared light sources with wavelengths such as 850 nm and 940 nm.
- the types of light sources can include edge-emitting lasers, vertical cavity surface lasers, or corresponding light source arrays.
- the distribution of the spots in the preset spot pattern is generally randomly distributed to achieve the irrelevance of the sub-regions in a certain direction or in multiple directions, that is, any sub-region selected in a certain direction satisfies high uniqueness requirements.
- the light emitting module 101 may also be composed of light sources such as LEDs and lasers that can emit visible light, ultraviolet light and other wavelengths, and is used to emit structures such as stripes, speckles, and two-dimensional coding. Light pattern.
- the depth camera may also be a time-of-flight (TOF) depth camera, a binocular depth camera, or the like.
- TOF depth cameras the light emitting module is used to emit a pulsed beam or a modulated (such as amplitude modulated) continuous wave beam.
- the processor circuit calculates the beam emission and The time interval between receiving to further calculate the depth information of the object.
- the binocular depth camera one is an active binocular depth camera, which includes a light emitting module and two light receiving modules.
- the light emitting module projects a structured light image to an object, and the two light receiving modules acquire For two structured light images, the processor will directly use these two structured light images for depth image calculations; the other is binocular. At this time, the light emitting module can be regarded as another light receiving module. Each light receiving module collects two images, and the processor directly uses these two images to calculate a depth image.
- a structured light depth camera is taken as an example to explain the idea of the present invention. It can be understood that the corresponding invention content can also be applied to other types of depth cameras.
- the present invention sets the sensor on the back of the display screen.
- the area corresponding to the sensor in the display screen 106 can still display the content normally as other areas, and the sensor can penetrate the display.
- the screen sends or receives signals, such as flood light illumination, structured light projection, and image acquisition through the display screen.
- the present invention not only avoids the disadvantage of poor reliability of the lifting structure, but also avoids the disadvantage of poor experience brought by the special-shaped screen.
- FIG. 1 only gives a schematic front view of an electronic device.
- the external shape and screen ratio of the electronic device may also be in other forms, such as a circular shape, an oval shape, a prism shape, and the like.
- the optical module is used to receive or emit a light beam of a specified wavelength or wavelength region.
- the optical module is divided into a visible light optical module and a non-visible light optical module.
- the visible light optical module is used to emit or receive a visible light beam.
- the visible light optical module is used to emit or receive non-visible light beams.
- an infrared optical module is used as an example of the non-visible light optical module. It can be understood that, for example, ultraviolet, X-ray and other non-visible light optical modules Visible light is also suitable for the present invention.
- FIG. 3 is a schematic structural diagram of an under-screen optical system according to a first embodiment of the present invention.
- the under-screen optical system includes a display screen 31 and a light receiving module 33.
- a light receiving module 33 is provided on one side of the display screen 31 (for example, the back and the lower part of the display screen).
- the display screen 31 includes a transparent display screen such as a plasma display screen, an LCD, an LED, and an OLED. Display periodically arranged pixel units, such as pixel units periodically arranged in the horizontal and vertical directions. In order to make the display screen transparent so that the light beam can pass through, it can be achieved by reasonable design of multiple pixel units, such as setting a gap between the pixel units or part of the internal structure of the pixel units made of transparent materials.
- the display has a certain aperture ratio, such as 50% aperture ratio.
- the entire structure of each pixel unit of the display screen may also be made of a transparent material, thereby improving transparency.
- the light receiving module 33 is configured to receive a light beam 34 from the display screen 31.
- the light receiving module 33 includes an image sensor 331, a filter element 332, and a lens 333.
- the image sensor 331 may be a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor Transistor, complementary metal oxide semiconductor).
- the filter element 332 may be a Bayer filter, an infrared filter, or the like.
- the light receiving module may also include other structural forms, such as a light field camera, a photodiode, and the like.
- the lens 333 may be a single lens, or a lens group or a lens array.
- FIG. 4 is a schematic structural diagram of an under-screen optical system according to a second embodiment of the present invention.
- the under-screen optical system includes a display screen 41 and a light emitting module 43.
- a light emitting module 43 is provided on one side of the display screen 41 (such as the back and the lower part of the display screen).
- the display screen 41 is a transparent display screen, and the light receiving module 43 provided on one side can emit outward through the transparent display screen.
- Light beam 44 (the outward emission referred to here is only an exemplary description and is not limited).
- the light emitting module 43 includes a light source 431, a lens 432, and a diffractive optical element 433.
- the light source 431 may be a light source such as an edge-emitting laser emitter, a vertical cavity surface laser emitter, or an LED, or may be a plurality of light sources.
- An array light source composed of light sources, such as a vertical cavity surface laser emitter array chip; a lens 432 is used to collimate or focus the light beam emitted by the light source 431; the diffractive optical element 433 receives the light beam from the lens and diffracts to project a patterned light beam, Such as structured light patterned beams (such as speckle patterns, speckle patterns, etc.).
- the light emitting module 43 may also be a flood illuminator, such as a flood illuminator composed of a light source and a diffuser; in some embodiments, the light emitting module 43 may also be a flashlight; In some embodiments, the light emitting module may also be a light source in a TOF camera, a proximity sensor, or the like, for emitting a pulse or a modulated light beam.
- a flood illuminator such as a flood illuminator composed of a light source and a diffuser
- the light emitting module 43 may also be a flashlight
- the light emitting module may also be a light source in a TOF camera, a proximity sensor, or the like, for emitting a pulse or a modulated light beam.
- the display screen and the optical module are further provided between the display screen and the optical module.
- Filters 32 and 42 can be provided, and the filters 32 and 42 can be configured to reduce the transmission of visible light from one side of the display screen, so that external users cannot directly observe the optical module behind the display screen. It makes the display have the appearance integrity and enhances the visual beauty.
- the optical filter is an optical switch, such as a liquid crystal shutter (liquid crystal spatial light modulator), which is in a non-transparent state when power is off and cannot pass light; it is in a transparent state when power is on and light can pass. Therefore, this optical switch is arranged between the optical module and the display screen, and the optical module can be hidden by setting the optical switch.
- the optical switch When the optical module is working, set the optical switch to a transparent state to allow light to pass; while when the optical module is not working, set the optical switch to an opaque state to prevent light from passing through, so that users on the other side of the display cannot see the setting Optical module on the opposite side of the display.
- the optical switch can also be made of other types of materials, such as electrochromic materials, thermochromic materials, or through a certain optical structure to make it possible to change whether light passes through.
- the filter is a one-way see-through film.
- the one-way see-through film allows external light to enter the optical module through the display screen and prevents internal light from passing through the display screen. That is, the one-way perspective film faces the optical module.
- the transmittance of the side surface to visible light is less than the reflectance (for example, the transmittance is 5% to 30%, the reflectance is 90% to 95%), and the transmittance of visible light to the side of the display surface is greater than the reflectance ( For example, the transmittance is 60% to 95% and the reflectance is 5% to 30%).
- the optical module on the display side is a visible light receiving module (such as a color camera), the transmission quality will affect the imaging quality to a certain extent; if the optical module on the display side is affected.
- the invisible light beam is received or transmitted (infrared beam is used as an example), that is, when the optical module includes an infrared receiving module (such as an infrared camera), an infrared transmitting module, etc.
- the corresponding unidirectional perspective film should be It is configured to have a high light transmittance to infrared light, that is, for the infrared receiving module, the surface of the one-way perspective film facing the display screen has a high transmittance for infrared light, and generally requires a transmittance greater than Reflectivity; for the infrared emitting module, the one-way perspective film facing the infrared emitting module is required to have a high transmittance for infrared light.
- the transmittance is generally greater than the reflectivity, such as 80%. ⁇ 95% to ensure imaging or projection quality.
- a better way is to choose a suitable unidirectional fluoroscopy film for different optical modules.
- the filter is a filter for blocking visible light and allowing only light beams in a certain non-visible wavelength range to pass.
- the optical module on the side of the display is an infrared receiving module (such as an infrared camera) or an infrared transmitting module
- the use of an infrared filter can enable the infrared receiving module and the infrared transmitting module to collect infrared images and The infrared light beam is emitted to prevent visible light from passing through, thereby achieving the purpose of hiding the optical module behind the display screen.
- the filter is a special filter.
- the special filter has a low transmittance for visible light and a high transmittance for a certain invisible wavelength, such as Near infrared light, in a better example, for example, the transmittance to visible light is 10% to 50%, and the transmittance to near infrared light is 60 to 99%.
- the transmittance to visible light is 10% to 50%
- the transmittance to near infrared light is 60 to 99%.
- the filter can be an independent optical device, or it can be combined with an optical module or a display screen.
- the filter when it is in the form of a thin film, it can be set on the surface of the display screen or optical device as a coating. Filter.
- the display screen 106 in addition to the sensor behind the display screen 106, it also includes other devices such as circuits, batteries, etc. In order to hide these devices, the filters described above can be used. In fact, because these devices do not need to collect or project the light beam outside the display screen, they can be opaque in a lower cost way to hide these devices, such as using opaque black or other colored polymer coatings.
- the under-screen optical system includes a display screen 51, a filter 52, and a depth camera.
- the depth camera includes a light receiving module 53 and a light emitting module 54, and a filter 52 is provided between the depth camera and the display screen 51.
- the filter 52 is an optical switch.
- the light-receiving module 53 and the light-emitting module 54 of the depth camera both work in the non-visible light band, such as the infrared band.
- the light-receiving module is used to collect a light beam with a wavelength of 850 nm, and the light-emitting module 54 A 850nm wavelength light beam is emitted.
- the filter can use an 850nm infrared filter to allow the 850nm wavelength light beam to pass through and prevent visible light from passing through to achieve the purpose of depth imaging and hiding the depth camera.
- the under-screen optical system includes a display screen 61, a filter, and a depth camera.
- the depth camera includes a light receiving module 65, a camera 66, and a light emitting module 67.
- a filter is provided between the depth camera and the display screen 61.
- the light receiving module 65 and the light emitting module 67 work in the non-visible light band to collect depth images (the infrared wavelength will be described as an example below), that is, the light receiving module 65 and the light emitting module 67 become Infrared receiving module and infrared light emitting module
- the camera 66 is a visible light receiving module, such as a visible light camera for collecting visible light images, such as color images.
- the filters can also be set as optical switches, unidirectional see-through films, filters, and the like. However, in some embodiments, a single form of the filter is often unable to meet the needs, so it is necessary to set the filter into a combination of multiple different forms. As shown in FIG.
- the filter includes a first filter 62, a second filter 63, and a third filter 64 (which correspond to the receiving module 65, the camera 66, and the light emitting module 67, respectively).
- a third filter 64 which correspond to the receiving module 65, the camera 66, and the light emitting module 67, respectively.
- the first filter 62, the second filter 63, and the third filter 64 are arranged along a direction perpendicular to the optical path of the optical module, that is, the first filter 62, the second filter 63, and the third
- the filters 64 are individually arranged, and can be arranged at intervals or adjacently in order.
- the filters 64 are determined according to the positional relationship between the receiving module 65, the camera 66, and the light emitting module 67, and there is no limitation on this.
- the first filter 62 and the third filter 64 are infrared filters, and the second filter 63 is an optical switch or a unidirectional see-through film.
- the first filter 62 is a first unidirectional see-through film
- the third filter 64 is a third unidirectional see-through film
- the second filter 63 is an optical switch or a second unidirectional see-through film.
- the transmittance of the surface of the first, second, and third unidirectional see-through films facing the optical module is less than the reflectance, and the transmittance of the surface facing the display screen 61 is greater than the reflectance;
- the transmittance of the surface of the first unidirectional see-through film facing the display screen 61 is greater than the reflectance
- the transmittance of the surface of the third unidirectional see-through film facing the light emitting module is greater than the reflectance.
- the first filter 62 and the third filter 64 are optical switches
- the second filter 63 is an optical switch or a unidirectional see-through film.
- FIG. 7 is a schematic structural diagram of an under-screen optical system according to a fifth embodiment of the present invention.
- the filter between the optical module and the display screen 71 includes at least two layers. It can be understood that, for different optical modules, the number of layers included in the filter may be different, some may be a single layer, and some may be multiple layers. In this embodiment, two layers are used as an example for illustration. Sexual description.
- the depth camera includes a light receiving module 74, a camera 75, and a light emitting module 76.
- a filter is provided between the depth camera and the display 71, and the filter includes a direction (or a beam direction) along the optical module to the display.
- the superimposed first filter 72 and the second filter 73 for example, the first filter 72 is an optical switch, and the second filter 73 is a unidirectional see-through film.
- the display screen is generally composed of a plurality of pixel units that are periodically arranged horizontally and vertically.
- the multiple pixel units form a periodic pixel diffraction structure, so the display screen will have a diffraction effect on the incident light beam, which will eventually cause the projection or imaging quality to decline. .
- FIG. 8 is a schematic structural diagram of an under-screen optical system according to a sixth embodiment of the present invention.
- the under-screen optical system includes a display screen 81 and a light emitting module.
- the light emitting module includes a light source 82, a lens 83, and a first diffractive optical element (DOE, Diffractive Optical Elements) 84.
- DOE diffractive optical element
- the lens 83 is used to collimate or focus the light beam emitted by the light source 82.
- the first diffractive optical element 84 receives the light from the lens.
- the diffracted beam is projected into a first diffracted beam 85 after being diffracted, and the first diffracted beam 85 is projected into the external space through the display screen 81.
- the lens 83 may be a lens group or a lens array. It can be understood that the composition of the light emitting module is not limited to this.
- the light emitting module may be composed of only the light source 82 and the first DOE 84, or the light emitting module may include other devices, such as a micro lens array, etc. In short, according to actual needs, the light emitting module can have a corresponding structural composition.
- a light emitting module composed of a light source, a lens, and a DOE is used to project a patterned light beam, such as a structured light patterned light beam (such as a speckle pattern, a stripe pattern, a two-dimensional pattern, etc.), a flood light beam, and a single beam. Spot beam, modulated TOF beam, etc.
- a structured light patterned light beam such as a speckle pattern, a stripe pattern, a two-dimensional pattern, etc.
- a flood light beam such as a single beam.
- Spot beam modulated TOF beam, etc.
- the display screen 81 is the second diffractive optical element (second DOE).
- the beams have been affected, such as reduced contrast, increased noise, etc., and even the beam after the second diffraction is completely divergent from the patterned beam. For this reason, it poses a huge challenge to placing optical modules behind the screen.
- the first DOE84 will no longer project a preset patterned beam (such as a preset speckle patterned beam), but will comprehensively consider the first DOE84 and the display screen (that is, the second DOE) during the design phase. ) 81 to achieve the following: the first DOE84 receives the incident light beam from the light source and projects a first diffracted beam 85, and the first diffracted beam 85 is diffracted again by the second DOE81 to project a patterned beam 86.
- a preset patterned beam such as a preset speckle patterned beam
- the design process of the first DOE84 generally includes the following steps:
- the diffraction performance of the display screen which is the second DOE.
- the complex amplitude transmittance function to describe it.
- One possible detection method is to use a plane wave to enter the display screen from a single angle or multiple angles. The distribution is collected by the receiving screen, and the diffraction performance of the second DOE is measured by the light intensity distribution;
- the complex amplitude spatial distribution of the first diffracted beam 85 is obtained from the patterned beam 86 through inverse diffraction calculation;
- the diffraction pattern of the first DOE is calculated from the spatial distribution of the complex amplitude of the first diffracted beam 85 and the beam distribution before it is incident on the first DOE 84 through the lens 83.
- the first DOE84 is not limited to only a single piece of DOE, but it can also be a multi-piece DOE.
- the multi-piece DOE is not limited to being formed on different optical devices. For example, two sub-DOEs can be generated on the opposite surface of the same transparent optical device. .
- the first DOE84 and the second DOE81 may not be limited to discrete devices.
- the first DOE84 can be generated on the back of the second DOE81 display screen, which can improve the overall integration. Since the display 81 often has multiple Composition of layers with different functions.
- the first DOE can also be integrated into a certain layer of the display screen 81, or one or more layers of the first DOE 84 can be integrated into the display screen 81. In a certain layer.
- FIG. 9 is a schematic structural diagram of an under-screen optical system according to a seventh embodiment of the present invention.
- the under-screen optical system includes a display screen 91 and a light emitting module.
- the light emitting module includes a light source 92, a lens 93, and a first diffractive optical element (DOE) 94.
- the lens 93 is used to collimate or focus the light beam emitted by the light source 92.
- the first diffractive optical element 94 receives the light beam from the lens and diffracts it.
- the patterned light beam 96 is projected, and the patterned light beam 96 is projected into the external space through the display screen 91.
- a compensation element 95 is further provided between the first DOE 94 and the display screen 91, and the compensation element 95 is used to compensate the diffraction effect of the display screen (second DOE) 91.
- a new compensation display screen 98 is composed of the compensation element 95 and the second DOE 91.
- the compensation element 95 in the compensation display screen 98 is designed to be complementary to the diffraction effect of the display screen, thereby cancelling the second
- the effect of DOE91 on the patterned light beam projected by the light emitting module that is, a plane wave incident on the iso-phase plane of the light emitted from the compensation display screen is still perpendicular to the direction of the incident light wave vector. Therefore, the patterned light beam emitted from the first DOE 94 is incident on the compensation display screen, and then projected into the space with the patterned light beam 97.
- the compensation element 95 it is difficult for the compensation element 95 to completely eliminate the diffraction effect of the second DOE91, so it is difficult to ensure that the patterned beam 97 is the same as the patterned beam 96. A slight difference between the two is also allowed, such as in the space of intensity The distribution is slightly different.
- the compensation element 95 can be configured as any optical element capable of changing the beam amplitude and / or phase, such as a DOE, a Spatial Light Modulator (SLM), and the like.
- a spatial light modulator it may be a liquid crystal spatial light modulator, which is composed of multiple pixels, and each pixel can change the amplitude of the incident light by changing its properties (such as refractive index, gray scale, etc.). And / or phase.
- the first DOE94 in FIG. 9 is designed in the same way as the DOE design idea in the conventional optical transmission module.
- the first DOE84 in the embodiment shown in FIG. There is a greater difficulty increase.
- the focus of the embodiment shown in FIG. 9 is to design the compensation element 95.
- the design steps are as follows:
- the design process of the compensation element 95 generally includes the following steps:
- the second DOE91 For example, use the complex amplitude transmittance function to describe it.
- One possible detection method is to use a plane wave to enter the display screen from a single angle or multiple angles. The distribution is collected by the receiving screen, and the diffraction performance of the second DOE91 is measured by the light intensity distribution;
- the complex beam amplitude distribution of the incident beam incident on the second DOE91 is obtained from the outgoing beam 97 through inverse diffraction calculation;
- the diffraction pattern of the compensation element 95 is calculated from the spatial distribution of the complex amplitude of the incident beam incident on the second DOE91 and the beam distribution of the incident beam 96 incident on the compensation element 95.
- the spatial distribution of the incident light beam 96 and the outgoing light beam 97 incident on the compensation element 95 is almost the same, which may be a plane wave beam or a patterned beam.
- the first DOE94 and the third DOE95 are not limited to only a single piece of DOE, but may also be formed by stacking multiple pieces of DOE in a stacked form, and the multiple pieces of DOE are not limited to forming On different optical devices, for example, two sub-DOEs can be generated on the opposite surfaces of the same transparent optical device, respectively.
- the first DOE94 and the third DOE95 may not be limited to being separate devices, and two DOEs may be generated on the opposite surfaces of the same transparent optical device, respectively, as the first DOE94 and the third DOE95.
- the third DOE95 and the second DOE91 are not limited to discrete devices.
- the third DOE95 can be generated on one side of the display screen (second DOE91), thereby improving the overall integration. Composition of layers with different functions. In order to further improve the integration, the third DOE95 can also be integrated into one of them.
- the relative positions of the first DOE94, the third DOE95, and the second DOE91 are not limited to the embodiment shown in FIG. 9.
- the three can be designed according to actual needs.
- the first DOE94 and the third DOE95 can be integrated into the first DOE94 and the third DOE95.
- the positions of the first DOE94 and the third DOE95 can be interchanged.
- any structural composition that does not violate the idea of the present invention is applicable to the present invention.
- FIG. 10 is a schematic structural diagram of an under-screen optical system according to an eighth embodiment of the present invention.
- the under-screen optical system includes a display screen 101 and a light receiving module.
- the light receiving module includes an image sensor 102 and a lens 103.
- the light beam 106 on the other side of the display screen 101 is incident on the lens 103 through the display screen 101 and is imaged on the image sensor 102. Due to the periodic microstructure of the pixels inside the display screen, it will diffract the incident light beam 106 and affect the imaging quality.
- a compensation element 104 is further provided between the image sensor 102 and the display screen 101.
- the first DOE 104 is used to compensate the diffraction effect of the display screen (second DOE) 101.
- a new compensation display 105 is composed of the first DOE104 and the second DOE101.
- the first DOE104 is designed to be complementary to the diffraction effect of the display, thereby canceling the second DOE101 imaging the light receiving module. The impact of quality.
- the first DOE 104 is not limited to only a single DOE, and may also be a multi-piece DOE.
- the multi-piece DOE is not limited to being formed on different optical devices.
- two sub-DOEs can be generated on the opposite surfaces of the same transparent optical device.
- the first DOE104 and the second DOE101 may not be limited to discrete devices.
- the first DOE104 can be generated on one side of the display screen (second DOE101), thereby improving the overall integration degree. Since the display screen 101 often has It is composed of multiple layers with different functions.
- the first DOE104 can also be integrated into a certain layer of the display 101, or one or more layers of the first DOE104 can be integrated into the display 101. In one of the layers.
- each component can be fused with each other, such as for As far as the under-screen light emitting module shown in FIG. 8 is concerned, a diffractive optical element can be integrated into the inner layer of the display screen, and a filter is disposed between the lens and the DOE.
- a diffractive optical element can be integrated into the inner layer of the display screen, and a filter is disposed between the lens and the DOE.
- the under-screen optical system includes:
- the depth camera is composed of a light receiving module and a light emitting module.
- the light receiving module includes an image sensor 113 and a lens 114.
- the light emitting module includes a light source 116, a lens 117, and a first DOE 118.
- the compensation display 111 is composed of multiple layers and compensation elements integrated in the layers, and the first DOE 118 is also integrated in the layers.
- the compensation element in this embodiment includes a first sub DOE115 corresponding to the light receiving module and a second sub DOE119 corresponding to the light transmitting module.
- the first sub DOE115 and the second sub DOE119 are separately set, and their diffraction effects are different from those of the display
- the diffraction effect of 111 is complementary.
- At least one of the first sub DOE 115 and the second sub DOE 119 may be integrated into the display screen 111.
- An optical filter 112 is provided between the light receiving module, the light emitting module and the display screen 111.
- the structural form of the light receiving module and the display screen, and the structural form of the light emitting module and the display screen can be based on actual needs. Any combination is not limited to the embodiment shown in FIG. 11.
- the structure of the light emitting module and the display screen 81 shown in FIG. 8 and the structure of the light receiving module and the display screen 101 shown in FIG. 10 can be combined into a screen. Depth camera.
- the compensation elements 95 and 104 are liquid crystal spatial light modulators in the compensation display screen, since they have the function of modulating the amplitude and phase of the incident beam, they can be used not only for diffraction compensation, but also for diffraction compensation. Can be used as an optical switch to hide the light emitting module or light receiving module.
- the liquid crystal spatial light modulator is adjusted to be in a transparent state, and the pixel units therein are phase-modulated to compensate the diffraction effect of the display screen 91 or 101 on the outgoing or incident light beam. This can greatly improve the system's functional and structural integration.
- the optical module behind the display screen requires that the display screen can transmit light, that is, the transparent display screen, but the transparent display screen has a higher cost than the traditional non-transparent display screen.
- the present invention provides a splicing display screen solution based on the above embodiments.
- FIG. 12 is a schematic diagram of an electronic device including a spliced display screen according to an embodiment of the present invention.
- the electronic device 12 includes a housing 125, a display screen 126 provided on the front, and a sensor, where the sensor includes a light emitting module 121, a camera 122, and a light receiving module 123, and may further include a sensor 124 such as a speaker, an ambient light / proximity sensor, and the like.
- the display screen 126 is composed of two parts, namely a first display screen unit 126a and a second display screen unit 126b.
- the sensor is disposed behind the first display screen unit 126a, and the first display screen unit 126a 126a is a transparent display screen, which allows sensors placed behind it to receive external information or transmit information to the outside.
- the second display screen unit 126b is provided with different attributes from the first display screen unit 126a.
- the second display screen unit 126b is a non-transparent display screen, such as a common LCD display screen or a common LED display screen.
- the first display screen unit 126a and the second display screen unit 126b are the same type of display screen, for example, both are OLED display screens, but the aperture ratio of the first display screen unit 126a is greater than that of the second display screen.
- Unit 126b to make it easier for light to pass through.
- the entire display screen 126 is not necessarily formed by splicing, but two areas of the same display screen, and the aperture ratio of the two areas is controlled during design and manufacturing. In addition to the aperture ratio, other types of settings can also be used.
- the resolution of the two areas is different.
- the resolution of the first display unit 126a is smaller than that of the second display unit 126b.
- the two areas are different.
- the overall transparency of the material in the first display unit 126a is higher than the overall transparency of the material in the second display unit 126b, so that the transparency of the first display unit 126a is higher than that of the second display unit 126b .
- the display screen 126 includes more than two display screen units, for example, a first display screen unit 126a is provided for each sensor.
- the shapes of the first display screen unit 126a and the second display screen unit 126b are not limited to those shown in FIG. 12, for example, the first display screen unit 126a may be circular, and the second display screen unit 126b has a shape similar to that of the first display screen unit 126b.
- 126a is a circular through hole adapted to form a whole display screen 126 together.
- the first display screen 126a and the second display screen 126b are independently controlled.
- the first display screen 126a is turned off, and the second display screen 126b can still display normally. content.
- the solutions of the first display screen 126a can be applied to the splicing screen solution.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
Abstract
本发明适用于电子技术领域,提供了一种屏下光学系统及电子设备,屏下光学系统包括透明显示屏、光学模组和滤光器,透明显示屏包括多个用于显示的周期性排列的像素单元,光学模组用于接收来自所述透明显示屏的光束或者透过所述透明显示屏向外发射光束;所述滤光器设置在所述透明显示屏与所述光学模组之间,被配置为可以减少来自所述透明显示屏一侧的可见光透过。本发明通过在透明显示屏与光学模组之间配置可以减少来自所述透明显示屏一侧的可见光透过的滤光器,能够实现显示屏和滤光器背面的光学模组的隐藏和可见,且其机械结构不容易受损,从而实现了全面屏,提升显示效果与用户体验。
Description
本发明属于电子技术领域,特别涉及一种屏下成光学系统及电子设备。
拍照与显示是目前许多电子设备的必备功能,在电子设备的正面同时设置前置相机以及显示器以满足多种需求,比如自拍、内容显示、触控交互等。
随着人们对手机美感越来越高的要求,全面屏电子设备,比如全面屏手机逐渐成为手机创新的新方向,因为全面屏手机具有极高的屏占比,便于操控,同时具有极富美感的视觉冲击力。当前全面屏电子设备所面临的挑战是前置相机与显示屏之间的冲突,前置相机的存在使得显示屏难以真正意义上充满整个手机正面,以达到较高的屏占比。
目前较佳的几种方案包括:翻转或升降式隐藏相机设计方案、异形屏方案等。前者利用翻转或者升降式机械结构将设置在电子设备后方或内部的相机在需要时翻转或升降至正面;后者则在显示屏中开口,并将相机隐藏在开口中。这些方案均存在问题,比如翻转或升降式隐藏相机方案中机械结构容易受损、用户体验不完美,异形屏方案并非真正意义上的全面屏方案,同时异形屏在一定程度上会影响显示效果。总之,当前缺乏一种效果更佳的全面屏方案。
发明内容
本发明为了解决目前的全面屏方案容易导致结构受损、会影响显示效果的技术问题,提供一种屏下光学系统,包括由多个用于显示的周期性排列的像素单元组成的透明显示屏,光学模组以及滤光器,其中所述光学模组用于接收来自所述透明显示屏的光束或者透过所述透明显示屏向外发射光束,所述滤光器设置在所述透明显示屏与所述光学模组之间,被配置为可以减少来自所述透明显示屏一侧的可见光透过。
在一些实施例中,所述滤光器包括光学开关,所述光学开关工作于透明或非透明状态以允许或阻止光线通过。
在一些实施例中,所述滤光器包括单向透视膜,所述单向透视膜面向所述显示屏的一侧表面对可见光的透过率大于反射率,所述单向透视膜远离所述显示屏的一侧表面对可见光的透过率小于反射率。
在一些实施例中,当所述光学模组接收的所述光束为非可见光光束时,与所述光学模组对应的所述单向透视膜面向所述显示屏的一侧表面对所述非可见光的透过率大于反射率;或,当所述光学模组发射的所述光束为非可见光光束时,与所述光学模组对应的所述单向透视膜面向所述光学模组的一侧表面对所 述非可见光的透过率大于反射率。
在一些实施例中,所述滤光器包括滤光片,所述滤光片用于阻止可见光且仅允许非可见光波长区间的光束通过。
在一些实施例中,所述滤光器包括滤光片,所述滤光片对可见光的透过率低于对非可见光的透过率。
在一些实施例中,所述光学模组包括非可见光接收模组以及非可见光发射模组,所述滤光器包括与所述非可见光接收模组以及非可见光发射模组分别对应的第一滤光器、第三滤光器,所述第一滤光器、第三滤光器包括光学开关、单向透视膜、滤光片中的一种或多种。
在一些实施例中,所述光学模组还包括可见光相机,所述滤光器还包括与所述可见光相机对应的第二滤光器,所述第二滤光器包括光学开关、单向透视膜中的一种或多种。
在一些实施例中,所述滤光器包括沿光束方向叠加设置至少第一滤光器以及第二滤光器,所述第一滤光器、第二滤光器包括光学开关、单向透视膜、滤光片中的一种或多种。
本发明还提供一种电子设备,包括以上各实施例中所述的屏下光学系统。
本发明提供的屏下光学系统相对于现有技术的进步在于:通过在透明显示屏与光学模组之间设置滤光器,该滤光器被配置为可以减少来自所述透明显示屏一侧的可见光透过,能够实现光学模组的隐藏和可见,从而实现全面屏,且其机械结构不容易受损,相对于现有技术的异形屏来说是真正意义上的全面屏,提升显示效果与用户体验。
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是根据本发明一个实施例的电子设备的正面示意图;
图2是根据本发明一个实施例的电子设备的结构组成示意图;
图3是根据本发明第一实施例的屏下光学系统的结构示意图;
图4是根据本发明第二实施例的屏下光学系统的结构示意图;
图5是根据本发明第三实施例的屏下光学系统的结构示意图;
图6是根据本发明第四实施例的屏下光学系统的结构示意图;
图7是根据本发明第五实施例的屏下光学系统的结构示意图;
图8是根据本发明第六实施例的屏下光学系统的结构示意图;
图9是根据本发明第七实施例的屏下光学系统的结构示意图;
图10是根据本发明第八实施例的屏下光学系统的结构示意图;
图11是根据本发明第九实施例的屏下光学系统的结构示意图;
图12是根据本发明一个实施例的含有拼接显示屏的电子设备示意图。
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本发明。
需说明的是,当部件被称为“固定于”或“设置于”另一个部件,它可以直接或者间接在该另一个部件上。当一个部件被称为是“连接于”另一个部件,它可以是直接或者间接连接至该另一个部件上。术语“上”、“下”、“左”、“右”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本专利的限制。术语“第一”、“第二”仅用于便于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明技术特征的数量。“多个”的含义是两个或两个以上,除非另有明确具体的限定。
为了说明本发明所述的技术方案,以下结合具体附图及实施例进行详细说明。
图1是根据本发明一个实施例的电子设备的正面示意图。电子设备10包括壳体105、设置在正面的显示屏106以及顶部的传感器,其中顶部的传感器包括光发射模组101、相机102、光接收模组103,还可以包括如扬声器、环境光/接近传感器等传感器104。显示屏106可以是等离子体显示屏、液晶显示屏(Liquid Crystal Display,LCD)、发光二极管显示屏(Light-Emitting Diode,LED)、有机发光二极管显示屏(Organic Light-Emitting Diode,OLED)等,用于显示应用程序图像、补光等,根据实际需要也可以是其他任意形式的显示屏。显示屏106同时还可以包含触摸功能,比如显示屏106中设置电容触控电极,以作为人机交互的输入装置。
多个传感器可以设置在顶部,也可以设置在其他部位,或者分散设置在电子设备的不同部位。在一些实施例中,传感器也可以设置在电子设备的背面。
传感器用于发送或接收电子设备外部信息,比如光照、声音等信息。比如相机102可以为可见光相机(彩色相机或灰度相机),用于采集外部物体的图像,扬声器用于将电信号转换成声音信号并向外发送,环境光传感器用于获取外部环境光强度信息,接近传感器用于检测是否有外部物体靠近电子设备,此外,由发射模组101、光接收模组103可以组成深度相机模组,用于采集外部物体的深度图像信息。可以理解的是,传感器的种类不限于此,可以根据实际需要在电子设备中设置不同种类的传感器,比如,在一个实施例中,传感器还包括泛光照明模组等。
图2是根据本发明一个实施例的电子设备的结构组成示意图。除了在图1中示出的显示屏106、环境光/接近传感器201、相机102、深度相机210等传感器外,电子设备还包含处理器206以及与之连接的麦克风202、射频及基带处理器203、接口204、存储器205、电池207、MEMS(Microelectro Mechanical Systems,微机电系统)传感器208、音频装置209等,不同的单元之间可以通 过电路连接实现数据传输与信号通讯。这里仅以一个实施例的组成结构进行说明,在其他实施例中,电子设备也可以包含更少的结构或者包含更多的其他组成结构。电子设备可以是手机、电脑、游戏机、平板、电视、可穿戴设备设备、智能手表等。
处理器206用于对整个电子设备进行整体控制,处理器206可以是单个的处理器也可以包含多个处理器单元,比如由不同功能的处理器单元组成。在一些实施例中,处理器206也可以是集成片上系统(SOC,System on Chip),包含中央处理单元、片上存储器、控制器、通信接口等。在一些实施例中,处理器206为应用处理器,比如移动应用处理器,主要负责电子设备中除通信外其他功能的实现,例如文本处理、图像处理等。
显示屏106用于在处理器206的控制下显示图像以将应用等呈现给用户,另外显示屏106也可以包含触控功能,此时显示器也作为人机交互接口,用于接收用户的输入。
麦克风202用于接收语音信息,可以用来实现与用户的语音交互。
射频及基带处理器203负责电子设备的通讯功能,比如接收及翻译语音或文字等信号以实现远程用户之间的信息交流。
接口204用于使得电子设备与外部进行连接,以进一步实现数据传输、电力传输等功能,接口204由处理器206中的通信接口来控制。接口204可以包括USB接口、WIFI接口等。
存储器205用于保存数据,比如应用程序数据、系统数据、处理器206在执行过程中保存的临时代码和数据。存储器205可以由单个或多个存储器组成,其可以是RAM(随机存取存储器,Random Access Memory)、FLASH闪存等任何可用于保存数据的存储器形式。可以理解的是,存储器即可以作为电子设备的一部分,也可以独立于电子设备存在,比如云端存储器,其保存的数据可以通过接口204等与电子设备通信。应用程序如人脸识别应用一般被保存在非易失性可读存储介质中,当执行该应用时,处理器将从该存储介质中调用相应的程序来执行。
环境光/接近传感器201,其可以是集成的单一传感器也可以是独立的环境光传感器以及接近传感器。其中环境光传感器用来获取电子设备所处当前环境的光照信息,在一个实施例中,基于该光照信息可以实现屏幕亮度的自动调整以提供对人眼更加舒适的显示亮度;接近传感器可以测量是否有物体靠近电子设备,基于此可以实现一些功能,比如在接听电话时当人脸足够靠近时关闭屏幕的触控功能防止误触。在一些实施例中,接近传感器还可以快速判断人脸与电子设备之间的大致距离。
电池207用于提供电力。扬声器209用于实现语音输出。
MEMS传感器208用于获取电子设备当前的状态信息,比如位置、方向、加速度、重力等,因此MEMS传感器208可以包含加速度计、重力计、陀螺仪等传感器。在一个实施例中,MEMS传感器208可以用来激活一些人脸识别应用,比如当用户拿起电子设备时,MEMS传感器208可以获取这一变化,同时 将这一变化传输到处理器206,处理器206调用存储器的人脸识别应用程序以进行人脸识别应用。
相机102用于采集图像,在一些应用中,比如自拍应用执行时,处理器控制相机102采集图像,并将图像传输到显示器进行显示。在一些实施例中,比如基于人脸识别的解锁程序,当解锁程序激活时,相机采集图像,处理器对图像进行处理,包括人脸检测与识别,并根据识别结果执行解锁任务。相机102可以是单个相机也可以是多个相机;在一些实施例中,相机102即可以包含用于采集可见光信息的RGB相机、灰度相机,也可以包含采集不可见光信息的红外、紫外相机等;在一些实施例中,相机102可以包含光场相机、广角相机、长焦相机等。
相机102可以设置在电子设备的任意位置,比如前置表面(与显示器所在表面相同)的顶端或底端等、后置表面等位置,在图1所示实施例中,电子设备正面设置了相机102用于采集用户人脸图像;相机102也被设置在后置表面用于对场景进行拍照等。在一个实施例中,相机102被设置在前置以及后置表面,二者可以独立采集图像也可以被处理器102控制以同步采集图像;在一些实施例中,相机102也可以是深度相机210的一部分,比如作为深度相机210中的光接收模组或彩色相机等。
深度相机210包括光发射模组101以及光接收模组103,其分别负责深度相机的信号发射与接收,深度相机还可以包括深度计算处理器,用于对接收的信号进行处理以获取深度图像信息,深度计算处理器可以是专用处理器,比如ASIC芯片,也可以是电子设备中的处理器206。例如,对于结构光深度相机,光发射模组101与光接收模组103可以分别为红外激光斑点图案投影仪以及与之相对应的红外相机,红外激光斑点图案投影仪用于向空间物体表面发射特定波长的预设斑点图案,该预设斑点图案经物体表面反射后成像在红外相机中,由此红外相机可以获取被物体调制后的红外斑点图像,进一步地,红外斑点图像会被深度计算处理器计算以生成相应的深度图像。一般地,投影仪中的光源可以选择如850nm、940nm等波长的近红外光源,光源的种类可以包含边发射激光器、垂直腔面激光器或相应的光源器阵列等。预设斑点图案中斑点的分布一般为随机分布以实现沿某一方向或多个方向上的子区域不相关性,即沿某一方向选择的任一个子区域均满足较高的唯一性要求。可以选择的是,在一些实施例中,光发射模组101也可以是由可发射可见光、紫外光等波长的LED、激光等光源组成,用于发射如条纹、散斑、二维编码等结构光图案。
在一些实施例,深度相机也可以是基于时间飞行法(Time of Flight,TOF)深度相机、双目深度相机等。对于TOF深度相机,光发射模组用于向外发射脉冲光束或者经调制(比如振幅调制)的连续波光束,光接收模组接收由物体反射的光束后,由处理器电路计算出光束发射与接收之间的时间间隔来进一步计算出物体的深度信息。而对于双目深度相机,一种是主动双目深度相机,其包含一个光发射模组和两个光接收模组,光发射模组向物体投射结构光图像,两个光接收模组分别获取两幅结构光图像,处理器将直接利用这两幅结构光图像进 行深度图像计算;另一种是被双目,此时可以将光发射模组看成是另一个光接收模组,由两个光接收模组采集两幅图像,处理器直接利用这两幅图像计算出深度图像。在接下来将以结构光深度相机为例说明本发明的思路,可以理解的是,相应的发明内容也可以被应用到其他种类的深度相机中。
回到图1,为了尽可能提升电子设备的屏占比,本发明将传感器设置在显示屏背面,显示屏106中与传感器对应的区域仍然可以与其他区域一样正常显示内容,传感器可以穿透显示屏以发送或接收信号,比如透过显示屏以进行泛光照明、结构光投影、图像采集等。与已有技术相比,本发明即避免了升降式结构的可靠性差的缺点也避免了异形屏所带来的体验差的缺点。可以理解的是,将传感器设置在显示屏106背面不仅有利于提升屏占比,同时也可以解决其他问题,比如视频通话时人眼注视方向朝向屏幕而非相机导致体验差的问题等。因此,图1仅示意性给出一种电子设备的正面示意图,电子设备的外形、屏占比等也可以是其他形式,比如外形是圆形、椭圆形、棱形等等。
然而,将传感器(以下将以光学模组,例如光发射模组、光接收模组、相机为例进行说明)设置在显示屏背面将面临一些问题,比如如何隐藏传感器以给用户提供完美的全面屏体验;再比如如何克服显示屏对光发射以及光接收的影响(包括对光束振幅以及相位的影响)。光学模组用于接收或发射指定波长或波长区域的光束,本发明中将光学模组分成可见光光学模组以及非可见光光学模组,其中可见光光学模组用于发射或接收可见光光束,可非可见光光学模组则用于发射或接收非可见光光束,为了便于理解,将以红外光学模组作为非可见光光学模组的一种示例来进行说明,可以理解的是,例如紫外、X射线等非可见光也适用于本发明。
图3是根据本发明第一实施例的屏下光学系统的结构示意图,屏下光学系统包括显示屏31以及光接收模组33。显示屏31一侧(比如指显示屏背部、下部等)设置有光接收模组33,显示屏31包括等离子体显示屏、LCD、LED、OLED等透明显示屏,显示屏中包括多个用于显示的周期性排列的像素单元,比如沿横向以及纵向周期性排列的像素单元。为了使显示屏透明化以使得光束通过,可以通过对多个像素单元进行合理的设计来实现,比如在像素单元之间设置间隙或者像素单元内部的部分结构采用透明材质制成,由此可以让显示屏达到一定的开口率,比如50%的开口率等。在一些实施例中,也可以将显示屏的各个像素单元的全部结构均用透明材质制成,由此可以提升透明度。
光接收模组33用于接收来自显示屏31的光束34。光接收模组33包括图像传感器331、滤光元件332以及透镜333,图像传感器331可以是CCD(Charge Coupled Device,电荷耦合器件)或CMOS(Complementary Metal-Oxide-Semiconductor Transistor,互补金属氧化物半导体)等,滤光元件332可以是拜尔滤光片、红外滤光片等。光接收模组也可以包括其他结构形式,比如光场相机、光电二极管等。透镜333即可以是单个透镜,也可以是透镜组或者透镜阵列。
图4是根据本发明第二实施例的屏下光学系统的结构示意图,在本实施例 中,屏下光学系统包括显示屏41以及光发射模组43。显示屏41一侧(比如显示屏背面、下部等)设置有光发射模组43,显示屏41为透明显示屏,设置在一侧的光接收模组43则可以透过透明显示屏向外发射光束44(这里所说的向外发射仅示例性说明,并非限定)。在本实施例中,光发射模组43包括光源431、透镜432以及衍射光学元件433,其中光源431可以是边发射激光发射器、垂直腔面激光发射器、LED等光源,也可以是多个子光源组成的阵列光源,比如垂直腔面激光发射器阵列芯片;透镜432用于准直或聚焦由光源431所发出的光束,衍射光学元件433接收来自透镜的光束经衍射后投射出图案化光束,比如结构光图案化光束(如斑点图案、散斑图案等)。在一些实施例中,光发射模组43也可以是泛光照明器,比如由光源、漫射器组成的泛光照明器;在一些实施例中,光发射模组43也可以是闪光灯;在一些实施例中,光发射模组也可以是TOF相机、接近度传感器中的光源等,用于发射脉冲或者经调制的光束。
在图3及图4所示的实施例中,由显示屏以及光学模组(包括光发射模组以及光接收模组)组成的屏下光学系统中,在显示屏以及光学模组之间还可以设置滤光器32和42,滤光器32和42可以被配置成减少来自显示屏一侧的可见光透过,从而使得外部的用户不能直接观察到显示屏背后的光学模组,由此可以使得显示屏具有外观上的完整性,提升视觉美感。
在一个实施例中,滤光器是光学开关,比如液晶快门(液晶空间光调制器),其在断电时处于非透明状态,光线无法通过;在通电时处于透明状态,光线可以通过。因此将此光学开关设置在光学模组与显示屏之间,可以通过对光学开关的设置来隐藏光学模组。在光学模组工作时,设置光学开关至透明状态,使得光线通过;而光学模组不工作时,设置光学开关至不透明状态,阻止光线通过,从而使得显示屏另一侧的用户无法看到设置在显示屏对侧的光学模组。光学开关也可以是其他类型材料制成,比如电致变色材料、热变色材料,或者通过一定的光学结构使得可以改变光线是否通过。
在一个实施例中,滤光器是单向透视膜,单向透视膜尽可能允许外部的光线通过显示屏进入光学模组而阻止内部光线通过显示屏,即单向透视膜面向光学模组一侧表面对于可见光的透过率小于反射率(比如透过率为5%~30%,反射率为90%~95%),而面向显示屏一侧表面对于可见光的透过率大于反射率(比如透过率为60%~95%,反射率为5%~30%)。需要说明的是,若显示屏一侧的光学模组是可见光接收模组(比如彩色相机)时,由于透过率的影响,会一定程度上影响成像质量;若显示屏一侧的光学模组所接收或发射的是非可见光光束时(以红外光束为例进行说明),即光学模组包括红外接收模组(比如红外相机)、红外发射模组等时,与之对应的单向透视膜应被配置成对红外光具有较高的透光率,即对于红外接收模组而言要求单向透视膜面向显示屏一侧表面对于红外光有较高的透过率,一般要求透过率大于反射率;对于红外发射模组而言要求单向透视膜面向红外发射模组一侧表面对于红外光有较高的透过率,一般要求透过率大于反射率,比如透过率为80%~95%,以确保成像或投影质量。在采用单向透视膜时,一种较佳的方式是针对不同的光学模组选择合适性能的单向透视 膜。
在一个实施例中,滤光器是滤光片,用于阻止可见光且仅允许某一非可见光波长区间的光束通过。比如,对于显示屏一侧的光学模组是红外接收模组(比如红外相机)、红外发射模组等时,采用红外滤光片可以使得红外接收模组、红外发射模组可以采集红外图像以及发射红外光束,而防止可见光通过,由此可以实现隐藏显示屏后光学模组的目的。
在一个实施例中,滤光器是一种特制的滤光片,这种特制的滤光片对可见光的透过率较低,而对某一非可见光波长的光透过率较高,例如近红外光,在一个较佳的例子中,比如对可见光的透过率为10%~50%,而对近红外光的透过率为60~99%,外界环境光通过这种特制的滤光片后照射到光学模组中,经光学模组反射后,重新透过这种特制滤光片的可能性大大降低,从而达到隐藏显示屏后光学模组的作用,同时由于这种模组对近红外光的透过率很高,对红外发射模组、红外接收模组的影响非常有限。
可以理解的是,以上几种滤光器并非对本发明的限定,任何可以实现类似功能的滤光器均可以被用于本发明中。
可以理解的是,滤光器可以是独立的光学器件,也可以是与光学模组或者显示屏结合,比如当滤光器是薄膜形式时,可以在显示屏或光学器件表面以镀膜的形式设置滤光器。
如图1所示,显示屏106背后除了传感器之外,还包括电路、电池等其他器件,为了隐藏这些器件,可以采用上面所述的滤光器。实际上,由于这些器件无需采集或投射显示屏外部的光束,因此可以通过成本更低的方式实现不透明从而隐藏这些器件,比如采用不透明的黑色或其他颜色的聚合物涂料等。
图5是根据本发明第三实施例的屏下光学系统的结构示意图,屏下光学系统包括显示屏51、滤光器52以及深度相机。深度相机包括光接收模组53以及光发射模组54,深度相机与显示屏51之间设置有滤光器52。在一个实施例中,滤光器52为光学开关,在深度相机工作时,比如人脸识别程序中启动深度相机采集显示屏外部的人脸深度图像时,打开光学开关以使得光线通过,当图像采集结束时,关于光学开关防止光线通过以隐藏深度相机。在一个实施例中,深度相机的光接收模组53以及光发射模组54均工作在非可见光波段,比如红外波段,比如光接收模组用于采集850nm波长的光束,而光发射模组54则发射850nm波长的光束,此时滤光器可以采用850nm的红外滤光片,用于让850nm波长的光束通过,防止可见光通过以达到深度成像以及隐藏深度相机的目的。
图6是根据本发明第四实施例的屏下光学系统的结构示意图,屏下光学系统包括显示屏61、滤光器以及深度相机。深度相机包括光接收模组65、相机66、光发射模组67,深度相机与显示屏61之间设置有滤光器。一般地,光接收模组65以及光发射模组67工作在非可见光波段用于采集深度图像(下面将以红外波长为例进行描述),即,光接收模组65和光发射模组67分别成为红外接收模组和红外发光模组,相机66为可见光接收模组,如可见光相机用于采集可见光图像,比如彩色图像。滤光器同样可以设置成光学开关、单向透视膜、滤 光片等。但在一些实施例中,单一形式的滤光器往往不能满足需求,因此需要将滤光器设置成多种不同形式的结合。如图6所示,滤光器包括与分别与接收模组65、相机66、光发射模组67对应的第一滤光器62、第二滤光器63以及第三滤光器64(这一思路同样适用于图5所示的实施例,即分别对光接收模组53以及光发射模组54单独配置第一滤光器与第三滤光器)。第一滤光器62、第二滤光器63以及第三滤光器64沿着垂直于光学模组的光路方向排列设置,即第一滤光器62、第二滤光器63以及第三滤光器64单独设置,可以间隔排列,也可以依次邻接排列,根据接收模组65、相机66、光发射模组67之间的位置关系而定,对此不做限制。
在一个实施例中,第一滤光器62、第三滤光器64为红外滤光片,第二滤光器63为光学开关或单向透视膜。
在一个实施例中,第一滤光器62为第一单向透视膜,第三滤光器64为第三单向透视膜,第二滤光器63为光学开关或第二单向透视膜。对于可见光而言,第一、第二以及第三单向透视膜面向光学模组一侧表面的透过率小于反射率,而面向显示屏61一侧表面的透过率大于反射率;对于红外光而言,第一单向透视膜面向显示屏61一侧表面的透过率大于反射率,第三单向透视膜面向光发射模组一侧表面的透过率大于反射率。
在一个实施例中,第一滤光器62、第三滤光器64为光学开关,第二滤光器63为光学开关或单向透视膜。
可以理解的是,以上几个实施例并非对本发明方案的限制,任意合理的滤光器搭配均可应用于此。
图7是根据本发明第五实施例的屏下光学系统的结构示意图。与图3~图6所示实施例不同的是,光学模组与显示屏71之间的滤光器包括呈至少两层设置。可以理解的是,对于不同光学模组,其滤光器包括的层数可以不同,有的可以是单层,有的可以是多层,在本实施例中,将以两层为例进行示意性说明。深度相机包括光接收模组74、相机75、光发射模组76,深度相机与显示屏71之间设置有滤光器,滤光器包括沿光学模组到显示屏沿线方向(或光束方向)的叠加的第一滤光器72、第二滤光器73,比如第一滤光器72为光学开关,第二滤光器73为单向透视膜。
以上各实施例给出了如何隐藏显示屏背面的光学模组的方案。
显示屏一般由横向以及纵向周期性排列的多个像素单元组成,多个像素单元构成了周期性的像元衍射结构,因此显示屏会对入射的光束产生衍射效应,最终导致投影或者成像质量下降。
图8是根据本发明第六实施例的屏下光学系统的结构示意图,屏下光学系统包括显示屏81以及光发射模组。光发射模组包括光源82、透镜83以及第一衍射光学元件(DOE,Diffractive Optical Elements)84,透镜83用于准直或聚焦由光源82所发出的光束,第一衍射光学元件84接收来自透镜的光束经衍射后投射出第一衍射光束85,第一衍射光束85经由显示屏81投射到外部空间。透镜83也可以是透镜组或者透镜阵列等。可以理解的是,这里的光发射模组的组成 不限于此,比如光发射模组可以仅由光源82以及第一DOE84组成,或者光发射模组也可以包含其他器件,比如微透镜阵列等等,总之,根据实际需要光发射模组可以具备相应的结构组成。
已有技术中,由光源、透镜以及DOE组成的光发射模组用于投射图案化光束,比如结构光图案化光束(如散斑图案、条纹图案、二维图案等)、泛光光束、单点光束、经调制的TOF光束等。光发射模组所发射出的图案化光束经显示屏81向外投射时,会因为显示屏81内部像元的周期性结构产生衍射,即若直接将已有技术中的光发射模组置于显示屏一侧,由光发射模组发射出的图案化光束会被显示屏再次衍射,此时显示屏81即是第二衍射光学元件(第二DOE),二次衍射出的光束会对图案化光束产生影响,比如对比度降低、噪声增加等,甚至经二次衍射后的光束完全与图案化光束背离,基于此原因,给屏后放置光学模组带来了巨大的挑战。
在本实施例中,第一DOE84将不再投射出预设的图案化光束(比如预设的散斑图案化光束),而是在设计阶段综合考虑第一DOE84以及显示屏(即第二DOE)81的衍射效应,以实现:第一DOE84接收来自光源的入射光束后投射出第一衍射光束85,第一衍射光束85被第二DOE81再次衍射后投射出图案化光束86。
在一个实施例中,第一DOE84的设计过程一般包括以下几个步骤:
首先,获取显示屏即第二DOE的衍射性能,比如用复振幅透过率函数来描述,一种可能的检测方法是用一束平面波从单一角度或多个角度入射显示屏,出射的光强分布用接收屏来采集,通过光强分布来衡量第二DOE的衍射性能;
其次,基于显示屏即第二DOE的衍射性能,由图案化光束86经逆衍射计算获取第一衍射光束85的复振幅空间分布;
最后,由第一衍射光束85的复振幅空间分布以及经透镜83入射到第一DOE84前的光束分布,计算出第一DOE的衍射图样。
可以理解的是,这个设计过程仅作为示例,其他任意合理的设计方案均适用于本发明。
第一DOE84也不局限于只是单片DOE,也可以是多片子DOE,多片子DOE也不局限于形成在不同的光学器件上,比如可以在同一个透明光学器件相对的表面分别生成两个子DOE。第一DOE84与第二DOE81也可以不局限于是分立的器件,比如可以在显示屏即第二DOE81的背面上生成第一DOE84,由此可以提高整体的集成度,由于显示屏81往往有多个功能不同的层组成,为了进一步提高集成度,第一DOE也可以集成到显示屏81中的某一层中去,或者第一DOE84的其中一层或几层子DOE集成到显示屏81中的某一层中去。
图9是根据本发明第七实施例的屏下光学系统的结构示意图,屏下光学系统包括显示屏91以及光发射模组。光发射模组包括光源92、透镜93以及第一衍射光学元件(DOE)94,透镜93用于准直或聚焦由光源92所发出的光束,第一衍射光学元件94接收来自透镜的光束经衍射后投射出图案化光束96,图案化光束96经由显示屏91投射到外部空间。与图8不同的是,在第一DOE94 与显示屏91之间还设置了补偿元件95,补偿元件95用于补偿由显示屏(第二DOE)91的衍射效应。
在本实施例中,由补偿元件95与第二DOE91组成了一个新的补偿显示屏98,该补偿显示屏98中补偿元件95被设计成与显示屏的衍射效应互补,由此来抵消第二DOE91对光发射模组所投影出的图案化光束的影响,即用一束平面波入射至该于补偿显示屏出射光的等相位面依然与入射光波矢方向垂直。由此由第一DOE94出射图案化光束入射至该补偿显示屏后以图案化光束97投射至空间中。可以理解的是,补偿元件95难以完全消除第二DOE91的衍射影响,因此图案化光束97难以保证与图案化光束96完成一样,二者之间具有稍微的差别也是允许的,比如在强度的空间分布上稍有不同。
补偿元件95可以被配置成任意能改变光束振幅和/或相位的光学元件,比如DOE、空间光调制器(Spatial Light Modulator,SLM)等元件。当补偿元件95为空间光调制器时,其可以是液晶空间光调制器,其有多个像素组成,每个像素可以通过改变其属性(比如折射率、灰度等)来对入射光的振幅和/或相位进行调制。
与图8所示实施例相比,图9中的第一DOE94在设计时与传统光发射模组中的DOE设计思路相同,图8所示实施例中的第一DOE84在设计时与传统相比有较大的难度提升,图9所示的实施例中重点需要对补偿元件95进行设计,在一个实施例中,其设计步骤如下:
在一个实施例中,补偿元件95的设计过程一般包括以下几个步骤:
首先,获取显示屏即第二DOE91的衍射性能,比如用复振幅透过率函数来描述,一种可能的检测方法是用一束平面波从单一角度或多个角度入射显示屏,出射的光强分布用接收屏来采集,通过光强分布来衡量第二DOE91的衍射性能;
其次,基于显示屏即第二DOE91的衍射性能,由出射光束97经逆衍射计算获取入射至第二DOE91上的入射光束的复振幅空间分布;
最后,由入射至第二DOE91上的入射光束的复振幅空间分布以及入射至补偿元件95上的入射光束96的光束分布,计算出补偿元件95的衍射图样。
以上步骤中,入射至补偿元件95的入射光束96与出射光束97的空间分布几乎相同,其可以是平面波光束也可以是图案化光束。
可以理解的是,这个设计过程仅作为示例,其他任意合理的设计方案均适用于本发明。
当补偿元件95是DOE(记为第三DOE95)时,第一DOE94与第三DOE95不局限于只是单片DOE,也可以是由多片子DOE呈层叠形式形成,多片子DOE也不局限于形成在不同的光学器件上,比如可以在同一个透明光学器件相对的表面分别生成两个子DOE。第一DOE94与第三DOE95也可以不局限于是分立的器件,可以在同一个透明光学器件相对的表面分别生成两个DOE,分别作为第一DOE94与第三DOE95。第三DOE95与第二DOE91同样不局限于是分立的器件,比如可以在显示屏(第二DOE91)的一侧上生成第三DOE95,由此可以 提高整体的集成度,由于显示屏往往有多个功能不同的层组成,为了进一步提高集成度,第三DOE95也可以集成到其中的某一层中去。
第一DOE94、第三DOE95以及第二DOE91的相对位置不局限于图9所示的实施例,三者之间可以根据实际需求进行设计,比如可以将第一DOE94以及第三DOE95均集成到第二DOE91的内部层结构中,比如第一DOE94与第三DOE95的位置可以互换。总之任意不违背本发明思想的结构组成均适用于本发明。
图10是根据本发明第八实施例的屏下光学系统的结构示意图,屏下光学系统包括显示屏101以及光接收模组。光接收模组包括图像传感器102以及透镜103,显示屏101另一侧光束106通过显示屏101入射至透镜103并成像在图像传感器102上。由于显示屏内部像元的周期性微结构,其会对入射光束106产生衍射从而影响成像质量。为了降低衍射影响,同样地,在本实施例中,在图像传感器102与显示屏101之间还设置了补偿元件104,第一DOE104用于补偿由显示屏(第二DOE)101的衍射效应。由第一DOE104与第二DOE101组成了一个新的补偿显示屏105,该补偿显示屏中第一DOE104被设计成与显示屏的衍射效应互补,由此来抵消第二DOE101对光接收模组成像质量的影响。
第一DOE104不局限于只是单片DOE,也可以是多片子DOE,多片子DOE也不局限于形成在不同的光学器件上,比如可以在同一个透明光学器件相对的表面分别生成两个子DOE。第一DOE104与第二DOE101也可以不局限于是分立的器件,比如可以在显示屏(第二DOE101)的一侧上生成第一DOE104,由此可以提高整体的集成度,由于显示屏101往往有多个功能不同的层组成,为了进一步提高集成度,第一DOE104也可以集成到显示屏101中的某一层中去,或者第一DOE104的其中一层或几层子DOE集成到显示屏101中的某一层中去。
在图8~10所示的实施例进行描述的过程中,仅重点对衍射影响进行阐述,没有对光学模组的隐藏进行说明,在实际设计中,往往需要同时考虑衍射影响以及隐藏,因此在图8~10的各个实施例中,光学模组与显示屏之间通过增加滤光器来实现隐藏也在本发明的保护范围内,这里的实施例可以参考图3-图7的实施例,具体的实施例在此不做详细阐述,但可以理解的是,光学模组中的各个部件、滤光器以及显示屏在进行整体设计、集成时,相互之间各个部件可以进行融合,比如对于图8所示的屏下光发射模组而言,可以将衍射光学元件集成到显示屏的内部层中,滤光器设置在透镜与DOE之间。接下来以实施例来进一步说明。
图11是根据本发明第九实施例的屏下光学系统的结构示意图,屏下光学系统包括。深度相机由光接收模组与光发射模组组成,其中光接收模组包括图像传感器113与透镜114,光发射模组包括光源116、透镜117以及第一DOE118。补偿显示屏111由多个分层以及集成在分层中的补偿元件组成,同时第一DOE118也被集成在分层中。本实施例中的补偿元件包括对应光接收模组的第一子DOE115以及对应光发射模组的第二子DOE119,第一子DOE115和第二 子DOE119单独设置,且其衍射效应分别与显示屏111的衍射效应互补。第一子DOE115和第二子DOE119中的至少一个可以集成于显示屏111内。光接收模组、光发射模组与显示屏111之间设置有滤光器112。
可以理解的是,光接收模组与光发射模组与显示屏结合形成屏下深度相机时,光接收模组与显示屏的结构形式、光发射模组与显示屏的结构形式可以根据实际需要任意搭配,不局限于图11所示的实施例,比如图8所示的光发射模组与显示屏81的结构与图10所示的光接收模组与显示屏101的结构可以组合成屏下深度相机。
回到图9或图10,补偿显示屏中当补偿元件95、104为液晶空间光调制器时,由于其具备对入射光束的振幅以及相位进行调制的功能,因此不仅可以作为衍射补偿用,也可以作为光学开关来对光发射模组或光接收模组进行隐藏。即,若当前光发射模组以及光接收模组处在非工作状态时,调整液晶空间光调制器使得其处于非透明状态,从而实现对屏后光学模组的隐藏;若当前光发射模组以及光接收模组处于工作状态时,调整液晶空间光调制器使其处于透明状态、且对其中的像素单元进行相位调制以补偿显示屏91或101对出射或入射光束的衍射效应。这样可以较大程度上提高系统在功能上以及结构上的集成度。
以上各实施例中,在显示屏背后设置光学模组要求显示屏可以透过光线,即为透明显示屏,但透明显示屏相比传统的非透明显示屏拥有更高的成本。为了解决这一问题,本发明在以上各实施例的基础上,提供一种拼接显示屏方案。
图12是根据本发明一个实施例的含有拼接显示屏的电子设备示意图。电子设备12包括壳体125、设置在正面的显示屏126以及传感器,其中传感器包括光发射模组121、相机122、光接收模组123,还可以包括如扬声器、环境光/接近传感器等传感器124。与图1所示实施例不同的是,显示屏126由两部分组成,即第一显示屏单元126a与第二显示屏单元126b,传感器设置在第一显示屏单元126a背后,第一显示屏单元126a为透明显示屏,允许设置在其背后的传感器接收外部的信息或向外部发射信息。第二显示屏单元126b被设置成与第一显示屏单元126a不同的属性。
在一个实施例中,第二显示屏单元126b为非透明显示屏,比如普通LCD显示屏或普通LED显示屏,二者通过拼接形成整块显示屏126。
在一个实施例中,第一显示屏单元126a与第二显示屏单元126b是同种类型的显示屏,比如都是OLED显示屏,只不过第一显示屏单元126a的开口率大于第二显示屏单元126b,以使得光线更易穿过。可以理解的是,此时整个显示屏126不一定通过拼接形成,而是同一块显示屏的两个区域,在设计及制造的时候控制好两个区域的开口率。除开口率之外,也可以是其他类型的设置,比如两个区域的分辨率不同,第一显示屏单元126a的分辨率小于第二显示屏单元126b的分辨率;又或者两个区域采用不同透明度的材料制成,第一显示屏单元126a中材料的整体透明度高于第二显示屏单元126b中材料的整体透明度,最终使得第一显示屏单元126a的透明率高于第二显示屏单元126b。
在一个实施例中,显示屏126包括不止两个显示屏单元,比如针对各个传 感器均设置一个第一显示屏单元126a。第一显示屏单元126a与第二显示屏单元126b的形状不局限于图12所示的形式,比如第一显示屏单元126a可以是圆形,第二显示屏单元126b具有与第一显示屏单元126a相适配的圆形通孔,二者共同形成一整块显示屏126。
在一个实施例中,第一显示屏126a与第二显示屏126b独立控制,当第一显示屏126a背后的传感器工作时,第一显示屏126a处于关闭状态,第二显示屏126b仍可以正常显示内容。
可以理解的是,第一显示屏126a为了满足传感器发送或接收信号的需求,上述各实施例的方案均可以应用在本拼接屏方案中。
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。
Claims (10)
- 一种屏下光学系统,其特征在于,包括:透明显示屏,包括多个用于显示的周期性排列的像素单元;光学模组,用于接收来自所述透明显示屏的光束或者透过所述透明显示屏向外发射光束;滤光器,设置在所述透明显示屏与所述光学模组之间,被配置为可以减少来自所述透明显示屏一侧的可见光透过。
- 如权利要求1所述的屏下光学系统,其特征在于,所述滤光器包括光学开关,所述光学开关工作于透明或非透明状态以允许或阻止光线通过。
- 如权利要求1所述的屏下光学系统,其特征在于,所述滤光器包括单向透视膜,所述单向透视膜面向所述显示屏的一侧表面对可见光的透过率大于反射率,所述单向透视膜远离所述显示屏的一侧表面对可见光的透过率小于反射率。
- 如权利要求3所述的屏下光学系统,其特征在于:当所述光学模组接收的所述光束为非可见光光束时,与所述光学模组对应的所述单向透视膜面向所述显示屏的一侧表面对所述非可见光的透过率大于反射率;或,当所述光学模组发射的所述光束为非可见光光束时,与所述光学模组对应的所述单向透视膜面向所述光学模组的一侧表面对所述非可见光的透过率大于反射率。
- 如权利要求1所述的屏下光学系统,其特征在于,所述滤光器包括滤光片,所述滤光片用于阻止可见光且仅允许非可见光波长区间的光束通过。
- 如权利要求1所述的屏下光学系统,其特征在于,所述滤光器包括滤光片,所述滤光片对可见光的透过率低于对非可见光的透过率。
- 如权利要求1所述的屏下光学系统,其特征在于:所述光学模组包括非可见光接收模组以及非可见光发射模组;所述滤光器包括与所述非可见光接收模组以及非可见光发射模组分别对应的第一滤光器、第三滤光器;所述第一滤光器、第三滤光器包括光学开关、单向透视膜、滤光片中的一种或多种。
- 如权利要求7所述的屏下光学系统,其特征在于:所述光学模组还包括可见光相机;所述滤光器还包括与所述可见光相机对应的第二滤光器;所述第二滤光器包括光学开关、单向透视膜中的一种或多种。
- 如权利要求1所述的屏下光学系统,其特征在于,所述滤光器包括沿光束方向叠加设置至少第一滤光器以及第二滤光器,所述第一滤光器、第二滤光器包括光学开关、单向透视膜、滤光片中的一种或多种。
- 一种电子设备,其特征在于,包括如权利要求1-9任一项所述的屏下光学系统。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811082952.7 | 2018-09-17 | ||
CN201811082952.7A CN109240021B (zh) | 2018-09-17 | 2018-09-17 | 屏下光学系统及电子设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020057206A1 true WO2020057206A1 (zh) | 2020-03-26 |
Family
ID=65058985
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/092165 WO2020057206A1 (zh) | 2018-09-17 | 2019-06-21 | 屏下光学系统及电子设备 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN109240021B (zh) |
WO (1) | WO2020057206A1 (zh) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109240021B (zh) * | 2018-09-17 | 2020-11-03 | 深圳奥比中光科技有限公司 | 屏下光学系统及电子设备 |
CN110012198B (zh) * | 2019-03-29 | 2021-02-26 | 奥比中光科技集团股份有限公司 | 一种终端设备 |
CN113132509B (zh) * | 2019-12-30 | 2023-03-10 | Oppo广东移动通信有限公司 | 电子设备 |
CN111402712B (zh) * | 2020-02-27 | 2021-05-11 | 嘉兴驭光光电科技有限公司 | 衍射抑制光学部件设计方法、显示屏和屏下摄像装置 |
CN111238400A (zh) * | 2020-03-19 | 2020-06-05 | 熵智科技(深圳)有限公司 | 一种大视野散斑结构光相机照明系统 |
CN111884722A (zh) * | 2020-07-06 | 2020-11-03 | Oppo(重庆)智能科技有限公司 | 一种信息传输方法及终端、存储介质 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101593271A (zh) * | 2009-06-26 | 2009-12-02 | 上海久娱网络科技有限公司 | 卡牌游戏机中人物身份识别系统 |
CN108476276A (zh) * | 2015-10-30 | 2018-08-31 | 精华产品公司 | 集成在显示器中的相机 |
CN109240021A (zh) * | 2018-09-17 | 2019-01-18 | 深圳奥比中光科技有限公司 | 屏下光学系统及电子设备 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009008758A (ja) * | 2007-06-26 | 2009-01-15 | Fujinon Corp | 撮像デバイス、およびカメラモジュールならびに携帯端末機器 |
CN108037796B (zh) * | 2017-12-21 | 2019-10-01 | Oppo广东移动通信有限公司 | 电子装置、显示控制方法及相关产品 |
CN108540595B (zh) * | 2018-03-09 | 2021-02-12 | Oppo广东移动通信有限公司 | 电子装置及其制造方法 |
CN108461044B (zh) * | 2018-03-09 | 2021-03-12 | Oppo广东移动通信有限公司 | 电子装置及其制造方法 |
-
2018
- 2018-09-17 CN CN201811082952.7A patent/CN109240021B/zh active Active
-
2019
- 2019-06-21 WO PCT/CN2019/092165 patent/WO2020057206A1/zh active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101593271A (zh) * | 2009-06-26 | 2009-12-02 | 上海久娱网络科技有限公司 | 卡牌游戏机中人物身份识别系统 |
CN108476276A (zh) * | 2015-10-30 | 2018-08-31 | 精华产品公司 | 集成在显示器中的相机 |
CN109240021A (zh) * | 2018-09-17 | 2019-01-18 | 深圳奥比中光科技有限公司 | 屏下光学系统及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
CN109240021A (zh) | 2019-01-18 |
CN109240021B (zh) | 2020-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020057205A1 (zh) | 屏下光学系统、衍射光学元件的设计方法及电子设备 | |
WO2020057208A1 (zh) | 电子设备 | |
WO2020057204A1 (zh) | 补偿显示屏、屏下光学系统及电子设备 | |
WO2020057207A1 (zh) | 电子设备 | |
WO2020057206A1 (zh) | 屏下光学系统及电子设备 | |
US10012841B1 (en) | Advanced retroreflecting aerial displays | |
US9298002B2 (en) | Optical configurations for head worn computing | |
US11277551B2 (en) | Multiple optical path imaging techniques and shared emitter for active depth sensing techniques | |
KR20150057011A (ko) | 광원일체형 카메라 | |
WO2019037468A1 (zh) | 结构光投影器、三维摄像头模组以及终端设备 | |
TWM523106U (zh) | 光學裝置 | |
KR101976463B1 (ko) | 3차원 영상 생성 장치 및 방법 | |
CN210381052U (zh) | 电子设备 | |
US20240127566A1 (en) | Photography apparatus and method, electronic device, and storage medium | |
EP4187436A1 (en) | Display assembly and display device | |
EP3009887B1 (en) | Optical imaging processing system | |
KR20030034535A (ko) | 카메라를 이용한 포인팅장치 및 포인터 위치산출 방법 | |
CN115407308A (zh) | 一种3d传感模组、3d传感方法及电子设备 | |
WO2018145463A1 (zh) | 一种实现增强现实的装置及方法 | |
CN213152213U (zh) | 视频会议系统及显示装置 | |
WO2020062107A1 (zh) | 一种设备 | |
WO2020062106A1 (zh) | 一种设备 | |
CN116699859A (zh) | 一种光学模组及电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19863002 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19863002 Country of ref document: EP Kind code of ref document: A1 |