CN113238250A - Method and device for eliminating stray light under screen, under screen system and storage medium - Google Patents
Method and device for eliminating stray light under screen, under screen system and storage medium Download PDFInfo
- Publication number
- CN113238250A CN113238250A CN202110428771.0A CN202110428771A CN113238250A CN 113238250 A CN113238250 A CN 113238250A CN 202110428771 A CN202110428771 A CN 202110428771A CN 113238250 A CN113238250 A CN 113238250A
- Authority
- CN
- China
- Prior art keywords
- signal
- stray light
- display screen
- optical signal
- receiving end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000003287 optical effect Effects 0.000 claims abstract description 121
- 238000002310 reflectometry Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 5
- 230000000149 penetrating effect Effects 0.000 claims description 3
- 238000005259 measurement Methods 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 4
- 230000002238 attenuated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
The application is applicable to the field of optics, and provides a method and a device for eliminating stray light under a screen, an under-screen system and a storage medium. The method for eliminating the stray light under the screen comprises the following steps: acquiring an echo signal received by a signal receiving terminal positioned on the inner side of a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen; acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen; and calculating a target optical signal of the first optical signal reflected by the target area based on the echo signal and the stray light signal. The method provided by the embodiment of the application can eliminate the stray light under the screen so as to improve the accuracy of the depth measurement value.
Description
Technical Field
The present application relates to the field of optics and image processing, and in particular, to a method and an apparatus for eliminating under-screen stray light, an under-screen system, and a storage medium.
Background
Currently, in order to improve screen integrity and product appearance aesthetics, technicians are constantly trying to place 2D and 3D cameras under the display screen. However, when the 3D technologies such as Indirect time of flight (irect TOF), Direct time of flight (dTOF), and structured light are applied to under-screen imaging, a signal receiving end located inside a display screen often receives a stray light signal, which causes an abnormality in a depth measurement value.
Therefore, a method for eliminating the under-screen stray light is needed to improve the accuracy of depth information in applications such as 3D technology.
Disclosure of Invention
The embodiment of the application provides a method and a device for eliminating under-screen stray light, an under-screen system and a storage medium, which can eliminate the under-screen stray light so as to improve the accuracy of a depth measurement value.
A first aspect of an embodiment of the present application provides a method for eliminating under-screen stray light, including:
acquiring an echo signal received by a signal receiving terminal positioned on the inner side of a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen;
acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
and calculating a target optical signal of the first optical signal reflected by the target area based on the echo signal and the stray light signal.
A device for eliminating stray light under a screen provided by a second aspect of the embodiments of the present application includes:
the echo signal acquisition unit is used for acquiring echo signals received by a signal receiving end positioned on the inner side of the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen;
the stray light signal acquisition unit is used for acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
and the target optical signal calculation unit is used for calculating a target optical signal of the first optical signal reflected by the target area based on the echo signal and the stray light signal.
A third aspect of the embodiments of the present application provides an off-screen system, which includes a projection module, an acquisition module, a processing module, a storage module, and a display screen, where:
the projection module is used for projecting a first optical signal to a target area through the display screen;
the acquisition module is used for receiving echo optical signals which are reflected by the target area and then penetrate through the display screen;
the processing module is used for calculating a target optical signal according to the received echo optical signal and the stray light signal prestored in the storage module;
the storage module is used for storing the stray light signal acquired based on the method for eliminating the under-screen stray light.
A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the above method.
A fifth aspect of embodiments of the present application provides a computer program product, which when run on an off-screen system, causes the off-screen system to perform the steps of the method.
In the embodiment of the application, through respectively obtaining the echo signal received by the signal receiving terminal positioned at the inner side of the display screen and the stray light signal received by the signal receiving terminal after the reflection and/or scattering of the display screen, the stray light signal can be filtered based on the echo signal and the stray light signal, after the signal transmitting terminal is obtained to transmit the first light signal to the target area at the outer side of the display screen, the target area actually reflects the first light signal to obtain the target light signal, so that the influence of the stray light signal transmitted to the receiving terminal through the display screen on the depth measurement can be eliminated, the depth measurement precision of the system under the screen is improved, and the 3D technology is applied to the under-screen measurement.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a schematic diagram of forming a stray light signal according to an embodiment of the present disclosure;
FIG. 2 is a schematic flow chart illustrating an implementation of a method for eliminating stray light under a screen according to an embodiment of the present application;
FIG. 3 is a schematic view of a display screen provided with a shading element at the outer side thereof according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of an embodiment of the present application showing no object capable of reflecting a second optical signal within a predetermined distance from a display screen;
FIG. 5 is a schematic diagram of an embodiment of the present application providing a low-reflectivity object disposed between a signal emitting end and a target area;
FIG. 6 is a schematic structural diagram of an apparatus for eliminating stray light under a screen according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an off-screen system according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
Currently, in order to improve screen integrity and product appearance aesthetics, technicians are constantly trying to place 2D and 3D cameras under the display screen.
It has been found that, in a display panel for under-panel imaging, an organic light-Emitting semiconductor (OLED) screen with high transmittance is generally used, and some high-reflectivity structures such as metal cathodes are inevitably present in the display panel, which may cause light incident to the inner side of the display panel to be reflected or scattered multiple times.
As shown in fig. 1, when 3D technologies such as time-of-flight and structured light are applied to under-screen imaging, since the distance between the signal transmitting end and the signal receiving end adopted by these 3D technologies is small, light emitted by the signal transmitting end located inside the display screen easily enters the signal receiving end through scattering and/or reflection of the screen, and a stray light signal interfering with imaging is formed, resulting in abnormal depth measurement values.
Therefore, a method for eliminating the under-screen stray light is needed to improve the accuracy of depth information in applications such as 3D technology.
In order to explain the technical means of the present application, the following description will be given by way of specific examples.
Fig. 2 is a schematic view illustrating an implementation flow of a method for eliminating off-screen stray light according to an embodiment of the present application, where the method is applicable to a terminal and is applicable to a situation where off-screen stray light needs to be eliminated to improve accuracy of a depth measurement value.
The terminal can be an off-screen system such as a mobile phone and a tablet personal computer, wherein the terminal can carry an off-screen camera, so as to eliminate the off-screen stray light of the terminal; the depth measurement method can also be used for terminals such as computers and servers to help other terminals with the off-screen camera to improve accuracy of the depth measurement value.
Specifically, the method for eliminating the under-screen stray light may include the following steps S201 to S203.
Step S201, obtaining an echo signal received by a signal receiving end located inside the display screen.
The echo signal is an optical signal received by a signal receiving end after a signal transmitting end positioned on the inner side of the display screen transmits a first optical signal to a target area on the outer side of the display screen. The first optical signal is a pulse beam emitted after the signal emitting end is modulated by a waveform of a specific frequency, and for example, the first optical signal may be a pulse beam emitted after being modulated by a sine wave or a rectangular wave of a specific frequency.
As shown in fig. 1, after a signal transmitting end located inside the display screen transmits a first optical signal to a target area outside the display screen, the target area may reflect the first optical signal, and the display screen itself may also reflect and/or scatter the first optical signal, and a signal receiving end located inside the display screen may receive a signal obtained by reflecting the first optical signal by the target area, and may also receive a signal obtained by reflecting and/or scattering the first optical signal by the display screen itself.
That is to say, the echo signal received by the signal receiving end includes both the target optical signal obtained by reflecting the first optical signal by the target region and the stray optical signal obtained by reflecting and/or scattering by the display screen.
Step S202, acquiring a stray light signal received by a signal receiving end after the first optical signal is reflected and/or scattered by the display screen.
In an embodiment of the application, the terminal may filter a target optical signal, which is obtained by reflecting the first optical signal by the target region, so that the signal receiving end receives a stray light signal, which is obtained by reflecting and/or scattering the first optical signal by the display screen.
Specifically, in some embodiments of the present application, when the terminal is provided with a light shielding element outside the display screen, the light signal received by the signal receiving end may be used as the stray light signal.
The shading element is used for preventing the target light signal reflected by the target area to the first light signal from transmitting through the display screen.
For convenience of illustration, as shown in fig. 3, which is a schematic diagram of a light shielding element disposed outside a display screen, a first optical signal (i.e., a pulse beam) emitted from a signal emitting end is divided into a first pulse beam and a second pulse beam, and the first pulse beam is reflected and/or scattered by the display screen at an inner side of the display screen and enters a signal receiving end; the second pulse light beam is transmitted outwards through the display screen and reflected to the signal receiving end through the target area, and the lightproof shading element is arranged on the outer side of the display screen, so that the pulse light beam reflected by the second pulse light beam through the target area is prevented from entering the signal receiving end, and the signal receiving end only generates a stray light signal. Therefore, when the terminal is provided with the shading element outside the display screen, the optical signal received by the signal receiving end can be used as the stray light signal.
In other embodiments of the present application, the terminal may further use the optical signal received by the signal receiving end as a stray light signal when no object capable of reflecting the second optical signal exists within a preset distance range from the display screen.
The second optical signal is obtained after the first optical signal transmitted by the signal transmitting end penetrates through the display screen.
For convenience of illustration, as shown in fig. 4, a schematic diagram that an object capable of reflecting the second optical signal does not exist within a preset distance range from the display screen is shown, a first optical signal (i.e., a pulse beam) emitted by the signal emitting end is divided into a first pulse beam and a second pulse beam (i.e., a second optical signal), and the first pulse beam is reflected and/or scattered by the display screen at the inner side of the display screen and enters the signal receiving end; the second pulse light beam is transmitted outwards through the display screen, but because no object capable of reflecting the second pulse light beam exists within a preset distance range from the display screen, the energy of the second pulse light beam is sufficiently attenuated when the second pulse light beam reaches the signal receiving end after being remotely transmitted, and the signal receiving end cannot respond to the signal receiving end, so that the signal receiving end only receives the stray light signal. Therefore, the terminal can take the optical signal received by the signal receiving end as the stray light signal when no object capable of reflecting the second optical signal exists within the preset distance range from the display screen.
In other embodiments of the present application, the terminal may further use the optical signal received by the signal receiving end as a stray light signal when a low-reflectivity object is disposed between the signal transmitting end and the target region.
The low-reflectivity object is used for absorbing a second optical signal obtained after a first optical signal emitted by the signal emitting end penetrates through the display screen. For example, the low-reflectivity object may be a low-reflectivity curtain or a low-reflectivity calibration board or the like that enables the second optical signal to be absorbed.
For convenience of illustration, as shown in fig. 5, which is a schematic diagram illustrating a low-reflectivity object disposed between a signal emitting end and a target area, a first optical signal (i.e., a pulse beam) emitted by the signal emitting end is divided into a first pulse beam and a second pulse beam (i.e., a second optical signal), and the first pulse beam is reflected and/or scattered by a display screen at the inner side of the display screen and enters a signal receiving end; the second pulse light beam penetrates through the display screen to be emitted outwards, but because a low-reflectivity object is arranged between the signal emitting end and the target area, the low-reflectivity object can absorb the second pulse light beam so as to prevent the second pulse light beam from penetrating through the display screen again to enter the signal receiving end, and the signal receiving end only receives the stray light signal. Therefore, the terminal can take the optical signal received by the signal receiving end as a stray light signal when a low-reflectivity object is arranged between the signal transmitting end and the target area.
In other embodiments of the present application, the stray light signal may also be acquired by allowing the second optical signal to be absorbed or attenuated until the second optical signal cannot be received by the signal receiving end in other manners.
The stray light signal may be a signal obtained by scaling the stray light signal in advance and storing the signal in a memory of the terminal. For example, a terminal carrying an off-screen camera may be placed in an open scene (e.g., an open corridor) in advance, and calibrated in the manner shown in fig. 4 to obtain a stray light signal, and the stored stray light signal is obtained when depth information needs to be calculated, so as to eliminate off-screen stray light. And when stray light is calibrated in advance, the calibration can be carried out indoors or in a dark environment, so that the interference of ambient light is avoided.
The stray light signal may also be a stray light signal obtained by calibration in a certain manner when depth information needs to be calculated. For example, after the echo signal is acquired, a light blocking element is provided outside the display screen to obtain a stray light signal in the manner shown in fig. 3, thereby eliminating the under-screen stray light to calculate accurate depth information.
Step S203 calculates a target optical signal of the target region reflecting the first optical signal based on the echo signal and the stray light signal.
In the embodiment of the present application, after the echo signal and the stray light signal are acquired, the stray light signal may be removed from the echo signal based on the echo signal and the stray light signal, and a target optical signal in which the target region reflects the first optical signal may be obtained.
Specifically, the step S203 may include: calculating the signal intensity P of the echo signal accumulated by the signal receiving end in the exposure time TaAnd the signal intensity P of the stray light signal accumulated by the signal receiving end within the exposure time TbAnd according to the formula P ═ Pa-PbAnd calculating the signal intensity P of the target optical signal accumulated by the signal receiving end within the exposure time T.
Specifically, the signal intensity P of the echo signal accumulated at the signal receiving end within the exposure time T isaMay include: according to the formula
Calculating the intensity P of the target optical signal accumulated by the signal receiving end in the exposure time TaWherein s' (t) represents the charge amount obtained from the echo signal received by the signal receiving end at time t; q (t) represents a demodulation waveform signal at time t, which is a demodulation waveform signal corresponding to the modulation waveform signal used by the signal transmitting terminal.
Similarly, the signal intensity P of the echo signal accumulated at the signal receiving end within the exposure time TbMay include: according to the formula
Calculating time of exposureIntensity P of stray light signal accumulated at signal receiving end in interval TbWherein n (t) represents the charge quantity obtained at the time t according to the stray light signal received by the signal receiving end; q (t) represents a demodulation waveform signal at time t, which is a demodulation waveform signal corresponding to the modulation waveform signal used by the signal transmitting terminal.
When the demodulation waveform signal q (t) is at a high level (i.e., 1), it indicates that the signal needs to be sampled, and when the demodulation waveform signal q (t) is at a low level (i.e., 0), it indicates that the signal is not sampled.
The signal intensity P of the echo signal accumulated by the signal receiving end in the whole exposure timeaThe method is effective superposition of a target light signal and a stray light signal, the intensity of the stray light signal entering a signal receiving end is related to the material and the structure of the stray light signal distributed on a display screen, and after the system under the display screen is assembled, the intensity and the distribution of the stray light signal are fixed immediately. Thus, P ═ P can be passeda-PbAnd obtaining the target optical signal.
In order to make the obtained target optical signal more accurate, in some embodiments of the present application, the obtained stray light signals may be multiple sets, for example, a set of stray light signals may be obtained respectively in the manners of fig. 3, fig. 4, and fig. 5, at this time, the target optical signal of the target region reflecting the first optical signal may be calculated by averaging the multiple sets of stray light signals, and based on the echo signal and the average value of the multiple sets of stray light signals.
In the embodiment of the application, through respectively obtaining the echo signal received by the signal receiving terminal positioned at the inner side of the display screen and the stray light signal received by the signal receiving terminal after the reflection and/or scattering of the display screen, the stray light signal can be filtered based on the echo signal and the stray light signal, after the signal transmitting terminal is obtained to transmit the first light signal to the target area at the outer side of the display screen, the target area actually reflects the first light signal to obtain the target light signal, so that the influence of the stray light signal transmitted to the receiving terminal through the display screen on the depth measurement can be eliminated, the depth measurement precision of the system under the screen is improved, and the 3D technology is applied to the under-screen measurement.
It should be noted that, for simplicity of description, the foregoing method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts, as some steps may, in accordance with the present application, occur in other orders.
Fig. 6 is a schematic structural diagram of a device 600 for eliminating under-screen stray light according to an embodiment of the present application, where the device 600 for eliminating under-screen stray light is configured on a terminal.
The device 600 for eliminating stray light under the screen may include: echo signal acquisition section 601, stray light signal acquisition section 602, and target light signal calculation section 603.
An echo signal acquiring unit 601, configured to acquire an echo signal received by a signal receiving end located inside a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen;
a stray light signal obtaining unit 602, configured to obtain a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
a target light signal calculation unit 603, configured to calculate a target light signal, which is obtained by reflecting the first light signal by the target region, based on the echo signal and the stray light signal.
In some embodiments of the present application, the stray light signal obtaining unit 602 may specifically be configured to: when a light shielding element is arranged on the outer side of the display screen, the optical signal received by the signal receiving end is used as the stray light signal, and the light shielding element is used for preventing the target optical signal reflected by the first optical signal from penetrating through the display screen by the target area.
In some embodiments of the present application, the stray light signal obtaining unit 602 may be further specifically configured to: when no object capable of reflecting the second optical signal exists within a preset distance range from the display screen, taking the optical signal received by the signal receiving end as the stray light signal; the second optical signal is obtained after the first optical signal transmitted by the signal transmitting end penetrates through the display screen.
In some embodiments of the present application, the stray light signal obtaining unit 602 may be further specifically configured to: and when a low-reflectivity object is arranged between the signal transmitting end and the target area, the optical signal received by the signal receiving end is used as the stray light signal, and the low-reflectivity object is used for absorbing a second optical signal obtained after the first optical signal transmitted by the signal transmitting end penetrates through the display screen.
In some embodiments of the present application, the target optical signal calculating unit 603 may be further specifically configured to: calculating the signal intensity P of the echo signal accumulated by the signal receiving end within the exposure time TaAnd the signal intensity P of the stray light signal accumulated by the signal receiving end within the exposure time Tb(ii) a According to the formula P ═ Pa-PbAnd calculating the signal intensity P of the target optical signal accumulated by the signal receiving end within the exposure time T.
In some embodiments of the present application, the target optical signal calculating unit 603 may be further specifically configured to: according to the formula
Calculating the intensity P of the target light signal accumulated by the signal receiving end within the exposure time TaWherein s' (t) represents the charge amount obtained from the echo signal received by the signal receiving end at time t; q (t) represents a demodulation waveform signal at time t, which is a demodulation waveform signal corresponding to the modulation waveform signal used by the signal transmitting terminal.
In some embodiments of the present application, the target optical signal calculating unit 603 may be further specifically configured to: according to the formula
Calculating the signal reception within the exposure time TEnd-integrated intensity P of the stray light signalbWherein n (t) represents the charge quantity obtained at the time t according to the stray light signal received by the signal receiving end; q (t) represents a demodulation waveform signal at time t, which is a demodulation waveform signal corresponding to the modulation waveform signal used by the signal transmitting terminal.
It should be noted that, for convenience and simplicity of description, the specific working process of the apparatus 600 for eliminating the under-screen stray light may refer to the corresponding process of the method described in fig. 2 to fig. 5, and is not described herein again.
As shown in fig. 7, a schematic structural diagram of an off-screen terminal system provided in the embodiment of the present application is shown. The off-screen system may include: projection module 70, collection module 71, processing module 72, storage module 73 and display screen 74, wherein:
a projection module 70 for projecting a first light signal through a display screen 74 to a target area;
the acquisition module 71 is configured to receive an echo light signal reflected by the target area and transmitted through the display screen 74;
a processing module 72, configured to calculate a target optical signal according to the received echo optical signal and a stray optical signal pre-stored in the storage module 73;
and the storage module 73 is used for storing the stray light signal acquired based on the method for eliminating the under-screen stray light.
In one embodiment, the projection module 70 may be a light source such as an edge-emitting laser (EEL) or a Vertical Cavity Surface Emitting Laser (VCSEL), or may be a light source array composed of a plurality of light sources, and the light beam emitted by the light source may be visible light, infrared light, or ultraviolet light. The light beam emitted by the light source may form a uniform, random or specially designed intensity distribution projection pattern on the reference plane. The acquisition module 71 includes an image sensor and a lens unit, and the lens unit receives a part of the light beam reflected by the object and forms an image on the image sensor. The image sensor may be a Charge Coupled Device (CCD), a Complementary Metal-Oxide-Semiconductor (CMOS), an Avalanche Diode (AD), a Single Photon Avalanche Diode (SPAD), or the like.
In one embodiment, the processing module 72 executes the steps in the embodiment of the method for eliminating the under-screen stray light, and more specifically, the steps can be executed by one or more units in the processing module 72 to complete the present application, and the specific execution functions of the units that can be divided (see fig. 6, fig. 6 shows a functional architecture diagram of a processor provided by the present application) are as follows:
the echo signal acquisition unit is used for acquiring echo signals received by a signal receiving end positioned on the inner side of the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen; the stray light signal acquisition unit is used for acquiring a stray light signal received by the signal receiving terminal after the first optical signal is reflected and/or scattered by the display screen, and transmitting the stray light signal to the storage module 73 for storage, so that a target optical signal can be calculated conveniently; and a target light signal calculation unit, configured to calculate a target light signal, which is obtained by reflecting the first light signal by the target region, based on the echo signal and the stray light signal in the storage module 73. The Processing module 72 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage module 73 may be an internal storage unit of the off-screen system, such as a hard disk or a memory of the off-screen system. The memory 71 may also be an external storage device of the off-screen system, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the off-screen system. Further, the storage module 73 may also include both an internal storage unit and an external storage device of the off-screen system. The memory module 73 is used to store the computer program and other programs and data required by the off-screen system. The storage module 73 may also be used to temporarily store data that has been output or is to be output.
The off-screen system may include, but is not limited to, the above-described modules. Those skilled in the art will appreciate that fig. 7 is merely an example of an off-screen system and is not intended to be limiting and may include more or fewer components than shown, or some components may be combined, or different components, e.g., the off-screen system may also include input-output devices, network access devices, buses, etc.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer-readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (10)
1. A method of eliminating under-screen stray light, comprising:
acquiring an echo signal received by a signal receiving terminal positioned on the inner side of a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen;
acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
and calculating a target optical signal of the first optical signal reflected by the target area based on the echo signal and the stray light signal.
2. The method according to claim 1, wherein said obtaining the stray light signal received by the signal receiving end after the first optical signal is reflected or scattered by the display screen comprises:
when a light shielding element is arranged on the outer side of the display screen, the optical signal received by the signal receiving end is used as the stray light signal, and the light shielding element is used for preventing the target optical signal reflected by the first optical signal from penetrating through the display screen by the target area.
3. The method according to claim 1, wherein said obtaining the stray light signal received by the signal receiving end after the first optical signal is reflected or scattered by the display screen comprises:
when no object capable of reflecting the second optical signal exists within a preset distance range from the display screen, taking the optical signal received by the signal receiving end as the stray light signal; the second optical signal is obtained after the first optical signal transmitted by the signal transmitting end penetrates through the display screen.
4. The method according to claim 1, wherein said obtaining the stray light signal received by the signal receiving end after the first optical signal is reflected or scattered by the display screen comprises:
and when a low-reflectivity object is arranged between the signal transmitting end and the target area, the optical signal received by the signal receiving end is used as the stray light signal, and the low-reflectivity object is used for absorbing a second optical signal obtained after the first optical signal transmitted by the signal transmitting end penetrates through the display screen.
5. The method according to any one of claims 1 to 4, wherein calculating a target light signal of the target region reflecting the first light signal based on the echo signal and the stray light signal comprises:
calculating the signal intensity P of the echo signal accumulated by the signal receiving end within the exposure time TaAnd the signal intensity P of the stray light signal accumulated by the signal receiving end within the exposure time Tb；
According to the formula P ═ Pa-PbAnd calculating the signal intensity P of the target optical signal accumulated by the signal receiving end within the exposure time T.
6. The method as claimed in claim 5, wherein the signal intensity P of the echo signal accumulated by the signal receiving terminal during the exposure time T is larger than the signal intensity P of the echo signal accumulated by the signal receiving terminal during the exposure time TaIs calculated by including
According to the formula
Calculating the intensity P of the target light signal accumulated by the signal receiving end within the exposure time TaWherein s' (t) represents the charge amount obtained from the echo signal received by the signal receiving end at time t; q (t) represents a demodulation waveform signal at time t, which is a demodulation waveform signal corresponding to the modulation waveform signal used by the signal transmitting terminal.
7. The method as claimed in claim 5, wherein the signal intensity P of the echo signal accumulated by the signal receiving terminal during the exposure time T is larger than the signal intensity P of the echo signal accumulated by the signal receiving terminal during the exposure time TbIs calculated by including
According to the formula
Calculating the intensity P of the stray light signal accumulated by the signal receiving end within the exposure time TbWherein n (t) represents the charge quantity obtained at the time t according to the stray light signal received by the signal receiving end; q (t) represents a demodulation waveform signal at time t, which is a demodulation waveform signal corresponding to the modulation waveform signal used by the signal transmitting terminal.
8. An apparatus for eliminating under-screen stray light, comprising:
the echo signal acquisition unit is used for acquiring echo signals received by a signal receiving end positioned on the inner side of the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen;
the stray light signal acquisition unit is used for acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
and the target optical signal calculation unit is used for calculating a target optical signal of the first optical signal reflected by the target area based on the echo signal and the stray light signal.
9. The utility model provides a system under screen which characterized in that, includes projection module, collection module, processing module, storage module and display screen, wherein:
the projection module is used for projecting a first optical signal to a target area through the display screen;
the acquisition module is used for receiving echo optical signals which are reflected by the target area and then penetrate through the display screen;
the processing module is used for calculating a target optical signal according to the received echo optical signal and the stray light signal prestored in the storage module;
the storage module is used for storing the stray light signal acquired based on the method for eliminating the under-screen stray light according to any one of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110428771.0A CN113238250B (en) | 2021-04-21 | 2021-04-21 | Method and device for eliminating stray light under screen, under screen system and storage medium |
| PCT/CN2021/107949 WO2022222290A1 (en) | 2021-04-21 | 2021-07-22 | Method and apparatus for eliminating stray light under screen, and under-screen system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110428771.0A CN113238250B (en) | 2021-04-21 | 2021-04-21 | Method and device for eliminating stray light under screen, under screen system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113238250A true CN113238250A (en) | 2021-08-10 |
| CN113238250B CN113238250B (en) | 2024-03-12 |
Family
ID=77128696
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110428771.0A Active CN113238250B (en) | 2021-04-21 | 2021-04-21 | Method and device for eliminating stray light under screen, under screen system and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113238250B (en) |
| WO (1) | WO2022222290A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114296272A (en) * | 2021-12-28 | 2022-04-08 | 努比亚技术有限公司 | Method for optimizing light spot of off-screen distance sensor, mobile terminal and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6072581A (en) * | 1998-10-30 | 2000-06-06 | Zygo Corporation | Geometrically-desensitized interferometer incorporating an optical assembly with high stray-beam management capability |
| US20040085545A1 (en) * | 2002-07-08 | 2004-05-06 | Hill Henry A. | Cyclic error compensation in interferometry systems |
| WO2014054963A1 (en) * | 2012-10-02 | 2014-04-10 | Общество с ограниченной ответственностью "Оптические измерительные системы" | Distributed coherent reflectometric system with phase demodulation (variants) |
| WO2019100989A1 (en) * | 2017-11-22 | 2019-05-31 | Oppo广东移动通信有限公司 | Display screen component, control method and device, storage medium and electronic device |
| US20190312401A1 (en) * | 2016-07-01 | 2019-10-10 | Ipg Photonics Corporation | Fiber laser system with mechanism for inducing parasitic light losses |
| CN209765529U (en) * | 2019-05-14 | 2019-12-10 | 深圳市汇顶科技股份有限公司 | Fingerprint identification device and electronic equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001305365A (en) * | 2000-04-25 | 2001-10-31 | Nec Corp | Light shielding structure of stray light in optical wavelength module |
| CN101793559B (en) * | 2010-03-18 | 2012-04-18 | 西安交通大学 | Light and small interference imaging spectrum full-polarized detection device |
| CN106772404B (en) * | 2015-11-23 | 2023-11-03 | 北京万集科技股份有限公司 | Laser radar ranging device and method |
| WO2018119734A1 (en) * | 2016-12-28 | 2018-07-05 | 深圳市柔宇科技有限公司 | Control method and apparatus for display screen |
| CN109196525B (en) * | 2017-07-18 | 2020-12-22 | 深圳市汇顶科技股份有限公司 | Anti-spoof sensing to reject false fingerprint patterns in an off-screen optical sensor module for on-screen fingerprint sensing |
-
2021
- 2021-04-21 CN CN202110428771.0A patent/CN113238250B/en active Active
- 2021-07-22 WO PCT/CN2021/107949 patent/WO2022222290A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6072581A (en) * | 1998-10-30 | 2000-06-06 | Zygo Corporation | Geometrically-desensitized interferometer incorporating an optical assembly with high stray-beam management capability |
| US20040085545A1 (en) * | 2002-07-08 | 2004-05-06 | Hill Henry A. | Cyclic error compensation in interferometry systems |
| WO2014054963A1 (en) * | 2012-10-02 | 2014-04-10 | Общество с ограниченной ответственностью "Оптические измерительные системы" | Distributed coherent reflectometric system with phase demodulation (variants) |
| US20190312401A1 (en) * | 2016-07-01 | 2019-10-10 | Ipg Photonics Corporation | Fiber laser system with mechanism for inducing parasitic light losses |
| WO2019100989A1 (en) * | 2017-11-22 | 2019-05-31 | Oppo广东移动通信有限公司 | Display screen component, control method and device, storage medium and electronic device |
| CN209765529U (en) * | 2019-05-14 | 2019-12-10 | 深圳市汇顶科技股份有限公司 | Fingerprint identification device and electronic equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114296272A (en) * | 2021-12-28 | 2022-04-08 | 努比亚技术有限公司 | Method for optimizing light spot of off-screen distance sensor, mobile terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022222290A1 (en) | 2022-10-27 |
| CN113238250B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11686826B2 (en) | Measuring time-of-flight using a plurality of detector subsystems and histogram storage | |
| CN106104297B (en) | Optoelectronic module operable to identify spurious reflections and compensate for errors caused by spurious reflections | |
| WO2021238212A1 (en) | Depth measurement apparatus and method, and electronic device | |
| CN111538024B (en) | Filtering ToF depth measurement method and device | |
| CN111751808A (en) | Method and apparatus for compensating for light reflection from a cover of a time-of-flight camera | |
| US11693093B2 (en) | Distance-measuring apparatus that outputs precision information | |
| US11143750B2 (en) | Optical crosstalk calibration for ranging systems | |
| CN111352120B (en) | Flight time ranging system and ranging method thereof | |
| US11762151B2 (en) | Optical radar device | |
| CN113504542B (en) | Distance measuring system and method, device and equipment for calculating reflectivity of measured object | |
| CN113238250A (en) | Method and device for eliminating stray light under screen, under screen system and storage medium | |
| CN115131215A (en) | Image correction method and screen-off system | |
| WO2023279621A1 (en) | Itof distance measurement system and method for calculating reflectivity of measured object | |
| WO2022160622A1 (en) | Distance measurement method, device, and system | |
| CN214122466U (en) | Collector, distance measurement system and electronic equipment | |
| US20230019246A1 (en) | Time-of-flight imaging circuitry, time-of-flight imaging system, and time-of-flight imaging method | |
| CN115657053A (en) | ITOF ranging system and method for shielding fuzzy distance value | |
| US20210349193A1 (en) | Time of flight apparatus and method | |
| CN113614566A (en) | Distance measurement method, distance measurement device, and program | |
| WO2023279618A1 (en) | Distance measurement system, and method for shielding fuzzy distance value | |
| CN110764099A (en) | Time-of-flight sensor and computer-readable storage medium | |
| Anthonys | Timing Jitter in Time-of-Flight Range Imaging Cameras | |
| WO2023279755A1 (en) | Method and apparatus for masking ambiguity distance values of ranging system, and device | |
| WO2022198861A1 (en) | Interference fringe correction method and under-screen system | |
| CN115657056A (en) | Distance measurement system and method, device and equipment for determining relative precision of distance measurement system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |