CN113238250B - Method and device for eliminating stray light under screen, under screen system and storage medium - Google Patents
Method and device for eliminating stray light under screen, under screen system and storage medium Download PDFInfo
- Publication number
- CN113238250B CN113238250B CN202110428771.0A CN202110428771A CN113238250B CN 113238250 B CN113238250 B CN 113238250B CN 202110428771 A CN202110428771 A CN 202110428771A CN 113238250 B CN113238250 B CN 113238250B
- Authority
- CN
- China
- Prior art keywords
- signal
- stray light
- receiving end
- display screen
- optical signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000003287 optical effect Effects 0.000 claims abstract description 136
- 238000002310 reflectometry Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 4
- 230000000149 penetrating effect Effects 0.000 claims description 2
- 238000005259 measurement Methods 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
Abstract
The application is applicable to the field of optics and provides a method and device for eliminating stray light under a screen, an under-screen system and a storage medium. The method for eliminating stray light under the screen comprises the following steps: acquiring an echo signal received by a signal receiving end positioned at the inner side of a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen; acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen; and calculating a target optical signal of the target area for reflecting the first optical signal based on the echo signal and the stray light signal. The method provided by the embodiment of the application can eliminate stray light under the screen so as to improve the accuracy of the depth measurement value.
Description
Technical Field
The application belongs to the field of optics and image processing, and particularly relates to a method and device for eliminating stray light under a screen, an under-screen system and a storage medium.
Background
Currently, in order to improve screen integrity and product appearance aesthetics, technicians are continually trying to place 2D cameras and 3D cameras under the display screen. However, when 3D technologies such as Indirect time of flight (iTOF), direct time of flight (dTOF), and structured light are applied to under-screen imaging, a signal receiving end located inside a display screen often receives a stray light signal, resulting in an abnormality in a depth measurement value.
Therefore, a method for eliminating stray light under the screen is needed to improve the accuracy of depth information in applications such as 3D technology.
Disclosure of Invention
The embodiment of the application provides a method, a device, an under-screen system and a storage medium for eliminating under-screen stray light, which can eliminate the under-screen stray light so as to improve the accuracy of depth measurement values.
A first aspect of an embodiment of the present application provides a method for eliminating stray light under a screen, including:
acquiring an echo signal received by a signal receiving end positioned at the inner side of a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen;
acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
and calculating a target optical signal of the target area for reflecting the first optical signal based on the echo signal and the stray light signal.
An apparatus for eliminating stray light under a screen according to a second aspect of the present application includes:
the echo signal acquisition unit is used for acquiring echo signals received by the signal receiving end positioned at the inner side of the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen;
the stray light signal acquisition unit is used for acquiring a stray light signal received by the signal receiving end after the first light signal is reflected and/or scattered by the display screen;
and a target optical signal calculation unit configured to calculate a target optical signal in which the target region reflects the first optical signal, based on the echo signal and the stray light signal.
The third aspect of the present application provides an under-screen system, which is characterized by comprising a projection module, an acquisition module, a processing module, a storage module and a display screen, wherein:
the projection module is used for projecting a first optical signal to a target area through the display screen;
the acquisition module is used for receiving echo light signals which are reflected by the target area and then penetrate through the display screen;
the processing module is used for calculating a target optical signal according to the received echo optical signal and the stray light signal prestored in the storage module;
the storage module is used for storing the stray light signal acquired based on the method for eliminating the stray light under the screen.
A fourth aspect of the present embodiments provides a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the above method.
A fifth aspect of the embodiments provides a computer program product which, when run on an off-screen system, causes the off-screen system to perform the steps of the method.
In the embodiment of the application, through respectively obtaining the echo signal received by the signal receiving end positioned at the inner side of the display screen and the stray light signal received by the signal receiving end reflected and/or scattered by the display screen, the stray light signal can be filtered based on the echo signal and the stray light signal, after the signal transmitting end transmits the first optical signal to the target area at the outer side of the display screen, the target area actually reflects the first optical signal to obtain the target optical signal, so that the influence of the stray light signal transmitted to the receiving end through the display screen on the depth measurement can be eliminated, the depth measurement precision of an under-screen system is improved, and the 3D technology is applied to the under-screen measurement.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required for the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of forming a stray light signal provided by an embodiment of the present application;
fig. 2 is a schematic implementation flow chart of a method for eliminating stray light under a screen according to an embodiment of the present application;
fig. 3 is a schematic view of a light shielding element provided outside a display screen according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an embodiment of the present application in which no object capable of reflecting the second optical signal is present within a predetermined distance from the display screen;
FIG. 5 is a schematic view of a low reflectivity object disposed between a signal emitting end and a target area according to an embodiment of the present application;
FIG. 6 is a schematic structural diagram of an apparatus for eliminating stray light under a screen according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an under-screen system according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, are intended to be within the scope of the present application.
Currently, in order to improve screen integrity and product appearance aesthetics, technicians are continually trying to place 2D cameras and 3D cameras under the display screen.
It has been found that display screens for off-screen imaging typically employ organic light-Emitting Diode (OLED) screens with relatively high transmittance, and that some high-reflectivity structures, such as metal cathodes, are inevitably present in the display screen, which may cause light incident on the inside of the display screen to undergo multiple reflections or scattering.
As shown in fig. 1, when 3D technologies such as time of flight and structured light are applied to under-screen imaging, because the distance between the signal transmitting end and the signal receiving end adopted by these 3D technologies is smaller, light emitted by the signal transmitting end located inside the display screen easily enters the signal receiving end through scattering and/or reflection of the screen, forming stray light signals interfering with imaging, and causing abnormal depth measurement values.
Therefore, a method for eliminating stray light under the screen is needed to improve the accuracy of depth information in applications such as 3D technology.
In order to illustrate the technical solution of the present application, the following description is made by specific examples.
Fig. 2 is a schematic implementation flow chart of a method for eliminating stray light under a screen, which is provided in an embodiment of the present application, and the method may be applied to a terminal, where stray light under a screen needs to be eliminated, so as to improve accuracy of a depth measurement value.
The terminal can be an under-screen system such as a mobile phone and a tablet personal computer, which can carry an under-screen camera, so as to eliminate own under-screen stray light; the system can also be a computer, a server and other terminals so as to help other terminals carrying the under-screen cameras to improve the accuracy of depth measurement.
Specifically, the method for eliminating stray light under the screen may include the following steps S201 to S203.
Step S201, acquiring an echo signal received by a signal receiving end located inside the display screen.
The echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to the target area at the outer side of the display screen. The first optical signal is a pulse beam emitted by the signal emitting end after being modulated by a waveform with a specific frequency, for example, the first optical signal can be a pulse beam emitted by being modulated by a sine wave or a rectangular wave with the specific frequency.
As shown in fig. 1, after the signal transmitting end located at the inner side of the display screen transmits the first optical signal to the target area at the outer side of the display screen, the target area may reflect the first optical signal, and meanwhile, the display screen itself may also reflect and/or scatter the first optical signal, and the signal receiving end located at the inner side of the display screen may receive a signal obtained by reflecting the first optical signal by the target area, and may also receive a signal obtained by reflecting and/or scattering the first optical signal by the display screen itself.
That is, the echo signal received by the signal receiving end includes both a target optical signal obtained by reflecting the first optical signal by the target area and a stray light signal obtained by reflecting and/or scattering the display screen.
Step S202, stray light signals received by a signal receiving end after the first light signals are reflected and/or scattered by a display screen are obtained.
In an embodiment of the present application, the terminal may filter the target optical signal that reflects the first optical signal by the target area, so that the signal receiving end receives the stray light signal obtained after the first optical signal is reflected and/or scattered by the display screen.
Specifically, in some embodiments of the present application, when the light shielding element is disposed on the outer side of the display screen, the terminal may use the optical signal received by the signal receiving device as the stray light signal.
The light shielding element is used for preventing the target optical signal reflected by the target area on the first optical signal from transmitting through the display screen.
For convenience of explanation, as shown in fig. 3, a schematic diagram of a shading element is provided on the outer side of the display screen, a first optical signal (i.e., a pulse beam) emitted by the signal emitting end is divided into a first pulse beam and a second pulse beam, and the first pulse beam is reflected and/or scattered by the display screen on the inner side of the display screen and enters the signal receiving end; the second pulse light beam is transmitted outwards through the display screen and is reflected to the signal receiving end through the target area, and as the opaque shading element is arranged on the outer side of the display screen, the pulse light beam reflected by the target area of the second pulse light beam is blocked from entering the signal receiving end, so that the signal receiving end only generates stray light signals. Therefore, when the light shielding element is arranged outside the display screen, the terminal can take the optical signal received by the signal receiving end as the stray light signal.
In other embodiments of the present application, the terminal may further use the optical signal received by the signal receiving end as the stray light signal when an object capable of reflecting the second optical signal does not exist within a preset distance range from the display screen.
The second optical signal is obtained after the first optical signal emitted by the signal emitting end passes through the display screen.
For convenience of explanation, as shown in fig. 4, there is a schematic diagram that an object capable of reflecting the second optical signal does not exist within a preset distance range from the display screen, the first optical signal (i.e., the pulse beam) emitted by the signal emitting end is divided into a first pulse beam and a second pulse beam (i.e., the second optical signal), and the first pulse beam is reflected and/or scattered by the display screen inside the display screen and enters the signal receiving end; the second pulse beam is emitted outwards through the display screen, but because an object capable of reflecting the second pulse beam does not exist in a preset distance range from the display screen, the energy of the second pulse beam is sufficiently attenuated when the second pulse beam reaches the signal receiving end after long-distance propagation, and the response of the signal receiving end cannot be caused, so that the signal receiving end only receives stray light signals. Therefore, the terminal can take the optical signal received by the signal receiving end as the stray light signal when no object capable of reflecting the second optical signal exists in a preset distance range from the display screen.
In other embodiments of the present application, the terminal may further use the optical signal received by the signal receiving end as the stray light signal when a low-reflectivity object is disposed between the signal transmitting end and the target area.
The low-reflectivity object is used for absorbing a second optical signal obtained after the first optical signal emitted by the signal emitting end passes through the display screen. For example, the low-reflectivity object may be a low-reflectivity curtain or a low-reflectivity calibration plate, or the like, that is capable of absorbing the second optical signal.
For convenience of explanation, as shown in fig. 5, a schematic diagram of a low reflectivity object disposed between a signal transmitting end and a target area is shown, a first optical signal (i.e., a pulse beam) transmitted by the signal transmitting end is divided into a first pulse beam and a second pulse beam (i.e., a second optical signal), and the first pulse beam is reflected and/or scattered by the display screen inside the display screen and enters a signal receiving end; the second pulse light beam is transmitted outwards through the display screen, but as a low-reflectivity object is arranged between the signal transmitting end and the target area, the low-reflectivity object can absorb the second pulse light beam so as to prevent the second pulse light beam from entering the signal receiving end through the display screen again, and the signal receiving end only receives stray light signals. Therefore, the terminal can take the optical signal received by the signal receiving end as the stray light signal when the low-reflectivity object is arranged between the signal transmitting end and the target area.
In other embodiments of the present application, the stray light signal may also be obtained by absorbing the second optical signal or attenuating the second optical signal until it cannot be received by the signal receiving end in other manners.
The stray light signal may be a signal obtained by calibrating the stray light signal in advance and stored in a memory of the terminal. For example, a terminal carrying an under-screen camera can be placed in an open scene (such as an open gallery) in advance, so as to be calibrated in the mode shown in fig. 4, obtain a stray light signal, and obtain a stored stray light signal when depth information needs to be calculated, thereby eliminating under-screen stray light. And when stray light is calibrated in advance, the method can be carried out in an indoor or dark environment, and interference of ambient light is avoided.
The stray light signal may be a stray light signal obtained by calibrating in a certain way when depth information needs to be calculated. For example, after acquiring the echo signal, a shading element is provided outside the display screen to obtain a stray light signal in the manner shown in fig. 3, thereby eliminating the stray light under the screen to calculate accurate depth information.
In step S203, a target optical signal in which the target area reflects the first optical signal is calculated based on the echo signal and the stray light signal.
In the embodiment of the present application, after the echo signal and the stray light signal are acquired, the stray light signal may be removed from the echo signal based on the echo signal and the stray light signal, and a target optical signal in which the target area reflects the first optical signal may be obtained.
Specifically, the step S203 may include: signal receiving end in calculating exposure time TSignal strength P of accumulated echo signals a And the signal intensity P of the stray light signal accumulated by the signal receiving end in the exposure time T b And according to the formula p=p a -P b And calculating the signal intensity P of the target optical signal accumulated by the signal receiving end in the exposure time T.
Specifically, the signal intensity P of the echo signal accumulated at the signal receiving end within the exposure time T a May include: according to the formulaCalculating the accumulated target light signal intensity P of the signal receiving end in the exposure time T a Wherein s' (t) represents the amount of charge obtained from the echo signal received by the signal receiving end at time t; q (t) represents a demodulation waveform signal at time t, and the demodulation waveform signal is a demodulation waveform signal corresponding to a modulation waveform signal used by the signal transmitting terminal.
Similarly, the signal intensity P of the echo signal accumulated at the signal receiving end in the exposure time T b May include: according to the formulaCalculating the accumulated stray light signal intensity P of the signal receiving end in the exposure time T b Wherein n (t) represents the amount of charge obtained from the stray light signal received by the signal receiving end at time t; q (t) represents a demodulation waveform signal at time t, and the demodulation waveform signal is a demodulation waveform signal corresponding to a modulation waveform signal used by the signal transmitting terminal.
When the demodulation waveform signal q (t) is at a high level (i.e. 1), the signal needs to be sampled, and when the demodulation waveform signal q (t) is at a low level (i.e. 0), the signal does not need to be sampled.
Due to the signal strength P of the echo signals accumulated by the signal receiving end in the whole exposure time a Is effective superposition of target light signal and stray light signal, and the stray light signal intensity entering the signal receiving end is related to the material and structure distributed on the display screen, when the system under the screen is assembled, the stray light signalThe intensity and distribution of (c) is then fixed. Thus, it is possible to pass p=p a -P b The target optical signal can be obtained.
In order to make the obtained target optical signals more accurate, in some embodiments of the present application, the obtained stray light signals may be multiple groups, for example, a group of stray light signals may be obtained by respectively using the modes of fig. 3, fig. 4, and fig. 5, where the average value of the multiple groups of stray light signals may be calculated, and the target optical signal that the target area reflects the first optical signal may be calculated based on the echo signal and the average value of the multiple groups of stray light signals.
In the embodiment of the application, through respectively obtaining the echo signal received by the signal receiving end positioned at the inner side of the display screen and the stray light signal received by the signal receiving end reflected and/or scattered by the display screen, the stray light signal can be filtered based on the echo signal and the stray light signal, after the signal transmitting end transmits the first optical signal to the target area at the outer side of the display screen, the target area actually reflects the first optical signal to obtain the target optical signal, so that the influence of the stray light signal transmitted to the receiving end through the display screen on the depth measurement can be eliminated, the depth measurement precision of an under-screen system is improved, and the 3D technology is applied to the under-screen measurement.
It should be noted that, for the sake of simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order according to the present application.
Fig. 6 is a schematic structural diagram of an apparatus 600 for eliminating stray light under a screen according to an embodiment of the present application, where the apparatus 600 for eliminating stray light under a screen is configured on a terminal.
The device 600 for eliminating stray light under the screen may include: an echo signal acquisition unit 601, a stray light signal acquisition unit 602, and a target light signal calculation unit 603.
An echo signal obtaining unit 601, configured to obtain an echo signal received by a signal receiving end located inside the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen;
a stray light signal obtaining unit 602, configured to obtain a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
a target optical signal calculating unit 603, configured to calculate a target optical signal in which the target area reflects the first optical signal, based on the echo signal and the stray light signal.
In some embodiments of the present application, the stray light signal obtaining unit 602 may be specifically configured to: when a shading element is arranged on the outer side of the display screen, the optical signal received by the signal receiving end is used as the stray light signal, and the shading element is used for preventing the target optical signal reflected by the target area on the first optical signal from penetrating through the display screen.
In some embodiments of the present application, the stray light signal obtaining unit 602 may be further specifically configured to: when no object capable of reflecting the second optical signal exists in a preset distance range from the display screen, the optical signal received by the signal receiving end is used as the stray light signal; the second optical signal is an optical signal obtained after the first optical signal emitted by the signal emitting end passes through the display screen.
In some embodiments of the present application, the stray light signal obtaining unit 602 may be further specifically configured to: when a low-reflectivity object is arranged between the signal transmitting end and the target area, the optical signal received by the signal receiving end is used as the stray light signal, and the low-reflectivity object is used for absorbing a second optical signal obtained after a first optical signal transmitted by the signal transmitting end passes through the display screen.
In some embodiments of the present application, the target optical signal calculating unit 603 may be specifically configured to: calculating the signal intensity P of the echo signals accumulated by the signal receiving end in the exposure time T a And the signal intensity P of the stray light signal accumulated by the signal receiving end in the exposure time T b The method comprises the steps of carrying out a first treatment on the surface of the According to the formula p=p a -P b And calculating the signal intensity P of the target optical signal accumulated by the signal receiving end in the exposure time T.
In some embodiments of the present application, the target optical signal calculating unit 603 may be specifically configured to: according to the formulaCalculating the accumulated intensity P of the target optical signal at the signal receiving end within the exposure time T a Wherein s' (t) represents an amount of charge obtained at time t according to an echo signal received by the signal receiving end; q (t) represents a demodulation waveform signal at time t, and the demodulation waveform signal is a demodulation waveform signal corresponding to a modulation waveform signal used by the signal transmitting terminal.
In some embodiments of the present application, the target optical signal calculating unit 603 may be specifically configured to: according to the formulaCalculating the accumulated intensity P of the stray light signal of the signal receiving end in the exposure time T b Wherein n (t) represents the electric charge amount obtained according to the stray light signal received by the signal receiving end at the time t; q (t) represents a demodulation waveform signal at time t, and the demodulation waveform signal is a demodulation waveform signal corresponding to a modulation waveform signal used by the signal transmitting terminal.
It should be noted that, for convenience and brevity of description, the specific working process of the device 600 for eliminating stray light under a screen may refer to the corresponding process of the method described in fig. 2 to 5, and will not be described herein again.
Fig. 7 is a schematic structural diagram of an under-screen system of a terminal according to an embodiment of the present application. The under-screen system may include: projection module 70, collection module 71, processing module 72, storage module 73 and display screen 74, wherein:
a projection module 70 for projecting a first optical signal to a target area through a display screen 74;
the acquisition module 71 is configured to receive an echo optical signal reflected by the target area and transmitted through the display screen 74;
a processing module 72, configured to calculate a target optical signal according to the received echo optical signal and a stray light signal pre-stored in the storage module 73;
the storage module 73 is configured to store the stray light signal obtained based on the method for eliminating the stray light under the screen.
In one embodiment, the projection module 70 may be a light source such as an Edge Emitting Laser (EEL) or a Vertical Cavity Surface Emitting Laser (VCSEL), or an array of light sources, where the light beam emitted by the light source may be visible light, infrared light, ultraviolet light, or the like. The light beam emitted by the light source may form a uniform, random or specially designed projection pattern of the intensity distribution on the reference plane. The acquisition module 71 includes an image sensor, a lens unit, and the like, and the lens unit receives a part of the light beam reflected by the object and images the part of the light beam on the image sensor. The image sensor may be an image sensor composed of a charge coupled device (Charge Coupled Device, CCD), a complementary metal Oxide semiconductor (Complementary Metal-Oxide-Semiconductor Transistor, CMOS), an Avalanche Diode (AD), a single photon Avalanche Diode (Single Photon Avalanche Diode, SPAD), or the like.
In one embodiment, the processing module 72 performs the steps in the method embodiment for eliminating the stray light under the screen, and more specifically, the steps may be performed by one or more units in the processing module 72 to complete the present application, and specific performing functions of the units that may be divided (please refer to fig. 6, fig. 6 shows a schematic diagram of a processor functional architecture provided in the present application) are as follows:
the echo signal acquisition unit is used for acquiring echo signals received by the signal receiving end positioned at the inner side of the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen; the stray light signal obtaining unit is configured to obtain a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen, and transmit the stray light signal to the storage module 73 for storage, so that a target optical signal is conveniently calculated; and a target optical signal calculating unit configured to calculate a target optical signal in which the target region reflects the first optical signal, based on the echo signal and the stray light signal in the storage module 73. The processing module 72 may be a central processing unit (Central Processing Unit, CPU), other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage module 73 may be an internal storage unit of the off-screen system, such as a hard disk or a memory of the off-screen system. The memory 71 may also be an external storage device of the off-screen system, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the off-screen system. Further, the memory module 73 may also include both an internal memory unit and an external memory device of the under-screen system. The memory module 73 is used for storing the computer program as well as other programs and data required by the off-screen system. The memory module 73 may also be used to temporarily store data that has been output or is to be output.
The under screen system may include, but is not limited to, the modules described above. It will be appreciated by those skilled in the art that fig. 7 is merely an example of an under-screen system and is not meant to be limiting, and that more or fewer components than shown may be included, or certain components may be combined, or different components may be included, for example, the under-screen system may also include input and output devices, network access devices, buses, etc.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each method embodiment described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.
Claims (9)
1. The method for eliminating stray light under the screen is characterized by being applied to a terminal with a signal transmitting end and a signal receiving end arranged on the inner side of a display screen, and comprises the following steps:
acquiring an echo signal received by a signal receiving end positioned at the inner side of a display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen;
acquiring a stray light signal received by the signal receiving end after the first optical signal is reflected and/or scattered by the display screen;
calculating a target optical signal of the target area for reflecting the first optical signal based on the echo signal and the stray light signal;
the calculating, based on the echo signal and the stray light signal, a target optical signal of the target area reflecting the first optical signal includes: calculating the signal intensity P of the echo signals accumulated by the signal receiving end in the exposure time T a And the signal intensity P of the stray light signal accumulated by the signal receiving end in the exposure time T b The method comprises the steps of carrying out a first treatment on the surface of the According to the formula p=p a -P b And calculating the signal intensity P of the target optical signal accumulated by the signal receiving end in the exposure time T.
2. The method for eliminating stray light under a screen according to claim 1, wherein said obtaining a stray light signal received by said signal receiving end after said first light signal is reflected or scattered by said display screen comprises:
when a shading element is arranged on the outer side of the display screen, the optical signal received by the signal receiving end is used as the stray light signal, and the shading element is used for preventing the target optical signal reflected by the target area on the first optical signal from penetrating through the display screen.
3. The method for eliminating stray light under a screen according to claim 1, wherein said obtaining a stray light signal received by said signal receiving end after said first light signal is reflected or scattered by said display screen comprises:
when no object capable of reflecting the second optical signal exists in a preset distance range from the display screen, the optical signal received by the signal receiving end is used as the stray light signal; the second optical signal is an optical signal obtained after the first optical signal emitted by the signal emitting end passes through the display screen.
4. The method for eliminating stray light under a screen according to claim 1, wherein said obtaining a stray light signal received by said signal receiving end after said first light signal is reflected or scattered by said display screen comprises:
when a low-reflectivity object is arranged between the signal transmitting end and the target area, the optical signal received by the signal receiving end is used as the stray light signal, and the low-reflectivity object is used for absorbing a second optical signal obtained after a first optical signal transmitted by the signal transmitting end passes through the display screen.
5. The method for eliminating stray light under screen as claimed in claim 1, wherein a signal intensity P of the echo signal accumulated by the signal receiving end during the exposure time T a Comprises the following steps of
According to the formulaCalculating the accumulated intensity P of the target optical signal at the signal receiving end within the exposure time T a Wherein s' (t) represents an amount of charge obtained at time t according to an echo signal received by the signal receiving end; q (t) represents a demodulation waveform signal at time t, where the demodulation waveform signal is a demodulation waveform signal corresponding to a modulation waveform signal used by the signal transmitting terminal。
6. The method for eliminating stray light under screen as claimed in claim 1, wherein a signal intensity P of the echo signal accumulated by the signal receiving end during the exposure time T b Comprises the following steps of
According to the formulaCalculating the accumulated intensity P of the stray light signal of the signal receiving end in the exposure time T b Wherein n (t) represents the electric charge amount obtained according to the stray light signal received by the signal receiving end at the time t; q (t) represents a demodulation waveform signal at time t, and the demodulation waveform signal is a demodulation waveform signal corresponding to a modulation waveform signal used by the signal transmitting terminal.
7. An apparatus for eliminating stray light under a screen, which is applied to a terminal in which a signal transmitting end and a signal receiving end are disposed inside a display screen, the apparatus comprising:
the echo signal acquisition unit is used for acquiring echo signals received by the signal receiving end positioned at the inner side of the display screen; the echo signal is an optical signal received by the signal receiving end after the signal transmitting end positioned at the inner side of the display screen transmits a first optical signal to a target area at the outer side of the display screen;
the stray light signal acquisition unit is used for acquiring a stray light signal received by the signal receiving end after the first light signal is reflected and/or scattered by the display screen;
a target optical signal calculation unit configured to calculate a target optical signal in which the target region reflects the first optical signal, based on the echo signal and the stray light signal;
the target optical signal calculation unit is used for: calculating the signal intensity P of the echo signals accumulated by the signal receiving end in the exposure time T a And the signal intensity P of the stray light signal accumulated by the signal receiving end in the exposure time T b The method comprises the steps of carrying out a first treatment on the surface of the According to the formula p=p a -P b And calculating the signal intensity P of the target optical signal accumulated by the signal receiving end in the exposure time T.
8. The utility model provides a system under screen, its characterized in that includes projection module, collection module, processing module, storage module and display screen, projection module with collection module locates the display screen is inboard, wherein:
the projection module is used for projecting a first optical signal to a target area through the display screen;
the acquisition module is used for receiving echo light signals which are reflected by the target area and then penetrate through the display screen;
the processing module is used for calculating a target optical signal according to the received echo optical signal and the stray light signal prestored in the storage module; the processing module is used for: calculating the signal intensity P of the echo signals accumulated by the signal receiving end in the exposure time T a And the signal intensity P of the stray light signal accumulated by the signal receiving end in the exposure time T b The method comprises the steps of carrying out a first treatment on the surface of the According to the formula p=p a -P b Calculating the signal intensity P of the target optical signal accumulated by the signal receiving end in the exposure time T;
the storage module is configured to store the stray light signal obtained based on the method for eliminating stray light under a screen according to any one of claims 1 to 6.
9. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110428771.0A CN113238250B (en) | 2021-04-21 | 2021-04-21 | Method and device for eliminating stray light under screen, under screen system and storage medium |
| PCT/CN2021/107949 WO2022222290A1 (en) | 2021-04-21 | 2021-07-22 | Method and apparatus for eliminating stray light under screen, and under-screen system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110428771.0A CN113238250B (en) | 2021-04-21 | 2021-04-21 | Method and device for eliminating stray light under screen, under screen system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113238250A CN113238250A (en) | 2021-08-10 |
| CN113238250B true CN113238250B (en) | 2024-03-12 |
Family
ID=77128696
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110428771.0A Active CN113238250B (en) | 2021-04-21 | 2021-04-21 | Method and device for eliminating stray light under screen, under screen system and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113238250B (en) |
| WO (1) | WO2022222290A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114296272A (en) * | 2021-12-28 | 2022-04-08 | 努比亚技术有限公司 | Method for optimizing light spot of off-screen distance sensor, mobile terminal and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6072581A (en) * | 1998-10-30 | 2000-06-06 | Zygo Corporation | Geometrically-desensitized interferometer incorporating an optical assembly with high stray-beam management capability |
| WO2014054963A1 (en) * | 2012-10-02 | 2014-04-10 | Общество с ограниченной ответственностью "Оптические измерительные системы" | Distributed coherent reflectometric system with phase demodulation (variants) |
| WO2019100989A1 (en) * | 2017-11-22 | 2019-05-31 | Oppo广东移动通信有限公司 | Display screen component, control method and device, storage medium and electronic device |
| CN209765529U (en) * | 2019-05-14 | 2019-12-10 | 深圳市汇顶科技股份有限公司 | Fingerprint identification device and electronic equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001305365A (en) * | 2000-04-25 | 2001-10-31 | Nec Corp | Light shielding structure of stray light in optical wavelength module |
| AU2003247779A1 (en) * | 2002-07-08 | 2004-01-23 | Zygo Corporation | Cyclic error compensation in interferometry systems |
| CN101793559B (en) * | 2010-03-18 | 2012-04-18 | 西安交通大学 | Light and small interference imaging spectrum full-polarized detection device |
| CN106772404B (en) * | 2015-11-23 | 2023-11-03 | 北京万集科技股份有限公司 | Laser radar ranging device and method |
| WO2018005927A1 (en) * | 2016-07-01 | 2018-01-04 | Ipg Photonics Corporation | Fiber laser system with mechanism for inducing parasitic light losses |
| WO2018119734A1 (en) * | 2016-12-28 | 2018-07-05 | 深圳市柔宇科技有限公司 | Control method and apparatus for display screen |
| CN109196525B (en) * | 2017-07-18 | 2020-12-22 | 深圳市汇顶科技股份有限公司 | Anti-spoof sensing to reject false fingerprint patterns in an off-screen optical sensor module for on-screen fingerprint sensing |
-
2021
- 2021-04-21 CN CN202110428771.0A patent/CN113238250B/en active Active
- 2021-07-22 WO PCT/CN2021/107949 patent/WO2022222290A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6072581A (en) * | 1998-10-30 | 2000-06-06 | Zygo Corporation | Geometrically-desensitized interferometer incorporating an optical assembly with high stray-beam management capability |
| WO2014054963A1 (en) * | 2012-10-02 | 2014-04-10 | Общество с ограниченной ответственностью "Оптические измерительные системы" | Distributed coherent reflectometric system with phase demodulation (variants) |
| WO2019100989A1 (en) * | 2017-11-22 | 2019-05-31 | Oppo广东移动通信有限公司 | Display screen component, control method and device, storage medium and electronic device |
| CN209765529U (en) * | 2019-05-14 | 2019-12-10 | 深圳市汇顶科技股份有限公司 | Fingerprint identification device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022222290A1 (en) | 2022-10-27 |
| CN113238250A (en) | 2021-08-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Maccarone et al. | Three-dimensional imaging of stationary and moving targets in turbid underwater environments using a single-photon detector array | |
| WO2021008209A1 (en) | Depth measurement apparatus and distance measurement method | |
| Buttafava et al. | Non-line-of-sight imaging using a time-gated single photon avalanche diode | |
| WO2021238212A1 (en) | Depth measurement apparatus and method, and electronic device | |
| CN109903241A (en) | A kind of the depth image calibration method and system of TOF camera system | |
| CN111538024B (en) | Filtering ToF depth measurement method and device | |
| US20150373322A1 (en) | Automatic multiple depth cameras synchronization using time sharing | |
| CN111751808A (en) | Method and apparatus for compensating for light reflection from a cover of a time-of-flight camera | |
| CN111123289B (en) | Depth measuring device and measuring method | |
| CN111736173B (en) | Depth measuring device and method based on TOF and electronic equipment | |
| US20190383906A1 (en) | Distance-measuring apparatus that outputs precision information | |
| CN113238250B (en) | Method and device for eliminating stray light under screen, under screen system and storage medium | |
| US20220043129A1 (en) | Time flight depth camera and multi-frequency modulation and demodulation distance measuring method | |
| CN109788216A (en) | For the anti-interference method of TOF, device and TOF sensor chip | |
| Rapp et al. | Dithered depth imaging | |
| CN111352120A (en) | Flight time ranging system and ranging method thereof | |
| CN114509740B (en) | Time-of-flight offset correction method, ToF device, electronic apparatus, and storage medium | |
| WO2022198862A1 (en) | Image correction method, and under-screen system | |
| CN112651286B (en) | Three-dimensional depth perception device and method based on transparent screen | |
| Falie et al. | Wide range time of flight camera for outdoor surveillance | |
| WO2023279621A1 (en) | Itof distance measurement system and method for calculating reflectivity of measured object | |
| CN113504542B (en) | Distance measuring system and method, device and equipment for calculating reflectivity of measured object | |
| WO2023279618A1 (en) | Distance measurement system, and method for shielding fuzzy distance value | |
| WO2022198861A1 (en) | Interference fringe correction method and under-screen system | |
| WO2020074467A1 (en) | Time of flight apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |