CN108594249B - Display panel and method for measuring distance of external object by using same - Google Patents
Display panel and method for measuring distance of external object by using same Download PDFInfo
- Publication number
- CN108594249B CN108594249B CN201810379015.1A CN201810379015A CN108594249B CN 108594249 B CN108594249 B CN 108594249B CN 201810379015 A CN201810379015 A CN 201810379015A CN 108594249 B CN108594249 B CN 108594249B
- Authority
- CN
- China
- Prior art keywords
- display panel
- infrared light
- infrared
- ranging
- light source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
Abstract
The present disclosure provides a display panel and a method of ranging an external object using the same. The display panel includes: a lower substrate; the sub-pixel array is positioned on the surface of the lower substrate close to the light-emitting surface of the display panel; and at least one ranging unit, each ranging unit comprising: the infrared receiving unit is used for receiving the infrared light from the light-emitting surface. The at least one infrared receiving unit is arranged on the surface of the lower substrate close to the light emitting surface and located between adjacent sub-pixels in the sub-pixel array.
Description
Technical Field
The present disclosure relates to the field of display, and in particular, to a display panel and a method of ranging an external object using the same.
Background
Currently, the ranging function for an external object (e.g., an object located in front of the display panel) on the display panel is implemented by an additional separate ranging module, which has a limited field of view, a blind area, and a low degree of integration with the panel.
Disclosure of Invention
The present disclosure provides a display panel and a method of ranging an external object using the same.
According to one aspect of the present disclosure, a display panel is provided. The display panel includes: a lower substrate; the sub-pixel array is positioned on the surface of the lower substrate close to the light-emitting surface of the display panel; and at least one ranging unit, each ranging unit comprising: the infrared receiving unit is used for receiving the infrared light from the light-emitting surface. The at least one infrared receiving unit is arranged on the surface of the lower substrate close to the light emitting surface and located between adjacent sub-pixels in the sub-pixel array.
In one embodiment, a distance between the at least one infrared receiving unit and the infrared light source is less than a first threshold.
In one embodiment, the infrared light source is disposed on the lower substrate and between adjacent sub-pixels in the sub-pixel array.
In one embodiment, the infrared light source and the infrared receiving unit are arranged between different sub-pixels.
In one embodiment, the infrared light source and at least one of the infrared receiving units are arranged between the same sub-pixels.
In one embodiment, the display panel further includes: and the at least one micro lens is arranged on the surface, close to the light-emitting surface, of the sub-pixel array corresponding to the infrared light source in the at least one distance measuring unit, and the orthographic projection of each micro lens on the lower substrate is at least partially overlapped with the orthographic projection of the infrared light source corresponding to the micro lens on the lower substrate.
In one embodiment, the orthographic projection of the micro-lens on the lower substrate and the orthographic projection of any infrared receiving unit on the lower substrate do not have a part which is overlapped.
In one embodiment, the infrared light source is arranged on one side of the lower substrate far away from the light emitting surface.
In one embodiment, the display panel further includes: at least one micro lens, which is arranged between the lower substrate and the infrared light source corresponding to the infrared light source in the at least one distance measuring unit, wherein the orthographic projection of each micro lens on the lower substrate is at least partially overlapped with the orthographic projection of the infrared light source corresponding to the micro lens on the lower substrate.
In one embodiment, the display panel further includes: a light shielding layer disposed on a surface of the lower substrate near the light emitting surface, wherein the infrared receiving unit is disposed on the light shielding layer.
In one embodiment, the light shielding layers are arranged in one-to-one correspondence with the infrared receiving units.
In one embodiment, the infrared receiving unit is a light-sensitive sensor.
In one embodiment, each ranging unit shares one or more infrared receiving units with at least one other ranging unit, respectively.
In one embodiment, the display panel further includes: and the controller is electrically connected with the at least one ranging unit and used for receiving the time information from the at least one ranging unit and sending a control signal to the at least one ranging unit.
According to another aspect of the present disclosure, there is provided a method for ranging an external object using the display panel according to any one of the above embodiments. The method comprises the following steps: controlling an infrared light source in the at least one distance measuring unit to vertically emit infrared light from the light emitting surface; controlling an infrared receiving unit of the at least one ranging unit to receive infrared light reflected from the external object; calculating a distance from a light exit surface of the display panel to the external object based on a time difference from when the infrared light is emitted from the infrared light source to when the infrared light is received by the infrared receiving unit.
In one embodiment, the method further comprises: dividing at least one ranging unit on the display panel into at least one group; in each group, sequentially activating each ranging unit to execute the steps of emitting infrared light and receiving infrared light; and calculating a distance from the light exit surface of the display panel to the external object for each ranging unit.
In one embodiment, the method further comprises: determining distance information of the external object with respect to the display panel according to the distance measured by each ranging unit.
According to the display panel disclosed by the embodiment of the disclosure, not only can the good integration of the distance measurement unit and the display panel be realized, the added value of the display panel is improved, but also the problem of limited view field existing in an additional distance measurement module in a conventional scheme is solved, and a distance measurement blind area is eliminated. Furthermore, by the method for ranging an external object using a display panel according to the embodiment of the present disclosure, it is also possible to achieve finer and accurate ranging (depth measurement) and to obtain more complete (three-dimensional) depth information of the external object in front of the display panel.
Drawings
Fig. 1 illustrates a structural diagram of a display panel according to an embodiment of the present disclosure.
Fig. 2 illustrates a structural diagram of a display panel in which an infrared light source and an infrared receiving unit are located between the same pair of sub-pixels according to an embodiment of the present disclosure.
Fig. 3A shows a view showing an arrangement relationship of the infrared light source and the infrared receiving unit as viewed from a normal direction of the display panel.
Fig. 3B shows another view showing an arrangement relationship of the infrared light source and the infrared receiving unit viewed from the normal direction of the display panel.
Fig. 3C shows another view showing an arrangement relationship of the infrared light source and the infrared receiving unit viewed from the normal direction of the display panel.
Fig. 4 illustrates a structural diagram of a display panel according to another embodiment of the present disclosure.
Fig. 5 illustrates a structural diagram of a display panel according to another embodiment of the present disclosure.
Fig. 6 illustrates a structural diagram of a display panel according to another embodiment of the present disclosure.
Fig. 7 shows a block diagram of a unit for implementing a ranging function in a display panel according to an embodiment of the present disclosure.
Fig. 8 illustrates a flowchart of a method of ranging an external object using a display panel according to an embodiment of the present disclosure.
Fig. 9 illustrates a flowchart of a method of ranging an external object using a display panel according to another embodiment of the present disclosure.
An example of grouping the ranging units on the display panel is shown in fig. 10.
Fig. 11 shows a schematic diagram of sequentially activating the ranging units in each group for ranging in the grouping example of fig. 10.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below in detail and completely with reference to the accompanying drawings in the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure. It should be noted that throughout the drawings, like elements are represented by like or similar reference numerals. In the following description, some specific embodiments are for illustrative purposes only and should not be construed as limiting the disclosure in any way, but merely as exemplifications of embodiments of the disclosure. Conventional structures or constructions will be omitted when they may obscure the understanding of the present disclosure. It should be noted that the shapes and sizes of the respective components in the drawings do not reflect actual sizes and proportions, but merely illustrate the contents of the embodiments of the present disclosure.
In the present application, "a is on B", "a is on the surface of B", or the like, does not limit a to B to be in direct contact, but merely means that a and B have a defined stacked positional relationship, and specifically, a and B may be in direct contact or a and B may have other layers or structures therebetween.
In the related art, (proximity) ranging (or referred to as depth detection) may be performed by means of a binocular camera (stereoscopic vision), structured light, TOF (time of flight), and the like. However, the distance measuring devices in the related art are implemented based on complementary metal oxide semiconductor (cmos) technology, which is difficult to fabricate on the display panel, and can be integrated only in the form of an auxiliary module, which is not favorable for increasing the product value of the display panel. In addition, due to the field of view limitation, a detection blind area problem inevitably exists in the process of integrating the attached ranging device with the display, which makes the ranging scheme in the related art have a large limitation.
In the TOF technique, a light source is used to continuously transmit light pulses to a measurement object, and then a light receiver is used to receive light returning from the measurement object. In this way, the distance of the measurement object from the measurement reference surface (e.g., the surface on which the light source and the light receiver are disposed) can be obtained by calculating the flight (round trip) time of the light pulse. In the TOF technique, the distance between the light source and the light receiver is also taken into consideration when calculating the distance, and the existence of the distance leads the distance to be at an angle θ relative to the measured point of the measuring object, and the angle has a substantial influence on the measuring result.
Embodiments of the present disclosure will be described below with reference to the accompanying drawings, and in embodiments of the present disclosure, a display panel and a method of measuring distance using the same, which can implement a more optimal distance measuring scheme than an accessory distance measuring module in the related art, will be provided.
Fig. 1 illustrates a block diagram of a display panel 100 according to an embodiment of the present disclosure.
As shown in fig. 1, the display panel 100 includes a lower substrate 110, a sub-pixel array 120, an infrared light source 130-1, and an infrared receiving unit 130-2. In addition, the display panel 100 further includes an upper substrate 140, and the upper substrate 140 is used to cover the sub-pixel array 120, the infrared light source 130-1, and the infrared receiving unit 130-2.
The sub-pixel array 120 is disposed on a surface of the lower substrate 110 near the light emitting surface of the display panel 100. The sub-pixel array 120 is shown in fig. 1 to include R (red), G (green), and B (blue) sub-pixels. However, it should be understood that this is merely exemplary, and in other embodiments, subpixel array 120 may include fewer or more types of subpixels. For example, in another embodiment, the sub-pixel array 120 may also have W (white) sub-pixels.
The infrared light source 130-1 is configured to emit infrared light from the light emitting surface, and it should be noted that, in order to implement the single-point distance measurement scheme adopted in the embodiment, the infrared light source 130-1 is required to emit infrared light in a direction substantially perpendicular to the light emitting surface, so that the infrared light can be received by the infrared receiving unit adjacent to the infrared light source 130-1 after being reflected by the measured object. The exemplary angle between the emitted and received light in fig. 1 is limited by the size of the pattern, which does not impose any limit on the actual angle between the two. In practice, the angle between the emitted light and the received light should be close to zero.
In fig. 1, the infrared light source 130-1 is disposed on a surface of the lower substrate 110 near the light emitting surface and between adjacent sub-pixels in the sub-pixel array 120. For example, one infrared light source 130-1 is disposed between the G sub-pixel and the B sub-pixel in fig. 1.
The infrared receiving unit 130-2 is used for receiving the infrared light from the light emitting surface, i.e. the infrared light emitted by the infrared light source 130-1 and reflected back to the light emitting surface by the measurement object. In one embodiment, the infrared receiving unit 130-2 may be implemented as a photosensitive sensor having an infrared sensing characteristic, which can respond quickly to infrared light. In particular, the photosensitive sensor may be a photodiode (e.g., an avalanche photodiode, a PIN photodiode, etc.) or other photosensitive sensor that can perform an infrared receiving function.
The infrared receiving unit 130-2 is disposed on a surface of the lower substrate 110 near the light emitting surface and between adjacent sub-pixels in the sub-pixel array 120. For example, one infrared receiving unit 130-2 is disposed between the R and G sub-pixels and between the B and R sub-pixels in fig. 1, respectively.
In one embodiment, to better ensure the effect of infrared reception, the wavelength of infrared light emitted by the infrared light source 130-1 is set to coincide with the most sensitive wavelength of the infrared receiving unit 130-2. In addition, it should be ensured that the wavelength of the infrared light actually emitted by the infrared light source 130-1 is better focused on the nominal wavelength set for it, and the infrared light beam emitted by the infrared light source 130-1 is more collimated.
For each infrared light source 130-1, at least one infrared receiving unit 130-2 may be correspondingly disposed in the vicinity thereof to sense reflected light of infrared light emitted from the infrared light source 130-1. A set of one infrared light source 130-1 and at least one infrared receiving unit 130-2 disposed corresponding thereto may be referred to as a ranging unit 130, for example, as indicated by a dotted line box in fig. 1, and the ranging unit 130 includes one infrared light source 130-1 and two infrared receiving units 130-2 disposed corresponding thereto. Different from the auxiliary ranging module in the related art, the ranging unit in the present application is fabricated on the display panel, and the integration level of the ranging unit with the display panel is higher.
It should be noted that although only one distance measuring unit 130 (including one infrared light source 130-1 and two infrared receiving units 130-2) is shown on the display panel 100 in fig. 1, this is for illustrative purposes only, and in other embodiments of the present disclosure, a plurality of distance measuring units 130 may be disposed on the display panel 100. These ranging units may be distributed on the display panel 100 at a certain density, so that an arbitrary point object in front of the display panel may be ranged, and distance information of any one body object in front of the display panel may be obtained (e.g., a distance distribution map, a depth map, a three-dimensional surface profile map of the body object).
In the case where a plurality of ranging units 130 are arranged, different ranging units 130 may be arranged on the display panel in a certain pattern, for example, in a matrix form on the display panel according to the arrangement of the sub-pixel array, or at a specific position set in advance.
In one embodiment, as shown in FIG. 1 (or referring to FIG. 3A below), the different ranging units 130 are arranged separately and do not overlap.
In another embodiment (refer to fig. 3B or fig. 3C below), some or all of the infrared receiving units 130-2 may be shared among different ranging units 130. This configuration can further increase the density of the on-panel ranging units 130, increasing measurement resolution. In this embodiment, it may be defined that the ranging units 130 sharing the infrared receiving unit cannot be simultaneously activated for distance measurement to provide more accurate measurement results. Specifically, when two infrared light sources sharing the infrared receiving unit are activated at the same time for ranging, since the shared infrared receiving unit is responsible for collecting reception time data for the two ranging units and the shared infrared receiving unit cannot distinguish which infrared light source the received infrared light is caused by, it will not be possible to accurately determine the infrared light reception time (at most one is accurate) for both ranging units, and by activating the ranging units sharing the infrared receiving unit at different times for distance measurement, the distance measurement accuracy of the ranging units can be improved.
It should be noted that although the infrared light source 130-1 and the infrared receiving unit 130-2 are located between different sub-pixels in fig. 1, the present disclosure is not limited thereto, and in other embodiments, the infrared light source 130-1 may be located between the same pair of sub-pixels as the infrared receiving unit 130-2. This situation is illustrated in fig. 2. In fig. 2, the infrared light source 130-1 and the two infrared receiving units 130-2 in the single ranging unit 130 are disposed between a pair of adjacent sub-pixels R and G. The angle between the emitting light and the receiving light is smaller due to the arrangement, so that the single-point distance measurement is more accurate. Also, since the distance between the infrared light source 130-1 and the infrared receiving unit 130-2 in the same ranging unit (e.g., the infrared light source and the infrared receiving unit in the dashed line frame) is more significantly smaller than the distance between the infrared light source 130-1 and a different group of infrared receiving units 130-2 (e.g., the infrared light source in the dashed line frame and the infrared receiving unit outside the dashed line frame), interference between different ranging units can be reduced, enabling more accurate measurement. It is noted that in other embodiments, a single ranging unit may include both an infrared receiving unit located between the same sub-pixels as the infrared light source and an infrared receiving unit located between different sub-pixels as the infrared light source.
It should be noted that the present application is not limited to the number of the infrared receiving units 130-2 in a single ranging unit, and the number may be set according to the requirement, or may be determined according to the quantity of the photoelectric signals required to be acquired. The infrared receiving units 130-2 should be distributed near (at one side or around) the infrared light sources 130-1.
In one embodiment, it may be defined to be located in a row or a column of sub-pixels with the infrared light source 130-1 and the infrared receiving unit 130-2 in a single ranging unit, as shown in fig. 1. In another embodiment, infrared light source 130-1 and infrared receiving unit 130-2 in a single ranging unit are located in different sub-pixel rows or columns. Fig. 3A shows a view showing an arrangement relationship of the infrared light source and the infrared receiving unit viewed from a normal direction of the display panel. As shown in FIG. 3A, the distance measuring unit 130 includes an infrared light source 130-1 and 8 infrared receiving units 130-2 surrounding the periphery thereof, and the infrared receiving units 130-2 are not all located in the same row or column as the infrared light source 130-1.
In general, it may be defined that the distance between the infrared receiving unit 130-2 and the infrared light source 130-1 within the same ranging unit is less than a first threshold value. In one embodiment, the first threshold may be, for example, twice a set pixel pitch (pitch) of the display panel.
Fig. 3B shows another view showing an arrangement relationship of the infrared light source and the infrared receiving unit viewed from the normal direction of the display panel. As shown in FIG. 3B, two ranging units 130 are shown, each ranging unit 130 including an infrared light source 130-1 and 8 infrared receiving units 130-2 surrounding it, the infrared receiving units 130-2 not all being in the same row or column as the infrared light source 130-1. As shown in fig. 3B, the first ranging unit 130 (upper dotted frame) and the second ranging unit 130 (lower dotted frame) share three infrared receiving units (three infrared receiving units in the area where the dotted frames overlap).
Fig. 3C shows another view of the arrangement relationship of the infrared light source and the infrared receiving unit viewed from the normal direction of the display panel. As shown in FIG. 3C, a distance measuring unit 130 includes an infrared light source 130-1 and 4 infrared receiving units 130-2 (shown by a rectangular dashed line frame) surrounding it, and the infrared receiving units 130-2 are not all located in the same row or column as the infrared light source 130-1. As shown in fig. 3C, each infrared receiving unit in the ranging unit 130 (e.g., the infrared receiving unit whose frame is bold at the center of fig. 3C) is shared by four infrared light sources (belonging to different ranging units) adjacent to the infrared receiving unit on the display panel (e.g., as indicated by a circular dotted-line frame in the figure). In this arrangement, although the ratio of the infrared light source to the infrared receiving unit in each ranging unit is 1 to 4, since a scheme common to the infrared receiving units is adopted, the ratio of the infrared light source to the infrared receiving unit actually arranged on the panel is 1 to 1, which greatly increases the number of the ranging units actually arranged on the panel.
Fig. 4 illustrates a structure diagram of a display panel 400 according to another embodiment of the present disclosure.
As shown in fig. 4, the display panel 400 includes a lower substrate 110, a sub-pixel array 120, an infrared light source 130-1, an infrared receiving unit 130-2, and a microlens 150. In addition, the display panel 400 further includes an upper substrate 140 covering the pixel array 120, the infrared light source 130-1 and the infrared receiving unit 130-2, and a cover layer 160 for covering the microlenses 150.
The micro lens 150 is used for restraining and collimating the infrared light emitted by the infrared light source 130-1, so that the infrared light has good directivity.
The microlenses 150 are arranged on the surface of the sub-pixel array near the light exit surface via the upper substrate 140. It should be understood that in other embodiments, the microlenses 150 may be located in the upper substrate 140, such that the cover layer 160 need not be provided in the display panel.
The micro lens 150 is disposed corresponding to the infrared light source 130-1 in the ranging unit 130, and an orthographic projection of the micro lens 150 on the lower substrate 110 is at least partially overlapped with an orthographic projection of the infrared light source 130-1 on the lower substrate 110. In one embodiment, the orthographic projection of the microlenses 150 on the lower substrate 110 includes the orthographic projection of the infrared light source 130-1 on the lower substrate 110.
In one embodiment, the orthographic projection of the micro lens 150 on the lower substrate 110 and the orthographic projection of any infrared receiving unit 130-2 on the lower substrate 110 do not have a portion that overlaps.
In each of the embodiments shown in fig. 1-4, the infrared light source 130-1 and the infrared receiving unit 130-1 are disposed on a surface of the lower substrate 110 near the light emitting surface.
Fig. 5 illustrates a structure diagram of a display panel 500 according to another embodiment of the present disclosure.
As shown in fig. 5, the display panel 500 includes a lower substrate 110, a sub-pixel array 120, an infrared light source 130-1, and an infrared receiving unit 130-2. In addition, the display panel 100 further includes an upper substrate 140 covering the sub-pixel array 120 and the infrared receiving unit 130-2, and a support layer 170 for supporting the infrared light source 130-1.
In fig. 5, the infrared light source 130-1 is disposed on a side of the lower substrate 110 away from the light emitting surface. Accordingly, the size of infrared light source 130-1 is not limited by the structure of the sub-pixel array. As shown in FIG. 5, a much larger size infrared light source 130-1 may be used, which may be more advantageous for providing high transmit power.
Accordingly, in the position for disposing the infrared light source 130-1 in fig. 1, another infrared receiving unit 130-2 may be disposed as shown in fig. 5. In other embodiments, no element may be disposed at this position.
In another embodiment, the display panel may not be provided with the support layer 170, and the infrared light source 130-1 may be attached to the surface of the lower substrate 110 away from the light emitting surface by, for example, adhesion. In addition, another covering layer may be further disposed to cover the infrared light source 130-1 on the surface of the lower substrate 110 away from the light emitting surface. The absence of a support layer reduces the thickness of the overall panel structure, and even with a cover layer, the thickness can be significantly reduced because there is no need to provide a support for the infrared light source by the support layer 170. In another embodiment, the infrared light source 130-1 may be embedded into the surface of the lower substrate 110 away from the light emitting surface, so as to further reduce the thickness of the panel.
Fig. 6 further illustrates a structure diagram of a display panel 600 according to another embodiment of the present disclosure.
As shown in fig. 6, the display panel 600 includes a lower substrate 110, a sub-pixel array 120, an infrared light source 130-1, an infrared receiving unit 130-2, a micro lens 150, and a light blocking layer 180. In addition, the display panel 100 further includes an upper substrate 140 covering the sub-pixel array 120 and the infrared receiving unit 130-2, and a support layer 170 for supporting the infrared light source 130-1 and the micro lens 150.
It should be noted that although the embodiment in fig. 6 shows that the display panel 600 includes both the microlenses 150 and the light-shielding layer 180, it should be understood that the arrangement of the microlenses 150 and the light-shielding layer 180 is not relevant, and in other embodiments, only one of them may be provided.
The micro lens 150 is disposed between the lower substrate 110 and the infrared light source 130-1. Microlenses 150 are arranged in correspondence with infrared light sources 130-1, whose orthographic projection on lower substrate 110 at least partially coincides with the orthographic projection of infrared light sources 130-1 on lower substrate 110.
The light shielding layer 180 is disposed on a surface of the lower substrate 110 near the light emitting surface. In one embodiment, as schematically shown in fig. 6, the light shielding layer 180 is disposed only at a position where the infrared receiving unit 130-2 is to be disposed. Further, the infrared receiving unit 130-2 is disposed on the light shielding layer 180.
The light shielding layer 180 can prevent the infrared receiving unit 130-2 from receiving the infrared light (emitted from the infrared light source 130-1) incident from the bottom, thereby generating an erroneous response signal. The light shielding layer 180 may be implemented by a black matrix, and may be any opaque metal or non-metal material. With this embodiment, it is ensured that the infrared light received by the infrared receiving unit 130-2 is all from the light exit surface side, so that the light intensity of the light actually reflected by the external object can be sensed more accurately.
Fig. 7 shows a block diagram of a unit for implementing a ranging function in a display panel according to an embodiment of the present disclosure.
As shown in fig. 7, the display panel is arranged with ranging units 1-1, 1-2, …, 4-1, and 4-2 for ranging. These ranging units are electrically connected to the controller 710, respectively. The controller 710 is for receiving time information from the ranging unit and transmitting a control signal to the ranging unit. Based on the received time information, the controller 710 can calculate the distance of the external object from the display panel.
In one embodiment, the controller 710 determines whether the intensity of the infrared light received by the infrared receiving unit in the ranging unit reaches an intensity threshold, and performs the distance calculation only when the intensity reaches the intensity threshold. It is noted that in the case where a plurality of infrared receiving units are included in the ranging unit, the infrared light receiving intensities of the different receiving units are generally different, and at this time, the intensity data should be processed by an appropriate statistical method to determine the infrared receiving unit receiving intensity to be compared with the intensity threshold. For example, in one embodiment, the maximum value of the infrared light reception intensity of each infrared receiving unit may be compared with an intensity threshold, i.e., the distance calculation is started when one of the infrared receiving units reaches a threshold criterion. In another embodiment, the average value of the infrared light receiving intensity of each infrared receiving unit may be compared with an intensity threshold, i.e., the distance calculation is started when each infrared receiving unit reaches the threshold criterion on average.
Fig. 8 shows a flow diagram of a method 800 for ranging an external object using a display panel according to an embodiment of the present disclosure. The method 800 may be implemented by the controller 710 or any external processing unit described in fig. 7.
In step S810, the infrared light source in the distance measuring unit on the display panel is controlled to emit infrared light vertically from the light emitting surface.
In step S820, the infrared receiving unit in the ranging unit on the control display panel receives the infrared light reflected from the external object.
In step S830, a distance from the light emitting surface of the display panel to the external object is calculated based on a time difference from when the infrared light is emitted from the infrared light source to when the infrared light is received by the infrared receiving unit.
For example, assuming that the time difference is Δ t, the distance d may be calculated as:
d＝c×Δt/2，
where c is the speed of light.
Considering that in some cases (for example, when the infrared light source is located on the back side of the substrate), the infrared light source emitting light may be located at a certain distance from the light emitting surface, and when the object to be measured is closer to the display panel, a large error may be caused to the measurement result. Thus, the distance formula can be changed to:
d＝c×Δt/2+d0，
where d0 is the distance constant and c is the speed of light.
It should be noted that in the case where the distance measuring unit includes a plurality of infrared receiving units, there may be a difference in the time when the infrared light is received by the different receiving units, and at this time, the data should be processed by an appropriate statistical method to determine the infrared receiving time to be used. For example, in one embodiment, the maximum value and the minimum value of the infrared receiving times of the respective infrared receiving units may be eliminated, and the remaining infrared receiving time values may be averaged.
When the distance measurement is performed as above, the infrared light from the infrared light source in one distance measurement unit may be diffusely reflected to the infrared receiving unit of the other distance measurement unit and received by the infrared receiving unit to generate an erroneous response signal. Although the intensity threshold may be set as above and the distance calculation is performed only when the intensity threshold is exceeded, when the external object is sufficiently far away from the display panel, the sum of the intensities of the interference signals from different ranging units may exceed the intensity threshold, affecting the measurement result.
It is also desirable to note that, in the present embodiment, in the case where a plurality of ranging units are present on the display panel and the infrared receiving unit is shared between different ranging units, as described above, it may also be defined that the ranging units sharing the infrared receiving unit cannot be simultaneously activated for distance measurement to provide a more accurate measurement result. In particular, in this common case, the individual ranging units may be activated by way of example as follows:
determining a degree of multiplexing M of the common infrared receiving units (i.e., each infrared receiving unit is shared by M different ranging units) (note that the degree of multiplexing of the infrared receiving units at the boundary may be low, and it is still considered here that the degree of multiplexing is M, except that the infrared light source that partially multiplexes the infrared receiving units is not arranged on the panel);
dividing a measurement cycle (e.g., one or more frames, or 1 second, etc.) into M periods;
dividing the infrared light sources in each distance measuring unit into a plurality of groups, wherein each infrared light source in each group shares one infrared receiving unit, and the infrared light sources sharing the infrared receiving unit are all included in the group (generally, each group comprises M infrared light sources, but the number of the infrared light sources in the edge family is less than M);
numbering each infrared light source in each group of infrared light sources;
one infrared light source in each group is activated in each of the M periods, respectively, by number (for the groups at the edges, where the number of infrared light sources may be less than M, then none of the infrared light sources are activated for some periods).
Taking the layout shown in fig. 3C as an example, the degree of multiplexing of the infrared receiving unit is 4, thereby dividing the measurement cycle into 4 periods. Then, the infrared light sources are grouped, each group includes 4 infrared light sources, in fig. 3C, the 4 infrared light sources 130-1 in the circle may be grouped into one group, the four infrared light sources 130-1 share the infrared receiving unit located at the center of the circle, and all the infrared light sources sharing the infrared receiving unit are in the group. The four infrared light sources may be numbered, for example, the four infrared light sources of upper, right, lower, and left may be numbered 1, 2, 3, and 4, respectively. Thus, the four infrared light sources can be activated in the 4 periods respectively in the order of the numbers. Similar operations are performed in other infrared light source groups.
The activation mode ensures that different infrared light sources sharing the infrared receiving unit are not activated at the same time, thereby obtaining more accurate measurement results.
Fig. 9 shows a flowchart of a method 900 for ranging an external object using a display panel according to another embodiment of the present disclosure. Likewise, the method 900 may be implemented by the controller 710 shown in fig. 7.
In step S910, the ranging units on the display panel are divided into at least one group.
In one embodiment, the same number of ranging units is included in each group of ranging units.
In one embodiment, the individual ranging units in each group may be adjacently located multiple ranging units.
In one embodiment, the respective ranging units in each group may be assigned sequence numbers such that the distance between ranging units with the same sequence number in each group is greater than a distance threshold (e.g., the first threshold).
Taking the grouping case in fig. 10 as an example, an example of grouping the ranging units on the display panel is shown in fig. 10.
Although each of the ranging units is shown as an arrangement of 3 ×, the technical solution of the present application is not limited thereto, and in other embodiments, the ranging units may be grouped in other arrangements, in general, the farther the distance between the external object and the display panel is, the more the reflected light is dispersed, and the larger the coverage of each group is (i.e., more ranging units are included, such as a 4 × arrangement which is larger compared to the 3 × arrangement in fig. 10).
In each group of ranging units, the 9 ranging units may be sorted into the first to ninth units in order of, for example, upper left, upper right, upper left, middle left, lower right. It can be seen that the distance between the ranging units with the same serial number in each group is enlarged by 3 times compared with that without grouping, and interference can be better avoided.
It should be noted that although each ranging unit is shown as a separate and distinct block in fig. 10, this is a schematic diagram provided for convenience of illustration, and it should be understood that fig. 10 covers the case where adjacent ranging units share the infrared receiving unit.
In step S920, for each group of ranging units, the respective ranging units are activated in turn to perform the steps of emitting infrared light and receiving infrared light (i.e., steps S810 and S820 in method 800).
Referring to fig. 11, fig. 11 is a schematic diagram illustrating that the ranging units in each group are sequentially activated for ranging in the example of fig. 10.
As can be seen from fig. 11, the first ranging unit (i.e., the top left ranging unit) in each group of ranging units is activated for transmission and reception, the second ranging unit (i.e., the top ranging unit) in each group of ranging units is activated for transmission and reception, and so on, and the ninth ranging unit (i.e., the bottom right ranging unit) in each group of ranging units is activated for transmission and reception.
In this way, all the ranging units perform the measurement step. The length of time for performing ranging may be divided into equal parts (e.g., 9 equal parts in the structure shown in fig. 10) according to the number of ranging units in each group, and transmission and reception may be performed for the ranging units of a particular rank in each group in each equal part of time.
In step S930, a distance from the light exit surface of the display panel to the external object is calculated for each ranging unit. This step corresponds to S920 in fig. 8, and is not described herein again.
It should be appreciated that in other embodiments, step S930 may be absorbed into step S920, i.e., the steps of transmitting, receiving, and calculating (i.e., performing method 800) are performed in sequence for the respective ranging units in each group in step S920.
In one embodiment, after step S930, distance information of the external object with respect to the display panel may also be determined according to the distance measured by each ranging unit. The distance information may include, for example, a distance map, a depth map, a three-dimensional surface profile map, and the like.
In the embodiment shown in fig. 9, additional consideration should also be given to step S920 in the case where a common infrared receiving unit is present. In one case, the ranging units with the same rank in different groups of ranging units are not adjacent, which already ensures that the ranging units sharing the infrared receiving unit are not activated at the same time. In another case, the ranging units having the same rank in different groups of ranging units are adjacent and share the infrared receiving unit, and in step S920, the adjacent ranging units should be activated at different time intervals when the ranging units having a certain rank are activated.
While the present disclosure has been described with reference to several exemplary embodiments, it is understood that the terminology used is intended to be in the nature of words of description and illustration, rather than of limitation. As the present disclosure may be embodied in several forms without departing from the spirit or essential characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, but rather should be construed broadly within its spirit and scope as defined in the appended claims, and therefore all changes and modifications that fall within the meets and bounds of the claims, or equivalences of such meets and bounds are therefore intended to be embraced by the appended claims.
Claims (15)
1. A display panel, comprising:
a lower substrate;
the sub-pixel array is positioned on the surface of the lower substrate close to the light-emitting surface of the display panel; and
at least one ranging unit, each ranging unit comprising: an infrared light source and at least one infrared receiving unit, wherein the infrared light source is used for vertically emitting infrared light from the light emitting surface, the infrared receiving unit is used for receiving the infrared light from the light emitting surface,
the at least one infrared receiving unit is arranged on the surface of the lower substrate close to the light emitting surface and is positioned between adjacent sub-pixels in the sub-pixel array.
2. The display panel of claim 1, wherein a distance between the at least one infrared receiving unit and the infrared light source is less than a first threshold.
3. The display panel of claim 1, wherein the infrared light source is disposed on the lower substrate between adjacent subpixels in the subpixel array.
4. The display panel of claim 3, wherein the infrared light source and the infrared receiving unit are arranged between different sub-pixels.
5. The display panel of claim 3, further comprising: and the at least one micro lens is arranged on the surface, close to the light-emitting surface, of the sub-pixel array corresponding to the infrared light source in the at least one distance measuring unit, and the orthographic projection of each micro lens on the lower substrate is at least partially overlapped with the orthographic projection of the infrared light source corresponding to the micro lens on the lower substrate.
6. The display panel of claim 5, wherein an orthographic projection of the microlens on the lower substrate does not have a portion overlapping with an orthographic projection of any infrared receiving unit on the lower substrate.
7. The display panel of claim 1, wherein the infrared light source is disposed on a side of the lower substrate away from the light exit surface.
8. The display panel of claim 7, further comprising: at least one micro lens, which is arranged between the lower substrate and the infrared light source corresponding to the infrared light source in the at least one distance measuring unit, wherein the orthographic projection of each micro lens on the lower substrate at least partially coincides with the orthographic projection of the infrared light source corresponding to the micro lens on the lower substrate.
9. The display panel of claim 7, further comprising: a light shielding layer disposed on a surface of the lower substrate near the light emitting surface, wherein the infrared receiving unit is disposed on the light shielding layer.
10. The display panel according to claim 9, the light shielding layer being arranged in one-to-one correspondence with the infrared receiving units.
11. The display panel of claim 1, wherein the infrared receiving unit is a photosensitive sensor.
12. The display panel of claim 1, wherein the display panel comprises a plurality of ranging units, each ranging unit sharing one or more infrared receiving units with at least one other ranging unit, respectively.
13. The display panel of claim 1, further comprising: and the controller is electrically connected with the at least one ranging unit and used for receiving the time information from the at least one ranging unit and sending a control signal to the at least one ranging unit.
14. A method of ranging an external object using the display panel of any one of claims 1-13, comprising:
controlling an infrared light source in the at least one distance measuring unit to vertically emit infrared light from the light emitting surface;
controlling an infrared receiving unit of the at least one ranging unit to receive infrared light reflected from the external object;
calculating a distance from a light exit surface of the display panel to the external object based on a time difference from when the infrared light is emitted from the infrared light source to when the infrared light is received by the infrared receiving unit.
15. The method of claim 14, further comprising:
dividing at least one ranging unit on the display panel into at least one group;
in each group, sequentially activating each ranging unit to execute the steps of emitting infrared light and receiving infrared light; and
calculating, for each ranging unit, a distance from a light exit surface of the display panel to the external object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810379015.1A CN108594249B (en) | 2018-04-25 | 2018-04-25 | Display panel and method for measuring distance of external object by using same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810379015.1A CN108594249B (en) | 2018-04-25 | 2018-04-25 | Display panel and method for measuring distance of external object by using same |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108594249A CN108594249A (en) | 2018-09-28 |
| CN108594249B true CN108594249B (en) | 2020-07-28 |
Family
ID=63609268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810379015.1A Active CN108594249B (en) | 2018-04-25 | 2018-04-25 | Display panel and method for measuring distance of external object by using same |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108594249B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11397475B2 (en) | 2019-01-14 | 2022-07-26 | Boe Technology Group Co., Ltd. | Display device, electronic device and method for driving display device |
| JP7366558B2 (en) * | 2019-03-13 | 2023-10-23 | 株式会社東芝 | Sensor and distance measuring device |
| CN109901324A (en) * | 2019-03-27 | 2019-06-18 | 京东方科技集团股份有限公司 | Display panel, gesture identification display device, recognition methods and readable storage medium storing program for executing |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2830839B2 (en) * | 1996-05-10 | 1998-12-02 | 日本電気株式会社 | Distance measuring device |
| DE10008240A1 (en) * | 1999-02-24 | 2000-10-05 | Denso Corp | Semiconductor light projector has several light emitting devices projecting light towards a projection surface |
| DE102007038528A1 (en) * | 2007-08-16 | 2009-02-19 | Robert Bosch Gmbh | Laser rangefinders |
| CN101567153A (en) * | 2009-06-05 | 2009-10-28 | 天津三星电子显示器有限公司 | Display integrated with distance measurement function |
| CN101751209A (en) * | 2008-11-28 | 2010-06-23 | 联想(北京)有限公司 | Method and computer for adjusting screen display element |
| CN103323980A (en) * | 2012-03-23 | 2013-09-25 | 株式会社日本显示器西 | Display device and electronic device |
| CN105093618A (en) * | 2015-08-06 | 2015-11-25 | 京东方科技集团股份有限公司 | Display substrate and preparation method thereof and display panel |
| CN105511132A (en) * | 2015-11-30 | 2016-04-20 | 友达光电股份有限公司 | Display with switchable viewing angle and operation method thereof |
| CN205670419U (en) * | 2016-06-15 | 2016-11-02 | 京东方科技集团股份有限公司 | A kind of virtual curved face display floater and display device |
| CN106950630A (en) * | 2017-05-22 | 2017-07-14 | 京东方科技集团股份有限公司 | A kind of grating and 3 d display device |
| CN206421276U (en) * | 2017-01-18 | 2017-08-18 | 张一帆 | One kind full screen display terminal |
| CN107479760A (en) * | 2017-09-22 | 2017-12-15 | 京东方科技集团股份有限公司 | Array base palte and preparation method thereof, display panel and display system |
| CN107608454A (en) * | 2017-08-31 | 2018-01-19 | 广东欧珀移动通信有限公司 | Display screen and electronic equipment |
| CN206961140U (en) * | 2017-03-24 | 2018-02-02 | 敦捷光电股份有限公司 | Has the display of biological characteristic identification function |
| CN107706223A (en) * | 2017-09-29 | 2018-02-16 | 京东方科技集团股份有限公司 | OLED shows structure and display, space point positioning system and method |
-
2018
- 2018-04-25 CN CN201810379015.1A patent/CN108594249B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2830839B2 (en) * | 1996-05-10 | 1998-12-02 | 日本電気株式会社 | Distance measuring device |
| DE10008240A1 (en) * | 1999-02-24 | 2000-10-05 | Denso Corp | Semiconductor light projector has several light emitting devices projecting light towards a projection surface |
| DE102007038528A1 (en) * | 2007-08-16 | 2009-02-19 | Robert Bosch Gmbh | Laser rangefinders |
| CN101751209A (en) * | 2008-11-28 | 2010-06-23 | 联想(北京)有限公司 | Method and computer for adjusting screen display element |
| CN101567153A (en) * | 2009-06-05 | 2009-10-28 | 天津三星电子显示器有限公司 | Display integrated with distance measurement function |
| CN103323980A (en) * | 2012-03-23 | 2013-09-25 | 株式会社日本显示器西 | Display device and electronic device |
| CN105093618A (en) * | 2015-08-06 | 2015-11-25 | 京东方科技集团股份有限公司 | Display substrate and preparation method thereof and display panel |
| CN105511132A (en) * | 2015-11-30 | 2016-04-20 | 友达光电股份有限公司 | Display with switchable viewing angle and operation method thereof |
| CN205670419U (en) * | 2016-06-15 | 2016-11-02 | 京东方科技集团股份有限公司 | A kind of virtual curved face display floater and display device |
| CN206421276U (en) * | 2017-01-18 | 2017-08-18 | 张一帆 | One kind full screen display terminal |
| CN206961140U (en) * | 2017-03-24 | 2018-02-02 | 敦捷光电股份有限公司 | Has the display of biological characteristic identification function |
| CN106950630A (en) * | 2017-05-22 | 2017-07-14 | 京东方科技集团股份有限公司 | A kind of grating and 3 d display device |
| CN107608454A (en) * | 2017-08-31 | 2018-01-19 | 广东欧珀移动通信有限公司 | Display screen and electronic equipment |
| CN107479760A (en) * | 2017-09-22 | 2017-12-15 | 京东方科技集团股份有限公司 | Array base palte and preparation method thereof, display panel and display system |
| CN107706223A (en) * | 2017-09-29 | 2018-02-16 | 京东方科技集团股份有限公司 | OLED shows structure and display, space point positioning system and method |
Non-Patent Citations (1)
| Title |
|---|
| 测距仪与电子经纬仪的集成应用及关键技术;孟宏蕊;《万方数据》;20140715;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108594249A (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI667490B (en) | Optical imaging modules and optical detection modules including a time-of-flight sensor | |
| US20220137189A1 (en) | Method and device for optically measuring distances | |
| US11762073B2 (en) | Three-dimensional (3D) image sensors including polarizer, and depth correction methods and 3D image generation methods based on 3D image sensors | |
| CN108594249B (en) | Display panel and method for measuring distance of external object by using same | |
| US9006636B2 (en) | Radiation sensor | |
| KR20190069126A (en) | 3-dimensional finger print device and electronic device comprising the same | |
| US10578431B2 (en) | Optical sensor and optical sensor system | |
| US20120134598A1 (en) | Depth Sensor, Method Of Reducing Noise In The Same, And Signal Processing System Including The Same | |
| US10760953B2 (en) | Image sensor having beam splitter | |
| US11532657B2 (en) | Image sensor and imaging apparatus having the same | |
| EP3211453A1 (en) | Optical proximity sensor arrangement and method for producing an optical proximity sensor arrangement | |
| TWI754809B (en) | Image sensing device | |
| US20230352505A1 (en) | Optical crosstalk mitigation for a detector array in an optical receiver | |
| US10644070B2 (en) | Component for detecting electromagnetic radiation | |
| US20230117198A1 (en) | Photoelectric conversion apparatus having avalanche photodiode | |
| CN114467176A (en) | Image sensor, image processing method and device and imaging system | |
| CN111065936B (en) | Method and apparatus for optical distance measurement | |
| CN111052142B (en) | Fingerprint identification device and electronic equipment | |
| US20220291380A1 (en) | Semiconductor device | |
| CN217425686U (en) | Distance sensing device | |
| EP3977157B1 (en) | High spatial resolution solid-state image sensor with distributed photomultiplier | |
| JP2020161779A (en) | Light receiving device and range finding module | |
| KR102636878B1 (en) | LiDAR receiving unit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |