WO2021232370A1 - Affichage de capteur d'image et son procédé de fonctionnement - Google Patents

Affichage de capteur d'image et son procédé de fonctionnement Download PDF

Info

Publication number
WO2021232370A1
WO2021232370A1 PCT/CN2020/091633 CN2020091633W WO2021232370A1 WO 2021232370 A1 WO2021232370 A1 WO 2021232370A1 CN 2020091633 W CN2020091633 W CN 2020091633W WO 2021232370 A1 WO2021232370 A1 WO 2021232370A1
Authority
WO
WIPO (PCT)
Prior art keywords
photodetection elements
masks
pixels
image sensor
photodetection
Prior art date
Application number
PCT/CN2020/091633
Other languages
English (en)
Inventor
Kenichi Takatori
Original Assignee
Huawei Technologies Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co., Ltd. filed Critical Huawei Technologies Co., Ltd.
Priority to PCT/CN2020/091633 priority Critical patent/WO2021232370A1/fr
Priority to CN202080099674.5A priority patent/CN115398630A/zh
Publication of WO2021232370A1 publication Critical patent/WO2021232370A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10K—ORGANIC ELECTRIC SOLID-STATE DEVICES
    • H10K59/00—Integrated devices, or assemblies of multiple devices, comprising at least one organic light-emitting element covered by group H10K50/00
    • H10K59/60—OLEDs integrated with inorganic light-sensitive elements, e.g. with inorganic solar cells or inorganic photodiodes
    • H10K59/65—OLEDs integrated with inorganic image sensors

Definitions

  • the present invention relates to an image sensor display and a method of operation thereof.
  • Such a display device generally includes a display for displaying an image and a photodetection portion superimposed on the display for reading an image.
  • Such a conventional display device incorporating a photodetection portion comprises: a display comprising pixels for emitting light; a cover for protecting the display and allowing light emitted from the display toward the outside of the display device to transmit therethrough; and a photodetection potion superposed under the display, arranged opposite to the cover relative to the display, and comprising photodetection elements for detecting light.
  • the display emits light for displaying an image.
  • an object for example, a fingertip of a user
  • the display device can obtain a reflection pattern of the object, i.e., a surface shape of the object (for example, a fingerprint) from signals of light approaching the photodetection elements, an image sensor display integrating an image sensor therein can be realized.
  • Patent Document 1 proposes an image sensor display 201 providing a collimator 206 (for example, a collection of optical fibers) arranged between pixels 202 and photodetection elements 204 for limiting a direction of light 210 reflected on an object 212 as shown in Figure 8.
  • a collimator 206 for example, a collection of optical fibers
  • the collimator 206 increases the thickness of the image sensor display 201 and increases the cost.
  • Patent Document 1 PCT International Publication No. WO 2017/211152
  • the present invention provides an image sensor display with no additional optics or with only minimal optics to detect a shape of an object while preventing optical crosstalk, and provides a method of operation thereof.
  • a first embodiment of the present invention provides an image sensor display comprising: a plurality of pixels configured to emit light outside the image sensor display and arranged separately from each other in a matrix in a plan view; a plurality of photodetection elements configured to detect light emitted from the pixels and reflected from an object disposed outside the image sensor display, the plurality of photodetection elements being arranged in a matrix in gaps between the pixels in a plan view; and a plurality of masks arranged on a side from where light impinges the photodetection elements and at positions corresponding to one or more photodetection elements, the plurality of masks being made of a thin film reflecting or absorbing at least a portion of light impinging the photodetection elements, wherein the plurality of masks are separated from each other, and wherein the plurality of pixels are configured to emit light in a predetermined emission pattern in an image detection mode.
  • one of the plurality of masks may be arranged to overlap with only one of the plurality of photodetection elements in a plan view.
  • each of the masks may be arranged to overlap with each of the photodetection elements in an identical positional relationship in a plan view.
  • each of the masks may be arranged to overlap with each of the photodetection elements in different positional relationships in a plan view, and the positional relationships between the masks and the photodetection elements may be configured to have a predetermined pattern between the plurality of photodetection elements.
  • one of the plurality of the masks may be arranged to overlap with one column of photodetection elements among the plurality of photodetection elements in a plan view.
  • each of the masks may be arranged to overlap with each of the columns of the photodetection elements in an identical positional relationship in a plan view.
  • each of the masks may be arranged to overlap with each of the columns of the photodetection elements in different positional relationships in a plan view, and the positional relationships between the masks and the columns of the photodetection elements may be configured to have a predetermined pattern between the columns of the plurality of photodetection elements.
  • the plurality of pixels may be configured to emit light in an emission pattern changing over time in the image detection mode.
  • the plurality of pixels may be configured to emit light in an emission pattern of one or more lines along a row direction of the matrix arrangement and/or a column direction orthogonal to the row direction, in an emission pattern of one or more lines crossing at predetermined angles with respect to the row and column directions of the matrix arrangement, in an emission pattern of a plurality of dots together forming a discrete grid, or in an emission pattern of a plurality of dots together forming a discrete staggered grid, in the image detection mode.
  • the plurality of pixels may be configured to emit light in an identical or different emission pattern for each of a plurality of colors in the image detection mode.
  • a second embodiment of the present invention provides a method of operating an image sensor display, the image sensor display comprising: a plurality of pixels configured to emit light outside the image sensor display and arranged separately from each other in a matrix in a plan view; and a plurality of photodetection elements configured to detect light emitted from the pixels and reflected from an object disposed outside the image sensor display, the plurality of photodetection elements being arranged in a matrix in gaps between the pixels in an plan view, wherein the plurality of pixels are configured to emit light in a predetermined emission pattern in an image detection mode, and in the image detection mode, the method comprising steps of: causing the plurality of pixels to emit light in a predetermined emission pattern; causing the plurality of photodetection elements to detect a portion of the emitted light reflected on a surface of the object disposed outside the image sensor display; and detecting a surface shape of the object from the detected light.
  • the plurality of pixels may be configured to emit light in an emission pattern changing over time in the image detection mode.
  • the plurality of pixels may be configured to emit light in an emission pattern of one or more lines along a row direction of the matrix arrangement and/or a column direction orthogonal to the row direction, in an emission pattern of one or more lines crossing at predetermined angles with respect to the row and column directions of the matrix arrangement, in an emission pattern of a plurality of dots together forming a discrete grid, or in an emission pattern of a plurality of dots together forming a discrete staggered grid, in the image detection mode.
  • the plurality of pixels may be configured to emit light in an identical or different emission pattern for each of a plurality of colors.
  • the image sensor display may further comprise a plurality of masks arranged ono a side from where light impinges the photodetection elements and at positions corresponding to one or more photodetection elements, the plurality of masks being made of a thin film reflecting or absorbing at least a portion of light impinging the photodetection elements, wherein the plurality of masks are separated from each other.
  • one of the plurality of masks may be arranged to overlap with only one of the plurality of photodetection elements in a plan view.
  • each of the masks may be arranged to overlap with each of the photodetection elements in an identical positional relationship in a plan view.
  • each of the masks may be arranged to overlap with each of the photodetection elements in different positional relationships in a plan view, and the positional relationships between the masks and the photodetection elements may be configured to have a predetermined pattern between the plurality of photodetection elements.
  • one of the plurality of masks may be arranged to overlap with one column of photodetection elements among the plurality of photodetection elements in a plan view.
  • each of the masks may be arranged to overlap with each of the columns of the photodetection elements in an identical positional relationship in a plan view.
  • each of the masks may be arranged to overlap with each of the columns of the photodetection elements in different positional relationships in a plan view, and the positional relationships between the masks and the columns of the photodetection elements may be configured to have a predetermined pattern between the columns of the plurality of photodetection elements.
  • the plurality of pixels may be configured to emit light in an emission pattern changing over time in the image detection mode.
  • the embodiments of the present invention provide an image sensor display with no additional optics or with only minimal optics to detect a shape of an object while preventing optical crosstalk, and provides a method of operation thereof.
  • Figure 1 shows a schematic cross-sectional view of an image sensor display according to the first embodiment of the present invention.
  • Figure 2 shows a schematic enlarged view of the image sensor display shown in Figure 1.
  • Figure 3 shows a schematic cross-sectional view of a variation of the image sensor display shown in Figure 1.
  • Figure 4 shows a diagram schematically showing a method of operation of the image sensor display according to the first embodiment of the present invention.
  • Figure 5 shows a schematic plan view of the image sensor display according to an embodiment of the present invention.
  • Figure 6 shows an oblique view schematically showing a method of operation of the image sensor display according to the present invention.
  • Figure 7 shows a schematic diagram showing results obtained by the image sensor displays according to the embodiments of the present invention.
  • Figure 8 shows a schematic diagram of a conventional image sensor display.
  • Figure 1 shows a schematic cross-sectional view of an image sensor display 1 according to a first embodiment of the present invention.
  • Figure 2 shows a schematic enlarged view of the image sensor display 1 shown in Figure 1.
  • the image sensor display 1 comprises: a plurality of pixels 2 configured to emit light outside the image sensor display 1 and arranged in a matrix and in a way separated from each other in a plan view; and a plurality of photodetection elements 4 configured to detect light 16-1, 16-2 emitted from the pixels 2 and reflected on an object arranged outside, the plurality of photodetection elements 4 being arranged in gaps between the pixels 2 and in rows and columns of a matrix in a plan view.
  • a plurality of masks 14 may be arranged at positions corresponding to one or more of the photodetection elements 4 in a direction in which each light impinges on the photodetection element 4, the masks 14 being formed of a thin film reflecting or absorbing at least a portion of light 16-3 impinging on the photodetection elements 4. If the configuration not comprising the masks 14 is selected, it should be understood that the masks 14 shown in Figures 1 and 2 do not exist. It should be noted that Figures 1 and 2 show only one pixel 2, only one photodetection element 4 and only one mask 14 for the sake of simplicity.
  • any pixels known by those skilled in the art can be employed as the pixel 2.
  • a light emitting diode, an organic light emitting diode, or a liquid crystal pixel can be employed as the pixel 2.
  • Any photodetection elements known by those skilled in the art can be employed as a photodetection element 4.
  • a photodiode can be employed as the photodetection element 4.
  • the masks 14 are disposed at a distance from each other. Any light-reflecting or light-absorbing material known by those skilled in the art can be employed as a material of the mask 14. For example, a masking material that absorbs light, such as carbon back or a non-conductive black pigment, known by those skilled in the art, can be employed as the material of the mask 14.
  • the mask 14 is arranged to cover only a portion of the photodetection element 4 and is configured to prevent light 16-3 from a particular direction and to allow light 16-1, 16-2 from other directions to pass through toward the photodetection element 4.
  • a pixel electrode of the pixel 2 is connected to a display controlling circuit 6 through a via 10 and the photodetection element 4 is connected to a photodetection circuit 8 through a via 12.
  • the display controlling circuit 6 controls on/off states and patterns of emission of the pixel 2.
  • the photodetection circuit 8 processes signals transmitted by the photodetection element 4 in response to impinging light.
  • the photodetection element 4 may be arranged opposite to the outside of the image sensor display 1 with respect to the pixel 2.
  • the image sensor display 1 comprises: an electronic circuit layer 22 including the display controlling circuit 6 and the photodetection circuit 8; a photodetection element layer 20 including an array of the photodetection elements 4; a pixel layer 18 including an array of the pixels 2; and a light-transmissive protective layer 26 for protecting these components of the image sensor display 1 and for emitting light from the pixel 2 to the outside of the image sensor display 1.
  • Other layers may be interposed between the above layers. The above layers may be also arranged in a different order.
  • Figure 3 shows a cross sectional view of an image sensor display 21 which is a variation example of the image sensor display 1 shown in Figure 1.
  • the mask 14 is arranged on the outermost layer of the image sensor display 21.
  • Such a configuration allows a larger distance between the mask 14 and the photodetection element 4 and therefore a smaller mask 14 can ensure a larger angle for blocking light impinging on the photodetection element 4.
  • the step of fabricating the mask 14 can be easily added to a conventional fabrication process.
  • Figure 4 shows a method of operation of the image sensor display 1 shown in Figures 1 and 2. Since the image sensor display 21 shown in Figure 3 is merely different from the image sensor display 1 in terms of the location of the mask 14, the image sensor display 21 can employ the same operation method.
  • Figure 4 (A) shows an exploded oblique view of the image sensor display 1.
  • Figure 4 (B) shows a state in which light 38 emitted from a pixel 2-1 irradiates an object 36 to be detected.
  • Figure 4 (C) shows a state in which the light 38 is reflected on the object 36 to impinge the photodetection element 4.
  • a plurality of pixels 2 are arranged on a pixel layer 18 in a matrix to form a pixel array 32.
  • a plurality of photodetection elements 4 are arranged on the photodetection element layer 20 in a matrix to form a photodetection element array 34.
  • Other components are not shown for the sake of simplicity.
  • Figure 4 (A) shows a pattern of the pixels 2-1 in predetermined columns emitting light.
  • Figures 4 (B) and 4 (C) show a configuration which does not comprise the masks 14.
  • Figure 4 (B) shows that the light 38 emitted from the pixel 2-1 irradiates the object 36 to be detected.
  • the object 36 is, for example, a surface of a finger of a user.
  • Figure 4 (C) shows that light 40-1 reflected in a particular direction among the light reflected from the object 36 impinges the photodetection element 4 without blocked.
  • the light 40-2 reflected in other directions is blocked by other elements, such as the pixel 2 and therefore does not reach the photodetection element 4.
  • Figures 4 (D) and 4 (E) show a configuration which comprises the masks 14.
  • Figure 4 (D) shows that the light emitted from the pixel 2-1 irradiates the object 36 to be detected.
  • the object 36 is, for example, a surface of a finger of a user.
  • Figure 4 (E) shows that light 40-1 reflected in a particular direction among the light reflected from the object 36 impinges the photodetection element 4 without blocked by the mask 14.
  • the light 40-2 reflected in other directions is blocked by the mask 14 and therefore does not reach the photodetection element 4.
  • mapping of a depth direction of the object 36 becomes easier. If light emitted from a particular pixel 2-1 is reflected on a portion of the surface of the object which is close to the image sensor display, the reflected light impinges a photodetection element 4 which is close to the pixel 2-1. On the other hand, if light emitted from the same pixel 2-1 is reflected on a portion of the surface of the object 36 which is far from the image sensor display, the reflected light may impinge a photodetection element 4 which is far from the pixel 2-1.
  • the pixel array 32 can be configured to emit light in an emission pattern which varies over time.
  • a column of emitting pixels 2-1 may vary over time to move in a direction orthogonal to the column (in a row direction) .
  • the light 38 emitted from the pixel 2-1 shown in Figures 4 (B) and 4 (D) irradiates the object 36 from different directions over time. Therefore, the directions of light 40-1 and 40-2 reflected by the object 36 also vary over time, and the position of the photodetection element 4, which the reflected light 40-1 impinges, also varies over time.
  • the surface of the object 36 is scanned by the light 38 with a change of the pattern of the emitting pixels 2-1, the surface shape of the object 36 can be accurately detected in two dimensions. If the emission pattern does not vary over time, it may be impossible to acquire a portion of the image because a portion of the reflected light is blocked by other elements such as the pixel 2 or the mask 14. However, by varying the emission pattern over time, a more complete image can be obtained by complementing the portion of the image which could not be acquired.
  • Figure 5 shows a plan view showing a positional relationship between photodetection elements 4 of a photodetection element array 34 and masks 14. For the sake of simplicity, components other than the photodetection elements 4 and the masks 14 are not shown.
  • the photodetection elements 4 are arranged in row and column directions of a matrix.
  • Figure 5 (A) shows a configuration in which one linear mask 14 is arranged to overlap with a plurality of photodetection elements 4 arranged in one column in a plan view.
  • Each mask 14 overlaps with each row of the photodetection elements 4 in the identical positional relationship.
  • each mask 14 overlaps with the photodetection elements 4 at portions in the vicinity of right sides of the photodetection elements 4.
  • Such a positional relationship between the mask 14 and the photodetection elements 4 is, for example, suitable for detection of an object 36 having a surface shape with a larger spatial frequency in a row direction and a smaller spatial frequency in a column direction.
  • Such an object may be, for example, a finger of a user arranged such that a direction of grooves of a fingerprint is aligned parallel to the column direction of the photodetection element array 34.
  • Figure 5 (B) shows a configuration in which only one of the masks 14 overlaps with only one of the photodetection elements 4 in a plan view.
  • the masks 14 overlap with the photodetection elements 4 in the identical positional relationship, respectively.
  • the masks 14 overlap with the photodetection elements 4 in the vicinity of lower right corners of the photodetection elements 4, respectively.
  • Such a positional relationship between the masks 14 and the photodetection elements 4 is, for example, suitable for detection of an object 36 having a surface shape with large spatial frequencies in both of the row and column directions.
  • Such an object 36 may be, for example, a finger of a user arranged such that a direction of grooves of a fingerprint is aligned at a given angle with respect to both of the row and column directions of the photodetection element array.
  • Other examples of such an object 36 may be, for example, an iris pattern in an eye of the user or a face of the user.
  • Figure 5 (C) shows a configuration in which one linear mask 14 overlaps with a plurality of photodetection elements 4 arranged in one column in a plan view. Unlike the configuration shown in Figure 5 (A) , each mask 14 overlaps with each column of the photodetection elements 4 in a different positional relationship in a plan view, and the positional relationship between the masks 14 and the photodetection elements 4 has a given pattern between a plurality of columns of the photodetection elements 4. For example, in Figure 5 (C) , the mask 14 is arranged to overlap with the photodetection elements 4 in the vicinity of the right sides of the photodetection elements 4 in the leftmost column of the photodetection elements 4.
  • the mask 14 is arranged to overlap with the photodetection elements 4 on the right sides of the centers of the photodetection elements 4.
  • the mask 14 is arranged to overlap with the photodetection elements 4 on the left sides of the centers of the photodetection elements 4.
  • the mask 14 is arranged to overlap with the photodetetion elements 4 in the vicinity of the left sides of the photodetection elements 4.
  • the relationship between the masks 14 and the columns of the photodetection elements 4 may have a predetermined pattern between the plurality of columns of the photodetection elements 4.
  • a positional relationship between the masks 14 and the photodetection elements 4 is, for example, suitable for detection of an object 36 having a surface shape with a larger spatial frequency in a row direction and a smaller spatial frequency in a column direction similarly to the photodetection element array 34 shown in Figure 5 (A) .
  • Such an object may be, for example, a finger of a user arranged such that a direction of grooves of a fingerprint is aligned parallel to the column direction of the photodetection element array 34.
  • a predetermined pattern of a positional relationship may reduce a moiré phenomenon which occurs when an object 36 having a surface shape with a constant cycle is detected.
  • Figure 5 (D) shows a configuration in which one of the masks 14 overlaps with only one of the photodetection elements 4 in a plan view. Unlike the configuration shown in Figure 5 (B) , each of the masks 14 overlaps with each of the photodetection elements 4 with a different positional relationship in a plan view, respectively, and the positional relationship between the masks 14 and the photodetection elements 4 is configured to have a predetermined pattern between a plurality of photodetection elements 4.
  • the masks 14 are arranged in the vicinity of the lower sides of the photodetection elements 4 in a positional relationship in the column direction, and the masks 14 are arranged in the vicinity of the right side, right side of the center, left side of the center, and the vicinity of the left side of the photodetection elements 4, respectively, in order from the uppermost photodetection element 4 in a positional relationship in the row direction.
  • the masks 14 are arranged on the lower sides of the centers of the photodetection elements 4, respectively, in a positional relationship in the column direction, and the marks 14 are arranged in the vicinity of the right side, right side of the center, left side of the center, and the vicinity of the left side of the photodetection elements 4, respectively, in order from the uppermost photodetection element 4 in a positional relationship in the row direction similarly to the photodetection elements 4 in the leftmost column.
  • the masks 14 are arranged on the upper sides of the centers of the photodetection elements 4, respectively, in a positional relationship in the column direction, and the masks 14 are arranged in the vicinity of the right side, right side of the center, left side of the center, and the vicinity of the left side of the photodetection elements 4, respectively, in order from the uppermost photodetection element 4 in a positional relationship in the row direction similarly to the photodetection elements 4 in the leftmost column and the second column from the left.
  • the masks 14 are arranged in the vicinity of the upper side of the photodetection elements 4, respectively, in a position relationship in the column direction, and the masks 14 are arranged in the vicinity of the right side, right side of the center, left side of the center, and the vicinity of the left side of the photodetection elements 4, respectively, in order from the uppermost photodetection element 4 in a positional relationship in the row direction similarly to the photodetection elements 4 in the other columns.
  • the positional relationship between the masks 14 and the photodetection elements 4 has a predetermined pattern.
  • a positional relationship between the masks 14 and the photodetection elements 4 is, for example, suitable for detection of an object 36 having a surface shape with large spatial frequencies in both of the row and column directions.
  • an object 36 may be, for example, a finger of a user arranged such that a direction of grooves of fingerprint is aligned at a predetermined angle with respect to both of the row and column directions of the photodetection element array.
  • Such an object 36 may be, for example, an iris pattern of an eye of a user and a face of a user.
  • a predetermined pattern of the positional relationship may, for example, reduce the moiré phenomenon which occurs when an object 36 having a surface shape with a constant cycle is detected.
  • patterns having various positional relationships repeated at a given period and in a given direction, respectively, are also possible, in addition to the positional relationships between the masks 14 and the photodetection elements 4 shown in Figure 5.
  • the masks 14 can be arranged at a given angle with respect to the columns of the photodetection elements 4.
  • Figure 5 (C) shows the pattern having the period of every four columns
  • Figure 5 (D) shows the pattern having the period of four rows and four columns
  • other periods, for example, every three columns and every five columns are also possible.
  • the shape of the masks 14 and the positional relationship between the masks 14 and the photodetection elements 4 allow a preferable detection of a surface shape of an object by combining an emission pattern of the pixel array 32 as discussed below.
  • Figure 6 shows an oblique view schematically showing various emission patterns of the pixel array 32 in the image detection mode.
  • components other than the photodetection elements 4 and the masks 14 are not shown in the figures.
  • Figure 6 (A) shows an emission pattern in the image detection mode, in which pixels 2-1 in two columns emit light in a linear pattern and other pixels 2 do not emit light.
  • the number of the columns of the emitting pixels 2-1 is not limited to two, and for example, may be one column or three or more columns.
  • the emission pattern may change such that the emitting column moves, for example, in the row direction over time.
  • Such an emission pattern is suitable for detection of, for example, an object 36 having a surface shape with a larger spatial frequency of a change in the row direction and a smaller spatial frequency of a change in the column direction.
  • Such an object 36 may be, for example, a figure of a user arranged such that a direction of grooves of a fingerprint is aligned parallel to the column direction of the photodetection element array 34.
  • Figure 6 (B) shows an emission pattern in the image detection mode, in which pixels 2-1 in two rows emit light in a linear shape and other pixels 2 do not emit light.
  • the number of the rows of the emitting pixels 2-1 is not limited to two, and may be one row or three or more rows.
  • the emission pattern may change such that the emitting row moves, for example, in the column direction over time.
  • Such an emission pattern is suitable for detection of, for example, an object 36 having a surface shape having a larger spatial frequency of a change in the column direction and a smaller spatial frequency of a change in the row direction.
  • Such an object 36 may be, for example, a finger of a user arranged such that a direction of grooves of a fingerprint is aligned parallel to the row direction of the photodetection array 34.
  • Figure 6 (C) shows an emission pattern in the image detection mode, in which pixels 2-1 in two rows and two columns emit light in a linear shape and other pixels 2 do not emit light.
  • the numbers of the rows and columns of the emitting pixels 2-1 are not limited to two, and may be one row and one column or three or more rows and columns.
  • the emission pattern may change such that the pattern moves, for example, in the column and/or row direction over time.
  • Such an emission pattern is suitable for detection of, for example, an object 36 having a surface shape with large spatial frequencies of changes in both of the row and column directions.
  • Such an object 36 may be, for example, a finger of a user arranged such that a direction of grooves of a fingerprint is aligned at given angles with respect to the row and column directions of the photodetection array 34.
  • Other examples of such an object 36 may be, for example, an iris pattern of an eye of a user and a face of a user.
  • Figure 6 (D) shows an emission pattern in the image detection mode, in which pixels 2-1 emits light in one or more lines crossing at given angles with respect to both of the row and column directions of the pixel array 32 of which pixels are disposed in matrix, and in which other pixels 2 do not emit light.
  • the number of the lines of the emitting pixels 2-1 is not limited to four lines shown in the figure, and may be other numbers.
  • the emission pattern may change such that the lines of the pattern moves, for example, in a direction perpendicular to the line shaped emission pattern, the row direction, or the column direction over time.
  • Such an emission pattern is suitable for detection of, for example, an object 36 having a surface shape with large spatial frequencies of a change in both of the row and column directions.
  • Such an object 36 may be, for example, a finger of a user arranged such that a direction of grooves of a fingerprint is aligned at given angles with respect to the row and column directions of the photodetection array 34.
  • Other examples of such an object 36 may be, for example, an iris pattern of an eye of a user and a face of a user.
  • Figure 6 (E) shows an emission pattern in the image detection mode, in which pixels 2-1 emit light in a pattern having a plurality of dots which together form a discrete grid across the pixel array 32, and other pixels 2 do not emit light.
  • the distance between the dots of the pattern of the pixels 2-1 is not limited to the distance shown in Figure 6 (E) , and may be other distances.
  • the emission pattern may change such that the pattern moves, for example, in the row direction, the column direction, or other directions over time.
  • Such an emission pattern is suitable for detection of, for example, an object 36 having a surface shape random in the row and column directions, or a surface shape which is difficult to preliminarily expect.
  • Such an object 36 may be, for example, a face of a user.
  • Figure 6 (F) shows an emission pattern in the image detection mode, in which pixels 2-1 emit light in a pattern having a plurality of dots which together form a discrete staggered grid across the pixel array, and other pixels 2 do not emit light.
  • the pixels 2-1 emitting light in a dot pattern in the first column may not be arranged in the same rows as the pixels 2-1 emitting light in a dot shape in the second column, and the pixels 2-1 emitting light in a dot pattern in the third column may be arranged in the same rows as the pixels 2-1 emitting light in the first column.
  • the distance between the dot pattern of the pixels 2-1 is not limited to the distance shown in Figure 6 (E) , and may be other distances.
  • the dot emission pattern of the pixels 2-1 shown in Figure 6 (E) has the staggered grid pattern in which the pixels 2-1 are arranged in the same rows for each of the two columns
  • the dot emission pattern may have other staggered patterns, for example, a staggered pattern in which the pixels 2-1 are arranged in the same rows for each of the three or four columns.
  • the emission pattern may change such that the pattern moves, for example, in the row direction, the column direction, or other directions over time.
  • Such an emission pattern is suitable for detection of, for example, an object 36 having a surface shape random in the row or column direction, or a surface shape which is difficult to preliminarily expect.
  • Such an object 36 may be, for example, a face of a user.
  • the emission pattern as shown in Figure 6 may more preferably detect a surface shape of an object 36 by combining the positional relationship between the masks 14 and the photodetection elements 4 as shown in Figure 5.
  • the image sensor display 1 of the present invention when the image sensor display 1 of the present invention is applied to a fingerprint detection on a screen of a smartphone, a user possibly holds a smartphone such that a longitudinal direction of the smartphone aligns a vertical direction to put a finger on the screen.
  • grooves of a fingerprint of the user are possibly aligned parallel to the longitudinal direction of the smartphone.
  • the surface shape of the finger of the user has a larger spatial frequency of a change in a direction perpendicular to the longitudinal direction of the smartphone (i.e., a short-handed direction) .
  • the masks 14 of the image sensor display 1 may be preferably the masks 14 having a line shape parallel to the longitudinal direction of the smartphone (for example, the masks shown in Figure 5 (A) or 5 (C) ) , and may be preferably arranged such that the masks 14 overlap with a portion of the columns of the photodetection elements 4 in a plan view.
  • the pixel array 32 may preferably emit light in an emission pattern having emission lines parallel to the longitudinal direction of the smartphone.
  • the image sensor display 1 of the present invention When the image sensor display 1 of the present invention is applied to a face identification or an iris pattern identification on a screen of a smartphone, shapes of a face and an iris pattern of a user have large spatial frequency of a change with respect to both of the longitudinal and short-handed directions of the smartphone. Therefore, a configuration, in which one of the masks 14 of the image sensor display 1 overlaps with one of the photodetection elements 4 in a plan view (for example, the masks shown in Figure 5 (B) or 5 (D) ) , may be preferable. Furthermore, the pixel array 32 may preferably emit light in a pattern shown in any one of Figures 6 (C) to 6 (F) .
  • the pixel array 32 may be configured such that the pixels 2 may emit light with different colors, and the same or different emission patterns for each of the plurality of colors over time in the image detection mode. For example, the pixel array 32 may emit red light to detect a surface shape of an object 36 in a first step. Then, the pixel array 32 may emit green light to detect the surface shape of the object 36 in a second step. The pixel array 32 may emit blue light to detect the surface shape of the object 36 in a third step. In this case, a difference between reflectance of the object 36 for each wavelength may be detected, and a composition of the object 36 may be detected by comparing the detection result with reference data.
  • the image sensor display may determine whether the object 36 is a finger of a user or, for example, a mold of a fingerprint copied on a resin by measuring the reflectance of the object 36 for each wavelength, and provide more secure fingerprint identification. Combination and number of colors to be used may be appropriately changed in response to types of an object to be detected or applications.
  • Figure 7 shows a schematic diagram of a simulation result obtained by an image sensor display according to an embodiment of the present invention.
  • An object having a stripe surface shape (areflecting pattern) was illuminated with a predetermined light emission pattern, and reflected light was detected to reconstruct an image of the object.
  • Figure 7 (A) all of the pixels emitted light and the image of the object was reconstructed from the reflected light according to a conventional method. However, a clear image could not be obtained.
  • Figure 7 (B) when the pixels emitted light in an emission pattern having a distance of 1 mm between lines, the ring surface shape of the object was reconstructed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Inorganic Chemistry (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Sustainable Development (AREA)
  • Image Input (AREA)

Abstract

La présente invention concerne un affichage de capteur d'image comprenant : une pluralité de pixels configurés pour émettre de la lumière à l'extérieur du dispositif d'affichage de capteur d'image et agencés séparément les uns des autres dans une matrice dans une vue en plan; une pluralité d'éléments de photodétection configurés pour détecter la lumière émise par les pixels et réfléchie par un objet disposé à l'extérieur du dispositif d'affichage de capteur d'image, la pluralité d'éléments de photodétection étant agencés dans une matrice dans des espaces entre les pixels dans une vue en plan; et une pluralité de masques disposés sur un côté à partir duquel la lumière frappe les éléments de photodétection et à des positions correspondant à un ou plusieurs éléments de photodétection, la pluralité de masques étant faits d'un film mince réfléchissant ou absorbant au moins une partie de la lumière frappant les éléments de photodétection, la pluralité de masques étant séparés les uns des autres, et la pluralité de pixels étant configurés pour émettre de la lumière selon un motif d'émission prédéterminé dans un mode de détection d'image.
PCT/CN2020/091633 2020-05-21 2020-05-21 Affichage de capteur d'image et son procédé de fonctionnement WO2021232370A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2020/091633 WO2021232370A1 (fr) 2020-05-21 2020-05-21 Affichage de capteur d'image et son procédé de fonctionnement
CN202080099674.5A CN115398630A (zh) 2020-05-21 2020-05-21 图像传感器显示器及其操作方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/091633 WO2021232370A1 (fr) 2020-05-21 2020-05-21 Affichage de capteur d'image et son procédé de fonctionnement

Publications (1)

Publication Number Publication Date
WO2021232370A1 true WO2021232370A1 (fr) 2021-11-25

Family

ID=78708995

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/091633 WO2021232370A1 (fr) 2020-05-21 2020-05-21 Affichage de capteur d'image et son procédé de fonctionnement

Country Status (2)

Country Link
CN (1) CN115398630A (fr)
WO (1) WO2021232370A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN208848221U (zh) * 2019-04-10 2019-05-10 深圳市汇顶科技股份有限公司 光学指纹识别装置和电子设备
CN110676274A (zh) * 2019-02-21 2020-01-10 友达光电股份有限公司 光感测器
US20200105841A1 (en) * 2018-10-01 2020-04-02 Lg Display Co., Ltd. Display apparatus including light receiving pixel area
US20200134284A1 (en) * 2019-07-31 2020-04-30 Xiamen Tianma Micro-Electronics Co., Ltd. Array substrate and display device
CN111106139A (zh) * 2019-11-22 2020-05-05 深圳阜时科技有限公司 光学式集成装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200105841A1 (en) * 2018-10-01 2020-04-02 Lg Display Co., Ltd. Display apparatus including light receiving pixel area
CN110676274A (zh) * 2019-02-21 2020-01-10 友达光电股份有限公司 光感测器
CN208848221U (zh) * 2019-04-10 2019-05-10 深圳市汇顶科技股份有限公司 光学指纹识别装置和电子设备
US20200134284A1 (en) * 2019-07-31 2020-04-30 Xiamen Tianma Micro-Electronics Co., Ltd. Array substrate and display device
CN111106139A (zh) * 2019-11-22 2020-05-05 深圳阜时科技有限公司 光学式集成装置

Also Published As

Publication number Publication date
CN115398630A (zh) 2022-11-25

Similar Documents

Publication Publication Date Title
EP3839808B1 (fr) Appareil de détection d'empreintes digitales et dispositif électronique
CN111095282B (zh) 指纹检测装置和电子设备
US11348359B2 (en) Display panel, display apparatus and method for fingerprint recognition
US11521419B2 (en) Display device and fingerprint recognition method
CN212848409U (zh) 光学感测系统和电子设备
US11455826B2 (en) Method for identifying fingerprint, fingerprint identification apparatus and electronic device
JP4995279B2 (ja) 液晶表示装置および電子機器
CN111523440B (zh) 屏下光学指纹识别装置
CN111801679B (zh) 指纹检测装置和电子设备
CN109146945B (zh) 一种显示面板及显示装置
KR20210018787A (ko) 광학 지문 장치 및 전자 기기
US11531430B2 (en) Fingerprint detection apparatus and electronic device
EP3971763B1 (fr) Appareil de reconnaissance d'empreintes digitales et dispositif électronique
CN111801684A (zh) 指纹检测的装置和电子设备
CN111598068B (zh) 指纹识别装置和电子设备
CN111052142B (zh) 指纹识别装置和电子设备
CN110832503B (zh) 光学指纹装置，电子设备和测量距离的方法
EP3789913A1 (fr) Appareil de détection d'empreintes digitales et dispositif électronique
WO2021232370A1 (fr) Affichage de capteur d'image et son procédé de fonctionnement
CN211180842U (zh) 指纹检测装置和电子设备
JP7564127B2 (ja) テクスチャ認識装置及び対向基板
CN111797731B (zh) 指纹识别模组及电子设备
CN111801688B (zh) 光学指纹装置和电子设备
CN210864750U (zh) 指纹检测装置和电子设备
WO2021258290A1 (fr) Dispositif de détection et dispositif électronique comprenant le dispositif de détection

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20936707

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20936707

Country of ref document: EP

Kind code of ref document: A1