WO2020215885A1 - Display device, and touch detection method and device - Google Patents

Display device, and touch detection method and device Download PDF

Info

Publication number
WO2020215885A1
WO2020215885A1 PCT/CN2020/076799 CN2020076799W WO2020215885A1 WO 2020215885 A1 WO2020215885 A1 WO 2020215885A1 CN 2020076799 W CN2020076799 W CN 2020076799W WO 2020215885 A1 WO2020215885 A1 WO 2020215885A1
Authority
WO
WIPO (PCT)
Prior art keywords
infrared
display device
light
infrared light
distance
Prior art date
Application number
PCT/CN2020/076799
Other languages
French (fr)
Chinese (zh)
Inventor
张平
王海生
丁小梁
王鹏鹏
曹学友
韩艳玲
李扬冰
邓立凯
王佳斌
陈博
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Publication of WO2020215885A1 publication Critical patent/WO2020215885A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412Digitisers structurally integrated in a display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/041012.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup

Definitions

  • the present disclosure relates to the display field, and in particular to a display device, a touch detection method and a device.
  • Three-dimensional space detection technology refers to a technology that uses machine vision to detect objects, surfaces, distances, and orientations in three-dimensional space.
  • the mobile terminal can use the three-dimensional space detection technology to detect the hand of the operator to realize functions such as three-dimensional touch and gesture recognition. .
  • the present disclosure provides a display device, a touch detection method and a device, which can realize a depth detection method with a simpler required structure.
  • the present disclosure provides a display device, which includes:
  • the sensing layer includes a number of infrared sensors distributed in the display area, the infrared sensor is used to detect a first distance, the first distance is infrared light from the infrared light source and in the to-be-detected The propagation distance of the infrared sensor after being reflected on the touch surface;
  • the optical structure layer is located on at least one side of the thickness direction of the sensing layer, and the optical structure layer includes a plurality of optical structures, and each of the optical structures is located in the thickness direction of a corresponding infrared sensor. On one side, the optical structure is used to limit the incident angle of infrared light reaching the corresponding infrared sensor.
  • the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device.
  • the infrared light source further includes a light-emitting control circuit respectively connected to each light-emitting element, and the light-emitting control circuit is configured to control the at least two light-emitting elements to emit light one by one in each detection period.
  • the display device further includes a touch circuit, and each of the infrared sensors is connected to the touch circuit,
  • the touch control circuit is used to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance and the receiving angle for each infrared sensor;
  • the second distance is the distance between the infrared sensor and the infrared light source
  • the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  • the display device includes an organic light-emitting layer, and the organic light-emitting layer includes a plurality of light-emitting patterns located in the display area;
  • each infrared sensor is located between the orthographic projections of two adjacent light-emitting patterns.
  • the orthographic projection of each infrared sensor is located between the orthographic projections of two adjacent light-emitting patterns.
  • the display device further includes a first substrate, a second substrate, and an organic light-emitting layer, and the organic light-emitting layer, the optical structure layer, and the sensing layer are on the first substrate. And the second substrate are sequentially stacked.
  • the infrared light source and the organic light-emitting layer are located in the same layer between the first substrate and the second substrate.
  • the display device further includes a first substrate, a second substrate, a third substrate, and an organic light-emitting layer, and the second substrate is located between the first substrate and the third substrate.
  • the organic light emitting layer is located between the first substrate and the second substrate, and the optical structure layer and the sensing layer are located between the second substrate and the third substrate.
  • the present disclosure also provides a touch detection method, the method including:
  • the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is the distance of infrared light from the infrared
  • the incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure.
  • the optical structure is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
  • the position at which the infrared light reaching the infrared sensor is reflected on the touch surface to be detected is determined by the first distance, the second distance, and the receiving angle;
  • the second distance is the distance between the infrared sensor and the infrared light source
  • the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  • the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device;
  • the providing infrared light illumination to the touch surface through an infrared light source includes:
  • each detection period controlling the at least two light-emitting elements to emit light one by one to obtain a detection result corresponding to each of the light-emitting elements;
  • the method further includes:
  • the detection results respectively corresponding to each of the light-emitting elements are integrated to obtain the detection results of the touch surface to be detected.
  • the present disclosure also provides a touch detection device, which includes:
  • a light emission control module for controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
  • the detection module is used to obtain a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors being distributed within the display area of the display device, and the first distance being infrared
  • the propagation distance of light from the infrared light source and reflected on the touch surface to be detected to reach the infrared sensor, the incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure , Each of the optical structures is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
  • a processing module configured to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance, and the receiving angle for each infrared sensor;
  • the second distance is the distance between the infrared sensor and the infrared light source
  • the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  • the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device;
  • the light emission control module is further used for:
  • each detection period controlling the at least two light-emitting elements to emit light one by one to obtain a detection result corresponding to each of the light-emitting elements;
  • the device further includes:
  • the integration module is used to integrate the detection results respectively corresponding to each of the light-emitting elements to obtain a complete detection result of the touch surface to be detected.
  • the present disclosure also provides a touch detection device, the device including:
  • a memory for storing executable instructions of the processor
  • the processor is configured to:
  • the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is the distance of infrared light from the infrared
  • the incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure.
  • the optical structure is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
  • the position at which the infrared light reaching the infrared sensor is reflected on the touch surface to be detected is determined by the first distance, the second distance, and the receiving angle;
  • the second distance is the distance between the infrared sensor and the infrared light source
  • the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  • the infrared light source, the sensing layer and the optical structure layer in the present disclosure can cooperate to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device .
  • the depth detection method provided by the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
  • FIG. 1 is a schematic structural diagram of a display device provided by an embodiment of the present disclosure
  • FIG. 2 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure.
  • FIG. 3 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure.
  • FIG. 4 is a schematic structural diagram of a display device according to another embodiment of the present disclosure.
  • FIG. 5 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure.
  • FIG. 6 is a schematic flowchart of a touch detection method for a display device according to an embodiment of the present disclosure
  • FIG. 7 is a structural block diagram of a touch detection device of a display device according to an embodiment of the present disclosure.
  • FIG. 8 is a structural block diagram of a touch detection device of a display device according to another embodiment of the present disclosure.
  • the imaging function is implemented in a camera-like mode to complete depth detection (three-dimensional space detection).
  • the device used The device is difficult to fabricate on the display panel, and generally can only be integrated into the display device in the form of an accessory module, which is not conducive to the simplification of the structure of the display device.
  • FIG. 1 is a schematic diagram of the structure of a display device provided by an embodiment of the present disclosure.
  • the display device includes an infrared light source 21, a sensing layer 22 and an optical structure layer 23.
  • the infrared light source 21 is located outside the display area of the display device and is used to provide infrared light illumination for the touch surface 100 to be detected;
  • the sensing layer 22 includes a number of infrared sensors 221 distributed in the display area; optical structure
  • the layer 23 is located on one side in the thickness direction of the sensing layer 22 and includes a plurality of optical structures 231, and each optical structure 231 is located on one side in the thickness direction of a corresponding infrared sensor 221.
  • Each infrared sensor 221 is used to detect the propagation distance (hereinafter referred to as the "first distance") of infrared light from the infrared light source 21 and reflected on the touch surface 100 to be detected to reach the infrared sensor 221, and each optical structure 231 is used to limit the incident angle of the infrared light reaching the corresponding infrared sensor 221.
  • the sensing layer 22 and the optical structure layer 23 are both layer structures formed on a base substrate in the display panel of the display device (other layer structures, such as metal electrodes, may also be formed on the base substrate. At least one of a layer, a transparent electrode layer, an organic light-emitting material layer, and an insulating material layer).
  • the infrared light source 21 may be located in the display panel (for example, on the base substrate outside the display area), on the circuit board bound to the display panel, on the frame surrounding the display panel, or the frame and Between display panels.
  • the touch detection process of the display device may be as follows: when the user's finger approaches the surface of the display device, the surface of the finger forms the touch to be detected The surface 100, at this time, the infrared light source 21 can provide infrared light illumination to the touch surface 100 to be detected. The infrared light emitted by the infrared light source 21 may be partially reflected when it reaches the touch surface 100 to be detected, and the reflected infrared light may reach the optical structure layer 23 according to different incident angles.
  • each optical structure 231 in the optical structure layer 23 can be based on a structure such as a collimating microlens or a collimating thick hole to prevent infrared light with an incident angle outside the specified range from reaching the corresponding infrared sensor 221, so that each infrared
  • the sensors 221 can only receive infrared light whose incident angle is within a specified range. In this way, when an infrared sensor 221 detects a first distance (such as the sum of the first length L1 and the second length L2 in FIG.
  • the incident angle limited by the optical structure 231 can be combined with
  • the positional relationship between the infrared sensor 221 and the infrared light source 21 for example, represented by the third length L3 in FIG. 1), the position at which the infrared light is reflected (for example, the position of the point P0 in FIG. 1) is calculated through geometric principles ,
  • the coordinate value in the thickness direction of the display device can be represented by calculating the second length L2, and the coordinate values in the remaining two coordinate directions can be represented by the position coordinates of the infrared sensor 221 in the display area).
  • the above calculation process can be simplified or reduced, for example, the height difference between the infrared sensor 221 and the infrared light source 21 is ignored, or the range of the incident angle limited by the optical structure 231 is used.
  • the intermediate value of (for example, the intermediate value of the incident angle range of 85 degrees to 95 degrees is 90 degrees) represents the incident angle for calculation, and so on.
  • the position of a point on the touch surface 100 to be detected can be obtained respectively. In this way, the obtained position of each point can be synthesized to obtain a depth image of the surface of the current user's finger, and touch control can be realized accordingly.
  • the infrared light source, the sensing layer and the optical structure layer in the embodiments of the present disclosure can cooperate with each other to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device .
  • the depth detection method provided by the embodiments of the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
  • the infrared sensor 221 is different from a sensor that senses the intensity of infrared light in the traditional sense, but belongs to a sensor that measures the propagation distance of the received infrared light based on the principle of optical distance measurement.
  • the infrared light source 21 can emit one or more infrared light pulses in each detection period, and the infrared light sensor 221 measures the length of time from when the infrared light pulse is sent to being received, so as to calculate the above-mentioned first pulse. A distance.
  • the infrared light source 21 may emit modulated (such as amplitude modulation and phase modulation) infrared light, and the infrared sensor 221 measures the phase delay of the received infrared light relative to the infrared light emitted by the infrared light source 21, thereby This calculates the first distance mentioned above.
  • modulated such as amplitude modulation and phase modulation
  • the display device may be configured in the following aspects: the irradiation area of the infrared light source 21 may be inclined toward the display panel to cover the possible spatial range of the touch surface 100 to be detected as much as possible;
  • the emission wavelength of the infrared light source 21 can be matched with the receiving wavelength of the infrared sensor 221 (for example, the main wavelength of the infrared light emitted by the infrared light source 21 is consistent with the most sensitive wavelength of the infrared sensor 221) to increase the signal-to-noise ratio of the sensing signal
  • the infrared sensor 221 can be formed by a device that can respond quickly to infrared light, such as avalanche diodes, PIN photodiodes, etc.; the range of incident angles limited by the optical structure 231 can be as small as possible to reduce calculation errors and enhance noise Inhibition of light.
  • the positional relationship between the infrared light source 21 and each infrared sensor 221 may be fixed, so that the positional relationship between the infrared sensor 221 and the infrared light source 21 can be pre-configured in the display device as a fixed parameter , There is no need to perform the step of acquiring the position information of the infrared light source 21 in the process of touch detection.
  • FIG. 2 is a schematic structural diagram of a display device according to another embodiment of the present disclosure.
  • the infrared light source 21 in the display device includes a first light-emitting element 211 and a second light-emitting element 212, and the first light-emitting element 211 and the second light-emitting element 212 surround the display of the display device. Outside the area ( Figure 2 is located on the left and right sides of the display panel as an example).
  • the first light-emitting element 211 and the second light-emitting element 212 can respectively provide infrared light illumination to different areas of the touch surface 100 to be detected (the illumination areas of different light-emitting elements may partially overlap).
  • the infrared sensor 221 cannot distinguish which light-emitting element the infrared light received comes from, it is possible to make each light-emitting element emit light in different periods of time during touch detection.
  • the position data of different light-emitting elements that is, the data representing the positional relationship between the infrared sensor and the infrared light source
  • the final depth image can be integrated by The depth image data under the illumination area is obtained.
  • the display device performs touch detection once in each detection period, where each detection period includes a first period and a second period, and the start time of the second period is after the end time of the first period.
  • each detection period includes a first period and a second period
  • the start time of the second period is after the end time of the first period.
  • the first light-emitting element 211 provides infrared light illumination from the left side of FIG. 2 to the touch surface 100 to be detected.
  • the sensing signal of each infrared sensor 221 can be collected according to the The process described above detects the touch surface 100 to be detected in the illumination area; in the second time period, the second light-emitting element 212 provides infrared light illumination to the touch surface 100 to be detected from the right side in FIG.
  • the sensing signal of each infrared sensor 221 can be collected to detect the touch surface 100 to be detected in the illuminated area according to the above-mentioned process.
  • the depth image data of the overlapping part of the illumination area of the two light-emitting elements can be integrated (for example, a line segment formed by connecting two position points sequentially detected based on the sensing signal of the same infrared sensor 221 As the integration result), it is combined with the depth image data of other parts into the depth image detected by the current detection cycle.
  • the infrared light source 21 may also include more than two light-emitting elements, which can surround the display area of the display device, and can realize each frame by emitting light one by one in each detection period. Detection of depth images.
  • FIG. 3 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure.
  • the infrared light source 21 includes a first light-emitting element 211, a second light-emitting element 212, a third light-emitting element 213, and a fourth light-emitting element 214 surrounding the display area A1.
  • the element 211, the second light-emitting element 212, the third light-emitting element 213, and the fourth light-emitting element 214 are all located in the peripheral area A2 outside the display area A1.
  • the display device further includes a light-emitting control circuit 24 and a touch circuit 25.
  • the light-emitting control circuit 24 is connected to each light-emitting element through a connection structure, and the touch circuit 25 is connected to each light-emitting element in the display area A1 through the connection structure.
  • the infrared sensor 221 is connected.
  • the light emitting control circuit 24 may provide current to the light emitting elements based on the connection with the light emitting elements, and control the light emitting state of each light emitting element by controlling the on and off of the current and the magnitude of the current.
  • the touch circuit 25 can receive the sensing signal collected by the infrared sensor 221 based on the connection with the infrared sensor 221, and thereby realize the above-mentioned touch detection process.
  • the lighting control circuit 24 and the touch control circuit 25 can use the same clock signal, thereby ensuring synchronization between each other; in one example, the lighting control circuit 24 and the touch control circuit 25 can be connected to the same timing controller, and Receive the synchronous clock signal from the timing controller.
  • the touch detection process of the display device may be as follows: the display device performs a touch detection in each detection period, and correspondingly, the light-emitting control circuit 24 During the detection period, each light-emitting element is controlled to emit light one by one. Taking the time period during which the first light-emitting element 211 emits light as an example, the touch circuit 25 can perform detection in each illumination area on the touch surface 100 to be detected in the following manner: First, the touch circuit 25 obtains the detection of each infrared sensor 221 The first distance obtained.
  • the touch circuit 25 may receive the sensing signal of each infrared sensor 221 synchronously based on the connection between each infrared sensor 221, and after at least one of shaping, amplifying and filtering it, the touch circuit 25
  • the data representing the size of the first distance can be detected.
  • the infrared sensor 221 may detect the first distance based on a pulse light source calculation time method, a charge accumulation calculation time method, or a light flight time calculation method, and it may not be limited thereto. It should be understood that the infrared sensor 221 may generate a sensor signal with a voltage amplitude close to zero because it cannot receive infrared light. The detected data close to zero indicates that the infrared sensor 221 does not detect infrared light.
  • the touch control circuit 25 can respectively target each infrared sensor 221 by the first distance, the second distance (the distance between the infrared sensor 221 and the light-emitting element that is emitting light), and the receiving angle (limited by the optical structure 231). , Determine the position where the infrared light reaching the infrared sensor 221 reflects on the touch surface 100 to be detected. For example, for the case where the receiving angle shown in FIG.
  • a number of depth data corresponding to the position identification of the infrared sensor 221 will be stored in the storage area of the touch detection result, which can represent a number of the touch surface 100 to be detected.
  • the position of the point relative to the display device in the three-dimensional space that is, it can be drawn as the aforementioned depth image).
  • the touch circuit 25 may integrate the detection results respectively corresponding to each of the light-emitting elements to obtain the detection result of the touch surface to be detected.
  • the touch circuit 25 may store the touch detection results corresponding to different light-emitting elements in different storage areas, so that after the touch detection corresponding to each light-emitting element is completed, all the obtained touch detection results The results are averaged. For example, all the non-zero depth data corresponding to the position identification of the same infrared sensor 221 may be averaged.
  • the touch control circuit 25 may store the touch detection results corresponding to different light-emitting elements in the same storage area.
  • the position identifier of each infrared sensor 221 corresponding to the stored depth data can be set to zero; each time the touch detection result is detected, it is determined whether the position identifier of the infrared sensor 221 has been stored correspondingly.
  • the depth data that is not zero; if it does not exist, the depth data to be stored is directly stored; if it exists, the depth data to be stored and the stored depth data are averaged and the original depth data is overwritten. In this way, the storage space of the touch detection result can be saved.
  • multiple light-emitting elements emit light one by one in each detection cycle and perform touch detection separately, and multiple touch detection results in the same detection cycle can be obtained without interfering with each other in the touch detection process.
  • These touch detection results can be Complement each other to reduce the blind area of touch detection, and can also be used for mutual comparison to eliminate erroneous data and reduce errors, to achieve more ideal three-dimensional touch detection.
  • FIG. 4 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure.
  • the display device includes a first substrate 27 and a second substrate 28, and also includes an infrared light source 21, a sensing layer 22, an optical structure layer 23, and an organic light emitting layer, wherein the organic light emitting layer includes several A light-emitting pattern 261, a cathode structure layer 262, and an anode structure layer 263, each light-emitting pattern 261 is located in the display area A1, the organic light-emitting layer, the optical structure layer 23 and the sensing layer 22 are on the first substrate 27 and The two substrates 28 are stacked in sequence.
  • the infrared light source 21 is located in the peripheral area A2 outside the display area A1, and is located in the same layer between the first substrate 27 and the second substrate 28 as the organic light-emitting layer.
  • the cathode structure layer in the organic light-emitting layer may include the cathode of the light-emitting pattern 261
  • the anode structure layer 263 in the organic light-emitting layer may include the anode of the light-emitting pattern 261.
  • the shape and structure of the organic light-emitting layer may refer to any one.
  • the shape and structure of the film layer on the base substrate in the organic light-emitting diode display device are realized, which will not be repeated here.
  • the infrared light source 21 includes an infrared light-emitting material layer 210 in the same layer as the light-emitting pattern 261, the cathode of the infrared light-emitting material layer 210 and the cathode of the light-emitting pattern 261 are the same layer, and the anode of the infrared light-emitting material layer 210 and The anode of the light-emitting pattern 261 is the same layer, and the infrared light-emitting material layer 210 and its anode and cathode constitute a light-emitting element in the infrared light source 21. That is, the same or similar manufacturing process can be used to form the required infrared light source 21 when manufacturing the organic light-emitting layer, so as to simplify the internal structure and manufacturing process of the display device.
  • each infrared sensor 221 is located between the orthographic projections of two adjacent light-emitting patterns 261.
  • the upper part of each infrared sensor 221 in FIG. 4 is a gap between two adjacent light-emitting patterns 261.
  • infrared light from above can pass through the gap between the light-emitting patterns 261 to reach the infrared sensor 221, so as to realize the above-mentioned touch detection process.
  • the distance between two adjacent infrared sensors 221 is equivalent to the distance between two adjacent light-emitting patterns 261, which is more conducive to high-resolution touch detection.
  • FIG. 5 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure.
  • the display device includes a first substrate 27, a second substrate 28, and a third substrate 29, and further includes an infrared light source 21, a sensing layer 22, an optical structure layer 23, and an organic light emitting layer, wherein
  • the organic light-emitting layer includes several light-emitting patterns 261, a cathode structure layer 262 and an anode structure layer 263. Each light-emitting pattern 261 is located in the display area.
  • the second substrate 28 is located between the first substrate 27 and the third substrate 29.
  • the light-emitting layer is located between the first substrate 27 and the second substrate 28, and the optical structure layer 23 and the sensing layer 22 are located between the second substrate 28 and the third substrate 29.
  • the cathode structure layer in the organic light-emitting layer may include the cathode of the light-emitting pattern 261
  • the anode structure layer 263 in the organic light-emitting layer may include the anode of the light-emitting pattern 261.
  • the shape and structure of the organic light-emitting layer may refer to any one.
  • the shape and structure of the film layer on the base substrate in the organic light-emitting diode display device are realized, which will not be repeated here.
  • the optical structure layer 23 includes a first optical structure layer and a second optical structure layer respectively located on both sides of the sensing layer 22 in the thickness direction
  • the infrared light source 21 includes a front surface of the display device ( The upper part in FIG. 5) provides the first light-emitting element 211 and the second light-emitting element 212 for infrared light illumination, and also includes the third light-emitting element 213 and the fourth light-emitting element 213 and the fourth light-emitting element that provide infrared light to the back of the display device (lower part in FIG. 5) Component 214.
  • the optical structure in the first optical structure layer and the optical structure in the second optical structure layer can respectively limit the incident angle of the infrared light reaching the infrared sensor 221 in two directions, and the four light-emitting elements can be as described above In this way, light is sequentially emitted in each detection cycle, so as to simultaneously realize touch detection on the front of the display device and touch detection on the back of the display device without mutual interference.
  • any display device capable of realizing single-sided touch detection in the embodiments of the present disclosure can be transformed into a display device capable of realizing double-sided touch detection with reference to the display device shown in FIG. 5. A repeat.
  • the orthographic projection of each infrared sensor 221 is partially located between the orthographic projections of two adjacent light-emitting patterns 261.
  • infrared light from above can pass through the gap between the light-emitting patterns 261 to reach the infrared sensor 221, so as to realize the above-mentioned touch detection process.
  • the size of the infrared sensor 221 and the optical structure 231 may not need to be consistent with the sub-pixel width of the display device, and the corresponding process requirements and process difficulty can be reduced.
  • the substrate 28 and the third substrate 29 there is no need to fabricate each of the organic light-emitting layer, the optical structure layer 23 and the sensing layer 22 on the same base substrate in the process, although this will make the display device relatively more Thick, but can reduce the requirements on the level of process.
  • the infrared light source, the sensing layer and the optical structure layer in the embodiments of the present disclosure can cooperate with each other to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device .
  • the depth detection method provided by the embodiments of the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
  • the display device in the embodiment of the present disclosure may be any product or component with display function, such as a display panel, a mobile phone, a tablet computer, a television, a monitor, a notebook computer, a digital photo frame, a navigator, and the like.
  • Fig. 6 is a schematic flowchart of a touch detection method of a display device provided by an embodiment of the present disclosure.
  • the display device may be any one of the above-mentioned display devices. Referring to Fig. 6, the method may include the following steps.
  • step 601 the infrared light source is controlled to provide infrared light illumination to the touch surface.
  • step 602 the first distance detected by each of the plurality of infrared sensors is acquired.
  • step 603 for each infrared sensor, the first distance, the second distance, and the receiving angle are used to determine the position where the infrared light reaching the infrared sensor reflects on the touch surface to be detected.
  • the infrared light source is located outside the display area of the display device.
  • the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is that infrared light starts from the infrared light source and reaches the infrared light after being reflected on the touch surface to be detected
  • the propagation distance of the sensor and the incident angle of the infrared light reaching each of the infrared sensors are limited by a corresponding optical structure, and each optical structure is located in the display device of a corresponding infrared sensor.
  • the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  • the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device; correspondingly, the infrared light source is directed toward the
  • the provision of infrared light illumination on the touch surface includes: controlling the at least two light-emitting elements to emit light one by one in each detection period to obtain detection results corresponding to each of the light-emitting elements; correspondingly, the touch
  • the detection method further includes: integrating the detection results respectively corresponding to each of the light-emitting elements to obtain the detection result of the touch surface to be detected.
  • Fig. 7 is a structural block diagram of a touch detection device of a display device according to an embodiment of the present disclosure.
  • the display device may be any of the above-mentioned display devices.
  • the touch detection device may include the following structure.
  • the light-emitting control module 71 is used to control an infrared light source to provide infrared light illumination to the touch surface, the infrared light source is located outside the display area of the display device.
  • the detection module 72 is configured to obtain a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors are distributed in the display area of the display device, and the first distance is
  • the infrared light starts from the infrared light source and is reflected on the touch surface to be detected to reach the propagation distance of the infrared sensor.
  • the incident angle of the infrared light reaching each infrared sensor is determined by a corresponding optical structure. Restriction, each of the optical structures is located on one side of the thickness direction of the corresponding infrared sensor in the display device.
  • the processing module 73 is configured to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance, and the receiving angle for each infrared sensor; wherein, The second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  • the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device; correspondingly, the light-emitting control module 71 further Used for: controlling the at least two light-emitting elements to emit light one by one in each detection period to obtain the detection results corresponding to each of the light-emitting elements; correspondingly, the device further includes: an integration module for The integration corresponds to the detection results of each of the light-emitting elements to obtain a complete detection result of the touch surface to be detected.
  • FIG. 8 is a structural block diagram of a touch detection device of a display device according to another embodiment of the present disclosure.
  • the display device may be any one of the above-mentioned display devices.
  • the touch detection device may include a processor 81 and a memory 82 for storing instructions executable by the processor.
  • the processor 81 is configured to call the program instructions in the memory 82 to execute any one of the touch detection methods of the display device described above.
  • the processor 81 may include a central processing unit (CPU, single-core or multi-core), a graphics processing unit (GPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), a digital signal processor (DSP), Digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, or multiple integrated circuits used to control program execution.
  • CPU central processing unit
  • GPU graphics processing unit
  • ASIC Application-Specific Integrated Circuit
  • DSP digital signal processor
  • DSPD Digital signal processing device
  • PLD programmable logic device
  • FPGA field programmable gate array
  • controller microcontroller, or multiple integrated circuits used to control program execution.
  • the memory 82 may include read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (Random Access Memory, RAM), or other types that can store information and instructions
  • the dynamic storage device can also include electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disc storage, optical disc storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.
  • the memory can be set independently or integrated with the processor.
  • the embodiment of the present disclosure also provides a computer storage medium for storing a computer program used in any of the above-mentioned touch detection methods of a display device, the computer program including program instructions. By executing the stored program, the touch detection method of any of the above-mentioned display devices provided in the present disclosure can be realized.
  • the infrared light source, the sensing layer and the optical structure layer in the embodiments of the present disclosure can cooperate with each other to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device .
  • the depth detection method provided by the embodiments of the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.

Abstract

Provided are a display device, and a touch detection method and device. The display device comprises: an infrared light source located outside a display area of the display device, wherein the infrared light source is used for providing infrared light illumination for a touch surface to be tested; a sensing layer comprising a plurality of infrared sensors distributed in the display area, wherein the infrared sensors are used for measuring a first distance, with the first distance being the propagation distance of infrared light emitted by the infrared light source and reflected on the touch surface to be tested and then reaching the infrared sensors; and an optical structure layer located on at least one side in the thickness direction of the sensing layer, wherein the optical structure layer comprises a plurality of optical structures, each optical structure is located on one side in the thickness direction of a corresponding infrared sensor, and the optical structure is used for limiting the incident angle of infrared light reaching the corresponding infrared sensor. By means of the present disclosure, a depth measurement method requiring a simpler structure can be realized.

Description

显示装置、触摸检测方法及装置Display device, touch detection method and device
本申请要求于2019年4月23日提交的申请号为201910330439.3、发明名称为“显示装置、触摸检测方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed on April 23, 2019 with the application number 201910330439.3 and the title of the invention "display device, touch detection method and device", the entire content of which is incorporated into this application by reference.
技术领域Technical field
本公开涉及显示领域,特别涉及一种显示装置、触摸检测方法及装置。The present disclosure relates to the display field, and in particular to a display device, a touch detection method and a device.
背景技术Background technique
三维空间检测技术指的是利用机器视觉实现对三维空间中的物体、表面、距离、方位等进行检测的技术。移动终端可以利用三维空间检测技术对操作者的手部进行检测,以实现三维触控和手势识别等功能。。Three-dimensional space detection technology refers to a technology that uses machine vision to detect objects, surfaces, distances, and orientations in three-dimensional space. The mobile terminal can use the three-dimensional space detection technology to detect the hand of the operator to realize functions such as three-dimensional touch and gesture recognition. .
发明内容Summary of the invention
本公开提供一种显示装置、触摸检测方法及装置,可以实现一种所需结构更加简单的深度检测方式。The present disclosure provides a display device, a touch detection method and a device, which can realize a depth detection method with a simpler required structure.
第一方面,本公开提供了一种显示装置,所述显示装置包括:In a first aspect, the present disclosure provides a display device, which includes:
红外光源,位于所述显示装置的显示区之外,所述红外光源用于为待检测的触摸表面提供红外光照明;An infrared light source located outside the display area of the display device, and the infrared light source is used to provide infrared light illumination for the touch surface to be detected;
传感层,包括分布在所述显示区之内的若干个红外线传感器,所述红外线传感器用于检测第一距离,所述第一距离是红外光从所述红外光源出发并在所述待检测的触摸表面上反射后到达所述红外线传感器的传播距离;The sensing layer includes a number of infrared sensors distributed in the display area, the infrared sensor is used to detect a first distance, the first distance is infrared light from the infrared light source and in the to-be-detected The propagation distance of the infrared sensor after being reflected on the touch surface;
光学结构层,位于所述传感层的厚度方向上的至少一侧,所述光学结构层包括若干个光学结构,每个所述光学结构位于相对应的一个所述红外线传感器的厚度方向上的一侧,所述光学结构用于限制到达相对应的所述红外线传感器的红外光的入射角度。The optical structure layer is located on at least one side of the thickness direction of the sensing layer, and the optical structure layer includes a plurality of optical structures, and each of the optical structures is located in the thickness direction of a corresponding infrared sensor. On one side, the optical structure is used to limit the incident angle of infrared light reaching the corresponding infrared sensor.
在一种可能的实现方式中,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外。In a possible implementation manner, the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device.
在一种可能的实现方式中,所述红外光源还包括分别连接每个发光元件的发光控制电路,所述发光控制电路用于在每个检测周期内控制所述至少两个发光元件逐个发光。In a possible implementation manner, the infrared light source further includes a light-emitting control circuit respectively connected to each light-emitting element, and the light-emitting control circuit is configured to control the at least two light-emitting elements to emit light one by one in each detection period.
在一种可能的实现方式中,所述显示装置还包括触控电路,每个所述红外传感器均与所述触控电路相连,In a possible implementation, the display device further includes a touch circuit, and each of the infrared sensors is connected to the touch circuit,
所述触控电路用于分别针对每个红外线传感器由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;The touch control circuit is used to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance and the receiving angle for each infrared sensor;
其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
在一种可能的实现方式中,所述显示装置包括有机发光层,所述有机发光层包括若干个位于所述显示区之内的发光图形;In a possible implementation manner, the display device includes an organic light-emitting layer, and the organic light-emitting layer includes a plurality of light-emitting patterns located in the display area;
在所述显示装置所在平面内,每个所述红外线传感器的正投影均有至少一部分位于相邻两个所述发光图形的正投影之间。In the plane where the display device is located, at least a part of the orthographic projection of each infrared sensor is located between the orthographic projections of two adjacent light-emitting patterns.
在一种可能的实现方式中,在所述显示装置所在平面内,每个所述红外线传感器的正投影均位于相邻两个所述发光图形的正投影之间。In a possible implementation manner, in the plane where the display device is located, the orthographic projection of each infrared sensor is located between the orthographic projections of two adjacent light-emitting patterns.
在一种可能的实现方式中,所述显示装置还包括第一基板、第二基板和有机发光层,所述有机发光层、所述光学结构层和所述传感层在所述第一基板和所述第二基板之间依次层叠。In a possible implementation, the display device further includes a first substrate, a second substrate, and an organic light-emitting layer, and the organic light-emitting layer, the optical structure layer, and the sensing layer are on the first substrate. And the second substrate are sequentially stacked.
在一种可能的实现方式中,所述红外光源与所述有机发光层位于所述第一基板与所述第二基板之间的同一层。In a possible implementation manner, the infrared light source and the organic light-emitting layer are located in the same layer between the first substrate and the second substrate.
在一种可能的实现方式中,所述显示装置还包括第一基板、第二基板、第三基板和有机发光层,所述第二基板位于所述第一基板和所述第三基板之间,所述有机发光层位于所述第一基板和所述第二基板之间,所述光学结构层和所述传感层位于所述第二基板和所述第三基板之间。In a possible implementation, the display device further includes a first substrate, a second substrate, a third substrate, and an organic light-emitting layer, and the second substrate is located between the first substrate and the third substrate The organic light emitting layer is located between the first substrate and the second substrate, and the optical structure layer and the sensing layer are located between the second substrate and the third substrate.
第二方面,本公开还提供了一种触摸检测方法,所述方法包括:In a second aspect, the present disclosure also provides a touch detection method, the method including:
控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所 述显示装置的显示区之外;Controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是红外光从所述红外光源出发并在所述待检测的触摸表面上反射后到达所述红外线传感器的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧;Acquire a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is the distance of infrared light from the infrared The propagation distance of the infrared sensor after the light source starts and reflects on the touch surface to be detected. The incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure. The optical structure is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
分别针对每个红外线传感器,由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;For each infrared sensor, the position at which the infrared light reaching the infrared sensor is reflected on the touch surface to be detected is determined by the first distance, the second distance, and the receiving angle;
其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
在一种可能的实现方式中,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外;In a possible implementation manner, the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device;
相对应地,所述通过红外光源向所述触摸表面提供红外光照明,包括:Correspondingly, the providing infrared light illumination to the touch surface through an infrared light source includes:
在每个检测周期内,控制所述至少两个发光元件逐个发光,以得到分别对应于每个所述发光元件的检测结果;In each detection period, controlling the at least two light-emitting elements to emit light one by one to obtain a detection result corresponding to each of the light-emitting elements;
相对应地,所述方法还包括:Correspondingly, the method further includes:
整合分别对应于每个所述发光元件的检测结果,以得到所述待检测的触摸表面的检测结果。The detection results respectively corresponding to each of the light-emitting elements are integrated to obtain the detection results of the touch surface to be detected.
第三方面,本公开还提供了一种触摸检测设备,所述设备包括:In a third aspect, the present disclosure also provides a touch detection device, which includes:
发光控制模块,用于控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所述显示装置的显示区之外;A light emission control module for controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
检测模块,用于获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是红外光从所述红外光源出发并在所述待检测的触摸表面上反射后到达该红外线传感器的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方 向上的一侧;The detection module is used to obtain a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors being distributed within the display area of the display device, and the first distance being infrared The propagation distance of light from the infrared light source and reflected on the touch surface to be detected to reach the infrared sensor, the incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure , Each of the optical structures is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
处理模块,用于分别针对每个红外线传感器由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;A processing module, configured to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance, and the receiving angle for each infrared sensor;
其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
在一种可能的实现方式中,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外;In a possible implementation manner, the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device;
相对应地,所述发光控制模块进一步用于:Correspondingly, the light emission control module is further used for:
在每个检测周期内,控制所述至少两个发光元件逐个发光,以得到分别对应于每个所述发光元件的检测结果;In each detection period, controlling the at least two light-emitting elements to emit light one by one to obtain a detection result corresponding to each of the light-emitting elements;
相对应地,所述设备还包括:Correspondingly, the device further includes:
整合模块,用于整合分别对应于每个所述发光元件的检测结果,以得到完整的所述待检测的触摸表面的检测结果。The integration module is used to integrate the detection results respectively corresponding to each of the light-emitting elements to obtain a complete detection result of the touch surface to be detected.
第四方面,本公开还提供了一种触摸检测设备,所述设备包括:In a fourth aspect, the present disclosure also provides a touch detection device, the device including:
处理器;processor;
用于存储所述处理器可执行指令的存储器;A memory for storing executable instructions of the processor;
其中,所述处理器被配置为:Wherein, the processor is configured to:
控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所述显示装置的显示区之外;Controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是红外光从所述红外光源出发并在所述待检测的触摸表面上反射后到达所述红外线传感器的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧;Acquire a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is the distance of infrared light from the infrared The propagation distance of the infrared sensor after the light source starts and reflects on the touch surface to be detected. The incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure. The optical structure is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
分别针对每个红外线传感器,由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;For each infrared sensor, the position at which the infrared light reaching the infrared sensor is reflected on the touch surface to be detected is determined by the first distance, the second distance, and the receiving angle;
其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
由上述技术方案可知,本公开中的红外光源、传感层和光学结构层能够相互配合地检测得到红外光在待检测的触摸表面发生反射的位置,从而实现手指靠近显示装置时手指表面的检测。相比于需要使用摄像器件的深度检测技术,本公开提供的深度检测方式无需引入图像处理模组或是复杂的CMOS器件制作工艺,所需要的结构和制作工艺更加简单。It can be seen from the above technical solutions that the infrared light source, the sensing layer and the optical structure layer in the present disclosure can cooperate to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device . Compared with the depth detection technology that requires the use of a camera device, the depth detection method provided by the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
附图说明Description of the drawings
图1是本公开一个实施例提供的显示装置的结构示意图;FIG. 1 is a schematic structural diagram of a display device provided by an embodiment of the present disclosure;
图2是本公开又一实施例提供的显示装置的结构示意图;2 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure;
图3是本公开又一实施例提供的显示装置的结构示意图;3 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure;
图4是本公开又一实施例提供的显示装置的结构示意图;4 is a schematic structural diagram of a display device according to another embodiment of the present disclosure;
图5是本公开又一实施例提供的显示装置的结构示意图;5 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure;
图6是本公开一个实施例提供的显示装置的触摸检测方法的流程示意图;FIG. 6 is a schematic flowchart of a touch detection method for a display device according to an embodiment of the present disclosure;
图7是本公开一个实施例提供的显示装置的触摸检测设备的结构框图;FIG. 7 is a structural block diagram of a touch detection device of a display device according to an embodiment of the present disclosure;
图8是本公开又一实施例提供的显示装置的触摸检测设备的结构框图。FIG. 8 is a structural block diagram of a touch detection device of a display device according to another embodiment of the present disclosure.
具体实施方式Detailed ways
为使本公开的目的、技术方案和优点更加清楚,下面将结合附图对本公开实施方式作进一步地详细描述。显然,所描述的实施例是本公开的一部分实施例,而不是全部的实施例。基于所描述的本公开的实施例,本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。除非另外定义,本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数 量或者重要性,而只是用来区分不同的组成部分。“包括”或者类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同,而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电性的连接,且该连接可以是直接的或间接的。In order to make the objectives, technical solutions, and advantages of the present disclosure clearer, the following further describes the embodiments of the present disclosure in detail with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative labor are within the protection scope of the present disclosure. Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in the present disclosure do not denote any order, quantity or importance, but are only used to distinguish different components. "Including" or similar words means that the elements or items appearing before the word cover the elements or items listed after the word and their equivalents, but do not exclude other elements or items. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, and the connections may be direct or indirect.
在相关技术中,不论是双目立体视觉技术、结构光技术还是TOF(Time of Flight)技术,都是以类似摄像头的模式实现成像功能来完成深度检测(三维空间检测)的,所使用的装置器件很难在显示面板上制作,一般只能以附属模组的形式集成到显示装置当中,不利于显示装置的结构的简化。In related technologies, whether it is binocular stereo vision technology, structured light technology or TOF (Time of Flight) technology, the imaging function is implemented in a camera-like mode to complete depth detection (three-dimensional space detection). The device used The device is difficult to fabricate on the display panel, and generally can only be integrated into the display device in the form of an accessory module, which is not conducive to the simplification of the structure of the display device.
图1是本公开一个实施例提供的显示装置的结构示意图。参见图1,所述显示装置包括红外光源21、传感层22和光学结构层23。其中,红外光源21位于所述显示装置的显示区之外,用于为待检测的触摸表面100提供红外光照明;传感层22包括分布在显示区之内的若干个红外线传感器221;光学结构层23位于传感层22的厚度方向上的一侧,包括若干个光学结构231,每个光学结构231各自位于相对应的一个红外线传感器221的厚度方向上的一侧。每个红外线传感器221均用于检测红外光从红外光源21出发并在待检测的触摸表面100上反射后到达该红外线传感器221的传播距离(以下简称“第一距离”),而每个光学结构231均用于限制到达相对应的红外线传感器221的红外光的入射角度。FIG. 1 is a schematic diagram of the structure of a display device provided by an embodiment of the present disclosure. Referring to FIG. 1, the display device includes an infrared light source 21, a sensing layer 22 and an optical structure layer 23. Wherein, the infrared light source 21 is located outside the display area of the display device and is used to provide infrared light illumination for the touch surface 100 to be detected; the sensing layer 22 includes a number of infrared sensors 221 distributed in the display area; optical structure The layer 23 is located on one side in the thickness direction of the sensing layer 22 and includes a plurality of optical structures 231, and each optical structure 231 is located on one side in the thickness direction of a corresponding infrared sensor 221. Each infrared sensor 221 is used to detect the propagation distance (hereinafter referred to as the "first distance") of infrared light from the infrared light source 21 and reflected on the touch surface 100 to be detected to reach the infrared sensor 221, and each optical structure 231 is used to limit the incident angle of the infrared light reaching the corresponding infrared sensor 221.
在一个示例中,所述传感层22和光学结构层23均是显示装置的显示面板中形成在衬底基板上形成的层结构(衬底基板上还可以形成有其他层结构,例如金属电极层、透明电极层、有机发光材料层以及绝缘材料层中的至少一种)。示例性地,所述红外光源21可以位于显示面板中(例如显示区之外的衬底基板上)、与显示面板存在绑定关系的电路板上、围绕显示面板的边框上,或是边框与显示面板之间。In an example, the sensing layer 22 and the optical structure layer 23 are both layer structures formed on a base substrate in the display panel of the display device (other layer structures, such as metal electrodes, may also be formed on the base substrate. At least one of a layer, a transparent electrode layer, an organic light-emitting material layer, and an insulating material layer). Exemplarily, the infrared light source 21 may be located in the display panel (for example, on the base substrate outside the display area), on the circuit board bound to the display panel, on the frame surrounding the display panel, or the frame and Between display panels.
参见图1,在一个示例中,所述显示装置的触摸检测的过程可以如下所述:使用者的手指靠近所述显示装置的表面时,所述手指的表面即形成了所述待检测的触摸表面100,此时红外光源21可以向待检测的触摸表面100提供红外光照明。红外光源21发出的红外光在到达待检测的触摸表面100时可以发生部分反射,反射后的红外光可能会按照不同的入射角度到 达光学结构层23。从而,光学结构层23中的每个光学结构231可以基于例如准直微透镜或准直厚孔等结构来阻止入射角度为规定范围以外的红外光到达相对应的红外线传感器221,使得每个红外线传感器221均只能接收到入射角度在规定范围内的红外光。如此,在一个红外线传感器221检测得到一个第一距离(比如图1中的第一长度L1与第二长度L2之和)时,可以结合光学结构231所限制的入射角度(比如约90°)以及该红外线传感器221与红外光源21之间的位置关系(比如用图1中的第三长度L3来表示),通过几何原理来计算得到上述红外光发生反射的位置(比如图1中点P0的位置,其在显示装置的厚度方向上的坐标值可以通过计算得到第二长度L2来表示,其余两个坐标方向上的坐标值可以通过该红外线传感器221在显示区中的位置坐标来表示)。其中应理解的是,为了方便计算,可以在上述计算过程中进行简化或约化,例如忽略红外线传感器221与红外光源21之间的高度差,或是使用光学结构231所限制的入射角度的范围的中间值(比如入射角度的范围85度至95度的中间值为90度)来代表入射角度进行运算,等等。基于每个红外线传感器221检测得到的第一距离,可以分别得到一个待检测的触摸表面100上的点的位置。由此,可以综合所得到的每个点的位置,得到当前使用者的手指的表面的深度图像,并依此实现触摸控制。Referring to FIG. 1, in an example, the touch detection process of the display device may be as follows: when the user's finger approaches the surface of the display device, the surface of the finger forms the touch to be detected The surface 100, at this time, the infrared light source 21 can provide infrared light illumination to the touch surface 100 to be detected. The infrared light emitted by the infrared light source 21 may be partially reflected when it reaches the touch surface 100 to be detected, and the reflected infrared light may reach the optical structure layer 23 according to different incident angles. Therefore, each optical structure 231 in the optical structure layer 23 can be based on a structure such as a collimating microlens or a collimating thick hole to prevent infrared light with an incident angle outside the specified range from reaching the corresponding infrared sensor 221, so that each infrared The sensors 221 can only receive infrared light whose incident angle is within a specified range. In this way, when an infrared sensor 221 detects a first distance (such as the sum of the first length L1 and the second length L2 in FIG. 1), the incident angle limited by the optical structure 231 (such as about 90°) can be combined with The positional relationship between the infrared sensor 221 and the infrared light source 21 (for example, represented by the third length L3 in FIG. 1), the position at which the infrared light is reflected (for example, the position of the point P0 in FIG. 1) is calculated through geometric principles , The coordinate value in the thickness direction of the display device can be represented by calculating the second length L2, and the coordinate values in the remaining two coordinate directions can be represented by the position coordinates of the infrared sensor 221 in the display area). It should be understood that, in order to facilitate the calculation, the above calculation process can be simplified or reduced, for example, the height difference between the infrared sensor 221 and the infrared light source 21 is ignored, or the range of the incident angle limited by the optical structure 231 is used. The intermediate value of (for example, the intermediate value of the incident angle range of 85 degrees to 95 degrees is 90 degrees) represents the incident angle for calculation, and so on. Based on the first distance detected by each infrared sensor 221, the position of a point on the touch surface 100 to be detected can be obtained respectively. In this way, the obtained position of each point can be synthesized to obtain a depth image of the surface of the current user's finger, and touch control can be realized accordingly.
可以看出,本公开实施例中的红外光源、传感层和光学结构层能够相互配合地检测得到红外光在待检测的触摸表面发生反射的位置,从而实现手指靠近显示装置时手指表面的检测。相比于需要使用摄像器件的深度检测技术,本公开实施例提供的深度检测方式无需引入图像处理模组或是复杂的CMOS器件制作工艺,所需要的结构和制作工艺更加简单。It can be seen that the infrared light source, the sensing layer and the optical structure layer in the embodiments of the present disclosure can cooperate with each other to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device . Compared with the depth detection technology that requires the use of a camera device, the depth detection method provided by the embodiments of the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
需要说明的是,所述红外线传感器221不同于传统意义上的感测红外光光强的传感器,而属于基于光学测距原理测量接收到的红外光的传播距离的传感器。在一个示例中,红外光源21可以在每个检测周期内发出一个或多个红外光脉冲,并通过红外线传感器221测量红外光脉冲从被发出到被接收的时间长短,从而以此计算出上述第一距离。在又一示例中,红外光源21可以发出经过调制(比如幅度调制和相位调制)的红外光,并通过红外线传感器221测量接收到的红外光相对于红外光源21发出的红外光的 相位延迟,从而以此计算出上述第一距离。It should be noted that the infrared sensor 221 is different from a sensor that senses the intensity of infrared light in the traditional sense, but belongs to a sensor that measures the propagation distance of the received infrared light based on the principle of optical distance measurement. In one example, the infrared light source 21 can emit one or more infrared light pulses in each detection period, and the infrared light sensor 221 measures the length of time from when the infrared light pulse is sent to being received, so as to calculate the above-mentioned first pulse. A distance. In another example, the infrared light source 21 may emit modulated (such as amplitude modulation and phase modulation) infrared light, and the infrared sensor 221 measures the phase delay of the received infrared light relative to the infrared light emitted by the infrared light source 21, thereby This calculates the first distance mentioned above.
在一个示例中,为了得到理想的检测结果,可以在以下方面配置所述显示装置:红外光源21的照射区域可以向着显示面板倾斜,以尽量覆盖待检测的触控表面100可能存在的空间范围;红外光源21的发射波长可以与红外线传感器221的接收波长相匹配(例如红外光源21发出的红外光的主要波长与红外线传感器221的最敏感波长相一致),以增大传感信号的信噪比;红外线传感器221可以采用能够对红外光快速响应的器件形成,比如雪崩二极管,PIN型光电二极管,等等;光学结构231所限制的入射角度的范围可以尽量小,以减少计算误差并增强对噪声光线的抑制作用。此外,为了方便计算,红外光源21与每一个红外线传感器221之间的位置关系可以是固定的,如此可以将上述红外线传感器221与红外光源21之间的位置关系作为固定参数预先配置在显示装置当中,而不需要在触摸检测的过程中进行获取红外光源21的位置信息的步骤。In one example, in order to obtain an ideal detection result, the display device may be configured in the following aspects: the irradiation area of the infrared light source 21 may be inclined toward the display panel to cover the possible spatial range of the touch surface 100 to be detected as much as possible; The emission wavelength of the infrared light source 21 can be matched with the receiving wavelength of the infrared sensor 221 (for example, the main wavelength of the infrared light emitted by the infrared light source 21 is consistent with the most sensitive wavelength of the infrared sensor 221) to increase the signal-to-noise ratio of the sensing signal The infrared sensor 221 can be formed by a device that can respond quickly to infrared light, such as avalanche diodes, PIN photodiodes, etc.; the range of incident angles limited by the optical structure 231 can be as small as possible to reduce calculation errors and enhance noise Inhibition of light. In addition, for the convenience of calculation, the positional relationship between the infrared light source 21 and each infrared sensor 221 may be fixed, so that the positional relationship between the infrared sensor 221 and the infrared light source 21 can be pre-configured in the display device as a fixed parameter , There is no need to perform the step of acquiring the position information of the infrared light source 21 in the process of touch detection.
在上述触摸检测过程中可以看出的是,如果待检测的触摸表面100上存在没有被红外光照射到的区域,那么就不会有红外光在这些区域内发生反射并被红外线传感器221接收到,从而这些区域就会成为触摸检测的盲区。为避免盲区的出现,既可以在红外光源21中尽量使用照明范围较大的发光元件,也可以通过多个发光元件来分别向待检测的触摸表面100提供红外光照明。It can be seen in the above touch detection process that if there are areas on the touch surface 100 to be detected that are not illuminated by infrared light, then there will be no infrared light reflected in these areas and received by the infrared sensor 221 , So these areas will become blind areas for touch detection. In order to avoid the occurrence of blind spots, light-emitting elements with a larger illumination range may be used as far as possible in the infrared light source 21, or multiple light-emitting elements may be used to provide infrared light illumination to the touch surface 100 to be detected.
图2是本公开又一实施例提供的显示装置的结构示意图。参见图2,在一个示例中,显示装置中的所述红外光源21包括第一发光元件211和第二发光元件212,第一发光元件211和第二发光元件212围绕在所述显示装置的显示区之外(图2中以分别位于显示面板的左右两侧作为示例)。如此,第一发光元件211和第二发光元件212可以分别向所述待检测的触摸表面100的不同区域提供红外光照明(不同发光元件的照明区域可以部分重叠)。在此基础之上,由于红外线传感器221无法分辨接收到的红外光来自于哪一个发光元件,因此在进行触摸检测时,可以使每个发光元件分别在不同时段内发光,并分别在不同时段内使用不同发光元件的位置数据(即表示上述红外线传感器与红外光源之间的位置关系的数据)来进行触摸检测,以分别得到不同照明区域下的深度图像数据,而最终的深度图 像可以通过整合各个照明区域下的深度图像数据来得到。FIG. 2 is a schematic structural diagram of a display device according to another embodiment of the present disclosure. 2, in an example, the infrared light source 21 in the display device includes a first light-emitting element 211 and a second light-emitting element 212, and the first light-emitting element 211 and the second light-emitting element 212 surround the display of the display device. Outside the area (Figure 2 is located on the left and right sides of the display panel as an example). In this way, the first light-emitting element 211 and the second light-emitting element 212 can respectively provide infrared light illumination to different areas of the touch surface 100 to be detected (the illumination areas of different light-emitting elements may partially overlap). On this basis, since the infrared sensor 221 cannot distinguish which light-emitting element the infrared light received comes from, it is possible to make each light-emitting element emit light in different periods of time during touch detection. The position data of different light-emitting elements (that is, the data representing the positional relationship between the infrared sensor and the infrared light source) are used for touch detection to obtain depth image data under different illumination areas, and the final depth image can be integrated by The depth image data under the illumination area is obtained.
在一个示例中,显示装置在每个检测周期内进行一次触摸检测,其中每个检测周期均包括第一时段和第二时段,第二时段的开始时刻在第一时段的结束时刻之后。参见图2,在第一时段内,第一发光元件211从图2中的左侧向待检测的触摸表面100提供红外光照明,此时可以通过采集每个红外线传感器221的传感信号来按照上文所述的过程检测照明区域内的待检测的触摸表面100;在第二时段内,第二发光元件212从图2中的右侧向待检测的触摸表面100提供红外光照明,此时可以通过采集每个红外线传感器221的传感信号来按照上文所述的过程检测照明区域内的待检测的触摸表面100。在第二时段结束之后,可以将两个发光元件的照明区域的重叠部分的深度图像数据进行整合(比如将基于同一红外线传感器221的传感信号先后检测得到的两个位置点所连成的线段的中点作为整合结果),从而与其他部分的深度图像数据合并为当前检测周期检测得到的深度图像。In an example, the display device performs touch detection once in each detection period, where each detection period includes a first period and a second period, and the start time of the second period is after the end time of the first period. Referring to FIG. 2, in the first time period, the first light-emitting element 211 provides infrared light illumination from the left side of FIG. 2 to the touch surface 100 to be detected. At this time, the sensing signal of each infrared sensor 221 can be collected according to the The process described above detects the touch surface 100 to be detected in the illumination area; in the second time period, the second light-emitting element 212 provides infrared light illumination to the touch surface 100 to be detected from the right side in FIG. The sensing signal of each infrared sensor 221 can be collected to detect the touch surface 100 to be detected in the illuminated area according to the above-mentioned process. After the second time period is over, the depth image data of the overlapping part of the illumination area of the two light-emitting elements can be integrated (for example, a line segment formed by connecting two position points sequentially detected based on the sensing signal of the same infrared sensor 221 As the integration result), it is combined with the depth image data of other parts into the depth image detected by the current detection cycle.
以此为例,所述红外光源21还可以包括多于两个的发光元件,这些发光元件可以围绕在显示装置的显示区之外,并可以通过在每个检测周期内逐个发光实现每一帧深度图像的检测。Taking this as an example, the infrared light source 21 may also include more than two light-emitting elements, which can surround the display area of the display device, and can realize each frame by emitting light one by one in each detection period. Detection of depth images.
图3是本公开又一实施例提供的显示装置的结构示意图。参见图3,所述显示装置中,上述红外光源21包括围绕在显示区A1之外的第一发光元件211、第二发光元件212、第三发光元件213以及第四发光元件214,第一发光元件211、第二发光元件212、第三发光元件213以及第四发光元件214均位于显示区A1以外的周边区A2内。此外,所述显示装置还包括发光控制电路24和触控电路25,其中发光控制电路24通过连接结构分别与每个发光元件相连,触控电路25通过连接结构与显示区A1内的每一所述红外线传感器221相连。在一个示例中,发光控制电路24可以基于与发光元件之间的连接向发光元件提供电流,并通过控制电流的通断和电流的大小来控制每个发光元件的发光状态。触控电路25可以基于与红外线传感器221之间的连接接收红外线传感器221采集到的传感信号,并由此实现上述触摸检测过程。此外,发光控制电路24和触控电路25可以使用相同的时钟信号,由此保证彼此之间的同步;在一个示例中,发光控制电路24 和触控电路25可以连接同一个时序控制器,并从该时序控制器处接收同步时钟信号。FIG. 3 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure. 3, in the display device, the infrared light source 21 includes a first light-emitting element 211, a second light-emitting element 212, a third light-emitting element 213, and a fourth light-emitting element 214 surrounding the display area A1. The element 211, the second light-emitting element 212, the third light-emitting element 213, and the fourth light-emitting element 214 are all located in the peripheral area A2 outside the display area A1. In addition, the display device further includes a light-emitting control circuit 24 and a touch circuit 25. The light-emitting control circuit 24 is connected to each light-emitting element through a connection structure, and the touch circuit 25 is connected to each light-emitting element in the display area A1 through the connection structure. The infrared sensor 221 is connected. In one example, the light emitting control circuit 24 may provide current to the light emitting elements based on the connection with the light emitting elements, and control the light emitting state of each light emitting element by controlling the on and off of the current and the magnitude of the current. The touch circuit 25 can receive the sensing signal collected by the infrared sensor 221 based on the connection with the infrared sensor 221, and thereby realize the above-mentioned touch detection process. In addition, the lighting control circuit 24 and the touch control circuit 25 can use the same clock signal, thereby ensuring synchronization between each other; in one example, the lighting control circuit 24 and the touch control circuit 25 can be connected to the same timing controller, and Receive the synchronous clock signal from the timing controller.
参见图1和图3,在一个示例中,所述显示装置的触摸检测的过程可以如下所述:显示装置在每个检测周期内进行一次触摸检测,相对应地,发光控制电路24在每个检测周期内控制每个发光元件逐个发光。以第一发光元件211发光的时段为例,触控电路25可以按照下述方式进行待检测的触摸表面100上每个照明区域内的检测:首先,触控电路25获取每一个红外线传感器221检测得到的第一距离。例如,触控电路25可以基于与每个红外线传感器221之间的连接同步接收每个红外线传感器221的传感信号,在对其进行整形、放大和滤波中的至少一个处理之后,触控电路25可以检测得到代表第一距离大小的数据。需要说明的是,红外线传感器221可以基于脉冲光源计算时间的方法、电荷累积计算时间的方法或是计算光的飞行时间的方法检测所述第一距离,并可以不仅限于此。应理解的是,红外线传感器221可能会因为接收不到红外光而生成电压幅值接近于零的传感信号,由此检测得到的大小接近于零的数据表示红外线传感器221没有检测到红外光。然后,触控电路25可以分别针对每个红外线传感器221,由所述第一距离、第二距离(红外线传感器221与正在发光的发光元件之间的距离)和接收角度(由光学结构231限制),确定到达所述红外线传感器221的红外光在所述待检测的触摸表面100上发生反射的位置。例如,对于图1中所示的接收角度为90°的情形,可以预先测量或估计传感层22与第一发光元件11之间的高度差H1作为固定参量,从而依据勾股定理得到计算关系L3 2+(L2-H1) 2=L1 2计算得到一张数据表格存储在触控电路25可以读取数据的存储器中,使得触控电路25可以通过查表的方式依据第一距离(即L1+L2)和红外线传感器221的位置标识(用来表示第二距离,其中第二距离即上述L3)来得到对应位置的深度数据(即上述L2),与红外线传感器221的位置标识对应存储在触摸检测结果的存储区域中。在完成针对每一红外线传感器221的处理之后,触摸检测结果的存储区域中会存储有若干个与红外线传感器221的位置标识对应的深度数据,其可以代表待检测的触控表面100上的若干个点在三维空间中相对于显示装置的位置(即可以绘制成上述深度图像)。 1 and 3, in an example, the touch detection process of the display device may be as follows: the display device performs a touch detection in each detection period, and correspondingly, the light-emitting control circuit 24 During the detection period, each light-emitting element is controlled to emit light one by one. Taking the time period during which the first light-emitting element 211 emits light as an example, the touch circuit 25 can perform detection in each illumination area on the touch surface 100 to be detected in the following manner: First, the touch circuit 25 obtains the detection of each infrared sensor 221 The first distance obtained. For example, the touch circuit 25 may receive the sensing signal of each infrared sensor 221 synchronously based on the connection between each infrared sensor 221, and after at least one of shaping, amplifying and filtering it, the touch circuit 25 The data representing the size of the first distance can be detected. It should be noted that the infrared sensor 221 may detect the first distance based on a pulse light source calculation time method, a charge accumulation calculation time method, or a light flight time calculation method, and it may not be limited thereto. It should be understood that the infrared sensor 221 may generate a sensor signal with a voltage amplitude close to zero because it cannot receive infrared light. The detected data close to zero indicates that the infrared sensor 221 does not detect infrared light. Then, the touch control circuit 25 can respectively target each infrared sensor 221 by the first distance, the second distance (the distance between the infrared sensor 221 and the light-emitting element that is emitting light), and the receiving angle (limited by the optical structure 231). , Determine the position where the infrared light reaching the infrared sensor 221 reflects on the touch surface 100 to be detected. For example, for the case where the receiving angle shown in FIG. 1 is 90°, the height difference H1 between the sensing layer 22 and the first light-emitting element 11 can be measured or estimated in advance as a fixed parameter, so as to obtain the calculation relationship according to the Pythagorean theorem L3 2 + (L2-H1) 2 = L1 2 is calculated to obtain a data table and stored in the memory where the touch circuit 25 can read the data, so that the touch circuit 25 can look up the table according to the first distance (ie L1 +L2) and the position identifier of the infrared sensor 221 (used to indicate the second distance, where the second distance is the above L3) to obtain the depth data of the corresponding position (that is, the above L2), and the position identifier of the infrared sensor 221 is stored in the touch In the storage area of the test results. After the processing for each infrared sensor 221 is completed, a number of depth data corresponding to the position identification of the infrared sensor 221 will be stored in the storage area of the touch detection result, which can represent a number of the touch surface 100 to be detected. The position of the point relative to the display device in the three-dimensional space (that is, it can be drawn as the aforementioned depth image).
在完成对应于每个所述发光元件的触摸检测之后,触控电路25可以整合分别对应于每个所述发光元件的检测结果,以得到所述待检测的触摸表面的检测结果。在一个示例中,触控电路25可以分别将对应不同发光元件的触摸检测结果存储在不同的存储区域中,以在完成对应于每个所述发光元件的触摸检测之后,将所有得到的触摸检测结果进行平均化处理。例如,可以将对应于同一红外线传感器221的位置标识的所有不为零的深度数据取平均。在又一示例中,触控电路25可以将对应不同发光元件的触摸检测结果存储在同一存储区域中。比如,可以在每个检测周期开始时,将每个红外线传感器221的位置标识对应存储的深度数据置零;在每次存储触摸检测结果检测时,判断红外线传感器221的位置标识是否已对应存储有不为零的深度数据;如果不存在,则直接存储所要存储的深度数据;如果存在,则将所要存储的深度数据与已存储的深度数据取平均后覆盖原有的深度数据。如此,可以在节省触摸检测结果的存储空间。After completing the touch detection corresponding to each of the light-emitting elements, the touch circuit 25 may integrate the detection results respectively corresponding to each of the light-emitting elements to obtain the detection result of the touch surface to be detected. In one example, the touch circuit 25 may store the touch detection results corresponding to different light-emitting elements in different storage areas, so that after the touch detection corresponding to each light-emitting element is completed, all the obtained touch detection results The results are averaged. For example, all the non-zero depth data corresponding to the position identification of the same infrared sensor 221 may be averaged. In another example, the touch control circuit 25 may store the touch detection results corresponding to different light-emitting elements in the same storage area. For example, at the beginning of each detection cycle, the position identifier of each infrared sensor 221 corresponding to the stored depth data can be set to zero; each time the touch detection result is detected, it is determined whether the position identifier of the infrared sensor 221 has been stored correspondingly. The depth data that is not zero; if it does not exist, the depth data to be stored is directly stored; if it exists, the depth data to be stored and the stored depth data are averaged and the original depth data is overwritten. In this way, the storage space of the touch detection result can be saved.
可以看出,通过多个发光元件在每个检测周期内逐个发光并分别进行触摸检测,可以在触摸检测过程互不干扰的同时得到同一检测周期内的多个触摸检测结果,这些触摸检测结果可以相互补充以减小触摸检测的盲区,也可以用来相互对照以消除错误数据和减少误差,实现效果更加理想的三维触摸检测。It can be seen that multiple light-emitting elements emit light one by one in each detection cycle and perform touch detection separately, and multiple touch detection results in the same detection cycle can be obtained without interfering with each other in the touch detection process. These touch detection results can be Complement each other to reduce the blind area of touch detection, and can also be used for mutual comparison to eliminate erroneous data and reduce errors, to achieve more ideal three-dimensional touch detection.
图4是本公开又一实施例提供的显示装置的结构示意图。参见图4,在一个示例中,所述显示装置包括第一基板27和第二基板28,还包括红外光源21、传感层22、光学结构层23和有机发光层,其中有机发光层包括若干个发光图形261、阴极结构层262和阳极结构层263,每个发光图形261均位于显示区A1之内,有机发光层、光学结构层23和传感层22在所述第一基板27和第二基板28之间依次层叠。其中,红外光源21位于显示区A1之外的周边区A2内,并与有机发光层位于第一基板27与所述第二基板28之间的同一层。在一个示例中,有机发光层中的阴极结构层中可以包括发光图形261的阴极,有机发光层中的阳极结构层263可以包括发光图形261的阳极,有机发光层的形状和构造可以参照任意一种有机发光二极管显示器件中衬底基板上的膜层形状和构造来实现,在此不再赘述。参见图4,在一个示例中,红外光源21包括与发光图形261同层的红外发光 材料层210,红外发光材料层210的阴极与发光图形261的阴极同层,红外发光材料层210的阳极与发光图形261的阳极同层,红外发光材料层210及其阳极、阴极组成所述红外光源21中的一个发光元件。即,可以在制作有机发光层时采用相同或相似的制作工艺形成所需要的红外光源21,以简化显示装置的内部结构和制作工艺。FIG. 4 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure. 4, in an example, the display device includes a first substrate 27 and a second substrate 28, and also includes an infrared light source 21, a sensing layer 22, an optical structure layer 23, and an organic light emitting layer, wherein the organic light emitting layer includes several A light-emitting pattern 261, a cathode structure layer 262, and an anode structure layer 263, each light-emitting pattern 261 is located in the display area A1, the organic light-emitting layer, the optical structure layer 23 and the sensing layer 22 are on the first substrate 27 and The two substrates 28 are stacked in sequence. The infrared light source 21 is located in the peripheral area A2 outside the display area A1, and is located in the same layer between the first substrate 27 and the second substrate 28 as the organic light-emitting layer. In one example, the cathode structure layer in the organic light-emitting layer may include the cathode of the light-emitting pattern 261, and the anode structure layer 263 in the organic light-emitting layer may include the anode of the light-emitting pattern 261. The shape and structure of the organic light-emitting layer may refer to any one. The shape and structure of the film layer on the base substrate in the organic light-emitting diode display device are realized, which will not be repeated here. 4, in an example, the infrared light source 21 includes an infrared light-emitting material layer 210 in the same layer as the light-emitting pattern 261, the cathode of the infrared light-emitting material layer 210 and the cathode of the light-emitting pattern 261 are the same layer, and the anode of the infrared light-emitting material layer 210 and The anode of the light-emitting pattern 261 is the same layer, and the infrared light-emitting material layer 210 and its anode and cathode constitute a light-emitting element in the infrared light source 21. That is, the same or similar manufacturing process can be used to form the required infrared light source 21 when manufacturing the organic light-emitting layer, so as to simplify the internal structure and manufacturing process of the display device.
参见图4,在一个示例中,在所述显示装置所在平面内,每个所述红外线传感器221的正投影均位于相邻两个所述发光图形261的正投影之间。例如,图4中的每个红外线传感器221的上方均为相邻两个发光图形261之间的空隙。由此,来自上方的红外光可以穿过发光图形261之间的空隙达到红外线传感器221,实现上述触摸检测的过程。基于此,相邻两个红外线传感器221之间的间距与相邻两个发光图形261之间的间距相当,更有利于实现高分辨率的触控检测。Referring to FIG. 4, in an example, in the plane where the display device is located, the orthographic projection of each infrared sensor 221 is located between the orthographic projections of two adjacent light-emitting patterns 261. For example, the upper part of each infrared sensor 221 in FIG. 4 is a gap between two adjacent light-emitting patterns 261. In this way, infrared light from above can pass through the gap between the light-emitting patterns 261 to reach the infrared sensor 221, so as to realize the above-mentioned touch detection process. Based on this, the distance between two adjacent infrared sensors 221 is equivalent to the distance between two adjacent light-emitting patterns 261, which is more conducive to high-resolution touch detection.
图5是本公开又一实施例提供的显示装置的结构示意图。参见图5,在一个示例中,所述显示装置包括第一基板27、第二基板28和第三基板29,还包括红外光源21、传感层22、光学结构层23和有机发光层,其中有机发光层包括若干个发光图形261、阴极结构层262和阳极结构层263,每个发光图形261均位于显示区之内,第二基板28位于第一基板27和第三基板29之间,有机发光层位于第一基板27和第二基板28之间,光学结构层23和传感层22位于第二基板28和第三基板29之间。在一个示例中,有机发光层中的阴极结构层中可以包括发光图形261的阴极,有机发光层中的阳极结构层263可以包括发光图形261的阳极,有机发光层的形状和构造可以参照任意一种有机发光二极管显示器件中衬底基板上的膜层形状和构造来实现,在此不再赘述。FIG. 5 is a schematic structural diagram of a display device provided by another embodiment of the present disclosure. Referring to FIG. 5, in an example, the display device includes a first substrate 27, a second substrate 28, and a third substrate 29, and further includes an infrared light source 21, a sensing layer 22, an optical structure layer 23, and an organic light emitting layer, wherein The organic light-emitting layer includes several light-emitting patterns 261, a cathode structure layer 262 and an anode structure layer 263. Each light-emitting pattern 261 is located in the display area. The second substrate 28 is located between the first substrate 27 and the third substrate 29. The light-emitting layer is located between the first substrate 27 and the second substrate 28, and the optical structure layer 23 and the sensing layer 22 are located between the second substrate 28 and the third substrate 29. In one example, the cathode structure layer in the organic light-emitting layer may include the cathode of the light-emitting pattern 261, and the anode structure layer 263 in the organic light-emitting layer may include the anode of the light-emitting pattern 261. The shape and structure of the organic light-emitting layer may refer to any one. The shape and structure of the film layer on the base substrate in the organic light-emitting diode display device are realized, which will not be repeated here.
参见图5,在一个示例中,光学结构层23包括分别位于传感层22在厚度方向上的两侧的第一光学结构层和第二光学结构层,而且红外光源21包括向显示装置正面(图5中的上方)提供红外光照明的第一发光元件211和第二发光元件212,还包括向显示装置背面(图5中的下方)提供红外光照明的第三发光元件213和第四发光元件214。如此,第一光学结构层中的光学结构和第二光学结构层中的光学结构可以分别在两个方向上限制到达红外线传感器221的红外光的入射角度,而四个发光元件可以如上文 所述的那样在每个检测周期内依次发光,以在不产生相互干扰的情况下同时实现显示装置正面的触摸检测和显示装置背面的触摸检测。以此为例,本公开实施例中的任意一种能够实现单面触摸检测的显示装置都可以参照图5所示的显示装置改造为能够实现双面触摸检测的显示装置,在此不再一一赘述。Referring to FIG. 5, in an example, the optical structure layer 23 includes a first optical structure layer and a second optical structure layer respectively located on both sides of the sensing layer 22 in the thickness direction, and the infrared light source 21 includes a front surface of the display device ( The upper part in FIG. 5) provides the first light-emitting element 211 and the second light-emitting element 212 for infrared light illumination, and also includes the third light-emitting element 213 and the fourth light-emitting element 213 and the fourth light-emitting element that provide infrared light to the back of the display device (lower part in FIG. 5) Component 214. In this way, the optical structure in the first optical structure layer and the optical structure in the second optical structure layer can respectively limit the incident angle of the infrared light reaching the infrared sensor 221 in two directions, and the four light-emitting elements can be as described above In this way, light is sequentially emitted in each detection cycle, so as to simultaneously realize touch detection on the front of the display device and touch detection on the back of the display device without mutual interference. Taking this as an example, any display device capable of realizing single-sided touch detection in the embodiments of the present disclosure can be transformed into a display device capable of realizing double-sided touch detection with reference to the display device shown in FIG. 5. A repeat.
参见图5,在一个示例中,在所述显示装置所在平面内,每个所述红外线传感器221的正投影均有部分位于相邻两个所述发光图形261的正投影之间。例如,图5中的每个红外线传感器221的上方均有至少一个相邻两个发光图形261之间的空隙。由此,来自上方的红外光可以穿过发光图形261之间的空隙达到红外线传感器221,实现上述触摸检测的过程。基于此,红外线传感器221以及光学结构231的尺寸可以不需要与显示装置的子像素宽度一致,相应的工艺要求和工艺难度可以得到降低。Referring to FIG. 5, in an example, in the plane where the display device is located, the orthographic projection of each infrared sensor 221 is partially located between the orthographic projections of two adjacent light-emitting patterns 261. For example, there is at least one gap between two adjacent light-emitting patterns 261 above each infrared sensor 221 in FIG. 5. In this way, infrared light from above can pass through the gap between the light-emitting patterns 261 to reach the infrared sensor 221, so as to realize the above-mentioned touch detection process. Based on this, the size of the infrared sensor 221 and the optical structure 231 may not need to be consistent with the sub-pixel width of the display device, and the corresponding process requirements and process difficulty can be reduced.
比照图4和图5可以看出的是,由于图4中的有机发光层、光学结构层23和传感层22均位于第一基板27和第二基板28之间,因此在工艺上需要在同一衬底基板上制作有机发光层、光学结构层23和传感层22中的每一个,如此对工艺水平的要求更高,但同时也更有利于显示装置的轻薄化。而由于图5中第二基板28位于第一基板27和第三基板29之间,有机发光层位于第一基板27和第二基板28之间,光学结构层23和传感层22位于第二基板28和第三基板29之间,因此在工艺上可以不需要在同一衬底基板上制作有机发光层、光学结构层23和传感层22中的每一个,如此虽然会使得显示装置相对更厚,但可以降低对工艺水平的要求。Comparing FIGS. 4 and 5, it can be seen that since the organic light-emitting layer, optical structure layer 23, and sensing layer 22 in FIG. 4 are all located between the first substrate 27 and the second substrate 28, the process needs to be Fabricating each of the organic light-emitting layer, the optical structure layer 23, and the sensing layer 22 on the same base substrate requires a higher level of technology, but at the same time, it is more conducive to the thinning of the display device. Since the second substrate 28 in FIG. 5 is located between the first substrate 27 and the third substrate 29, the organic light emitting layer is located between the first substrate 27 and the second substrate 28, and the optical structure layer 23 and the sensing layer 22 are located on the second substrate. Between the substrate 28 and the third substrate 29, there is no need to fabricate each of the organic light-emitting layer, the optical structure layer 23 and the sensing layer 22 on the same base substrate in the process, although this will make the display device relatively more Thick, but can reduce the requirements on the level of process.
可以看出,本公开实施例中的红外光源、传感层和光学结构层能够相互配合地检测得到红外光在待检测的触摸表面发生反射的位置,从而实现手指靠近显示装置时手指表面的检测。相比于需要使用摄像器件的深度检测技术,本公开实施例提供的深度检测方式无需引入图像处理模组或是复杂的CMOS器件制作工艺,所需要的结构和制作工艺更加简单。It can be seen that the infrared light source, the sensing layer and the optical structure layer in the embodiments of the present disclosure can cooperate with each other to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device . Compared with the depth detection technology that requires the use of a camera device, the depth detection method provided by the embodiments of the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
需要说明的是,本公开实施例中的显示装置可以为:显示面板、手机、平板电脑、电视机、显示器、笔记本电脑、数码相框、导航仪等任何具有显示功能的产品或部件。It should be noted that the display device in the embodiment of the present disclosure may be any product or component with display function, such as a display panel, a mobile phone, a tablet computer, a television, a monitor, a notebook computer, a digital photo frame, a navigator, and the like.
图6是本公开一个实施例提供的显示装置的触摸检测方法的流程示意 图。所述显示装置可以是上述显示装置中的任意一种。参见图6,所述方法可以包括下述步骤流程。Fig. 6 is a schematic flowchart of a touch detection method of a display device provided by an embodiment of the present disclosure. The display device may be any one of the above-mentioned display devices. Referring to Fig. 6, the method may include the following steps.
在步骤601中,控制红外光源向触摸表面提供红外光照明。In step 601, the infrared light source is controlled to provide infrared light illumination to the touch surface.
在步骤602中,获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离。In step 602, the first distance detected by each of the plurality of infrared sensors is acquired.
在步骤603中,分别针对每个红外线传感器,由第一距离、第二距离和接收角度确定到达红外线传感器的红外光在待检测的触摸表面上发生反射的位置。In step 603, for each infrared sensor, the first distance, the second distance, and the receiving angle are used to determine the position where the infrared light reaching the infrared sensor reflects on the touch surface to be detected.
其中,所述红外光源位于所述显示装置的显示区之外。所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是红外光从所述红外光源出发并在所述待检测的触摸表面上反射后到达所述红外线传感器的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧。所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the infrared light source is located outside the display area of the display device. The plurality of infrared sensors are distributed within the display area of the display device, and the first distance is that infrared light starts from the infrared light source and reaches the infrared light after being reflected on the touch surface to be detected The propagation distance of the sensor and the incident angle of the infrared light reaching each of the infrared sensors are limited by a corresponding optical structure, and each optical structure is located in the display device of a corresponding infrared sensor. One side in the thickness direction. The second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
在一种可能的实现方式中,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外;相对应地,所述通过红外光源向所述触摸表面提供红外光照明,包括:在每个检测周期内,控制所述至少两个发光元件逐个发光,以得到分别对应于每个所述发光元件的检测结果;相对应地,所述触摸检测方法还包括:整合分别对应于每个所述发光元件的检测结果,以得到所述待检测的触摸表面的检测结果。In a possible implementation, the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device; correspondingly, the infrared light source is directed toward the The provision of infrared light illumination on the touch surface includes: controlling the at least two light-emitting elements to emit light one by one in each detection period to obtain detection results corresponding to each of the light-emitting elements; correspondingly, the touch The detection method further includes: integrating the detection results respectively corresponding to each of the light-emitting elements to obtain the detection result of the touch surface to be detected.
应当理解的是,上文中已经包含了本实施例的方法的可选实现方式和相关说明,故在此不再赘述。It should be understood that the optional implementation manners and related descriptions of the method of this embodiment have already been included in the foregoing, so they will not be repeated here.
图7是本公开一个实施例提供的显示装置的触摸检测设备的结构框图。参见图7,所述显示装置可以是上述显示装置中的任意一种。参见图7,所述触摸检测设备可以包括下述结构。Fig. 7 is a structural block diagram of a touch detection device of a display device according to an embodiment of the present disclosure. Referring to FIG. 7, the display device may be any of the above-mentioned display devices. Referring to FIG. 7, the touch detection device may include the following structure.
发光控制模块71,用于控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所述显示装置的显示区之外.The light-emitting control module 71 is used to control an infrared light source to provide infrared light illumination to the touch surface, the infrared light source is located outside the display area of the display device.
检测模块72,用于获取若干个红外线传感器中的每一个红外线传感器 检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是红外光从所述红外光源出发并在所述待检测的触摸表面上反射后到达该红外线传感器的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧.The detection module 72 is configured to obtain a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors are distributed in the display area of the display device, and the first distance is The infrared light starts from the infrared light source and is reflected on the touch surface to be detected to reach the propagation distance of the infrared sensor. The incident angle of the infrared light reaching each infrared sensor is determined by a corresponding optical structure. Restriction, each of the optical structures is located on one side of the thickness direction of the corresponding infrared sensor in the display device.
处理模块73,用于分别针对每个红外线传感器由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。The processing module 73 is configured to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance, and the receiving angle for each infrared sensor; wherein, The second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
在一种可能的实现方式中,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外;相对应地,所述发光控制模块71进一步用于:在每个检测周期内,控制所述至少两个发光元件逐个发光,以得到分别对应于每个所述发光元件的检测结果;相对应地,所述设备还包括:整合模块,用于整合分别对应于每个所述发光元件的检测结果,以得到完整的所述待检测的触摸表面的检测结果。In a possible implementation, the infrared light source includes at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device; correspondingly, the light-emitting control module 71 further Used for: controlling the at least two light-emitting elements to emit light one by one in each detection period to obtain the detection results corresponding to each of the light-emitting elements; correspondingly, the device further includes: an integration module for The integration corresponds to the detection results of each of the light-emitting elements to obtain a complete detection result of the touch surface to be detected.
应当理解的是,上文中已经包含了本实施例的触摸检测设备的可选实现方式和相关说明,故在此不再赘述。It should be understood that the above has already included the optional implementation manners and related descriptions of the touch detection device of this embodiment, so they will not be repeated here.
图8是本公开又一实施例提供的显示装置的触摸检测设备的结构框图。参见图8,所述显示装置可以是上述显示装置中的任意一种。参见图8,所述触摸检测设备可以包括处理器81和用于存储所述处理器可执行指令的存储器82。,所述处理器81配置为调用所述存储器82中的程序指令以执行上述任意一种显示装置的触摸检测方法。FIG. 8 is a structural block diagram of a touch detection device of a display device according to another embodiment of the present disclosure. Referring to FIG. 8, the display device may be any one of the above-mentioned display devices. Referring to FIG. 8, the touch detection device may include a processor 81 and a memory 82 for storing instructions executable by the processor. The processor 81 is configured to call the program instructions in the memory 82 to execute any one of the touch detection methods of the display device described above.
处理器81可以包括中央处理器(CPU,单核或者多核),图形处理器(GPU),微处理器,特定应用集成电路(Application-Specific Integrated Circuit,ASIC),数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器,或者多个用于控制程序执行的集成电路。The processor 81 may include a central processing unit (CPU, single-core or multi-core), a graphics processing unit (GPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), a digital signal processor (DSP), Digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, or multiple integrated circuits used to control program execution.
存储器82可以包括只读存储器(Read-Only Memory,ROM)或可存 储静态信息和指令的其他类型的静态存储设备,随机存取存储器(Random Access Memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以包括电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。存储器可以是独立设置的,也可以和处理器集成在一起。The memory 82 may include read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (Random Access Memory, RAM), or other types that can store information and instructions The dynamic storage device can also include electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disc storage, optical disc storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this. The memory can be set independently or integrated with the processor.
本公开的实施例还提供了一种计算机存储介质,用于储存为上述任意一种显示装置的触摸检测方法所用的计算机程序,所述计算机程序包括程序指令。通过执行存储的程序,可以实现本公开提供的上述任意一种显示装置的触摸检测方法。The embodiment of the present disclosure also provides a computer storage medium for storing a computer program used in any of the above-mentioned touch detection methods of a display device, the computer program including program instructions. By executing the stored program, the touch detection method of any of the above-mentioned display devices provided in the present disclosure can be realized.
可以看出,本公开实施例中的红外光源、传感层和光学结构层能够相互配合地检测得到红外光在待检测的触摸表面发生反射的位置,从而实现手指靠近显示装置时手指表面的检测。相比于需要使用摄像器件的深度检测技术,本公开实施例提供的深度检测方式无需引入图像处理模组或是复杂的CMOS器件制作工艺,所需要的结构和制作工艺更加简单。It can be seen that the infrared light source, the sensing layer and the optical structure layer in the embodiments of the present disclosure can cooperate with each other to detect the position where the infrared light reflects on the touch surface to be detected, thereby realizing the detection of the finger surface when the finger approaches the display device . Compared with the depth detection technology that requires the use of a camera device, the depth detection method provided by the embodiments of the present disclosure does not need to introduce an image processing module or a complicated CMOS device manufacturing process, and the required structure and manufacturing process are simpler.
以上所述仅为本公开的示例性实施例,并不用以限制本公开,凡在本公开的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本公开的保护范围之内。The above are only exemplary embodiments of the present disclosure, and are not intended to limit the present disclosure. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the protection of the present disclosure. Within range.

Claims (15)

  1. 一种显示装置,其特征在于,所述显示装置包括:A display device, characterized in that the display device comprises:
    红外光源,位于所述显示装置的显示区之外,所述红外光源用于为待检测的触摸表面提供红外光照明;An infrared light source located outside the display area of the display device, and the infrared light source is used to provide infrared light illumination for the touch surface to be detected;
    传感层,包括分布在所述显示区之内的若干个红外线传感器,所述红外线传感器用于检测第一距离,所述第一距离是由所述红外光源发出并在所述待检测的触摸表面上反射后到达所述红外线传感器的红外光的传播距离;The sensing layer includes a plurality of infrared sensors distributed in the display area, and the infrared sensor is used to detect a first distance, and the first distance is emitted by the infrared light source and displayed on the touch to be detected. The propagation distance of the infrared light that reaches the infrared sensor after being reflected on the surface;
    光学结构层,位于所述传感层的厚度方向上的至少一侧,所述光学结构层包括若干个光学结构,每个所述光学结构位于相对应的一个所述红外线传感器的厚度方向上的一侧,所述光学结构用于限制到达相对应的所述红外线传感器的红外光的入射角度。The optical structure layer is located on at least one side of the thickness direction of the sensing layer, and the optical structure layer includes a plurality of optical structures, and each of the optical structures is located in the thickness direction of a corresponding infrared sensor. On one side, the optical structure is used to limit the incident angle of infrared light reaching the corresponding infrared sensor.
  2. 根据权利要求1所述的显示装置,其特征在于,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外。The display device according to claim 1, wherein the infrared light source comprises at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device.
  3. 根据权利要求2所述的显示装置,其特征在于,所述红外光源还包括分别连接每个发光元件的发光控制电路,所述发光控制电路用于在每个检测周期内控制所述至少两个发光元件逐个发光。The display device according to claim 2, wherein the infrared light source further comprises a light-emitting control circuit respectively connected to each light-emitting element, and the light-emitting control circuit is used to control the at least two light-emitting elements in each detection period. The light-emitting elements emit light one by one.
  4. 根据权利要求1所述的显示装置,其特征在于,所述显示装置还包括触控电路,每个所述红外传感器均与所述触控电路相连,The display device of claim 1, wherein the display device further comprises a touch circuit, and each of the infrared sensors is connected to the touch circuit,
    所述触控电路用于分别针对每个红外线传感器由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;The touch control circuit is used to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance and the receiving angle for each infrared sensor;
    其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  5. 根据权利要求1所述的显示装置,其特征在于,所述显示装置包括有机 发光层,所述有机发光层包括若干个位于所述显示区之内的发光图形;The display device according to claim 1, wherein the display device comprises an organic light-emitting layer, and the organic light-emitting layer comprises a plurality of light-emitting patterns located in the display area;
    在所述显示装置所在平面内,每个所述红外线传感器的正投影均有至少一部分位于相邻两个所述发光图形的正投影之间。In the plane where the display device is located, at least a part of the orthographic projection of each infrared sensor is located between the orthographic projections of two adjacent light-emitting patterns.
  6. 根据权利要求5所述的显示装置,其特征在于,在所述显示装置所在平面内,每个所述红外线传感器的正投影均位于相邻两个所述发光图形的正投影之间。5. The display device of claim 5, wherein in the plane where the display device is located, the orthographic projection of each infrared sensor is located between the orthographic projections of two adjacent light-emitting patterns.
  7. 根据权利要求1至6中任一项所述的显示装置,其特征在于,所述显示装置还包括第一基板、第二基板和有机发光层,所述有机发光层、所述光学结构层和所述传感层在所述第一基板和所述第二基板之间依次层叠。The display device according to any one of claims 1 to 6, wherein the display device further comprises a first substrate, a second substrate and an organic light emitting layer, the organic light emitting layer, the optical structure layer and The sensing layer is sequentially laminated between the first substrate and the second substrate.
  8. 根据权利要求7所述的显示装置,其特征在于,所述红外光源与所述有机发光层位于所述第一基板与所述第二基板之间的同一层。8. The display device according to claim 7, wherein the infrared light source and the organic light emitting layer are located in the same layer between the first substrate and the second substrate.
  9. 根据权利要求1至6中任一项所述的显示装置,其特征在于,所述显示装置还包括第一基板、第二基板、第三基板和有机发光层,所述第二基板位于所述第一基板和所述第三基板之间,所述有机发光层位于所述第一基板和所述第二基板之间,所述光学结构层和所述传感层位于所述第二基板和所述第三基板之间。The display device according to any one of claims 1 to 6, wherein the display device further comprises a first substrate, a second substrate, a third substrate and an organic light emitting layer, and the second substrate is located on the Between the first substrate and the third substrate, the organic light-emitting layer is located between the first substrate and the second substrate, and the optical structure layer and the sensing layer are located between the second substrate and the second substrate. Between the third substrate.
  10. 一种显示装置的触摸检测方法,其特征在于,所述方法包括:A touch detection method for a display device, characterized in that the method includes:
    控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所述显示装置的显示区之外;Controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
    获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是由所述红外光源发出并在所述待检测的触摸表面上反射后到达所述红外线传感器的红外光的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧;Acquire a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is emitted by the infrared light source And the propagation distance of the infrared light reaching the infrared sensor after being reflected on the touch surface to be detected, the incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure, each The optical structure is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
    分别针对每个红外线传感器,由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;For each infrared sensor, the position at which the infrared light reaching the infrared sensor is reflected on the touch surface to be detected is determined by the first distance, the second distance, and the receiving angle;
    其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  11. 根据权利要求10所述的方法,其特征在于,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外;The method according to claim 10, wherein the infrared light source comprises at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device;
    相对应地,所述通过红外光源向所述触摸表面提供红外光照明,包括:Correspondingly, the providing infrared light illumination to the touch surface through an infrared light source includes:
    在每个检测周期内,控制所述至少两个发光元件逐个发光,以得到分别对应于每个所述发光元件的检测结果;In each detection period, controlling the at least two light-emitting elements to emit light one by one to obtain a detection result corresponding to each of the light-emitting elements;
    相对应地,所述方法还包括:Correspondingly, the method further includes:
    整合分别对应于每个所述发光元件的检测结果,以得到所述待检测的触摸表面的检测结果。The detection results respectively corresponding to each of the light-emitting elements are integrated to obtain the detection results of the touch surface to be detected.
  12. 一种显示装置的触摸检测设备,其特征在于,所述设备包括:A touch detection device for a display device, wherein the device includes:
    发光控制模块,用于控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所述显示装置的显示区之外;A light emission control module for controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
    检测模块,用于获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是由所述红外光源发出并在所述待检测的触摸表面上反射后到达所述红外线传感器的红外光的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧;The detection module is used to obtain the first distance detected by each infrared sensor of a plurality of infrared sensors, the plurality of infrared sensors are distributed in the display area of the display device, and the first distance is determined by The propagation distance of the infrared light emitted by the infrared light source and reflected on the touch surface to be detected and reaching the infrared sensor, the incident angle of the infrared light reaching each infrared sensor is determined by a corresponding optical structure By limitation, each of the optical structures is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
    处理模块,用于分别针对每个红外线传感器由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;A processing module, configured to determine the position where the infrared light reaching the infrared sensor is reflected on the touch surface to be detected from the first distance, the second distance, and the receiving angle for each infrared sensor;
    其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  13. 根据权利要求12所述的设备,其特征在于,所述红外光源包括至少两个发光元件,所述至少两个发光元件围绕在所述显示装置的显示区之外;The device according to claim 12, wherein the infrared light source comprises at least two light-emitting elements, and the at least two light-emitting elements surround the display area of the display device;
    相对应地,所述发光控制模块进一步用于:Correspondingly, the light emission control module is further used for:
    在每个检测周期内,控制所述至少两个发光元件逐个发光,以得到分别对应于每个所述发光元件的检测结果;In each detection period, controlling the at least two light-emitting elements to emit light one by one to obtain a detection result corresponding to each of the light-emitting elements;
    相对应地,所述设备还包括:Correspondingly, the device further includes:
    整合模块,用于整合分别对应于每个所述发光元件的检测结果,以得到完整的所述待检测的触摸表面的检测结果。The integration module is used to integrate the detection results respectively corresponding to each of the light-emitting elements to obtain a complete detection result of the touch surface to be detected.
  14. 一种显示装置的触摸检测设备,其特征在于,所述设备包括:A touch detection device for a display device, wherein the device includes:
    处理器;processor;
    用于存储所述处理器可执行指令的存储器;A memory for storing executable instructions of the processor;
    其中,所述处理器被配置为:Wherein, the processor is configured to:
    控制红外光源向所述触摸表面提供红外光照明,所述红外光源位于所述显示装置的显示区之外;Controlling an infrared light source to provide infrared light illumination to the touch surface, the infrared light source being located outside the display area of the display device;
    获取若干个红外线传感器中的每一个红外线传感器检测得到的第一距离,所述若干个红外线传感器分布在所述显示装置的所述显示区之内,所述第一距离是由所述红外光源发出并在所述待检测的触摸表面上反射后到达所述红外线传感器的红外光的传播距离,到达每个所述红外线传感器的红外光的入射角度均由相对应的一个光学结构所限制,每个所述光学结构位于所述显示装置中相对应的一个所述红外线传感器的厚度方向上的一侧;Acquire a first distance detected by each of a plurality of infrared sensors, the plurality of infrared sensors are distributed within the display area of the display device, and the first distance is emitted by the infrared light source And the propagation distance of the infrared light reaching the infrared sensor after being reflected on the touch surface to be detected, the incident angle of the infrared light reaching each infrared sensor is limited by a corresponding optical structure, each The optical structure is located on one side in the thickness direction of the corresponding one of the infrared sensors in the display device;
    分别针对每个红外线传感器,由所述第一距离、第二距离和接收角度确定到达所述红外线传感器的红外光在所述待检测的触摸表面上发生反射的位置;For each infrared sensor, the position at which the infrared light reaching the infrared sensor is reflected on the touch surface to be detected is determined by the first distance, the second distance, and the receiving angle;
    其中,所述第二距离是所述红外线传感器与所述红外光源之间的距离,所述接收角度是由所述光学结构限制的所述红外线传感器接收到的红外光的入射角度。Wherein, the second distance is the distance between the infrared sensor and the infrared light source, and the receiving angle is the incident angle of the infrared light received by the infrared sensor limited by the optical structure.
  15. 一种非易失性的计算机可读存储介质,其特征在于,所述存储介质上存储有可执行指令,所述可执行指令被执行时实现如权利要求10或11所述的 方法。A non-volatile computer-readable storage medium, characterized in that executable instructions are stored on the storage medium, and the executable instructions implement the method according to claim 10 or 11 when executed.
PCT/CN2020/076799 2019-04-23 2020-02-26 Display device, and touch detection method and device WO2020215885A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910330439.3 2019-04-23
CN201910330439.3A CN110058742B (en) 2019-04-23 2019-04-23 Display device, touch detection method and device

Publications (1)

Publication Number Publication Date
WO2020215885A1 true WO2020215885A1 (en) 2020-10-29

Family

ID=67320265

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/076799 WO2020215885A1 (en) 2019-04-23 2020-02-26 Display device, and touch detection method and device

Country Status (2)

Country Link
CN (1) CN110058742B (en)
WO (1) WO2020215885A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110058742B (en) * 2019-04-23 2021-01-26 京东方科技集团股份有限公司 Display device, touch detection method and device
CN111078045A (en) * 2019-11-29 2020-04-28 京东方科技集团股份有限公司 Display device and touch detection method thereof
CN112527156B (en) * 2020-12-25 2022-04-12 广州长嘉电子有限公司 Infrared multi-point touch identification method, device and system based on conference tablet
CN112882594B (en) * 2020-12-31 2023-12-22 安徽鸿程光电有限公司 Touch device, positioning method, device and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101819490A (en) * 2009-02-27 2010-09-01 索尼公司 Reflection detection apparatus, display apparatus, electronic apparatus, and reflection detection method
CN102520826A (en) * 2011-08-18 2012-06-27 友达光电股份有限公司 Display and method for judging position of indicator of three-dimensional interactive stereoscopic display
CN102736794A (en) * 2011-04-15 2012-10-17 原相科技股份有限公司 Optical touch pad, handheld electronic device and method
US20120268426A1 (en) * 2011-04-25 2012-10-25 Samsung Electronics Co., Ltd. Apparatus to sense touching and proximate objects
CN107491227A (en) * 2017-07-14 2017-12-19 北京汇冠触摸技术有限公司 A kind of touch recognition device and method realized by optical ranging
CN110058742A (en) * 2019-04-23 2019-07-26 京东方科技集团股份有限公司 Display device, touch detecting method and device

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8970589B2 (en) * 2011-02-10 2015-03-03 Edge 3 Technologies, Inc. Near-touch interaction with a stereo camera grid structured tessellations
CN109154869B (en) * 2016-06-07 2021-02-05 深圳市汇顶科技股份有限公司 Optical collimator of optical sensor module under screen for on-screen fingerprint sensing
CN107505753B (en) * 2017-09-15 2020-06-05 京东方科技集团股份有限公司 Array substrate and display device
CN107704125A (en) * 2017-09-20 2018-02-16 上海斯雷迪数字科技有限公司 Touch location device and 3D touches interactive system
CN107742631B (en) * 2017-10-26 2020-02-14 京东方科技集团股份有限公司 Depth imaging device, display panel, method of manufacturing depth imaging device, and apparatus
CN108428725B (en) * 2018-03-30 2021-07-09 上海天马有机发光显示技术有限公司 Array substrate, manufacturing method of array substrate, display panel and display device
CN109146945B (en) * 2018-08-02 2021-01-26 京东方科技集团股份有限公司 Display panel and display device
CN109074491B (en) * 2018-08-02 2021-03-19 深圳市汇顶科技股份有限公司 Under-screen biological feature recognition device and electronic equipment
CN109040363B (en) * 2018-08-10 2024-03-19 Oppo广东移动通信有限公司 Display screen, electronic device and three-dimensional feature recognition method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101819490A (en) * 2009-02-27 2010-09-01 索尼公司 Reflection detection apparatus, display apparatus, electronic apparatus, and reflection detection method
CN102736794A (en) * 2011-04-15 2012-10-17 原相科技股份有限公司 Optical touch pad, handheld electronic device and method
US20120268426A1 (en) * 2011-04-25 2012-10-25 Samsung Electronics Co., Ltd. Apparatus to sense touching and proximate objects
CN102520826A (en) * 2011-08-18 2012-06-27 友达光电股份有限公司 Display and method for judging position of indicator of three-dimensional interactive stereoscopic display
CN107491227A (en) * 2017-07-14 2017-12-19 北京汇冠触摸技术有限公司 A kind of touch recognition device and method realized by optical ranging
CN110058742A (en) * 2019-04-23 2019-07-26 京东方科技集团股份有限公司 Display device, touch detecting method and device

Also Published As

Publication number Publication date
CN110058742A (en) 2019-07-26
CN110058742B (en) 2021-01-26

Similar Documents

Publication Publication Date Title
WO2020215885A1 (en) Display device, and touch detection method and device
CN102538758B (en) Plural detector time-of-flight depth mapping
US10094927B2 (en) Detector for optically determining a position of at least one object
US9729860B2 (en) Indirect reflection suppression in depth imaging
US9978147B2 (en) System and method for calibration of a depth camera system
EP2590057B1 (en) 3D optical input system and operating method
WO2021120402A1 (en) Fused depth measurement apparatus and measurement method
WO2021212917A1 (en) Device and method for measuring tof depth
JP2011038916A (en) Detector, display apparatus, and method for measuring proximal distance of object
TWI558982B (en) Optical sensor and optical sensor system
CN109146945B (en) Display panel and display device
US9317137B2 (en) Optical touch detection module, projection system with optical touch detection module, and method of optical touch detection module
US20150077399A1 (en) Spatial coordinate identification device
US10055881B2 (en) Video imaging to assess specularity
WO2013035553A1 (en) User interface display device
US20120044213A1 (en) Optical Touch Display System
TWI430151B (en) Touch device and touch method
CN107077196B (en) Identifying objects on a touch-sensitive surface
US20150185321A1 (en) Image Display Device
TWI439906B (en) Sensing system
US10725551B2 (en) Three-dimensional touch sensing method, three-dimensional display device and wearable device
US20210110130A1 (en) Electronic device including point detector and biometric information obtaining method using the same
US11637149B2 (en) Array substrate, display device and spatial positioning method of display device
JP2017139012A (en) Input device, aerial image interaction system, and input method
JP2010519605A (en) Interactive display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20794834

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20794834

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20794834

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 04.05.2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20794834

Country of ref document: EP

Kind code of ref document: A1