JP6584898B2 - Display with position detection function in 3D space - Google Patents

Description

  The present invention relates to a display with a position detection function in a three-dimensional space that can easily and inexpensively detect the position of a detection target in a three-dimensional space defined in front of the display.

  There is a naked-eye 3D display technology that can perform stereoscopic display with the naked eye without using special glasses. When this technique is applied, image data for optimal display differs depending on the viewing position. For this reason, a function for detecting / tracking the viewing position and realizing optimum display may be provided on the display device side (see, for example, Non-Patent Document 1).

  FIG. 8 is an explanatory diagram related to a viewing position detection / tracking technique in Non-Patent Document 1. In Non-Patent Document 1, the front surface of a display image is photographed with a small camera attached to a display device, and the image is analyzed to detect and track the viewer's head and the like.

  In addition to the method using a small camera as described above, there is an attempt to add a thin film optical sensor to a display (for example, see Non-Patent Documents 2 and 3). FIG. 9 is a diagram illustrating a specific example in which a thin film photosensor is added to a display in Non-Patent Document 2, and FIG. 10 is a diagram illustrating a specific example in which a thin film photosensor is added to a display in Non-Patent Document 3. is there.

  When adding a thin film photosensor to a display, a thin film photosensor is embedded in all or some of the display pixels, a part of the display pixel is replaced with a thin film photosensor pixel, and a display pixel and a thin film photosensor pixel are mixed. Attempts have been made to provide a separate pixel having only a thin film photosensor. Thin film photosensor arrays have application examples for contact image scanners, fingerprint sensors, and the like.

"Seeing things in three dimensions" National Institute of Informatics Hironobu Gotoda Fingerprint sensing techniques (Dr. Hsu, Wen-Hsing), http: // fingerchip. pagesperso-orange. fr / biometrics / types / fingerprint_sensors_physics. htm IEICE 2014 General Meeting [C-9-5], “Frequency Modulation Output Thin Film Photosensor”

However, the prior art has the following problems.
As described above, the thin film light sensor incorporated in the display is applied to information input when a detection target is brought into close contact with a display such as a fingerprint sensor or a touch. However, unlike the case of non-contact information input such as Hover input, or a CCD or CMOS image sensor in a normal camera, a subject at a distant position is photographed, and the image is analyzed to obtain input information. It is not applied for the purpose. Therefore, there is no application example of the thin film light sensor in the naked-eye 3D display.

  Further, as in Non-Patent Document 1, when a small camera is attached to a display device and an image is captured on the front surface of the display, there are problems of increase in size and cost associated with the equipment.

  Here, problems in the prior art in which a thin film photosensor is incorporated in a display will be described. In the prior art, the upper portion of the thin film photosensor has been widely opened in order to obtain more incident light. For this reason, light from a wide range of directions is incident on one thin film optical sensor.

  That is, in a thin film photosensor array, when an object is located at a position distant from the thin film photosensor array, a very wide range of information on the object is incident on one thin film photosensor, thereby forming an image of the object. It was difficult. If it is a normal camera, it is the same as the state which is not in focus at all.

  Unlike a normal camera, it is difficult to install a condensing lens in front of the display, which is also a major factor that hinders the capture of fine images in the thin film photosensor array.

  Furthermore, in the case of a normal camera, an information acquisition method based on image processing such as analyzing a captured high-definition image and extracting necessary information is applied. However, in the case of a thin film optical sensor incorporated in a display, such a conventional image processing-based information acquisition method is difficult to apply.

  That is, in order to realize a position detection function in a three-dimensional space using a thin film photosensor, conventional thin film photosensors are given directivity for light detection, and further, conventional image processing that matches the characteristics of the thin film photosensor. It is necessary to apply a position detection method different from the base method.

  The present invention has been made to solve the above-described problems, and improves the light collection characteristics of a thin film photosensor, and in a device using a display in which the improved thin film photosensor is incorporated. It is an object of the present invention to obtain a display with a position detection function in a three-dimensional space that can realize the position detection of a detection target in a three-dimensional space defined in front.

  The display with a position detection function in a three-dimensional space according to the present invention includes a photoelectric conversion region, performs light detection according to the amount of light received in the photoelectric conversion region, and detects light above the photoelectric conversion region which is a light receiving surface. A thin film photosensor further comprising a structure for providing directivity to the display is a display in which a plurality of thin film photosensors are arranged so as to have a columnar arrangement in an arbitrary edge region, and in a plane facing the light receiving surface in the manufacturing stage Thus, by displacing the relative positional relationship of the structure with respect to the photoelectric conversion region to a desired position, a plurality of arranged thin film lights in which the main detection direction of light detection with directivity is set to the desired direction Each thin film light sensor in a three-dimensional detection space defined in the space in front of the display by the main detection direction of each thin film light sensor set in a desired direction with the display having the sensor Based on the detection result by the combination, in which and a detector for identifying the position of the detection object in the three-dimensional detection space.

  According to the present invention, it is possible to realize a thin film photosensor having a structure for imparting directivity to light detection, and by embedding a column by the thin film photosensor in a pixel column on the edge of the display, a tertiary defined in front of the display. A display having a position detection function in the original space can be realized. As a result, the light-collecting characteristics of the thin-film photosensor are improved, and the position of the target to be detected in the three-dimensional space defined in front of the display is realized in equipment using a display incorporating the improved thin-film photosensor. It is possible to obtain a thin film photosensor and a display with a position detection function in a three-dimensional space.

It is the figure which showed the structural example of the thin film optical sensor which has the directivity of light detection in Embodiment 1 of this invention. In the thin film optical sensor which concerns on Embodiment 1 of this invention, it is explanatory drawing which showed the method of setting the directivity of light detection to a desired direction by displacing the position of a micropore. It is the figure which showed the light detection characteristic (1) in various conditions of the thin film photosensor which provided the light detection directivity in Embodiment 1 of this invention. It is the figure which showed the light detection characteristic (2) in various conditions of the thin film optical sensor which provided the light detection directivity in Embodiment 1 of this invention. It is the figure which showed the 1st Example of the position detection in the three-dimensional space ahead of a display in the display incorporating the thin film optical sensor which has the light detection directivity based on Embodiment 1 of this invention. It is the figure which showed the 2nd Example of the position detection in the three-dimensional space ahead of a display in the display incorporating the thin film optical sensor which has the light detection directivity based on Embodiment 1 of this invention. It is the figure which showed the 3rd Example of the position detection in the three-dimensional space ahead of a display in the display incorporating the thin film optical sensor which has the light detection directivity based on Embodiment 1 of this invention. It is explanatory drawing regarding the detection and tracking technique of the viewing-and-listening position in a nonpatent literature 1. It is the figure which showed the specific example which added the thin film photosensor to the display in the nonpatent literature 2. FIG. It is the figure which showed the specific example which added the thin film photosensor in the nonpatent literature 3 to the display.

Hereinafter, preferred embodiments of a display with a position detection function in a three-dimensional space of the present invention will be described with reference to the drawings.
The present invention provides a function of detecting the position of an object in a three-dimensional space on the front surface of a display based on the provision of light detection directivity in a thin film photosensor embedded in a display and the thin film photosensor provided with directivity. Realization is a technical feature.

Embodiment 1 FIG.
FIG. 1 is a diagram showing an example of the structure of a thin-film photosensor having photodetection directivity in Embodiment 1 of the present invention. The thin film photosensor element 10 shown in FIG. 1 includes a first conductive region 11 (portion shown by oblique hatching) corresponding to an N-type region and the like, and a second conductive region 12 (vertical portion) corresponding to a P-type region and the like. And a photoelectric conversion region 13 (portion shown in white) corresponding to a depletion layer of a PN junction and the like.

And in order to give directivity, in this Embodiment 1, as shown to Fig.1 (a) above the photoelectric conversion area | region 13 in the thin film photosensor element 10, the micropore 21 is formed. The structure 30 (hereinafter, the concave lens structure 30) having the light shielding layer 20 having the optical characteristics or optically concave lens-like characteristics (there may be no lens characteristics in the vicinity of the center) as shown in FIG. For example). Incidentally, _n A, _{n B} in FIG. 1 (b), means the refractive index.

  By forming the above-described configuration directly above the photoelectric conversion region, light in a direction perpendicular to the display surface (θ = 0 °) is incident on the photoelectric conversion region and detected as usual. Furthermore, light in an oblique direction (| θ |> 0 °) is difficult to be incident on the photoelectric conversion region and is difficult to detect, and thus directivity in the vertical direction is imparted.

  Further, not only in the vertical direction (θ = 0 °), but also by moving the position of the minute hole 21 or the concave lens structure 30 horizontally (parallel to the display surface), the direction of light detection is changed to an oblique direction deviated from the vertical direction. Can be controlled. In other words, the light detection direction of each thin film photosensor arranged in a row in an arbitrary edge region of the display can be set to a desired direction by making the display at the manufacturing stage.

  FIG. 2 is an explanatory diagram showing a method of setting the directivity of light detection in a desired direction by displacing the position of the microhole 21 in the thin film optical sensor according to Embodiment 1 of the present invention. 2A to 2C show a state in which the directivity can be given to θx by displacing the position of the minute hole 21 in the x direction corresponding to the left-right direction on the paper surface of FIG. Yes. Similarly, FIGS. 2D to 2F show states in which θy can have directivity by displacing the position of the minute hole 21 in the y direction corresponding to the vertical direction on the paper surface of FIG. Is shown.

  FIG. 3 is a diagram showing light detection characteristics (1) under various conditions of the thin film photosensor provided with the light detection directivity according to the first embodiment of the present invention. In FIG. 3, when a certain position is a reference point x = 0 (and z = 0) and there is a detection target at a distance z that is directly above θ = 0 °, only | x | from the reference point The detection values by the thin film photosensors at five different θ (0 °, small, middle, large, and large) at the shifted positions are verified by physical simulation. The background is black.

Further, FIG. 4 is a diagram showing the light detection characteristics (2) under various conditions of the thin film photosensor provided with the light detection directivity in the first embodiment of the present invention. More specifically, FIG. 4A shows a thin film photosensor data extracted from the following combination A from FIG. 3, and a thin film photosensor data extracted from the following combination B is extracted from FIG. It is FIG.4 (b).
Combination A: {θ = 0 °, x = 0}, {θ: middle, x = 6}, {θ: middle, x = 10}, {θ: middle, x = 14}.
Combination B: {θ = 0 °, x = 0}, {θ: middle, x = 16}, {θ: large, x = 16}, {θ: larger, x = 16}.

That is, using the main thin film photosensor of θ = 0 ° and the sub thin film photosensor combined as combination A or combination B as follows, detection is performed immediately above the output value of a certain main thin film photosensor. When it is detected that there is a target, z can be derived from each output value of the sub thin film photosensor group combined therewith.
Combination A: A plurality of sub thin film photosensors having the same θ at different positions | x | (> 0).
Combination B: A plurality of sub thin film photosensors having different θ at substantially the same position of | x |> 0.

  Note that θ of the main thin film optical sensor does not have to be in the vertical direction θ = 0 °. In addition, if each line drawn in the light detection direction from the sub thin film photo sensor intersects with a similar line in the main thin film photo sensor at a plurality of locations in the detection space, θ and The position is also arbitrary.

For example, if the long side direction of the display is X and the short side direction is Y, the θ and the thin film photosensors of the main and sub thin film photosensors in the (θ _X , θ _Y ) and (displacement _{X 1} , displacement _Y ) spaces. The position can be set.

  FIG. 5 is a diagram showing a first example of position detection in a three-dimensional space in front of the display in the display incorporating the thin film photosensor having the light detection directivity according to Embodiment 1 of the present invention. . In the first embodiment shown in FIG. 5, a thin film photosensor is incorporated in a pixel row having a width of 1 to 2 pixels on the horizontal edge 1 a on the upper side of the display 1.

  Here, θ and position of each optical thin film sensor are set so that each intersection of the detection direction line of the main optical thin film sensor and the detection direction line of the sub optical thin film sensor is distributed in the detection target space. In the manufacturing stage, the desired θ and position are set.

  More specifically, for example, a detection surface that can be regarded as a substantially flat surface is formed in front of the thin film light sensor at substantially the same position x in the pixel row. FIG. 5 also shows detection points that are intersections of the detection direction lines of the main thin film photosensors and the detection direction lines of the sub thin film photosensors.

  A set of thin film photosensors forming a detection plane (that is, a set consisting of a main thin film photosensor forming a detection plane and a sub thin film photosensor attached to the main thin film photosensor) is set to a position x and each direction. A three-dimensional detection space composed of detection plane groups with slightly different positions and orientations is formed by gradually changing θ.

  One thin film optical sensor has a detection sensitivity distributed around the detection direction line, and therefore the detection sensitivity is distributed around the detection point. Further, the detection target object (for example, a human head) has a certain size. Therefore, the minimum interval between detection points can be determined in consideration of the sensitivity distribution and the size of the detection target object.

FIG. 6 is a diagram showing a second example of position detection in a three-dimensional space in front of the display in the display incorporating the thin-film photosensor having photodetection directivity according to Embodiment 1 of the present invention. . In the second embodiment shown in FIG. 6, a state in which pixel columns incorporating thin film photosensors are arranged in five patterns as shown in the following (a) to (e) is illustrated.
(A) When the pixel row incorporating the thin film photosensor is the lower horizontal edge.
(B) A case where a pixel row in which the thin film photosensor is incorporated is one vertical end.
(C) When the pixel column incorporating the thin film photosensor is the other vertical edge.
(D) A case where the pixel row into which the thin-film photosensor is incorporated is a pair of upper and lower horizontal edges.
(E) A case where a pixel row incorporating a thin film photosensor is a pair of right and left vertical edges.

  As shown in FIGS. 6 (a) to 6 (c), as an arrangement different from FIG. 5, the thin film photosensor is arranged on the lower horizontal edge, or on the left or right of the vertical edge. Can be arranged.

  In addition, as shown in FIGS. 6D and 6E, horizontal or vertical edge pairs can be used. In this case, the thin film photosensor group constituting one detection plane or The main and sub thin-film photosensors corresponding to one detection point do not necessarily have to be arranged together on one end side, and may be arranged separately between end pairs. The detection interval can be reduced as compared with the case of FIGS. 6A to 6C, and the detection accuracy can be improved.

In the display in which the thin film photosensors are arranged as shown in FIGS. 5 and 6, the number of thin film photosensors to be examined is greatly reduced by performing the following multi-stage processing. Detection processing can be performed in a short time.
(Process 1) The main thin film photosensor that has reacted is identified by examining the output of each main thin film photosensor.
(Process 2) The output value of the sub thin film photosensor combined with the main thin film photosensor that has reacted is analyzed.

  Further, FIG. 7 is a diagram showing a third example of position detection in a three-dimensional space in front of the display in the display incorporating the thin film photosensor having the light detection directivity according to Embodiment 1 of the present invention. It is. In the third embodiment shown in FIG. 7, thin film photosensors are incorporated in the pixel columns on the horizontal edge and the vertical edge, and such an arrangement can also be adopted.

  The thin film optical sensor incorporated in the horizontal end side is responsible for detection of each vertical detection surface, and the thin film optical sensor incorporated in the vertical end side is responsible for detection of each substantially horizontal detection surface. Then, a detection target object is detected on the intersection line between the vertical detection surface and the horizontal detection surface.

  This intersection line has the same meaning as the detection direction line of the main thin film optical sensor described above. Therefore, in the case of the configuration of FIG. 7, it is not always necessary to separately use main and sub in the thin film photosensor. However, the main / sub system is also applicable.

When the main / sub method is not applied, the total amount of detection processing can be reduced and the processing time can be shortened by the following multistage processing.
(Process 1) A detection surface including a detection target object is identified by a simple sum of detection values for each detection surface.
(Process 2) The output value in the thin film photosensor constituting the detection surface or detection direction line is analyzed.

The effects of the display with the position detection function in the three-dimensional space by providing the thin film photosensor according to the first embodiment described above are summarized as follows.
-A display having a position detection function in a three-dimensional space defined in front of the display can be realized. For example, it is suitable for detection of the viewer's head in a naked-eye 3D television, and can be applied to the optimum display of the naked-eye 3D based on the head position.

-Even on a 2D display television, the viewing distance can be detected, and a display suitable for the detected viewing distance can be performed.
Further, by using a large number of thin film optical sensors or by narrowly defining a three-dimensional space, the detection resolution can be improved and face orientation detection can be implemented.

・ Furthermore, when a color filter is applied to a part of the thin film light sensor, it is possible to measure the brightness and color of the illumination when watching TV, and to change the display brightness and hue appropriately according to the measurement result. is there.

As another example, for example, a three-dimensional space to be detected can be defined between the display and the head at a standard viewing distance, and a hand can be detected in the three-dimensional space. The present invention can be applied to device operation information input (that is, gesture input) using information on the approximate state and movement of the hand, such as whether the finger is closed or open, or the direction of the finger.
Also, in a mobile device, non-contact gesture input is possible by using a dedicated pen or the like provided with a bright detection pair area at the tip.

  As described above, according to the first embodiment, it is possible to realize a thin-film photosensor having a structure that imparts directivity to light detection. Specifically, the light detection directivity is imparted by a method such as (a) providing a light-shielding layer having microscopic holes above the photoelectric conversion region, or (b) providing a structure having optical characteristics such as a concave lens. Realized. Furthermore, by displacing the horizontal position of such a structure, the light detection direction can be set in a desired direction by making it in the manufacturing stage.

  Furthermore, by embedding the column of the thin film photosensor of the present application in the pixel column on the edge of the display, a display having a position detection function in a three-dimensional space defined in front of the display can be realized. Specifically, a plurality of thin film photosensors having different positions and positions in the light detection direction are arranged along one end side or a plurality of end sides of the display, and positions are determined according to output values of a plurality of thin film photosensors combined in advance. Detection can be performed. When performing such position detection, it is possible to apply a position detection method by multi-stage processing suitable for the arrangement method of each thin film photosensor.

  As a result, by incorporating the thin film optical sensor of the present application into a display such as a naked-eye 3D television, a monitor device, or a mobile device, the position detection function in the three-dimensional space can be added without adding a device such as a camera. A display with a position detection function in a three-dimensional space that can be realized and suppresses the increase in size and cost of the device can be obtained.

  DESCRIPTION OF SYMBOLS 1 Display, 1a Horizontal edge, 10 Thin film photosensor element (thin film photosensor), 11 1st electroconductive area | region, 12 2nd electroconductive area | region, 13 photoelectric conversion area | region, 20 light shielding layer, 21 micropore, 30 concave lens structure.

Claims (4)

A photoelectric conversion region is provided, and light detection is performed in accordance with the amount of light received in the photoelectric conversion region, and a structure for giving directivity to the light detection is provided above the photoelectric conversion region that is a light receiving surface. A plurality of thin film photosensors are arranged so as to have a columnar arrangement in an arbitrary edge region, and in the manufacturing stage, the structure of the structure with respect to the photoelectric conversion region is within a plane facing the light receiving surface. A display having the plurality of thin film photosensors arranged in which a main detection direction of the light detection having the directivity is set to a desired direction by displacing a relative positional relationship to a desired position;
In the three-dimensional detection space defined in the space in front of the display by the respective main detection direction of each thin film photosensor set in the desired direction, based on the detection result by the combination of each thin film photosensor, e Bei a detector for identifying the position of the detection object in the three-dimensional detection space,
The thin film photosensors are arranged at least at two adjacent sides that are adjacent and orthogonal as the row arrangement,
The detector is
The detection plane of one row of the two end sides is defined as a first detection plane,
The detection plane of the other row of the two end sides is defined as a second detection plane,
A virtual main thin film photosensor is defined on the display, wherein an intersection line between the first detection plane and the second detection plane is a line in a light detection direction perpendicular to the display.
The thin film photosensor that actually exists is defined as a sub thin film photosensor with respect to the detection plane or a line in the photodetection direction,
A display with a position detection function in a three-dimensional space that performs position detection in the three-dimensional detection space including all of the detection planes . The detector is
A first process for identifying the main thin film photosensor that has reacted by examining the output of each main thin film photosensor;
When there is a main thin film photosensor having the reaction due to the execution of the first process, the output value of the sub thin film photosensor arranged in combination with the main thin film photosensor having the reaction is analyzed. The display with a position detection function in a three-dimensional space according to claim 1, wherein multistage processing is performed by performing the second processing. The detector is
A first process for identifying a detection plane or a light detection direction line including a detection target object based on a detection result in the detection plane or the light detection direction line;
A multi-stage process is executed by a second process for analyzing an output value in a thin film photosensor that constitutes a detection plane or a line in a light detection direction including the detection target object specified by the execution of the first process. The display with a position detection function in three-dimensional space according to 1 . The three-dimensional space according to any one of claims 1 to 3 , wherein the detection unit is configured to detect head detection, gesture detection, and brightness and color of illumination in the three-dimensional detection space. Display with position detection function.

Images