KR20170062199A

KR20170062199A - Touchless 3d position sensor

Info

Publication number: KR20170062199A
Application number: KR1020150167715A
Authority: KR
Inventors: 김용신; 김정석
Original assignee: 고려대학교 산학협력단
Priority date: 2015-11-27
Filing date: 2015-11-27
Publication date: 2017-06-07
Also published as: KR101746014B1

Abstract

A non-contact type 3D position sensing sensor according to an embodiment of the present invention is a non-contact type 3D position sensing sensor that detects light and detects the position and tilting angle of an object. The non-contact type 3D position sensing sensor includes a light emitting unit for emitting light, The light receiving unit includes a light receiving sensor for detecting an optical signal flowing into the light receiving unit by reflected light, and a controller connected to the light receiving sensor to determine a 3D position or a tilting angle of the object do.

Description

[0001] TOUCHLESS 3D POSITION SENSOR [0002]

Field of the Invention [0002] The present invention relates to a non-contact 3D position sensing sensor, and more particularly, to an apparatus for sensing a 3D position or a tilting angle of an object using an optical signal reflected by an object.

A display device such as a TV or a computer monitor generally inputs and processes desired information through a button input or a mouse input directly connected to a computer or a monitor through a computing device built in or connected to the display device.

In recent years, various types of main or auxiliary input methods have been adopted to overcome this conventional input method. Touch screen method is one of new input methods that is useful. The touch screen method uses a resistance film or an ultrasonic wave on a screen side of a display device to change a resistance of a screen generated when a user touches the screen with a finger or other input means or to generate a surface acoustic wave Detecting the coordinate on the screen of the touched portion, inputting information in the coordinates, and executing the command accordingly.

When such a touch screen type input method is used, there is an advantage that desired information can be easily input.

However, as the display device using the input device is becoming larger and larger, the distance between the display device and the operator is also distant, and thus, compared with the conventional condition in which the operator can easily reach out and touch, The operator often moves away from the operator's arm length, and the operator must move to touch the surface of the screen.

In addition, the contact-type coordinate input method such as the touch screen method causes a problem of contamination of the screen due to contact, and repeatedly applies a load load to the screen, thereby deteriorating the durability of the display device panel.

To solve this problem, a non-contact type coordinate input system has been developed. Unlike the contact-type coordinate input system described above, the non-contact type coordinate input system uses a different type of input means and sensor because the screen and the input means (finger, pen, etc.) do not make physical contact.

That is, the non-contact type coordinate input system generally uses a method using light, and performs the same function as the touch screen method by irradiating light at a desired position on the screen and inputting coordinates of a position where the light is irradiated. As the light used for such a purpose, mainly a laser beam is used but it is not necessarily limited to this, and the term " light " is a concept including all electromagnetic waves in all areas such as infrared rays and ultraviolet rays.

An example of a non-contact type coordinate input system is Korean Patent Laid-Open Publication No. 2001-0026856, which discloses a direct pointing system using light. The present invention is directed to a method for directly selecting a desired menu by directly pointing a remote controller without operating the remote controller. The pointer is a pointer for emitting and selecting light such as a laser beam toward a direction to be instructed, A position calculator for calculating a position on the screen from a sensing signal of the sensing unit, a controller for controlling the cursor to be displayed at the calculated position, A CPU for controlling an operation corresponding to a menu at a cursor position during operation, and a cursor generating unit for generating and displaying a cursor under the control of the CPU.

In case of using the direct pointing system, the user can easily select the menu displayed on the screen by directly pointing to the light without manipulating the remote controller.

Another example of such a non-contact type coordinate input system is the input / output device described in Japanese Patent Laid-Open No. 11-119910.

An input / output device detects an arbitrary position and performs an input corresponding to the input / output device. The input / output device causes the display screen to input a position in a non-contact manner. More specifically, the input / output device is an input / output device that detects a position of an arbitrary position of a display screen and performs input / output processing corresponding to the detected position, And the irradiation position is detected by a plurality of matrix-arranged light switching elements provided integrally with the display device to perform position detection corresponding to the output state of the photoelectric conversion element.

The above-mentioned input / output device is also a useful means for inputting information on a screen in a non-contact manner.

However, the invention disclosed in Korean Patent Laid-Open Publication No. 2001-0026856 or the invention disclosed in Japanese Laid-Open Patent Publication No. 11-119910 is disadvantageous in that a sensor capable of detecting light is arranged at a lattice point corresponding to each coordinate and a pointer And the coordinates are input by the information when the emitted light reaches the respective sensors.

However, this type of coordinate input method may have a problem when the display device is enlarged or the input coordinates must be more finely divided. That is, in the coordinate input method, since a sensor such as an optical sensor corresponding to each coordinate must be arranged, the sensor number is required as many as the coordinate number used in the input, and when the sensor is arranged at the same interval, The required amount of the sensor increases in proportion to the square of the degree of increase of the screen size (such as the width or the height), and the process of disposing the sensor in the enlarged input device is not practical.

Therefore, when the display device is enlarged, the sensor usage amount may become a heavy burden. In the same way, when the resolution of the coordinates increases, the number of sensors is increased as the resolution increases, and the number of the sensors is increased in proportion to the square of the resolution of the coordinates .

In addition, in the method of arranging the sensor at each coordinate, since the area where the sensor is located is set separately due to the opacity of the sensor and the remaining area is used as the pixel area, the sensor must be very small in order to secure the area of the pixel area. There is a possibility that the image quality may deteriorate

Korean Patent No. 10-1469186 (Nov. 21, 2014) Korean Patent Publication No. 10-2008-0014683 (Feb. 14, 2008)

It is an object of the present invention to provide a non-contact type 3D position sensing sensor capable of freely moving and selecting a pointer in a display device by the position and tilting angle of a user's hand.

Here, the light receiving sensor includes first to fourth photodiode arrays arranged in the longitudinal direction of each side of a quadrangle, and includes a first photodiode array and a second photodiode array positioned in a direction opposite to the first photodiode array The output terminal of the third photodiode array is connected to the first differential amplifier and the output terminal of the fourth photodiode array located in the direction facing the third photodiode array and the third photodiode array can be connected to the second differential amplifier.

Here, the output terminal of the first differential amplifier may be connected to the first converter, and the output terminal of the second differential amplifier may be connected to the second converter so as to be respectively converted into digital signals.

Here, the output terminal of the first converter and the output terminal of the second converter may be connected to the controller.

Each of the sub output terminals connected in parallel to the output terminals of the first through fourth photodiode arrays may be connected to the controller via a sub amplifier and a sub converter.

Here, the controller determines a position or tilting angle in the X direction using a signal input from the output terminal of the first converter, and determines a position or a tilting angle in the Y direction using a signal input from the output terminal of the second converter And the position of the object in the Z direction can be determined using the signal input at the output terminal of each of the sub-converters.

The non-contact type 3D position sensing sensor according to the embodiment of the present invention can adjust the moving speed of the pointer according to the tilted angle.

In addition, the operation of the user can be accurately recognized.

Also, it can be realized in chip form and can be manufactured in small size.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram of coordinate definition of a non-contact 3D position sensing sensor and an object for recognition according to an embodiment of the present invention; FIG.
2 is a plan view and a cross-sectional view of a light receiving unit according to an embodiment of the present invention.
3 is a circuit diagram of a light-receiving unit according to an embodiment of the present invention.
4 is a conceptual diagram for determining the position or tilting angle of an object through mapping in a controller according to an embodiment of the present invention.
5 is a graph showing a change in the voltage value according to the detected light.

It is to be understood that the specific structural or functional description of embodiments of the present invention disclosed herein is for illustrative purposes only and is not intended to limit the scope of the inventive concept But may be embodied in many different forms and is not limited to the embodiments set forth herein.

The embodiments according to the concept of the present invention can make various changes and can take various forms, so that the embodiments are illustrated in the drawings and described in detail herein. It is not intended to be exhaustive or to limit the invention to the particular forms disclosed, but on the contrary, is intended to cover all modifications, equivalents, or alternatives falling within the spirit and scope of the invention.

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms may be named for the purpose of distinguishing one element from another, for example, without departing from the scope of the right according to the concept of the present invention, the first element may be referred to as a second element, The component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between. Other expressions that describe the relationship between components, such as "between" and "between" or "neighboring to" and "directly adjacent to" should be interpreted as well.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like are used to specify that there are features, numbers, steps, operations, elements, parts or combinations thereof described herein, But do not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the meaning of the context in the relevant art and, unless explicitly defined herein, are to be interpreted as ideal or overly formal Do not.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram of coordinate definition of a non-contact 3D position sensing sensor and an object for recognition according to an embodiment of the present invention; FIG.

As shown in FIG. 1, the non-contact type 3D position sensing sensor according to the embodiment of the present invention measures a 3D position and a tilting angle of an object by measuring light reflected by an object (hand) .

The angle θ _x formed between the plane on which the object is placed and the XY plane horizontal to the X axis and the angle θ _y formed with the Y axis in the three-dimensional Cartesian coordinate system shown in FIG. 1 is the tilting angle (information) used in the embodiment of the present invention, to be.

A non-contact type 3D position sensing sensor according to an embodiment of the present invention is a non-contact type 3D position sensing sensor that detects light and detects an object position and a tilting angle. The non-contact type 3D position sensing sensor includes a light emitting unit 100 for emitting light, The light receiving unit 200 includes a light receiving sensor that detects an optical signal flowing into the light receiving unit 200 by reflected light, a light receiving unit that is connected to the light receiving sensor 200, And a controller for determining a 3D position and a tilting angle of the object.

The light emitting portion 100 emits light. In detail, it is preferable to diverge toward an object placed on top of the non-contact 3D position sensing sensor. The light emitting unit 100 may be an infrared LED, but is not limited thereto.

The light emitted from the light emitting unit 100 can be driven by a separate power source at a low power and can be manufactured in a small size within a range of several millimeters to several tens of millimeters although the size is not limited.

The light receiving unit 200 detects reflected light that is emitted from the light emitting unit 100 and is reflected by the object.

2 is a plan view and a cross-sectional view of a light receiving unit according to an embodiment of the present invention.

3 is a circuit diagram of a light-receiving unit according to an embodiment of the present invention.

2 and 3, the light receiving unit 200 according to the embodiment of the present invention includes a rectangular substrate 280 inside a rectangular parallelepiped body 210 having an open upper part, And first to fourth photodiode arrays 221, 222, 223, and 224 that are light receiving sensors that detect light at the edges.

The shapes of the main body 210 and the substrate 280 are not limited to those described above. Further, the shape of the light receiving sensor 220 can be variously realized, Can be installed at a deformable position on the substrate (280). For example, the light receiving sensor 220 may include two or more photodiodes, phototransistors, and other elements capable of detecting optical signals. The light receiving sensor 220 may be disposed at a predetermined distance from the edge of the substrate.

The light receiving sensor 220 according to the embodiment of the present invention shown in FIG. 2 (a) includes first through fourth photodiode arrays 221, 222, 223, and 224 arranged in the longitudinal direction of each side of a square . The area that can be detected by one photodiode array is limited when the light receiving unit 200 according to the embodiment of the present invention has the shape of the main body 210 shown in Fig. 2 (b). (FOV _XL , FOV _XR )

Also, in FIG. 3, it is difficult to determine in which direction an object is placed when an object is placed in a blurred area where FOV (Field Of View) is overlapped. However, when the area overlapping with the size of the object for recognition is not large, the position of the object or the tilted information can be determined due to the change in the amount of light incident on the both-end photodiode array. The non-contact type 3D position sensing device according to the embodiment of the present invention is not necessarily, but an object (hand) is placed mainly in an ambiguous area. At this time, as shown in FIG. 2, the degree of tilting of the object is determined, Can be detected. In addition, as shown in FIG. 1, it is determined which direction the object advances in the X and Y directions, and whether the object is positioned and the object is located at a certain height from the light receiving sensor.

3, the light receiving unit 200 includes a light receiving sensor 220 that generates an electric signal when light is incident, and the light receiving sensor 220 according to the embodiment of the present invention includes first to fourth The output terminals of the first photodiode array 221 and the second photodiode array 222 are connected to the first differential amplifier 231 and the output terminals of the third photodiode 231, The outputs of the array 223 and the fourth photodiode array 224 are connected to a second differential amplifier 232.

3, the output terminal of the first differential amplifier 231 is connected to the first converter 241, the output terminal of the second differential amplifier 232 is connected to the second converter 242, And the output terminal of the first converter 241 and the output terminal of the second converter 242 are connected to the controller 250.

Further, all the other voltage signals connected in parallel at the output terminals of the first to fourth photodiode arrays 221, 222, 223, and 224 are added together, and the sub-amplifier 233 and the sub- And is connected to the controller 250. The first differential amplifier 231 and the second differential amplifier 232 may be a Fully Differential Amplifier. The pulley differential amplifier is a differential amplifier composed of two input stages and two output stages, and amplifies the difference value between signals input to two input stages.

The controller 250 determines the position or tilting angle of the object in the X direction by using the signal inputted from the output terminal of the first converter 231 and determines the position or tilting angle of the object using the signal input at the output terminal of the second converter 232. [ Determines the position or tilting angle in the Y direction, and determines the position of the object in the Z direction using the signal input at the output terminal of the sub converter 243. [

4 is a conceptual diagram for determining the position or tilting angle of an object through mapping in a controller according to an embodiment of the present invention.

The control unit 250 comprises a non-contact 3D position sensor according to an embodiment of the present invention as shown in Figure 4 is a variation of the change in position X, Y, Z and tilt angles for each axis of the object θ _x, θ _y When receiving a signal for the light receiving sensor 220 through the light receiving sensor 220, the pointing position can be changed through 3D mapping or 2D mapping.

The conventional gesture sensor performs the function of outputting the corresponding gesture according to the position of the object on the gesture sensor or the tilting angle. However, non-contact 3D position sensor according to an embodiment of the present invention includes a controller (3D mapper) according to the 3D position (X, Y, Z) with X or Y direction tilding angle (θ _x, θ _y) of the object (250) And the tilting angle and the height (? _X ',? _Y ', Z ') information as shown in FIG. 4A as 3D position detection information (X', Y ', Z' And output 2D (Fig. 4 (c)) or 1D position information and tilting angle (Fig. 4 (d)) according to the user's intention.

Equation (1) below is an example of 3D mapping by the controller.

[Equation 1]

(A) shows a case where the electrical signals (V _x , V _y , V _z ) are linearly mapped to 3D position information, (b) shows an example in which an electrical signal 3D positional information is mapped proportionally to the quadratic function, and (c) is a case where the electrical signal is mapped proportionally to the exponential function as the 3D positional information. The present invention is not limited to the above three mapping functions. In addition, the present invention can output pointing position or tilting information according to the movement of an object using various methods, in addition to pointing position or tilting information output through mapping.

Described in detail the operation of the non-contact 3D position sensor according to an embodiment of the present invention, the foregoing also by from 1 to 3, the left side of the first photodiode array 221 of the light receiving sensor 220, a photodiode (PD _L) as the array as the second photodiode array as 222 array from the right, a photodiode (PD _R) and the third photodiode upper photodiode (PD _T) array 223 array, and a fourth photodiode array ( 224 are referred to as photodiode (PD _B ) arrays below.

When the object is tilted in the y-axis direction (up or down direction) in consideration of FIG. 1, light is detected in PD _T , which is the third photodiode array 223 and PD _B , which is the fourth photodiode array 224. 3, the second photodiode array 223 and the fourth photodiode array 224 are connected to each other. In the second differential amplifier 232, the third photodiode array 223 and the fourth photodiode array 224 are connected to the third photodiode array 223 and the fourth photodiode array 224, The controller 250 transmits the difference of the input signal to the controller 250. The controller 250 determines the tilted direction and determines the tilted angle using the difference value of the signal.

Further, the detecting light in, claim 1 The photodiode array 221, the PD _L to the second photodiode array (222) PD _R case tipping the object in consideration of the first x-axis direction (left, right direction) . The first differential amplifier 231 transmits the difference between the signals input to the first photodiode array 221 and the second photodiode array 222 to the controller 250 and the controller 250 outputs the difference In this case, it is determined whether the tilted direction is the left direction or the right direction, and the tilted angle is determined using the difference value of the signal.

Furthermore, the object is positioned shifted to the + X direction when moving linearly, the signal is detected in the PD _R first photodiode array 221, the PD _L to the second photodiode array 222, a detected The controller 250 determines that the object is located on the right-hand side. If the difference is larger than the predetermined threshold value, the controller 250 determines that the object is located on the right-hand side. The same applies to the case of being located in the + Y direction or the -Y direction.

5 is a graph showing a change in the voltage value according to the detected light.

5 is a graph showing changes in the voltage level value obtained by connecting the respective terminals of the oscilloscope to the output terminal of the first differential amplifier 231 when tilted in the actual x-axis direction. The LED of the light emitting portion repeatedly turns on / off at a constant cycle when, if inclined at a rise in the left (left) of the object state first photodiode array 221, the PD _L is the voltage value of the LED is on and similar phases is detected. In contrast the second photodiode array PD _R 222 is a voltage value of the state and the phase opposite to the LED is On is detected.

5, it can be seen that the voltage values of the first photodiode array 221 and the second photodiode array 222 are opposite to those described above when the object is tilted to the right.

In PD _L, the terminal (X) of the signal of the PD _R pass through the first differential amplifier 231 and the first converter (ADC) over the 241 control unit 250 when tilted in the x-axis direction as shown in Figure 5 . However, even in this case, when the optical signal is input to PD _T and PD _B , a predetermined voltage value is detected but it is determined that there is almost no difference between PD _T and PD _B when the voltage is tilted in the x-axis direction. The signals of PD _T and PD _B pass through the second differential amplifier 232 and pass through the second converter ADC 242 to the terminal Y of the controller 250 .

The controller 250 determines the tilt direction and tilt direction of the object in the x-axis using the polarity and magnitude of the input signal, and determines the tilt direction and tilt of the object along the y-axis.

The sub-amplifier 233 amplifies the signals input to the first through fourth photodiode arrays 221, 222, 223, and 224 after they are all added thereto. The sub-converter 243 converts the signals into digital signals, 250 determine the position of the object using the input signal. The position of the object, that is, the height at which the object is located from the light receiving unit 200, is determined using the intensity sum of the signals input to the four terminals. The height determination method can be variously implemented. For example, the correlation data of the height according to the sum of the signal intensities is stored in advance and the height matched with the signal intensity sum is determined as the height where the actual object is located according to the correlation data Method can be used.

The light receiving unit as described above can be implemented as a single chip, and the light emitting unit 100 and the light receiving unit 200 can be fabricated in one package as shown in FIG.

100 Light emitting portion 200 Light receiving portion
210 Main body 220 Light receiving sensor
221 First photodiode array 222 Second photodiode array
223 Third photodiode array 224 Fourth photodiode array
231 First differential amplifier 232 Second differential amplifier
233 sub amplifier 241 first converter
242 Second converter 243 Sub converter

Claims

A non-contact 3D position sensing sensor for sensing light and detecting an object's position and tilting angle,
A light emitting portion for emitting light; And
And a light receiving unit for detecting reflected light reflected from the object by the light emitted from the light emitting unit,
The light receiving unit includes a light receiving sensor for detecting an optical signal flowing into the light receiving unit by reflected light;
And a controller connected to the light receiving sensor to determine a 3D position or a tilting angle of the object.

The method according to claim 1,
Wherein the light receiving sensor includes first through fourth photodiode arrays arranged in the longitudinal direction of each side of a quadrangle, the first photodiode array and the output end of a second photodiode array positioned in a direction opposite to the first photodiode array, Is connected to the first differential amplifier and the output terminal of the fourth photodiode array, which is located in the direction opposite to the third photodiode array, is connected to the second differential amplifier. Detection sensor.

3. The method of claim 2,
Wherein the output terminal of the first differential amplifier is connected to the first converter and the output terminal of the second differential amplifier is connected to the second converter and converted into a digital signal.

The method of claim 3,
Wherein the output terminal of the first converter and the output terminal of the second converter are connected to the controller.

5. The method of claim 4,
And each sub output terminal connected in parallel to each of the output terminals of the first through fourth photodiode arrays is connected to the controller via the sub amplifier and the sub converter.

6. The method of claim 5,
The controller determines a position or tilting angle in the X direction by using a signal input from the output terminal of the first converter and determines a position or tilting angle in the Y direction using a signal input at the output terminal of the second converter And determines the position of the object in the Z direction by using a signal input from an output terminal of each of the sub-converters.