JP2022180917A - Non-contact input apparatus - Google Patents

Abstract

To enable precise detection of a gesture operation.SOLUTION: A non-contact input apparatus includes: an optical sensor 2 having a light emitting part 21 for emitting light and a light receiving part 22 for receiving reflected light generated by irradiation to a detection target of light emitted from the light emitting part 21 and outputting a sensor value based on the received light; and an operation detection unit for, based on the output from the light receiving part 22, detecting an operation of the detection target on an operation plane set in a detectable area of the optical sensor 2. The optical sensor 2 is positioned on an extended surface of the operation plane.SELECTED DRAWING: Figure 1

Description

The present invention relates to a non-contact input device that receives input operations in a non-contact manner.

Conventionally, non-contact input devices that receive input operations in a non-contact manner have been provided. For example, a non-contact input device has been proposed that includes an optical sensor having a plurality of light-receiving elements that receive light emitted from a light-emitting element and reflected by a detection target (see Patent Document 1). In a conventional touch input device, an optical sensor is provided in the facing direction of the operation plane.

Here, since the light emitted from the light-emitting element and the light-receivable area of the light-receiving element expand radially, if the optical sensor is provided in the facing direction of the operation plane, the distance between the optical sensor and the object to be detected will affect the operation plane. The top position changes.

For this reason, in conventional touch input devices, the size of the detectable area changes depending on the distance between the optical sensor and the detection target, and the position of the boundary on the operation plane for determining the movement also changes. Therefore, there is a problem in terms of accuracy as a gesture sensor that detects a gesture operation from the movement of a detection target such as a human hand. In addition, the conventional contact input device also has a problem that the operation position cannot be detected appropriately when not only the operator's fingers but also a large area such as the palm or elbow is recognized as a detection target.

WO2014/115397

SUMMARY OF THE INVENTION An object of the present invention is to provide a non-contact input device capable of accurately detecting a gesture operation.

The present invention includes a light-emitting unit that emits light, receives reflected light generated by the light emitted from the light-emitting unit irradiating a detection object, and outputs a sensor value based on the intensity of the received light. and a motion detection unit that detects motion of the detection target on an operation plane set within a detectable area of the photosensor, based on the sensor value output from the light receiving unit. wherein the optical sensor is a non-contact input device positioned on an extension plane of the operation plane.

According to the present invention, it is possible to provide a non-contact input device that can accurately detect a gesture operation.

The block diagram which shows the structure of a non-contact input device. 4A and 4B are diagrams showing a configuration of an optical sensor of Example 1; FIG. FIG. 4 is a diagram showing a detectable area when viewed from the width direction of the substrate; The figure which shows the detectable area|region at the time of seeing from a light-receiving center direction. FIG. 4 is a diagram showing the operation area of the first embodiment when viewed from the light receiving center direction; FIG. 5 is a diagram showing the operation area of the first embodiment when viewed from the direction of the light emitting section; FIG. 4 is a perspective view showing the operation area of the first embodiment when viewed obliquely from above; FIG. 4 is a diagram showing an example of an input operation when viewed from the longitudinal direction of the substrate; FIG. 5 is a diagram showing an example of an input operation when viewed from the light receiving center direction; FIG. 4 is a perspective view showing an example of an input operation when viewed obliquely from above; FIG. 4 is an explanatory diagram showing an example of a histogram for motion determination according to the first embodiment; FIG. 4 is a flowchart of motion determination processing according to the first embodiment; FIG. 10 is a block diagram showing the configuration of the non-contact input device of Example 2; FIG. 11 is a perspective view showing the configuration and operation area of the optical sensor of Example 2; FIG. 11 is a block diagram showing the configuration of the non-contact input device of Example 3; FIG. 11 is an explanatory diagram showing an example of a histogram for signature determination according to the third embodiment; FIG. 12 is an explanatory diagram showing an example of a signature reference table according to the third embodiment; FIG. FIG. 11 is an explanatory diagram showing another example of the signature reference table of Example 3; FIG. 11 is a flowchart of signature determination processing according to the third embodiment; FIG. 11 is a diagram showing an example of a motion determination block according to the fourth embodiment;

An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of the non-contact input device 1. As shown in FIG. The non-contact input device 1 is an input device for inputting operation data according to an operator's input operation to an operation object such as an electronic device or a machine. It is a non-contact input device (touchless sensor, touchless gesture sensor) capable of receiving a gesture operation on an operation target without touching the object.

As shown in FIG. 1, the non-contact input device 1 has an optical sensor 2, a control section 3, and a storage section 4 for storing various data. The control unit 3 is communicably connected to the optical sensor 2 and the storage unit 4 . Although illustration is omitted, the control unit 3 is also connected to an operation target, and appropriately transmits operation data detected by the non-contact input device 1 to the operation target.

FIG. 2 is a diagram showing the configuration of the optical sensor 2 of Example 1. As shown in FIG. As shown in FIG. 2, the optical sensor 2 has a light-emitting portion 21, a light-receiving portion 22, and a substrate . The substrate 23 is a plate-like member having a rectangular shape in plan view, and the light emitting section 21 and the light receiving section 22 are arranged on one surface (same surface) of the substrate 23 . The substrate 23 may be a member having a circular shape, square shape, or other polygonal shape in plan view.

Further, the light emitting unit 21 and the light receiving unit 22 are arranged so as to be aligned in a predetermined direction, and are arranged so as to be separated from each other with a predetermined gap (distance). In this embodiment, the light emitting section 21 and the light receiving section 22 are arranged side by side in the longitudinal direction of the substrate 23 .

The light emitting unit 21 has a light source that emits light of a predetermined wavelength. The optical axis of the light source of the light emitting unit 21 is provided so as to be substantially perpendicular to the surface of the substrate 23 (the surface on which the light emitting unit 21 is installed on the substrate 23). The optical axis of the light source of the light emitting section 21 may be slightly inclined with respect to the direction perpendicular to the surface of the substrate 23 .

The light source of the light emitting unit 21 is, for example, an infrared LED that emits light with a wavelength of 700 nm to 1 mm, so-called infrared light. In this case, the light emitted from the light emitting unit 21 is infrared light (infrared light). The light emitted from the light emitting section 21 need not be limited to infrared light, and the light emitting section 21 may emit light having a wavelength other than infrared light.

Further, although one light emitting unit 21 is provided for one light receiving unit 22 in this embodiment, a plurality of light emitting units 21 may be provided for one light receiving unit 22 . In this case, each of the plurality of light emitting units 21 is arranged so as to have the same distance from the light receiving unit 22 . That is, each of the plurality of light emitting units 21 is arranged concentrically around the light receiving unit 22 . In addition, each of the plurality of light emitting units 21 is arranged point-symmetrically or line-symmetrically with respect to the center of the light-receiving unit 22 so that the amount of light incident on the light-receiving unit 22 is uniform.

The light-receiving unit 22 receives reflected light generated by the light emitted from the light-emitting unit irradiating the object to be detected, and outputs an electric signal based on the intensity (brightness, light amount) of the received light. Specifically, the light receiving unit 22 continuously outputs a digital value (sensor value) corresponding to the amount of received light at predetermined time intervals.

The light receiving section 22 has a light receiving element as a detector for detecting the amount of received light. The light-receiving element is, for example, a photosensor, and in this embodiment, the light-receiving surface of the light-receiving element is substantially parallel to the light-emitting surface of the light-emitting section 21 . That is, the light receiving center direction of the light receiving element (the direction perpendicular to the light receiving surface) is the same direction (parallel) as the optical axis of the light source of the light emitting section 21 . The direction of the light receiving center of the light receiving element may be slightly inclined with respect to the direction of the optical axis of the light source of the light emitting section 21 . However, the light-receiving center directions of the plurality of light-receiving elements are all parallel to each other.

Further, the light receiving section 22 has three or more light receiving elements. Two or more (plurality) of each light receiving element are arranged in a first direction on the surface of the substrate 23, and two or more are arranged in a second direction (different from the first direction) intersecting the first direction. arranged side by side. That is, in the light receiving section 22, a plurality of light receiving elements are arranged in two directions.

In this embodiment, as shown in FIG. 2, the light receiving section 22 has four light receiving elements 22A to 22D arranged in a matrix (2×2). In this embodiment, the first direction is the longitudinal direction of the substrate 23 (the direction in which the light emitting portion 21 and the light receiving portion 22 are aligned), and the second direction is the width direction of the substrate 23 . That is, the first direction and the second direction are orthogonal directions (right angles). Also, the number of light receiving elements arranged in each of the first direction and the second direction is the same.

The number and layout of the light receiving elements provided in the light receiving section 22 are not particularly limited. For example, the plurality of light receiving elements may be arranged to form a triangle, may be arranged to form a rhombus, or may be arranged such that the number in one direction increases, such as 2×3. may be arranged, or may be arranged in a matrix of 3×3 (9 pieces) or more.

FIG. 3 is a diagram showing the detectable region DR when viewed from the width direction of the substrate 23. As shown in FIG. FIG. 4 is a diagram showing the detectable region DR when viewed from the light receiving center direction. As shown in FIGS. 3 and 4, the light emitted from the light emitting section 21 spreads radially around the optical axis. In this embodiment, a substantially conical light emitting region is formed with the light emitting portion 21 as the vertex and the optical axis as the generatrix (center line). Further, the area where the light receiving section 22 can receive light (light receiving area) is a substantially conical area with the light receiving section 22 as the apex and the light receiving center direction as the center line. The light receiving section 22 can receive the light reflected by the detection target when the detection target exists in the region where the light emitting region and the light receiving region overlap. Therefore, the substantially conical area where the light emitting area and the light receiving area overlap is the maximum area (detectable area) DR in which the presence of the detection target can be detected in the optical sensor 2 .

By increasing the radiation angle of the light-emitting portion 21 and the angle at which the light-receiving portion 22 can receive light, the detectable region DR can be made substantially hemispherical or nearly semispherical. Further, the distance from the optical sensor 2 to the bottom surface of the light emitting region, that is, the detectable distance is determined by the amount of light emitted from the light emitting section 21 (a light amount at which the light receiving section 22 can detect the reflected light). Therefore, by increasing the amount of light emitted from the light emitting unit 21 (increasing the light emission level), the detectable region DR can be widened (enlarged), and the amount of light emitted from the light emitting unit 21 can be increased. By decreasing (lowering the light emission level), the detectable region DR can be narrowed (smaller).

Further, the detection object that can be detected by the optical sensor 2 may be any object that reflects the light emitted from the light emitting unit 21, not only a part of the operator's body such as fingers and arms, but also a part of the operator's body. Objects such as pens, electronic devices, and sticks held by the operator, and part of clothing or accessories worn by the operator are also included.

Returning to FIG. 1 , the controller 3 controls each element of the non-contact input device 1 . Specifically, the control unit 3 has a CPU (Central Processing Unit), and performs lighting/lighting-off processing of the light-emitting unit 21, processing of sensor values input from the light-receiving unit 22, and processing of the operation object. Performs transmission processing of operation data, etc.

The storage unit 4 stores a main processing program 41, a coordinate conversion program 42, a mode determination program 43, a motion detection program 44, coordinate data 45, motion detection data 46, and operation data 47. FIG. The main processing program 41 is a program for executing overall processing of the non-contact input device 1, lighting/extinguishing processing of the light emitting unit 21, processing for transmitting operation data to an operation target, and the like.
<Coordinate conversion processing>

The coordinate conversion program 42 is a program for converting sensor values continuously input from the light receiving section 22 (each light receiving element) at predetermined time intervals into coordinate data in the detectable region DR. The method of coordinate conversion processing for converting the sensor values input from the light receiving unit 22 into coordinate data is not particularly limited. )can do.

For example, the direction in which the light-emitting portion 21 and the light-receiving portion 22 are arranged (the first direction in which the light-receiving elements are arranged) is the X-direction, and the light-receiving center direction of the light-receiving portion 22 is the Z-direction. When the direction (the direction perpendicular to the XZ plane defined by the X direction and the Z direction, or the second direction in which the light receiving elements are arranged) is the Y direction (see FIGS. 3 and 4), the X coordinate, the Y coordinate, and the Z Each of the coordinates can be calculated by the following formula (number A), formula (number B), and formula (number C).
[Number A]
X=((S1+S4)-(S2+S3)/(S1+S2+S3+S4))
[Number B]
Y=((S1+S2)-(S3+S4)/(S1+S2+S3+S4))
[Number C]
Z=1−k(S1+S2+S3+S4/Smax)

Here, S1 is a sensor value input from the first light receiving element 22A, S2 is a sensor value input from the second light receiving element 22B, and S3 is an input from the third light receiving element 22C. S4 is the sensor value input from the fourth light receiving element 22D, and Smax is the sum of the sensor values when the detection target is closest to the sensor (when the detection target is is the sum of the sensor values in the detectable region DR at the position closest to the optical sensor 2), and k is an arbitrary correction coefficient. In this case, each of the X coordinate, Y coordinate, and Z coordinate is data of a coordinate system with the light receiving unit 22 as the origin (X=0, Y=0, Z=0). Also, since the Z coordinate is the total value of the sensor values of the four light receiving elements 22A to 22D, it can also be said to be the total output value (total amount of light) of the optical sensor 2. FIG.

As described above, the coordinates (position) of the detection object in the detectable region DR can be calculated. The data converted according to the coordinate conversion program 42 are stored in the storage unit as coordinate data 45 in chronological order.

In this embodiment, the coordinate conversion process is executed by the control unit 3 (CPU) according to the coordinate conversion program 42, but the coordinate conversion process may be executed by a hardware circuit. In this case, the directions (the first direction and the second direction) in which the four light receiving elements arranged in a 2×2 arrangement are inclined by 45° with respect to the X direction or the Y direction, and the two light receiving elements arranged in the X direction A coordinate conversion method in which the difference between the sensor values of the light receiving elements is defined as the X coordinate, the difference between the sensor values of the two light receiving elements arranged in the Y direction is defined as the Y coordinate, and the sum of the sensor values of the four light receiving elements is defined as the Z coordinate. A circuit may be provided between the optical sensor 2 and the controller 3 .
<Mode determination processing>

The mode determination program 43 determines whether the detection target has entered the detectable region DR or has left the detectable region DR from the change in the position (coordinates) of the detection target indicated by the coordinate data 45 converted according to the coordinate conversion program 42 . This is a program for determining whether or not the object to be detected has left (removed). In addition, the mode determination program 43 determines whether the detection target enters the operation region R (the region for accepting the gesture operation) set in the detectable region DR while the detection target exists in the detectable region DR. Alternatively, it is also a program for determining whether or not the object to be detected has left the operation area R.

There is no particular limitation on the method of entry/exit determination processing for the detectable region DR for determining whether the detection target has entered the detectable region DR or whether the detection target has left the detectable region DR. For example, a threshold for determining whether or not a detection object has entered the detectable region DR is set to the Z coordinate (total output value of the optical sensor 2), and the Z coordinate (total output value of the optical sensor 2) ) changes from below the threshold to above the threshold, it is determined that the detection object has entered the detectable region DR, and when the Z coordinate changes from above the threshold to below the threshold, detection is possible. It can be determined that the detection target has left the area DR. In addition, the state where the Z coordinate is equal to or greater than the threshold can also be said to be the state where the detection target exists within the detectable region DR.

Furthermore, in the entry/exit determination process for the detectable region DR, determination can be made using only the Z coordinate. Therefore, it is also possible to reduce the processing load of the control unit 3 by converting only the Z coordinate with respect to the sensor value from the light receiving unit 22 after the exit determination from the detectable region DR until the next entry determination. can.

FIG. 5 is a diagram showing the operation region R of Example 1 when viewed from the light receiving center direction (Z direction). FIG. 6 is a diagram showing the operation area R of Example 1 when viewed from the longitudinal direction (X direction) of the substrate 23. As shown in FIG. FIG. 7 is a perspective view showing the operation area R of the first embodiment when viewed obliquely from above.

As shown in FIGS. 5 and 6, two virtual boundary planes are set in the detectable region DR to define the boundary of the operation region R in the Y direction. Since each virtual boundary surface is a plane parallel to the XZ plane, the position of the virtual boundary surface in the Y direction is defined by the numerical value of the Y coordinate. In other words, of the detectable region DR, the region sandwiched between the two virtual boundary surfaces, that is, the region between the two virtual boundary surfaces becomes the operation region R. Therefore, the numerical value that defines the position of the virtual boundary surface in the Y direction can also be said to be the threshold value of the operation region R in the Y direction. As described above, since the coordinate system of the detectable region DR has the light receiving unit 22 as the origin, one of the two virtual boundary surfaces is defined by the positive Y coordinate, and the other virtual boundary surface is defined by the positive Y coordinate. Defined by the negative Y coordinate.

Therefore, as shown in FIGS. 5 to 7, the operation area R extends along the XZ plane (extends in the X direction and the Z direction) and becomes a plate-like area having a predetermined thickness in the Y direction. In other words, the operation region R becomes a region having a shape with a thickness in the Y direction inside the detectable region DR centered on the XZ plane where the Y coordinate is (Y=0).

Then, the non-contact input device 1 of the present embodiment detects a gesture operation in the operation area R based on the XZ plane (operation plane) where the Y coordinate is zero (Y=0). That is, in the non-contact input device 1, the operation plane serves as the reference plane of the operation area R. As shown in FIG. Also, the optical sensor 2 (the light emitting unit 21 and the light receiving unit 22) is positioned on the extended plane of the operation plane. In this embodiment, the optical sensor 2 is positioned on an extension plane extending downward from the operation plane. That is, the operation plane (operation area R) is set above the optical sensor 2 .

Also, in this embodiment, the XZ plane will be described as the operation plane. Therefore, the operation plane and the first direction are parallel to each other, and the first direction is a direction on the operation plane, and the light-receiving element is directed toward the operation plane from the edge or the vicinity of the edge of the operation plane. Line direction is facing. Also, the operation plane and the second direction are perpendicular, and the second direction is the normal direction of the operation plane. However, the light-receiving elements do not have to be orthogonal in each of the first direction and the second direction.

The operation plane may be a plane slightly inclined with respect to the XZ plane as long as it extends in the X direction and the Z direction. It may be a plane offset from the XZ plane where the Y coordinate is zero (Y=0).

It can be said that the operation region R and the operation plane included therein are regions extending in the light receiving center direction of the light receiving unit 22 and in a direction orthogonal to the light receiving center direction of the light receiving unit 22 . In this embodiment, of the two directions in which the operation region R and the operation plane extend, the direction orthogonal to the light receiving center direction of the light receiving unit 22 is the same direction as the direction in which the light emitting unit 21 and the light receiving unit 22 are arranged. That is, both the light emitting section 21 and the light receiving section 22 are positioned on the X axis of the operation plane.

There is no particular limitation on the method of the entry/exit determination processing for the operation area R that determines whether the detection object has entered or exited from the operation area R set as described above. . As an example of the method of the entry/exit determination process for the operation area R, for example, the Y coordinate of the coordinate data 45 is the coordinate outside the virtual boundary surface (the state where the object to be detected is located outside the operation area R). ) to the state of the coordinates inside the virtual boundary surface (the state where the detection target is positioned inside the operation region R), it can be determined that the detection target has entered the operation region R. . Further, when the Y coordinate of the coordinate data 45 changes from the coordinates inside the virtual boundary surface to the coordinates outside the virtual boundary surface, it is determined that the object to be detected has left the operation area R. can do. Note that the state where the Y coordinate is the coordinate inside the virtual boundary plane can also be said to be the state where the object to be detected exists within the operation region R. FIG.

Also, in the entry/exit determination process for the operation area R, determination can be made using only the Y coordinate and the Z coordinate for calculating the Y coordinate. Therefore, after the exit from the operation area R is determined, until the next entry is determined, only the Y coordinate and the Z coordinate are converted (only the number B is calculated) with respect to the sensor value from the light receiving unit 22, and the determination process is performed. , the processing load on the control unit 3 can be reduced.

8A and 8B are diagrams showing an example of an input operation when viewed from the longitudinal direction of the substrate 23. FIG. FIG. 9 is a diagram showing an example of an input operation when viewed from the light receiving center direction. FIG. 10 is a perspective view showing an example of an input operation when viewed obliquely from above.

As shown in FIGS. 8 to 10, when the object to be detected exists within the operation area R, motion detection on the operation plane (operation area R) becomes possible, and the object to be detected is outside the operation area R. If it exists (the object to be detected does not exist within the operation area R), the motion cannot be detected. In this embodiment, when it is determined that the user has entered the operation area R, the gesture operation detection mode (motion detection mode) is started, and when it is determined that the user has left the operation area R, the operation detection mode ends. do. Therefore, the mode determination program 43 is also a program for starting/ending the motion detection mode.
<Action detection processing>

During execution of the motion detection mode, the motion detection program 44 detects changes in the position (coordinates) of the detection object indicated by the coordinate data 45, that is, changes in sensor values input from the light receiving unit 22 (each light receiving element). It is a program for detecting a motion (gesture operation) of a detection target in an operation region R (operation plane) by calculation.

The method of motion detection processing for detecting a motion on the operation plane from changes in the coordinate data 45 is not particularly limited. There is a method in which vectors (vectors to be detected) are continuously detected at predetermined detection cycles (5 to 30 mm/sec), and a gesture operation is detected based on the vectors to be detected. That is, the gesture operation is detected from the change in the coordinate data 45 continuously acquired at predetermined time intervals.

In this case, data of a reference vector (reference vector) corresponding to a pre-registered gesture operation (registered gesture) is created in advance, and each time a vector to be detected is detected, the data of the vector to be detected is detected. and reference vector data to determine whether the vector to be detected is the reference vector, that is, whether the motion of the detection target on the operation plane is a registered gesture.

FIG. 11 is an explanatory diagram illustrating an example of a histogram for action determination (gesture determination) according to the first embodiment. As shown in FIG. 11, in the first embodiment, as registered gestures, linear gestures directed upward, downward, leftward, or rightward on the operation plane (gestures such as drawing straight lines in any one of the upward, downward, leftward, or rightward directions) V1 to V4. , a right rotation gesture (a gesture like drawing a circle clockwise) V5 on the operation plane and a left rotation gesture (a gesture like drawing a circle counterclockwise) V6 on the operation plane are registered. , and reference vectors corresponding to each of the registered gestures V1 to V6 are registered. Note that the left and right directions of the reference vector are set according to the left and right directions when viewed from the negative side of the Y coordinate, and the left and right directions are reversed when viewed from the positive side of the Y coordinate. Become.

Specifically, for the linear gestures V1 to V4, the difference between the positions of the two coordinate data 45 before and after the detection cycle (at the start and end) of the detection cycle, that is, the previous position (at the start of the cycle) P1(x1 , z1) and the current (at the end of the cycle) position P2 (x2, z2) is determined as a vector to be detected.

Further, for the rotation operations V5 and V6, the difference between the positions of the three coordinate data 45 in the two detection cycles, that is, the position P0 (x0, z0) two times before (at the start of the first cycle) and the position P0 (x0, z0) the previous time (1 Cross product of two vectors generated from position P1 (x1, z1) at the end of the second cycle and at the start of the second cycle and position P2 (x2, z2) at the current time (at the end of the second cycle) It is determined by the positive or negative of . Then, when the motion detection mode is started, each time the detection cycle ends, it is determined whether or not the vector to be detected is the reference vector corresponding to each of the registered gestures V1 to V6.

In addition, in the histogram for gesture determination according to the first embodiment, the number of detections of registered gestures is counted ("Number of Detections" column in FIG. 11). When it is determined that the vector to be detected is a registered gesture, that is, when a registered gesture is detected, the detection count of the detected registered gesture is incremented by one (added by one). FIG. 11 shows histograms in which the left-to-right linear gesture V1 and the bottom-to-up linear gesture V4 are detected once each.

The detection target vector data, the reference vector data (registered gesture data), and the histogram data for gesture determination are stored in the storage unit as motion detection data 46 .

Then, when the motion detection mode ends, that is, when it is determined that the user has left the operation area R, data (operation data) 47 of gesture manipulations detected during execution of the motion detection mode is generated according to the number of detections. and the operation data 47 is transmitted to the operation target at appropriate timing. Note that when a plurality of gesture operations are detected, one operation data 47 including data of a plurality of gesture operations may be generated, or one operation data 47 may be generated for each gesture operation. may be generated. Moreover, when one operation data 47 including data of a plurality of gesture operations is generated, the operation data 47 may include data in the order in which the plurality of gesture operations are detected.
<Flowchart>

FIG. 12 is a flowchart of the action determination process. The motion determination process will be described below with reference to FIG. The motion determination process is started when a detection target enters the detectable region DR, that is, when the Z coordinate (the total output value of the optical sensor 2) changes from below the threshold to above the threshold.

When the action determination process is started, it is determined whether the user has entered the operation area R (step S1). If it is not determined in step S1 that the detection target has entered the operation area R (step S1: NO), the process returns to step S1. That is, it waits until it is determined that the object to be detected has entered the operation region R.

On the other hand, if it is determined in step S1 that the object to be detected has entered the operation area R (step S1: YES), the motion detection mode is started, the vector to be detected is detected (step S2), and detected in step S2. It is determined whether the vector to be detected is a reference vector (step S3).

If it is determined in step S3 that the vector to be detected is not the reference vector (step S3: NO), the process proceeds to step S5, which will be described later. On the other hand, if it is determined in step S3 that the vector to be detected is the reference vector (step S3: YES), the detected number of registered gestures (movements) corresponding to the reference vector is incremented by one (step S4), Determination of leaving the operation area R is performed (step S5).

If it is not determined in step S5 that the object to be detected has left the operation area R (step S5: NO), that is, if the object to be detected remains in the operation area R, the process returns to step S2. The process of step S4 is repeatedly performed for each detection cycle.

On the other hand, if it is determined in step S5 that the object to be detected has left the operation area R (step S5: YES), the motion detection mode is terminated, and it is determined whether or not a registered gesture (motion) has been detected (step S5: YES). S6).

If it is determined in step S6 that no registered gesture has been detected (step S6: NO), the process proceeds to step S8, which will be described later. On the other hand, if it is determined in step S6 that a registered gesture has been detected (step S6: YES), operation data corresponding to the detected registered gesture is generated (step S7), and histogram data for gesture determination is initialized. (step S8), and it is determined whether or not the motion determination process is finished, that is, whether or not the detection object has left the detectable area DR (step S9).

If it is not determined in step S9 that the detection target has left the detectable region DR (step S9: NO), that is, if the detection target remains within the detectable region DR, the process returns to step S1. On the other hand, if it is determined in step S9 that the detection object has left the detectable region DR (step S9: YES), the motion determination process is terminated.

As described above, in the present invention, the optical sensor 2 is positioned on the extended plane of the operation plane and detects the movement of the detection target on the operation plane. The motion (gesture operation) of the detection target can be accurately detected regardless of the distance). Moreover, since the motion of the detection target on the operation plane is detected, the motion of the detection target can be accurately detected regardless of the size of the detection target.

Further, the light-receiving section 22 has a plurality of light-receiving elements 22A to 22D arranged so as to line up two or more in each of the first direction and the second direction crossing the first direction, and the plurality of light-receiving elements Since the three-dimensional position (X coordinate, Y coordinate, Z coordinate) of the detection target on the operation plane is detected based on the multiple sensor values output from 22A to 22D, the movement of the detection target can be accurately detected. can be done.

Furthermore, the sensor value input from the light receiving unit 22 is converted into coordinate data by integer arithmetic processing, and the movement of the detection object on the operation plane is detected from the change (difference) of the converted coordinate data, so complicated calculations are not required. Therefore, the processing load on the control unit 3 can be reduced, and the manufacturing cost can be reduced, the processing speed can be increased, or the response speed can be improved.

In addition to the configuration described above, a configuration that enables the operation plane or the operation region R to be visually recognized may be added. For example, an aerial imaging unit that displays an image in the air may be provided to display an image corresponding to the operation plane or the operation area R. FIG. In addition, an index object that serves as an index may be arranged at the end of the operation plane or the operation area R. FIG.

Further, determination of a gesture is not limited to coordinates, and may be determined based on changes in a data string that continues at predetermined time intervals in sensor values such as brightness acquired by each light receiving element. In this case, artificial intelligence (AI) is used to learn various gesture learning data, and the sensor value data string acquired by this artificial intelligence (AI) corresponds to which gesture. It is good also as a structure which determines whether it carries out.

Furthermore, in the above embodiment, both the light emitting section 21 and the light receiving section 22 are positioned on the X axis of the operation plane, but the light emitting section 21 and the light receiving section 22 are arranged side by side in the Y direction. Alternatively, they may be arranged in any direction other than the X and Y directions. However, in these cases, the light receiving section 22 is preferably arranged on the X axis.

FIG. 13 is a block diagram showing the configuration of the non-contact input device 1 of Example 2. As shown in FIG. FIG. 14 is a perspective view showing the configuration and operation area R of the optical sensor 2 of Example 2. FIG. As shown in FIGS. 13 and 14 , the second embodiment differs from the first embodiment in that the non-contact input device 1 has a plurality of optical sensors 2 .

Specifically, the non-contact input device 1 has three optical sensors 2A-2C. Each of the three optical sensors 2A to 2C is connected to the controller 3 so as to be communicable. The configuration of each of the three photosensors 2A to 2C is the same as that of the photosensor 2 of the first embodiment, so detailed description thereof will be omitted.

The three photosensors 2A to 2C are arranged at equal intervals in a direction perpendicular to the light receiving center direction of the light receiving portion 22 (the X direction in this embodiment), out of the two directions in which the operation plane extends. That is, the three optical sensors 2A to 2C are arranged so that the operation regions R and the operation planes set in the respective optical sensors 2A to 2C are aligned in the X direction. Further, the light receiving center directions of the three optical sensors 2A to 2C are all parallel to each other. Furthermore, the direction in which the three optical sensors 2A to 2C are arranged side by side is parallel to the operation plane and is the first direction, and at least the light receiving units 22 (light receiving elements) are arranged in a line parallel to the operation plane. ing. It is preferable that not only the light-receiving portions 22 (light-receiving elements) but also the light-emitting portions 21 are arranged in a line parallel to the operation plane. That is, it is preferable that the optical sensors 2 themselves are arranged in a line parallel to the operation plane.

Also, the distance between adjacent optical sensors 2 (separation in the X direction) is set to such a distance that the operation regions R and the operation planes overlap each other when viewed in the Y direction. Therefore, as shown in FIG. 14, the operation area R and the operation plane set for each of the optical sensors 2A to 2C are combined. Here, the length in the direction in which the photosensors 2A to 2C are arranged (the X direction in this embodiment) increases according to the number of the photosensors 2, so the direction in which the photosensors 2A to 2C are arranged is L It can also be called a direction (longitudinal direction).

Further, as shown in FIG. 13 , in the second embodiment, since a plurality of optical sensors 2 are provided, the storage unit 4 stores the contents of the first embodiment, as well as the light receiving units 22 of the plurality of optical sensors 2 . A synthesizing program 48 for synthesizing sensor values input from (each light receiving element) is stored. Although the method of synthesizing processing for synthesizing sensor values input from a plurality of optical sensors 2 is not particularly limited, for example, calculation can be performed by the following formula (number D).
[number D]
L=1/2D+D×(Nmax−1)+k×Xmax

Here, D is the distance (mm) between the optical sensors 2, and Nmax is the sensor number of the optical sensor 2 with the maximum Y coordinate value (light at the end in the L direction). The sensor 2 is the first sensor, and the number is assigned in the order in which they are arranged in the L direction), and k is an arbitrary correction coefficient.

The contents of the motion detection process, other configurations and operations are the same as those of the first embodiment except that the X coordinate is replaced with that for the L seat, and detailed description thereof will be omitted. Also, the same reference numerals are given to the same elements. Also in the second embodiment, the same effects as in the first embodiment can be obtained.

In addition, in the second embodiment, since the operation area can be extended (enlarged) in the horizontal direction (X direction), it is possible not only to accept gesture operations in a wider range, but also to detect gesture operations with long strokes. It is also possible to increase the types of detectable gesture operations, such as becoming

In the above-described embodiment, the light emitting portion 21 and the light receiving portion 22 of each optical sensor 2 are positioned on the X axis of the operation plane, but the light emitting portion 21 and the light receiving portion 22 of each optical sensor 2 are positioned on the Y axis. They may be arranged so as to line up in the direction, or may be arranged so as to line up in any direction other than the X direction and the Y direction. However, in these cases, the light receiving section 22 is preferably arranged on the X axis.

FIG. 15 is a block diagram showing the configuration of the non-contact input device 1 of Example 3. As shown in FIG. The non-contact input device 1 of Example 3 differs from Example 1 in that a sign can be detected from one or more motions. A sign is a number, a symbol, a figure, a pattern, or the like drawn (configured) by a plurality of gesture operations (movements). As shown in FIG. 15, in the third embodiment, as a configuration for detecting a sign, the storage unit 4 includes a direction determination program 49, a sign detection program 50, and a sign reference table 51 in addition to the contents of the first embodiment. remembered.
<Direction determination processing>

The direction determination program 49 determines the direction in which the detection object enters the operation region R (the Y direction), that is, the direction in which the detection object enters the operation region R, that is, is a program for judging whether has entered from the plus side of the Y coordinate or from the minus side of the Y coordinate. The method of direction determination processing for determining the approach direction of the detection object to the operation region R is not particularly limited. can be determined by the positive/negative of the Y coordinate when it is determined to have entered the . The direction in which the object to be detected enters the operation area R determined in this direction determination process is the direction of the operator, and the left and right directions of the vectors in the motion detection process and the sign detection process are the left and right directions as seen from the operator. is set according to
<Signature detection processing>

The signature detection program 50 is a program for detecting a signature by calculation from movements on one or more operation planes detected from changes in the position of the object to be detected indicated by the coordinate data 45 during execution of the movement detection mode. be. The method of detecting the signature from the motion on the operation plane is not particularly limited, but for example, one or a combination of multiple motions on the operation plane detected in each detection cycle corresponds to a pre-registered signature (registered signature). There is a method of detecting it as an input signature.

For example, data of a combination of motions (registered gestures) constituting a registered sign is referenced in advance, and a histogram (histogram for sign determination) for each motion detected during execution of the motion detection mode is input. Determines whether to detect as a signature.

FIG. 16 is an explanatory diagram showing an example of a histogram for signature determination according to the third embodiment. As shown in FIG. 16, in the signature determination histogram of Example 3, as registered gestures, straight gestures V1 to V4 directed upward, downward, leftward, and rightward on the operation plane, and the directions of V1 through V4 are tilted by 45°. Linear gestures V5 to V8, a right rotation gesture V9 on the operation plane, and a left rotation gesture V10 on the operation plane are set. is set. The left-right direction of the reference vector is set according to the left-right direction when viewed from the approach direction determined in the direction determination process.

In the signature determination histogram of Example 3, the number of detections of each registered gesture is counted (the column of "number of detections" in FIG. 16). As described in the first embodiment, when a registered gesture is detected, the number of detected registered gestures is incremented by one.

FIG. 17 is an explanatory diagram showing an example of a signature reference table according to the third embodiment. FIG. 18 is an explanatory diagram showing another example of the signature reference table according to the third embodiment. The signature reference tables shown in FIGS. 17 and 18 are tables showing combinations of registered gestures forming registered signs.

The sign reference table shown in FIG. 17 is expressed by the number of detections of each registered gesture necessary for drawing a sign. As shown in FIG. 17 , for example, the number “0” is composed of a left rotation gesture V10 for four cycles. The number "2" is represented by two cycles of a left-to-right linear gesture V1, a one-cycle upper-right to lower-left linear gesture V7, and a three-cycle clockwise rotation gesture V9. Consists of Furthermore, the figure "□" is composed of two cycles of gestures V1 to V4.

The sign reference table shown in FIG. 18 expresses the rate of each registered gesture in the line length when drawing a sign. As shown in FIG. 18 , for example, the number “0” is composed only of left-turning gestures (100%). Also, the number "2" is composed of 33% gesture V1, 17% gesture V7, and 50% gesture V9. Furthermore, the figure "□" is composed of 25% gestures V1 to V4, respectively.

When the motion detection mode ends, the histogram for signature determination is compared with the signature reference table, and if the difference is less than or equal to a predetermined threshold value, or if there is a signature whose degree of matching is greater than or equal to a predetermined threshold value. , a series of motions is detected as an input signature. When comparing the signature determination histogram and the signature reference table, the number of detections of each registered gesture necessary for drawing a sign may be compared, or the number of detected registered gestures in the line length when drawing a sign may be compared. can be compared by the ratio of Also, if there are a plurality of signatures whose degree of matching is equal to or greater than a predetermined threshold, the signature with the highest degree of matching is taken as the input signature. When the registration signature is detected, operation data 47 corresponding to the registration signature is generated.
<Flowchart>

FIG. 19 is a flowchart of signature determination processing. The signature determination process will be described below with reference to FIG. The signature determination process is started when a detection target enters the detectable region DR. Note that the processing from steps S11 to S15 is the same as steps S1 to S5 of the first embodiment except that the histogram for gesture determination is used instead of the histogram for gesture determination, so detailed description will be omitted. omitted.

The signature determination process is started, and if it is determined in step S15 that the object to be detected has left the operation area R (step S15: YES), the motion detection mode is terminated, the signature reference table is read out (step S16), and the signature The judgment histogram is compared with the signature reference table to judge whether or not the registered signature has been detected (step S17).

If it is determined in step S17 that the registration signature has not been detected (step S17: NO), the process proceeds to step S19, which will be described later. On the other hand, if it is determined in step S17 that the registered signature has been detected (step S17: YES), operation data corresponding to the detected registered signature is generated (step S18), and the histogram data for signature determination is initialized. (step S19), and it is determined whether or not to end the motion determination process, that is, whether or not the detection object has left the detectable area DR (step S20).

If it is determined that the detection target has not left the detectable region DR in step S20 (step S20: NO), that is, if it is determined that the detection target remains within the detectable region DR, step Return to S11. On the other hand, if it is determined in step S20 that the detection object has left the detectable region DR (step S20: YES), the signature determination process is terminated.

Since other configurations and operations are the same as those of the first embodiment, detailed description thereof will be omitted. Also, the same reference numerals are given to the same elements. Also in the third embodiment, the same effects as in the first embodiment can be obtained.

Further, in the third embodiment, since a sign more complicated than individual registered gestures can be detected, the degree of freedom of operation data is increased, and the convenience of operating an operation target is improved.

Furthermore, in the third embodiment, the approach direction in which the object to be detected enters the operation area is detected, and the sign is detected in the direction corresponding to the approach direction. , and the signature can be properly and accurately detected.

In the non-contact input device 1 of the fourth embodiment, instead of the vector-based motion detection method, the operation region R (operation plane) is divided into a plurality of blocks, and motion detection is performed by detecting movement between the blocks. is different from the first embodiment.

FIG. 20 is a diagram showing an example of a motion determination block according to the fourth embodiment. As shown in FIG. 20, in the fourth embodiment, an operation area R (operation plane) is divided into a plurality of blocks. In the example shown in FIG. 20, in the operation region R (operation plane), the area on the lower side is A block, the area on one of the left and right sides (the left side as viewed in FIG. 20) is block B, and the other on the left and right The area on the side (on the right side as viewed in FIG. 20) is C block, the upper area is D block, and the central area surrounded by A to D blocks is E block. Also, an area outside the operation region R (operation plane) is defined as an F block.

In this way, the position (coordinates) of the detection target indicated by the coordinate data 45 is detected in chronological order, and the detection target exits the operation area R (operation plane) after entering the operation area R (operation plane). It is possible to detect which blocks the detection target has passed through before reaching the target, that is, the movement path of the detection target on the operation plane. Actions can be detected from the movement path of the detection target. For example, when the position of the detection target passes through blocks B, E, and C in this order, it can be determined that the motion is a straight left-to-right gesture operation. Also, when the position of the detection object passes through blocks A, B, D, and C in this order, it can be determined that the movement is clockwise rotation.

In addition, in the fourth embodiment, the action of moving between two blocks may be determined to be any of flick, swipe (pan), and drag. When flicking, swiping (panning), and dragging are to be discriminated, they can be discriminated by the speed (acceleration) of movement between blocks, the position of the Y coordinate, and the like. Further, an action of moving between two blocks arranged in the Z direction (for example, an action of moving from E block to A block) may be determined as a touch (tap) used for item selection or the like. Furthermore, when an action of moving twice continuously between two blocks arranged in the Z direction is detected, it may be determined as a double touch (double tap). Furthermore, when staying in the same block for a predetermined period of time or longer, it may be determined as a long touch (long tap). Further, a motion of reciprocating two or more times between two blocks may be determined as a shake operation.

Since other configurations and operations are the same as those of the first embodiment, detailed description thereof will be omitted. Also, the same reference numerals are given to the same elements. Also in the third embodiment, the same effects as in the first embodiment can be obtained. Further, according to the fourth embodiment, it is possible to detect not only linear motions and rotational motions, but also various motions.

In the fourth embodiment, the operation area is divided into the front side and the back side in the approach direction (Y direction) of the detection object, and by detecting the movement between the front side block and the back side block, , Y-direction motion detection may be performed. By doing so, it is possible to detect a touch operation (an operation of pressing a button or the like) in the approach direction of the detection object.
About this invention and examples (embodiments),

The optical sensor of the present invention corresponds to the optical sensor 2 of each embodiment, the light emitting portion corresponds to the light emitting portion 21, the light receiving portion corresponds to the light receiving portion 22, and the motion detection portion corresponds to the motion detection program 44 and the motion detection program 44. The plurality of light receiving elements correspond to the light receiving elements 22A to 22D, the combining section corresponds to the combining program 48 and the control section 3 operating according to it, and the sign detection section corresponds to the sign detection program. 50 and the control unit 3 that operates according to this, and the direction determination unit corresponds to the direction determination program 49 and the control unit 3 that operates according to this, but the present invention is not limited to this embodiment and can be applied to various other embodiments. can do. Also, the specific configurations and the like given in the above-described embodiments are examples, and can be changed as appropriate according to actual products.

For example, the operation plane of the XZ plane described above is set as the first operation plane, the operation area R based on the first operation plane is set as the first operation area, and in addition, the operation plane of the YZ plane (second A second operation area may be set with reference to the operation plane of . By doing so, the motion can be detected from both the X direction and the Y direction. That is, gesture operations from four directions are possible.

The non-contact input device 1 of the present invention can be applied, for example, to an elevator operating panel (operating panel). In this case, the operation plane is set to be a parallel plane separated from the surface of the operation panel of the elevator by a predetermined distance. Then, the floor number of the destination can be set according to gesture operations in the vertical direction on the operation plane, or the floor number of the destination can be set by inputting a sign (number). In this way, the elevator can be operated without touching the operation panel of the elevator.

Further, the present invention provides not only a non-contact input device, but also a method, a program, and a program for detecting motion of a detection target on an operation plane as described above using a non-contact input device. It can also be provided as a stored storage medium.

INDUSTRIAL APPLICABILITY The present invention can be used in industries that receive input operations in a non-contact manner and operate objects such as electronic devices.

Reference Signs List 1 Non-contact input device 2 Optical sensor 21 Light emitting unit 22 Light receiving unit 22A to 22D Light receiving element 3 Control unit 4 Storage unit

Claims (5)

a light-emitting portion that emits light; and a light-receiving portion that receives reflected light generated when the light emitted from the light-emitting portion is applied to a detection target and outputs a sensor value based on the intensity of the received light. an optical sensor comprising
a motion detection unit that detects a motion of the detection target on an operation plane set within a detectable area of the optical sensor based on the sensor value output from the light receiving unit;
The optical sensor is a non-contact input device located on an extension plane of the operation plane. The light-receiving unit has a plurality of light-receiving elements arranged two or more in each of a first direction and a second direction intersecting the first direction,
2. The non-contact input device according to claim 1, wherein the motion detection section detects the motion of the detection object on the operation plane based on the plurality of sensor values output from the plurality of light receiving elements. a plurality of the optical sensors arranged side by side in a predetermined direction;
3. The non-contact input device according to claim 1, further comprising a synthesizing unit for synthesizing sensor values output from each of said plurality of optical sensors. 4. The non-contact input device according to claim 1, further comprising a sign detection unit that detects a sign from one or more of said motions. A direction determination unit that determines an approach direction in which the detection object enters an operation area that includes the operation plane and is set within the detectable area. 5. The non-contact input device according to claim 4, which detects signs.

Images