WO2014168416A1 - Non-contact operation device and electronic device linked with same - Google Patents

Abstract

To provide a non-contact operation device having low power consumption, a quick algorithm for recognizing a motion, low manufacturing cost, and a simple motion recognition processing step, the present invention provides the non-contact operation device comprising: one or more light-emitting portions for emitting light; one or more light receiving portions comprising a plurality of light sensors arranged in horizontal and vertical arrays, for receiving light from the light emitting portion as a light source and reflected due to a motion of an object, and converting into an electric signal an optical signal with respect to the motion of the object containing information on the strength and angle of the light that is received; and a micro-control unit (MCU) for receiving an input of the electric signal, calculating space coordinates of the object, determining a gesture motion with respect to the motion of the object by using the space coordinates, and generating a control signal corresponding to the gesture motion.

Description

Non-contact operation device and associated electronic device

The present invention relates to a contactless control device and an electronic device linked thereto, and more particularly, to a non-contact control device and an electronic device linked thereto, which can provide a new and various interface to a user through a simple position and / or motion recognition process. It is about.

With the rapid change in IT technology, various control methods through motion recognition have been proposed for convenient use in various situations. Motion recognition in the control methods is implemented using an image sensor (camera). In order to recognize the motion with the image sensor, power must be connected at all times, so a lot of power is unnecessarily wasted. In addition, since the image sensor requires a series of processes for extracting a plurality of images from the motion recognition process to perform image processing, the burden on the processor is high and the device implementation and processing algorithms are very complicated. Therefore, in order to implement motion recognition with an image sensor, a problem arises in that the manufacturing cost increases.

The present invention is to solve a number of problems including the above problems, low power consumption, fast algorithm for motion recognition, low manufacturing cost, and provides a non-contact operation device with a simple operation recognition process, An object of the present invention is to provide an electronic device interlocked with such a non-contact manipulation device. However, these problems are exemplary, and the scope of the present invention is not limited thereby.

Non-contact manipulation apparatus according to one aspect of the present invention can be provided. The non-contact manipulation device may include at least one light emitting unit capable of emitting light; Comprising a plurality of optical sensors arranged in a horizontal and vertical array, respectively, receiving the light reflected by the object motion by using the light emitting unit as a light source, for the object motion having information on the intensity and angle of the received light At least one light receiving unit capable of converting an optical signal into an electrical signal; And a microcontrol unit configured to receive the electrical signal, calculate a spatial coordinate for the object, determine a gesture motion with respect to the object motion using the spatial coordinate, and generate a control signal corresponding to the gesture motion. MCU);

In the non-contact manipulation apparatus, the light receiving unit comprises: a first array unit including a plurality of photodiodes arranged horizontally; And a second array unit including a plurality of photodiodes arranged in a vertical array, wherein the optical signal for the object motion comprises: an optical signal for a horizontal component of the object motion detected by the first array unit; An optical signal for a vertical component of the object motion detected by the second array unit; And an optical signal for the height component of the object motion detected by the first array unit and the second array unit.

In the non-contact manipulation apparatus, the first array portion and the second array portion may be arranged separately from each other and spaced apart from each other without being mixed.

The contactless control device is a computer, notebook, tablet PC, tablet mobile communication device, smart phone, mobile phone, smart pad, game device, virtual experience device, portable multimedia playback device, electronic book, USB hub (USB HUB) The electronic device may further include a communication unit configured to transmit to an electronic device including at least one of a mouse, a keyboard, a monitor, and a headset. The control signal may include a signal for controlling hardware constituting the electronic device or software installed on the electronic device.

In the contactless operation apparatus, the communication unit may include at least one of a wireless communication unit using Bluetooth communication or Zigbee communication and a wired communication unit using a universal serial bus (USB) cable.

In the non-contact manipulation device, at least some of the light emitting unit, the light receiving unit, the microcontrol unit, and the communication unit may be embedded in the electronic device.

In the non-contact manipulation apparatus, at least some of the light emitting unit, the light receiving unit, the microcontrol unit, and the communication unit may be disposed outside the electronic device.

In the non-contact manipulation apparatus, the light emitting portion and the light receiving portion may be disposed apart from each other without being modularized.

In the non-contact manipulation apparatus, the light emitting unit and the light receiving unit may constitute at least one non-contact sensor module. Here, the at least one non-contact sensor module includes a first non-contact sensor module and a second non-contact sensor module spaced apart from each other, the microcontrol unit, the separation distance of the first and second non-contact sensor modules and the first The height component of the spatial coordinates of the object may be calculated using the light receiving angles of the reflected light received by the light receiving units provided in the first and second non-contact sensor modules, respectively.

In the non-contact manipulation apparatus, the at least one light receiving unit includes a first light receiving unit and a second light receiving unit spaced apart from each other, and the microcontrol unit includes a separation distance between the first light receiving unit and the second light receiving unit and the first light receiving unit. And a height component of the spatial coordinates of the object using the light receiving angle of the reflected light received by the second light receiving unit.

The light emitting unit may include an infrared light emitting diode (IRED), and the light receiving unit may include a photodiode.

An electronic device according to another aspect of the present invention may be provided. The electronic device may be configured in conjunction with the non-contact manipulation apparatus described above.

The electronic device includes a computer, a laptop, a tablet PC, a tablet mobile communication device, a smartphone, a mobile phone, a smart pad, a game device, a virtual experience device, a portable multimedia player, an electronic book, a USB hub, a mouse, a keyboard, It may include at least one of a monitor and a headset.

According to some embodiments of the present invention made as described above, there is provided a non-contact operation device and a linked electronic device with low power consumption, fast algorithm for motion recognition, low manufacturing cost, and simple motion recognition processing. can do. Of course, the scope of the present invention is not limited by these effects.

1 is a configuration diagram illustrating a configuration including a non-contact operation device according to an embodiment of the present invention.

2 is a view illustrating a non-contact sensor module including a light emitting unit and a light receiving unit in a non-contact manipulation apparatus according to an embodiment of the present invention.

3 and 4 are views illustrating a concept in which the first array unit detects an optical signal for a horizontal component of the movement of the object in the non-contact manipulation device according to the embodiment of the present invention.

5 and 6 are views illustrating a concept of detecting the optical signal for the vertical component of the movement of the object in the non-contact manipulation apparatus according to an embodiment of the present invention, respectively.

7 is a view illustrating a concept of the non-contact sensor module to detect the optical signal for the height component of the movement of the object in the non-contact operation device according to an embodiment of the present invention.

8 is a block diagram illustrating a configuration including a non-contact manipulation apparatus according to a modified embodiment of the present invention.

FIG. 9 illustrates a concept of calculating a spatial coordinate of an object based on an optical signal detected by a first array unit and a second array unit in a non-contact manipulation apparatus according to an embodiment of the present invention.

10 is a configuration diagram illustrating a configuration including a non-contact manipulation apparatus according to another embodiment of the present invention.

FIG. 11 is a diagram illustrating a concept of calculating a height component among spatial coordinates of an object by using a distance between two non-contact sensor modules and a light receiving angle of reflected light in a non-contact manipulation device according to another exemplary embodiment of the present invention.

12 is a configuration diagram illustrating a configuration including a non-contact manipulation apparatus according to another modified embodiment of the present invention.

13A and 13B illustrate a concept in which a first array unit detects an optical signal for a horizontal component of a movement of an object in a non-contact manipulation device according to still another embodiment of the present invention.

14 is a diagram illustrating a configuration of a mouse to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

15 is a diagram illustrating a configuration of a keyboard to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

16 is a diagram illustrating a configuration of a USB hub to which a non-contact manipulation device according to some embodiments of the present invention is applied.

17 is a diagram illustrating a configuration of a headset to which a non-contact manipulation device is applied according to some embodiments of the present invention.

18 is a diagram illustrating a configuration of a monitor to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

19 is a diagram illustrating a configuration of a smart phone to which a non-contact manipulation device according to some embodiments of the present invention is applied.

20 is a diagram illustrating a configuration in which a non-contact manipulation device according to some embodiments of the present disclosure is disposed and provided outside of an electronic device.

21A-21D illustrate exemplary movements of an object that may be provided on a mouse to which a non-contact manipulation device is applied in accordance with some embodiments of the present invention.

22A-22D illustrate exemplary movements of an object that may be provided on a keyboard to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

Hereinafter, with reference to the accompanying drawings will be described embodiments of the present invention; The embodiments of the present invention are provided to more fully explain the present invention to those skilled in the art, and the following examples can be modified in various other forms, and the scope of the present invention is It is not limited to the embodiments. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In addition, for convenience and clarity of description, the components illustrated in the drawings may be at least partially exaggerated or reduced in size without being proportional to each other.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an" and "the" may include the plural forms as well, unless the context clearly indicates otherwise. Also, as used herein, the term "comprise" refers to the presence of the shapes, numbers, steps, actions, members, elements, and / or groups mentioned, and one or more other shapes, numbers. It is not intended to exclude the presence or addition of acts, members, elements and / or groups. As used herein, the term "and / or" includes any and all combinations of one or more of the listed items.

The terms first, second, etc. are used herein to describe various members, parts, regions, layers, and / or parts, but these members, parts, regions, layers, and / or parts are defined by these terms. It is obvious that not. These terms are only used to distinguish one member, part, region, layer or portion from another region, layer or portion. Thus, the first member, part, region, layer or portion, which will be discussed below, may refer to the second member, component, region, layer or portion without departing from the teachings of the present invention.

Embodiments of the present invention will now be described with reference to the drawings, which schematically illustrate ideal embodiments of the present invention. In the figures, for example, variations in the shape shown may be expected, depending on manufacturing techniques and / or tolerances. Accordingly, embodiments of the inventive concept should not be construed as limited to the specific shapes of the regions shown herein, but should include, for example, changes in shape resulting from manufacturing.

The present application is filed with the Korean Intellectual Property Office No. 10-2013-0038417, 10-2013-0074878, 10-2013-0038416, 10-2013-0074876, 10-2013-0074877, By claiming priorities with respect to 10-2013-0082215 and 10-2013-0091493, the contents of the above-claimed inventions are hereby incorporated by reference in their entirety.

1 is a block diagram illustrating a configuration including a non-contact manipulation apparatus according to an embodiment of the present invention, Figure 2 is a diagram illustrating a non-contact sensor module in a non-contact manipulation apparatus according to an embodiment of the present invention.

1 to 2, the non-contact manipulation apparatus 1000 according to an embodiment of the present invention includes a light emitting unit 10 and a light receiving unit 20, respectively, and an object (for example, FIGS. 3 and 5). 7, or at least one non-contact sensor module 30 capable of converting the optical signal for S) of FIG. 11 into an electrical signal. The non-contact sensor module 30 includes a light emitting unit 10 and a light receiving unit 20.

The light emitter 10 may irradiate the object S with irradiation light. For example, the light emitting unit 10 may be a light emitting device such as a light emitting diode (LED) capable of irradiating irradiated light, and the light emitting unit 10 may be an infrared light emitting diode in order to detect an operation and / or a position of a human body. (IRED). The light emitter 10 may be configured to emit irradiation light only when necessary according to a user's selection. This is to prevent unnecessary consumption of power by continuously radiating light even during a period of inactivity not used by the user.

The light receiving unit 20 may receive the reflected light reflected from the object S by using the light emitting unit 10 as a light source. The light receiver 20 may include, for example, an array arrangement horizontally and vertically, and a plurality of optical sensors. The optical sensor may be a light receiving device capable of converting an optical signal for the object S into an electrical signal, and may include, for example, a photodiode. For example, the light receiving unit 20 includes a first array unit 20a composed of a plurality of photodiodes 25 arranged horizontally and a second array composed of a plurality of photodiodes 25 arranged vertically. It may include a portion 20b.

The light receiver 20 may convert an optical signal for the object S into an electrical signal. The optical signal refers to all signals related to light in a broad sense, and refers to an optical signal that can be converted into various electrical signals capable of measuring voltage, current, power, etc. in a narrow sense. Furthermore, according to the spirit of the present invention, the optical signal for the object S is, for example, a signal implemented by extracting a plurality of images and performing image processing with respect to the position and / or movement of the object S. Rather, it may mean a signal having information on the intensity of the reflected light and / or the angle of the reflected light that is reflected and received by the static position and / or dynamic movement of the object S. FIG. That is, the optical signal for the object S, for example, as shown in Fig. 4 or 6, the information on the intensity of the reflected light received, for example, as shown in Fig. 11, the light receiving angle of the received reflected light ( ∠θ ₁ and ∠θ ₂ ).

In addition, the non-contact manipulation apparatus 1000 according to an embodiment of the present invention includes a micro control unit (MCU) 40 that receives the electrical signal and calculates a spatial coordinate for the object S. Further, the microcontrol unit 40 determines the static position of the object S by using the spatial coordinates, determines the gesture motion corresponding to the dynamic movement of the object S, and determines the static position and / or A control signal corresponding to the gesture operation may be generated.

Meanwhile, the aforementioned object S may include a body part of a user who uses the non-contact manipulation apparatus 1000 and / or the electronic device 1120. In addition, the object S may include tools, devices, instruments and / or devices that the user possesses or wears. The object S may be fixed in space for a predetermined time, and furthermore, the position S may be variable in space. Accordingly, when the position S is fixed in the space for a predetermined time, the non-contact manipulation apparatus 1000 may perform a function of a position sensor for detecting the position of the object S, and the object S may be Accordingly, when the position is changed in the space, the non-contact manipulation apparatus 1000 may perform a function of a motion sensor or a gesture sensor that detects a movement of the object S and determines a gesture motion corresponding thereto.

Herein, the motion of the object S, that is, the motion of the object, refers to a user's finger movement, palm movement, back movement of the hand, hand movement, arm movement, head movement, It may include at least one of facial movement, eye movement, eye movement, eyelid movement, mouth movement, lip movement, tongue movement, shoulder movement, torso movement, leg movement, toe movement, and foot movement.

Further, the movement of the object S may include not only the movement of the user's body mentioned above, but also the movement of a tool, an apparatus, an apparatus, and / or an apparatus whose position may be changed by the user having or wearing it. For example, when a user wears a ring on which a radiation beam provided by the light emitting unit 10 is reflected on a finger, the movement of the object S may include the movement of the ring.

On the other hand, the non-contact operation apparatus 1000 according to an embodiment of the present invention may further include a communication unit 50 for transmitting the control signal generated by the microcontrol unit 40 to the electronic device 1120. . In addition, the communication unit 50 may transmit and receive information data with the electronic device 1120.

The electronic device 1120 referred to herein is not only a device that is connected to a communication device in the center through a communication network and inputs data or outputs a processing result, but also independently or independently of the computer device in the center. It may include a device that can input or output the processing results. For example, the electronic device 1120 may be a computer, a laptop, a tablet PC, a tablet mobile communication device, a smartphone, a mobile phone, a smart pad, a game device, a virtual experience device, a portable multimedia player, an electronic book, a USB hub, and a USB HUB. ), A mouse, a keyboard, a monitor, and a headset.

The control signal transmitted to the electronic device 1120 by the communication unit 50 may be, for example, a signal capable of controlling at least one hardware or software installed in the electronic device 1120 constituting the electronic device 1120. It may include. For example, when the electronic device 1120 is a keyboard, the control signal may be a signal for operating the keyboard or a computer connected to the keyboard or a signal for controlling software installed in the keyboard or a computer connected to the keyboard. It may include. The communication unit 50 may include at least one of the wireless communication unit 52 and the wired communication unit 54.

The wireless communication unit 52 may use, for example, Bluetooth communication or Zigbee communication. On the other hand, the communication method applied to the wireless communication unit 52 is not limited to the Bluetooth method or the Zigbee method, for example, a variety of RFID (Radio Frequency Identification), NFC (Near Field Communication), resonance induction, magnetic induction Communication methods can also be applied. For Bluetooth communication or Zigbee communication, a setting is required between the contactless operation device 1000 and the electronic device 1120. Accordingly, the electronic device 1120 may include a module supporting Bluetooth communication or Zigbee communication. If the electronic device 1120 does not have such a module, a separate communication repeater, for example, a dongle 220 may be additionally provided to the electronic device 1120. The dongle 220 may include, for example, a USB dongle that may be connected to a USB port of the electronic device 1120, but is not particularly limited to a form connected to the electronic device 1120.

The wired communication unit 54 may be configured to support, for example, a wired cable connecting the non-contact manipulation device 1000 and the electronic device 1120. The wired cable may include, for example, a USB cable or an extension cable, and may connect a connection port portion of the non-contact manipulation apparatus 1000 and a connection port portion of the electronic device 1120.

The non-contact manipulation apparatus 1000 may further include an input / output port unit 60 that may exchange various signals, data, and the like with an external device.

In some embodiments of the present disclosure, at least a part of the non-contact manipulation apparatus 1000 may be embedded in the electronic device 1120. For example, at least some of the components constituting the non-contact manipulation apparatus 1000 (eg, the light emitting unit 10, the light receiving unit 20, the microcontrol unit 40, and the communication unit 50) are electronic devices. The remaining parts of the components constituting the non-contact manipulation apparatus 1000 may be disposed to be exposed in the surface of the electronic device 1120. For example, the light emitting unit 10 and / or the light receiving unit 20 constituting the non-contact sensor module 30 may be disposed to be exposed on the surface of the electronic device 1120, and the microcontrol unit 40 may be electronic. It may be arranged in a form that is embedded inside the device 1120.

Meanwhile, the components constituting the non-contact manipulation device 1000 may be spaced apart from the electronic device 1120 without forming a single unity. Of course, the components forming the non-contact manipulation apparatus 1000 may be provided in the electronic device 1120 while forming a single integral part.

In addition, the non-contact manipulation apparatus 1000 may be provided outside the electronic device 1120 and spaced apart from the electronic device 1120 separately from the electronic device 1120.

Hereinafter, a concept in which the non-contact manipulation apparatus 1000 detects an optical signal and calculates spatial coordinates in response to the position of the object S and / or the movement of the object S will be described.

3 and 4 are views illustrating a concept in which the first array unit detects an optical signal for the horizontal component of the movement of the object in the non-contact manipulation device according to one embodiment of the present invention, and FIGS. 5 and 6 illustrate the present invention. In the non-contact manipulation device according to an embodiment of the present invention, a second array unit illustrates a concept of detecting an optical signal for a vertical component of a movement of an object, and FIG. 7 is a non-contact manipulation device according to an embodiment of the present invention. Is a diagram illustrating the concept of the non-contact sensor module to detect the optical signal for the height component of the movement of the object.

2 to 6, the light receiving unit 20 receives the reflected light reflected by the position of the object S and / or the movement of the object S using the light emitting unit 10 as a light source, and is horizontal and vertical. A plurality of photosensors (eg photodiodes) arranged in an array. The light receiving unit 20 is, for example, a second array in which the photodiode 25 is arranged in the horizontal axis (x-axis) and the second array in which the photodiode 25 is arranged in the vertical axis (y-axis). It may be composed of an array unit 20b.

In the first array unit 20a in which the photodiodes 25 are arranged in the horizontal axis (x-axis), a photodiode 25 having a form of an M1 x N1 matrix may be arranged. Although not shown in FIG. For example, the number of columns N1 may be greater than the number M1 of rows of the matrix. In addition, in the second array unit 20b in which the photodiodes 25 are arrayed on a vertical axis (y-axis), a photodiode 25 having a form of an M2 x N2 matrix may be arranged, but not shown in FIG. 5. For example, but not limited to, the number of rows M2 may be larger than the number of columns N2 of the matrix.

Referring to FIGS. 3 and 5, the first array unit 20a and the second array unit 20b may not be mixed with each other, but may be separately spaced apart from each other. With this configuration, the accuracy of sensing is improved by recognizing the motion by dividing the component of the motion of the object having an arbitrary direction into the horizontal motion and the vertical motion, and this increase in accuracy is due to the improvement of the resolution of the sensor itself. However, since it is implemented by the array arrangement of the existing sensor, it is possible to expect an advantageous effect that the burden of manufacturing cost for improving the accuracy of sensing is significantly lowered.

 In a modified embodiment of the present invention, the first array portion 20a and the second array portion 20b may be disposed adjacent to each other instead of being separated from each other and spaced apart from each other, and further, mixed and disposed. May be

3 and 4, in the first array unit 20a, the horizontal movement of the object S is performed by the plurality of photodiodes 25 arranged in the horizontal axis (movement in a direction parallel to the x-axis). It can detect the optical signal for. Alternatively, in the first array unit 20a, the plurality of photodiodes 25 arranged in the horizontal axis may be used to provide an optical system with respect to the horizontal component (component in the direction parallel to the x axis) of an arbitrary movement of the object S. The signal can be detected.

For example, when the object S moves from left to right in FIG. 3, the intensity of the optical signal of the reflected light received by the first array unit 20a may be reduced by any photodiodes (eg, in the first array unit 20a). It changes with time as shown in FIG. 4 based on 25a, 25b, 25c). That is, as the object S moves closer to the photodiode 25a, the intensity A of the optical signal of the reflected light received by the photodiode 25a is gradually increased, and the photo at the position closest to the photodiode 25a is increased. The intensity A of the optical signal of the reflected light received by the diode 25a peaks, and as the object S moves and moves away from the photodiode 25a, the optical signal of the reflected light received by the photodiode 25a increases. The intensity A is gradually reduced. In the same principle, the distribution of the intensity B of the optical signal with time is shown in the photodiode 25b, and the distribution of the intensity C of the optical signal with time is shown in the photodiode 25c. On the other hand, since the object S moves, the separation distances of the object S and the photodiodes 25a, 25b, and 25c each change sequentially with time, and the intensity (A, B, C) of the optical signal is changed. The distribution also changes sequentially with time. As such, when the intensity and angle of the optical signals detected by each of the plurality of photodiodes 25 arranged in the array are collected and analyzed, the horizontal component of the horizontal movement of the object S or the arbitrary movement of the object S is determined. Vector information such as moving distance, speed, acceleration, and the start and end points of the movement can be grasped.

5 and 6, in the second array unit 20b, the vertical movement of the object S (movement in a direction parallel to the y axis) is performed by the plurality of photodiodes 25 arranged in the vertical axis. It can detect the optical signal for. Alternatively, in the second array unit 20b, the plurality of photodiodes 25 arranged in the vertical axis may be used to provide an optical system with respect to the vertical component (component in the direction parallel to the y axis) of an arbitrary movement of the object S. The signal can be detected.

For example, when the object S moves from the upper side to the lower side in parallel with the y-axis direction as shown in FIG. 5, the optical signal intensity of the reflected light received by the second array unit 20b is in the second array unit 20b. It changes with time as shown in FIG. 6 based on arbitrary photodiodes 25d, 25e, 25f, and 25g. That is, as the object S moves closer and closer to the photodiode 25d, the optical signal intensity D of the reflected light received by the photodiode 25d is gradually increased, and the photodiode at the position closest to the photodiode 25d is increased. The intensity D of the optical signal of the reflected light received at 25d is at its peak, and as the object S moves and moves away from the photodiode 25d, the optical signal intensity of the reflected light received at the photodiode 25d ( D) gradually decreases. In the same principle, the distribution of the optical signal intensity E with time is shown in the photodiode 25e, the distribution of the optical signal intensity F with the time in the photodiode 25f, and time in the photodiode 25g. The distribution of the optical signal intensity G according to the above appears. Meanwhile, since the object S moves, the separation distances of the object S and the photodiodes 25d, 25e, 25f, and 25g sequentially change with time, and the optical signal intensities D, E, F, The distribution of G) also changes sequentially with time. As described above, when the intensity and angle of the optical signal detected by each of the plurality of photodiodes 25 arranged in the array are collected and analyzed, the longitudinal component of the vertical movement of the object S or the arbitrary movement of the object S is determined. Vector information such as moving distance, speed, acceleration, and the start and end points of the movement can be grasped.

Referring to FIG. 7, in the light receiving unit 20 including the first array unit 20a and / or the second array unit 20b, the plurality of photodiodes 25 are arranged in a horizontal axis and / or a vertical axis. The optical signal for the height movement (movement in the direction parallel to the z axis) of the object S can be detected. Alternatively, in the light receiving unit 20 including the first array unit 20a and the second array unit 20b, any of the objects S may be formed by a plurality of photodiodes 25 arrayed in a horizontal axis and / or a vertical axis. The optical signal for the height component (component in the direction parallel to the z axis) of the directional motion can be detected. For example, when the object S moves from the high point to the low point as shown in FIG. 7, the optical of the reflected light received by the light receiving unit 20 including the first array unit 20a and / or the second array unit 20b. The strength of the signal is increased. As such, when the intensity and angle of the optical signals detected by each of the plurality of photodiodes 25 arranged in the array are collected and analyzed, the height component of the height movement of the object S or the arbitrary movement of the object S is determined. Vector information such as moving distance, speed, acceleration, and the start and end points of the movement can be grasped.

As described with reference to FIGS. 3 and 4, the optical signal (or the electrical signal converted from the optical signal) for the arbitrary direction movement of the object S in space is the object detected by the first array unit 20a ( An optical signal (or an electrical signal converted from the optical signal) for the horizontal component of the movement of S); 5 and 6, an optical signal (or an electrical signal converted from the optical signal) for the vertical component of the movement of the object S detected by the second array unit 20b; As described with reference to FIG. 7, an optical signal (or an electrical signal converted from the optical signal) for the height component of the movement of the object S detected by the first array unit 20a and the second array unit 20b. It can be implemented by separating and integrating;

The integrated optical signal (or an electrical signal converted from the optical signal) may reflect time information and vector information such as a moving distance, a speed, an acceleration, a start point and an end point of the movement of the object S in any direction. Can be. Accordingly, the non-contact sensor module 30 including the light emitting unit 10 and the light receiving unit 20 can measure the angle and intensity of light reflected by the object S without using an image sensor (camera). It is possible to detect the exact trajectory of the position and the movement of the object S in space.

The microcontrol unit 40 receives an optical signal for the object S detected by the non-contact sensor module 30 and an electrical signal converted from the optical signal, and then spatial coordinates of the position and / or movement of the object S. Algorithm to implement Furthermore, the gesture coordinate corresponding to the position and / or the movement of the object S may be determined using the spatial coordinates, and a control signal corresponding to the gesture gesture may be generated. The microcontrol unit 40 may include a database unit which stores a gesture operation and a control signal corresponding thereto in order to generate the control signal. In addition, the microcontrol unit 40 may include a comparison determination unit to determine a gesture operation corresponding to the position and / or movement of the object S using the spatial coordinates.

For example, the microcontrol unit 40 includes at least one hardware or electronic device 1120 in which a control signal corresponding to the electronic device 1120 when the gesture action forms a circle clockwise. And a database portion set as a control signal for enabling a zoom up function of the software installed in the. Such a database unit may be configured to be arbitrarily set by a user.

In addition, for example, the microcontrol unit 40 is the actual shape of the object (S) even if the motion of the object (S), that is, the shape that the actual movement of the object (S) forms in space does not exactly match the starting point and the end point. Considering the time information and the vector information such as the moving distance, the speed, the acceleration, the curvature, the start point and the end point of the movement, the motion of the object S forms a circle in the clockwise direction. It may include a comparison determination unit that can be determined by the gesture operation. The comparison determination unit calculates an error between the movement of the object S and the gesture operation, and a algorithm for classifying and determining the movement of the object S as a gesture operation stored in the database within a predetermined error range. It may include.

8 is a block diagram illustrating a configuration including a non-contact manipulation apparatus according to a modified embodiment of the present invention.

Referring to FIG. 8, in the non-contact manipulation apparatus 1000 according to the modified embodiment of the present invention, unlike FIG. 1, the light emitting unit 10 and the light receiving unit 20 may be connected to the non-contact sensor module 30. The modules may be spaced apart from each other without configuring the same single module. Since the light emitting unit 10 and the light receiving unit 20 do not constitute a single module, the light emitting unit 10 and the light receiving unit 20 may be freely disposed independently in the non-contact manipulation apparatus 1000, so that the degree of freedom of arrangement is increased. You can expect the effect. Of course, in FIG. 1, since the light emitting unit 10 and the light receiving unit 20 are configured as one module, an advantageous effect that the light emitting unit 10 and the light receiving unit 20 may be easily disposed and handled in the non-contact manipulation apparatus 1000 may be expected. The concept of detecting the optical signal and calculating the spatial coordinates in response to the position of the object S and / or the movement of the object S using the light emitter 10 and the light receiver 20 is the same as FIG. Description of the control unit 40 and the communication unit 50 is also the same as in FIG.

Hereinafter, as another embodiment of the present invention, when the above-described non-contact sensor module 30 is provided in at least two or more, or when the light receiving unit 20 is provided in at least two or more, The advantageous effect of calculating the spatial coordinates more precisely is explained.

4 and 9, for example, at time T ₁ , the optical signal intensity of the reflected light received by the photodiodes 25a, 25b, and 25c in the first array unit 20a may be represented by the optical signal C, It becomes smaller gradually in order of the optical signal B and the optical signal A. FIG. That is, the position of the object S at time T ₁ may correspond to any one point on the plane that is closest to the photodiode 25c and spaced apart from the photodiode 25a. Therefore, the position of the object S at time T ₁ is perpendicular to the xy plane, perpendicular to the x-axis, parallel to the y-axis and z-axis, by the first array portion 20a, as shown in FIG. 9. It can correspond to any one point on the plane P _x .

6 and 9, for example, at time T ₁ , the optical signal intensity of the reflected light received by the photodiodes 25d, 25e, 25f, and 25g in the second array unit 20b may be represented by an optical signal. (F), optical signal (E), optical signal (G), and optical signal (D) in order of decreasing. That is, at time T ₁ , the position of the object S is closest to the photodiode 25f, then close to the photodiode 25e, and is spaced apart from the photodiode 25d most arbitrarily. It can correspond to any point of. Therefore, the position of the object S at time T ₁ is perpendicular to the xy plane, perpendicular to the y-axis, parallel to the x-axis and z-axis, by the second array portion 20b, as shown in FIG. 9. It can correspond to any one point on the plane P _y .

Thus, referring to FIGS. 4, 6 and 9, for example, at time T ₁ , the position of the object S is in the xy plane by the first array unit 20a, as shown in FIG. 9. Perpendicular to the x-axis, corresponding to any point on the plane P _x parallel to the y-axis and z-axis, and perpendicular to the y-axis by the second array portion 20b Since it is perpendicular and can correspond to any point on the plane P _y parallel to the x and z axes, at time T ₁ , the position of the object S is the plane P _x and the plane P _y. ) May correspond to any point on the intersection line L _z that intersects.

According to this, the position of the object S is set to any one on the intersection line L _z even by the first array unit 20a and the second array unit 20b provided in one non-contact sensor module 30. May correspond to a point. However, it may not be easy to accurately grasp the height component (z component) of the spatial coordinates of the object S by the single non-contact sensor module 30. Of course, as the object S moves away from the non-contact sensor module 30 in the height direction (z-axis direction), the absolute value of the intensity of the optical signal shown in FIGS. 4 and 6 is relatively small, and the object S is As the non-contact sensor module 30 gets closer to the height direction (z-axis direction), the absolute value of the intensity of the optical signal shown in FIGS. 4 and 6 becomes relatively large, but the absolute value of the height component (z component) in the spatial coordinates is increased. It is not easy to figure out.

As described above, when one independent non-contact sensor module including the light emitting unit 10 and the light receiving unit 20 is used, it is difficult to accurately calculate the exact position coordinates of the object S. In addition, when the size of the object S is large, reception of reflected light is blocked in the coordinates of some sections according to left, right, and up and down movements, so that it is difficult to determine accurate spatial coordinates and furthermore, an error may occur in recognizing the movement of the object. The non-contact manipulation apparatus 1000 according to another embodiment of the present invention includes a plurality of non-contact sensor modules to solve this problem.

10 is a configuration diagram illustrating a configuration including a non-contact manipulation apparatus according to another embodiment of the present invention. FIG. 11 is a diagram illustrating a concept of calculating a height component among spatial coordinates of an object by using a distance between two non-contact sensor modules and a light receiving angle of reflected light in a non-contact manipulation device according to another exemplary embodiment of the present invention.

As illustrated in FIG. 10, at least two non-contact sensor modules 30 include a first non-contact sensor module 30-1 and a second non-contact sensor module 30-2 spaced apart from each other. Each of the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 is the same as the non-contact sensor module described above. Referring to FIG. 11, the separation distance D between the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2, and the plurality of non-contact sensor modules 30-1 and 30-2. The spatial coordinates of the object S by using the light receiving angle (각 θ ₁ , θθ ₂ , unit: degree (°)) of the reflected light (R ₁ , R ₂ ) received by the light receiving unit 20 respectively provided in the The middle height component (H) can be calculated by the trigonometric method as in Equation (1).

<Equation 1>

H = D / (tan (90 °-θ ₁ ) + tan (90 °-θ ₂ ))

In addition, since the plurality of non-contact sensor modules 30 are arranged, it is possible to calculate the exact position coordinates regardless of the size of the object (S). 10 and 11 exemplarily illustrate a case in which the non-contact sensor modules 30 are two non-contact sensor modules. Furthermore, a larger number of the plurality of non-contact sensor modules 30 are in the horizontal and / or vertical directions. By arranging in an array, it is possible to calculate a more accurate position coordinate of the object S.

The received angles of the received reflected light are a plurality of photodiodes 25 arranged in the horizontal axis in the first array unit 20a and a plurality of photodiodes 25 arranged in the vertical axis in the second array unit 20b. The intensity distribution of the optical signal of the reflected light received at can be comprehensively analyzed and calculated. On the other hand, to facilitate the calculation of the light receiving angle, slit portions (not shown) for selectively blocking and passing the reflected light may be disposed on the first array portion 20a and the second array portion 20b. . For example, the slit portion may be composed of a plurality of bars arranged side by side spaced apart from each other. The slit portion direction on the first array portion 20a and the slit portion direction on the second array portion 20b may be directions crossing each other.

Finally, when the height component H of the spatial coordinates calculated with reference to FIG. 11 is combined with the intersection line L _z calculated with reference to FIG. 9, the spatial coordinates of the object S may be calculated. The microcontrol unit 40 receives the optical information of the reflected light detected by the plurality of non-contact sensor modules 30 and the distance D information between the plurality of non-contact sensor modules 30 and receives spatial coordinates of the object S. Equipped with an algorithm to output accurate coordinate data.

In addition, the microcontrol unit 40 may determine a gesture motion with respect to the movement of the object S by using the calculated spatial coordinates indicating the position of the object S, and generate a control signal corresponding to the gesture motion. have. To this end, it may optionally further comprise a database unit for storing the gesture operation and the control signal corresponding thereto. In addition, the microcontrol unit 40 may further include a comparison determination unit to determine the gesture operation for the movement of the object (S).

For example, the microcontrol unit 40 may include at least one hardware or electronic device 1120 configured to control the electronic device 1120 when the gesture action forms a circle in a clockwise direction. And a database portion set as a control signal for enabling a zoom up function of the software installed in the &lt; RTI ID = 0.0 &gt; Such a database unit may be configured to be arbitrarily set by a user. In addition, the microcontrol unit 40 moves the horizontal component, the vertical component, and the height component of the actual movement of the target object S, even if the actual movement of the target object S is formed in space, when the starting point and the end point do not exactly match. Considering the time information and the vector information such as the distance, speed, acceleration, curvature, the starting point and the end point of the movement, the actual movement of the object S may include a comparison determination unit which can be determined by the gesture motion forming a clockwise circle. Can be. The comparison determination unit calculates an error between the actual motion of the object S and the gesture motion, and classifies and determines the motion of the object S as a gesture motion stored in the database within a predetermined error range. It may include.

12 is a configuration diagram illustrating a configuration including a non-contact manipulation apparatus according to another modified embodiment of the present invention.

Referring to FIG. 12, in the non-contact manipulation apparatus 1000 according to another modified embodiment of the present invention, unlike FIG. 10, the light emitting unit 10 and the light receiving unit 20 may be connected to the non-contact sensor module 30. The modules may be spaced apart from each other without configuring the same single module. Since the light emitting unit 10 and the light receiving unit 20 do not constitute a single module, the light emitting unit 10 and the light receiving unit 20 may be freely disposed independently in the non-contact manipulation apparatus 1000, so that the degree of freedom of arrangement is increased. You can expect the effect. Furthermore, unlike FIG. 10, at least two light receiving units 21 include a first light receiving unit 20-1 and a second light receiving unit 20-2. Each of the first light receiving unit 20-1 and the second light receiving unit 20-2 is the same as the light receiving unit 20 described above. In this case, the height component H of the spatial coordinates of the object S is the separation distance D between the first light receiving unit 20-1 and the second light receiving unit 20-2 and the first light receiving unit 20-1. ) And the light receiving angles (∠θ ₁ , ∠θ ₂ , unit: degree (°)) of the reflected light R ₁ , R _{2 received at} the second light receiving unit 20-2, respectively. Can be calculated. The concept of detecting an optical signal and calculating spatial coordinates in accordance with the position of the object S and / or the movement of the object S using the light emitter 10 and the plurality of light receivers 21 is the same as that of FIG. 10. Since the description of the microcontrol unit 40 and the communication unit 50 is also the same as in FIG. 10, it will be omitted here.

13A and 13B illustrate a concept in which a first array unit detects an optical signal for a horizontal component of a movement of an object in a non-contact manipulation device according to still another embodiment of the present invention. Specifically, FIG. 13A corresponds to a modified embodiment of the first array unit 20a disclosed in FIG. 3, and FIG. 13B is a cross-sectional view illustrating the Q-Q cut plane of FIG. 13A.

The first photodiode PD1 has a height H at which the amount of light passage can vary according to at least an angle, and has a first partition W1 having a plurality of first slits S1 arranged side by side in the first direction. The photodiode may be a photodiode capable of detecting the light amount of the first region biased to one side of the light passing between the first slits S1 and the light amount of the second region biased to the other side. As shown in FIGS. 13A and 13B, the first photodiode PD1 may include a first eccentric array PD1a and a second eccentric array PD1b, the first shown in FIGS. 13A and 13B. The first eccentric array PD1a may correspond to the photodiode 25a shown in FIG. 3, and the second eccentric array PD1b shown in FIGS. 13A and 13B may correspond to the photodiode 25b shown in FIG. 3. have.

The first eccentric array PD1a is installed below the first partition walls W1 and is installed to be biased to one side based on the center line of each of the first slits S1, and has different intensities according to the amount of light. Signal can be output. In addition, the second eccentric array PD1b is disposed below the first partition walls W1, and is disposed to be biased to the other side based on the center line of each of the first slits S1, and has a different intensity according to the amount of light. Can output a signal.

Therefore, as shown in FIG. 3, when the reflected light L2 reflected from the object S passes through the plurality of first slits S1 at an angle biased to one side, the first partition wall W1. As a result, a greater amount of light may reach the second eccentric array PD1b installed on the other side than the first eccentric array PD1a installed on one side. That is, the greater the angle at which the reflected light L2 reflected from the object S is biased toward one side, the greater the amount of light may be output to the second eccentric array PD1b than the first eccentric array PD1a. .

13A and 13B, the first array unit 20a having the photodiode 25 arrayed on the horizontal axis (x axis) may include first partition walls W1 extending along the vertical axis (y axis). Accordingly, the microcontrol unit 40 may determine the X-axis angle of the object S by using the output difference of the relative electrical signals of the first eccentric array PD1a and the second eccentric array PD1b. .

Although not shown in the drawing, in a similar manner, the second array portion 20b in which the photodiodes 25 are arranged in the vertical axis (y axis) is disposed between the first partition walls W1 extending along the horizontal axis (x axis). The first eccentric array PD1a and the second eccentric array PD1b described above are arranged so that the microcontrol unit 40 is relative to the first eccentric array PD1a and the second eccentric array PD1b. The Y-axis angle of the object S may be determined using the difference in output of the electrical signal. The angle of the object S can be finally calculated by combining the X-axis angle and the Y-axis angle of the object S thus determined.

The non-contact manipulation apparatus 1000 according to the embodiment of the present invention may improve the problem of the conventional image sensor (camera) method and provide a new and diverse interface to the user through a motion recognition algorithm capable of low power and low cost. have. The conventional non-contact gesture gesture recognition method is implemented by a camera module method. The camera module method is a method of capturing a user's movement with a CMOS camera and recognizing an image captured by a sensor integrated circuit (IC). The time taken to transfer the image taken by the CMOS camera to the sensor integrated circuit and to recognize and detect the motion is relatively high, and the recognition sensitivity is much lowered. In addition, there is a disadvantage that it is very difficult to process a variety of operations at the same time because the recognition sensitivity is much lower. Furthermore, since the camera module must be operated to recognize the operation, there is a disadvantage in that a lot of power consumption is required. In addition, since the camera module is used, manufacturing costs are also very high. On the contrary, in the embodiments of the present invention, since the motion recognition is performed by using an infrared light emitting diode (IRED), a photodiode, and a microcontrol unit, this problem is achieved through a low power, fast motion recognition algorithm, low cost, and simple motion recognition processing. Can solve them.

On the other hand, the technical idea of the present invention described above to improve the problem of the image sensor (camera) method, a variety of products in that a new and various interface to the user through a low power, low cost possible position and / or motion recognition algorithm It is applicable to the following, below, the aspect of the electronic device 1120 to which the non-contact operation device 1000 is applied will be described.

14 is a diagram illustrating a configuration of a mouse to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

Referring to FIG. 14, the non-contact manipulation apparatus 1000 described above may be embedded in the mouse 1120. In particular, the plurality of non-contact sensor modules 30 including the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 spaced apart from each other may be disposed on the surface of the mouse 1120. .

For example, when the user's hand is separated from the left without contact with the mouse 1120 interlocked with the non-contact manipulation apparatus 1000 and moves from left to right, in the microcontrol unit 40 of the non-contact manipulation apparatus 1000. The determined gesture motion may be classified into a linear motion toward the right. Accordingly, the control signal transmitted to the computing device connected to the mouse 1120 may include a signal corresponding to the right direction key of the keyboard.

15 is a diagram illustrating a configuration of a keyboard to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

Referring to FIG. 15, at least a part of the non-contact manipulation apparatus 1000 described above may be provided in a form of being attached to the surface of the keyboard 1120 or inserted into the inside thereof. In particular, the plurality of non-contact sensor modules 30 including the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 spaced apart from each other may be disposed on the surface of the keyboard 1120. . For example, in the keyboard 1120 interlocked with the non-contact manipulation apparatus 1000, the non-contact sensor modules 30 may be arranged in a frame 124a surrounding the keyboard 124b of the keyboard. The keyboard 1120 interlocked with the non-contact manipulation apparatus 1000 according to an embodiment of the present invention detects a user's motion without touching and touching a body, such as a finger, to easily operate a computer device such as a PC and related software. Because it can be controlled, it can be applied to various fields.

16 is a diagram illustrating a configuration of a USB hub to which a non-contact manipulation device according to some embodiments of the present invention is applied.

Referring to FIG. 16, at least a part of the non-contact manipulation apparatus 1000 described above may be provided to be attached to or inserted into the surface of the UBS hub 1120 having the multi UBS port 122a. In particular, the plurality of non-contact sensor modules 30 including the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 spaced apart from each other may be disposed on the surface 122b of the USB hub 1120. Can be deployed. The USB hub 1120 interlocked with the non-contact manipulation device 1000 according to an exemplary embodiment of the present invention detects a user's motion without touching and touching a body, such as a finger, and easily operates a computer device such as a PC and related software. It can be applied to various fields because it can control.

17 is a diagram illustrating a configuration of a headset to which a non-contact manipulation device is applied according to some embodiments of the present invention.

Referring to FIG. 17, the headset 1120 includes two speaker units 126a, a microphone unit 126b, and a headband unit 126c connecting the two speaker units 126a and the speaker unit 126a. It includes the housing portion 126d formed on the outside. The plurality of non-contact sensor modules 30 and / or the microcontrol unit 40 including the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 spaced apart from each other are each a speaker unit. 126a, the microphone unit 126b, the headband portion 126c, and the housing portion 126d may be disposed and provided in a form that is attached to or inserted into the inside.

The above-described gesture recognition headset 1120 is a non-contact gesture headset using a light emitting unit and a light receiving unit, and can easily control a mobile device by recognizing a user's motion without touching and touching a finger.

18 is a diagram illustrating a configuration of a monitor to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

Referring to FIG. 18, at least a portion of the non-contact manipulation apparatus 1000 described above may be provided in a form of being attached to the surface of the monitor 1120 or inserted into the inside thereof. In particular, the plurality of non-contact sensor modules 30 including the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 spaced apart from each other may be disposed on the surface of the monitor 1120. . For example, the non-contact sensor modules 30 in the monitor 1120 interlocked with the non-contact manipulation device 1000 may be selected from a monitor pedestal 125a, a monitor pillar 125b, a monitor frame 125c, and a monitor screen 125d. It may be arranged and configured in at least one. The monitor 1120 interlocked with the non-contact manipulation apparatus 1000 according to an exemplary embodiment of the present invention detects a user's motion without touching and touching a body, such as a finger, to easily operate a computer device such as a PC and related software. Because it can be controlled, it can be applied to various fields.

19 is a diagram illustrating a configuration of a smart phone to which a non-contact manipulation device according to some embodiments of the present invention is applied.

Referring to FIG. 19, at least a part of the non-contact manipulation apparatus 1000 described above may be provided to be attached to the surface of the smart phone 1120 or inserted into the inside. In particular, the first non-contact sensor module 30-1 and the second non-contact sensor module 30-2 constituting a part of the non-contact manipulation device 1000 may be spaced apart from each other to have a predetermined distance.

20 is a diagram illustrating a configuration in which a non-contact manipulation device according to some embodiments of the present disclosure is disposed and provided outside of an electronic device.

Referring to FIG. 20, the non-contact manipulation apparatus 1000 described above may be provided as a separate device from the electronic device 1120. The control signal generated by the microcontrol unit 40 of the non-contact manipulation apparatus 1000 is wired to the electronic device 1120 through wired cables 127a and 127b, or is disposed in the non-contact manipulation apparatus 1000. 52 may be wirelessly transmitted to the electronic device 1120. In this case, the electronic device 1120 may include at least one of a computer, a laptop, a tablet PC, a tablet mobile communication device, a smartphone, a mobile phone, a smart pad, a game device, a virtual experience device, a portable multimedia playback device, and an electronic book. Can be.

21A-21D illustrate exemplary movements of an object that may be provided on a mouse to which a non-contact manipulation device is applied in accordance with some embodiments of the present invention.

For example, referring to FIG. 21A, when the user's hand S moves from the left to the right without contacting the mouse on the mouse 1120 interlocked with the non-contact manipulation apparatus 1000 described above, the non-contact manipulation apparatus The gesture motion determined by the microcontrol unit 40 of FIG. 1000 may be classified into a linear motion toward the right. Accordingly, a control signal transmitted to a computing device such as a computer connected to the mouse 1120 may be transmitted to the right direction key of the keyboard. It may be a signal corresponding to.

For example, referring to FIG. 21B, when the user's hand S is moved away from the lower side without contacting the mouse on the mouse 1120 interlocked with the non-contact manipulation apparatus 1000 described above, the contactless state is not contacted. The gesture motion determined by the microcontrol unit 40 of the control device 1000 may be classified into a linear motion directed upward. Accordingly, a control signal transmitted to a computer device such as a computer connected to the mouse 1120 may be transmitted. It may be a signal corresponding to an up direction key.

For example, referring to FIG. 21C, when the user's hand S is separated from the high point to the low point without contacting the mouse on the mouse 1120 linked with the non-contact manipulation apparatus 1000 described above, for example. The gesture motion determined by the micro-control unit 40 of the non-contact manipulation device 1000 may be classified into a linear motion in the direction of gravity, and thus a control signal transmitted to a computer device such as a computer connected to the mouse 1120. May be a signal corresponding to a click of an enter key or a mouse button on the keyboard.

For example, referring to FIG. 21D, when the user's hand S is tilted away from the desk without contacting the mouse on the mouse 1120 interlocked with the non-contact manipulation apparatus 1000 described above, The control signal transmitted to the computing device such as a computer connected to the mouse 1120 may be a signal corresponding to the direction in which the joystick is pulled toward the user.

Of course, the relationship between the gesture operation described above and the control signal corresponding thereto may be arbitrarily changed and set by the producer or the user of the mouse.

22A-22D illustrate exemplary movements of an object that may be provided on a keyboard to which a non-contact manipulation device is applied according to some embodiments of the present disclosure.

For example, referring to FIG. 22A, when the user's hand S is spaced apart from the keyboard 1120 without contacting the keyboard 1120 on the keyboard 1120 linked with the non-contact manipulation apparatus 1000, the user may move from left to right. The gesture motion determined by the micro-control unit 40 of the non-contact manipulation device 1000 may be classified into a linear motion toward the right. Accordingly, a control signal transmitted to a computing device such as a computer connected to the keyboard 1120 may be transmitted to the keyboard. It may be a signal corresponding to the right direction key of 1120.

For example, referring to FIG. 22B, the user's hand S may be spaced apart from the keyboard 1120 without touching the keyboard 1120 on the keyboard 1120 interlocked with the non-contact manipulation apparatus 1000 described above. When moving downward from the lower side of the keyboard 1120, the gesture motion determined by the microcontrol unit 40 of the non-contact manipulation apparatus 1000 may be classified as a linear movement toward the upper side, and thus connected to the keyboard 1120. The control signal transmitted to the computing device such as a computer may be a signal corresponding to the upper direction key of the keyboard 1120.

For example, referring to FIG. 22C, the user's hand S may be spaced apart from the keyboard 1120 without touching the keyboard 1120 on the keyboard 1120 interlocked with the non-contact manipulation apparatus 1000, at a high point in the height direction. In the case of moving to the low point, the gesture motion determined by the microcontrol unit 40 of the non-contact manipulation apparatus 1000 may be classified into a linear motion toward the gravity direction, and accordingly, the computing device such as a computer connected to the keyboard 1120 may be used. The control signal to be transmitted may be a signal corresponding to a click of an enter key or a mouse button of the keyboard 1120.

For example, referring to FIG. 22D, the user's hand S may be spaced apart from the keyboard 1120 without contacting the keyboard 1120 on the keyboard 1120 interlocked with the non-contact manipulation apparatus 1000 described above. In the case of tilting, the control signal transmitted to the computing device such as a computer connected to the keyboard 1120 may be a signal corresponding to the direction in which the joystick is pulled toward the user.

Of course, the relationship between the gesture operation described above and the control signal corresponding thereto may be arbitrarily changed and set by the producer or the user of the mouse.

The keyboard 1120 interlocked with the non-contact manipulation apparatus 1000 may include a frame 124a, a basic input key 124b, a special function key 124c, a switch key 124d, and a display window 124e. Can be. In the keyboard 1120 interlocked with the non-contact manipulation apparatus 1000, the position and / or the movement of the object S may be determined by the first state in which the basic input key 124b is available and the non-contact manipulation apparatus 1000. It may be necessary to clearly distinguish the second state. The first state refers to a general keyboard use state using a general basic input key 124b such as a character input key, a numeric input key, an enter input key, a space input key, and the like. The second state refers to a state in which the position and / or movement of the object S can be grasped by the non-contact manipulation apparatus 1000 as shown in FIGS. 22A to 22D.

For example, in the keyboard 1120 interlocked with the non-contact manipulation apparatus 1000, even when the user approaches the keyboard to press a general input key 124b, the non-contact manipulation apparatus 1000 is activated to hold the user's palm. In some cases, it may not be easy to use a conventional keyboard if the movement of the controller determines the movement of the gesture, the gesture action corresponding to the gesture, and the control signal is generated. In order to overcome this problem, the first state in which the primary input key 124b of the keyboard 1120 can be used and the position or movement of the object S can be determined by the non-contact sensor module 30 and the microcontrol unit 40. The switch key 124d for selecting any one of the second states may be provided separately from the existing basic input key 124b. The switch key 124d may be understood as a toggle key capable of toggling the first state and the second state. That is, as the toggle key 124d is sequentially pressed, the first step is activated and the second state is deactivated, and the second step is deactivated and the second state is activated. It can be configured to be implemented sequentially.

According to the above description, the first state in which the basic input key 124b of the keyboard 1120 can be used and the position or movement of the object S can be determined by the non-contact sensor module 30 and the microcontrol unit 40. Although the toggle key 124d is configured to prevent the second state from being activated at the same time, the modified embodiment of the present invention may be configured to include the case where the first state and the second state are activated at the same time. For example, a step of inputting an enter key, which is a basic input key of a keyboard, for shooting in a process of performing a simulation game, etc. and the position of the object S by the non-contact manipulation apparatus 1000 instead of the joystick. It may be necessary for the steps to grasp the movement to be performed simultaneously. In this case, the non-contact sensor module 30 may detect the left hand of the user who inputs the enter key, which is the basic input key of the keyboard, and the right hand of the user who expresses the movement of the object S, for example, moving toward the right. The range of the area and the algorithm of the microcontrol unit 40 can be finely adjusted. Accordingly, in a modified embodiment of the present invention, as the toggle key 124d is sequentially pressed, the first state is activated and the second state is deactivated, and the first state is deactivated and the second is deactivated. The state may be configured to sequentially implement a second step of activating, and a third step of activating the first state and the second state simultaneously. Of course, the order of the steps can be arbitrarily changed.

In addition, in the drawing, each step is configured to be implemented sequentially by pressing a single toggle key 124d in sequence, but in another modified embodiment of the present invention, two switch keys 124d may be provided. have. That is, a first switch key for sequentially activating and deactivating the first state and a second switch key for sequentially activating and deactivating the second state can be provided. Accordingly, the first to third steps may be implemented by the combination of the first switch key and the second switch key.

Meanwhile, a first state in which the basic input key 124b of the keyboard 1120 is used and a second in which the position or movement of the object S can be detected by the non-contact sensor module 30 and the microcontrol unit 40 are used. Other configurations are also possible that can impart a switching function between states. For example, the switching function may be given to any one of the special function keys 124c. In addition, for example, a separate switching device may be provided on the frame 124a of the keyboard 1120. Furthermore, in addition to the hardware switch, the switching function may be configured by a specific gesture operation corresponding to a specific movement of the object S. FIG.

Meanwhile, information about the activated state may be displayed on the display window 124e so that the user of the keyboard 1120 may easily determine whether the first state and / or the second state are activated. That is, at least one selected from a first state capable of using the basic input key 124b of the keyboard 1120 and a second state capable of detecting the position or movement of the object S by the non-contact manipulation apparatus 1000. A display window 124e for checking the status may be provided. For example, when the display window 124e indicates that the first state is activated, the contactless operation device 1000 is activated by pressing the above-described toggle key 124d to adjust the position and / or movement of the object S. FIG. I can figure it out. For example, if the display window 124e indicates that the second state is activated, the non-contact manipulation device 1000 is deactivated by pressing the above-described toggle key 124d to disable the normal basic input key 124b. It is available.

Existing general keyboards are equipped with a track ball, a touch pad, and a pointing stick to implement various user interfaces. The interface using the trackball is inexpensive, but the sensitivity is often poor and there is a bulky problem, a relatively high cost is required to obtain a sensitivity over a certain performance. The interface using the touch pad is weak to heat and has a problem of malfunctioning and a problem of accurately capturing the pointer, and also has a disadvantage of difficulty in positioning the pointer even when drawing a picture. The interface using the pointing stick is a pressure sensor that uses the method of moving the mouse cursor on the screen at a speed proportional to the pressure that the user presses, and relatively fine adjustment is possible but it is not easy to cope with various movements of the user. Therefore, the existing input methods such as trackball, touch pad, and pointing stick have many disadvantages to replace the mouse in terms of fine adjustment or quick response. In the embodiments of the present invention can overcome these disadvantages by providing a keyboard interlocked with the non-contact operation apparatus 1000 described above.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and those skilled in the art will understand that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims (14)

1. At least one light emitting unit capable of emitting light;

   Comprising a plurality of optical sensors arranged in a horizontal and vertical array, respectively, receiving the light reflected by the object motion by using the light emitting unit as a light source, for the object motion having information on the intensity and angle of the received light At least one light receiving unit capable of converting an optical signal into an electrical signal; And

   The micro-control unit (MCU) receives the electrical signal to calculate a spatial coordinate for the object, uses the spatial coordinates to determine a gesture motion with respect to the object motion, and generates a control signal corresponding to the gesture motion. );

   Non-contact operation apparatus having a.
2. The method of claim 1,

   The light receiving unit,

   A first array unit including a plurality of photodiodes arranged horizontally; And a second array unit including a plurality of photodiodes arranged in a vertical array.

   The optical signal for the object motion,

   An optical signal for a horizontal component of the object motion detected by the first array unit; An optical signal for a vertical component of the object motion detected by the second array unit; And an optical signal for a height component of the object motion detected by the first array unit and the second array unit.

   Contactless controls.
3. The method of claim 2,

   And the first array portion and the second array portion are arranged separately from each other and spaced apart from each other without being mixed with each other.
4. The method of claim 1,

   The control signal is a computer, a laptop, a tablet PC, a tablet mobile communication device, a smartphone, a mobile phone, a smart pad, a gaming device, a virtual experience device, a portable multimedia playback device, an electronic book, a USB hub, a mouse, a keyboard, Further comprising: a communication unit for transmitting to an electronic device including at least one of a monitor and a headset,

   The control signal includes a signal for controlling the hardware constituting the electronic device or software installed in the electronic device,

   Contactless controls.
5. The method of claim 4, wherein

   The communication unit includes at least any one of a wireless communication unit using Bluetooth communication or Zigbee communication and a wired communication unit using a universal serial bus (USB) cable.
6. The method of claim 4, wherein

   And at least some of the light emitting unit, the light receiving unit, the microcontrol unit, and the communication unit are disposed in the electronic device.
7. The method of claim 4, wherein

   And at least some of the light emitting unit, the light receiving unit, the microcontrol unit, and the communication unit are disposed outside the electronic device.
8. The method of claim 1,

   And the light emitting portion and the light receiving portion are disposed apart from each other without being modularized.
9. The method of claim 1,

   And the light emitting portion and the light receiving portion constitute at least one non-contact sensor module.
10. The method of claim 9,

    The at least one non-contact sensor module includes a first non-contact sensor module and a second non-contact sensor module spaced apart from each other,

    The microcontrol unit may be configured based on a distance between the first and second non-contact sensor modules and a light-receiving angle of the reflected light received by the light-receiving unit provided in the first and second non-contact sensor modules, respectively. A non-contact operating device for calculating the height component in the spatial coordinates.
11. The method of claim 1,

    The at least one light receiving unit includes a first light receiving unit and a second light receiving unit spaced apart from each other,

    The microcontrol unit uses a separation distance between the first light receiving unit and the second light receiving unit and a light receiving angle of the reflected light received by the first light receiving unit and the second light receiving unit to determine a height component of the spatial coordinates of the object. Calculated, non-contact operation device.
12. The method of claim 1,

    And the light emitting portion includes an infrared light emitting diode (IRED), and the light receiving portion includes a photodiode.
13. An electronic device interlocked with the non-contact manipulation device according to any one of claims 1 to 12.
14. The method of claim 13,

    The electronic device includes a computer, a laptop, a tablet PC, a tablet mobile communication device, a smartphone, a mobile phone, a smart pad, a game device, a virtual experience device, a portable multimedia player, an electronic book, a USB hub, a mouse, a keyboard, An electronic device comprising at least one of a monitor and a headset.

Images