KR20110095565A - User input device, method for recognizing user finger prints, and method for recognizing user touches using a transparent sensor grid panel which is able to recognize finger prints or mult-touch - Google Patents

Abstract

PURPOSE: A user input device, a method for recognizing user finger prints, and a method for recognizing user touches are provided to efficiently control UI by using the combination of fingers. CONSTITUTION: A display unit(801) displays the result of an operation or a reaction and a user input data. A sensor grid panel(804) composed of sensors which are arranged in grid shape by the size of a screen recognizes the touched finger location. A memory(803) stores a location data which is received from the sensor grid panel. A controller(802) reads an input pattern corresponding to an operation mode which is identified from the location data from the memory and performs a specific operation to the display part.

Description

Transparent panel user input device with fingerprint grid or multi-touch sensor, user fingerprint recognition method, and user touch recognition method PANEL WHICH IS ABLE TO RECOGNIZE FINGER PRINTS OR MULT-TOUCH}

The present invention relates to a user input device and method, and more particularly, to a user input device using a transparent panel having a multi-touch or fingerprint recognition or a sensor grid capable of simultaneously recognizing a multi-touch and a fingerprint, and user fingerprint recognition in such a device. It relates to a method and a user touch recognition method.

In general, a user input unit provided in an electronic device capable of interacting with a user includes a keypad or a touch screen. In particular, touch input is one of the important input methods in a portable terminal or a device such as a TV. The input method using the touch enables text data input using a soft keyboard input method and handwriting recognition method, thereby overcoming the absence of a physical keypad or keyboard and pointing the mouse through a touch method. Overcoming the lack of a pointing device such as Examples of electronic devices having such a touch screen include an electronic notebook, a mobile phone, a PDA, a TV, a notebook, a netbook, a desktop, and the like.

Since an input in an electronic device having such a touch screen is based on a simple input method such as contact between a finger and a panel, various input methods cannot exist. In order to solve this problem, many similar technologies have emerged to measure the time of touch and execute other functions or to cope with such technologies as multi-touch. Although the typical example of measuring time and executing other functions is to keep the touched state for a certain time, the same function as pressing the right mouse button is provided, but such a method does not provide a quick input method to the user. In addition, although multi-touch provides more various input methods by using two or more fingers, the structure of the human hand makes it difficult to take several or more gestures while recognizing two or more touches with one hand. There is a limitation that the maximum number of cases for the input that the touch can provide is not available.

Recently, a device or a method capable of outputting a plurality of screens by using a stereoscopic image display or a transparent element (transparent electrode or graphene, etc.) has been introduced. In the case of a stereoscopic display, for example, two display layers having a three-dimensional effect are basically created, and a user can see an efficient and intuitive GUI formed in these two layers. However, since a single touch recognition or a multi-touch recognition method targets only one screen, it causes difficulty for a user who wants to manipulate a plurality of screens formed in two or more layers.

The present invention provides a user input device and method for overcoming the limitation of the limited input method of touch (touch) or drag in an electronic device having a touch screen or similar input device.

In addition, the present invention provides an electronic device having a stereoscopic image display and a multi-display device comprising a transparent display device including elements such as graphene and transparent electrodes. Provided are a user input device and method capable of efficiently controlling a user interface output on a plurality of displays and performing a corresponding specific function.

Finally, the present invention can be directly combined with the existing display device using a transparent input panel made of a transparent electrode or graphene material having a structure capable of receiving a plurality of position recognition or fingerprint recognition input An apparatus and method are provided.

In order to achieve the above object, a sensor grid-type multi-touch user input device according to the present invention includes a display unit for displaying data input by a user, a result of performing an operation and a response according to the data, and a finger in contact with the same. A sensor grid panel comprising sensors arranged in a grid shape to recognize the position of the screen, a memory unit for storing one or more position data received from the sensor grid panel, and identified from the position data And a control unit which reads an input pattern corresponding to an operation mode from the memory and displays and displays a specific operation on the display unit. The operation mode of the device includes an operation mode for pointing, a multi-touch operation mode, and gesture recognition. And an operation mode for the memory unit, wherein the memory unit The sensor grid panel may store an input pattern and corresponding operation and function performance information. The sensor grid panel may receive an ultra-small light emitting unit capable of outputting infrared or light of a specific frequency, and light reflected from light of the corresponding frequency. A light-receiving unit, and sensors capable of detecting a change in light, wherein the sensor grids in the sensor grid panel are arranged in a lattice form, and the sensor grid panel is made of a material having graphene or transparent electrodes, and a display It is placed on the front of the device.

According to an embodiment of the present invention, the control unit may perform an operation of providing a feedback indicating or selecting a specific part of the display unit by calculating a coordinate value of the center of the position data input in the operation mode for pointing. .

In addition, according to another embodiment of the present invention, the control unit calculates a coordinate value of the center of the two or more position data input in the multi-touch operation mode to provide a feedback to simultaneously point or select a specific portion of the display unit Can be performed.

According to another embodiment of the present invention, the controller may calculate a trajectory of one or more input position data in an operation mode for gesture recognition to perform a corresponding preset operation.

In addition, according to another embodiment of the present invention, the sensor grid panel detects a change in light to generate digital data, the control unit calculates the contact area and the center point between the finger and the panel using the digital data to the user Can recognize the intended location.

In addition, according to another embodiment of the present invention, when the sensor grid panel detects a change in light, the light reflected by using the backlight (Back Light) of the LCD, or the natural light is blocked by the finger to block the light The light emitting unit of the sensor may output light of a specific frequency and reflect light thereto, or a combination of two or more of the above three methods may be used to recognize a user's intended position.

In addition, according to another embodiment of the present invention, the sensor grid panel may include a sensor for detecting a change in light and a light receiving unit designed to recognize a specific light in one.

According to an aspect of the present invention, a sensor grid type user input device capable of fingerprint recognition includes a display unit displaying data input by a user, an operation result and response according to the data, and a screen for recognizing fingerprints of touched fingers. A sensor grid panel including sensors arranged in a lattice form according to the size of the sensor, a memory unit for storing one or more fingerprint data received from the sensor grid panel, and an operation pattern corresponding to an operation mode set from the fingerprint recognition data; A control unit configured to display and display a specific operation on the display unit after reading from the memory, and includes a multi-touch operation mode and a fingerprint recognition operation mode as an operation mode of the device, and the memory unit includes an input pattern for the operation modes. And corresponding action and function performance information. The sensor grid panel includes an ultra-small light emitting unit capable of outputting infrared or light of a specific frequency, a light receiving unit capable of receiving light reflected from light of a corresponding frequency, and sensors capable of detecting a change in light. In addition, the sensor grid in the sensor grid panel is arranged in a grid form, the sensor grid panel is made of a material having a graphene or a transparent electrode, it is disposed on the front of the display device.

According to an embodiment of the present invention, the controller may output an infrared ray or light of a specific frequency to the sensor grid panel for fingerprint scanning at a specific position.

In addition, according to another embodiment of the present invention, the control unit may output an infrared ray or light of a specific frequency to the sensor grid panel for the fingerprint scan for the position of two or more touched fingers in the multi-touch operation mode.

According to another embodiment of the present disclosure, the controller may analyze one or more fingerprint data in a fingerprint recognition operation mode and perform a preset operation corresponding to the corresponding fingerprint data combination.

In addition, according to another embodiment of the present invention, the sensor grid panel detects a minute distance through the reflection of light having a specific frequency to generate digital data, the control unit is a contact surface between the finger and the panel based on the digital data The fingerprint information generated by analyzing the information may be used to recognize a specific finger fingerprint of the user.

According to an embodiment of the present invention, a sensor grid type multi-touch and a user input device capable of fingerprint recognition may include a display unit displaying data input by a user, a result of performing an operation, and a response according to the data; A sensor grid panel comprising sensors arranged in a grid shape so as to be recognizable, a memory unit storing one or more position data or fingerprint data received from the sensor grid panel, and identified from the position data And a control unit which reads an input pattern corresponding to an operation mode from the memory and displays the display on the display unit and executes a specific operation. The operating mode of the device is an operation mode for pointing, a multi-touch operation mode, and gesture recognition. An operation mode, and an operation mode for fingerprint recognition; The memory unit stores an input pattern for the operation modes and corresponding operation and function performance information, and the sensor grid panel includes an ultra-small light emitting unit capable of outputting infrared rays or light of a specific frequency, and reflected from light of the corresponding frequency. And a light receiving unit capable of receiving a light, and sensors capable of detecting a change in light, wherein the sensor grid in the sensor grid panel is arranged in a grid, and the sensor grid panel has graphene or transparent electrodes. It is made of material and is placed in front of the display device.

According to an embodiment of the present invention, the control unit may perform an operation of providing a feedback indicating or selecting a specific part of the display unit by calculating a coordinate value of the center of the position data input in the operation mode for pointing. .

In addition, according to another embodiment of the present invention, the control unit calculates a coordinate value of the center of the two or more position data input in the multi-touch operation mode to provide a feedback to simultaneously point or select a specific portion of the display unit Can be performed.

According to another embodiment of the present invention, the controller may calculate a trajectory of one or more input position data in an operation mode for gesture recognition to perform a corresponding preset operation.

In addition, according to another embodiment of the present invention, the control unit may output an infrared ray or light of a specific frequency to the sensor grid panel for the fingerprint scan for a specific position received from the touch recognition unit.

In addition, according to another embodiment of the present invention, the control unit may output an infrared ray or light of a specific frequency to the sensor grid panel for the fingerprint scan for two or more positions in the multi-touch operation mode.

According to another embodiment of the present invention, the controller may analyze one or more fingerprint data in an operation mode for fingerprint recognition and perform a preset operation corresponding to the corresponding fingerprint data combination.

In addition, according to another embodiment of the present invention, the sensor grid panel detects a minute distance through the reflection of light having a specific frequency to generate digital data, the control unit using the digital data between the finger and the panel By calculating the contact area and the center point, the user may recognize the intended position, or by using the fingerprint information generated by analyzing the information on the contact surface between the finger and the panel based on the digital data, the user may recognize the specific finger fingerprint. .

In addition, according to another embodiment of the present invention, the sensor grid panel uses the light reflected by the backlight (Back Light) of the LCD when detecting the change of light, or the natural light is blocked by the finger is blocked light The light emitting unit of the sensor may output light of a specific frequency and reflect light thereto, or a combination of two or more of the above three methods may be used to recognize a user's intended position.

In addition, according to another embodiment of the present invention, the sensor grid panel may include a sensor for detecting a change in light and a light receiving unit designed to recognize a specific light in one.

A user touch recognition method of an electronic device having a multi-touch sensor grid panel according to an embodiment of the present invention includes detecting a change in one or more optical signals displayed on a sensor grid panel by a user's touch, and detecting the change in the optical signal. And measuring and generating coordinate data for determining a finger coordinate at a contact surface where the user's finger and the sensor grid panel meet or measuring the degree to which the finger presses the sensor grid panel; The coordinate data is used to calculate the center coordinates on the contact surface, the center coordinates are used to grasp the user's intended touch position, and the change of the finger coordinates is continuously analyzed as time passes, thereby specifying a specified time. Determining whether a gesture is input; And checking whether an input pattern corresponding to the detected touch position or the detected gesture exists as an input pattern previously stored in the electronic device, and then inputting the corresponding input pattern when the corresponding input pattern exists. Displaying on the display device of the device or causing the electronic device to perform a specific function according to a corresponding input pattern.

A user fingerprint recognition method of an electronic device having a sensor grid panel capable of fingerprint recognition according to the present invention is characterized in that the sensor of each sensor in one or more specific areas through the output and reflection of a specific frequency emitted from the sensor grid panel according to a fingerprint recognition command. Detecting a fine distance, comprising: analyzing and calculating a change between an output time of a light emitting unit and an input time of a light receiving unit using a reference unit time to detect the fine distance; Processing fingerprint data from a sensor grid panel to remove noise data and transforming it into a format that can be used in the electronic device, thereby identifying a fingerprint of a user's finger using the fine distance differences; And checking whether an input pattern corresponding to the fingerprint of the identified finger exists as an input pattern previously stored in the electronic device, and then displaying the input pattern corresponding to the case where the corresponding input pattern exists. Displaying on or causing the electronic device to perform a specific function according to a corresponding input pattern.

A fingerprint recognition and touch recognition method of an electronic device having a sensor grid panel capable of fingerprint recognition and multi-touch according to the present invention is a step of detecting a change in one or more optical signals displayed on the sensor grid panel by a user's touch. Sensing and measuring the change in the optical signal to determine finger coordinates at the contact surface where the user's finger and the sensor grid panel meet or to generate coordinate data for determining the degree to which the finger presses the sensor grid panel; A step of detecting the fine distance of each sensor in one or more specific areas through the output and reflection of a specific frequency emitted from the sensor grid panel according to the fingerprint recognition command, to detect the minute distance by using a reference unit time Analyzing and calculating a change between the output time and the input time of the light receiver; The coordinate data is used to calculate the center coordinates on the contact surface, the center coordinates are used to grasp the user's intended touch position, and the change of the finger coordinates is continuously analyzed as time passes, thereby specifying a specified time. Determining whether a gesture is input; Processing fingerprint data from a sensor grid panel to remove noise data and transforming it into a format that can be used in the electronic device, thereby identifying a fingerprint of a user's finger using the fine distance differences; And when an input pattern corresponding to the detected touch position or the identified gesture or the fingerprint of the detected finger exists as an input pattern previously stored in the electronic device, and when a corresponding input pattern exists And displaying a corresponding input pattern on a display device of the electronic device or causing the electronic device to perform a specific function according to the corresponding input pattern.

As described above, the sensor grid transparent panel and the electronic device using the same according to the present invention may implement various user interfaces according to finger fingerprint recognition as well as a multi-touch input. Through this, the left hand and the right hand can be distinguished from each other or by finger, and a plurality of finger touches can be recognized, so that various functions can be assigned. For example, it is possible to operate and control a plurality of screens, and to select an operation mode set according to a gesture or a fingerprint so that a user can select a frequently used operation mode more quickly. In addition, since it can be combined with the display device, a plurality of fingerprints can be recognized without requiring a separate fingerprint recognition device, and thus various input and authentication methods are possible.

When a display device for outputting multiple layers configured by superimposing a stereoscopic image display or a transparent display is applied to an electronic device, the present invention may be usefully utilized. For example, the user can use the GUI displayed on the front panel for the right hand that is mainly used, and also act as the left mouse button for the most used right hand detection, and the right hand for the right hand stop. Can act as a button. In addition, the remaining fingers, which are not generally used, may be used as a shortcut function for executing a specific program or used to control a background program not visible on the screen. For example, it is possible to manipulate a playlist of an MP3 file by dragging using the right hand ring finger, and play or stop, forward or rewind the MP3 file by dragging with the left hand ring finger.

1 is a view schematically showing the structure of a sensor grid type touch panel according to an embodiment of the present invention;
2 is a schematic view of a portable terminal to which a sensor grid type input panel is applied according to an embodiment of the present invention;
3 is a view showing the panel parts of FIG. 2 separated by layers according to an embodiment of the present invention;
4 is a view showing a panel portion composed of a sensor grid according to an embodiment of the present invention;
5 is a cross-sectional view of a display device including a sensor grid transparent panel according to an embodiment of the present invention;
6 is a cross-sectional view of a device in the case of detecting a position through contact of a finger with a user input device composed of a sensor grid according to an embodiment of the present invention;
FIG. 7 is a cross-sectional view of a device in the case of recognizing a fingerprint through contact of a finger with a user input device composed of a sensor grid according to an embodiment of the present invention; FIG.
8 is a block diagram schematically illustrating a configuration of an electronic device having a user input device configured with a sensor grid according to an embodiment of the present invention;
9 is a flowchart illustrating a process of recognizing a touch or a fingerprint by a user input device and an electronic device having a sensor grid panel according to an embodiment of the present invention;
FIG. 10 is a flowchart illustrating a process in which an electronic device having a user input device according to an embodiment of the present invention performs a pre-stored corresponding function or manipulates and controls a plurality of screens through touch, fingerprint, or a combination thereof. ,
11 is a flowchart illustrating a process of generating a user fingerprint profile by inputting a user's fingerprint in advance in a user input device according to an embodiment of the present invention;
12 illustrates an example of enlarging a photo through a multi-touch input of a user in a user input device according to an embodiment of the present invention;
FIG. 13 is a view showing an example of elements that can be manipulated in a display organized by layers in a user input device according to an embodiment of the present invention; FIG.
FIG. 14 is a diagram illustrating that a user input device according to an embodiment of the present invention can operate a multi-layer display using a stereoscopic image display or a transparent display configured for each layer by distinguishing hands;
15 is a flowchart illustrating a user touch recognition method of an electronic device having a sensor grid panel capable of multi-touch.
16 is a flowchart illustrating a user fingerprint recognition method of an electronic device having a sensor grid panel capable of fingerprint recognition.
FIG. 17 is a flowchart illustrating a user fingerprint recognition and a touch recognition method of an electronic device including a sensor grid panel capable of fingerprint recognition and multi-touch.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, only parts necessary for understanding the operation according to the embodiment of the present invention will be described, it should be noted that other description will be omitted so as not to distract from the gist of the present invention.

The terms or words used in the specification and claims described below should not be construed as being limited to the ordinary or dictionary meanings, and the inventors should properly introduce the concept of terms in order to explain their invention in the best way. It should be interpreted as meanings and concepts in accordance with the technical spirit of the present invention based on the principle that it can be defined. Therefore, the embodiments described in the specification and the configuration shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all of the technical idea of the present invention, various equivalents that may be substituted for them at the time of the present application It should be understood that there may be water and variations.

Prior to the detailed description of the present invention, the electronic device according to an embodiment of the present invention will be described as a mobile communication terminal for convenience of description, but the present invention is not limited thereto. That is, the portable terminal according to an embodiment of the present invention is an electronic device including a sensor grid type touch panel, and preferably, a mobile communication terminal, a mobile phone, a personal digital assistant (PDA), a smart phone ( It will be apparent that the present invention can be applied to all information communication devices and multimedia devices such as smart phones and the like, and applications thereof.

In this specification, "multi-touch" refers to the simultaneous generation of touch at two or more points on the touchscreen.

In this specification, "drag operation" means moving while maintaining a multi-touch. For example, in the multi-touch state, the distance between two or more touched points may be moved by using an input tool such as a hand or a pen such that the distance between two or more touched points becomes far or near.

In the present specification, the "sensor grid panel" is arranged in a grid pattern of a conductive material that can replace fine wires or their roles at equal intervals, and the intersection may perform a function of touch recognition or fingerprint recognition. Microminiature device is a panel type device in which a set of sensors is fixed.

Hereinafter, in describing the embodiments of the present invention, components that perform the same function will be described with the same reference numerals.

1 is a diagram schematically illustrating a structure of a sensor grid type touch panel according to an exemplary embodiment of the present invention.

Referring to FIG. 1, the sensor grid type touch panel 100 may simultaneously recognize a protective layer 101 made of a transparent material for protecting a panel, a touch recognition or a fingerprint recognition including a sensor grid, or both. Sensor grid layer 102 of transparent material, which is disposed on the front surface, and is a virtual display layer or software on the front surface of a transparent display material or a stereoscopic image display device using graphene or transparent electrodes. A first display layer 103 comprising a display layer which can be said to be displayed on the back side, which can be said to be displayed on the back side in a display layer or software which is arranged on the back side and can be seen on the back side in a typical display device or stereoscopic image display. It may include a second display layer 104 including a display layer that is present. In addition, although not shown, the display layer may include three or more display layers, and may include an ADC and a controller for converting an analog signal into a digital signal.

2 is a diagram schematically illustrating a portable terminal to which a sensor grid type input panel according to an exemplary embodiment of the present invention is applied.

Referring to FIG. 2, the mobile terminal 200 employing a sensor grid-type input panel may display various information or elements for operation such as an icon 201 corresponding to a function of the corresponding terminal on the first display layer 103. An element 202 for various information or operations may be output to the second display layer 104 through a menu, a message, a background screen, or the like.

3 is a diagram illustrating the panel parts of FIG. 2 separated by layers according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the panel portion 300 of FIG. 3 includes elements for manipulation such as a protective layer 301 for protecting the panel, a sensor grid layer 302 of a transparent material for touch or fingerprint recognition, an icon, and the like. It may include a first display layer 303 for displaying various elements mainly, and a second display layer 304 for displaying various elements mainly for elements for expressing a menu or message-oriented information.

4 is a view showing a panel portion composed of a sensor grid according to an embodiment of the present invention.

Referring to FIG. 4, the transparent panel 400 having the sensor grid in which the optical sensor combinations form a lattice pattern at specific unit intervals includes a light receiving unit 401 capable of receiving an optical signal of a specific frequency band and an optical signal of the frequency band. By using a device such as a light emitting unit 402 that can output, an illumination sensor unit 403 that can detect a change in light such as natural light or light blocking, carbon nanotubes, etc. It may include a very thin conductor 404 disposed at unit intervals to transmit the recognition result of the optical sensor combination as an electrical signal or to operate by transmitting voltage and current to the optical sensor combination. In addition, although not shown, each light sensor combination may include a light receiving unit 401 and an illuminance sensor unit 403 configured as one device element. Also, although not shown, it will be apparent to those skilled in the art that a combination of sensors located at the intersection of the sensor grids can be replaced by optical sensors as well as other more efficient and accurate sensors, if any. will be.

5 is a cross-sectional view of a display device having a sensor grid transparent panel according to an embodiment of the present invention.

Referring to FIG. 5, the display apparatus 500 including the sensor grid transparent panel may include the light receiving unit 501, the light emitting unit 502, the illuminance sensor 503, and the protective layer described with reference to FIGS. 1 and 3. 504, a sensor grid transparent panel 505 for recognition, a first display layer 506, a second display layer 507, a light emitting element 508 for displaying colors in the first display layer and the second display layer. It may include. Although not shown, the first display layer 506 and the second display layer 507 may be removed when the user input device is used only as an input device, not in combination with a display device. It will be apparent to those skilled in the art.

FIG. 6 is a diagram illustrating a cross section of the apparatus in the case of detecting a position through contact of a finger with a user input device configured with a sensor grid according to an embodiment of the present invention.

Referring to FIG. 6, the display device 600 composed of a sensor grid recognizes the light 603 reflected by the finger 602 using the backlight 601 by the light receiving unit or the illumination sensor 604 of the light sensor combination. In addition, the contact recognition result data 605 may be generated to recognize the actual contact area and the contact strength through the results of the combination of the plurality of optical sensors recognized by the same method. In addition, although not shown, the backlight 601 may be replaced by the light output from the light emitting unit of the optical sensor combination and used in the recognition process, or may be replaced with natural light to detect the degree of light blocking and used in the recognition process.

FIG. 7 illustrates a cross-sectional view of a device in a case where a fingerprint is recognized through contact of a finger with a user input device configured with a sensor grid according to an embodiment of the present invention.

Referring to FIG. 7, the user input device 700 configured as a sensor grid includes light of a specific frequency at which light 702 of a specific frequency output from the light emitting unit 701 of the light sensor combination is reflected by the finger 703 and returned. 704 may be recognized by the light receiving unit 705 of the optical sensor combination, and the fingerprint data 706 of the actual contact surface may be generated through the results of several optical sensor combinations recognized in the same manner.

8 is a block diagram schematically illustrating a configuration of an electronic device having a user input device configured with a sensor grid according to an embodiment of the present invention.

Referring to FIG. 8, the electronic device 800 may include a display unit 801, a controller 802, a memory unit 803, and a sensor grid panel 804.

The display unit 801 displays information input by the user or information provided to the user, including various menus of the electronic device. In other words, the data input by the user and the result and response of the operation performed according to the data are displayed. The display unit 801 may be formed by combining a general display device, a transparent display device using graphene or a transparent electrode, or a stereoscopic image display in a single or plural number.

The controller 802 may control an overall operation of the electronic device, a signal flow between internal blocks of the electronic device, and perform a data processing function. In addition, when a touch occurs in the sensor grid panel 804, the controller 802 may detect the touch and perform a function corresponding thereto. In particular, when the multi-touch occurs in the controller 802, it may recognize the multi-touch and perform a function corresponding to the multi-touch. That is, the controller 802 may check a change in the output voltage generated by the sensor grid panel 804 according to the drag operation after the multi-touch. The controller 802 confirming the change of the output voltage may perform a control command linked to the touch operation or the drag operation. In more detail, the entire contact data generated through the change of the output voltage generated in the sensor grid panel 804 is generated as a data set according to the resolution of the sensor grid panel 804 and the center coordinate value is calculated from the contact area. One or more touch coordinates can be determined, and the drag and gesture can be recognized by analyzing the change based on time.

In addition to performing the function, the controller 802 may recognize a fingerprint in this area when an input is generated from the sensor grid panel 804 or a fingerprint recognition command is issued to perform a function corresponding thereto. In particular, when a plurality of fingerprint inputs are generated in the controller 802, the controller 802 may recognize the fingerprint input and perform a function corresponding to the plurality of fingerprint recognition. That is, the controller 802 may perform a control command in conjunction with a single touch operation or a drag operation after recognizing the plurality of fingerprints. In more detail, the entire contact data generated through the change of the output voltage generated in the sensor grid panel 804 is generated as a data set according to the resolution of the sensor grid panel 804 using the measured fine distance difference. One or more fingerprint data may be generated through a filtering operation that removes unnecessary noise data. In addition, the controller 802 may perform a corresponding function and operation by comparing the fingerprint data with a fingerprint data profile of a user existing in the memory unit 803.

The memory unit 803 stores one or more position data received from the sensor grid 804. The controller 802 reads an input pattern corresponding to the operation mode identified from the position data from the memory, and then displays and displays a specific operation on the display unit 801.

The sensor grid panel 804 is composed of sensors arranged in a grid shape to fit the size of the screen to recognize the position of the touched finger. The sensor grid panel 804 may generate digital data by detecting a change in light, and uses a backlight of an LCD (Liquid Crystal Display) when the sensor grid panel 804 detects a change in light. By using the reflected light, by using natural light is blocked by the finger to block the light, by using the light emitting unit of each sensor to output the light of a specific frequency to use the light reflected on it, among the three methods Two or more methods can be combined to recognize the location intended by the user.

The operation mode of the electronic device 800 may include an operation mode for pointing, an multi-touch operation mode, an operation mode for gesture recognition, and an operation mode for fingerprint recognition.

In addition, although not shown, the electronic device includes a wireless communication unit, a camera module, a broadcast receiving module, an audio signal output device such as a speaker, a voice signal input device such as a microphone, a connection terminal for data exchange with an external digital device, and a charging device. Optionally, the terminal may further include components having additional functions such as a digital sound source reproduction module such as an MP3 module. These components can not be enumerated because all the variations according to the convergence (convergence) trend of the digital device, but the components equivalent to the above-mentioned components is further included in the electronic device according to the present invention It will be apparent to those skilled in the art of the present invention.

9 is a flowchart illustrating a process of recognizing a touch or a fingerprint by a user input device and an electronic device having a sensor grid panel according to an exemplary embodiment of the present invention.

According to the present invention, the controller 802 may recognize a touch or a fingerprint, and the controller 802 detects whether the sensor grid panel 804 is touched in step S901. In operation S901, the user's finger touches the screen. In operation S902, a change in the optical signal is detected by the sensor grid of the corresponding range, and the operation proceeds to operation S903. In step S903, the controller 802 checks whether the one or more fingers are already in contact with the memory in which the touch data is stored, and if there is already one or more pieces of touch data, the controller 802 proceeds to step S904 to increase the index value of the data to add a plurality of additional data. After the data is stored, the flow proceeds to step S905. If the touch data is generated by the first contact, the controller 802 immediately proceeds to step S905. In step S905, the light emitting units of the light sensor combinations corresponding to the contact area are operated to output light of a specific frequency. Proceed to step S906. In step S906 the control unit 802 receives the light of a specific frequency output in step S905 is reflected back to the contact surface of the finger and proceeds to step S907, and in step S907 processes the individual light signal data received in step S906 Integrate into possible data sets and store in memory used by the system for processing in step S908. In addition, in FIG. 9, if the user input device is used only for touch, steps S905 and S906 may be omitted.

FIG. 10 is a flowchart illustrating a process in which an electronic device having a user input device according to an embodiment of the present invention performs a pre-stored corresponding function or manipulates and controls a plurality of screens through touch, fingerprint, or a combination thereof. to be.

According to the present invention, the controller 802 may perform a specific function through a touch or a fingerprint or a combination of the two. The controller 802 may obtain data related to the touch or the fingerprint in steps S1001 and S1002. In operation S1003, a check is made to see if there are fingerprints that match the currently input fingerprint among fingerprints previously stored in the user profile. If it is determined in step S1003 that the matching fingerprint does not exist, the controller 802 proceeds to step S1004 to process the currently generated touch event as a basic touch input. If it is determined in step S1003 that the matching fingerprint exists, the control unit 802 proceeds to step S1005, and in step S1005, the controller 802 checks whether information corresponding to a command or a function corresponding to the matching fingerprint exists. The controller 802 proceeds to step S1006 when there is a command or function execution corresponding to the matching fingerprint in step S1005, and performs the command or function in this step. If there is no command or function corresponding to the matching fingerprint in step S1005, the controller 802 proceeds to step S1007. In this step, the controller 802 checks whether the matching fingerprint is registered as one of the fingers of the left hand. If it is determined in step S1007 that the matching fingerprint is not one of the fingers of the left hand, that is, it is determined to be one of the fingers of the right hand, the controller 802 proceeds to step S1008 to switch to the front panel display operation state and then to step S1010. To continue processing the corresponding touch input. If it is determined in step S1007 that the matching fingerprint is one of the fingers of the left hand, the controller 802 proceeds to step S1009 to switch to the rear display manipulation state and proceeds to step S1010 to continue processing the corresponding touch input. In addition, although not shown, an operation corresponding to a result of distinguishing whether a matching fingerprint is a left hand or a right hand in the input processing sequence 1000 of the user input device is not limited to changing a display manipulation state. It will be self-evident to those of ordinary knowledge.

11 is a flowchart illustrating a process of generating a user fingerprint profile by inputting a user's fingerprint in advance in a user input device according to an embodiment of the present invention.

According to the present invention, the controller 802 may have a standby state as in step S1101, and may select various menus in this state. The controller 802 may provide a fingerprint registration menu and check whether the user selects the fingerprint registration menu in operation S1102. If it is determined in step S1102 that the user has not selected the fingerprint registration menu, the process returns to the standby state of step S1101. If it is determined that the user has selected the fingerprint registration menu, the process proceeds to step S1103 to receive information about the user and receive the user. Register. The controller 802 receives fingerprint data of all fingers sequentially through steps S1104 and S1105 to store fingerprint data of a finger after completing user registration in step S1103. After that, the control unit 802 proceeds to step S1106 and checks whether the fingerprint registration is correctly performed in this step. If the user does not select completion, the control unit 802 returns to step S1104 to restart the user registration. The process proceeds to the step so that a command corresponding to each input fingerprint can be set.

12 is a diagram illustrating an example of enlarging a photo through a multi-touch input of a user in a user input device according to an embodiment of the present invention.

Referring to FIG. 12, when a user touches two fingers 1202 and 1203 to a panel to enlarge an image output on the display device 1201 to which the sensor grid transparent panel is coupled, and the distance between the two fingers is large ( 1204 and 1205 images appear enlarged 1206.

FIG. 13 is a diagram illustrating an example of an element operable in a display configured for each layer in a user input device according to an exemplary embodiment of the present invention.

Referring to FIG. 13, the display device including the sensor grid transparent panel may output information superimposed when the display device is a multi-layer display device.

FIG. 14 is a diagram illustrating that a user input device according to an embodiment of the present invention can operate a multi-layer display using a stereoscopic image display or a transparent display configured for each layer by distinguishing a hand.

Referring to FIG. 14, an electronic device having the sensor grid transparent panel may operate a GUI displayed on different layers by distinguishing a hand. For example, FIG. 14 shows that when a screen is selected with the left hand, an icon related to a menu of the electronic device can be operated, and a widget manager provided by the electronic device can be operated with a right hand.

A user touch recognition method of an electronic device having a multi-touch sensor grid panel according to the present invention may be implemented according to the flowchart shown in FIG. 15 based on the above-described functions. The user touch recognition method according to the present invention is a step of detecting one or more optical signal changes appearing on the sensor grid panel by a user's touch, and a touch surface where the user's finger and the sensor grid panel meet by detecting and measuring the optical signal change. (S1501) generating coordinate data for grasping the finger coordinates at or determining the degree to which the finger presses the sensor grid panel; The coordinate data is used to calculate the center coordinates on the contact surface, the center coordinates are used to grasp the user's intended touch position, and the change of the finger coordinates is continuously analyzed as time passes, thereby specifying a specified time. Determining whether a gesture is input (S1502); And checking whether an input pattern corresponding to the detected touch position or the detected gesture exists as an input pattern previously stored in the electronic device, and then inputting the corresponding input pattern when the corresponding input pattern exists. Displaying on the display device of the device or causing the electronic device to perform a specific function according to a corresponding input pattern (S1503).

According to an embodiment of the present invention, the step of detecting one or more optical signal changes appearing in the sensor grid panel by the user's touch is calculated by comparing the total width of the contact surface with the total width of the data above or below a certain reference value. The results can be used to determine the strength of the input that the user intended to apply.

A user fingerprint recognition method of an electronic device having a sensor grid panel capable of fingerprint recognition according to the present invention may be implemented according to the flowchart shown in FIG. 16 based on the above-described functions. The user fingerprint recognition method according to the present invention detects the fine distance of each sensor in one or more specific areas through the output and reflection of a specific frequency emitted from the sensor grid panel according to a fingerprint recognition command, and detects the fine distance. Analyzing and calculating a change between an output time of the light emitting unit and an input time of the light receiving unit using the reference unit time to perform the step (S1601); Processing fingerprint data from a sensor grid panel to remove noise data and changing the format into a format that can be used in the electronic device, thereby identifying a fingerprint of a user's finger using the fine distance differences (S1602); And checking whether an input pattern corresponding to the fingerprint of the identified finger exists as an input pattern previously stored in the electronic device, and then displaying the input pattern corresponding to the case where the corresponding input pattern exists. Displaying or causing the electronic device to perform a specific function according to a corresponding input pattern (S1603).

A user fingerprint recognition and touch recognition method of an electronic device having a fingerprint grid and a multi-touch sensor grid panel according to the present invention may be implemented according to the flowchart shown in FIG. 17 based on the above-described functions. The user fingerprint recognition and touch recognition method according to the present invention is a step of detecting one or more optical signal changes appearing in the sensor grid panel by a user's touch, and detecting and measuring the optical signal changes to detect the user's finger and sensor grid panel. (S1701) comprising generating coordinate data for identifying finger coordinates at the contact surface or for grasping a finger pressing the sensor grid panel; A step of detecting the fine distance of each sensor in one or more specific areas through the output and reflection of a specific frequency emitted from the sensor grid panel according to the fingerprint recognition command, to detect the minute distance by using a reference unit time Analyzing and calculating a change between the output time and the input time of the light receiver (S1702); The coordinate data is used to calculate the center coordinates on the contact surface, the center coordinates are used to grasp the user's intended touch position, and the change of the finger coordinates is continuously analyzed as time passes, thereby specifying a specified time. Determining whether a gesture is input (S1703); Processing fingerprint data from a sensor grid panel to remove noise data and changing it into a format that can be used in the electronic device, thereby identifying a fingerprint of a user's finger using the fine distance differences (S1704); And when an input pattern corresponding to the detected touch position or the identified gesture or the fingerprint of the detected finger exists as an input pattern previously stored in the electronic device, and when a corresponding input pattern exists And displaying the corresponding input pattern on the display device of the electronic device or causing the electronic device to perform a specific function according to the corresponding input pattern (S1705).

According to an embodiment of the present invention, the step of detecting one or more optical signal changes appearing on the sensor grid panel by the user's touch may be calculated by the user calculated through the total width of the contact surface and the total width of the data below a certain value. You can find out the strength of the input you wanted.

In addition, according to an embodiment of the present invention, when the corresponding input pattern is present, the corresponding input pattern is displayed on the display device of the electronic device or the electronic device performs a specific function according to the corresponding input pattern. In the step of allowing, the input pattern corresponding to the identified fingerprint of the finger may have an input pattern corresponding to each of the left hand and the right hand finger.

According to an embodiment of the present invention, when the corresponding input pattern is present, the corresponding input pattern is displayed on the display device of the electronic device or the electronic device performs a specific function according to the corresponding input pattern. The step may include displaying an input pattern corresponding to the detected touch position or the detected gesture on a display device of the electronic device to perform a pointing function for selecting or indicating a specific element or function.

In the above, preferred embodiments of the sensor grid-type user input device and an electronic device using the same have been described through the specification and the drawings. Although specific terms are used, these are only examples of the present invention. It is only used in a general sense to easily describe the technical content and help the understanding of the invention, the present invention is not limited to the above-described embodiment. In other words, it will be apparent to those skilled in the art that various embodiments based on the technical idea of the present invention are possible.

Claims (29)

In the user input device capable of a multi-touch sensor grid method,
A display unit which displays data input by a user, a result of performing an operation according to the data, and a response;
A sensor grid panel composed of sensors arranged in a grid to fit the size of the screen so as to recognize the position of touched fingers;
A memory unit for storing one or more position data received from the sensor grid panel;
And a control unit which reads an input pattern corresponding to an operation mode identified from the position data from the memory and displays and displays a specific operation on the display unit.
An operation mode for pointing, an operation mode for pointing, a multi-touch operation mode, and an operation mode for gesture recognition,
The memory unit stores an input pattern for the operation modes and corresponding operation and function performance information.
The sensor grid panel includes a very small light emitting unit capable of outputting infrared or light of a specific frequency, a light receiving unit capable of receiving light reflected from light of a corresponding frequency, and sensors capable of detecting a change in light; ,
The sensor grid in the sensor grid panel is arranged in a grid form,
The sensor grid panel is made of a material having a graphene or a transparent electrode, the user input device, characterized in that disposed on the front of the display device. The method of claim 1,
And the control unit calculates a coordinate value of the center of the position data input in an operation mode for pointing to provide feedback for indicating or selecting a specific portion of the display unit. The method of claim 1,
And the control unit calculates a coordinate value of a center of two or more position data input in a multi-touch operation mode and provides feedback for simultaneously pointing or selecting a specific portion of the display unit. The method of claim 1,
The control unit may calculate a trajectory of one or more input position data in an operation mode for gesture recognition and perform a corresponding preset operation. The method of claim 1,
The sensor grid panel detects a change in light to generate digital data, and the controller calculates a contact area and a center point between a finger and the panel using the digital data to recognize a position intended by a user. User input device. The method of claim 1,
When the sensor grid panel detects a change in light, the light reflected by using a backlight of the LCD is used, the light is blocked by natural light by a finger, or the light emitter of each sensor is used. The user input device, characterized in that for outputting a light of a specific frequency to use the reflected light, or by combining two or more of the three methods to recognize the location intended by the user. The method of claim 1,
The sensor grid panel includes a sensor for detecting a change in light and a light receiving unit designed to recognize a specific light into a single unit. A user input device capable of fingerprint recognition using a sensor grid method,
A display unit which displays data input by a user, a result of performing an operation according to the data, and a response;
A sensor grid panel composed of sensors arranged in a grid to fit the size of the screen so that the fingerprints of the touched fingers can be recognized;
A memory unit for storing one or more fingerprint data received from the sensor grid panel;
And a controller configured to read an operation pattern corresponding to an operation mode set from the fingerprint identification data from the memory, and display and display a specific operation on the display unit.
An operation mode of the device including a multi-touch operation mode and a fingerprint recognition operation mode,
The memory unit stores an input pattern for the operation modes and corresponding operation and function performance information.
The sensor grid panel includes a very small light emitting unit capable of outputting infrared or light of a specific frequency, a light receiving unit capable of receiving light reflected from light of a corresponding frequency, and sensors capable of detecting a change in light; ,
The sensor grid in the sensor grid panel is arranged in a grid form,
The sensor grid panel is made of a material having a graphene or a transparent electrode, the user input device, characterized in that disposed on the front of the display device. The method of claim 8,
The control unit may be configured to output an infrared ray or light of a specific frequency to the sensor grid panel for the fingerprint scan for a specific position. The method of claim 8,
The control unit may be configured to output an infrared ray or light of a specific frequency to the sensor grid panel for the fingerprint scan for the position of two or more touched fingers in the multi-touch operation mode. The method of claim 8,
The control unit analyzes one or more fingerprint data in a fingerprint recognition operation mode and performs a preset operation corresponding to the corresponding fingerprint data combination. The method of claim 8,
The sensor grid panel detects a small distance through reflection of light having a specific frequency to generate digital data, and the controller analyzes information on a contact surface between the finger and the panel based on the digital data, and generates fingerprint data. And a user's specific finger fingerprint. In the user input device capable of multi-touch and fingerprint recognition of the sensor grid method,
A display unit which displays data input by a user, a result of performing an operation according to the data, and a response;
A sensor grid panel composed of sensors arranged in a grid to fit the size of the screen so as to recognize the position and fingerprint of the touched finger;
A memory unit for storing one or more location data or fingerprint data received from the sensor grid panel;
And a control unit which reads an input pattern corresponding to an operation mode identified from the position data from the memory and displays and displays a specific operation on the display unit.
An operation mode of the device including an operation mode for pointing, an multi-touch operation mode, an operation mode for gesture recognition, and an operation mode for fingerprint recognition,
The memory unit stores an input pattern for the operation modes and corresponding operation and function performance information.
The sensor grid panel includes a very small light emitting unit capable of outputting infrared or light of a specific frequency, a light receiving unit capable of receiving light reflected from light of a corresponding frequency, and sensors capable of detecting a change in light; ,
The sensor grid in the sensor grid panel is arranged in a grid form,
The sensor grid panel is made of a material having a graphene or a transparent electrode, the user input device, characterized in that disposed on the front of the display device. The method of claim 13,
And the control unit calculates a coordinate value of the center of the position data input in an operation mode for pointing to provide feedback for indicating or selecting a specific portion of the display unit. The method of claim 13,
And the control unit calculates a coordinate value of a center of two or more position data input in a multi-touch operation mode and provides feedback for simultaneously pointing or selecting a specific portion of the display unit. The method of claim 13,
The control unit may calculate a trajectory of one or more input position data in an operation mode for gesture recognition and perform a corresponding preset operation. The method of claim 13,
The controller may be configured to output an infrared ray or light of a specific frequency to the sensor grid panel for a fingerprint scan at a specific position received from the touch recognition unit. The method of claim 13,
The control unit may be configured to output an infrared ray or light of a specific frequency to the sensor grid panel for fingerprint scanning in two or more positions in the multi-touch operation mode. The method of claim 13,
The control unit analyzes one or more fingerprint data in an operation mode for fingerprint recognition and performs a preset operation corresponding to the corresponding fingerprint data combination. The method of claim 13,
The sensor grid panel detects a small distance through reflection of light having a specific frequency and generates digital data, and the controller calculates a contact area and a center point between the finger and the panel using the digital data, and the user's intended And a user's specific finger fingerprint using fingerprint information generated by recognizing a location or analyzing information on a contact surface between a finger and a panel based on the digital data. The method of claim 13,
When the sensor grid panel detects a change in light, the sensor grid panel uses light reflected by using a backlight of the LCD, a light is blocked by natural light by a finger, or a light emitter of each sensor. The user input device, characterized in that for outputting a light of a specific frequency to use the reflected light, or by combining two or more of the three methods to recognize the location intended by the user. The method of claim 13,
The sensor grid panel includes a sensor for detecting a change in light and a light receiving unit designed to recognize a specific light into a single unit. In the user touch recognition method of an electronic device having a sensor grid panel capable of multi-touch,
Detecting a change in one or more optical signals appearing on the sensor grid panel by a user's touch, and detecting and measuring the change in the optical signals to obtain finger coordinates at the contact surface where the user's finger and the sensor grid panel meet or Generating coordinate data for grasping the degree of pressing the grid panel;
The coordinate data is used to calculate the center coordinates on the contact surface, the center coordinates are used to grasp the user's intended touch position, and the change of the finger coordinates is continuously analyzed as time passes, thereby specifying a specified time. Determining whether a gesture is input; And
After checking whether an input pattern corresponding to the detected touch position or the detected gesture exists as an input pattern previously stored in the electronic device, the input pattern corresponding to the case where the corresponding input pattern exists is stored in the electronic device. Displaying on a display device of a display device or causing the electronic device to perform a specific function according to a corresponding input pattern. The method of claim 23,
Detecting one or more optical signal changes appearing on the sensor grid panel by the user's touch is based on a result calculated by comparing the total area of the contact surface with the total area of data above or below a certain reference value. A method for recognizing a user's touch of an electronic device, characterized by determining the strength of an input. A user fingerprint recognition method of an electronic device having a sensor grid panel capable of fingerprint recognition,
A step of detecting the fine distance of each sensor in one or more specific areas through the output and reflection of a specific frequency emitted from the sensor grid panel according to the fingerprint recognition command, to detect the minute distance by using a reference unit time Analyzing and calculating a change between the output time and the input time of the light receiver;
Processing fingerprint data from a sensor grid panel to remove noise data and transforming it into a format that can be used in the electronic device, thereby identifying a fingerprint of a user's finger using the fine distance differences; And
After checking whether an input pattern corresponding to the fingerprint of the identified finger exists as an input pattern previously stored in the electronic device, an input pattern corresponding to the case where the corresponding input pattern exists is displayed on the display device of the electronic device. Displaying or causing the electronic device to perform a specific function according to a corresponding input pattern. A user fingerprint recognition and touch recognition method of an electronic device having a sensor grid panel capable of fingerprint recognition and multi-touch,
Detecting a change in one or more optical signals appearing on the sensor grid panel by a user's touch, and detecting and measuring the change in the optical signals to obtain finger coordinates at the contact surface where the user's finger and the sensor grid panel meet or Generating coordinate data for grasping the degree of pressing the grid panel;
A step of detecting the fine distance of each sensor in one or more specific areas through the output and reflection of a specific frequency emitted from the sensor grid panel according to the fingerprint recognition command, to detect the minute distance by using a reference unit time Analyzing and calculating a change between the output time and the input time of the light receiver;
The coordinate data is used to calculate the center coordinates on the contact surface, the center coordinates are used to grasp the user's intended touch position, and the change of the finger coordinates is continuously analyzed as time passes, thereby specifying a specified time. Determining whether a gesture is input;
Processing fingerprint data from a sensor grid panel to remove noise data and transforming it into a format that can be used in the electronic device, thereby identifying a fingerprint of a user's finger using the fine distance differences; And
If the input pattern is stored in the electronic device in advance and the input pattern corresponding to the detected touch position or the identified gesture or the fingerprint of the detected finger is present, the corresponding input pattern is present. And displaying the input pattern on a display device of the electronic device or causing the electronic device to perform a specific function according to a corresponding input pattern. The method of claim 26,
Detecting one or more optical signal changes appearing on the sensor grid panel by the user's touch is to determine the intensity of the input the user intended to apply through the overall width of the contact surface and the total width of the data below a certain value. A user fingerprint recognition and a touch recognition method of an electronic device. The method of claim 26,
Displaying the corresponding input pattern on the display device of the electronic device when the corresponding input pattern exists, or causing the electronic device to perform a specific function according to the corresponding input pattern; The input pattern corresponding to the user fingerprint recognition and touch recognition method of the electronic device, characterized in that the input pattern corresponding to each of the left hand and the right hand finger. The method of claim 26,
In the case where the corresponding input pattern exists, displaying the corresponding input pattern on the display device of the electronic device or causing the electronic device to perform a specific function according to the corresponding input pattern may include: And displaying a input pattern corresponding to the identified gesture on a display device of the electronic device to perform a pointing function for selecting or pointing to a specific element or function. Recognition method.

Images