KR20120045502A - Method and apparatus for providing keypad in mobile terminal - Google Patents

Method and apparatus for providing keypad in mobile terminal Download PDF

Info

Publication number
KR20120045502A
KR20120045502A KR1020100107085A KR20100107085A KR20120045502A KR 20120045502 A KR20120045502 A KR 20120045502A KR 1020100107085 A KR1020100107085 A KR 1020100107085A KR 20100107085 A KR20100107085 A KR 20100107085A KR 20120045502 A KR20120045502 A KR 20120045502A
Authority
KR
South Korea
Prior art keywords
hand
information
size
user
keypad
Prior art date
Application number
KR1020100107085A
Other languages
Korean (ko)
Inventor
나상준
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to KR1020100107085A priority Critical patent/KR20120045502A/en
Publication of KR20120045502A publication Critical patent/KR20120045502A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202—Constructional details or processes of manufacture of the input device
    • G06F3/0219—Special purpose keyboards
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412—Digitisers structurally integrated in a display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H04B1/3833—Hand-held transceivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/40—Circuits
    • H04B1/401—Circuits for selecting or indicating operating mode

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a method and apparatus for providing a keypad of a mobile terminal. Method of providing a keypad of a mobile terminal according to an embodiment of the present invention comprises the steps of sensing a touch input of the user's hand; Generating shape information of the touch input user hand; Determining a keypad shape according to the generated shape information of the user's hand; And configuring and displaying the keypad according to the determined keypad form. According to the present invention, a keypad optimized for a user's hand can be provided to a portable terminal user.

Description

Method and device for providing keypad of mobile terminal {METHOD AND APPARATUS FOR PROVIDING KEYPAD IN MOBILE TERMINAL}

The present invention relates to a method and apparatus for providing a keypad of a mobile terminal, and more particularly, to a method for providing a keypad optimized for a user's hand and an apparatus for implementing the same.

With the recent rapid increase in the penetration rate of portable terminals, portable terminals are now becoming a necessity of modern man. Such a mobile terminal can provide not only a unique voice call service but also various data transmission services and various additional services, thereby becoming a multimedia communication device. Recently, touch screens have been applied to portable terminals, and preferences for touch screen based portable terminals are gradually increasing.

When a touch screen-based portable terminal enters a menu for text input, a virtual keypad is displayed on a screen, and a user touches the virtual keypad to input a key. However, most portable terminals on the market currently provide virtual keypads of the same size. Since the virtual keypad is generally implemented to fit the average hand size of users, those who have very small or very large hands may feel uncomfortable using the virtual keypad. In particular, with the recent emergence of large touch screen-based portable terminals such as tablet PCs, the problem has been increasingly highlighted.

An object of the present invention is to provide a method for providing a keypad optimized for a user's hand of a portable terminal and an apparatus for implementing the same.

Method of providing a keypad of a mobile terminal according to an embodiment of the present invention comprises the steps of sensing a touch input of the user's hand; Generating shape information of the touch input user hand; Determining a keypad shape according to the generated shape information of the user's hand; And configuring and displaying the keypad according to the determined keypad form.

A mobile terminal according to an embodiment of the present invention includes a touch sensor unit for detecting a touch input of a user's hand; A controller configured to generate wrist direction information, hand size information, finger length information, and fingertip size information, and determine a direction, a key size, and a distance between keys based on the generated information; And a display unit for configuring and displaying the keypad according to the determined direction, key size, and distance between the keys.

According to the present invention, a keypad optimized for a user's hand can be provided to a portable terminal user. This allows the user to enter keys more conveniently than using a conventional keypad.

1 is a diagram illustrating an internal configuration of a mobile terminal 100 according to an embodiment of the present invention.
2 is a flowchart illustrating a keypad providing method of a mobile terminal 100 according to an embodiment of the present invention.
3 is an exemplary view of a screen for receiving a touch of a user's hand in an embodiment of the present invention.
4 is a diagram illustrating a method of generating wrist direction information in an embodiment of the present invention.
5 is a diagram illustrating a method for generating hand size information, finger length information, and fingertip size information in an embodiment of the present invention.
6 is an illustration of a keypad implemented according to an embodiment of the invention.
7 is a diagram illustrating a keypad form changed according to the size of the display unit.
8 is a diagram illustrating a keypad form changed according to a model name or a manufacturer of a mobile terminal.
FIG. 9 illustrates a keypad in which a key size is smaller than that of FIG.
10 illustrates a keypad in which key sizes are set differently for each key constituting the keypad.
FIG. 11 illustrates a keypad in which a space between keys is wider than that in FIG. 5A.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference symbols as possible. In addition, detailed descriptions of well-known functions and configurations that may blur the gist of the present invention will be omitted.

Although the present invention will be described using a mobile terminal as an example, the present invention is not limited thereto, and the present invention can be applied to any device having a touch screen. In addition, the portable terminal according to an embodiment of the present invention is a terminal provided with a touch screen, preferably a mobile communication terminal, a portable multimedia player (PMP), a personal digital assistant (PDA), smart Information communication devices such as smart phones, MP3 players, and the like may be configured. In particular, the present invention can be applied not only to a small portable terminal having a display of 4 inches or less, but also to a medium portable terminal having a display of 7 inches or larger and a large portable terminal having a display of 10 inches or larger.

1 is a diagram illustrating an internal configuration of a mobile terminal 100 according to an embodiment of the present invention. The mobile terminal 100 of the present invention includes a wireless communication unit 110, an audio processor 120, a storage unit 130, a touch screen unit 140, a key input unit 150, and a controller 160.

The wireless communication unit 110 performs a function of transmitting and receiving corresponding data for wireless communication of the mobile terminal 100. The wireless communication unit 110 may include an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. In addition, the wireless communication unit 110 may receive data through a wireless channel, output the data to the controller 160, and transmit data output from the controller 160 through the wireless channel.

The audio processor 120 may include a codec, and the codec may include a data codec for processing packet data and an audio codec for processing an audio signal such as voice. The audio processor 120 converts a digital audio signal into an analog audio signal through an audio codec, plays back through a speaker SPK, and converts an analog audio signal input through a microphone MIC into a digital audio signal through an audio codec. .

The storage unit 130 stores a program and data necessary for the operation of the mobile terminal 100 and may be divided into a program area and a data area. The program area may include a program for controlling the overall operation of the mobile terminal 100, an operating system (OS) for booting the mobile terminal 100, an application required for multimedia content playback, other optional functions of the mobile terminal 100, For example, an application program required for a camera function, a sound reproduction function, an image or a video reproduction function, and the like can be stored. The data area is an area in which data generated according to the use of the mobile terminal 100 is stored, and may store an image, a video, a phone book, and audio data. In the present invention, the storage unit 130 stores a hand size application coefficient, a finger length application coefficient, a fingertip size application coefficient, a display unit size application coefficient, a mobile terminal model application coefficient, and a mobile terminal manufacturer application coefficient.

The touch screen unit 140 includes a touch sensor unit 141 and a display unit 142. The touch sensor unit 141 detects a user's touch input. The touch sensor unit 141 is composed of a touch sensor such as a capacitive overlay, a resistive overlay, an infrared beam, or a pressure sensor. May be In addition to the sensors, all kinds of sensor devices capable of detecting contact or pressure of an object may be configured as the touch sensor unit 141 of the present invention. The touch sensor unit 141 detects a user's touch input, generates a detection signal, and transmits the detected signal to the controller 160. The detection signal includes coordinate data input by a user.

The display unit 142 may be formed of a liquid crystal display (LCD), organic light emitting diodes (OLEDs), active matrix organic light emitting diodes (AMOLEDs), and the like. A menu, input data, function setting information, and various other information of the terminal 100 are visually provided to the user. The display unit 142 performs a function of outputting a boot screen, a standby screen, a menu screen, a call screen, and other application screens of the mobile terminal 100. In the present invention, the display unit 142 outputs the keypad configured by the controller 160.

The key input unit 150 receives a user's key operation for controlling the mobile terminal 100, generates an input signal, and transmits the generated input signal to the controller 160. The key input unit 150 may be configured as a keypad including a numeric key and a direction key, and may be formed as a predetermined function key on one surface of the portable terminal 100. According to the exemplary embodiment of the present invention, the key input unit 150 may be omitted in the case of a portable terminal which can be operated by only the touch screen unit 140.

The controller 160 controls the overall operation of each component of the portable terminal. In the present invention, when the controller 160 detects a touch input of the user's hand through the touch sensor unit 141, the controller 160 generates shape information of the touch-in user's hand. The controller 160 determines the keypad form according to the generated shape information of the user's hand, configures the keypad according to the determined keypad form, and controls and displays the display unit 142. Here, the controller 160 generates at least one of wrist direction information, hand size information, finger length information, and size information for each fingertip as shape information of the user hand when generating shape information of the user hand. In addition, when determining the keypad shape, the controller 160 determines at least one of a direction, a key size, and a distance between keys. The controller 160 configures the keypad according to the determined direction of the keypad, the key size, and the interval between the keys, and controls the display unit 142 to display the configured keypad.

According to an exemplary embodiment of the present invention, when generating wrist direction information, the controller 160 calculates an arctan (x / y) value for all pixels of a region where the user's hand is touched, and calculates the calculated arctan (x / y) value. The total value divided by the total number N of pixels touched by the user's hand may be generated as wrist direction information. In addition, the controller 160 calculates arctan (x / y) values for all pixels of the touched area of the user's hand, selects the maximum and minimum values among the calculated arctan (x / y) values, and selects the maximum and minimum values. The average value of may be calculated, and the calculated average value may be generated as wrist direction information.

According to an exemplary embodiment of the present invention, the controller 160 calculates a quadrangle having a maximum size in which all four sides of the quadrangle are in contact with the area where the user's hand touches, calculates the calculated area of the quadrangle, and uses the calculated width value as hand size information. Can be generated with In addition, the controller 160 may analyze the touch input user's hand to distinguish the finger portion and the palm portion, calculate the width of the palm portion, and generate the calculated width value as the hand size information. According to an embodiment of the present invention, the control unit 160 may calculate a rectangle having a maximum size in which all four sides of the rectangle contact the palm portion, calculate the calculated area of the rectangle, and generate the calculated area value as hand size information. have.

According to an exemplary embodiment of the present invention, the controller 160 analyzes a touch input user's hand to distinguish a finger portion and a palm portion, measures a distance between a point where a finger portion starts and a fingertip point, and measures the measured distance by a finger. Can be generated with length information. According to an embodiment of the present invention, the control unit 160 measures the distance between the point where the finger portion starts and the fingertip point for all five fingers, calculates an average value of the measured five distances, and calculates the average value of the fingers. The length information may be generated, and a maximum value or a minimum value among five measured distances may be generated as finger length information. In addition, the controller 160 may generate each of the five measured distances as finger length information.

According to an embodiment of the present invention, the controller 160 may calculate the touch area size of the fingertip node from the touch input user's hand, and generate the calculated touch area size as fingertip node size information. According to an embodiment of the present invention, the controller 160 calculates the touch area size of the fingertips for all five fingers, calculates an average value of the calculated five touch area sizes, and uses the calculated average value as the fingertip size information. The maximum value or the minimum value among the calculated five touch area sizes may be generated as fingertip size information. In addition, the controller 160 may generate each of the five touch region sizes calculated as the fingertip size information.

According to an embodiment of the present invention, when determining the keypad direction, the controller 160 may determine the keypad direction in the same manner as the generated wrist direction information. In addition, when determining the keypad direction, the controller 160 may determine the keypad direction by multiplying the generated wrist direction information by a predetermined coefficient value, and the keypad direction is determined by adding or subtracting the preset angle value to the generated wrist direction information. You can decide.

According to an exemplary embodiment of the present invention, when determining the size of the key, the controller 160 may determine the size of the key in the same manner as the size information of the generated fingertip, and multiplies the size information of the generated fingertip by the preset coefficient value. You can determine the key size. Here, the preset coefficient value may be determined according to the size of the display unit 142, may be determined according to the size of the area where the keypad is displayed, or may be determined according to what model and manufacturer the portable terminal 100 is. .

According to an exemplary embodiment of the present invention, the controller 160 may determine at least one of hand size information, finger length information, and fingertip size information when determining an interval between keys. The storage unit 130 stores a hand size application coefficient, a finger length application coefficient, a fingertip size application coefficient, and a size coefficient of the display unit 142, and the controller 160 determines at least one of the coefficients when determining a distance between keys. Can be used. For example, the controller 160 may determine the distance between the keys by multiplying the hand size information, the hand size application coefficient, the finger length information, the finger length application coefficient and the display unit size coefficient.

2 is a flowchart illustrating a keypad providing method of a mobile terminal 100 according to an embodiment of the present invention.

In operation 201, the controller 160 detects a touch input of a user's hand through the touch sensor unit 141. The portable terminal 100 may include a menu for generating shape information of the user's hand. When the user selects the menu, the controller 160 controls the display unit 142 to display a screen for receiving a touch of the user's hand. On the screen, a message, 'Please raise both hands comfortably' may be displayed. When the user puts his hand on the screen, the touch sensor unit 141 generates a touch signal including the touch input coordinate information and transmits it to the controller 160, and the controller 160 controls the user's hand through the touch signal. Detect touch input. According to an exemplary embodiment of the present invention, when executing an application (text message writing application or email writing application) that allows a user to input text, the controller 160 controls the display unit 142 to touch a user's hand along with a text input window. A screen for receiving input can be displayed. When the user puts his hand on the screen, the controller 160 detects a touch input of the user's hand through a touch signal received from the touch sensor unit 141.

3 is an exemplary view of a screen for receiving a touch of a user's hand in an embodiment of the present invention. The display unit 142 displays a message, 'Please raise both hands comfortably,' and the user places both hands on the display unit 142 according to the message. 3 illustrates a form in which a user puts both hands on the display unit 142.

The controller 160 generates shape information of the user's hand according to the touch signal received in step 202 after receiving the touch signal from the touch sensor unit 141. The controller 160 may generate wrist direction information, hand size information, finger length information, and fingertip size information as shape information of the user hand when generating shape information of the user hand. The controller 160 may generate only some of the four pieces of information as form information of the user's hand, and may generate all four pieces of information as form information of the user's hand.

According to an exemplary embodiment of the present invention, when generating wrist direction information, the controller 160 calculates an arctan (x / y) value for all pixels of a region where the user's hand is touched, and calculates the calculated arctan (x / y) value. After summing, the value divided by the total number N of the touched area of the user's hand may be generated as wrist direction information.

4 is a diagram illustrating a method of generating wrist direction information according to an exemplary embodiment of the present invention.

4A illustrates a screen for calculating an arctan (x / y) value for a pixel of a touch area of a user's hand when the lower left point of the display unit 142 is set to (0,0). A point (0,0) illustrated in [a] of FIG. 4 corresponds to a lower left point of the display unit 142 and corresponds to a point identical to the point (0,0) illustrated in FIG. 3. The controller 160 calculates an arctan (x / y) value for all the pixels of the area 401 where the user's hand is touched, sums the calculated arctan (x / y) values, and then calculates an arctan (x / y) value of the area where the user's hand is touched. Divide by the total number of pixels (N). The final calculated value may be an average value of arctan (x / y) values for all pixels of the region where the user's hand is touched. As such, the controller 160 may generate, as wrist direction information, an average value of arctan (x / y) values of all pixels of the area where the user's hand is touched.

According to an exemplary embodiment of the present invention, the controller 160 calculates arctan (x / y) values for all the pixels of the touched area of the user's hand, and selects the maximum and minimum values among the calculated arctan (x / y) values. After calculating the average value between the maximum value and the minimum value, the calculated average value may be generated as wrist direction information.

4B illustrates a screen for generating wrist orientation information using the maximum and minimum values of arctan (x / y) values of all pixels of the region where the user's hand is touched. The controller 160 calculates an arctan (x / y) value for all the pixels of the region 401 where the user's hand is touched, and the maximum value (b) and minimum value (a) of the calculated arctan (x / y) values. Check. The maximum value (b) plus the minimum value (a) plus the value (b + a) divided by two ((b + a) / 2) correspond to the average value of the angle occupied by the area 401 where the user's hand is touched. . The controller 160 may generate the average value (b + a) / 2 as wrist direction information K. FIG.

According to an exemplary embodiment of the present invention, the controller 160 checks the pixel farthest from the (0,0) point of the area where the user's hand is touched, and checks the (0,0) point, the identified pixel point, and the display unit 142. The angle formed by the bottom side of the) may be measured, and the measured angle may be generated as wrist direction information.

[C] of FIG. 4 shows the pixel 402, the point (0,0) having the longest distance from the point (0,0) among all the pixels in the region 401 where the user's hand is touched, and the display unit 142. A screen for generating, as the wrist direction information, an angle formed by the lower side 403 is illustrated. The controller 160 calculates an angle K formed by (0,0), the lower side 403 of the display unit 142, and the pixel 402, and generates the calculated angle K as wrist direction information. .

According to an embodiment of the present invention, when generating hand size information, the controller 160 may analyze a touch input user's hand to distinguish a finger portion and a palm portion and generate a width value of the palm portion as hand size information. In addition, the controller 160 may calculate a quadrangle having a maximum size in which all four sides of the quadrangle are in contact with the palm portion, and generate the calculated area size as hand size information. According to an embodiment of the present invention, when generating the hand size information, the controller 160 calculates a quadrangle having a maximum size in which all four sides of the quadrangle are in contact with the touched area of the user's hand, and uses the calculated width value of the quadrangle as hand size information. Can be generated.

According to an embodiment of the present invention, when generating the finger length information, the controller 160 analyzes a touch input user's hand to distinguish a finger portion and a palm portion, and determines the distance between a finger starting point and a finger tip. Can be generated with information. The controller 160 may measure a distance between a finger start point and a fingertip point for all five fingers, and generate the average value of the five measured distances as finger length information. In addition, the controller 160 may generate the maximum value or the minimum value of the five measured distances as the finger length information, and may generate all the measured five distances as the finger length information. The controller 160 may generate finger length information for each of the left hand and the right hand.

According to an embodiment of the present invention, when generating the fingertip size information, the controller 160 may calculate the touch region size of the fingertip node from the touch input user's hand and generate the calculated touch region size as the fingertip size information. . The controller 160 may calculate the touch area size of the fingertips for all five fingers, and generate the average value of the calculated five touch area sizes as the fingertip size information, and among the calculated five touch area sizes. The maximum or minimum value can be generated as fingertip size information. In addition, the controller 160 may generate all of the calculated five touch region sizes as fingertip size information. At this time, the controller 160 generates fingertip segment size information corresponding to the thumb, the index finger, the middle finger, the ring finger, and the hand. The controller 160 may generate fingertip segment size information for each of the left hand and the right hand.

5 is a diagram illustrating a method for generating hand size information, finger length information, and fingertip size information in an embodiment of the present invention.

FIG. 5A illustrates a palm portion 501, a quadrangle 502 of four sides facing the palm portion, a finger portion 503, and a finger connection point 504. The controller 160 analyzes the coordinate information (x, y) of the touch area included in the touch signal received from the touch sensor unit 141 to identify four finger connection points 504. Subsequently, the controller 160 generates a parallel line connecting the index finger and the middle finger connection point, the middle finger and the ring finger connection point, and the ring finger and the hand point connecting point, and generates a parallel line perpendicular to the parallel line and passing through the connection point between the thumb and the index finger. The controller 160 divides the palm portion 501 and the finger portion 503 by using the two parallel lines as a boundary line. The controller 160 may calculate the width of the palm portion 501 and generate the calculated value as hand size information. In addition, the control unit 160 calculates the quadrangle 502 of the maximum size in which the four sides contact the palm portion 501, calculates the area of the calculated quadrangle 502, and generates the calculated value as hand size information. can do.

5B illustrates a form in which all four sides of the quadrangle generate hand size information through a quadrangle 507 having a maximum size in contact with an area where the user's hand touches. In FIG. 5B, the controller 160 calculates the width of the quadrangle 507 and generates the calculated width value as hand size information.

FIG. 5A illustrates a method of measuring a distance between a point where the finger portion 503 starts and a fingertip point 505. 5A illustrates a middle finger as an example, and the controller 160 measures a distance between a connection point between the index finger and the middle finger and a line connecting the middle finger and the middle finger to the fingertip point 505. The measured distance may be generated as finger length information. As shown in [a] of FIG. 5, the controller 160 may generate finger length information based on a specific finger among five fingers, and a point where the finger portion 503 starts for five fingers. And a distance to the fingertip point 505 may be measured, an average value of the five measured distances may be calculated, and the calculated average value may be generated as finger length information. In addition, the controller 160 may generate the minimum or maximum value of the five measured distances as the finger length information, and may generate all the measured five distances as the finger length information.

FIG. 5A also illustrates the form of measuring the touch area size of the fingertip. FIG. 5A illustrates a middle finger, and the controller 160 recognizes a bent portion connecting the node and the node at the middle finger to check the tip portion 506 of the finger, and the finger tip portion 506 of the finger tip portion 506. After measuring the size of the touch area, the size of the measured touch area may be generated as fingertip size information. In addition, the controller 160 may calculate a rectangle having a maximum size that the four sides contact the touch area of the fingertip node, measure the width of the rectangle, and generate the width of the measured rectangle as the fingertip size information. As shown in FIG. 5A, the controller 160 may generate fingertip size information based on a specific finger among five fingers, and measure the touch area size of the fingertips with respect to five fingers. The average value of the measured five touch area sizes may be generated as fingertip size information. In addition, the controller 160 may generate the minimum or maximum value of the five touch area sizes as the size information of the fingertip. In addition, the controller 160 may generate the entirety of the five touch region sizes as the fingertip size information.

After generating shape information of the user's hand such as wrist direction information, hand size information, finger length information, and fingertip size information, the controller 160 determines a keypad shape in step 203. In step 203, the controller 160 is in the form of a keypad. The controller 160 determines a keypad direction, a key size, and an interval between keys.

According to an embodiment of the present invention, when determining the keypad direction, the controller 160 may determine the keypad direction in the same manner as the generated wrist direction information. In addition, when determining the keypad direction, the controller 160 may determine the keypad direction by a value obtained by multiplying the generated wrist direction information by a pre-stored adjustment coefficient value, and by adding or subtracting the pre-stored adjustment angle value to the generated wrist direction information. Direction can be determined. For example, when the generated wrist direction information is 30 degrees, the controller 160 may determine the keypad direction as 'the direction inclined 30 degrees based on the lower side of the display unit 142'. In addition, when the adjustment coefficient value is set to 1.1, the control unit 160 may determine the keypad direction as a '33 (30 * 1.1) also inclined direction relative to the lower side of the display unit 142, the adjustment angle value When stored in the first degree, the controller 160 may determine the keypad direction as a direction in which 31 (30 + 1) is inclined based on the lower side of the display unit 142.

According to an embodiment of the present invention, when determining the key size, the controller 160 may determine the key size by multiplying the generated fingertip size information by a pre-stored coefficient value. Here, the pre-stored coefficient value may be determined according to the size of the display unit, and may be determined according to the model name or manufacturer of the mobile terminal 100. For example, when the generated fingertip size information is 1.4 cm 2 and the size coefficient of the display unit is 0.75, the controller 160 may determine the key size as 1.05 (1.4 * 0.75) cm 2 . In addition, when the generated fingertip size information is 1.4 cm 2 , the coefficient according to the size of the display unit is 0.75, and the coefficient according to the model name of the mobile terminal 100 is 0.9, the controller 160 sets the key size to 0.945 (1.4 * 0.75). * 0.9) cm 2 can be determined.

According to an embodiment of the present invention, when determining the key size, the controller 160 may determine the key size in consideration of a finger frequently touched for each key. Based on the QWERTY keypad, when the user inputs the keyboard, the left hand is frequently touched by the 'A' key and the index finger of the left hand is frequently touched by the 'F' key. That is, the controller 160 may determine a finger frequently touched for each key and set a different key size for each finger. For example, since the end node size of the index finger is larger than the end node size of the index finger, the controller 160 may determine the size of the 'F' key to be larger than the size of the 'A' key.

When the key type corresponding to each finger is stored in the storage 130 in advance, the controller 160 generates fingertip size information for all ten fingers touched in step 202, and in step 203. After multiplying the generated size information of the fingertips by a pre-stored coefficient value, the size of the key may be determined for each key according to key type information corresponding to each finger. For example, 'F', 'R', and 'V' are set as the keys corresponding to the index finger, and 'A', 'Q' and 'Z' are set as the keys corresponding to the index finger. If the size information is to 1.4cm 2, the finger kkeutmadi size information of the substrate is generated by 1.1cm 2, display unit 142, the size coefficient is 0.75, the controller 160 of 'F', 'R', 'V' The key size can be determined as 1.05 (1.4 * 0.75) cm 2 , and the key sizes for 'A', 'Q' and 'Z' can be determined as 0.825 (1.1 * 0.75) cm 2 .

According to an exemplary embodiment of the present invention, the controller 160 may determine at least one of finger length information, hand size information, and fingertip size information when determining an interval between keys. For example, the controller 160 multiplies the interval between the keys by multiplying the finger length information, the preset finger length application coefficient, the hand size information, the preset hand size application coefficient, and a coefficient corresponding to the size of the display unit 142. You can decide. In addition, the controller 160 determines the distance between the keys by multiplying the finger length information, the preset finger length application coefficient, the fingertip size information, the preset fingertip size application coefficient, and the coefficient corresponding to the model name of the mobile terminal 100. Can be. In addition, the controller 160 may include finger length information, hand size information, fingertip size information, finger length application coefficient, hand size application coefficient, fingertip size application coefficient, coefficient corresponding to the size of the display unit 142, and the mobile terminal. The interval between the keys may be determined using some or all of the coefficients corresponding to the model name.

For example, when the length information of the finger is 9 cm, the length application coefficient of the finger is 0.1, the size of the hand 10 cm 2 , the hand size application coefficient is 0.1, and the size application coefficient of the display unit 142 is 0.75, the controller 160 You can determine the spacing between the keys as 0.675 (9 * 0.1 * 10 * 0.1 * 0.75).

After determining the keypad form, the controller 160 controls the display unit 142 in step 204 to configure and display the keypad according to the determined keypad form. In this case, when displaying the keypad on the display unit 142, the controller 160 may generate and display the keypad based on the point where the user put his hand.

6 is an illustration of a keypad implemented according to an embodiment of the invention. FIG. 6A shows two separate QWERTY keypads, each of which is inclined according to the user's wrist direction. [B] of FIG. 6 illustrates a QWERTY keypad having a curved downward shape, and the QWERTY keypad is also bent and displayed according to the direction of the user's wrist. The angle K shown in [a] and [b] of FIG. 6 may correspond to the same value as the wrist direction information generated in step 202, and may be a value obtained by multiplying the wrist direction information by a constant adjustment factor. For example, a predetermined adjustment angle may be added to or subtracted from the wrist direction information.

In the present invention, the shape of the keypad may be changed according to the size of the display unit 142. The storage unit 130 may store the size application coefficient of the display unit 142, and the controller 160 may use the stored size application coefficient of the display unit 142 when determining the key size and the distance between the keys. According to an exemplary embodiment of the present invention, even if the size of the display unit 142 is the same, the size of the keypad may vary according to the size of the area where the keypad is displayed in the display unit 142.

7 is a diagram illustrating a keypad form changed according to the size of the display unit. The display portion of FIG. 7 is smaller in size than the display portion shown in FIG. 5A, and the size application coefficient of the display portion stored in the portable terminal including the display portion of FIG. 7 is a portable portion having the display portion of FIG. 5A. It has a smaller value than the size application coefficient of the display unit stored in the terminal. As a result of this, the keypad of FIG. 7 is displayed smaller than the keypad of [a] of FIG.

According to the exemplary embodiment of the present invention, the shape of the keypad may be changed according to the model name or the manufacturer of the mobile terminal 100. The storage unit 130 may store coefficients corresponding to the model name or manufacturer of the mobile terminal 100, and the controller 160 determines the model name or manufacturer of the stored mobile terminal 100 when determining the key size and the distance between the keys. Coefficients corresponding to can be used. That is, even if the size of the display unit 142 is the same, the shape of the keypad may be set differently according to the model name or the manufacturer of the portable terminal 100.

8 is a diagram illustrating a keypad form changed according to a model name or a manufacturer of a mobile terminal. Since the display portion of FIG. 8 is the same size as the display portion of FIG. 5A, the display portion in the portable terminal having the display portion size application coefficient in the portable terminal having the display portion of FIG. 8 and the display portion of FIG. The magnitude application factor may correspond to the same value. However, since the portable terminal having the display unit of FIG. 8 and the portable terminal having the display unit of [a] of FIG. 5 are different models, each portable terminal uses different model name coefficients. Set differently. As a result of this, the keypad of FIG. 8 is displayed smaller than the keypad of [a] of FIG.

FIG. 9 illustrates a keypad in which a key size is smaller than that of FIG. In the present invention, the key size may be changed according to the fingertip size information. When a user who has a smaller fingertip size than the user who created the keypad of FIG. 5A puts his hand on the display unit 142, the controller 160 controls the display unit 142 to display the hand. As shown in FIG. 5, a keypad having a smaller key size may be displayed.

10 illustrates a keypad in which key sizes are set differently for each key constituting the keypad. According to an embodiment of the present invention, the storage unit 130 stores key types that are frequently touched in response to ten fingers, and the controller 160 has a fingertip size for each finger when a user's hand touch is input. The size of the keys constituting the keypad may be set differently in consideration of the generation of the information and the type of key corresponding to each finger. In FIG. 10, the 'A' key is displayed smaller than the 'F' key. When the user enters a letter, the 'A' key is frequently input and the 'F' key is frequently entered. The index finger is usually larger than the size of the finger. Displayed smaller than the key.

FIG. 11 illustrates a keypad in which a space between keys is wider than that in FIG. 5A. In the present invention, the distance between the keys is changed according to at least one of hand size information, finger length information, and user fingertip size information. When a user who has a larger finger size, longer finger length, or larger fingertip size than the user who created the keypad of FIG. 5A puts his hand on the display unit 142, the controller 160 displays the display unit. As shown in FIG. 11, the keypad 142 may be controlled to display a keypad in which a space between keys is widened.

According to the present invention, the portable terminal 100 can provide an optimal keypad for a user's hand. As a result, the user can enter characters more conveniently than in the prior art.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to easily explain the technical contents of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

100: mobile terminal 401: area where a user's hand is touched
110: wireless communication unit 402: longest pixel from the point (0,0)
120: audio processing unit 403: lower side of the display unit 142
130: storage unit 501: palm part
140: touch screen unit 502: the largest size square of the four sides in contact with the palm portion
141: touch sensor unit 503: finger portion
142: display unit 504: finger connection point
150: key input unit 505: hand point
160: control unit 506: end of finger
507: rectangle of maximum size where the user's hand touches the touched area

Claims (13)

In the keypad providing method of a mobile terminal,
Detecting a touch input of a user's hand;
Generating shape information of the touch input user hand;
Determining a keypad shape according to the generated shape information of the user's hand; And
And constructing and displaying a keypad according to the determined keypad form. The method of claim 1,
The generating step
And generating at least one of wrist direction information, hand size information, finger length information, and fingertip size information as shape information of a user's hand. The method of claim 2,
The step of determining
And determining at least one of a direction, a key size, and a distance between the keys of the keypad. The method of claim 2,
The generating step
Calculating an arctan (x / y) value for every pixel of the area where the user's hand is touched; And
Summing the calculated arctan (x / y) values and generating a value obtained by dividing the total number of pixels (N) of the touched area by the user's hand as wrist direction information. Way. The method of claim 2,
The generating step
Calculating an arctan (x / y) value for every pixel of the area where the user's hand is touched;
Selecting a maximum value and a minimum value among the calculated arctan (x / y) values; And
And generating an average value of the selected maximum value and the minimum value as wrist direction information. The method of claim 2,
The generating step
Calculating the largest rectangle in which all four sides of the rectangle touch the area where the user's hand is touched; And
And generating a hand size information of the calculated area value of the quadrangle. The method of claim 2,
The generating step
Distinguishing a finger portion and a palm portion from the touch input user hand; And
And generating a hand size information of the width value of the palm portion. The method of claim 2,
The generating step
Distinguishing a finger portion and a palm portion from the touch input user hand;
Measuring a distance between a point where the finger portion starts and a point where the fingertip points; And
And generating the measured distance as finger length information. The method of claim 2,
The generating step
Calculating a touch area size of a fingertip in the touch-in user's hand;
And generating the calculated touch area size as fingertip size information. The method of claim 3,
The step of determining
And determining a direction of the keypad in the same manner as the generated wrist direction information. The method of claim 3,
The step of determining
And determining the key size by multiplying the generated fingertip size information by a coefficient corresponding to the size of the display unit. The method of claim 3,
The step of determining
And determining a distance between the keys by multiplying the generated finger length information, a preset finger length application coefficient, the generated hand size information, a preset hand size application coefficient, and a coefficient corresponding to the size of the display unit. Method for providing a keypad of a mobile terminal, characterized in that. A touch sensor unit sensing a touch input of a user's hand;
A controller configured to generate wrist direction information, hand size information, finger length information, and fingertip size information, and determine a direction, a key size, and a distance between keys based on the generated information; And
And a display unit configured to display the keypad according to the determined direction of the keypad, key size, and interval between keys.
KR1020100107085A 2010-10-29 2010-10-29 Method and apparatus for providing keypad in mobile terminal KR20120045502A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020100107085A KR20120045502A (en) 2010-10-29 2010-10-29 Method and apparatus for providing keypad in mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020100107085A KR20120045502A (en) 2010-10-29 2010-10-29 Method and apparatus for providing keypad in mobile terminal

Publications (1)

Publication Number Publication Date
KR20120045502A true KR20120045502A (en) 2012-05-09

Family

ID=46264956

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100107085A KR20120045502A (en) 2010-10-29 2010-10-29 Method and apparatus for providing keypad in mobile terminal

Country Status (1)

Country Link
KR (1) KR20120045502A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104168363A (en) * 2013-05-16 2014-11-26 中兴通讯股份有限公司 Keyboard customization method and apparatus of touch-screen mobile phone

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104168363A (en) * 2013-05-16 2014-11-26 中兴通讯股份有限公司 Keyboard customization method and apparatus of touch-screen mobile phone
CN104168363B (en) * 2013-05-16 2019-02-15 中兴通讯股份有限公司 A kind of the keyboard method for customizing and device of touch-screen mobile phone

Similar Documents

Publication Publication Date Title
JP5916042B2 (en) Device with touch screen and touch recognition method thereof
US8918146B2 (en) Automatic gain control based on detected pressure
KR101115467B1 (en) Terminal and method for providing virtual keyboard
US8451254B2 (en) Input to an electronic apparatus
CN107977132B (en) Information display method and mobile terminal
US20110050575A1 (en) Method and apparatus for an adaptive touch screen display
US20150084885A1 (en) Portable electronic device with display modes for one-handed operation
CN110874147B (en) Display method and electronic equipment
CN108491149B (en) Split screen display method and terminal
US10133480B2 (en) Method for adjusting input-method keyboard and mobile terminal thereof
JP4706629B2 (en) Mobile terminal device
KR100821161B1 (en) Method for inputting character using touch screen and apparatus thereof
JP5743847B2 (en) Mobile terminal and low sensitivity area setting program
CN109032447B (en) Icon processing method and mobile terminal
CN109634438B (en) Input method control method and terminal equipment
US8508500B2 (en) Touch panel electrical device and method for operating thereof
US20120105331A1 (en) Portable electronic device
KR20120018541A (en) Method and apparatus for inputting character in mobile terminal
US11558500B2 (en) Gesture interaction method and terminal
CN105653168B (en) Electronic device and control method thereof
WO2020001358A1 (en) Icon sorting method and terminal device
KR20140106801A (en) Apparatus and method for supporting voice service in terminal for visually disabled peoples
KR102384284B1 (en) Apparatus and method for controlling volume using touch screen
KR20110025520A (en) Apparatus and method for controlling a mobile terminal
CN111190517B (en) Split screen display method and electronic equipment

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination