KR101426791B1 - Apparatas and method of inputting selected symbol for detecting input gesture in a electronic device - Google Patents

Abstract

The present invention provides a method of operating an electronic device, comprising: confirming that input means is detected at a position less than a predetermined height from a touch area; Confirming that the position of the input means is included in one of the touch areas divided into the plurality of areas; And analyzing a gesture of the input means and inputting at least one of the symbols assigned to the touch region in which the input means is located, And more particularly, to an electronic device and a method for inputting the same.

Description

[0001] APPARATUS AND METHOD OF INPUTTING SELECTED SYMBOL FOR DETECTING INPUT GESTURE IN A ELECTRONIC DEVICE [0002]

The present invention relates to an input system.

As the multimedia information service is developed, there is a growing demand for electronic devices for supporting the disabled for the realization of social welfare. In particular, the electronic device for the visually impaired should be able to supplement the limited ability of the user by applying a strong user interface that can efficiently support the hearing and touch.

Currently, electronic devices are made mainly of non-functionalities. For example, since interfaces between electronic devices and people are all performed through a touch screen, there is a problem that a visually impaired person can not receive services using electronic devices.

The conventional keyboard input system has a disadvantage in that input is impossible in a smart touch device or a virtual space in which the keyboard can not be physically recognized. Therefore, there is a problem that the disabled, the sight weakened and the elderly are not able to see in front of the flat touch-type keyboard input system and the user can not easily recognize that the key is actually input because the user does not receive the response that the key is pressed by the feedback.

The present invention has been proposed in order to solve the above-mentioned problems of the previously proposed methods, and it is an object of the present invention to provide a smart device which can not recognize a character position of a keyboard, And to provide an apparatus and method capable of performing input.

It is another object of the present invention to provide an apparatus and method which can be easily used by a general public who is not familiar with sight weakness, visually impaired, elderly people, and smart devices.

It is still another object of the present invention to provide an apparatus and method for providing feedback to a user not only in terms of time, but also in auditory and tactile sense to satisfy various needs of the user.

According to an aspect of the present invention, there is provided an operation method of an electronic device, including: confirming that input means is detected at a position less than a predetermined height from a touch area; Confirming that the position of the input means is included in one of the touch areas divided into the plurality of areas; And analyzing the gesture of the input means and inputting at least one of the notation types assigned to the touch region in which the input means is located.

Preferably, the step of confirming that the input means is detected at a position less than the predetermined height from the touch region may include determining a height from the touch region to the input means using at least one of a camera, a piezoelectric sensor, an infrared sensor, Can be detected.

The method may further include displaying the selected notation type among at least one notation type assigned to the touch area including the input unit.

The method may further include the step of outputting information about the selected notation type among a plurality of notation types assigned to the touch region including the input means.

The method may further include transmitting the tactile signal to the input unit whenever the input unit confirms movement between the respective touch regions partitioned into the plurality of regions.

Preferably, the method further comprises enlarging a touch area in which the input unit is located by a predetermined size, and reducing the remaining area by a predetermined size.

Preferably, the step of analyzing the gesture of the input means and inputting any one of the at least one notation type assigned to the touch region in which the input means is located comprises the steps of: inputting at least one The method comprising the steps of: Confirming that the input means is not sensed at a position higher than the set height; Confirming that the set time has elapsed without the input means being detected; And inputting the selected notation type.

Detecting a first gesture of the input means; And selecting a display type of at least one of the same kind of display type assigned to the touch area according to the set order if it is determined that the sensed first gesture is the same as the set gesture.

Detecting a second gesture of the input means; And converting the currently selected second type of gesture into a different type of notation type according to the set order if it is determined that the detected second gesture is the same as the set gesture.

Preferably, the notation type may include at least one of numbers, letters, and symbols.

According to an aspect of the present invention, there is provided an electronic device including: an electronic device that confirms that an input means is detected at a position less than a predetermined height from a touch region, At least one of a camera, a motion sensor, and a touch screen confirms that the touch screen is included in one of the divided touch areas, and analyzes the gesture of the input device to detect at least one Of the present invention.

Preferably, at least one of the camera subsystem, the motion sensor, and the touch screen senses the height from the touch region to the input means.

The touch screen may display the selected notation type among at least one notation type assigned to the touch area including the input unit.

The apparatus may further include an audio subsystem for outputting information about the selected notation type among a plurality of notation types assigned to the touch region including the input means.

Preferably, the touch screen may transmit a tactile sense signal to the input means whenever the input means confirms movement between respective touch regions partitioned into the plurality of regions.

Preferably, the touch screen may enlarge a touch area in which the input unit is located by a predetermined size, and reduce the remaining area by a predetermined size.

Preferably, the touch screen is selected from any one of at least one notation type assigned to a touch region in which the input means is located, and the processor unit determines whether the input means is located at a position higher than the set height It is confirmed that the set time has elapsed in the state where the input means is not detected, and the selected notation type can be inputted.

Preferably, the processor unit senses a first gesture of the input means, and when the touch screen determines that the sensed first gesture is the same as the set gesture, The notation type of the order of the at least one same notation type can be selected.

Preferably, the processor unit senses a second gesture of the input means, and when it is determined that the sensed second gesture is the same as the set gesture, It can be converted to the notation type.

Preferably, the notation type may include at least one of numbers, letters, and symbols.

According to the electronic device and method for detecting the input gesture of the present invention and inputting the selected symbol, there is an effect that a user can input desired input through a one-touch input connection operation in a smart device or virtual space that can not recognize the keyboard .

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram for generally explaining an electronic device for inputting a selected symbol by sensing an input gesture according to the present invention; FIG.
FIG. 2 is a diagram illustrating an example of inputting a notation type selected from input means according to the present invention. FIG.
FIG. 3 illustrates an embodiment of acoustically feeding back a selected specific function to a user according to the present invention. FIG.
4 is a view illustrating an embodiment of analyzing a gesture of an input means according to the present invention and inputting a notation type selected from the input means.
FIG. 5 illustrates an embodiment of analyzing a gesture of an input means according to the present invention and inputting a notation type selected from the input means; FIG.
FIG. 6 illustrates an embodiment of detecting a second gesture according to the present invention to select another type of notation. FIG.
7 illustrates one embodiment of transmitting a tactile signal to an input means according to the present invention.
FIG. 8 is a flowchart illustrating an operation procedure for inputting a selected notation type by sensing a first gesture from an input means according to an embodiment of the present invention; FIG.
9 is a flowchart illustrating an operation procedure of inputting a selected notation type by sensing a second gesture from an input means according to an embodiment of the present invention.
10 is a block diagram showing a configuration of an electronic device according to an embodiment of the present invention;

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order that those skilled in the art can easily carry out the present invention. In the following detailed description of the preferred embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In the drawings, like reference numerals are used throughout the drawings.

FIG. 1 is a diagram for explaining an electronic device for inputting a selected symbol by sensing an input gesture according to the present invention. Referring to FIG. First, the electronic device of the present invention can sense the spatial touch input of the input means. More specifically, when an electronic device is input with an arbitrary height from the touch area to the input means at a set height, the electronic device can sense the spatial touch input of the input means located below the set arbitrary height. Here, the electronic device can detect that the input means is located at a predetermined height or lower by a sensor input device such as a camera, a piezoelectric sensor, and an infrared sensor provided in the electronic device. For example, when the electronic device is input with a height of h at a set height, the electronic device determines that the input means is located at a height of h or less from the touch region, such as a camera, a piezoelectric sensor, Device. That is, the user can place the input means at a predetermined height or less even when the input means is not touched to the touch region, and the user can perform the spatial touch input. Of course, the electronic device may use a touch pad to sense that the input means has been touched to the touch region.

In addition, the electronic device of the present invention can display a mark type selected from at least one notation type assigned to a touch area including the input means on the touch screen 101. [ First, the touch area of the electronic device is divided into a plurality of areas for receiving letters, numbers, symbols, and the like, and at least one notation type is assigned to each touch area. Here, the notation type can be defined as including at least one of numbers, letters, and symbols. That is, the electronic device can display the selected notation type among at least one notation type allocated to the touch area including the input means among the touch areas partitioned into a plurality of areas on the touch screen 101. [

Further, the electronic device of the present invention can output information about the selected notation type as sound. More specifically, the electronic device can acoustically output information on the selected notation type among a plurality of notation types allocated to the touch area including the input means, through the speaker 102. [ For example, if the electronic device receives an alphabet letter K, the electronic device outputs a sound of "alphabet C" to allow the user to audibly verify information about the notation type entered by the user. Accordingly, when the electronic device of the present invention is used by the blind, sight-impaired, and the elderly, it is possible to receive audible feedback on the notation type without visually confirming the notation type inputted by the user. In addition, the present invention can be effectively used even when a general user who has no problem in visual acuity can not visually confirm a character to be transmitted or a number to be called, such as when a character must be transmitted while driving or when an urgent call is needed.

Further, the electronic device according to the present invention can transmit a tactile sense signal to the input means whenever it is confirmed that the input means has moved between the respective touch regions partitioned into the plurality of regions. More specifically, the electronic device can feed back the tactile signal to the input means whenever the input means moves between the respective touch regions. For example, when a user moves from one area of the touch area divided into a plurality of areas to another touch area, a tactile signal such as vibration or the like can be fed back from the electronic device. That is, the user has the advantage of being able to confirm that he / she has moved from one touch area to another touch area among a plurality of touch areas by visual, auditory, and tactile sense.

In addition, the electronic device according to the present invention can analyze the gesture of the input means and select any one of the at least one notation types assigned to the touch region in which the input means is located. First, when the electronic device senses the first gesture of the input means and determines that the first gesture is the same as the set gesture, the electronic device receives the notation type of at least one of the same kind of notation types allocated to the touch region according to the set order . Here, the first gesture may be defined as a gesture of an input means for selecting a notation type of at least one of the same type notation types assigned to the touch region according to the set order. For example, if the electronic device confirms that the input means is located in the touch area including the alphabetic characters "J, K, L ", the first letter" J " Then, if the electronic device senses the first gesture set by the input means, the user selects an alphabetical letter "K " In the same sense, if the electronic device again detects the first gesture set by the input means, the user selects the letter "L" which is set to the next order among the English alphabet letters of the same type. That is, the user can change at least one of the same type of notation by taking the set first gesture. In the above example, the user takes the first gesture set in a state in which the input means is positioned in the touch area including the alphabetic characters "J, K, L" You can choose English characters. That is, if an alphabetical letter "J" is selected in the electronic device, the user can take the set first gesture once and select the alphabet letter "K ", or take the set first gesture twice and select the alphabet letter" L ".

Also, the electronic device senses the second gesture of the input means, and if it is determined that the second gesture is the same as the set gesture, the electronic device can change from the currently selected notation type to another notation type . Here, the second gesture may be defined as a gesture to be converted from the current notation type to another notation type according to the set order. For example, if the electronic device confirms that the input means is located in the touch area including the numeral "5 ", the Korean consonant" b ", and the alphabetic characters "J, K, L" Any one notation type is selected according to the set order. If the electronic device is set in numeric, Korean consonant, and alphabetical order, the input means is located in the touch area including the numeral "5 ", the Korean consonant" b ", and the alphabetic characters "J, K, If confirmed, the electronic device is selected with the first digit "5 ". Thereafter, if the electronic device detects the second gesture set by the input means, the Korean character consonant of "b" In the same sense, if the electronic device detects the second gesture set again from the input means, it selects an alphabet letter "J" which is an alphabetical notation type set to the next order. That is, the user can change the type of the notation type assigned to the same touch area by taking the set second gesture. In the above example, the user takes the set second gesture while placing the input means in the touch area including the numeral "5 ", the consonant" 5 "to the Korean consonant" ㄴ ".

In addition, the electronic device of the present invention can enlarge (103) the touch area where the input means is located by a predetermined size, and reduce the remaining area by a predetermined size. More specifically, if it is confirmed that the position of the input means is included in one of the touch areas divided into the plurality of areas, the electronic device enlarges the touch area in which the current input means is located by a predetermined size, The touch area can be reduced in size and displayed. Accordingly, the user can conveniently input the first gesture or the second gesture in the touch area where the current input means is located.

2 is a diagram illustrating an embodiment of inputting a notation type selected from the input means according to the present invention. FIG. 2 (a) is a diagram illustrating an example of selecting a notation type from the input means according to the present invention. First, the electronic device can sense the input means only when the input means is located at a position below the set height h. More specifically, the electronic device can select the notation type of the touch region where the input means is located only when the input means is located at a position below the set height (h). If the electronic device detects that the input means is located at a position below the set height h, the electronic device determines that the position of the input means is included in one of the touch regions divided into a plurality of regions Check. That is, the electronic device according to the present invention is advantageous in that if the input means is located below the set height (h), it can detect a spatial touch input as well as a direct touch. Here, the electronic device can sense the spatial touch input by the sensor input device such as the camera, the piezoelectric sensor, and the infrared sensor provided in the electronic device that the input means is located below the predetermined height. For example, when the electronic device is input with a height of h, at a set height, the electronic device determines that the input means is located at a height of h or less from the touch region by at least one of a camera, a piezoelectric sensor, and an infrared sensor Can be detected. Of course, the electronic device may sense that the input means directly touches the touch region using the touch pad. That is, the fact that the input means is directly touch input to the electronic device means that 0 is input as the set height h.

As described above, if the electronic device detects that the input means is located below the set height h, at least one notation type assigned to the touch region in which the input means is located is selected among the touch regions of the electronic device. For example, when the touch area in which the input means is located among the plurality of touch areas of the electronic device includes numeral "4 ", alphabet letters" G, H, I ", and Korean consonants " Thus, one of the notation types is selected. Assuming that the order of the notation type set in the electronic device is the number "4", the alphabet letters "G, H, I" and the Korean consonant "a, b", the electronic device selects the number "4". Thereafter, when the input means moves, the electronic device selects another notation type assigned to the touch area where the current input means is located. That is, the user moves the input means to the touch area where the notation type to be selected is located in a state where the input means is located below the set height (h).

FIG. 2B is a diagram illustrating an example of inputting the selected notation type according to the present invention. As shown in FIG. 2 (b), if the electronic device is determined to be located at a position higher than the set height h at a position below the set height h, the electronic device inputs the selected notation type. More specifically, if the electronic device confirms that any one of the notation types assigned to the touch area in which the input means is located is selected and the input means is located at a position higher than the set height, After confirming that the set time has elapsed without being detected, input the selected notation type. For example, let us assume that the notation type selected by the electronic device from the input means is alphabet "L", the set height is h, and the set time is 1 second.

In the above-mentioned assumption, if the electronic device is located at a position higher than the set height h and the input means is located and it is confirmed that the input means is not detected, the electronic device judges whether a set time of 1 second has elapsed. If it is determined that the set time of one second elapsed in the electronic device, the electronic device inputs the selected alphabet letter "L ". That is, when the user desires to input the notation type selected by using the input means, the user may place the input means at a position higher than the set height h for a predetermined time or more. Here, the reason why the selected notation type is inputted only when the elapsed time has elapsed from the electronic device is that the input means is located at a position higher than the set height h, which is not intended by the user, . For example, when the user unintentionally positions the input means at a position higher than the set height h after the user selects an arbitrary notation type, the user places the input means at a position below the set height h It is possible to prevent a case where a wrong input is made. In other words, if the user inputs an electronic device, the set time is set high to prevent malfunction. If the user is skilled in the operation of inputting the electronic device, .

FIG. 3 is a diagram illustrating an example of acoustically feeding back a selected specific function to a user according to the present invention. FIG. 3 (a) is a diagram illustrating an example of feedback of a selected call function to a user acoustically according to the present invention. As shown in FIG. 3 (a), the electronic device can display various functions in the touch area by the user's selection. More specifically, the electronic device can display icons in the touch area that can directly execute various functions provided in the electronic device. For example, a call icon, a message icon, a phonebook icon, a menu icon, and the like can be displayed in the touch area. Thereafter, when the electronic device senses that the input means is located below the set height (h), it can output information about the icon on which the input means is located among the plurality of icons displayed in the touch region. As in the embodiment shown in FIG. 3 (a), if the input means among the plurality of icons displayed in the touch area is located in the icon of the call function, the electronic device can display the corresponding icon Can be outputted as sound. That is, since the electronic device according to the present invention feeds information on the selected function to the user through the sound, it can be used by the general public. However, it is advantageous for the blind, visually impaired, and elderly people to use it conveniently.

FIG. 3 (b) is a diagram illustrating an example in which the selected character input function according to the present invention is fed back to the user acoustically. As shown in FIG. 3 (b), the electronic device can display various functions in the touch area by the user's selection. More specifically, the electronic device can display icons in the touch area that can directly execute various functions provided in the electronic device. For example, a call icon, a message icon, a phone book icon, a menu icon, and the like can be displayed in the touch area. Thereafter, when the electronic device senses that the input means is located below the set height (h), it can output information about the icon on which the input means is located among the plurality of icons displayed in the touch region. As in the embodiment shown in FIG. 3 (b), if the input means among the plurality of icons displayed in the touch area is located in the icon of the character input function, the electronic device is a "character input function" Information about the icon can be outputted as sound. That is, since the electronic device according to the present invention feeds information on the selected function to the user through the sound, it can be used by the general public. However, it is advantageous for the blind, visually impaired, and elderly people to use it conveniently.

4 is a diagram illustrating an example of inputting a notation type selected from an input means by analyzing a gesture of an input means according to the present invention. FIG. 4A is a diagram illustrating an example of detecting that the input means is located at a position below a set height according to the present invention. First, the electronic device can sense the input means only when the input means is located at a position below the set height h. More specifically, the electronic device can select the notation type of the touch region in which the input means is located only when the input means is located at a position below the set height (h). That is, the electronic device according to the present invention is advantageous in that if the input means is located below the set height (h), it can detect a spatial touch input as well as a direct touch. Here, the electronic device can sense the spatial touch input by the sensor input device such as the camera, the piezoelectric sensor, and the infrared sensor provided in the electronic device that the input means is located below the predetermined height. For example, when the electronic device is input with a height of h, at a set height, the electronic device determines that the input means is located at a height of h or less from the touch region by at least one of a camera, a piezoelectric sensor, and an infrared sensor Can be detected. Of course, the electronic device may sense that the input means directly touches the touch region using the touch pad. That is, the fact that the input means is directly touch input to the electronic device means that 0 is input as the set height h.

4 (b) is a diagram illustrating an embodiment of analyzing the position of the input means according to the present invention and selecting a desired notation type. If the electronic device detects that the input device is located at a position below the predetermined height as shown in FIG. 4 (b), the electronic device displays the touch area in which the input device is located among the plurality of touch areas At least one notation type assigned thereto is selected. Hereinafter, an embodiment will be described in which the representation type is selected by analyzing the position of the input means, assuming that the order of selecting the notation type in the electronic device is set in the order of English alphabet, number, and Korean consonant. As shown in FIG. 4B, the electronic device enlarges the touch area selected from the input means by a predetermined size, and displays the selected non-selected touch area while reducing the touch area by a set size. That is, since the electronic device enlarges and displays the touch area selected from the input means by a predetermined size, the user can conveniently take an arbitrary gesture or the like in the selected touch area. Then, after confirming that the order set in the touch area in which the input means is located is set in the order of English alphabet, number and Korean consonant, the electronic device selects "M" as the first alphabet selected by the input means. If the order set in the touch area where the input means is located in the electronic device is set in the order of numeric, alphabetic and Korean consonants, the number "6" is of course selected. In the same sense, if the order set in the touch area in which the input means is located in the electronic device is set in the order of Korean consonants, numbers, and alphabetic characters, it is needless to say that the first letter "c" is selected.

In addition, the electronic device can output information about the selected notation type as sound. As shown in FIG. 4 (b), the electronic device outputs audio information about the notation type selected from the input means to audibly feedback the selected noticing time to the user. For example, the electronic device outputs a sound such as "English letter M " indicating that the English letter" M "has been selected from the input means so that the user can visually confirm the notation type selected by the user. Accordingly, the electronic device has the advantage of outputting information about the notation type selected from the input means to the audible sound, so that the user such as the blind, the sight blind, and the elderly can check it by the auditory sense.

In addition, the electronic device can display the information about the notation type selected from the input means so that the user can visually confirm the information, and can transmit the tactile signal to the input means every time the input means moves between the plurality of touch regions . Therefore, even if the user does not input the notation type while visually checking the touch area of the electronic device, the tactile signal can be received every time the user moves between the plurality of touch areas, It is advantageous to receive feedback.

FIG. 4 (c) is a diagram illustrating an embodiment in which a gesture of the input means according to the present invention is analyzed to select an arbitrary notation type. As shown in FIG. 4 (c), the electronic device senses the first gesture of the input means, and when it is determined that the sensed first gesture is the same as the set gesture, The notation type of the next highest order among the same type of notation of the same type is selected. For example, let us suppose that the touch area where the input means is located among the plurality of touch areas of the electronic device includes the number "6", alphabet letters "M, N, O" and the Korean consonants " . In addition, suppose that the order set in the electronic device is set in the order of alphabets, numbers, and Korean consonants, and that the order in which alphabetic characters are selected can be selected in the order of "M, N, O". In the above-described assumption, when the electronic device receives the first gesture as the input means, the electronic device judges whether the first gesture inputted is the same as the set gesture. Here, the first gesture may be defined as a gesture of an input means for selecting a notation type of at least one of the same type notation types assigned to the touch region according to the set order. For example, the user can set the first gesture to draw a circle clockwise. In the above-described assumption, the electronic device selects an English letter "M" among at least one notation type assigned to the touch area where the input means is located. 4 (c), if the electronic device senses the first gesture set by the input means, it selects an alphabetical character of "N" set to the order of alphabet letters of the same notation type. In the same sense, if the electronic device detects again the first gesture set from the input means, it selects the letter "O" which is set to the next order among the alphabet letters of the same type of notation. That is, the user can change at least one of the same type of notation by taking the set first gesture.

In addition, the electronic device can output information about the selected notation type as sound. As shown in (c) of FIG. 4, the electronic device outputs audio information about the notation type selected from the input means, and audibly feeds back the selected noticing time to the user. For example, the electronic device outputs a sound such as "English alphabet" indicating that the English letter "N" is selected from the input means so that the user can visually confirm the notation type selected by the user. Accordingly, the electronic device has the advantage of outputting information about the notation type selected from the input means to the audible sound, so that the user such as the blind, the sight blind, and the elderly can check it by the auditory sense.

FIG. 4 (d) illustrates an example of inputting the selected notation type by sensing the position of the input means according to the present invention. As shown in FIG. 4 (d), when the electronic device is determined to be located at a position higher than the set height h at a position below the set height h, the electronic device inputs the selected notation type. More specifically, if the electronic device confirms that any one of the notation types assigned to the touch area in which the input means is located is selected and the input means is located at a position higher than the set height, After confirming that the set time has elapsed without being detected, input the selected notation type. For example, suppose that the notation type selected by the electronic device from the input means is alphabetical "N", the set height is h, and the set time is 0.5 second.

In the above-described assumption, if the electronic device has found that the input means is located at a position higher than the set height h and the input means is not detected, the electronic device determines whether the set time, 0.5 seconds, has elapsed. If it is determined that the set time of 0.5 seconds has elapsed in the electronic device, the electronic device inputs the selected alphabet letter "N ". That is, when the user desires to input the notation type selected by using the input means, the user may place the input means at a position higher than the set height h for a predetermined time or more. Here, the reason why the selected notation type is inputted only when the elapsed time has elapsed from the electronic device is that the input means is located at a position higher than the set height h, which is not intended by the user, . For example, when the user unintentionally positions the input means at a position higher than the set height h after the user selects an arbitrary notation type, the user places the input means at a position below the set height h It is possible to prevent a case where a wrong input is made. In other words, if the user inputs an electronic device, the set time is set high to prevent malfunction. If the user is skilled in the operation of inputting the electronic device, .

5 is a diagram illustrating an embodiment of analyzing a gesture of an input means according to the present invention and inputting a notation type selected from the input means. FIG. 5 (a) is a diagram illustrating an example of detecting that the input means is located at a position below a set height according to the present invention. First, the electronic device can sense the input means only when the input means is located at a position below the set height. More specifically, the electronic device can select the notation type of the touch region where the input means is located only when the input means is located at a position below the set height. Here, the electronic device can sense the spatial touch input by the sensor input device such as the camera, the piezoelectric sensor, and the infrared sensor provided in the electronic device that the input means is located below the predetermined height. For example, when the electronic device is input with a height of h, at a set height, the electronic device determines that the input means is located at a height of h or less from the touch region by at least one of a camera, a piezoelectric sensor, and an infrared sensor Can be detected. Of course, the electronic device may sense that the input means directly touches the touch region using the touch pad. That is, the fact that the input means is directly touch input to the electronic device means that 0 is input as the set height h. In FIG. 5 (a), the height set in the electronic device is input as 0, and the electronic device can receive the touch input only when the input means directly inputs the input.

FIG. 5B is a view illustrating an embodiment of analyzing the position of the input means according to the present invention to select an arbitrary notation type. If the electronic device detects that the input device is located at a position below the set height as shown in FIG. 5 (b), the electronic device displays the touch area in which the input means is located among the plurality of touch areas At least one notation type assigned thereto is selected. Hereinafter, an embodiment will be described in which it is assumed that the order in which the notation type is selected in the electronic device is set in the order of Korean consonant, alphabet, and number, and the notation type is selected by analyzing the position of the input means. As shown in FIG. 5B, the electronic device enlarges the touch area selected from the input means by a predetermined size, and displays the selected non-selected touch area while reducing the touch area by a set size. That is, since the electronic device enlarges and displays the touch area selected from the input means by a predetermined size, the user can conveniently take an arbitrary gesture or the like in the selected touch area. Then, after confirming that the order set in the touch area in which the input means is located is set in the order of Hangul consonant, English alphabet and number, the electronic device selects the first one of the Korean consonants selected by the input means. It is a matter of course that the number "9" is selected if the order set in the touch area where the input means is located in the electronic device is set in the order of numeric, alphabetic and Korean consonants. In the same sense, if the order set in the touch area where the input means is located in the electronic device is set in the order of alphabetic characters, Korean consonants, and numbers, it is a matter of course to select "W" as the first alphabetic character.

In addition, the electronic device can output information about the selected notation type as sound. As shown in (b) of FIG. 5, the electronic device outputs audio information about the notation type selected from the input means, and audibly feedbacks the notation time selected by the user. For example, the electronic device outputs a sound such as "Korean consonant note" that the Korean consonant "X" is selected from the input means so that the user can visually confirm the notation type selected by the user. Accordingly, the electronic device has the advantage of outputting information about the notation type selected from the input means to the audible sound, so that the user such as the blind, the sight blind, and the elderly can check it by the auditory sense.

In addition, the electronic device can display the information about the notation type selected from the input means so that the user can visually confirm the information, and can transmit the tactile signal to the input means every time the input means moves between the plurality of touch regions . Therefore, even if the user does not input the notation type while visually checking the touch area of the electronic device, the tactile signal can be received every time the user moves between the plurality of touch areas, It is advantageous to receive feedback.

FIG. 5C is a view illustrating an embodiment of analyzing a gesture of the input means according to the present invention to select an arbitrary notation type. 5 (c), the electronic device senses the first gesture of the input means, and when it is determined that the sensed first gesture is the same as the set gesture, the electronic device recognizes at least one The notation type of the next highest order among the same type of notation of the same type is selected. For example, let us suppose that a touch area in which the input means is located among a plurality of touch areas of the electronic device includes a numeral "9", alphabetic characters "W, X, Y" and a Korean consonant " . Also, suppose that the order set in the electronic device is set in the order of Korean consonant, English alphabet, and number, and that the order in which the Korean consonants are selected can be selected in the order of "Yi, Ji". In the above-described assumption, when the electronic device receives the first gesture as the input means, the electronic device judges whether the first gesture inputted is the same as the set gesture. Here, the first gesture may be defined as a gesture of an input means for selecting a notation type of at least one of the same type notation types assigned to the touch region according to the set order. For example, the user can set the first gesture to draw a circle clockwise. In the above-described assumption, the electronic device selects the Korean consonant "X" among at least one notation type assigned to the touch area in which the input means is located. 5 (c), if the electronic device senses the first gesture set by the input means, the Korean character consonant of "d" set to the order of the Korean consonants of the same type of notation type is selected. That is, the user can change at least one of the same type of notation by taking the set first gesture.

In addition, the electronic device can output information about the selected notation type as sound. As shown in (c) of FIG. 5, the electronic device outputs audio information about the notation type selected from the input means, and audibly feedbacks the display time selected by the user. For example, the electronic device outputs a sound such as "Hangul consonant key" indicating that the Korean consonant "?" Is selected from the input means so that the user can visually confirm the notation type selected by the user. Accordingly, the electronic device has the advantage of outputting information about the notation type selected from the input means to the audible sound, so that the user such as the blind, the sight blind, and the elderly can check it by the auditory sense.

FIG. 5D is a diagram illustrating an example of inputting the selected notation type by sensing the position of the input means according to the present invention. As shown in FIG. 5 (d), when the electronic device determines that the input means is located at a position lower than a set height, the electronic device inputs the selected notation type. More specifically, if the electronic device confirms that any one of the notation types assigned to the touch area in which the input means is located is selected and the input means is located at a position higher than the set height, After confirming that the set time has elapsed without being detected, input the selected notation type. For example, suppose that the notation type selected by the electronic device from the input means is a Korean consonant "J ", the set height is 0, and the set time is 0.3 seconds.

In the above-mentioned assumption, if the electronic device has found that the input means is located at a position higher than the set height of 0 and the input means is not detected, the electronic device determines whether the set time of 0.3 seconds has elapsed. If it is determined that 0.3 seconds, which is the set time of the electronic device, has elapsed, the electronic device inputs the selected Korean consonant " That is, when the user desires to input the selected notation type by using the input means, the user may place the input means at a position higher than the set height for a predetermined time or longer. Here, the reason why the selected notation type is inputted only when the elapsed time has elapsed from the electronic device is to prevent the case where the input means is located at a position higher than the height that is not intended by the user and the selected notation type is wrongly inputted to be. For example, when the user unintentionally positions the input means at a position higher than the set height after the user selects an arbitrary notation type, the user places the input means at a position below the set height and prevents the input means from being erroneously input can do. In other words, if the user inputs an electronic device, the set time is set high to prevent malfunction. If the user is skilled in the operation of inputting the electronic device, .

6 is a view showing an embodiment of detecting a second gesture according to the present invention and selecting another type of notation. 6A is a diagram illustrating an embodiment of analyzing a position of an input means according to the present invention to select an arbitrary notation type. If the electronic device detects that the input means is located at a position below the set height as shown in FIG. 6 (b), the electronic device displays the touch region in which the input means is located among the plurality of touch regions At least one notation type assigned thereto is selected. Hereinafter, an embodiment will be described in which the representation type is selected by analyzing the position of the input means on the assumption that the order of selecting the notation type in the electronic device is set in the order of numeric, Korean consonant, and English alphabet. As shown in FIG. 6A, the electronic device enlarges the touch area selected from the input means by a predetermined size, and displays the selected non-selected touch area while reducing the touch area by a set size. That is, since the electronic device enlarges and displays the touch area selected from the input means by a predetermined size, the user can conveniently take an arbitrary gesture or the like in the selected touch area. Thereafter, the electronic device selects the number "6" selected by the input means after confirming that the order set in the touch area where the input means is located is set in the order of numeric, Korean consonant and English alphabet. If the order set in the touch area in which the input means is located in the electronic device is set in the order of alphabetic characters, numerals, and Korean consonants, it is needless to say that the alphabet letter "J " In the same sense, if the order set in the touch area in which the input means is located in the electronic device is set in the order of Hangul consonant, English alphabet, and number, it is needless to say that the first of the Hangul consonants is selected as "b".

In addition, the electronic device can output information about the selected notation type as sound. As shown in FIG. 6 (a), the electronic device outputs audio information about the notation type selected from the input means to audibly feedback the selected noticing time to the user. For example, the electronic device outputs to the user an indication that the number "5" has been selected from the input means, such as "numeral o" Accordingly, the electronic device has the advantage of outputting information about the notation type selected from the input means to the audible sound, so that the user such as the blind, the sight blind, and the elderly can check it by the auditory sense.

FIG. 6 (b) is a view illustrating an embodiment of detecting a second gesture according to the present invention and selecting a notation type. 6B, the electronic device senses the second gesture of the input means. If it is determined that the sensed second gesture is the same as the set gesture, the electronic device displays the currently selected notation type To another type of notation type. For example, let us suppose that a touch area in which the input means is located among the plurality of touch areas of the electronic device includes the number "5", alphabetic characters "J, K, L" and the Korean consonant " . Also, suppose that the order set in the electronic device is set in the order of numbers, Korean consonants, and English letters, and that the order in which the Korean consonants are selected can be selected in the order of "b, d". In the above-described assumption, when the electronic device receives the second gesture as the input means, the electronic device judges whether the inputted second gesture is the same as the set gesture. Here, the second gesture may be defined as a gesture of the input means for converting from the currently selected notation type to the notation type of another kind according to the set order. For example, the user can set the second gesture to draw a circle in a counterclockwise direction. In the above-described assumption, the electronic device is selected by the number "5" among the at least one notation type assigned to the touch area where the input means is located. 6 (b), if the electronic device senses the second gesture set by the input means, it selects a different consonant type of consonant "b" That is, the user can take the set second gesture and change it to another notation type.

In addition, the electronic device can output information about the selected notation type as sound. As shown in FIG. 6 (b), the electronic device outputs audio information about the notation type selected from the input means to audibly feedback the selected noticing time to the user. For example, the electronic device outputs a sound such as "Hangul consonant sounds" that the Korean consonant "b" has been selected from the input means so that the user can visually confirm the notation type selected by the user. Accordingly, the electronic device has the advantage of outputting information about the notation type selected from the input means to the audible sound, so that the user such as the blind, the sight blind, and the elderly can check it by the auditory sense.

7 is a diagram illustrating an embodiment for transmitting a tactile signal to an input unit according to the present invention. FIG. 7A is a view showing an embodiment of transmitting a tactile signal to an input means located in a touch region according to the present invention. As shown in Fig. 7 (a), when the electronic device of the present invention determines that the input means is located below the set height h from the touch region, the electronic device can transmit the tactile signal to the input means. More specifically, when it is determined that the input means is located in the touch region (d), the electronic device can transmit a tactile signal such as vibration to the input means. For example, if it is determined in the electronic device that the input means is located in the touch region (d), the electronic device can feedback to the input means via the tactile signal that the input means is located within the current touch region. That is, the electronic device transmits a tactile sense signal to the input means whenever it is confirmed that the input means has moved between the respective touch regions partitioned into the plurality of regions, thereby providing feedback to a user with poor eyesight such as a blind person .

FIG. 7 (b) illustrates an embodiment of transmitting a tactile signal to an input means located outside the touch region according to the present invention. As shown in FIG. 7 (b), the electronic device can transmit the tactile signal to the input means when the input means is out of the touch region (d). More particularly, the electronic device has the advantage that it can give tactile feedback, such as vibration, to the input means when the input means is located within the touch region (d) as well as when leaving the touch region. For example, when a user with a poor visual acuity moves the input device out of the touch area, the electronic device transmits a tactile signal such as vibration to the input device so that the user visually confirms it directly, It can be confirmed that it is out of the area. Accordingly, the user can receive feedback from the touch region of any one of the plurality of touch regions to the touch region of the other one or from the touch region.

8 is a flowchart illustrating an operation of inputting a selected notation type by sensing a first gesture from an input unit according to an embodiment of the present invention. As shown in FIG. 8, the electronic device determines whether the input means is detected at a position below the set height from the touch area (801). More specifically, the electronic device is able to sense the spatial touch input of the input means located below the set arbitrary height when the electronic device is inputted with a certain height from the touch region to the input means at the set height. That is, the electronic device can receive the touch input only when the input means is detected at a position below the set height. Here, the electronic device can detect that the input means is located at a set height or lower by at least one of a camera, a piezoelectric sensor, and an infrared sensor provided in the electronic device. For example, when the electronic device is input with a height of h, at a set height, the electronic device determines that the input means is located at a height of h or less from the touch region by at least one of a camera, a piezoelectric sensor, and an infrared sensor Can be detected. That is, the user can place the input means at a predetermined height or less even when the input means is not touched to the touch region, and the user can perform the spatial touch input. Of course, the electronic device may detect that the input means is touch-input to the touch region using the touch pad.

If the electronic device determines that the input means is detected at a position less than the set height from the touch area, the electronic device enlarges the touch area where the input means is located by a predetermined size, and displays the reduced area by reducing the remaining area 803). More specifically, if it is confirmed that the position of the input means is included in one of the touch areas divided into the plurality of areas, the electronic device enlarges the touch area in which the current input means is located by a predetermined size, The touch area can be reduced in size and displayed. Therefore, the user can input the first gesture or the second gesture more conveniently in the touch region where the current input means is located.

Thereafter, the electronic device selects one of at least one notation type assigned to the touch area in which the input means is located (805). For example, when the touch area in which the input means is located among the plurality of touch areas of the electronic device includes numeral "4 ", alphabet letters" G, H, I ", and Korean consonants " Thus, one of the notation types is selected. Assuming that the order of the notation type set in the electronic device is the number "4", the alphabet letters "G, H, I" and the Korean consonant "a, b", the electronic device selects the number "4".

The electronic device selected at least one of the notation types assigned to the touch region in which the input means is located determines whether the first gesture of the sensed input means is the same as the set gesture (807). Here, the first gesture may be defined as a gesture of an input means for selecting a notation type of at least one of the same type notation types assigned to the touch region according to the set order. For example, if the first gesture in an electronic device is set to draw a circle in a clockwise direction, the electronic device determines whether a first gesture in which the input means draws a circle in a clockwise direction is sensed.

If it is determined that the first gesture of the input means sensed by the electronic device is the same as the set gesture, the electronic device selects the same notation type among at least one notation type assigned to the touch region according to the set order (809) . For example, if the electronic device confirms that the input means is located in the touch area including the alphabetic characters "J, K, L ", the first letter" J " Then, if the electronic device senses the first gesture set by the input means, the user selects an alphabetical letter "K " In the same sense, if the electronic device again detects the first gesture set by the input means, the user selects the letter "L" which is set to the next order among the English alphabet letters of the same type. That is, the user can change at least one of the same type of notation by taking the set first gesture. In the above example, the user takes the first gesture set in a state in which the input means is positioned in the touch area including the alphabetic characters "J, K, L" You can choose English characters. That is, if an alphabetical letter "J" is selected in the electronic device, the user can take the set first gesture once and select the alphabet letter "K ", or take the set first gesture twice and select the alphabet letter" L ".

Thereafter, the electronic device determines whether the set time has elapsed in a state in which the input means is located at a position higher than the set height (811). More specifically, if the electronic device confirms that any one of the notation types assigned to the touch area in which the input means is located is selected and the input means is located at a position higher than the set height, It is determined whether the set time has elapsed in the non-sensed state. For example, let us assume that the notation type selected by the electronic device from the input means is alphabet "L", the set height is h, and the set time is 1 second. In the above-mentioned assumption, if the electronic device is located at a position higher than the set height h and the input means is located and it is confirmed that the input means is not detected, the electronic device judges whether a set time of 1 second has elapsed.

If it is determined in the electronic device that the input means is located at a position higher than the predetermined height and the set time has not elapsed, the electronic device inputs the selected symbol (813). For example, let us assume that the notation type selected by the electronic device from the input means is alphabet "L", the set height is h, and the set time is 1 second. In the above-mentioned assumption, if the electronic device is located at a position higher than the set height h and the input means is located and it is confirmed that the input means is not detected, the electronic device judges whether a set time of 1 second has elapsed. If it is determined that the set time of one second elapsed in the electronic device, the electronic device inputs the selected alphabet letter "L ". That is, when the user desires to input the notation type selected by using the input means, the user may place the input means at a position higher than the set height h for a predetermined time or more. Here, the reason why the selected notation type is inputted only when the elapsed time has elapsed from the electronic device is that the input means is located at a position higher than the set height h, which is not intended by the user, . For example, when the user unintentionally positions the input means at a position higher than the set height h after the user selects an arbitrary notation type, the user places the input means at a position below the set height h It is possible to prevent a case where a wrong input is made. In other words, if the user inputs an electronic device, the set time is set high to prevent malfunction. If the user is skilled in the operation of inputting the electronic device, .

If it is determined in step 801 that the electronic device is not detected by the input device at a position less than the set height from the touch area, the electronic device does not detect the touch input from the input device, Of course. If it is determined in step 807 that the first gesture of the input means detected by the electronic device is not the same as the set gesture, the determination process 807 is repeated. Further, if it is determined that the set time has not elapsed in the state where the input means is located at a position higher than the set height in the electronic device, the electronic device repeats the above-described determination process (801).

9 is a flowchart illustrating an operation procedure of inputting a selected notation type by sensing a second gesture from an input means according to an embodiment of the present invention. As shown in FIG. 9, the electronic device determines whether the input means is detected at a position lower than the set height from the touch area (901). More specifically, the electronic device is able to sense the spatial touch input of the input means located below the set arbitrary height when the electronic device is inputted with a certain height from the touch region to the input means at the set height. That is, the electronic device can receive the touch input only when the input means is detected at a position below the set height. Here, the electronic device can detect that the input means is located at a set height or lower by at least one of a camera, a piezoelectric sensor, and an infrared sensor provided in the electronic device. For example, when the electronic device is input with a height of h at a set height, the electronic device determines that the input means is located at a height of h or less from the touch region, such as a camera, a piezoelectric sensor, Device. That is, the user can place the input means at a predetermined height or less even when the input means is not touched to the touch region, and the user can perform the spatial touch input. Of course, the electronic device may detect that the input means is touch-input to the touch region using the touch pad.

If the electronic device determines that the input means is detected at a position less than the set height from the touch area, the electronic device enlarges the touch area where the input means is located by a predetermined size, and displays the reduced area by reducing the remaining area 903). More specifically, if it is confirmed that the position of the input means is included in one of the touch areas divided into the plurality of areas, the electronic device enlarges the touch area in which the current input means is located by a predetermined size, The touch area can be reduced in size and displayed. Accordingly, the user can conveniently input the first gesture or the second gesture in the touch area where the current input means is located.

Then, the electronic device selects one of at least one notation type assigned to the touch region in which the input means is located (905). For example, when the touch area in which the input means is located among the plurality of touch areas of the electronic device includes numeral "5 ", alphabet letters" J, K, L ", and Korean consonant " Thus, one of the notation types is selected. Assuming that the order of the notation type set in the electronic device is the number "5", the letters "J, K, L" and the Korean consonant "b, d", the electronic device selects the number "5".

The electronic device selected in any one of the at least one notation type assigned to the touch region in which the input means is located determines whether the second gesture of the sensed input means is the same as the set gesture (907). Here, the second gesture may be defined as a gesture to be converted from the current notation type to another notation type according to the set order. For example, if the second gesture in the electronic device is set to draw a circle in a counterclockwise direction, the electronic device determines whether a second gesture in which the input means draws a circle in a counterclockwise direction is sensed.

If it is determined that the second gesture of the input means sensed by the electronic device is the same as the set gesture, the electronic device selects a different notation type among at least one notation type assigned to the touch region according to the set order ). For example, if the electronic device confirms that the input means is located in the touch area including the numeral "5 ", the Korean consonant" b ", and the alphabetic characters "J, K, L" Any one notation type is selected according to the set order. If the electronic device is set in numeric, Korean consonant, and alphabetical order, the input means is located in the touch area including the numeral "5 ", the Korean consonant" b ", and the alphabetic characters "J, K, If confirmed, the electronic device is selected with the first digit "5 ". Thereafter, if the electronic device detects the second gesture set by the input means, the Korean character consonant of "b" In the same sense, if the electronic device detects the second gesture set again from the input means, it selects the alphabet letter "L", which is an alphabetical notation type set to the next order. That is, the user can change the type of the notation type assigned to the same touch area by taking the set second gesture. In the above example, the user takes the set second gesture while placing the input means in the touch area including the numeral "5 ", the consonant" 5 "to the Korean consonant" ㄴ ".

After that, the electronic device judges whether the set time has passed since the input means is located at a position higher than the set height and is not detected (911). More specifically, if the electronic device confirms that any one of the notation types assigned to the touch area in which the input means is located is selected and the input means is located at a position higher than the set height, It is determined whether the set time has elapsed in the non-sensed state. For example, let us assume that the notation type selected by the electronic device from the input means is alphabet "L", the set height is h, and the set time is 1 second. In the above-mentioned assumption, if the electronic device is located at a position higher than the set height h and the input means is located and it is confirmed that the input means is not detected, the electronic device judges whether a set time of 1 second has elapsed.

If it is determined in the electronic device that the input means is located at a position higher than the set height and the set time has not elapsed, the electronic device inputs the selected symbol (913). For example, let us assume that the notation type selected by the electronic device from the input means is alphabet "L", the set height is h, and the set time is 1 second. In the above-mentioned assumption, if the electronic device is located at a position higher than the set height h and the input means is located and it is confirmed that the input means is not detected, the electronic device judges whether a set time of 1 second has elapsed. If it is determined that the set time of one second elapsed in the electronic device, the electronic device inputs the selected alphabet letter "L ". That is, when the user desires to input the notation type selected by using the input means, the user may place the input means at a position higher than the set height h for a predetermined time or more. Here, the reason why the selected notation type is inputted only when the elapsed time has elapsed from the electronic device is that the input means is located at a position higher than the set height h, which is not intended by the user, . For example, when the user unintentionally positions the input means at a position higher than the set height h after the user selects an arbitrary notation type, the user places the input means at a position below the set height h It is possible to prevent a case where a wrong input is made. In other words, if the user inputs an electronic device, the set time is set high to prevent malfunction. If the user is skilled in the operation of inputting the electronic device, .

If it is determined in step 901 that the electronic device is not detected by the input unit at a position lower than the set height from the touch area, the electronic device does not detect the touch input from the input unit, Of course. If it is determined in step 907 that the second gesture of the input means detected by the electronic device is not the same as the set gesture, the determination process 907 is repeated. In addition, if it is determined that the set time has not elapsed in the state where the input means is located at a position higher than the set height in the electronic device, the electronic device repeats the above-described determination process (901).

10 is a block diagram showing the configuration of an electronic device according to an embodiment of the present invention. Such an electronic device 1000 may be a portable electronic device and may be a portable terminal, a mobile phone, a mobile pad, a media player, a tablet computer a tablet computer, a handheld computer, or a PDA (Personal Digital Assistant). It may also be any portable electronic device, including devices combining two or more of these devices.

This electronic device 1000 includes a memory 1010, a processor unit 1020, a first wireless communication subsystem 1030, a second wireless communication subsystem 1031, an external port 1060, A system 1050, a speaker 1051, a microphone 1052, an input and output (IO) system 1070, a touch screen 1080 and other input or control devices 1090. A plurality of memories 1010 and external ports 1060 may be used.

The processor unit 1020 may include a memory interface 1021, one or more processors 1022, and a peripheral interface 1023. In some cases, the entire processor unit 1020 may be referred to as a processor. In the present invention, the processor unit 1020 analyzes the gesture of the input means and inputs any one of at least one notation type assigned to the touch region in which the input means is located. In addition, the processor unit 1020 confirms that the input unit is not sensed at a position higher than the set height, confirms that the set time has passed in the state where the input unit is not sensed, and inputs the selected notation type . In addition, the processor unit 1020 senses the first gesture of the input means, detects the second gesture of the input means, and if it is determined that the sensed second gesture is the same as the set gesture, Converts from the notation type to another notation type.

The processor 1022 executes various software programs to perform various functions for the electronic device 1000 and also performs processing and control for voice communication and data communication. In addition to these conventional functions, the processor 1022 also executes a specific software module (instruction set) stored in the memory 1010 to perform various specific functions corresponding to the module. In other words, the processor 1022 performs the method of the embodiment of the present invention in conjunction with the software modules stored in the memory 1010.

Processor 1022 may include one or more data processors, image processors, or codecs (CODECs). The data processor, image processor, or codec may be configured separately. Also, it may be composed of a plurality of processors performing different functions. The peripheral device interface 1023 connects the input / output subsystem 1070 of the electronic device 1000 and various peripheral devices to the processor 1022 and the memory 1010 (via the memory interface).

The various components of electronic device 1000 may be coupled by one or more communication buses (reference numeral not shown) or stream lines (reference numeral not shown).

The external port 1060 is used to connect a portable electronic device (not shown) directly to another electronic device or indirectly to another electronic device via a network (e.g., Internet, intranet, wireless LAN, etc.). The external port 1060 refers to, for example, but not limited to, a USB (Universal Serial Bus) port or a FIREWIRE port.

The motion sensor 1091 and the first optical sensor 1092 may be coupled to the peripheral device interface 1023 to enable various functions. For example, a motion sensor 1091 and a light sensor 1092 may be coupled to the peripheral device interface 1023 to enable motion sensing of the electronic device and light sensing from the outside, respectively. In addition, other sensors, such as a position measurement system, a temperature sensor, or a biosensor, may be connected to the peripheral device interface 1023 to perform related functions. The movement sensor 1091 according to the present invention confirms that the input means is detected at a position less than a predetermined height from the touch region and the position of the input means is included in any one of the touch regions divided into the plurality of regions Yes. In addition, the motion sensor 1091 senses the height from the touch area to the input means.

The camera subsystem 1093 may perform camera functions such as photograph and video clip recording. The camera subsystem 1093 according to the present invention confirms that the input means is detected at a position less than a predetermined height from the touch region and the position of the input means is included in any one of the touch regions divided into the plurality of regions . In addition, the camera subsystem 1093 senses the height from the touch area to the input means.

The optical sensor 1092 may be a charged coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) device.

Communication functions are performed through one or more wireless communication subsystems 1030, 1031. The wireless communication subsystems 1030 and 1031 may include a radio frequency receiver and a transceiver and / or an optical (e.g., infrared) receiver and a transceiver. The first communication subsystem 1030 and the second communication subsystem 1031 can be distinguished according to the communication network with which the electronic device 1000 communicates. For example, the communication network may include, but is not limited to, a Global System for Mobile Communication (GSM) network, an Enhanced Data GSM Environment (EDGE) network, a Code Division Multiple Access (CDMA) network, a W- A communication subsystem designed to operate over a plurality of access networks, a long term evolution (LTE) network, an orthogonal frequency division multiple access (OFDMA) network, a wireless fidelity (Wi-Fi) network, a WiMax network, . However, since the present invention requires WiFi communication over a Wi-Fi (Wireless Fidelity) network, the first wireless communication subsystem 1030 and the second wireless communication subsystem 1031 are combined into one wireless communication subsystem You may.

An audio subsystem 1050 may be coupled to the speaker 1051 and the microphone 1052 to take charge of the input and output of audio streams such as speech recognition, voice reproduction, digital recording and telephone functions. That is, the audio subsystem 1050 communicates with the user via a speaker 1051 and a microphone 1052. The audio subsystem 1050 receives the data stream through the peripheral interface 1023 of the processor unit 1020 and converts the received data stream into an electrical stream. The converted electric signal is transmitted to the speaker 1051. The speaker 1051 converts the electric stream into a sound wave that can be heard by a person and outputs the sound wave. The microphone 1052 converts sound waves delivered from a person or other sound source into an electrical stream. Audio subsystem 1050 receives the converted electrical stream from microphone 1052. The audio subsystem 1050 converts the received electrical stream into an audio data stream and transmits the converted audio data stream to the peripheral interface 1023. The audio subsystem 1050 may include an attachable and detachable ear phone, a head phone, or a headset. The audio subsystem 1050 according to the present invention outputs information about the selected notation type among a plurality of notation types assigned to the touch area including the input means.

The input / output (I / O) subsystem 1070 may include a touch screen controller 1071 and / or other input controller 1072. The touch screen controller 1071 may be coupled to the touch screen 1080. The touch screen 1080 and the touch screen controller 1071 may include capacitive, resistive, infrared and surface acoustic wave techniques for determining one or more contact points with the touch screen 1080, as well as other Any multi-touch sensing technique, including a proximity sensor arrangement or other elements, may be used to detect contact and movement or interruptions thereof. Other input controllers 1072 may be coupled to other input / control devices 1090. Such as a pointer device such as one or more buttons, a rocker switch, a thumb-wheel, a dial, a stick, and / or a stylus on the other input /

The touch screen 1080 provides an input / output interface between the electronic device 1000 and the user. That is, the touch screen 1080 transmits the touch input of the user to the electronic device 1000. And is an intermediary for displaying the output from the electronic device 1000 to the user. That is, the touch screen 1080 shows a visual output to the user. This visual output appears in the form of text, graphics, video, and combinations thereof.

The touch screen 1080 may use various displays. (LED), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AMOLED), or an organic light emitting diode (LED), for example, a liquid crystal display (Flexible LED) can be used. In the present invention, the touch screen 1080 confirms that the input means is detected at a position below the set height from the touch area, and the position of the input means is included in any one of the touch areas divided into the plurality of areas Yes. Also, the touch screen 1080 senses the height from the touch area to the input means. Also, the touch screen 1080 displays the selected notation type among at least one notation type assigned to the touch area including the input means, and the input means moves between the respective touch areas partitioned into the plurality of areas The tactile signal is transmitted to the input means every time it is checked. In addition, the touch screen 1080 enlarges the touch area in which the input means is located by a predetermined size, reduces the remaining area by a predetermined size, and displays at least one of the at least one notation types assigned to the touch area in which the input means is located One is chosen. If it is determined that the first gesture detected is the same as the set gesture, the touch screen 1080 selects a notation type of at least one of the same notation types assigned to the touch region according to the set order. Here, a method in which the touch screen senses the height from the touch region to the input means is a known technique. For example, a touch screen of air can be detected by including a proximity sensor of air.

The memory 1010 may be coupled to the memory interface 1021. Memory 1010 may include high speed random access memory and / or nonvolatile memory such as one or more magnetic disk storage devices, one or more optical storage devices and / or flash memory (e.g., NAND, NOR).

The memory 1010 stores software. The software components include an operating system module 1011, a communication module 1012, a graphics module 1013, a user interface module 1014 and an MPEG module 1015, a camera module 1016, (1017), and the like. A module, which is a software component, can also be expressed as a set of instructions, so a module is sometimes referred to as an instruction set. Modules can also be expressed as programs. In the present invention, the memory 1010 automatically stores the second map tile image. Operating system software 1011 (for example, an embedded operating system such as WINDOWS, LINUX, Darwin, RTXC, UNIX, OS X, or VxWorks) includes various software that control general system operations ≪ / RTI > Control of such general system operations refers to, for example, memory management and control, storage hardware (device) control and management, power control and management, and the like. These operating system software also facilitates communication between various hardware (devices) and software components (modules).

The communication module 1012 may enable communication with other electronic devices, such as a computer, a server, and / or a portable terminal, via the wireless communication subsystem 1030, 1031 or the external port 1060.

The graphics module 1013 includes various software components for providing and displaying graphics on the touch screen 1080. The term graphics refers to text, a web page, an icon, a digital image, video, animation, and the like. In the present invention, the touch screen 1080 displays a message regarding whether or not the smart rotation function is set, and selects an arbitrary area included in the message.

The user interface module 1014 includes various software components related to the user interface. How the state of the user interface changes, and under what conditions the change of the user interface state occurs.

Codec (CODEC) module 1015 may include software components related to the encoding and decoding of video files. The codec module may include a video stream module, such as an MPEG module and / or an H204 module. In addition, the codec module may include a codec module for various audio files such as AAA, AMR, and WMA. In addition, the codec module 1015 includes a set of instructions corresponding to an embodiment of the present invention.

Camera module 1016 includes camera-related software components that enable camera-related processes and functions.

The application module 1017 may include a browser, an email, an instant message, a word processing, a keyboard emulation, an address book, a touch list, , Widgets, digital rights management (DRM), voice recognition, voice duplication, position determining functions, location based services, and the like.

It should also be noted that the various functions of the electronic device 1000 described above, and as discussed below, in accordance with the present invention may include one or more stream processing and / or application specific integrated circuits (ASICs) Hardware and / or software and / or a combination thereof.

The present invention may be embodied in many other specific forms without departing from the spirit or essential characteristics of the invention.

101: touch screen 102: speaker
103: Touch area enlarged by the set size
1000: electronic device
1010: Memory 1011: Operating system module
1012: Communication module 1013: Graphics module
1014: User interface module 1015: CODEC module
1016: camera module 1017: application
1020: Processor unit 1021: Memory interface
1022: Processor 1023: peripheral interface
1030: first wireless communication subsystem 1031: second wireless communication subsystem
1050: Audio subsystem 1051: Speaker
1052: microphone 1060: external port
1070: Input / output system 1071: Touch screen controller
1072: Other input controller 1080: Touch screen
1090: Other input / control devices 1091: Motion sensor
1092: optical sensor 1093: camera subsystem

Claims (20)

A method of operating an electronic device,
Confirming that the input means is detected at a position lower than the set height from the touch area;
Confirming that the position of the input means is included in one of the touch areas divided into a plurality of areas; And
Analyzing a gesture of the input means and inputting at least one of the at least one mark type assigned to the touch region in which the input means is located.
The method according to claim 1,
Wherein the step of confirming that the input means is detected at a position less than a predetermined height from the touch area,
Sensing a height from the touch region to the input means using at least one of a camera, a piezoelectric sensor, an infrared sensor, and a touch screen.
The method according to claim 1,
Further comprising the step of displaying the selected notation type among at least one notation type assigned to the touch area including the input means.
The method according to claim 1,
Further comprising the step of outputting information about the selected notation type among a plurality of notation types allocated to the touch region including the input means.
The method according to claim 1,
Further comprising the step of transmitting a tactile signal to the input means whenever the input means confirms movement between the respective touch regions partitioned into the plurality of regions.
The method according to claim 1,
Further comprising enlarging a touch area in which the input unit is located by a predetermined size, and reducing the remaining area by a predetermined size.
The method according to claim 1,
Analyzing a gesture of the input means and inputting any one of at least one notation type assigned to a touch region in which the input means is located,
Receiving at least one of at least one notation type assigned to a touch region in which the input means is located;
Confirming that the input means is not sensed at a position higher than the set height;
Confirming that the set time has elapsed without the input means being detected; And
And inputting the selected notation type.
8. The method of claim 7,
Detecting a first gesture of the input means; And
Further comprising the step of, when it is determined that the sensed first gesture is the same as the set gesture, selecting the notation of the next of the at least one same notation type assigned to the touch region according to the set order .
8. The method of claim 7,
Detecting a second gesture of the input means; And
And converting the selected second gesture to a different type of notation type according to the set order when it is determined that the detected second gesture is the same as the set gesture.
The method according to claim 1,
The above-
A number, a letter, and a symbol.
In an electronic device,
The touch sensor detects that the input means is detected at a position less than a predetermined height from the touch region and that the position of the input means is included in one of the touch regions divided into the plurality of regions, Lt; RTI ID = 0.0 >
Characterized by analyzing the gesture of the input means and inputting at least one of the notation types assigned to the touch region in which the input means is located.
12. The method of claim 11,
Wherein at least one of the camera, the motion sensor, and the touch screen senses a height from the touch area to the input means.
12. The method of claim 11,
Wherein the touch screen displays a selected notation type among at least one notation type assigned to a touch area including the input means.
12. The method of claim 11,
Further comprising an audio subsystem for acoustically outputting information about a selected notation type among a plurality of notation types assigned to a touch area including the input means.
12. The method of claim 11,
Wherein the touch screen transmits a tactile signal to the input means whenever the input means confirms movement between respective touch regions partitioned into the plurality of regions.
12. The method of claim 11,
Wherein the touch screen enlarges a touch area in which the input unit is located by a predetermined size, and reduces the remaining area by a predetermined size.
12. The method of claim 11,
Wherein the touch screen is configured to select any one of at least one notation type assigned to a touch region in which the input means is located,
Wherein the processor unit confirms that the input unit is not sensed at a position higher than the set height, confirms that the set time has elapsed without the input unit being sensed, and inputs the selected notation type Lt; / RTI >
18. The method of claim 17,
Wherein the processor unit detects a first gesture of the input means,
Wherein the touch screen selects a notation type of at least one of the same type of notation types assigned to the touch area according to a set order when it is determined that the sensed first gesture is the same as a set gesture .
18. The method of claim 17,
Wherein the processor unit detects a second gesture of the input means and, if it is determined that the sensed second gesture is the same as the set gesture, selects a different type of notation type Into a second signal.
12. The method of claim 11,
The above-
A number, a character, and a symbol.

Images