KR102293309B1 - Electrical device having multi-functional human interface and method for editing document using the same - Google Patents

Abstract

The present invention relates to an electronic device having a complex human interface and a document editing method using the same, comprising a keycap receiving a vertical push input from a user, a plurality of buttons arranged according to a keyboard layout, and a lower portion of the keycap An electrode positioned in the area, detecting a touch input from the user, a plurality of switches arranged along the keyboard layout under the plurality of buttons and obtaining a key input as the push input is provided, and text in a text field A first mode for obtaining information about the key input from the plurality of switches and obtaining a key value based on the information on the key input as a mode for inputting and indicating a position where the text is to be input on the text field A second mode for adjusting the position of the cursor, acquiring information about the touch input from the electrode, acquiring touch coordinates based on the information on the touch input, and acquiring cursor movement information based on the touch coordinates It operates in any one of the modes, but in the second mode: acquiring first touch coordinates and second touch coordinates at a first time point and a second time point later than the first time point, respectively, and the first touch coordinates and a controller for acquiring the cursor movement information corresponding to the positional relationship between the first button to which the first touch coordinates belong and the second button to which the second touch coordinates belong, based on the second touch coordinates; include

Description

Electronic device with complex human interface and document editing method using same

The present invention relates to an electronic device having a complex human interface and a document editing method using the same, and more particularly, to an electronic device providing a user interface for text input and cursor manipulation, and a document editing method using the same.

Recently, input devices such as a physical keyboard for text input in a personal computer or a portable digital device, a virtual keyboard, and a digitizer using a touch sensor have been disclosed. In particular, in a touch-sensitive computing device having a virtual keyboard, a method in which a user provides a touch gesture to control a movement of a cursor is disclosed.

However, in the case of a conventional text input device, the position of the cursor is designated using a mouse pointing device provided separately from the text input device. Accordingly, work efficiency for text input is lowered in a work environment in which a command input operation is repeatedly performed between the text input device and the mouse pointing device.

An object of the present invention is to provide an electronic device equipped with a complex human interface for selectively performing a text input mode and a cursor manipulation mode, and a document editing method using the same.

Another object of the present invention is to provide an electronic device equipped with a complex human interface capable of providing tactile feedback so that a user can determine a cursor movement in a cursor manipulation mode, and a document editing method using the same.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and the problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. .

According to an aspect of the present application, a plurality of buttons including a keycap receiving a vertical push input from a user, arranged according to a keyboard layout, located in a lower area of the keycap, and detecting a touch input from the user. de, a plurality of switches arranged along the keyboard layout under the plurality of buttons to obtain a key input as the push input is provided and a mode for inputting text into a text field, the key input from the plurality of switches A first mode for obtaining information about and obtaining a key value based on the information about the key input, and a mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field. It operates in any one of the second modes of acquiring information on the touch input, acquiring touch coordinates based on the information on the touch input, and acquiring cursor movement information based on the touch coordinates, In the mode: acquiring first touch coordinates and second touch coordinates, respectively, at a first time point and a second time point later than the first time point, and based on the first touch coordinates and the second touch coordinates, the first touch An electronic device equipped with a complex human interface including a controller, characterized in that the cursor movement information corresponding to the positional relationship between the first button to which the coordinates belong and the second button to which the second touch coordinates belong can be provided. have.

In addition, according to an aspect of the present application, a key input is received according to the elevation of a plurality of buttons arranged according to a keyboard layout, and a touch input is received using a capacitive sensor installed in at least a part of the keyboard layout. A document editing method performed by an electronic device equipped with a complex human interface, a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field Entering any one of two modes; when entering the first mode, a key value to be converted into the text to be input at a position where the cursor is placed on the text field based on the key input information and acquiring cursor movement information instructing movement of a cursor disposed on the text field based on information about the touch input when entering the second mode, wherein the cursor movement The acquiring information includes: a first button to which the first touch coordinates according to the touch input input at the first time point belong and the second touch coordinates according to the touch input input at a second time point later than the first time point belong A document editing method including a; generating the cursor movement information corresponding to the positional relationship between the second buttons may be provided.

In addition, according to an aspect of the present application, a display for outputting a document application including a text field into which text is input and a cursor indicating a position at which the text is to be input on the text field, arranged according to a keyboard layout and ascending and descending A first mode for inputting text into a text field and an input module including a plurality of buttons for receiving a key input and a capacitive sensor installed on at least a part of the keyboard layout and receiving a touch input, and the text field Any one of the second modes for adjusting the position of the cursor indicating the position at which text is to be input is performed, and when the first mode is entered, the text field is displayed on the text field based on the key input information. The first button to which the first touch coordinates according to the touch input input at the first time point belong when the text is output at the position where the cursor is placed and the second mode is entered, and the second time point after the first time point An electronic device having a complex human interface including a controller that moves the cursor on the text field to correspond to a positional relationship between the second buttons to which the second touch coordinates according to the touch input inputted corresponds to the positional relationship between the second buttons may be provided.

Solutions of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. will be able

According to the present invention, by performing the text input mode and the cursor manipulation mode in a single device, it is possible to improve work efficiency when creating a document compared to when text input and cursor manipulation are performed by separate devices.

According to the present invention, when the user manipulates the movement of the cursor, the position of the cursor can be precisely manipulated by allowing the user to determine not only the visual information on the cursor provided on the display but also the tactile information by the touch input provided to the device. have.

The effects of the present invention are not limited to the above-described effects, and the effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and accompanying drawings.

1 is an exemplary diagram of a configuration of a touch layer-integrated text input device according to an embodiment of the present invention.
2 is a block diagram of a multi-function input button according to an embodiment of the present invention.
3 is an embodiment of an electrode of a multi-function input button according to an embodiment of the present invention.
4 is an example of a configuration diagram of a touch layer-integrated text input device according to an embodiment of the present invention.
5 is an embodiment of an operation mode of the touch layer integrated text input device according to the present invention.
6 is a flowchart illustrating an operation of a text input mode of the touch layer integrated text input device according to an embodiment of the present invention.
7 is a flowchart illustrating an operation of a cursor manipulation mode of the touch layer integrated text input device according to an embodiment of the present invention.
8 is an exemplary embodiment illustrating a direction of a cursor movement according to a user's touch input.
9 is an example illustrating a distance of a cursor movement according to a user's touch input.
10 and 11 are exemplary diagrams illustrating a distance relationship between touch points provided on each of different buttons.
12 and 13 are examples of cursor movement according to a touch input.
14 is a flowchart illustrating an operation of a pointer manipulation mode of the touch layer integrated text input device according to an embodiment of the present invention.
15 is an embodiment illustrating a keyboard layout in which a plurality of key grooves are formed.
16, 17 and 18 are diagrams illustrating a unit movement distance of a cursor movement according to an embodiment of the present invention.
19 is a flowchart illustrating a unit movement distance of a cursor based on a touch input speed according to an embodiment of the present invention.
20 and 21 are exemplary embodiments illustrating a difference in cursor movement according to a single gesture or a plurality of gestures.
22 is an example showing the configuration of an electronic device having a complex human interface according to an embodiment of the present invention.
23 is a flowchart illustrating a document editing method performed by an electronic device according to the present invention.

The embodiments described in this specification are for clearly explaining the spirit of the present invention to those of ordinary skill in the art to which the present invention pertains, so the present invention is not limited by the embodiments described herein, and the present invention It should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terms used in the present specification are selected as widely used general terms as possible in consideration of the functions in the present invention, but they may vary depending on the intention, custom, or emergence of new technology of those of ordinary skill in the art to which the present invention belongs. can However, if a specific term is defined and used with an arbitrary meaning, the meaning of the term will be separately described. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the terms and the contents of the entire specification, rather than the names of simple terms.

The drawings attached to this specification are for easy explanation of the present invention, and the shapes shown in the drawings may be exaggerated as necessary to help understand the present invention, so the present invention is not limited by the drawings.

In the present specification, when it is determined that a detailed description of a known configuration or function related to the present invention may obscure the gist of the present invention, a detailed description thereof will be omitted if necessary.

According to an aspect of the present application, a plurality of buttons including a keycap receiving a vertical push input from a user, arranged according to a keyboard layout, located in a lower area of the keycap, and detecting a touch input from the user , a plurality of switches arranged along the keyboard layout under the plurality of buttons to obtain a key input as the push input is provided and a mode for inputting text into a text field to the key input from the plurality of switches A first mode for acquiring information about the key input and acquiring a key value based on the information about the key input, and a mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field. Operates in any one of the second modes of acquiring information about a touch input, acquiring touch coordinates based on the information on the touch input, and acquiring cursor movement information based on the touch coordinates, wherein the second mode In: Obtaining first touch coordinates and second touch coordinates at a first time point and a second time point later than the first time point, respectively, and based on the first touch coordinates and the second touch coordinates, the first touch coordinates An electronic device with a complex human interface including a controller, characterized in that the cursor movement information corresponding to the positional relationship between the first button to which belongs and the second button to which the second touch coordinates belongs is obtained.

The cursor movement information includes at least cursor movement direction information. An electronic device equipped with a complex human interface to be obtained correspondingly may be provided.

The controller is configured to obtain the cursor movement direction information indicating a left and right direction on the text field when the direction in which the second button is positioned from the first button is a longitudinal direction on the keyboard layout, and from the first button When the direction in which the second button is positioned is the longitudinal direction on the keyboard layout, an electronic device provided with a complex human interface for obtaining the cursor movement direction information indicating an up-down direction on the text field may be provided.

the controller acquires the cursor movement direction information indicating a left-right direction on the text field when belonging to the same row as the first button on the keyboard layout, and in the same column as the first button on the keyboard layout In the case of belonging to , an electronic device having a complex human interface for obtaining the cursor movement direction information indicating an up-down direction on the text field may be provided.

The controller has a complex human interface for acquiring the cursor movement information so that the cursor moves on the text field in response to a button interval at which the second button is spaced apart from the first button in the longitudinal direction and the width direction on the keyboard layout. An equipped electronic device may be provided.

The cursor movement information includes at least cursor movement distance information, and the controller controls the cursor movement to correspond to a button interval at which the second button is spaced apart from the first button according to a length direction and a width direction on the keyboard layout. An electronic device equipped with a complex human interface for obtaining distance information may be provided.

The controller is an electronic device equipped with a complex human interface that acquires the cursor movement information by a number corresponding to a button interval at which the second button is spaced apart from the first button in the longitudinal direction and the width direction on the keyboard layout. may be provided.

The controller is a mode for adjusting a position of a pointer that designates a point at which a pointing execution command is executed, and acquires information about touch coordinates based on information about a touch input obtained from the electrode, and obtains the acquired touch coordinates Further operating in a third mode for acquiring movement information of the pointer based on information on including the fourth touch coordinates obtained at the fourth time point, and when the controller operates in the third mode, obtaining the movement information of the pointer according to the relative positional relationship between the third touch coordinates and the fourth touch coordinates An electronic device having a complex human interface may be provided.

A key groove for physically separating the adjacent buttons is formed between the buttons adjacent to each other among the plurality of buttons, and the controller performs the slide touch type touch input when the slide touch type touch input is applied. output the cursor movement information corresponding to a point in time when the touch coordinates of the first and second buttons pass through the key groove formed between the first button and the second button, and the key groove provides the user with the text field according to the cursor movement information. An electronic device provided with a complex human interface providing tactile feedback indicating that the cursor movement is indicated on the screen may be provided.

The controller may be provided with an electronic device equipped with a complex human interface for obtaining the cursor movement information as a unit movement distance of any one of a character distance, a word distance, or a paragraph distance according to a predetermined criterion of the cursor.

The predetermined criterion may be an electronic device equipped with a complex human interface, which is a criterion for obtaining the cursor movement information based on a speed of a slide touch input having a sliding shape.

The controller is configured to: acquire the cursor movement information so that the cursor moves based on the character distance when the speed of the slide touch input is within the first speed range, and the speed of the slide touch input falls within the second speed range When included, the cursor movement information is acquired so that the cursor moves based on the word distance, and when the speed of the slide touch input is included in the third speed range, the cursor moves based on the character distance. An electronic device equipped with a complex human interface for obtaining movement information may be provided.

The predetermined criterion may be an electronic device equipped with a complex human interface, which is a cursor movement information acquisition criterion based on the number of touch points defined by the touch input.

The controller is configured to: acquire cursor movement information so that the cursor moves based on the character distance when the number of the touch points is the first number, and when the number of the touch points is the second number, the cursor moves the word distance An electronic device provided with a complex human interface for acquiring cursor movement information to move based on , and acquiring cursor movement information so that the cursor moves based on the paragraph distance when the number of touch points is the third number can be

The controller acquires the cursor movement information so that the cursor moves a first unit distance when the touch input is provided as a single gesture, and when the touch input is provided as two or more gestures, the second An electronic device provided with a complex human interface for acquiring the cursor movement information to move a second unit distance corresponding to one unit distance may be provided.

The controller enters one of the first mode and the second mode according to a predetermined mode switching criterion, wherein the predetermined mode switching criterion performs an input operation including at least one of the touch input and the push input. An electronic device with a complex human interface based on it can be provided.

The controller, the first touch coordinates and the second touch coordinates are different, but when the first button and the second button are the same, the controller does not output the cursor movement information to maintain the position of the cursor, An electronic device provided with a complex human interface for outputting the cursor movement information so that the position of the cursor is changed when the button and the second button are different from each other may be provided.

The controller is configured to: in the second mode: obtain third touch coordinates belonging to a third button and fourth touch coordinates belonging to a fourth button, respectively, at a third time point and a fourth time point later than the third time point, Even if the distance between the first touch coordinates and the second touch coordinates is greater than the distance between the third touch coordinates and the fourth touch coordinates, the distance between the first button and the second button is not equal to the distance between the third button and the fourth button. Electronic equipped with a complex human interface for outputting the cursor movement information so that the movement distance of the cursor between the first viewpoint and the second viewpoint is smaller than the movement distance of the cursor between the third viewpoint and the fourth viewpoint when it is smaller than the distance A device may be provided.

The controller may be provided with an electronic device equipped with a complex human interface that outputs the key value or the cursor movement information to a module or an external device that executes a document application including the text field.

Each of the plurality of buttons includes a button body coupled to a lower portion of the keycap and ascending and descending by the push input, and the electrode is interposed between the keycap and the button body to be included in each of the plurality of buttons. An electronic device equipped with a complex human interface may be provided.

The electrode may be provided with an electronic device equipped with a complex human interface, characterized in that included in the plurality of switches.

According to another aspect of the present application, a key input is received according to the elevation of a plurality of buttons arranged according to a keyboard layout, and a touch input is received using a capacitive sensor installed in at least a part of the keyboard layout. A document editing method performed by an electronic device equipped with a complex human interface, a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field Entering any one of two modes; when entering the first mode, a key value to be converted into the text to be input at a position where the cursor is placed on the text field based on the key input information and acquiring cursor movement information instructing movement of a cursor disposed on the text field based on information about the touch input when entering the second mode, wherein the cursor movement The acquiring information includes: a first button to which the first touch coordinates according to the touch input input at the first time point belong and the second touch coordinates according to the touch input input at a second time point later than the first time point belong A document editing method including generating the cursor movement information corresponding to a positional relationship between second buttons may be provided.

The cursor movement information includes at least cursor movement direction information, and the cursor movement direction information corresponds to a direction in which the second button is positioned from the first button according to a length direction and a width direction on the keyboard layout. An editing method may be provided.

The moving distance of the cursor on the text field indicated by the cursor movement information corresponds to a button interval at which the second button is spaced apart from the first button in the longitudinal direction and the width direction on the keyboard layout. may be provided.

When the first button and the second button are different from each other, a document editing method of performing the generating may be provided.

The obtaining of the cursor movement information includes a third button to which the third touch coordinates according to the touch input input at a third time point belong and a fourth touch according to a touch input input at a fourth time point later than the third time point. The method further comprising the step of generating the cursor movement information corresponding to the positional relationship between the fourth button to which the coordinates belong, wherein the distance between the first touch coordinates and the second touch coordinates is the third touch coordinates and the fourth touch coordinates Cursor movement information corresponding to the positional relationship between the first button and the second button when the distance between the first button and the second button is smaller than the distance between the third button and the fourth button even if it is greater than the distance between the buttons A document editing method may be provided in which the movement distance of the cursor indicated by is smaller than the movement distance of the cursor indicated by cursor movement information corresponding to a positional relationship between the third button and the fourth button.

According to another aspect of the present application, a display for outputting a document application including a text field into which text is input and a cursor indicating a position where the text is to be input on the text field;

an input module including a plurality of buttons arranged according to the keyboard layout and receiving key input according to elevation and a capacitive sensor installed in at least a portion of the keyboard layout and receiving a touch input; and

Any one of a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field is performed, and entering the first mode In one case, a text is output at a position where the cursor is disposed on the text field based on the information about the key input, and when the second mode is entered, the first touch according to the touch input input at the first time point a controller for moving the cursor on the text field so as to correspond to a positional relationship between a first button to which coordinates belong and a second button to which second touch coordinates according to a touch input input at a second time point later than the first time point belong; An electronic device having a complex human interface including a may be provided.

1. Keyboard

1-1 Overview

Hereinafter, an electronic device equipped with a complex human interface and a document editing method using the same according to an embodiment of the present specification will be described.

The present invention relates to an electronic device having a complex human interface and a document editing method using the same, and more particularly, to a touch layer-integrated text input device providing a user interface for text input and cursor manipulation and a document editing method using the same it is related

As a conventional text input device, a physical keyboard that is configured with a plurality of physical buttons each having an elastic body and a switch and outputs text data based on a push input authorized by a user is widely used.

Recently, touch interface means for displaying desired data on a display based on a touch input provided on a touch screen from a user as well as a keyboard composed of physical buttons have been widely used. In the digital device having the touch interface, a virtual keyboard is displayed on the display, and when a part of the user's body is touched on the virtual keyboard displayed on the display, the user's gesture or electrical signal is sensed and the user's touch is performed. A method of inputting text on a virtual keyboard displayed on the part is also used.

Examples of a touch interface capable of receiving a touch input include a pressure-sensitive touch, a capacitive touch screen, an optical touch screen, and an ultrasonic touch screen.

Various touch input technologies that can be used to control location information of a pointer or a cursor by recognizing location information of a part of a user's body by sensing a user's touch or movement may be used in the present invention.

1-2 Physical Configuration

1 is an exemplary diagram of a configuration of a touch layer-integrated text input device according to an embodiment of the present invention.

Referring to FIG. 1 , the touch layer-integrated text input device according to an embodiment of the present invention may have a housing 100 for supporting the text input device and the touch location information input area.

The touch layer-integrated text input device may be physically separated and configured with a plurality of buttons for receiving text input information from a user. The plurality of buttons may be referred to as a multi-function input button.

The plurality of buttons may form a key groove 109 having a predetermined groove shape. Here, when the user provides a touch or push input, the key groove may provide information that each button is a separate area to the user through tactile information. Details of the key groove will be described later with reference to FIG. 15 .

The touch layer-integrated text input device may have a touch layer including the text input area 107a and at least a portion of the text input area as a common area and including the touch location information input area 108a. The touch layer may receive a touch input provided from a user.

The touch location information input area is an area located on the surface, upper or lower part of the button for text input, and as shown in FIG. 1 , the touch location information input area may have at least a portion in common with the text input area.

2 is a block diagram of a multi-function input button according to an embodiment of the present invention.

The touch layer-integrated text input device according to an embodiment of the present invention may include a plurality of multi-function input buttons.

Referring to FIG. 2 , the multi-function input button includes a keycap 1010 to which a user's finger touch is made, an electrode part 1020 including a transmitter and a receiver for forming an electric field, and protects the electrode part and connects with the button body. It may be composed of an intermediate part 1030 for securing connectivity and a button body 1040 that supports the lower portion of the button and can ascend and descend when a push input is provided.

The button body may include an upper support portion 1042 , an elastic body 1044 , and a lower support portion 1046 . The upper support part and the lower support part may be moved through the elastic body, and the lower support part may guide the movement of the upper support part.

3 is an embodiment of an electrode of a multi-function input button according to an embodiment of the present invention.

The capacitive touch type electrode part is composed of a plurality of transmitters and receivers that form a grid shape with each other. In addition, a scan line for detecting a change in capacitance that may occur when a drive signal inducing capacitance is applied to the electrode unit and a touch input is provided may be formed in the electrode unit.

The electrode section includes first transmitters 1101, 1102, 1103 having a first drive cycle, second transmitters 1104, 1105, 1106 having a second drive cycle, and third transmitters 1107, 1108 having a third drive cycle. , 1109).

Here, the period may mean a timing at which a signal is generated.

It may have first receivers 1110 and 1111 having a first scan period and second receivers 1112 and 1113 having a second scan period.

The first and second receivers may be printed on a circuit board in a short-circuited state and connected to a separate connection member, or may be configured to be independently scanned for electrical signals such as capacitance in the same scan cycle.

In the case of a general capacitive touchpad, receivers having one scan cycle are interconnected. However, in the present embodiment, the first receiver having one scan cycle is composed of at least two receiver blocks 1110 and 1111, and the at least two receiver blocks are short-circuited to each other and transmit a scan signal to the outside. can do.

The scan signal may be processed by summing the capacitance signals received from each receiver block.

The transmitter and receiver may be electrically shorted to insulators 1114 and 1115 .

The electrode unit may be implemented by being included in a plurality of switches according to the present invention. For example, the plurality of switches may receive an electrostatic touch type touch input. That is, according to an example, a scan line for detecting a change in capacitance that may occur when a drive signal inducing capacitance is applied to the plurality of switches and a touch input is provided may be formed in the plurality of switches.

The electrode unit may include a bridge 1120 that transmits and receives an external drive signal and a scan signal stacked or connected to the bottom. The bridge may transmit a drive signal to the electrode unit and receive a capacitance signal from the receiver.

1-3 functional composition

4 is an example of a configuration diagram of a touch layer-integrated text input device according to an embodiment of the present invention.

Referring to FIG. 4 , the touch layer-integrated text input device 2000 according to an embodiment of the present invention provides a button 2100 that receives a push input or a touch input from a user, and a key input according to the descent of the button according to the push input. The switch 2200 for acquiring information about It may include a controller 2500 that performs various information and electrical signal processing including calculation of touch coordinate information based on the touch coordinate information.

At this time, the push input is provided to any one or more of the plurality of buttons 2100 arranged according to the keyboard layout, which can elevate the button 2100 by contracting the elastic body. In addition, the push input may mean applying a physical pressure on the input device to provide information that the user wants to input.

In this case, the touch input is one of input methods in which a contact is generated by a part of the body provided by the user, and information is recognized based on the change caused by the contact. The touch input may mean a user input that induces a change in capacitance of the electrode 2120 embedded in the button or located in the lower region of the button. In this case, a case in which the change in capacitance is greater than or equal to a predetermined touch threshold may be understood as a touch input.

The touch layer-integrated text input device 2000 may include a plurality of buttons 2100 arranged according to a keyboard layout and each separated by a physical groove. Here, the button may be a multi-function input button described with reference to FIG. 1 .

The touch layer integrated text input device 2000 may be provided in the form of a keyboard as shown in FIG. 1 as a whole, or may be provided in the form of a notebook in which a display and a keyboard are combined.

According to an embodiment, the button may include a keycap 2110 , an electrode 2120 , and a button body 2130 . Here, the keycap 2110 and the button body 2130 may be disposed on the upper and lower portions, respectively, and the electrode 2120 may be interposed between the keycap 2110 and the button body 2130 . That is, the button 2100 may be provided by stacking the keycap 2110 , the electrode 2120 , and the button body 2130 sequentially.

The keycap 2110 is exposed on the top of the button 2100 so that it can be in direct contact with an input provided from the user. The button body 2130 is disposed under the keycap 2110, and when a push input of a predetermined pressure or more by the user is provided to the keycap 2110, the switch 2200 is elevated and arranged under the button 2100. can provide an electrical change in

The electrode 2120 may be located in a lower region of the keycap 2110 . According to an embodiment, the electrode 2120 may be interposed between the keycap 2110 and the button body 2130 or located under the button 2100 . When a touch input is provided to the keycap 2110 , the electrode 2120 has a change in capacitance due to it, and thus can sense the touch input.

The switch 2200 is located below the button. The switch 2200 may be pressed by a push input provided to the keycap 2110 by the user, and accordingly, information regarding a key input corresponding to each switch 2200 may be obtained.

According to an example, the electrode 2120 may be included in the switch 2200 . In this case, when a touch input is provided to the keycap 2110 , the switch 2200 has a change in capacitance due to this, and thus the switch 2200 can sense the touch input.

The electrical connection member 2300 may form the circuit layer 2400 by electrically connecting the plurality of buttons 2110 to each other. Here, the electrical connection member 2300 may be a form implemented through a pattern printed on the FPCB, or a form of a conductor installed on a substrate on which a switch is installed and a button that moves up and down, respectively.

The circuit layer 2400 may provide an electrical signal received from the button 2100 to the controller 2500 . That is, the circuit layer 2400 may obtain information about a change in capacitance provided from the electrode 2120 , and may provide information for calculating a position of a touch input provided by a user to the controller 2500 .

The controller 2500 may process various types of information and electrical signals, including calculation of touch coordinate values based on a change in capacitance. For example, according to an embodiment, a key value for inputting cursor movement information or text may be output. The controller 2500 may be implemented as a CPU or a similar device according to hardware, software, or a combination thereof. The controller 2500 may be provided in the form of an electronic circuit that performs a control function by processing an electrical signal in hardware. In addition, the controller 2500 may be provided in the form of a program processed by the hardware controller 2500 in terms of software, an application, firmware, or the like.

The controller 2500 may process an electronic signal, process information, or perform an operation. Accordingly, the controller 2500 may process the overall operation of the touch layer integrated text input device 2000 or control each component of the touch layer integrated text input device 2000 . For example, the controller 2500 may obtain information about a change in capacitance, ie, information about a touch input, from the circuit layer 2400 and calculate a touch coordinate value. As another example, the controller 2500 may perform a mode switching operation of the touch layer integrated text input device 2000 .

In addition, the controller 2500 may process and perform various functions or operations of the touch layer integrated text input device 2000 . A more detailed description thereof will be given later. Meanwhile, in the present specification, functions or operations of the touch layer integrated text input device 2000 may be interpreted as being performed under the control of the controller 2500 unless otherwise specified.

2. Mode of operation

2-1 Overview

5 is an embodiment of an operation mode of the touch layer integrated text input device according to the present invention.

Referring to FIG. 5 , the touch layer-integrated text input device according to an embodiment of the present invention may operate in a text input mode, a cursor manipulation mode, and a pointer manipulation mode.

Here, in the text input mode, a user of the touch layer integrated text input device according to the present invention provides a vertical push input to buttons arranged according to a keyboard layout, and a button that is lowered by the push input operates a switch It is a mode to provide a keyboard input that reflects the key value assigned to the button to which the push input is applied.

In the cursor manipulation mode, the user of the touch layer-integrated text input device according to the present invention provides information about the cursor movement by performing a touch input on the touch area formed by the electrode, and moves the cursor based on this. mode to control

In the pointer manipulation mode, the user of the touch layer-integrated text input device according to the present invention provides information on the touch position of the pointer by performing a touch input on the touch region formed by the electrode, and provides information on the touch position. It is a mode in which the position of the pointer is adjusted by acquiring movement information of the pointer based on the information.

Hereinafter, three modes of the touch layer integrated text input device will be described in more detail.

2-2 Text input mode

6 is a flowchart illustrating an operation of a text input mode of the touch layer integrated text input device according to an embodiment of the present invention.

The touch layer integrated text input device may enter a text input mode (S3100). Here, the controller of the touch layer integrated text input device may enter the text input mode according to a predetermined criterion.

The touch layer integrated text input device may obtain a push input from the user (S3200).

A plurality of switches located under the button may acquire information about key input as the button is moved up and down (S3300). Accordingly, the touch layer-integrated text input device may acquire information about key input from the plurality of switches to input text into the text field.

In this case, the text field may mean an area in which text data can be input. The text field may be an area for inputting text on an application program for creating a document including text data. Also, the text field may be included in a document application for creating a document.

Alternatively, the text field may mean an inner area of the text box in a text box including a text input available area created in an application in which text input is not permitted.

In this case, the information about the key input is information about a key value corresponding to each of the plurality of buttons. A button can be assigned a single key value or more than one key value. Accordingly, the above-mentioned information on key input may be interpreted as at least corresponding to a key value assigned to a key to which a push input is provided.

For example, key values corresponding to uppercase English letters "A", lowercase English letters "a", and Korean vowels "ㅁ" may be assigned to button "A" on the keyboard layout, and when a predetermined conversion button is input, each other can be converted Accordingly, when a push input is provided to the keyboard button "A", the information on the assigned key input may correspond to the key information for the uppercase English letter "A", the English lowercase letter "a", and the Korean vowel "ㅁ".

The touch layer-integrated text input device may obtain a key value based on the key input information so that the display device can display the text to be output ( S3400 ).

Here, the controller may acquire a key value displayed on the display device. The key value obtained by the controller may be controlled by the display controller. The display controller may be referred to as a control unit. The display controller may instruct the display to display the provided key value. The display device may display the instructed key value at a point where the cursor is positioned on the text field.

2-3 Cursor operation mode

2-3-1 Overview

7 is a flowchart illustrating an operation of a cursor manipulation mode of the touch layer integrated text input device according to an embodiment of the present invention.

The touch layer integrated text input device according to the present invention may enter the cursor manipulation mode (S4100). The controller of the touch layer integrated text input device may enter a cursor manipulation mode according to a predetermined criterion.

The touch layer integrated text input device may obtain a touch input from the user (S4200). The touch layer-integrated text input device may include a touch layer capable of receiving a touch input provided from a user on a keyboard layout.

The electrode may detect information about a touch input at a touch input point sensed on the touch layer. In this case, the electrode may be located under the keycap of the button. The electrode unit may detect an electrostatic change due to a touch of a part of the user's body, and obtain location information on the changed point. The location information may be location information on the touch point or direction and distance information based on a specific reference point.

The information on the touch input may be information on a region corresponding to a predetermined range with respect to a point corresponding to the touch input point. For example, when the virtual X-axis and Y-axis are formed by taking the coordinate point of the lower left corner of the upper-case letter "A" as the origin, it may be position information on the point corresponding to the coordinates of (1, 2).

Alternatively, the information on the touch input may be a button corresponding to the touch input point. For example, when a touch input is provided to the central point of the English capital letter "A", the information about the touch input may be the "A" key.

The controller may receive information on the touch input ( S4300 ). The information on the touch input may be provided from the circuit layer as described above. In addition, the controller may acquire information on touch coordinates based on the received touch input information.

The controller may acquire cursor movement information instructing movement of the cursor based on the acquired touch coordinate information (S4400).

In this case, the cursor movement information is information for determining the position of the cursor, and may include at least direction information or distance information. The direction information may be information corresponding to vertical, horizontal, and vertical directions in which the cursor is to be moved. The distance information may be information corresponding to a distance to which the cursor is to be moved. For example, when the cursor is moved a distance of three characters to the right when the cursor is based on a specific position, the direction information may be “right” and the distance information may be “a distance of three characters”. In this case, the distance information may be distance information designated based on a predetermined reference unit. For example, when obtaining distance information for moving a unit distance of “3”, the cursor can move three paragraphs when the predetermined criterion is a paragraph criterion, and when the predetermined criterion is a character distance criterion, the cursor moves by three characters can move the distance. Details of the predetermined criteria will be described later.

The cursor may mean an object waiting for input by designating a position for inputting text. That is, as a pointer for designating a position where text is to be input on a text field, it may be one of the user interface means.

The cursor may be displayed in the form of a vertical line or bar that blinks at predetermined time intervals on a position designating a text input position. Alternatively, the cursor may be displayed in a rectangular shape, and may be displayed as a horizontal line having a size corresponding to the text size in the horizontal direction below a position where text is input. However, the shape of the cursor is not limited and may be expressed differently depending on an execution program in which text input is performed or an operating system executing a command.

2-3-2 Cursor movement direction

8 is an exemplary embodiment illustrating a direction of a cursor movement according to a user's touch input.

The touch layer-integrated text input device according to the present invention may have a keyboard layout, and the keyboard layout may have a rectangular shape.

Referring to FIG. 8 , the keyboard layout may have a rectangular shape in which a horizontal length is longer than a vertical length based on a direction in which the user views the touch layer integrated text input device. In this case, the horizontal direction of the rectangle may be referred to as a length direction, and the vertical direction of the rectangle may be referred to as a width direction.

The touch layer integrated text input device may include a plurality of buttons to which key values are assigned to correspond to positions on rows and columns on the keyboard layout. The row refers to a row direction and may correspond to the horizontal direction. The column is an expression indicating a longitudinal direction and may correspond to the vertical direction.

For example, a button located in the same column as the specific button may refer to a button that at least partially overlaps with a virtual area extending in the vertical direction with respect to the specific button. Also, a button located in the same row as the specific button may refer to a button in which at least a partial area overlaps with a virtual area extending in a horizontal direction with respect to the specific button.

Referring to FIG. 8 , the first button 210 and the second button 220 are buttons located in the same row, and the first button 210 is the third button 230 and the fourth button 240 and Each button may be located in the same column. The third button 230 and the fourth button 240 refer to buttons adjacent to at least a portion of the lower surface of the first button 210 , but regions of the adjacent surfaces may be different from each other. That is, when two or more buttons overlap at least a partial area in the vertical direction, the two or more buttons may be buttons located in the same column.

The touch layer-integrated text input device according to the present invention may determine the direction of the cursor movement through a positional relationship between buttons each including touch input points obtained at different points in time.

Referring to FIG. 8 , the direction of the cursor movement is after the first button 210 including the touch input coordinates provided at the first time point on the touch layer integrated text input device according to the present invention and after the first time point. It may be determined based on the positional relationship of the second button 220 including the touch input coordinates provided at the second point in time.

The first button 210 may correspond to a touch input point provided at the first time point, and the second button 220 may correspond to a touch input point provided at the second time point. At the first time point, the cursor may be located at a first cursor position, and at the second time point, the cursor may be located at a second cursor position.

The second button 220 may be located on the left side of the first button 210 . That is, the first button 210 is located in the same row as the second button 220, but may be located on the left side, and accordingly, the controller receives direction information of the cursor movement to direct the cursor to the left. can be obtained That is, the position of the cursor may be moved in a left direction corresponding to a direction from the first button to the second button.

The second cursor point may be located to the left of the first cursor point.

In the present embodiment, the case where the direction of the cursor movement is left is exemplified, but the direction defined by the positional relationship between the plurality of buttons is not limited to the present embodiment.

That is, the controller acquires cursor movement direction information for directing the cursor to the right when the second button 220 is located on the right side with respect to the first button 210, and is located in the same column but is located on the upper side When positioned in , cursor movement direction information for pointing the cursor upwards is acquired, and when positioned in the same column but positioned at the bottom, cursor movement direction information for pointing the cursor downward can be acquired.

2-3-3 Cursor movement distance

9 is an example illustrating a distance of a cursor movement according to a user's touch input.

The distance information of the cursor movement may be obtained based on a button interval between buttons to which a touch input is provided. The button interval may be expressed as the number of buttons arranged between two buttons or the number of grooves formed between the buttons.

For example, a distance between a first touch point provided on the first button 310 at a first time point and a second touch point provided on the second button 320 at a second time point after the first time point is the first button It can be defined as the number of buttons or grooves arranged between the 310 and the second button 320 .

Referring to FIG. 9 , three buttons are arranged between the first button 310 and the second button 320 and four grooves are formed. That is, even when a touch input is provided to the third touch point corresponding to the area of the first button 310 at a first time point, not the first touch point, the first touch point and the second touch point The button spacing between points is the same as the button spacing between the third touch point and the second touch point.

Referring to FIG. 9 , three buttons are arranged between the first button 310 and the second button 320 , and the controller provides cursor movement information to move the cursor to a position separated by four characters. can be printed out. That is, the cursor may be moved to a position separated by four characters to correspond to the information on the button interval between the first button 310 and the second button 320 . In this case, one space spaced between words due to spacing may be treated as one character distance.

For example, when referring to FIG. 9 , the position of the cursor that is four characters away from the initial position of the cursor located after "north", which is the position of the initial cursor, may be a space after "," instead of a space before ",". .

However, the cursor movement distance corresponding to the information on the interval between the buttons, but the distance the cursor is actually moved according to a predetermined criterion may be determined.

For example, even when a touch input is provided from the first button 310 to the second button 320 in the same manner, the cursor may be moved by a distance of three words or a distance of three paragraphs according to the predetermined criterion. Details of the predetermined criteria will be described later.

10 and 11 are exemplary diagrams illustrating a distance relationship between touch points provided on each of different buttons according to an embodiment of the present invention.

Referring to FIG. 10 , the first touch coordinates are a touch point provided at a first time point, and the first touch coordinates are included in an area corresponding to the first button 410 . In addition, the second touch coordinates are touch points provided at a second time point after the first time point, and the second touch coordinates are included in an area corresponding to the second button 420 .

At this time, since the first button 410 and the second button 420 are disposed adjacent to each other, the cursor is moved by the first unit distance by the provided touch input. In this case, the first unit distance may be a character-based distance, a word-based distance, or a paragraph-based distance. In the embodiment disclosed in this figure, the position is moved by one character distance. That is, the first button 410 and the second button 420 are different from each other, and since the position of the button corresponding to the touch point has been changed, cursor movement occurs.

In comparison, referring to FIG. 11 , the third touch coordinates are the touch points provided at the third time point, and the third touch coordinates are included in a region corresponding to the third button 415 . In addition, the fourth touch coordinate is a touch point provided at a fourth time point after the third time point, and the fourth touch coordinate is included in an area corresponding to the third button 415 . That is, the third touch point and the fourth touch point are located in an area corresponding to the same single button.

At this time, despite the change of the touch position from the third touch point to the fourth touch point, no cursor movement occurs. Referring to FIG. 11 , the positions of the cursors may be the same at the third time point and the fourth time point.

10 and 11 , the shortest distance 470 between the first touch coordinates and the second touch coordinates has a smaller value than the shortest distance 475 between the third coordinates and the fourth touch coordinates. Even when the coordinates of the touch input provided by the user are changed, the position of the cursor may not be changed when the provided touch coordinates respectively correspond to the same button.

2-3-4 Cursor movement distance and direction

12 and 13 are examples of cursor movement according to a touch input.

12 and 13 , the first touch coordinates obtained from the touch input provided at the first time point may be located in the inner region of the first button 510 and are continuous until the second time point after the first time point. A traditional sliding touch input is provided. The second touch coordinates obtained from the touch input provided at the second time point may be located in the inner region of the second button 520 . Three key grooves may be formed between the first button 510 and the second button 520 . That is, two separate buttons may be disposed between the first button 510 and the second button 520 .

For example, referring to FIG. 12 , the controller may output cursor movement information based on the above-described button interval. The controller may output cursor movement information instructing the cursor to move three spaces to the left on the display by the positional relationship between the first button 510 and the second button 520 . That is, when the touch input designated to the second button 520 is provided for more than a predetermined time, the controller may output cursor movement information instructing to move the cursor to the left by three characters.

Referring to FIG. 13 , the controller may repeatedly output information instructing the cursor to move to the left on the display the number of times to correspond to the information instructing to move the cursor 3 spaces to the left.

The second button 525 may be spaced apart from the first button 515 by three buttons to the left. Accordingly, the controller may output cursor movement information instructing to repeat the movement of the cursor to the left by one character based on a total of three times.

In the end, even when the controller outputs cursor movement information instructing the cursor to move the same distance, it may be command information instructing that two or more commands be repeatedly performed, and a single command instructing to move the specified movement distance. It may be command information.

2-4 Pointer operation mode

In the above, the text input mode and the cursor manipulation mode have been described as the operation modes of the touch layer integrated text input device according to the present invention. However, the touch layer integrated text input device outputs pointer movement information for adjusting the position of the pointer. It can also operate in the pointer operation mode. The pointer may mean an object designating a point at which a pointing execution command is executed. Here, the pointing execution command may refer to a command, input, etc. for executing an application application disposed at a position corresponding to an area where the pointer is located on the display.

The pointer movement information may refer to an input mainly output from a mouse interface for adjusting a position of a pointer displayed on a display. For example, an electronic device such as a personal computer, a notebook computer, a smart phone, or a tablet may use a mouse input to control the position of a pointer displayed on a display.

14 is a flowchart illustrating an operation in a pointer manipulation mode of the touch layer integrated text input device according to an embodiment of the present invention.

Referring to FIG. 14 , the touch layer integrated text input device according to the present invention may enter a pointer manipulation mode ( S5100 ). For example, when an input related to a push input corresponding to a preset pointer manipulation mode conversion criterion, a touch input, or a combination thereof is provided while operating in the text input mode, the touch layer integrated text input device may enter the pointer manipulation mode have. The predetermined pointer manipulation mode conversion criterion may be a method in which a push input is provided to a first mode conversion key that is one of the composite input buttons on a keyboard layout, and a touch input for displaying a predetermined gesture on a touch layer is provided. can be However, the above-described example is an example of a pointer manipulation mode conversion method and is not limited thereto.

The touch layer-integrated text input device according to the present invention may receive a touch input from the user and acquire information about the touch input based on the received touch input (S5200).

In addition, the controller of the touch layer integrated text input device may acquire information on touch coordinates based on the information on the touch input ( S5300 ). Here, the information about the touch coordinates may correspond to the (x, y) form. Since the description of the controller has been described above with reference to FIG. 4 , overlapping content will be omitted.

The controller may calculate a coordinate change value based on the previous touch coordinates and the current touch coordinates (S5400). For example, when the touch layer integrated text input device is operating in the pointer manipulation mode, a sliding touch input may be provided up to a third time point and a fourth time point later than the third time point. The controller may calculate touch coordinates for each viewpoint based on information about the touch input provided at the third and fourth viewpoints, and calculate the touch coordinates for each of the calculated touch coordinates from the third viewpoint through a difference operation. A coordinate change value for up to the fourth time point may be calculated. Here, the touch coordinates of the fourth time point are touch coordinates calculated from the scan signal obtained in the scan signal period of the fourth time point, and the touch coordinate value of the third time point is the scan signal immediately before the scan signal period of the fourth time point. It may be a touch coordinate calculated from a scan signal acquired in a period. The calculated coordinate change value may be expressed as a relative positional relationship between previous touch coordinates and current touch coordinates.

The controller may acquire movement information of the pointer according to the calculated coordinate change value (S5500). The movement information may include information on at least a movement distance or movement direction of the pointer.

The controller calculates the touch coordinates for the touch input point in real time based on the received touch input, obtains a touch coordinate change value through the difference operation of the calculated touch coordinate, and displays the touch coordinate change value based on the obtained touch coordinate change value Pointer movement information for adjusting the upper pointer position may be output.

3. Implementation example

3-1 key groove

15 is an embodiment illustrating a keyboard layout in which a plurality of key grooves are formed.

A plurality of buttons to which respective key values are assigned may be physically distinguished from each other. At this time, the plurality of buttons may be lifted up and down by an elastic body included therein. The area of the plurality of buttons may become narrower toward the upper part from the lower part. According to an embodiment, each of the plurality of buttons may have a quadrangular truncated pyramid shape, and a side surface thereof may have a trapezoidal shape. Alternatively, each of the plurality of buttons may have a rectangular parallelepiped shape, and a side surface may have a rectangular shape.

A key groove 680 for physically separating the adjacent buttons may be formed between the adjacent buttons among the plurality of buttons. The key groove 680 may distinguish between buttons adjacent to each other arranged in the longitudinal direction on the keyboard layout or between buttons adjacent to each other arranged in the width direction of the keyboard layout.

The key groove 680 may provide a tactile feedback informing a user who provides a touch input to move the cursor position that the cursor movement is directed according to information on the cursor movement.

In this case, the information on the cursor movement may include movement direction information or movement distance information of the cursor.

Referring to FIG. 15 , the key groove 680 may be formed between the first button 610 and the second button 620 arranged adjacent to the left side of the first button 610 .

When a touch input is continuously provided to an area inside the button adjacent to the left based on the button including the touch start point, the user may move the cursor to the left by the first unit distance according to a predetermined criterion. The first unit distance may be a unit distance with respect to a character, a word, or a paragraph.

At this time, the key groove 680 formed in a predetermined groove shape can provide tactile information to the user through a part of the body, and based on the tactile information recognized by the user, the user can move the cursor to one button interval. It can be effectively recognized that the corresponding cursor movement has occurred.

For example, if the cursor is to be moved by a three-character distance, the user may need to provide a sliding touch input between buttons spaced apart from each other by three buttons. Referring to FIG. 15 , the user may provide a touch input to the first button 610 , and may provide a sliding touch input up to the fourth button 640 while maintaining the touch input on the keyboard layout.

At this time, there are three key grooves 680 formed between the first button 610 and the fourth button 640 , and there is a button interval between the first button 610 and the fourth button 640 . On the display corresponding to , the cursor may be moved by a second unit distance corresponding to three times the first unit distance. Even when the user does not acquire visual information, the user may move by three character distances by acquiring tactile information indicating that the part of the body providing the sliding touch input has passed three key grooves 680 .

In the present embodiment, the second unit distance is a distance of three characters, but it may be a movement distance that changes the cursor position by three word distances or three paragraph distances according to a predetermined criterion, and the unit movement distance is limited to the above-described example doesn't happen

3-2 Moving reference distance

3-2-1 Character, Word, Paragraph Distance

16, 17 and 18 are diagrams illustrating a unit movement distance of a cursor movement according to an embodiment of the present invention.

In the touch layer-integrated text input device according to the present invention, different cursor movements may occur according to a predetermined criterion even when the same touch input is provided by a user. For example, the movement distance information of the cursor may be different according to the unit movement distance. The unit movement distance is a minimum unit serving as a reference for the movement distance at which the position of the cursor is changed, and the unit movement distance may include a character distance, a word distance, and a paragraph distance. 16, 17 and 18 are diagrams of a unit movement distance of a cursor movement, and are examples of a cursor movement related to a character distance, a word distance, and a paragraph distance, respectively.

The unit movement distance may be changed by providing a push input or a touch input to the conversion keys 780 and 784 . Each of the conversion keys 780 and 784 may be a specific button of a keyboard layout or a button provided separately from the keyboard layout.

Referring to FIG. 16 , when a touch input is provided from the first button 710 to the second button 720 , the first button 710 and the second button 720 are spaced apart by three button intervals, and , the cursor may be moved three spaces in a character unit in a direction from the first button 710 to the second button 720 to be positioned in a space after "PC".

In comparison with this, referring to FIG. 17 , while a push input is provided to the first conversion key 780 or a key combination including the conversion key 780, the touch from the first button 712 to the second button 722 When an input is provided, it is possible to move 3 spaces by a word distance in a direction from the first button 712 to the second button 722 .

In this case, the movement information of the cursor regarding the word distance may refer to cursor movement information in which the cursor moves to be positioned at the frontmost part of each specific word.

In this embodiment, the cursor moves the character distance per button spacing on the keyboard layout when a push input is not provided to the conversion key, but includes a first conversion key 780 or a first conversion key 780 When providing a push input to a key combination, the word distance per button interval can be moved.

Alternatively, referring to FIG. 18 , when a touch input is provided from the first button 714 to the third button 734 according to a predetermined criterion, the cursor moves from the first button 714 to the third button 734 . The paragraph may be changed by the number of units corresponding to the button spacing in the direction facing.

For example, when a push input is provided to a key combination including the second conversion key 784 or the second conversion key 784 corresponding to a specific key on the keyboard layout according to the predetermined criterion, the touch input It is possible to make the cursor movement distance unit corresponding to the button spacing according to the paragraph unit the paragraph unit. In addition, a sliding touch input is provided to the third button 734 spaced apart from the first button 714 by one button on the upper side, so that the cursor can be moved to the start point of the paragraph where the cursor is located. .

The predetermined criterion may be a cursor movement information acquisition criterion based on the number of touch points defined by the touch input. That is, the controller is configured to: acquire cursor movement information so that the cursor moves the character distance when the number of touch points provided by the user is the first number, and when the number of touch points provided by the user is the second number, the cursor Cursor movement information may be acquired to move based on the word distance, and if the number of touch points is the third number, cursor movement information may be acquired so that the cursor moves based on the paragraph distance. According to an example, when the provided touch input is a two-point touch input, the controller acquires cursor movement information based on the character distance, but when the provided touch input is a three-point touch input, the controller determines the word distance Cursor movement information is acquired as a reference, and when the provided touch input is a four-point touch input, the controller may acquire cursor movement information based on the short-circuit distance.

Here, the two-point touch input may be a touch input provided to two different points spaced apart from each other by a predetermined distance or more on the touch layer. For example, the two-point touch input may be a touch input in which two fingers of a user are spaced apart from each other by the predetermined distance or more to provide a touch input on a touch layer. The three-point or four-point touch input may be a touch input provided to three or four different points, respectively.

As described above, the method for determining the cursor movement according to a predetermined criterion may include a case in which a push input is provided to the first or second conversion keys 780 and 784 and a case in which a touch input is provided. not limited

3-2-2 sliding speed

19 is a flowchart illustrating a unit movement distance of a cursor based on a touch input speed according to an embodiment of the present invention.

As described above, the unit movement distance of the cursor may include a character distance, a word distance, or a paragraph distance, and the unit movement distance may be changed according to a predetermined criterion. According to an embodiment, the predetermined criterion may be a cursor movement acquisition criterion based on the speed of the slide touch input when a sliding-type slide touch input is provided.

Referring to FIG. 19 , the touch layer-integrated text input device according to an embodiment of the present invention enters a cursor manipulation mode ( S1710 ), and a slide-type touch input may be provided ( S1720 ). The slide-type touch input may be a swiping-type input in which a continuous touch input is provided on the touch layer-integrated text input device.

The touch layer-integrated text input device may acquire information on the speed of the provided touch input (S1730). Information on the touch input speed may be obtained by the controller described above with reference to FIG. 4 . The controller may receive information on the provided slide-type touch input, obtain touch coordinates based on the received touch input information, and adjust the speed of the slide-type touch input based on the acquired touch coordinates. information can be obtained.

The touch layer-integrated text input device may determine the unit movement distance of the cursor movement according to the speed of the provided touch input (S1740). For example, when the speed of the provided touch input is: when included in the first speed range, the unit movement distance of the cursor movement is a character distance, when included in the second speed range, the unit movement distance of the cursor movement is a word distance, and When included in the 3 speed range, the unit movement distance of the cursor movement may be a short-circuit distance. The first to third speed ranges may be numerical ranges having upper and lower limits for the speed value, respectively, and may mean a speed greater than a specific speed value or smaller than a specific speed value. According to an embodiment, when the speed of the slide-type touch input corresponds to a predetermined reference speed range, the unit movement distance of the cursor movement is a word distance, and when it is smaller than the lower limit of the predetermined reference speed range, the unit of the cursor movement The movement distance is a character distance, and when it is greater than the upper limit of the predetermined reference speed range, the unit movement distance of the cursor movement may be a short distance.

The touch layer integrated text input device may acquire cursor movement information based on the determined unit movement distance (S1750). That is, the cursor movement information may be obtained based on the speed of the touch input provided to the touch layer integrated text input device according to the present invention.

3-3 Gestures

20 and 21 are exemplary embodiments illustrating a difference in cursor movement according to a single gesture or a plurality of gestures.

Gestures are one of communication methods performed by motions using the body. In the present specification, a gesture may mean the number of touch points, a touch shape, etc. occurring at the same point in time defined by a touch input provided on the keyboard layout by the user, and may refer to other touch methods provided through the user's body. can mean

A user may form a gesture using one or more fingers. A gesture of providing a touch input using a predetermined number of fingers may be referred to as a single gesture, and a gesture of providing a touch input to a separate button at the same time using at least a greater number of fingers than the predetermined number can be called a plural gesture.

Referring to FIG. 20 , the user may provide a touch input, which is a single gesture, from the first button 810 to the second button 820 . In this case, the cursor movement information may instruct the cursor to move a first unit distance in a direction from the first button 810 to the second button 820 .

In comparison with this, referring to FIG. 21 , the user provides a touch input to the first button 815 and the third button 835 located in the same column as the first button 815 at a first time, and a second At a time point, a touch input may be provided to a second button 825 spaced apart from the first button 815 by a predetermined button interval, and a fourth button 845 positioned in the same column as the second button, respectively. In this case, the controller obtains cursor movement information in which the cursor moves a second unit distance having a value twice the first unit distance in a direction from the first button 815 to the second button 825. can

For example, in FIG. 20 , the cursor moves two word distances corresponding to the first unit distance as a single gesture touch input is provided by the user, and in FIG. 21 , the cursor moves through a plurality of gesture touch inputs. Four word distances corresponding to the second unit distance are moved.

However, by performing a specific conversion operation, the first unit distance may be a character distance and the second unit distance may be a cursor movement distance corresponding to the character distance of the first unit distance.

Alternatively, the short-circuiting distance of the first unit distance and the second unit distance may be a cursor movement distance corresponding to the short-circuiting distance of the first unit distance.

A difference in movement distance of a cursor movement may occur between a single gesture and a plurality of gestures according to a predetermined criterion, and the present embodiment is not limited thereto.

3-4 mode switching

3-4-1 Temporary Transition Mode, Permanent Transition Mode

The touch layer-integrated text input device according to the present invention may have a temporary switching mode or a permanent switching mode with respect to the cursor manipulation mode.

The touch layer-integrated text input device according to the present invention may be converted from a text input mode to a cursor manipulation mode when a push input or a touch input is provided for a predetermined specific button.

The predetermined specific button may be any one of buttons located on the keyboard layout or a key combination including the same. Alternatively, the predetermined specific button may be a mode switching button provided separately from the keyboard layout rather than a button on the keyboard layout.

The predetermined specific button may be a permanent switch button in which the operation mode of the controller is maintained as the cursor operation mode even when the touch input or the push input provided to the predetermined specific button is removed. Alternatively, the predetermined specific button is a temporary mode in which the operation mode of the controller is switched from the cursor operation mode to the text input mode when a predetermined time elapses after the touch input or the push input provided to the predetermined specific button is removed It may be a toggle button.

3-4-2 Mode switching example

The touch layer-integrated text input device according to the present invention may be switched from a text input mode or a pointer manipulation mode to a cursor manipulation mode according to a predetermined criterion.

The controller of the touch layer integrated text input device according to the present invention may enter a text input mode, a cursor manipulation mode, or a pointer manipulation mode according to a predetermined criterion.

The predetermined mode switching criterion may be an input operation based on a touch input and/or a push input. For example, the touch input and/or push input may be independently performed, or the touch input and the push input may be combined and provided to the touch layer integrated text input device.

According to an embodiment, the predetermined mode change criterion may be a mode change criterion based on a gesture defined by a touch input. For example, when the controller is operating in a text input mode and points designated by a touch input provided by a user form a circle shape, the controller may be mode switched to operate in a cursor manipulation mode. In addition, when points defined by a touch input form a triangular shape with respect to the controller operating in the cursor manipulation mode, the operating mode of the controller may be switched to operate in the text input mode.

According to another embodiment, the predetermined mode change criterion may be a mode change criterion based on the number of touch points defined by a touch input. For example, when the controller is operating in a text input mode and a touch input provided by a user corresponds to a four-point touch input, the controller may be mode-switched to operate in a cursor manipulation mode. Here, the four-point touch input may be a touch input provided to four different points spaced apart from each other by a predetermined distance or more on the touch layer. For example, the four-point touch input may be a touch input in which the user's four fingers are spaced apart from each other by the predetermined distance or more to provide the touch input on the touch layer.

According to another embodiment, the predetermined mode switching criterion may be a predetermined pattern defined by the touch input.

The above-described mode switching method is an embodiment of the mode switching method of the touch layer integrated text input device according to the present invention, and is not limited to the above-described example.

4. Others

4-1 Single, Multi-Device

22 is an example showing the configuration of an electronic device having a complex human interface according to an embodiment of the present invention.

Referring to FIG. 22 , an electronic device 5000 having a complex human interface may include a display 5200 , an input module 5400 , and a controller 5600 .

The display 5200 may be a device capable of visually displaying data. For example, the display 5200 may output a document application including a text field into which text is input and a cursor indicating a position where the text is to be input on the text field.

Here, the document application may mean an application program for creating a document related to text data. Alternatively, it may be an application including at least a cursor for designating a position where text is to be input.

The input module 5400 may be a device capable of transmitting data or a command based on an input provided from the outside. The input module 5400 may include a plurality of buttons arranged according to the keyboard layout and receiving a key input according to elevation and a capacitive sensor installed in at least a part of the keyboard layout and receiving a touch input.

Here, the capacitive sensor is an example of a touch interface capable of receiving a touch input, and may have a configuration including the electrode described above with reference to FIG. 3 .

The controller 5600 performs any one of a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field, When entering the first mode, a text is output at a position where the cursor is placed on the text field based on the key input information, and when entering the second mode, a touch input input at the first time point The cursor on the text field corresponds to a positional relationship between the first button to which the first touch coordinates according to can be moved

Here, the controller 5600 may output the cursor movement information based on the information provided from the input module 5400 .

The controller 5600 may instruct the position of the cursor on the document application to be changed based on the cursor movement information.

An electronic device having a complex human interface may function as an input device by being connected or applied to various devices. That is, the electronic device having the complex human interface may be a portable computing device including a notebook computer.

For example, an electronic device having a complex human interface according to the present invention may be connected to a separate electronic device such as a smart phone, a tablet device, or a computer to perform a function as an input device. Alternatively, it may be an input device embedded in a single computing device, such as a notebook computer in which a display and an input device are combined.

However, it should be noted that the multi-device environment is not limited thereto in the present specification.

4-2 Method

23 is a flowchart for explaining a document editing method performed by an electronic device according to the present invention.

Referring to FIG. 23 , in the document editing method performed by an electronic device having a complex human interface according to the present invention, a key input is received according to the elevation of a plurality of buttons arranged according to the keyboard layout, and the keyboard layout A document editing method performed by an electronic device having a complex human interface that receives a touch input using a capacitive sensor installed in at least a part of a first mode for inputting text into a text field and the text field Entering any one of the second modes for adjusting the position of the cursor indicating the position where the text is to be input on the screen (S6100), when entering the first mode, based on the information about the key input to obtain a key value to be converted into the text to be input at a position where the cursor is placed on the text field ( S6400 ), and when entering the second mode, based on the touch input information, the text field Including a step (S6400) of obtaining cursor movement information instructing movement of a cursor disposed on the cursor, wherein the step of obtaining the cursor movement information includes a first touch coordinate according to a touch input input at a first time point to which the first touch coordinate belongs. Generating the cursor movement information corresponding to the positional relationship between the first button and the second button to which the second touch coordinates according to a touch input input at a second time point later than the first time point belong (S6300) can

Hereinafter, each of the above-described steps will be described in more detail.

The electronic device having the complex human interface may enter any one of the first mode and the second mode. Here, the controller may determine whether to enter one of the first mode and the second mode according to a predetermined mode conversion criterion. Since the predetermined mode switching criterion has been described above, a detailed description thereof will be omitted.

When any one of the first mode and the second mode is entered, the electronic device having a complex human interface enters the text to be input at a position where the cursor is placed on the text field when the first mode is entered. It is possible to obtain a key value to be converted to . Here, the key value may be based on information about the key input.

Alternatively, when the electronic device having the complex human interface enters the second mode, cursor movement information may be generated and obtained.

Here, the cursor movement information is information based on the touch input information, and since it has been described above with reference to FIGS. 7 to 13 , a detailed description thereof will be omitted.

The methods according to the embodiments of the present invention described above may be used alone or in combination with each other. Since each step described in the method according to the embodiment of the present invention is not essential, each method may be performed including all of the steps as well as only some of the steps. In addition, since the order in which each step is described is only for convenience of description, each step in the method described in the present invention does not necessarily have to be performed in the described order.

The above description is merely illustrative of the technical spirit of the present invention, and various modifications and variations will be possible without departing from the essential characteristics of the present invention by those skilled in the art to which the present invention pertains. Accordingly, the embodiments of the present invention described above may be implemented separately or in combination with each other.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

Claims (27)

As an electronic device equipped with a complex human interface,
a plurality of buttons including a keycap to which a vertical push input is applied from a user and arranged according to a keyboard layout;
a plurality of switches for obtaining a key input as the push input is provided under the plurality of buttons;
an electrode for sensing a touch input from the user; and
A first mode in which the electronic device acquires at least one command information corresponding to the push input according to the input obtained from the user, and a second and third mode in which at least one command information corresponding to the touch input is acquired A controller that operates in at least one mode of
The controller is
When a first input is received from the user,
operating in the first mode for outputting at least one key value based on information input from the plurality of switches as a mode for inputting text into a text field;
When a second input is received from the user,
As a mode for adjusting a position of a cursor indicating a position where the text is to be input on the text field, it operates in the second mode in which cursor movement information is output based on information about the touch input from the electrode;
When a third input is received from the user,
It is a mode for adjusting the position of a pointer that designates a point at which a pointing execution command is executed, and operates in the third mode in which movement information of the pointer is output based on information about a touch input obtained from the electrode;
The controller is operating in the second mode
Obtaining first touch coordinates and second touch coordinates at a first time point and a second time point later than the first time point, respectively, and the cursor movement information based on a distance between the first touch coordinates and the second touch coordinates to output
Electronic devices with complex human interfaces.
According to claim 1,
the first input comprises the push input;
The second and third inputs include the touch input,
The gesture of the second input and the gesture of the third input are different from each other.
Electronic devices with complex human interfaces.
3. The method of claim 2,
The number of touch points generated by the second input is different from the number of touch points generated by the third input
Electronic devices with complex human interfaces.
According to claim 1,
The second input includes the push input and the touch input,
In the second mode
acquiring a push input for a first button different from the first touch coordinates and the second touch coordinates during a time period from the first time point to the second time point
Electronic devices with complex human interfaces.
According to claim 1,
On the keyboard layout, a position at which the second input is obtained and a position at which the third input is obtained are different from each other.
Electronic devices with complex human interfaces.
According to claim 1,
On the keyboard layout, the position at which the second input is obtained and the position at which the third input is obtained are included in the position at which the first input is obtained.
Electronic devices with complex human interfaces.
7. The method of claim 6,
The position at which the second input is obtained and the position at which the third input is obtained overlap each other at least partially.
Electronic devices with complex human interfaces.
According to claim 1,
The electronic device includes a first button on the keyboard layout,
the controller
When the first input to the first button is obtained, it operates in the first mode,
operate in the second mode when the second input to the first button is obtained;
When the third input for the first button is obtained, operating in the third mode
Electronic devices with complex human interfaces.
9. The method of claim 8,
the controller
When the first input for the first button is obtained, it operates in the first mode to output a key value corresponding to the first button,
When the second input to the first button is obtained, it operates in the second mode to obtain touch coordinates corresponding to the second input,
When the third input for the first button is obtained, the third mode is operated to obtain touch coordinates corresponding to the third input.
Electronic devices with complex human interfaces.
9. The method of claim 8,
the first input comprises a push input for the first button when the controller operates in the second mode or the third mode;
The second input includes a touch input for the first button when the controller operates in the first mode or the third mode,
The third input includes a touch input for the first button when the controller operates in the first mode or the second mode
Electronic devices with complex human interfaces.
According to claim 1,
In the first mode, a signal is received from the plurality of switches,
In the second and third modes, receiving a signal from the electrode
Electronic devices with complex human interfaces.
12. The method of claim 11,
The portion of the electrode used in the second mode and the portion of the electrode used in the third mode overlap each other at least partially
Electronic devices with complex human interfaces.
According to claim 1,
The controller is configured to obtain the cursor movement information in which the cursor uses any one of a character distance, a word distance, or a paragraph distance as a unit movement distance according to a predetermined criterion.
Electronic devices with complex human interfaces.
According to claim 1,
The controller is
In the second mode:
Obtaining the third touch coordinates and the fourth touch coordinates at the third time point and the fourth time point later than the third time point, respectively,
Even if the distance between the first touch coordinates and the second touch coordinates is greater than the distance between the third touch coordinates and the fourth touch coordinates, the distance between the first touch coordinates and the second touch coordinates does not exceed a certain distance In the case of outputting the cursor movement information so that the movement distance of the cursor between the first time point and the second time point is the same as the movement distance of the cursor between the third time point and the fourth time point
Electronic devices with complex human interfaces.
According to claim 1,
The controller is
Acquiring the cursor movement information so that the cursor is moved on the text field in response to an interval at which the second touch coordinates are spaced apart from the first touch coordinates in the length direction and the width direction on the keyboard layout
Electronic devices with complex human interfaces.
According to claim 1,
The controller is operating in the second mode
Even if information on the first touch coordinates and the second touch coordinates are obtained, the pointer movement information is not output.
Electronic devices with complex human interfaces.
According to claim 1,
The controller is operating in the second mode
outputting a key value corresponding to the first button when the push input for the first button is obtained at a third time point later than the second time point
Electronic devices with complex human interfaces.
According to claim 1,
The cursor position is
Based on the cursor movement information output based on the distance between the first touch coordinates and the second touch coordinates, the first position at the first time point is moved to the second position at the second time point,
The controller is operating in the second mode
When the push input for the first button is obtained at a third time point later than the second time point, the key value corresponding to the first button is set so that the text corresponding to the first button is output at the second position. output
Electronic devices with complex human interfaces.
According to claim 1,
The controller outputs the key value or the cursor movement information to a module or an external device that executes a document application including the text field.
Electronic devices with complex human interfaces.
According to claim 1,
Each of the plurality of buttons includes a button body coupled to a lower portion of the keycap and ascending and descending by the push input,
The electrode is interposed between the keycap and the button body, characterized in that each included in the plurality of buttons
Electronic devices with complex human interfaces.
According to claim 1,
The electrode is characterized in that included in the plurality of switches
Electronic devices with complex human interfaces.
According to claim 1,
A key groove for physically separating the adjacent buttons is formed between the buttons adjacent to each other among the plurality of buttons,
The controller, in the second mode,
When a touch input in the form of a slide touch is applied from the first touch coordinates to the second touch coordinates, at least one cursor movement information is output,
wherein the key groove provides a tactile feedback informing the user that movement of the cursor on the text field is indicated.
Electronic devices with complex human interfaces.
According to claim 1,
The controller is
When the direction in which the second touch coordinates are located from the first touch coordinates is the longitudinal direction on the keyboard layout, the cursor movement information indicating the left and right directions on the text field is obtained, and the second touch coordinates are obtained from the first touch coordinates. When the direction in which the touch coordinates are located is the width direction on the keyboard layout, obtaining the cursor movement information indicating the vertical direction on the text field
Electronic devices with complex human interfaces. delete delete delete delete

Images