KR20200040692A - Electrical device having multi-functional human interface and method for editing document using the same - Google Patents

Abstract

The present invention relates to an electronic device having a multi-functional human interface and a method for editing a document using the same. The electronic device includes: a plurality of buttons that receives a push input in a vertical direction from a user and are arranged in a keyboard layout; an electrode positioned at a lower area of the key cap to sense a touch input from the user; a plurality of switches which are arranged at a lower portion of the plurality of buttons in the keyboard layout to receive a key input as the push input is provided; and a controller. The controller operates in any one of a first mode, which is a mode to input a text into a text field, to obtain information on the key input from the plurality of switches, and to obtain a key value based on information on the key input, and a second mode which is a mode to adjust a position of a cursor indicating a position for inputting the text into the text field, to obtain information on the touch input from the electrode, to obtain touch coordinates based on information on the touch input, and to obtain information on cursor movement based on the touch coordinates. In the second mode, the controller obtains first touch coordinates and second touch coordinates at a first time point and a second time point after the first time point, and to obtain information on the cursor movement corresponding to a position relationship between a first button belonging to the first touch coordinates and a second button belonging to the second touch coordinates based on the first touch coordinates and the second touch coordinates.

Description

Electronic device equipped with a composite human interface and a document editing method using the same {ELECTRICAL DEVICE HAVING MULTI-FUNCTIONAL HUMAN INTERFACE AND METHOD FOR EDITING DOCUMENT USING THE SAME}

The present invention relates to an electronic device equipped with a composite human interface and a document editing method using the same, and more particularly, to an electronic device providing a user interface for text input and cursor manipulation, and a document editing method using the same.

Recently, input devices such as a digitizer using a physical keyboard, a virtual keyboard, and a touch sensor for text input in personal computers or portable digital devices have been disclosed. In particular, in a touch-sensitive computing device with a virtual keyboard, a method for controlling a cursor movement by providing a touch gesture by a user has been disclosed.

However, in the case of the conventional text input device, the position of the cursor was designated using a mouse pointing device provided separately from the text input device. Accordingly, the work efficiency for text input is deteriorated in a work environment in which a command input operation is repeatedly performed between a text input device and a mouse pointing device.

An object of the present invention is to provide an electronic device equipped with a complex human interface that selectively performs a text input mode and a cursor operation mode, and a document editing method using the same.

Another object of the present invention is to provide an electronic device equipped with a complex human interface capable of providing tactile feedback so that a user can determine a cursor movement in a cursor operation mode, and a document editing method using the same.

The problem to be solved by the present invention is not limited to the above-described problems, and the problems not mentioned will be clearly understood by those having ordinary knowledge in the technical field to which the present invention pertains from this specification and the accompanying drawings. .

According to an aspect of the present application, including a key cap for receiving a push input in the vertical direction from the user, a plurality of buttons arranged in accordance with the keyboard layout, located in the lower region of the key cap, the electro to sense the touch input from the user De, a key input from the plurality of switches as a mode for inputting text into a text field and a plurality of switches that are arranged along the keyboard layout under the plurality of buttons and acquire key input as the push input is provided A first mode for acquiring information on and obtaining a key value based on the information on the key input and a mode for adjusting a position of a cursor indicating a position to enter the text on the text field from the electroload Acquiring information about the touch input and relating to the touch input Operate in any one of the second modes of acquiring touch coordinates based on information and obtaining cursor movement information based on the touch coordinates, but in the second mode: a first time point and later than the first time point A first touch coordinate and a second touch coordinate are respectively obtained at a second time point, and a first button to which the first touch coordinate belongs and the second touch coordinate to belong to based on the first touch coordinate and the second touch coordinate belong to An electronic device with a composite human interface including a controller, characterized in that the cursor movement information corresponding to the positional relationship between the second buttons is acquired may be provided.

In addition, according to an aspect of the present application, a key input is received according to the elevation of a plurality of buttons arranged according to a keyboard layout, and a touch input is received using a capacitive sensor installed on at least a portion of the keyboard layout. A document editing method performed by an electronic device equipped with a composite human interface, comprising: a first mode for inputting text into a text field and a control for controlling a position of a cursor indicating a position to enter the text on the text field Entering any one of the two modes, and when entering the first mode, a key value to be converted into the text to be input at a position where the cursor is placed on the text field based on information about the key input Acquiring and when entering the second mode, based on information on the touch input And obtaining cursor movement information indicating the movement of the cursor disposed on the text field, wherein obtaining the cursor movement information comprises: belonging to a first touch coordinate according to a touch input input at a first time point. Generating the cursor movement information corresponding to a positional relationship between a first button and a second button to which a second touch coordinate according to a touch input input at a second time point after the first time point belongs; Methods can be provided.

In addition, according to an aspect of the present application, a display for outputting a document application including a text field in which text is input and a cursor indicating a position in which the text is to be input on the text field, arranged according to a keyboard layout and according to elevation A first mode for inputting text into a text field and an input module including a plurality of buttons for receiving a key input and a capacitive sensor installed on at least a part of the keyboard layout and receiving a touch input, and on the text field Performs any one of the second modes for adjusting the position of the cursor indicating the position where the text is to be input, but when the first mode is entered, the text field is based on the key input information. Outputs text at the position where the cursor is placed, and enters the second mode. In one case, between the first button to which the first touch coordinate according to the touch input input at the first time belongs and the second button to which the second touch coordinate according to the touch input input at the second time after the first time belongs. An electronic device having a composite human interface including; a controller for moving the cursor on the text field to correspond to a positional relationship may be provided.

The solving means of the subject matter of the present invention is not limited to the above-mentioned solving means, and the solving means not mentioned will be clearly understood by those skilled in the art from the present specification and the accompanying drawings. Will be able to.

According to the present invention, by performing the text input mode and the cursor operation mode on a single device, it is possible to improve the work efficiency when writing a document compared to the text input and cursor operation performed by separate devices.

According to the present invention, when the user manipulates the movement of the cursor, the position of the cursor can be accurately manipulated by allowing the user to judge not only visual information about the cursor provided on the display but also tactile information by touch input provided to the device. have.

The effects of the present invention are not limited to the above-described effects, and the effects not mentioned will be clearly understood by those skilled in the art from the present specification and the accompanying drawings.

1 is an exemplary view of the configuration of a touch layer-integrated text input device according to an embodiment of the present invention.
2 is a block diagram of a composite function input button according to an embodiment of the present invention.
3 is an embodiment of an electroload of a composite function input button according to an embodiment of the present invention.
4 is an example of configuration of a touch layer-integrated text input device according to an embodiment of the present invention.
5 is an embodiment of an operation mode of a text input device integrated with a touch layer according to the present invention.
6 is a flowchart illustrating an operation of a text input mode of a text input device integrated with a touch layer according to an embodiment of the present invention.
7 is a flowchart illustrating an operation of a cursor operation mode of a text input device integrated with a touch layer according to an embodiment of the present invention.
8 is an embodiment showing a direction of a cursor movement according to a user's touch input.
9 is an example of a distance of a cursor movement according to a user's touch input.
10 and 11 are exemplary views showing a distance relationship between touch points provided to each of different buttons.
12 and 13 are examples of a cursor movement according to a touch input.
14 is a flowchart illustrating an operation of a pointer manipulation mode of a text input device integrated with a touch layer according to an embodiment of the present invention.
15 is an embodiment of a keyboard layout in which a plurality of key grooves are formed.
16, 17, and 18 are views illustrating a unit movement distance of a cursor movement according to an embodiment of the present invention.
19 is a flowchart illustrating a unit moving distance of a cursor based on a touch input speed according to an embodiment of the present invention.
20 and 21 are exemplary embodiments showing differences in cursor movement according to a single gesture or a plurality of gestures.
22 is an example of a configuration of an electronic device having a composite human interface according to an embodiment of the present invention.
23 is a flowchart illustrating a document editing method performed by an electronic device according to the present invention.

Since the embodiments described in this specification are intended to clearly explain the spirit of the present invention to those skilled in the art to which the present invention pertains, the present invention is not limited by the embodiments described in the present specification. The scope of should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terminology used in the present specification selects a general terminology that is currently widely used in consideration of the functions in the present invention, but this varies depending on the intention, customs, or the emergence of new technologies, etc. of those skilled in the art to which the present invention pertains. You can. However, if a specific term is defined and used in an arbitrary way, the meaning of the term will be described separately. Therefore, the terms used in this specification should be interpreted based on not only the names of simple terms, but also the actual meaning of the terms and contents throughout the present specification.

The drawings attached to the present specification are intended to easily describe the present invention, and the shapes illustrated in the drawings may be exaggerated and displayed as necessary to aid understanding of the present invention, and the present invention is not limited by the drawings.

In the present specification, when it is determined that detailed descriptions of known configurations or functions related to the present invention may obscure the subject matter of the present invention, detailed descriptions thereof will be omitted as necessary.

According to an aspect of the present application, a key cap receiving a push input in a vertical direction from a user, a plurality of buttons arranged in accordance with a keyboard layout, located in a lower region of the key cap, and an electric load sensing a touch input from the user , A mode for inputting text into a text field and a plurality of switches that are arranged along the keyboard layout under the plurality of buttons and acquire key input as the push input is provided, from the plurality of switches to the key input. A first mode for acquiring information on the key input and obtaining a key value based on the information on the key input, and a mode for adjusting a position of a cursor indicating a position to enter the text on the text field. Acquiring information about touch input and relating to the touch input Operate in any one of the second modes for acquiring touch coordinates based on the beam and obtaining cursor movement information based on the touch coordinates, but in the second mode: the first time point and later than the first time point A first touch coordinate and a second touch coordinate are respectively obtained at a second time point, and a first button to which the first touch coordinate belongs and the second touch coordinate to belong to based on the first touch coordinate and the second touch coordinate belong to An electronic device having a complex human interface including a controller, characterized in that the cursor movement information corresponding to the positional relationship between the second buttons is acquired.

The cursor movement information includes at least cursor movement direction information, and the controller displays the cursor movement direction information in a direction in which the second button is positioned from the first button along a length direction and a width direction on the keyboard layout. An electronic device having a composite human interface that is acquired so as to correspond may be provided.

The controller acquires the cursor movement direction information indicating the left and right directions on the text field when the direction in which the second button is located is the length direction on the keyboard layout from the first button, and from the first button When the direction in which the second button is located is the length direction on the keyboard layout, an electronic device having a composite human interface for acquiring the cursor movement direction information indicating the up and down direction on the text field may be provided.

When the controller belongs to the same row as the first button on the keyboard layout, the controller acquires the cursor movement direction information indicating left and right directions on the text field, and the same column as the first button on the keyboard layout If it belongs to, an electronic device having a composite human interface for acquiring the cursor movement direction information indicating the up and down direction on the text field may be provided.

The controller has a complex human interface for acquiring the cursor movement information so that the cursor moves on the text field in response to a button spacing in which the second button is spaced apart from the first button according to a length direction and a width direction on the keyboard layout. Provided electronic devices may be provided.

The cursor movement information includes at least cursor movement distance information, and the controller moves the cursor movement such that the second button is spaced apart from the first button according to a length direction and a width direction on the keyboard layout. An electronic device having a composite human interface for obtaining distance information may be provided.

The controller has an electronic device equipped with a composite human interface for acquiring the cursor movement information as many as the number corresponding to a button spacing in which the second button is spaced apart from the first button according to a length direction and a width direction on the keyboard layout. Can be provided.

The controller is a mode for adjusting the position of a pointer that designates a point at which a pointing execution command is performed, and acquires information on touch coordinates based on information on touch inputs obtained from the electric rod, and acquires touch coordinates Further operating in a third mode for acquiring the movement information of the pointer based on the information on the information, the information on the acquired touch coordinates is the third touch coordinates obtained at the third time point, and the second after the third time point It includes the fourth touch coordinates acquired at four time points, and when the controller operates in the third mode, the movement information of the pointer is acquired according to a relative positional relationship between the third touch coordinates and the fourth touch coordinates. An electronic device having a composite human interface may be provided.

Among the plurality of buttons, adjacent to each other, a key groove for physically separating the adjacent buttons is formed, and when the touch input of the slide touch type is applied to the controller, the slide touch type of touch input is applied. The cursor movement information is output in response to a point in time when the touch coordinates of the key pass through the key groove formed between the first button and the second button, and the key groove, to the user, the text field according to the cursor movement information An electronic device having a composite human interface providing tactile feedback indicating that the movement of the cursor is indicated on the screen may be provided.

The controller may be provided with an electronic device equipped with a complex human interface for acquiring the cursor movement information as a unit movement distance of any one of a character distance, a word distance, or a paragraph distance according to a predetermined criterion.

The predetermined criterion may be an electronic device equipped with a composite human interface, which is a criterion for acquiring cursor movement information based on the speed of a slide touch input having a sliding form.

The controller: when the speed of the slide touch input is included in the first speed range, acquires the cursor movement information so that the cursor moves based on the character distance, and the speed of the slide touch input is within the second speed range. When included, the cursor movement information is acquired so that the cursor moves based on the word distance, and when the speed of the slide touch input is included in a third speed range, the cursor moves so that the cursor moves based on the text distance An electronic device having a composite human interface for obtaining movement information may be provided.

The predetermined criterion may be an electronic device equipped with a composite human interface, which is a criterion for obtaining cursor movement information based on the number of touch points defined by the touch input.

The controller: if the number of touch points is the first number, acquires cursor movement information such that the cursor moves based on the character distance, and when the number of touch points is the second number, the cursor is the word distance Provided is an electronic device equipped with a composite human interface for acquiring cursor movement information to move based on and obtaining cursor movement information to move the cursor based on the short distance when the number of touch points is a third number Can be.

The controller acquires the cursor movement information such that the cursor moves a first unit distance when the touch input is provided as a single gesture, and when the touch input is provided as two or more gestures, the controller according to a predetermined criterion. An electronic device having a composite human interface for acquiring the cursor movement information to move a second unit distance corresponding to a one unit distance may be provided.

The controller enters either the first mode or the second mode according to a predetermined mode switching criterion, wherein the predetermined mode switching criterion is an input operation including at least one of the touch input or the push input. An electronic device having a composite human interface based thereon may be provided.

The controller, the first touch coordinates and the second touch coordinates are different, but do not output the cursor movement information to maintain the position of the cursor when the same as the first button and the second button, the first An electronic device having a composite human interface for outputting the cursor movement information may be provided so that the position of the cursor is changed when the button is different from the second button.

In the second mode, the controller acquires third touch coordinates belonging to a third button and fourth touch coordinates belonging to a fourth button at a third time point and a fourth time point that is later than the third time point, respectively. Although the distance between the first touch coordinate and the second touch coordinate is greater than the distance between the third touch coordinate and the fourth touch coordinate, the distance between the first button and the second button is between the third button and the fourth button. If the distance is smaller than the distance, the movement distance of the cursor between the first time point and the second time point is smaller than the movement distance of the cursor between the third time point and the fourth time point. The device can be provided.

The controller may be provided with an electronic device having a composite human interface that outputs the key value or the cursor movement information to a module or external device that executes a document application that includes the text field.

The plurality of buttons is coupled to the lower portion of the keycap, and includes a button body that moves up and down by the push input, and the electrode is interposed between the keycap and the button body, and included in each of the plurality of buttons. An electronic device having a composite human interface characterized by the above may be provided.

The electronic rod may be provided with an electronic device having a composite human interface, characterized in that included in the plurality of switches.

According to another aspect of the present application, a key input is received according to the elevation of a plurality of buttons arranged according to a keyboard layout, and a touch input is received using a capacitive sensor installed on at least a part of the keyboard layout. A document editing method performed by an electronic device equipped with a composite human interface, comprising: a first mode for inputting text into a text field and a control for controlling a position of a cursor indicating a position to enter the text on the text field Entering any one of the two modes, and when entering the first mode, a key value to be converted into the text to be input at a position where the cursor is placed on the text field based on information about the key input Acquiring and when entering the second mode, based on information on the touch input And obtaining cursor movement information indicating the movement of the cursor disposed on the text field, wherein obtaining the cursor movement information comprises: belonging to a first touch coordinate according to a touch input input at a first time point. And generating the cursor movement information corresponding to a positional relationship between a first button and a second button to which a second touch coordinate according to a touch input input at a second time point after the first time point belongs. This can be provided.

The cursor movement information includes at least cursor movement direction information, and the cursor movement direction information is a document corresponding to a direction in which the second button is located from the first button along a length direction and a width direction on the keyboard layout. Editing methods may be provided.

In the text field indicated by the cursor movement information, the movement distance of the cursor is a document editing method corresponding to a button spacing in which the second button is spaced apart from the first button in the length and width directions on the keyboard layout. Can be provided.

When the first button and the second button are different, a document editing method for performing the generating step may be provided.

The obtaining of the cursor movement information may include: a third button to which a third touch coordinate according to the touch input input at the third time point and a fourth touch according to the touch input input at a fourth time point after the third time point; Further comprising the step of generating the cursor movement information corresponding to the positional relationship between the fourth button to which the coordinates belong, the distance between the first touch coordinates and the second touch coordinates is the third touch coordinates and the fourth touch coordinates Cursor movement information corresponding to a positional relationship between the first button and the second button when the distance between the first button and the second button is smaller than the distance between the third button and the fourth button The cursor indicated by the cursor movement information corresponding to the positional relationship between the third button and the fourth button is the moving distance of the cursor indicated by It may provide a way to edit documents smaller than the distance traveled.

According to another aspect of the present application, a display for outputting a document application including a text field in which text is input and a cursor indicating a position in which the text is to be input in the text field;

An input module including a plurality of buttons arranged according to a keyboard layout and receiving key input according to elevation and a capacitive sensor installed on at least a part of the keyboard layout and receiving touch input; And

Perform one of a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position to enter the text on the text field, but enter the first mode In one case, based on the information on the key input, the text is output to the text field at the position where the cursor is placed, and when the second mode is entered, the first touch according to the touch input input at the first time point A controller that moves the cursor on the text field to correspond to a positional relationship between a first button to which a coordinate belongs and a second button to which a second touch coordinate according to a touch input input at a second time point after the first point belongs; An electronic device having a composite human interface including a may be provided.

1. keyboard

1-1 Overview

Hereinafter, an electronic device equipped with a composite human interface and a document editing method using the same will be described according to an embodiment of the present disclosure.

The present invention relates to an electronic device equipped with a composite human interface and a document editing method using the same, and more particularly, to a touch layer-integrated text input device providing a user interface for text input and cursor manipulation, and a document editing method using the same. It is related.

2. Description of the Related Art As a conventional text input device, a physical keyboard composed of a plurality of physical buttons each equipped with an elastic body and a switch and outputting data on text based on a push input authorized by a user is widely used.

Recently, a touch interface means for displaying desired data on a display based on a touch input provided on a touch screen from a user as well as a keyboard composed of physical buttons has been widely used. When a virtual keyboard is displayed on a display on a digital device equipped with the touch interface and a part of the user's body is touched on the virtual keyboard displayed on the display, a user's gesture or electrical signal is sensed and touched by the user. A method of inputting text on a virtual keyboard displayed in a part is also used.

Examples of a touch interface capable of receiving a touch input include a pressure-sensitive touch, a capacitive touch screen, an optical touch screen, and an ultrasonic touch screen.

Various touch input technologies that can be used to control location information of a pointer or cursor by recognizing location information of a part of the user's body by detecting a user's contact or movement may be used in the present invention.

1-2 Physical Configuration

1 is an exemplary view of the configuration of a touch layer-integrated text input device according to an embodiment of the present invention.

Referring to FIG. 1, a touch layer-integrated text input device according to an embodiment of the present invention may have a text input device and a housing 100 for supporting a touch location information input area.

The touch layer-integrated text input device is physically divided, and may be configured with a plurality of buttons for receiving text input information from a user. The plurality of buttons may be referred to as a composite function input button.

The plurality of buttons may form a key groove 109 having a predetermined groove shape. Here, the key groove may provide information that each button is a separate area to the user through tactile information when the user provides touch or push input. The details of the key groove will be described later with reference to FIG. 15.

The touch layer-integrated text input device may have a touch layer including a text input area 107a and at least a portion as a common area and a touch location information input area 108a. The touch layer may receive a touch input provided by a user.

The touch location information input area is an area located on the top or bottom of the button or for the text input, and as shown in FIG. 1, the touch location information input area may have at least a part in common with the text input area.

2 is a block diagram of a composite function input button according to an embodiment of the present invention.

The touch layer-integrated text input device according to an embodiment of the present invention may include a plurality of complex function input buttons.

Referring to FIG. 2, the composite function input button is a key cap 1010 where a user's finger touches, an electric rod part 1020 including a transmitter and a receiver for forming an electric field, and protects the electric rod part and communicates with a button body. It may be composed of a button body 1040 that supports the lower portion of the intermediary unit 1030 and buttons for securing connectivity and can be elevated when a push input is provided.

The button body may include an upper support portion 1042, an elastic body 1044, and a lower support portion 1046. The upper support portion and the lower support portion may move the position through the elastic body, and the lower support portion may guide the movement of the upper support portion.

3 is an embodiment of an electroload of a composite function input button according to an embodiment of the present invention.

The capacitive touch type electrode part is composed of a plurality of transmitters and receivers forming a grid shape with each other. In addition, a drive signal for inducing electrostatic capacitance is applied to the electroload unit, and a scan line for detecting a change in capacitance that may occur when a touch input is provided may be formed.

The electroload section includes first transmitters 1101, 1102, 1103 with a first drive period, second transmitters 1104, 1105, 1106 with a second drive period, and third transmitters 1107, 1108 with a third drive period. , 1109).

Here, the period may mean a timing at which a signal is generated.

It may have a first receiver (1110, 1111) having a first scan cycle, a second receiver (1112, 1113) having a second scan cycle.

The first and second receivers may be configured to be printed on a circuit board in a state of being short-circuited to each other and connected to separate connection members, or to independently scan electrical signals such as capacitance at the same scan cycle.

In the case of a typical capacitive touchpad, receivers having one scan cycle are interconnected. However, in the present embodiment, the first receiver having one scan period is composed of at least two receiver blocks 1110 and 1111, and the at least two receiver blocks transmit a scan signal to the outside in a state of being short-circuited with each other. can do.

The scan signal may be processed by summing the capacitive signals received from each receiver block.

The transmitter and receiver may be electrically shorted to the insulators 1114 and 1115.

The electrorod portion may be implemented by being included in a plurality of switches according to the present invention. For example, the plurality of switches may be provided with a touch input of an electrostatic touch method. That is, according to an example, the plurality of switches may be formed with a scan line for detecting a change in capacitance that may occur when a drive signal for inducing capacitance is applied and a touch input is provided.

The electro-rod unit may include a bridge 1120 that transmits and receives external drive signals and scan signals that are stacked or connected downward. The bridge may transmit a drive signal to the electroload unit and receive a capacitive signal from the receiver.

1-3 Functional Configuration

4 is an example of configuration of a touch layer-integrated text input device according to an embodiment of the present invention.

Referring to FIG. 4, the touch layer-integrated text input device 2000 according to an embodiment of the present invention inputs a key 2100 that receives a push input or a touch input from a user, and a key input according to a drop of a button according to a push input The switch 2200 for obtaining information about the electrical connection member 2300 and the capacitance change forming the circuit layer 2400 for obtaining a change in capacitance according to the touch input of the electrode 2120 included in the button. It may include a controller 2500 for performing various types of information including the calculation of the touch coordinate information and electrical signal processing.

At this time, the push input is provided to any one or more of the plurality of buttons 2100 arranged according to the keyboard layout, which can elevate the button 2100 by contracting the elastic body. In addition, the push input may mean applying physical pressure on the input device to provide information that the user wants to input.

At this time, the touch input is one of input methods in which contact occurs by a part of the body provided by the user and information is recognized based on the change caused by the contact. The touch input may refer to a user input that induces a change in the electrostatic capacity of the electric rod 2120 embedded in the button or located in the lower region of the button. In this case, a case where the change in the electrostatic capacity is equal to or greater than a predetermined touch threshold value can be understood as a touch input.

The touch layer-integrated text input device 2000 is arranged according to a keyboard layout, and may include a plurality of buttons 2100 separated by physical grooves. Here, the button may be a composite function input button described with reference to FIG. 1.

The touch layer-integrated text input device 2000 may be provided in the form of a keyboard as illustrated in FIG. 1, or in the form of a laptop combined with a display and a keyboard.

According to an embodiment, the button may include a keycap 2110, an electrode 2120, and a button body 2130. Here, the key cap 2110 and the button body 2130 are disposed on the upper and lower portions, respectively, and the electric rod 2120 may be interposed between the key cap 2110 and the button body 2130. That is, the button 2100 may be provided by stacking and combining the keycap 2110, the electric rod 2120, and the button body 2130 in order.

The keycap 2110 is exposed on the upper portion of the button 2100, and may directly contact an input provided by a user. The button body 2130 is disposed under the key cap 2110, and when a push input of a predetermined pressure or higher is provided to the key cap 2110 by the user, the button body 2 is lifted to switch 2200 arranged under the button 2100. Can provide electrical changes.

The electric rod 2120 may be located in the lower region of the keycap 2110. According to an embodiment, the electrode 2120 may be interposed between the keycap 2110 and the button body 2130 or may be located under the button 2100. When the touch input is provided to the keycap 2110, the electroload 2120 changes the electrostatic capacity thereby, so that the touch input can be sensed.

The switch 2200 is located at the bottom of the button. The switch 2200 may be pressed by a push input provided to the keycap 2110 by a user, and accordingly, information regarding a key input corresponding to each switch 2200 may be obtained.

According to an example, the electric rod 2120 may be included in the switch 2200. In this case, when the touch input is provided to the keycap 2110, the switch 2200 changes the electrostatic capacity due to this, and can sense the touch input accordingly.

The electrical connection member 2300 may form a circuit layer 2400 by electrically connecting the plurality of buttons 2110. Here, the electrical connection member 2300 may be implemented through a pattern printed on the FPCB, or may be in the form of conductors respectively installed on a board on which a switch is installed and a button for lifting.

The circuit layer 2400 may provide an electrical signal received from the button 2100 to the controller 2500. That is, the circuit layer 2400 may obtain information regarding a change in capacitance provided from the electroload 2120, and provide information for calculating the position of the touch input provided by the user to the controller 2500.

The controller 2500 may perform processing of various information and electrical signals including calculation of touch coordinate values based on changes in capacitance. For example, in one embodiment, cursor movement information or a key value for text input may be output. The controller 2500 may be implemented as a CPU or a similar device according to hardware or software or a combination thereof. The controller 2500 may be provided in the form of an electronic circuit that performs an electrical control function by processing an electrical signal. In addition, the controller 2500 may be provided in the form of a program, application, firmware, etc., which are processed by the hardware controller 2500 in software.

The controller 2500 may perform electronic signal processing, information processing, and calculation. Accordingly, the controller 2500 may process the overall operation of the touch layer-integrated text input device 2000 or control each component of the touch-layer integrated text input device 2000. For example, the controller 2500 may obtain information on a change in capacitance, that is, information on a touch input, from the circuit layer 2400 to calculate a touch coordinate value. As another example, the controller 2500 may perform a mode switching operation of the text input device 2000 integrated with a touch layer.

In addition, the controller 2500 may process and perform various functions or operations of the touch layer-integrated text input device 2000. A more detailed description of this will be described later. Meanwhile, in the present specification, a function or operation of the touch layer-integrated text input device 2000 may be interpreted as being performed by the control of the controller 2500 unless otherwise specified.

2. Operation mode

2-1 Overview

5 is an embodiment of an operation mode of a text input device integrated with a touch layer according to the present invention.

Referring to FIG. 5, the touch layer-integrated text input device according to an embodiment of the present invention may operate in a text input mode, a cursor manipulation mode, and a pointer manipulation mode.

Here, in the text input mode, a user of the touch layer-integrated text input device according to the present invention provides a push input in a vertical direction to buttons arranged according to a keyboard layout, and a button descending by the push input operates a switch This mode is to provide keyboard input that reflects the key value assigned to the button to which push input is applied according to the method.

In addition, in the cursor operation mode, a user of a touch layer-integrated text input device according to the present invention performs touch input on a touch area formed by an electrode, thereby providing information about a cursor movement and moving the cursor based on the information. It is a mode to control.

The pointer manipulation mode provides information on a touch position of the pointer by performing a touch input on a touch area formed by an electrode of a user of the touch layer-integrated text input device according to the present invention. In this mode, the position of the pointer is adjusted by acquiring movement information of the pointer.

Hereinafter, three modes of the touch layer-integrated text input device will be described in more detail.

2-2 Text input mode

6 is a flowchart illustrating an operation of a text input mode of a text input device integrated with a touch layer according to an embodiment of the present invention.

The touch layer-integrated text input device may enter a text input mode (S3100). Here, the controller of the text input device integrated with the touch layer may enter the text input mode according to a predetermined criterion.

The touch layer-integrated text input device may obtain a push input from a user (S3200).

The plurality of switches located at the bottom of the button may acquire information on key input as the button is elevated (S3300). Accordingly, the touch layer-integrated text input device may acquire information on key input from the plurality of switches in order to input text into the text field.

At this time, the text field may mean an area in which text data can be input. The text field may be an area for inputting text on an application program for creating a document including text data. In addition, the text field may be included in a document application for creating a document.

Alternatively, the text field may mean an inner area of the text box in a text box including a text input available area created on an application for which text input is not permitted.

At this time, the information on the key input is information on a key value corresponding to each of the plurality of buttons. A single key value or two or more key values may be assigned to one button. Therefore, the above-mentioned key input information may be interpreted as at least corresponding to a key value assigned to a key provided with a push input.

For example, a key value corresponding to an uppercase English letter “A”, an English lowercase letter “a”, and a Korean vowel “ㅁ” may be assigned to the button “A” on the keyboard layout, and when predetermined conversion buttons are input, Can be converted Accordingly, when a push input is provided to the keyboard button "A", the information on the assigned key input may correspond to key information for the English uppercase letter "A", the English lowercase letter "a", and the Hangul vowel "ㅁ".

The touch layer-integrated text input device may obtain a key value based on the information on the key input so that the display device can display the text to be output (S3400).

Here, the controller may acquire a key value displayed on the display device. The key value obtained by the controller can be controlled by the display controller. The display controller may be referred to as a control unit. The display controller may instruct the display to display the key value provided. The display device may display the indicated key value at the point where the cursor is located on the text field.

2-3 Cursor operation mode

2-3-1 Overview

7 is a flowchart illustrating an operation of a cursor operation mode of a text input device integrated with a touch layer according to an embodiment of the present invention.

The touch layer-integrated text input device according to the present invention may enter a cursor manipulation mode (S4100). The controller of the touch layer integrated text input device may enter a cursor manipulation mode according to a predetermined criterion.

The touch layer-integrated text input device may acquire a touch input from a user (S4200). The touch layer-integrated text input device may include a touch layer capable of receiving a touch input provided by a user on a keyboard layout.

The electroroad may detect information regarding touch input of a touch input point detected on the touch layer. At this time, the electrode may be located under the keycap of the button. The electro-rod unit may detect an electrostatic change due to a touch of a part of the user's body and obtain location information on the changed point. The location information may be location information on a touch point or direction and distance information based on a specific reference point.

The information related to the touch input may be information about an area corresponding to a predetermined range centering on a point corresponding to the touch input point. For example, when forming a virtual X-axis and a Y-axis using the coordinate point at the lower left of the English uppercase letter "A" as the origin, it may be location information for a point corresponding to the coordinates of (1, 2).

Alternatively, the information related to the touch input may be a button corresponding to the touch input point. For example, when a touch input is provided at a center point of the key “A” in English, the information regarding the touch input may be the key “A”.

The controller may receive information related to the touch input (S4300). The information related to the touch input may be provided from the circuit layer as described above. In addition, the controller may acquire information about touch coordinates based on the received information about the touch input.

The controller may acquire cursor movement information indicating the movement of the cursor based on the acquired information about the touch coordinates. (S4400)

At this time, the cursor movement information is information for determining the position of the cursor, and may include at least direction information or distance information. The direction information may be information corresponding to directions of up, down, left, and right where the cursor is to be moved. The distance information may be information corresponding to a distance to which the cursor is moved. For example, when three cursors are moved to the right when the cursor is based on a specific location, the direction information may be “right” and the distance information may be “three character distances”. In this case, the distance information may be distance information specified based on a predetermined reference unit. For example, when obtaining distance information for moving a unit distance of "3", the cursor can move three paragraphs when the predetermined criterion is a paragraph criterion, and the cursor is three characters when the predetermined criterion is a character distance criterion The distance can be moved. Details of the predetermined criteria will be described later.

The cursor may indicate an object waiting for input by designating a location for inputting text. That is, it may be one of the user interface means as a pointer designating a location where text is to be input on a text field.

The cursor may be displayed as a vertical line or bar shape blinking at a predetermined time interval on a location where a text input location is generally specified. Alternatively, the cursor may be displayed in a rectangular shape, and may be displayed as a horizontal line having a size corresponding to the text size in the horizontal direction at the lower portion of the text input position. However, the cursor is not limited in shape, and may be differently expressed according to an execution program for executing text input or an operating system for executing a command.

2-3-2 Direction of cursor movement

8 is an embodiment showing a direction of a cursor movement according to a user's touch input.

The touch layer-integrated text input device according to the present invention may have a keyboard layout, and the keyboard layout may have a rectangular shape.

Referring to FIG. 8, the keyboard layout may have a rectangular shape in which the horizontal length is longer than the vertical length, based on the direction in which the user touches the touch layer-integrated text input device. At this time, the horizontal direction of the rectangle may be referred to as a length direction, and the vertical direction of the rectangle may be referred to as a width direction.

The touch layer integrated text input device may include a plurality of buttons to which key values are assigned to correspond to positions on a row and column on the keyboard layout. The furnace refers to a row direction and may correspond to the horizontal direction. The column may correspond to the vertical direction in an expression indicating the longitudinal direction.

For example, a button located in the same column as a specific button may refer to a button overlapping at least a part of a virtual area extending in a vertical direction based on the specific button. In addition, a button located in the same row as a specific button may refer to a button in which at least a portion of a virtual area and a region extending in a horizontal direction based on the specific button overlap.

Referring to FIG. 8, the first button 210 and the second button 220 are buttons located on the same road, and the first button 210 is the third button 230 and the fourth button 240 Each may be a button located in the same column. In the third button 230 and the fourth button 240, at least a portion of a lower surface of the first button 210 means an adjacent button, but regions of adjacent surfaces may be different from each other. That is, when two or more buttons overlap in at least some areas in the vertical direction, the two or more buttons may be buttons located in the same column.

The touch layer-integrated text input device according to the present invention can determine the direction of a cursor movement through a positional relationship between buttons each including touch input points acquired at different times.

Referring to FIG. 8, the direction of the cursor movement is after the first button 210 including the touch input coordinate provided at the first time point on the touch layer-integrated text input device according to the present invention and after the first time point It may be determined based on the positional relationship of the second button 220 including the touch input coordinate provided at the second time.

The first button 210 may correspond to a touch input point provided at the first time point and the second button 220 may correspond to a touch input point provided at the second time point. At the first time point, the cursor may be positioned at a first cursor point, and at the second time point, the cursor may be positioned at a second cursor point.

The second button 220 may be located on the left side based on the first button 210. That is, the first button 210 is located on the same row as the second button 220 but may be located on the left side, and accordingly, the controller receives direction information of the cursor movement that causes the cursor to face to the left. Can be obtained. That is, the position of the cursor may be moved in the left direction corresponding to the direction from the first button to the second button.

The second cursor point may be located on the left side based on the first cursor point.

In this embodiment, the case where the direction of the cursor movement is left is illustrated, but the direction defined by the positional relationship between the plurality of buttons is not limited to this embodiment.

That is, when the second button 220 is positioned to the right when the second button 220 is referenced to the first button 210, the controller acquires cursor movement direction information to direct the cursor to the right, and is located in the same column, but is located at the top When located at, cursor movement direction information to point the cursor upward may be obtained, and when positioned at the same column but located at the bottom, cursor movement direction information to point the cursor downward may be obtained.

2-3-3 Cursor travel distance

9 is an example of a distance of a cursor movement according to a user's touch input.

Distance information of the cursor movement may be obtained based on a button interval between buttons provided with a touch input. The button spacing may be expressed as the number of buttons arranged between two buttons or the number of grooves formed between the buttons.

For example, the distance between the first touch point provided on the first button 310 at the first time point and the second touch point provided on the second button 320 at the second time point after the first time point is the first button. It may be defined as the number of buttons or grooves arranged between 310 and the second button 320.

Referring to FIG. 9, three buttons are arranged between the first button 310 and the second button 320 and four grooves are formed. That is, the first touch point and the second touch, even if a touch input is provided to the third touch point other than the first touch point, corresponding to the area of the first button 310 at the first time point The button spacing between points is the same as the button spacing between the third touch point and the second touch point.

Referring to FIG. 9, three buttons are arranged between the first button 310 and the second button 320, and the controller moves cursor movement information to move the cursor to a position separated by four characters Can output That is, the cursor may be moved to a position separated by four characters so as to correspond to information on the button spacing between the first button 310 and the second button 320. At this time, one space separated by words due to spaces can be treated as one character distance.

For example, referring to FIG. 9, the position of the cursor four characters away from the initial position of the cursor located after the “book”, which is the position of the initial cursor, may be the back column of “,” rather than the front column of “,”. .

However, it is a cursor movement distance corresponding to information on the spacing between buttons, and a distance at which the cursor is actually moved may be determined according to a predetermined criterion.

For example, even when a touch input is provided from the first button 310 to the second button 320, the cursor may move three word distances or three paragraph distances according to the predetermined criteria. Details of the predetermined criteria will be described later.

10 and 11 are exemplary views showing a distance relationship between touch points provided to each of different buttons according to an embodiment of the present invention.

Referring to FIG. 10, the first touch coordinate is a touch point provided at a first time point, and the first touch coordinate is included in an area corresponding to the first button 410. The second touch coordinates are touch points provided at a second time point after the first time point, and the second touch coordinates are included in an area corresponding to the second button 420.

At this time, since the first button 410 and the second button 420 are disposed adjacent to each other, the cursor moves to the first unit distance by the provided touch input. In this case, the first unit distance may be a text reference distance, a word reference distance, or a paragraph reference distance. In the embodiment disclosed in the figure, the position was shifted by one character distance. That is, since the first button 410 and the second button 420 are different buttons, and there is a position change in a button corresponding to a touch point, a cursor movement occurs.

11, the third touch coordinate is a touch point provided at a third time point, and the third touch coordinate is included in an area corresponding to the third button 415. In addition, the fourth touch coordinate is a touch point provided at a fourth time point after the third time point, and the fourth touch coordinate is included in an area corresponding to the third button 415. That is, the third touch point and the fourth touch point are located in an area corresponding to one button.

At this time, despite the change of the touch position from the third touch point to the fourth touch point, a cursor movement does not occur. Referring to FIG. 11, the position of the cursor may be the same as that of each cursor at the third time point and the fourth time point.

10 and 11, the shortest distance 470 between the first touch coordinates and the second touch coordinates has a value smaller than the shortest distance 475 between the third coordinates and the fourth touch coordinates. Even when the coordinates of the touch input provided by the user are changed, the location of the cursor may not change when the provided touch coordinates correspond to the same button, respectively.

2-3-4 Cursor movement distance and direction

12 and 13 are examples of a cursor movement according to a touch input.

12 and 13, the first touch coordinates obtained from the touch input provided at the first time point may be located in the inner region of the first button 510 and continue until the second time point after the first time point. Sliding touch input is provided. The second touch coordinates obtained from the touch input provided at the second time point may be located in the inner region of the second button 520. Three key grooves may be formed between the first button 510 and the second button 520. That is, two separate buttons may be disposed between the first button 510 and the second button 520.

For example, referring to FIG. 12, the controller may output cursor movement information based on the above-described button spacing. The controller may output cursor movement information indicating that the cursor on the display moves three spaces to the left by a positional relationship between the first button 510 and the second button 520. That is, when a touch input designated to the second button 520 is provided for a predetermined time or longer, the controller may output cursor movement information indicating the movement of the cursor to the left by 3 spaces based on a character.

Referring to FIG. 13, the controller may repeatedly output information instructing the cursor on the display to move to the left to correspond to information instructing to move three spaces to the left.

The second button 525 may have three button intervals spaced from the first button 515 to the left. Accordingly, the controller may output cursor movement information instructing the cursor to repeat the movement of one space based on the character three times in total.

As a result, even when the controller outputs cursor movement information indicating that the cursor moves the same distance, it may be command information indicating that two or more commands are repeatedly performed, and a single command indicating that the specified movement distance is moved. It may be command information.

2-4 Pointer operation mode

In the above, the text input mode and the cursor operation mode have been described as an operation mode of the touch layer-integrated text input device according to the present invention, but the touch layer-integrated text input device outputs pointer movement information for adjusting the position of the pointer. It can also operate in the pointer operation mode. The pointer may refer to an object designating a point at which a pointing execution command is performed. Here, the pointing execution command may mean a command, input, etc. for executing an application application disposed at a position corresponding to an area where a pointer is located on the display.

The pointer movement information may refer to an input mainly output from a mouse interface for adjusting the position of the pointer displayed on the display. For example, a personal computer or an electronic device such as a laptop, smart phone, or tablet may use mouse input to control the position of the pointer displayed on the display.

14 is a flowchart illustrating an operation of a pointer manipulation mode of a text input device integrated with a touch layer according to an embodiment of the present invention.

Referring to FIG. 14, the touch layer integrated text input device according to the present invention may enter a pointer manipulation mode (S5100). For example, when an input related to a push input, a touch input, or a combination thereof corresponding to a predetermined pointer manipulation mode conversion criterion is provided during operation in a text input mode, the touch layer-integrated text input device may enter a pointer manipulation mode. have. The predetermined pointer manipulation mode conversion criterion may be a method in which a push input is provided to a first mode conversion key that is one of a composite input button on a keyboard layout, and a touch input for displaying a predetermined gesture on a touch layer is provided. Can be However, the above-described example is not limited to this as one example of the pointer manipulation mode conversion method.

The touch layer-integrated text input device according to the present invention may receive a touch input from a user and obtain information about the touch input based on the approved touch input (S5200).

In addition, the controller of the touch layer-integrated text input device may acquire information on touch coordinates based on the information on the touch input (S5300). Here, the information on the touch coordinate may correspond to (x, y) form. Since the description of the controller has been described above with reference to FIG. 4, redundant content will be omitted.

The controller may calculate a coordinate change value based on the previous touch coordinates and the current touch coordinates (S5400). For example, when the touch layer-integrated text input device is operating in a pointer manipulation mode, a touch input in a sliding form may be provided until a third time point and a fourth time point after the third time point. The controller may calculate touch coordinates for each time point based on information regarding touch inputs provided at the third and fourth time points, and may calculate the touch coordinates for each time point from the third time point through a difference operation for each touch point value calculated. Coordinate variation values up to the fourth time point can be calculated. Here, the touch coordinates of the fourth time point are touch coordinates calculated from the scan signals obtained in the scan signal period of the fourth time point, and the touch coordinate values of the third time point are scan signals immediately before the scan signal period of the fourth time point. It may be a touch coordinate calculated from the scan signal acquired in the period. The calculated coordinate fluctuation value may be expressed as a relative positional relationship between the previous touch coordinates and the current touch coordinates.

The controller may acquire movement information of the pointer according to the calculated coordinate fluctuation value (S5500). The movement information may include at least a movement distance or a movement direction of the pointer.

The controller calculates touch coordinates related to the touch input point in real time based on the received touch input, obtains touch coordinate fluctuation values through difference calculation of the calculated touch coordinates, and displays based on the obtained touch coordinate fluctuation values. It is possible to output pointer movement information for adjusting the image pointer position.

3. Implementation example

3-1 key groove

15 is an embodiment of a keyboard layout in which a plurality of key grooves are formed.

The plurality of buttons to which individual key values are respectively assigned may be physically separated from each other. At this time, the plurality of buttons may be moved up and down by the elastic body included therein. The area of the plurality of buttons may be narrower from the bottom toward the top. According to an embodiment, each of the plurality of buttons may have a quadrangular pyramid shape, and a side surface may have a trapezoidal shape. Alternatively, each of the plurality of buttons may have a rectangular parallelepiped shape, and a side surface may have a rectangular shape.

A key groove 680 may be formed between the adjacent buttons among the plurality of buttons to physically separate the adjacent buttons. The key groove 680 may distinguish between adjacent buttons arranged in a length direction on the keyboard layout or between adjacent buttons arranged in a width direction of the keyboard layout.

The key groove 680 may provide tactile feedback to a user who provides a touch input to move the position of the cursor, indicating that the movement of the cursor is indicated according to information about the cursor movement.

At this time, the information about the cursor movement may include information about a moving direction or moving distance of the cursor.

Referring to FIG. 15, a key groove 680 may be formed between a first button 610 and a second button 620 arranged adjacent to the left side of the first button 610.

When a touch input is continuously provided to an area inside the button adjacent to the left side based on the button including the touch start point, the user can move the cursor to the left according to a predetermined criterion to move the first unit distance. The first unit distance may be a unit distance for a letter, word, or paragraph.

At this time, the key groove 680 formed in a predetermined groove shape may provide tactile information to the user through a part of the body, and based on the tactile information recognized by the user, the user may move the cursor to one button interval. It can be effectively recognized that a corresponding cursor movement has occurred.

For example, if the cursor is to be moved by a distance of three characters, the user may need to provide a sliding touch input between buttons spaced apart from three buttons. Referring to FIG. 15, a user may provide a touch input to the first button 610 and provide a sliding touch input to the fourth button 640 while maintaining the touch input on the keyboard layout.

At this time, there are three key grooves 680 formed between the first button 610 and the fourth button 640, and a button gap between the first button 610 and the fourth button 640 is provided. On the display corresponding to, the cursor may be moved by a second unit distance corresponding to three times the first unit distance. Even if the user does not acquire visual information, the user may move three character distances by acquiring tactile information that a part of the body providing the sliding touch input has passed three key grooves 680.

In this embodiment, the second unit distance is three character distances, but may be a movement distance to change the cursor position by three word distances or three paragraph distances according to a predetermined criterion, and the unit movement distance is limited to the above-described example Does not work.

3-2 Reference distance

3-2-1 character, word, paragraph distance

16, 17, and 18 are views illustrating a unit movement distance of a cursor movement according to an embodiment of the present invention.

In the touch layer-integrated text input device according to the present invention, even when the same touch input is provided by a user, different cursor movements may occur according to predetermined criteria. For example, the movement distance information of the cursor may be different according to the unit movement distance. The unit movement distance is a minimum unit that is a reference for a movement distance at which the cursor position is changed. The unit movement distance may include a character distance, a word distance, and a paragraph distance. 16, 17, and 18 are diagrams for a unit movement distance of a cursor movement, and are examples of cursor movements for character distance, word distance, and paragraph distance, respectively.

The unit movement distance may be changed by providing a push input or a touch input to the conversion keys 780 and 784. Each of the conversion keys 780 and 784 may be a specific button of the keyboard layout or a button provided separately from the keyboard layout.

Referring to FIG. 16, when a touch input is provided from the first button 710 to the second button 720, three button intervals are spaced between the first button 710 and the second button 720. , The cursor may be moved three spaces in units of characters in the direction from the first button 710 to the second button 720 to be positioned in the space behind “PC,”.

In comparison, referring to FIG. 17, while a push input is provided to a first conversion key 780 or a key combination including the conversion key 780, the touch is performed from the first button 712 to the second button 722. When input is provided, it may be moved three spaces by a word distance in a direction from the first button 712 to the second button 722.

At this time, the movement information of the cursor regarding the word distance may refer to cursor movement information that moves the cursor so that it is positioned at the front of each specific word.

In this embodiment, the cursor moves the character distance per button spacing on the keyboard layout when no push input is provided to the transform key, but includes a first transform key 780 or a first transform key 780. When providing push input to a key combination, the word distance per button spacing can be shifted.

Alternatively, referring to FIG. 18, when a touch input is provided from the first button 714 to the third button 734 according to a predetermined criterion, the cursor moves from the first button 714 to the third button 734. The paragraph may be changed by the number of units corresponding to the button spacing in the direction of the direction.

For example, when a push input is provided to a key combination including the second transform key 784 or the second transform key 784 corresponding to a specific key on the keyboard layout according to the predetermined criteria, the touch input The cursor movement distance unit corresponding to the corresponding button spacing can be set to a short circuit unit. In addition, when the first button 714 is used as a reference, the sliding touch input is provided to the third button 734 spaced apart by a button space of one column on the top, so that the cursor can be moved to the start point of the paragraph in which the cursor is located. .

The predetermined criterion may be a criterion for obtaining cursor movement information based on the number of touch points defined by the touch input. That is, the controller: acquires cursor movement information so that the cursor moves the character distance when the number of the touch points provided by the user is the first number, and the cursor when the number of the touch points is the second number The cursor movement information is acquired to move based on the word distance, and when the number of touch points is a third number, cursor movement information is acquired to move the cursor based on the paragraph distance. According to an example, when the provided touch input is a 2-point touch input, the controller acquires cursor movement information based on the character distance, but when the provided touch input is a 3-point touch input, the controller determines the word distance. As a reference, cursor movement information is obtained. When the provided touch input is a 4-point touch input, the controller may acquire cursor movement information based on the short-circuit distance.

Here, the two-point touch input may be a touch input provided for two different points spaced apart by a predetermined distance or more on the touch layer. For example, the two-point touch input may be a touch input in which a user's two fingers are spaced apart from each other by a predetermined distance or more to provide a touch input on a touch layer. The three-point or four-point touch input may be touch inputs provided at three or four different points, respectively.

As described above, a method for determining a cursor movement according to a predetermined criterion may include a case where a push input is provided to the first or second transform keys 780 and 784 and a case where a touch input is provided. It is not limited.

3-2-2 sliding speed

19 is a flowchart illustrating a unit moving distance of a cursor based on a touch input speed according to an embodiment of the present invention.

As described above, the unit movement distance of the cursor may include a character distance, a word distance, or a paragraph distance, and the unit movement distance may be changed according to a predetermined criterion. According to an embodiment, when a slide touch input in a sliding form is provided, the predetermined criterion may be a cursor movement acquisition criterion based on the speed of the slide touch input.

Referring to FIG. 19, the touch layer-integrated text input device according to an embodiment of the present invention enters a cursor manipulation mode (S1710), and a slide-type touch input may be provided (S1720). The slide-type touch input may be a swiping-type input in which continuous touch input is provided on a touch layer-integrated text input device.

The touch layer-integrated text input device may acquire information regarding a speed of a provided touch input (S1730). Information regarding the touch input speed may be obtained by the controller described above with reference to FIG. 4. The controller may receive information on a touch input in the form of a provided slide, and obtain touch coordinates based on the information on the approved touch input, and the speed of the touch input in the slide form based on the acquired touch coordinates. You can get information about.

The touch layer-integrated text input device may determine a unit movement distance of the cursor movement according to the speed of the provided touch input (S1740). For example, if the speed of the provided touch input is included in the first speed range, the unit movement distance of the cursor movement is a text distance, and if included in the second speed range, the unit movement distance of the cursor movement is a word distance, When included in the 3 speed range, the unit movement distance of the cursor movement may be a short circuit distance. Each of the first to third speed ranges may be a numerical range having an upper limit and a lower limit for the speed value, and may mean a speed greater than or less than a specific speed value. According to an embodiment, when the speed of the touch input in the form of a slide: corresponds to a predetermined reference speed range, the unit movement distance of the cursor movement is a word distance, and if it is smaller than a lower limit of the predetermined reference speed range, the unit of the cursor movement The movement distance is a character distance, and if it is larger than an upper limit of the predetermined reference speed range, the unit movement distance of the cursor movement may be a short distance.

The touch layer integrated text input device may acquire cursor movement information based on the determined unit movement distance (S1750). That is, the cursor movement information may be obtained based on the speed of touch input provided to the touch layer-integrated text input device according to the present invention.

3-3 gesture

20 and 21 are exemplary embodiments showing differences in cursor movement according to a single gesture or a plurality of gestures.

Gesture (gesture) is one of the communication methods performed by using the body. In the present specification, the gesture may mean the number of touch points, a touch shape, etc. occurring at the same time point defined by the touch input provided on the keyboard layout by the user, and other touch methods provided through the user's body. Can mean

The user can form a gesture using one or more fingers. A gesture for providing a touch input using a predetermined number of fingers may be referred to as a single gesture, and a gesture for providing a touch input for a separate button at the same time using at least a larger number of fingers than the predetermined number. Can be referred to as a plurality of gestures.

Referring to FIG. 20, the user may provide a single gesture touch input from the first button 810 to the second button 820. In this case, the cursor movement information may instruct the cursor to move a first unit distance in a direction from the first button 810 to the second button 820.

In comparison, referring to FIG. 21, the user provides a touch input to a first button 815 at a first time point and a third button 835 located in the same column as the first button 815, and a second A touch input may be provided to a first button 815 and a second button 825 spaced apart from a predetermined button at a time, and a fourth button 845 positioned in the same column as the second button. In this case, the controller acquires cursor movement information that moves a second unit distance having a value twice the first unit distance in a direction in which the cursor moves from the first button 815 to the second button 825. You can.

For example, in FIG. 20, the cursor moves two word distances corresponding to the first unit distance as the touch input of the single gesture is provided by the user, and in FIG. 21, as the cursor is provided with a plurality of gesture touch inputs, Four word distances corresponding to the second unit distance are moved.

However, by performing a specific conversion operation, the first unit distance may be a character distance and the second unit distance may be a cursor movement distance corresponding to the character distance of the first unit distance.

Alternatively, the short distance of the first unit distance and the second unit distance may be a cursor movement distance corresponding to the short distance of the first unit distance.

A single gesture and a plurality of gestures may cause a difference in the movement distance of the cursor movement according to a predetermined criterion, and are not limited to this embodiment.

3-4 mode switching

3-4-1 temporary switching mode, permanent switching mode

The touch layer-integrated text input device according to the present invention may have a temporary switching mode or a permanent switching mode for a cursor operation mode.

The touch layer-integrated text input device according to the present invention may be converted from a text input mode to a cursor manipulation mode when a push input or a touch input is provided for a specific predetermined button.

The predetermined specific button may be any one of buttons located on a keyboard layout or a key combination including the button. Alternatively, the predetermined specific button may be a mode switching button provided separately from the keyboard layout, not a button on the keyboard layout.

The predetermined specific button may be a permanent switching button in which the operation mode of the controller is maintained in the cursor operation mode even when the touch input or the push input provided to the predetermined specific button is removed. Alternatively, the predetermined specific button is a temporary mode in which the operation mode of the controller is switched from the cursor operation mode to the text input mode when a predetermined time elapses after the touch input or the push input provided to the predetermined specific button is removed. It can be a toggle button.

3-4-2 Mode switching example

The touch layer-integrated text input device according to the present invention may be switched from a text input mode or a pointer manipulation mode to a cursor manipulation mode according to a predetermined criterion.

The controller of the touch layer-integrated text input device according to the present invention may enter a text input mode, a cursor manipulation mode, or a pointer manipulation mode according to a predetermined criterion.

The predetermined mode switching criterion may be an input operation based on touch input and / or push input. For example, the touch input and / or the push input may be performed alone, or the touch input and the push input may be combined to be provided to the touch layer-integrated text input device.

According to an embodiment, the predetermined mode switching criterion may be a mode switching criterion based on a gesture defined by a touch input. For example, when the controller is operating in a text input mode, when points designated by a touch input provided by a user form a circle shape, the controller may be switched to operate in a cursor operation mode. And when the points defined by the touch input for the controller operating in the cursor operation mode form a triangular shape, the operation mode of the controller may be switched to operate in the text input mode.

According to another embodiment, the predetermined mode switching criterion may be a mode switching criterion based on the number of touch points defined by a touch input. For example, when the controller is operating in a text input mode, when a touch input provided by a user corresponds to a 4-point touch input, the controller may be switched to operate in a cursor operation mode. Here, the four-point touch input may be a touch input provided for four different points spaced apart by a predetermined distance or more on the touch layer. For example, the four-point touch input may be a touch input in which a user's four fingers are spaced apart from each other by a predetermined distance or more to provide a touch input on a touch layer.

According to another embodiment, the predetermined mode switching criterion may be a predetermined pattern defined by the touch input.

The above-described mode switching method is not limited to the above-described example as one embodiment of the method for switching the mode of the touch layer-integrated text input device according to the present invention.

4. Other

4-1 Single, multi device

22 is an example of a configuration of an electronic device having a composite human interface according to an embodiment of the present invention.

Referring to FIG. 22, the electronic device 5000 having a composite human interface may include a display 5200, an input module 5400 and a controller 5600.

The display 5200 may be a device that can visually display data. For example, the display 5200 may output a document application including a text field in which text is input and a cursor indicating a location in which the text is input on the text field.

Here, the document application may mean an application program for creating a document related to text data. Alternatively, it may be an application that includes at least a cursor that designates a location where text is to be input.

The input module 5400 may be a device capable of transmitting data or commands based on input provided from the outside. The input module 5400 may include a plurality of buttons arranged according to a keyboard layout and receiving key input according to elevation and a capacitive sensor installed on at least a part of the keyboard layout and receiving touch input.

Here, the capacitive sensor is an example of a touch interface capable of receiving a touch input, and may be configured to include the above-described electroload with reference to FIG. 3.

The controller 5600 performs any one of a first mode for inputting text in a text field and a second mode for adjusting a position of a cursor indicating a position in which the text is to be input on the text field. When entering the first mode, text is output at a position where the cursor is placed on the text field based on the information regarding the key input, and when entering the second mode, a touch input input at a first time point The cursor on the text field corresponds to a positional relationship between a first button to which a first touch coordinate according to belongs and a second button to which a second touch coordinate according to a touch input input at a second time later than the first point belongs Can be moved.

Here, the controller 5600 may output the cursor movement information based on the information provided from the input module 5400.

The controller 5600 may instruct the cursor position on the document application to be changed based on the cursor movement information.

An electronic device having a composite human interface can be connected or applied to various devices to perform functions as an input device. That is, the electronic device having the composite human interface may be a portable computing device including a notebook computer.

For example, an electronic device having a composite human interface according to the present invention can be connected to a separate electronic device such as a smart phone, a tablet device, or a computer to function as an input device. Or, it may be an input device embedded in a single computing device such as a laptop in which a display and an input device are combined.

However, it should be noted that the multi-device environment is not limited thereto.

4-2 Method

23 is a flowchart illustrating a document editing method performed by an electronic device according to the present invention.

Referring to FIG. 23, a document editing method performed by an electronic device having a composite human interface according to the present invention receives key inputs according to the elevation of a plurality of buttons arranged according to a keyboard layout, and the keyboard layout A document editing method performed by an electronic device equipped with a complex human interface that receives a touch input using a capacitive sensor installed on at least a portion of the first mode for inputting text into a text field and the text field Entering any one of the second modes for adjusting the position of the cursor indicating the position to which the text is to be input (S6100), when entering the first mode, based on the information on the key input To obtain a key value to be converted into the text to be entered at the position where the cursor is placed on the text field And (S6400), and when entering the second mode, obtaining cursor movement information indicating the movement of the cursor disposed on the text field based on the information regarding the touch input (S6400). In the obtaining of the cursor movement information, the first button to which the first touch coordinates according to the touch input input at the first time point belongs, and the second touch according to the touch input input at a second time point after the first time point. The method may further include generating the cursor movement information corresponding to the positional relationship between the second buttons to which the coordinates belong (S6300).

Hereinafter, each step will be described in more detail.

An electronic device having a composite human interface may enter any one of the first mode and the second mode. Here, according to a predetermined mode switching criterion, the controller can determine which of the first mode and the second mode to enter. Since the predetermined mode switching criterion has been described above, a detailed description thereof will be omitted.

When entering either the first mode or the second mode, the electronic device having the composite human interface enters the text to be input at the position where the cursor is placed on the text field when entering the first mode A key value to be converted can be obtained. Here, the key value may be based on information related to the key input.

Alternatively, when an electronic device having a composite human interface enters the second mode, cursor movement information may be generated and obtained.

Here, the cursor movement information is information based on the information related to the touch input, and as described above with reference to FIGS. 7 to 13, a detailed description thereof will be omitted.

The methods according to the embodiments of the present invention described above may be used alone or in combination with each other. Each of the steps described in the method according to the embodiment of the present invention is not essential, and thus it is possible that each method includes all of the steps as well as a part. In addition, the order in which the steps are described is only for convenience of description, and therefore, the steps in the method described in the present invention are not necessarily performed in the order described.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments of the present invention described above may be implemented separately or in combination with each other.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the claims below, and all technical spirits within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims (27)

A plurality of buttons including a keycap for receiving push input in a vertical direction from a user and arranged according to a keyboard layout;
An electronic rod located in a lower region of the keycap and sensing a touch input from the user;
A plurality of switches arranged along the keyboard layout under the plurality of buttons and obtaining key input as the push input is provided; And
As a mode for inputting text into a text field, a first mode in which information on the key input is obtained from the plurality of switches and a key value is obtained based on the information on the key input, and the text is input on the text field As a mode for adjusting the position of a cursor indicating a position to be, information about the touch input is obtained from the electroload, touch coordinates are obtained based on the information related to the touch input, and cursor movement information is based on the touch coordinates. It operates in any one of the second mode to acquire,
In the second mode: acquire first touch coordinates and second touch coordinates respectively at a first time point and a second time point that is later than the first time point, and based on the first touch coordinates and the second touch coordinates, The controller comprising: obtaining the cursor movement information corresponding to a positional relationship between a first button to which a first touch coordinate belongs and a second button to which a second touch coordinate belongs;
An electronic device equipped with a composite human interface.
According to claim 1,
The cursor movement information includes at least cursor movement direction information,
The controller acquires the cursor movement direction information to correspond to a direction in which the second button is located from the first button according to a length direction and a width direction on the keyboard layout.
An electronic device equipped with a composite human interface.
According to claim 2,
The controller acquires the cursor movement direction information indicating the left and right directions on the text field when the direction in which the second button is located is the length direction on the keyboard layout from the first button, and from the first button If the direction in which the second button is located is the length direction on the keyboard layout, obtaining the cursor movement direction information indicating the up and down direction on the text field
An electronic device equipped with a composite human interface.
According to claim 2,
When the controller belongs to the same row as the first button on the keyboard layout, the controller acquires the cursor movement direction information indicating left and right directions on the text field, and the same column as the first button on the keyboard layout To obtain the cursor movement direction information indicating the up and down direction on the text field
An electronic device equipped with a composite human interface.
According to claim 1,
The controller acquires the cursor movement information such that the second button is moved from the first button to the cursor on the text field in response to a spaced apart button from the first button according to a length direction and a width direction on the keyboard layout.
An electronic device equipped with a composite human interface.
The method of claim 5,
The cursor movement information includes at least cursor movement distance information,
The controller acquires the cursor movement distance information such that the second button corresponds to a spaced apart button from the first button according to a length direction and a width direction on the keyboard layout.
An electronic device equipped with a composite human interface.
The method of claim 5,
The controller acquires the cursor movement information as many as the number corresponding to the button spacing in which the second button is spaced apart from the first button according to a length direction and a width direction on the keyboard layout.
An electronic device equipped with a composite human interface.
According to claim 1,
The controller is a mode for adjusting the position of a pointer that designates a point at which a pointing execution command is performed, and acquires information on touch coordinates based on information on touch inputs obtained from the electric rod, and acquires touch coordinates Further operating in a third mode for obtaining the movement information of the pointer based on the information about,
The acquired touch coordinate information includes a third touch coordinate obtained at a third time point and a fourth touch coordinate obtained at a fourth time point after the third time point, and the controller operates in the third mode. In the case of obtaining the movement information of the pointer according to the relative positional relationship between the third touch coordinates and the fourth touch coordinates
An electronic device equipped with a composite human interface.
According to claim 1,
Between the adjacent buttons among the plurality of buttons, a key groove for physically separating the adjacent buttons is formed,
When the touch input in the form of a slide touch is applied, the controller moves the cursor movement in response to a time when the touch coordinates of the touch input in the slide touch form pass through a key groove formed between the first button and the second button. Print out the information,
The key groove provides tactile feedback informing the user that the movement of the cursor is indicated on the text field according to the cursor movement information.
An electronic device equipped with a composite human interface.
According to claim 1,
The controller acquires the cursor movement information as a unit movement distance of any one of a character distance, a word distance, or a paragraph distance, according to a predetermined criterion for the cursor,
An electronic device equipped with a composite human interface.
The method of claim 10,
The predetermined criterion is a criterion for acquiring the cursor movement information based on the speed of a slide touch input having a sliding form.
An electronic device equipped with a composite human interface.
The method of claim 11,
The controller is:
When the speed of the slide touch input is included in the first speed range, the cursor movement information is acquired so that the cursor moves based on the character distance, and when the speed of the slide touch input is included in the second speed range, the The cursor movement information is acquired so that a cursor moves based on the word distance, and when the speed of the slide touch input is included in a third speed range, the cursor movement information is acquired so that the cursor moves based on the character distance. doing
An electronic device equipped with a composite human interface.
The method of claim 10,
The predetermined criterion is a criterion for obtaining cursor movement information based on the number of touch points defined by the touch input.
An electronic device equipped with a composite human interface.
The method of claim 13,
The controller is:
When the number of the touch points is the first number, cursor movement information is acquired so that the cursor moves based on the character distance, and when the number of the touch points is the second number, the cursor moves based on the word distance To obtain cursor movement information, and when the number of touch points is a third number, acquire cursor movement information so that the cursor moves based on the paragraph distance
An electronic device equipped with a composite human interface.
According to claim 1,
The controller acquires the cursor movement information such that the cursor moves a first unit distance when the touch input is provided as a single gesture, and when the touch input is provided as two or more gestures, the controller according to a predetermined criterion. Acquiring the cursor movement information to move the second unit distance corresponding to the one unit distance
An electronic device equipped with a composite human interface.
According to claim 1,
The controller enters either the first mode or the second mode according to a predetermined mode switching criterion,
The predetermined mode switching criterion is based on an input operation including at least one of the touch input or the push input.
An electronic device equipped with a composite human interface.
According to claim 1,
The controller, the first touch coordinates and the second touch coordinates are different, but do not output the cursor movement information to maintain the position of the cursor when the same as the first button and the second button, the first If the button is different from the second button, the cursor movement information is output to change the position of the cursor.
An electronic device equipped with a composite human interface.
According to claim 1,
In the second mode, the controller acquires third touch coordinates belonging to a third button and fourth touch coordinates belonging to a fourth button at a third time point and a fourth time point that is later than the third time point, respectively. Although the distance between the first touch coordinate and the second touch coordinate is greater than the distance between the third touch coordinate and the fourth touch coordinate, the distance between the first button and the second button is between the third button and the fourth button. Outputting the cursor movement information so that the movement distance of the cursor between the first time point and the second time point is smaller than the distance between the third time point and the fourth time point when the distance is smaller than the distance.
An electronic device equipped with a composite human interface.
According to claim 1,
The controller outputs the key value or the cursor movement information to a module or an external device that executes a document application that includes the text field.
An electronic device equipped with a composite human interface.
According to claim 1,
The plurality of buttons, each coupled to the lower portion of the keycap and includes a button body that moves up and down by the push input,
The electro rod is interposed between the key cap and the button body, characterized in that each included in the plurality of buttons
An electronic device equipped with a composite human interface.
According to claim 1,
The electro rod is characterized in that included in the plurality of switches
An electronic device with a complex human interface.
In an electronic device equipped with a composite human interface that receives a key input according to the movement of a plurality of buttons arranged according to the keyboard layout, and receives a touch input using a capacitive sensor installed in at least part of the keyboard layout. A document editing method performed by,
Entering any one of a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position to enter the text on the text field;
When entering the first mode, obtaining a key value to be converted into the text to be input at a position where the cursor is placed on the text field based on information regarding the key input; And
In the case of entering the second mode, obtaining cursor movement information indicating a movement of a cursor disposed on the text field based on the information related to the touch input.
In the obtaining of the cursor movement information, the first button to which the first touch coordinates corresponding to the touch input input at the first time point belongs, and the second touch according to the touch input input at a second time point after the first time point. And generating the cursor movement information corresponding to the positional relationship between the second buttons to which the coordinates belong.
How to edit documents.
The method of claim 22,
The cursor movement information includes at least cursor movement direction information,
The cursor movement direction information corresponds to a direction in which the second button is located from the first button according to a length direction and a width direction on the keyboard layout.
How to edit documents.
The method of claim 22,
The movement distance of the cursor on the text field indicated by the cursor movement information corresponds to a button spacing in which the second button is spaced apart from the first button according to a length direction and a width direction on the keyboard layout.
How to edit documents.
The method of claim 22,
When the first button and the second button are different, performing the generating step
How to edit documents.
The method of claim 22,
The obtaining of the cursor movement information may include: a third button to which a third touch coordinate according to the touch input input at the third time point and a fourth touch according to the touch input input at a fourth time point after the third time point; Further comprising the step of generating the cursor movement information corresponding to the positional relationship between the fourth button to which the coordinates belong;
Although the distance between the first touch coordinate and the second touch coordinate is greater than the distance between the third touch coordinate and the fourth touch coordinate, the distance between the first button and the second button is the third button and the fourth When it is smaller than the distance between the buttons, the movement distance of the cursor indicated by the cursor movement information corresponding to the positional relationship between the first button and the second button corresponds to the positional relationship between the third button and the fourth button Smaller than the movement distance of the cursor indicated by the cursor movement information
How to edit documents.
A display for outputting a document application including a text field in which text is input and a cursor indicating a position in which the text is to be input on the text field;
An input module including a plurality of buttons arranged according to a keyboard layout and receiving key input according to elevation and a capacitive sensor installed on at least a part of the keyboard layout and receiving touch input; And
Perform one of a first mode for inputting text into a text field and a second mode for adjusting a position of a cursor indicating a position to enter the text on the text field, but enter the first mode In one case, based on the information on the key input, the text is output to the text field at the position where the cursor is placed, and when the second mode is entered, the first touch according to the touch input input at the first time point A controller that moves the cursor on the text field to correspond to a positional relationship between a first button to which a coordinate belongs and a second button to which a second touch coordinate according to a touch input input at a second time point after the first point belongs; Containing
An electronic device equipped with a composite human interface.

Images