KR20230027136A - Electronic device having multi functional human interface and method for controlling the same - Google Patents

Abstract

The present invention relates to an electronic device with a complex human interface and a control method thereof, which can improve work efficiency. The electronic device comprises: a plurality of buttons including a keycap, a button body, and an electrode, separately; a plurality of switches for acquiring a key input; an electrical connection member for electrically connecting the electrode; and a controller for acquiring a touch coordinate value.

Description

Electronic device having a complex human interface and its control method

The present invention relates to a human interface for receiving text information or pointing location information from a user in a digital device capable of receiving text or pointing location information, such as a computer, laptop computer, tablet PC, or mobile phone, and transmitting the same to the digital device.

A text input device such as a keyboard for text input in a personal computer or portable digital device has been disclosed. In addition, a pointing device such as a mouse device for controlling the pointing position of a pointer and performing functions for controlling the digital device has been disclosed.

Conventional text input devices and pointing devices are provided as separate devices, or the pointing input area is configured in a separate location distinguished from the text input area of the text input device. As a result, in a working environment in which text input, pointing position information input, and pointer execution command input are frequently switched, user's hand movement occurs more than necessary, resulting in reduced work efficiency.

Another object of the present invention is to provide a pointing device-integrated text input device that receives keyboard input, performs a keyboard mode, a mouse mode, and a digitizer mode, and freely switches between these modes, and a control method thereof.

Another object of the present invention is to provide a pointing device-integrated text input device and a method for controlling the same, in which an attribute value to be adjusted, such as audio volume, can be easily adjusted.

Another object of the present invention is to provide a pointing device-integrated text input device capable of processing a touch input and a hovering input and selecting a control target device through a hovering input in a multi-device environment and a control method thereof.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and problems not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings. .

In the present invention, a pointing location information input area of a pointing device is provided on a text input area of a text input device, and a switching unit for switching between a text input mode and a pointing location information input mode is provided so that the user can simply switch the input mode during text input. Work efficiency can be improved by enabling pointing input while minimizing hand movement.

According to one aspect of the present application, an electronic device having a complex human interface having a keyboard layout includes: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller A keyboard mode for ignoring the touch input and outputting only a keyboard input reflecting a key value according to the push input, ignoring the push input for at least some of the plurality of buttons and using the change value of the touch coordinate value A mouse mode for outputting mouse input indicating the moving distance and direction of movement of the pointer and a digitizer input for indicating the location of the pointer using the touch coordinate values ignoring the push input for at least some of the plurality of buttons An electronic device performing a digitizer mode for outputting may be provided.

According to another aspect of the present invention, in an electronic device equipped with a complex human interface having a keyboard layout, the keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller A keyboard mode for ignoring the touch input and outputting only a keyboard input reflecting a key value according to the push input and a pointer control signal ignoring the push input for at least some of the plurality of buttons and reflecting the touch coordinate value When operating in the touch mode, the controller calculates touch coordinate values according to the touch input based on the scan signal, and when the touch mode is a mouse mode, the touch coordinates An electronic device may be provided that obtains a relative coordinate value from a value, and acquires an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode.

ignoring the touch input when operating in the keyboard mode and outputting only a keyboard input reflecting a key value according to the push input; entering mouse mode; ignoring the push input for at least some of the plurality of buttons when operating in the mouse mode and outputting a mouse input indicating a moving distance and a moving direction of the pointer using a change value of the touch coordinate value; entering a digitizer mode; and ignoring the push input for at least some of the plurality of buttons and outputting a digitizer input indicating a location of the pointer using the touch coordinate value. .

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the touch A keyboard mode that ignores input and outputs only keyboard input that reflects key values according to the push input, and a touch that ignores the push input for at least some of the plurality of buttons and outputs a pointer control signal that reflects the touch coordinate value entering any one of the modes; calculating touch coordinate values according to the touch input based on the scan signal upon entering the touch mode; obtaining a relative coordinate value from the touch coordinate value when the touch mode is a mouse mode; obtaining an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode; and outputting a signal for controlling a position of a pointer based on one of the relative coordinate value and the absolute coordinate value obtained.

According to another aspect of the present invention, in an electronic device equipped with a complex human interface having a keyboard layout, the keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller is any one of a keyboard mode that ignores the touch input and outputs only a keyboard input reflecting a key value according to the push input and a touch mode that outputs a first touch signal for controlling the position of a pointer according to the touch coordinate value mode, but when a key input is obtained for a button having a key value assigned to an adjustment target attribute during operation in the touch mode, an electronic device that outputs a second touch signal instructing adjustment of the attribute value of the target attribute to be adjusted. may be provided.

According to another aspect of the present invention, in an electronic device equipped with a complex human interface having a keyboard layout, the keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller When the key input is obtained, it is determined whether the key input is in a keyboard mode or a touch mode, and in the case of the keyboard mode, a text value according to the key input is output, and in the case of the touch mode, the touch input is used to adjust a specific property value. An electronic device that performs a used attribute adjustment mode may be provided.

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the elektroid toroid in response to the touch input. entering; ignoring the touch input when operating in the keyboard mode and outputting only a keyboard input reflecting a key value according to the push input; entering touch mode; outputting a first touch signal for controlling a position of a pointer according to the touch coordinate value when operating in the touch mode; receiving a key input for a button having a key value to which an adjustment target property is assigned during operation in the touch mode; and outputting a second touch signal instructing adjustment of the property value of the property to be adjusted according to the touch coordinate value.

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and determining whether the key input is in a keyboard mode or a touch mode when the key input is obtained. outputting a character value according to the key input in case of the keyboard mode; and in case of the touch mode, performing an attribute adjustment mode using the touch input to adjust a specific attribute value.

According to another aspect of the present invention, in an electronic device having a complex human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, a user receives a push input in a vertical direction keycaps; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode that receives a gesture input including touch or hovering from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the length direction and the width direction; a plurality of buttons each including a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the gesture input. an electrical connection member electrically connecting the electrode; and obtaining a key value assigned to a button corresponding to a switch that obtained the key input, determining that the gesture input is a touch input when the change in capacitance is greater than a touch threshold, and determining the capacitance according to the touch input. A touch coordinate value is calculated from the change in , and a first signal instructing the movement of a pointer on a screen of a control target, which is one of the plurality of output devices, is output based on the calculated touch coordinate value, and the capacitance When the amount of change is smaller than the touch threshold and larger than the hovering threshold, the gesture input is determined as a hovering input, and a hovering coordinate value is calculated from the change in capacitance according to the hovering input, based on the calculated hovering coordinate value. An electronic device including a controller may be provided that outputs a second signal instructing movement of the virtual pointer in virtual space, real space, or augmented space.

According to another aspect of the present invention, a method for controlling an electronic device having a complex human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, wherein the electronic device moves up and down from a user. a keycap that receives a directional push input; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; and electrically connecting the first block group between buttons arranged along the first direction to form a drive line for applying a drive signal for inducing capacitance to the electrode, and arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connecting member electrically connecting the electrode between the liver; obtaining a key value assigned to a button corresponding to a switch from which the key input was acquired and outputting a keyboard input reflecting the key value; determining that the gesture input is a touch input when the change in capacitance is greater than a touch threshold; calculating a touch coordinate value from a change in capacitance according to the touch input; outputting a first signal instructing movement of a pointer on a screen of a control target that is one of the plurality of output devices based on the calculated touch coordinate values; determining that the gesture input is a hovering input when the change in capacitance is smaller than the touch threshold and larger than the hovering threshold; and calculating a hovering coordinate value from a change in the capacitance according to the hovering input. A method for controlling an electronic device may include outputting a second signal instructing movement of a virtual pointer in virtual space, real space, or augmented space based on the calculated hovering coordinates.

The solutions to the problems of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings. You will be able to.

By integrating the separately provided text input device and pointing device into one human interface device, the unit cost and size of the product can be reduced, and work efficiency can be improved by eliminating unnecessary user operations.

According to the present invention, a single pointing device integrated text device can be used as a keyboard interface and a mouse interface as well as a digitizer interface.

According to the present invention, when using a pointing device-integrated text device, when adjusting an attribute value such as audio volume, the corresponding attribute is selected using a pointer, and the position of the indicator indicating the attribute value in the selected attribute is adjusted using the pointer again. You can easily adjust the value of the desired property with a simple push input or touch input without any hassle.

According to the present invention, a single pointing device-integrated text device can be used as an input interface for multiple devices in a multi-device environment.

Effects of the present invention are not limited to the above-mentioned effects, and effects not mentioned will be clearly understood by those skilled in the art from this specification and the accompanying drawings.

1 is an exemplary view of a pointing device-integrated text input device.
2 is a flowchart illustrating an example of an operation sequence according to mode switching of a pointing device and a text device.
3 is an exemplary embodiment of the configuration of a text input device and a pointing device.
4 is an embodiment of a pointer execution command unit-integrated mode conversion unit.
5 is an example of displaying a pointer location information input area.
6 is an example of a pointer execution command unit-integrated mode conversion unit.
7 is an embodiment using a cover of a human interface device to which a lower position type pointer location information input device is applied.
8 is an example of a human interface device applied to a portable notebook.
9 is an embodiment in which a lower position type pointer position information input device and a lower position type pointer execution command unit are applied.
10 is a configuration diagram of a complex function input button.
11 is an example of an electrode of a complex function input button.
12 is an example of arrangement of multiple function input buttons.
13 is an example of electrode arrangement of different patterns of multi-function input buttons;
14 is an example of an electrical connection member of a multi-function input button.
15 is an example of a switch for character input of a multifunction input button.
16 is an example of a human interface device having multiple function input buttons.
17 is an example of an Electrode keycap.
18 to 22 are examples of electrode patterns of a plurality of complex function input buttons.
23 is a flowchart of a method for switching between a text input mode and a pointer location information input mode.
24 is a flowchart of a permanent touch mode switching method.
25 is a composite function input button module provided with a plurality of composite function input buttons in a plate shape.
26 is an example of the detailed structure of the electrode part.
27 is an example of a bonding site of a conductive adhesive.
28 is an example of a complex function input button.
29 is an embodiment of a wireless electrical connection member.
30 is an example of a configuration diagram of a text input device integrated with a pointing device.
FIG. 31 is an example of text input signal processing of the pointing device-integrated text input device of FIG. 30 .
FIG. 32 is an example of signal processing of mouse input of the text input device integrated with the pointing device of FIG. 30 .
33 and 34 are examples of pointer operations according to mouse input according to FIG. 32 .
35 and 36 are other examples of pointer operations according to mouse input according to FIG. 32 .
FIG. 37 is an example of signal processing of a digitizer input of the pointing device-integrated text input device of FIG. 30 .
38 is an example of an operation of a pointer according to a digitizer input according to FIG. 37 .
39 is another example of a pointer operation according to a digitizer input according to FIG. 37 .
FIG. 40 is an example of mode conversion of the pointing device-integrated text input device of FIG. 30 .
41 is an example of setting a touch area according to a digitizer mode of the text input device integrated with a pointing device of FIG. 30 .
42 and 43 are examples of a relationship between a touch area according to the digitizer mode of FIG. 41 and a touch area according to the mouse mode.
44 and 45 are other examples of setting a touch area according to a digitizer mode of the text input device integrated with a pointing device of FIG. 30 .
FIG. 46 is an example of setting a touch area outside a touchable area when setting the touch area according to FIGS. 44 and 45 .
47 is an example of resetting a touch area according to the digitizer mode of FIG. 46 .
48 is another example of resetting a touch area according to the digitizer mode of FIG. 46 .
49 is a flowchart illustrating an example of a mode switching method of the text input device integrated with a pointing device of FIG. 30 .
FIG. 50 is a flowchart illustrating a touch input processing method of the pointing device-integrated text input device of FIG. 30 in mouse mode and digitizer mode.
51 is a flowchart illustrating an example of a method of setting a touch area in a digitizer mode of the text input device integrated with a pointing device of FIG. 30 .
52 is a flowchart illustrating another example of a touch area setting method in the digitizer mode of the pointing device-integrated text input device of FIG. 30 .
FIG. 53 is a flow chart of a method of resetting a touch area in a digitizer mode of the text input device integrated with a pointing device of FIG. 30 .
54 is a diagram of some examples of attributes to be adjusted.
55 is a diagram related to a matching relationship between attributes to be adjusted and buttons of a text input device integrated with a pointing device.
56 and 57 are diagrams related to an example of adjustment of an attribute to be adjusted of the pointing device-integrated text input device.
58 is a view related to another example of adjusting the property to be adjusted of the pointing device-integrated text input device.
59 is a view related to another example of adjusting the property to be adjusted of the pointing device-integrated text input device.
60 is a diagram relating to a first example of processing of a touch input for adjusting an adjustment target attribute of a pointing device-integrated text input device.
61 is a diagram relating to a second example of processing a touch input for adjusting an adjustment target attribute of a pointing device-integrated text input device.
62 is a diagram related to a third example of processing a touch input for adjusting an adjustment target property of a pointing device-integrated text input device.
63 is a diagram related to a fourth example of processing a touch input for adjusting an adjustment target attribute of a text input device integrated with a pointing device.
64 is a diagram related to a fifth example of touch input processing for adjusting an adjustment target attribute of a pointing device-integrated text input device.
65 is a diagram related to a sixth example of processing a touch input for adjusting an adjustment target attribute of a pointing device-integrated text input device.
66 is a diagram related to a seventh example of processing of a touch input for adjusting an adjustment target attribute of a pointing device-integrated text input device.
67 is a flowchart of an example of a method for adjusting a property to be adjusted of a text input device integrated with a pointing device.
68 is a flowchart of another example of a method for adjusting an adjustment target attribute of a pointing device-integrated text input device.
69 is a flowchart of another example of a method for adjusting an adjustment target attribute of a pointing device-integrated text input device.
70 is a flow chart of yet another example of a method for adjusting the property to be adjusted of the pointing device-integrated text input device.
71 is a flow chart of yet another example of a method for adjusting a property to be adjusted of a pointing device-integrated text input device.
72 is an example of a hovering input of a text input device integrated with a pointing device.
FIG. 73 is an example of a multi-device environment using the pointing device-integrated text input device of FIG. 30 .
FIG. 74 is a diagram related to an example of selecting a control target device using a hovering input in the multi-device environment of FIG. 73 .
75 is a diagram related to another example of selecting a control target device using a hovering input in the multi-device environment of FIG. 73;
FIG. 76 is a diagram related to another example of selecting a control target device using a hovering input in the multi-device environment of FIG. 73 .
77 is a flowchart of an example of a multi-device control method of a pointing device-integrated text input device.

The embodiments described in this specification are intended to clearly explain the spirit of the present invention to those skilled in the art to which the present invention belongs, and the present invention is not limited by the embodiments described in this specification, and the present invention The scope of should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terms used in this specification have been selected as general terms that are currently widely used as much as possible in consideration of the functions in the present invention, but they may vary depending on the intention, custom, or the emergence of new technologies of those skilled in the art in the technical field to which the present invention belongs. can However, in the case where a specific term is defined and used in an arbitrary meaning, the meaning of the term will be separately described. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the term and the overall content of this specification, not the simple name of the term.

The drawings accompanying this specification are intended to easily explain the present invention, and the shapes shown in the drawings may be exaggerated as necessary to aid understanding of the present invention, so the present invention is not limited by the drawings.

If it is determined that a detailed description of a known configuration or function related to the present invention in this specification may obscure the gist of the present invention, a detailed description thereof will be omitted if necessary.

According to one aspect of the present application, an electronic device having a complex human interface having a keyboard layout includes: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller A keyboard mode for ignoring the touch input and outputting only a keyboard input reflecting a key value according to the push input, ignoring the push input for at least some of the plurality of buttons and using the change value of the touch coordinate value A mouse mode for outputting mouse input indicating the moving distance and direction of movement of the pointer and a digitizer input for indicating the location of the pointer using the touch coordinate values ignoring the push input for at least some of the plurality of buttons An electronic device performing a digitizer mode for outputting may be provided.

The controller, in the mouse mode, calculates the change value of the touch coordinate value through a difference operation between the touch coordinate value of the current scan period and the touch coordinate value of the previous scan period, and outputs the pointer in the digitizer mode. The digitizer input may be output from the touch coordinate values in consideration of a matching relationship between the screen area and the touch coordinate values.

When entering the digitizer mode, the controller may set the matching relation so that touch coordinate values of a first touch input correspond to a location of the pointer on the screen area.

The controller, in the mouse mode, calculates the change value of the touch coordinate value through difference operation between the touch coordinate value of the current scan period and the touch coordinate value of the previous scan period, and in the digitizer mode, it is first performed when entering the digitizer mode. The digitizer input may be obtained through a difference operation between the touch coordinate value of the received touch input and the current touch coordinate value.

When entering the mouse mode, the controller determines whether it is a left-handed mode or a right-handed mode, and in the case of the left-handed mode, activates only the electrodes of buttons located on the left side of the entire touch sensing area, and in the case of the right-handed mode, Only the electrodes of buttons located on the right side of the entire touch sensing area may be activated, and when entering the digitizer mode, all of the electrodes of buttons located in the entire touch sensing area may be activated.

The controller may set a touch area that matches the screen area where the pointer is displayed so that a touch coordinate value initially performed when entering the digitizer mode matches the location of the pointer in the screen area.

The controller may reset the touch area according to the touch input to an area deviating from the touch area, among the entire touch sensing area.

The controller may differently set a touch area that matches the screen area displaying the pointer according to a first touch input upon entering the digitizer mode.

According to another aspect of the present invention, in an electronic device equipped with a complex human interface having a keyboard layout, the keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller A keyboard mode for ignoring the touch input and outputting only a keyboard input reflecting a key value according to the push input and a pointer control signal ignoring the push input for at least some of the plurality of buttons and reflecting the touch coordinate value When operating in the touch mode, the controller calculates touch coordinate values according to the touch input based on the scan signal, and when the touch mode is a mouse mode, the touch coordinates An electronic device may be provided that obtains a relative coordinate value from a value, and acquires an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode.

The relative coordinate value is calculated from a difference operation between the touch coordinate value of the current scan period and the touch coordinate value of the previous scan period, and the absolute coordinate value is determined by considering the matching relationship between the touch area and the screen area displaying the pointer. It can be calculated from touch coordinate values.

The controller may set the matching relationship based on a first input touch coordinate value after entering the digitizer mode.

The relative coordinate value is calculated from difference operation between the touch coordinate value of the current scan period and the touch coordinate value of the previous scan period, and the absolute coordinate value is the touch coordinate value of the current scan period and the first after entering the digitizer mode. It can be calculated from difference operation between input touch coordinate values.

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the elektroid toroid in response to the touch input. entering;

ignoring the touch input when operating in the keyboard mode and outputting only a keyboard input reflecting a key value according to the push input; entering mouse mode; ignoring the push input for at least some of the plurality of buttons when operating in the mouse mode and outputting a mouse input indicating a moving distance and a moving direction of the pointer using a change value of the touch coordinate value; entering a digitizer mode; and ignoring the push input for at least some of the plurality of buttons and outputting a digitizer input indicating a location of the pointer using the touch coordinate value. .

The outputting of the mouse input includes calculating a variation value of the touch coordinate value through a difference operation between a touch coordinate value of a current scan period and a touch coordinate value of a previous scan period, and outputting the digitizer input. The step may include obtaining the digitizer input from the touch coordinate values in consideration of a matching relationship between a screen area of a display outputting the pointer and the touch coordinate values.

When entering the digitizer mode, the method may further include setting the matching relationship so that the touch coordinate values of the first touch input correspond to the location of the pointer on the screen area.

The outputting of the mouse input includes calculating a variation value of the touch coordinate value through a difference operation between a touch coordinate value of a current scan period and a touch coordinate value of a previous scan period, and outputting the digitizer input The step may further include obtaining the digitizer input through a difference operation between a touch coordinate value of a first touch input performed when entering the digitizer mode and a current touch coordinate value.

determining whether the mouse mode is entered into a left-handed mode or a right-handed mode; activating only the electrodes of buttons located on the left side of the entire touch sensing area in the case of the left-handed mode; activating only the electrodes of the buttons located on the right side of the entire touch sensing area in the case of the right hand mode; and activating all the electrodes of the buttons positioned over the entire touch sensing area when entering the digitizer mode.

The method may further include setting a touch area matched to a screen area where the pointer is displayed so that a first touch coordinate value when entering the digitizer mode matches a position of the pointer in the screen area.

obtaining a touch input for an area outside the touch area among all touch sensing areas during operation in the digitizer mode; and resetting the touch area according to a touch input to the out-of-area area.

The method may further include setting a different touch area that matches a screen area displaying the pointer according to a first touch input upon entering the digitizer mode.

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the touch A keyboard mode that ignores input and outputs only keyboard input that reflects key values according to the push input, and a touch that ignores the push input for at least some of the plurality of buttons and outputs a pointer control signal that reflects the touch coordinate value entering any one of the modes; calculating touch coordinate values according to the touch input based on the scan signal upon entering the touch mode; obtaining a relative coordinate value from the touch coordinate value when the touch mode is a mouse mode; obtaining an absolute coordinate value from the touch coordinate value when the touch mode is a digitizer mode; and outputting a signal for controlling a position of a pointer based on one of the relative coordinate value and the absolute coordinate value obtained.

Calculating the relative coordinate value from a difference operation between a touch coordinate value of a current scan period and a touch coordinate value of a previous scan period; and calculating the absolute coordinate values from the touch coordinate values in consideration of a matching relationship between the screen area displaying the pointer and the touch area.

The method may further include setting the matching relationship based on a first input touch coordinate value after entering the digitizer mode.

Calculating the relative coordinate value from a difference operation between a touch coordinate value of a current scan period and a touch coordinate value of a previous scan period; and calculating the absolute coordinate value from a difference operation between the touch coordinate value of the current scan period and the first input touch coordinate value after entering the digitizer mode.

According to another aspect of the present invention, in an electronic device equipped with a complex human interface having a keyboard layout, the keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller is any one of a keyboard mode that ignores the touch input and outputs only a keyboard input reflecting a key value according to the push input and a touch mode that outputs a first touch signal for controlling the position of a pointer according to the touch coordinate value mode, but when a key input is obtained for a button having a key value assigned to an adjustment target attribute during operation in the touch mode, an electronic device that outputs a second touch signal instructing adjustment of the attribute value of the target attribute to be adjusted. may be provided.

The controller may output a signal instructing activation of the property to be adjusted when a key input is obtained for a button having a key value to which the property to be adjusted is assigned during operation in the touch mode.

Activation of the property to be adjusted may include displaying a graphic object for adjusting the property to be adjusted.

When the property to be adjusted has a one-dimensional property value, the controller may generate the second touch signal based on only one of a vertical value and a horizontal value of the touch coordinate value.

The controller may generate the second touch signal based on a value corresponding to a movement direction of an indicator on a graphic object for adjusting the property to be adjusted among vertical and horizontal values of the touch coordinate values.

The controller may generate the second touch signal based on a difference between a touch coordinate value of a current scan period and a touch coordinate value of a previous scan period.

The controller may set a touch area related to the adjustment of the adjustment target attribute corresponding to a range of attribute values of the adjustment target attribute.

The controller may set the touch area so that the maximum value of the property value of the property to be adjusted matches the topmost or rightmost side of the touch area, and matches the minimum value of the property value with the bottommost or leftmost side of the touch area. there is.

The controller may generate the second touch signal so that the touch coordinate value and the current attribute value of the adjustment target attribute correspond to each other.

The controller generates a matching relationship between a touch coordinate value of an initial touch input and an attribute value of the adjustment target property after a key input for a button having a key value to which the adjustment target property is assigned is obtained, and the touch coordinate value And the second touch signal may be generated based on the matching relationship.

The controller performs a difference operation between a touch coordinate value of a touch input performed first after obtaining a key input for a button having a key value assigned to the adjustment target property and a touch coordinate value for adjusting the adjustment target property. A second touch signal may be generated.

The controller may generate the second touch signal according to the touch coordinate value obtained while a touch input sensed together with a key input for a button having a key value to which the adjustment target property is assigned is maintained.

The controller may generate the second touch signal based on a touch coordinate value of a touch input detected by an electrode of a button having a key value to which the property to be adjusted is assigned.

The controller generates the second touch signal indicating either an increase or a decrease in the property value when a touch input detected by an electrode of a button having a key value assigned to the property to be adjusted is in a counterclockwise direction, and , When the touch input sensed by the electrode of the button having the key value to which the property to be adjusted is in a clockwise direction, a second touch signal indicating an increase or decrease in the property value may be generated.

According to another aspect of the present invention, in an electronic device equipped with a complex human interface having a keyboard layout, the keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the Ilhyeoroid according to the touch input, wherein the controller When the key input is obtained, it is determined whether the key input is in a keyboard mode or a touch mode, and in the case of the keyboard mode, a text value according to the key input is output, and in the case of the touch mode, the touch input is used to adjust a specific property value. An electronic device that performs a used attribute adjustment mode may be provided.

In the case of the touch mode, the controller may enter the attribute control mode when the key input occurs, and return to the touch mode when the key input occurs in the attribute control mode.

In the case of the touch mode, the controller may maintain the attribute adjustment mode while the key input is maintained.

In the case of the touch mode, the controller may use a single touch input after the key input is generated to adjust the specific attribute value.

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and a controller that obtains a key value assigned to a button corresponding to a switch that has obtained the key input, and obtains a touch coordinate value calculated from a change in capacitance of the elektroid toroid in response to the touch input. entering; ignoring the touch input when operating in the keyboard mode and outputting only a keyboard input reflecting a key value according to the push input; entering touch mode; outputting a first touch signal for controlling a position of a pointer according to the touch coordinate value when operating in the touch mode; receiving a key input for a button having a key value to which an adjustment target property is assigned during operation in the touch mode; and outputting a second touch signal instructing adjustment of the property value of the property to be adjusted according to the touch coordinate value.

The method may further include outputting a signal instructing activation of the target property to be adjusted when a key input is obtained for a button having a key value assigned to the target property to be adjusted during operation in the touch mode.

Activation of the property to be adjusted may include displaying a graphic object for adjusting the property to be adjusted.

The generating of the second touch signal includes generating the second touch signal based on only one of a vertical value and a horizontal value of the touch coordinate value when the property to be adjusted has a one-dimensional property value. can do.

The generating of the second touch signal may include generating the second touch signal based on a value corresponding to a moving direction of an indicator on a graphic object for adjusting the property to be adjusted among vertical and horizontal values of the touch coordinate values. It may include generating steps.

The generating of the second touch signal may include generating the second touch signal based on a difference between a touch coordinate value of a current scan period and a touch coordinate value of a previous scan period.

The method may further include setting a touch area related to the adjustment of the adjustment target attribute corresponding to a range of attribute values of the adjustment target attribute.

The setting may include setting the touch area so that the maximum value of the attribute value to be adjusted matches the uppermost or rightmost edge of the touch area, and matches the minimum value of the attribute value with the lowermost or leftmost edge of the touch area. It may include setting steps.

The generating of the second touch signal may include generating the second touch signal so that the touch coordinate values and the current attribute value of the property to be adjusted correspond to each other.

The generating of the second touch signal may include determining a matching relationship between a touch coordinate value of an initial touch input and an attribute value of an adjustment target attribute after a key input for a button having a key value to which the adjustment target attribute is assigned is obtained. and generating the second touch signal based on the touch coordinate value and the matching relationship.

The generating of the second touch signal may include a touch coordinate value of a first touch input performed after obtaining a key input for a button having a key value to which the adjustment target property is assigned and a touch coordinate for adjusting the adjustment target property. The method may include generating the second touch signal through a difference operation between values.

The generating of the second touch signal may include generating the second touch signal according to the touch coordinate values obtained while a touch input sensed together with a key input for a button having a key value to which the property to be adjusted is assigned is maintained. It may include generating steps.

The generating of the second touch signal may include generating the second touch signal based on a touch coordinate value of a touch input detected by an electrode of a button having a key value to which the property to be adjusted is assigned. there is.

In the generating of the second touch signal, when a touch input detected by an electrode of a button having a key value to which the property to be adjusted is assigned is in a counterclockwise direction, the property value is increased or decreased. Generating a second touch signal, and when a touch input detected by an electrode of a button having a key value to which the adjustment target property is assigned is in a clockwise direction, a second touch signal instructing the other of increasing or decreasing the property value It may include the step of generating.

According to another aspect of the present invention, a control method of an electronic device having a complex human interface having a keyboard layout, the electronic device comprising: a keycap receiving a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connection member electrically connecting the electrode; and determining whether the key input is in a keyboard mode or a touch mode when the key input is obtained. outputting a character value according to the key input in case of the keyboard mode; and in case of the touch mode, performing an attribute adjustment mode using the touch input to adjust a specific attribute value.

entering the property adjustment mode when the key input occurs in the case of the touch mode; and returning to the touch mode when the key input occurs in the attribute adjustment mode.

In case of the touch mode, the method may further include maintaining the property adjustment mode while the key input is maintained.

In the case of the touch mode, a single touch input after the key input occurs may be used to adjust the specific attribute value.

According to another aspect of the present invention, in an electronic device having a complex human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, a user receives a push input in a vertical direction keycaps; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode that receives a gesture input including touch or hovering from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the length direction and the width direction; a plurality of buttons each including a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the gesture input. an electrical connection member electrically connecting the electrode; and obtaining a key value assigned to a button corresponding to a switch that obtained the key input, determining that the gesture input is a touch input when the change in capacitance is greater than a touch threshold, and determining the capacitance according to the touch input. A touch coordinate value is calculated from the change in , and a first signal instructing the movement of a pointer on a screen of a control target, which is one of the plurality of output devices, is output based on the calculated touch coordinate value, and the capacitance When the amount of change is smaller than the touch threshold and larger than the hovering threshold, the gesture input is determined as a hovering input, and a hovering coordinate value is calculated from the change in capacitance according to the hovering input, based on the calculated hovering coordinate value. An electronic device including a controller may be provided that outputs a second signal instructing movement of the virtual pointer in virtual space, real space, or augmented space.

When the touch input is obtained while the virtual pointer according to the second signal is at a position corresponding to any one of the output devices, the controller may set any one of the output devices as a control target.

The multi-device environment further includes a virtual or augmented object,

The controller may set the object as a control target when the touch input is obtained in a state where the virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object.

The multi-device environment may further include an HMD that processes virtual reality or augmented reality, and the second signal may indicate a location of a virtual pointer displayed by the HMD.

According to another aspect of the present invention, a method for controlling an electronic device having a complex human interface having a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, wherein the electronic device moves up and down from a user. a keycap that receives a directional push input; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout; a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; And electrically connecting the first block group between the buttons arranged along the first direction to form a drive line for applying a drive signal for inducing capacitance to the electrode, arranged along the second direction The buttons are electrically connected to the second block group to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. an electrical connecting member electrically connecting the electrode between the liver; obtaining a key value assigned to a button corresponding to a switch from which the key input was acquired and outputting a keyboard input reflecting the key value; determining that the gesture input is a touch input when the change in capacitance is greater than a touch threshold; calculating a touch coordinate value from a change in capacitance according to the touch input; outputting a first signal instructing movement of a pointer on a screen of a control target that is one of the plurality of output devices based on the calculated touch coordinate values; determining that the gesture input is a hovering input when the change in capacitance is smaller than the touch threshold and larger than the hovering threshold; and calculating a hovering coordinate value from a change in the capacitance according to the hovering input. A method for controlling an electronic device may include outputting a second signal instructing movement of a virtual pointer in virtual space, real space, or augmented space based on the calculated hovering coordinates.

obtaining the touch input in a state where the virtual pointer according to the second signal is at a position corresponding to one of the output devices; and setting the one output device as a control target.

The multi-device environment further includes a virtual or augmented object, and obtaining the touch input in a state where a virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object; and right, setting the object as a control target.

The multi-device environment may further include an HMD that processes virtual reality or augmented reality, and the second signal may indicate a location of a virtual pointer displayed by the HMD.

The present invention relates to a human interface for receiving text information or pointing location information from a user in a digital device capable of receiving text or pointing location information, such as a computer, laptop computer, tablet PC, or mobile phone, and transmitting the same to the digital device.

As a conventional text information input device, a keyboard composed of a plurality of physical buttons connected to an elastic body and a switch is widely used.

In addition, in a digital device equipped with a touch interface, a virtual keyboard is displayed on a display, and when a user touches a part of the user's body on the virtual keyboard displayed on the display, the user's gesture or electrical signal is detected and the user touches the keyboard. A method of inputting text on a virtual keyboard displayed on the part is also used.

The touch interface recognizes movement of a part of the user's body, recognizes contact with a specific contact surface, detects the flow of current through the user's body, or detects that light or sound waves are blocked or interfered with by a part of the user's body. A user's touch may be recognized by sensing or the like.

Examples of the touch interface include a resistive touch screen, a capacitive touch screen, an optical touch screen, and an ultrasonic touch screen.

A resistive touch screen or resistive touch screen is a touch screen that operates by recognizing pressure.

Resistive touch screens are inexpensive, and have the advantage of being able to write with a stylus pen or small spaces, but because they use pressure, they are not recognized when you press them hard, and the touch is slightly duller than the capacitive touch method. This is known as a downside.

A resistive touch screen is composed of several layers.

Among these several layers, there is a conductive layer, in which two layers face each other with an air layer in the middle.

When the outer screen is pressed, the two conductive layers come into contact with each other, which causes the resistance and current to change, recognizing that a touch has been made.

* The capacitive sensing or capacitive touch method is a method of sensing an operation using a capacitive coupling effect.

Unlike resistive touch screens that use pressure, capacitive touch screens are made of highly conductive glass called indium tin oxide.

As sensors are attached to the four corners of the glass, current flows on the surface of the glass.

Recognizing the change of current through this is the principle of the electrostatic type.

At this time, the moment you put your finger on the screen, the electrons that flowed through the glass flow into the body through the finger, and the sensor detects the position where the change occurred and operates.

The capacitive touch method is known to have a softer feel of operation and scrolling compared to the resistive touch screen because it is recognized by lightly touching the screen rather than pressing the screen with force.

In addition, the capacitive touch method enables multi-touch capable of touching several places.

Since the capacitive touch method is a method of manipulation using a change in current, it may not be operated with a fingernail or a stylus pen or while wearing leather gloves that do not conduct current.

However, if you use a separate capacitive stylus pen, you can touch the screen.

Since the sensor is sensitive, it may be affected by nearby devices.

An optical touch screen works by measuring the coordinates of an infrared camera and an infrared light mounted at the apex of the touch screen using the shadow of an object to touch the screen.

The ultrasonic touch screen emits ultrasonic waves on the screen to detect the interference effect caused by the user's touch, and measures the coordinates to operate.

In addition, various touch input technologies that can be used to control the location information of a pointer by detecting a user's touch or motion and recognizing location information of a part of the user's body can be used in the present invention.

1 is an exemplary view of a pointing device-integrated text input device.

The pointing device-integrated text input device may have a housing 100 for supporting the text input device and a pointer location information input area.

The housing has strength to withstand the pressure of user input, receives text input information and pointer position information input information, and transmits the corresponding information to a digital device connected to the pointing device-integrated text input device by wire or wirelessly. It may be composed of a control unit, a memory unit, a battery unit, an encoding unit, a transmission unit, and the like.

The pointing device-integrated text input device may include a plurality of buttons 109 for receiving text input information from a user.

The plurality of buttons 109 may be composed of physical buttons or virtual buttons.

The physical button may be composed of a button connected to an elastic body, or the button itself may be elastic so that the physical button moves when a user's input is received and returns to its original position when the user's pressure is removed.

Since the physical button is connected to an electrical switch, a user's pressure is applied to move the button, and the phase of the switch is changed so that a text input value of the corresponding button is generated.

The physical button has an elastic structure without an electrical switch and is moved by the user's pressure and returns to its original position when the user's pressure is removed, and the user's text input information is received by the touch input device. Text input information may be generated based on location information in which a user's pressure or gesture is recognized.

The virtual button may be configured by displaying a text input button on a display device.

The virtual button may display an arbitrary button by projecting light onto a transparent, translucent, or opaque object.

The virtual button is not recognized by the user's eyes, but has unique location information for each text and can generate corresponding text input information based on user's pressure or gesture information.

The pointing device-integrated text input device may have the text input area 107 and the pointing location information input areas 108a and 108b having at least a portion as a common area.

The pointing location information input areas 108a and 108b are areas located on the surface, top, or bottom of the button for text input, and as shown in FIG. 1, the pointing location information input area may have at least a part in common with the text input area. there is.

The pointing location information input area may include the text input area, or the text input area may include the pointing location information input area.

The pointing location information input area and the text input area have at least a part in common, and at least a part is used as a pointing location information input area, but is not used as a text input area, and at least a part is used as a text input area, but a pointing location information input area. may not be used as

The pointing device-integrated text input device is a pointer location information input device (105) for forming a virtual text input area or virtual pointing location information input area for text input, pointing location information input, or text input and pointing location information input. ) may be configured on the pointing device integrated text input device or outside the pointing device integrated text input device.

The pointer location information input device 105 is a user on the surface of the housing 100 or above the housing 100, such as an infrared generator and an infrared receiver, an RGB camera, an ultrasonic generator and an ultrasonic receiver, or an infrared generator and an infrared camera. By detecting a part of the body of the user, location information and gesture information may be input.

The pointer location information input device may be composed of a plurality of devices to expand the pointer location information input area or to improve accuracy and sensitivity.

For example, it may have a pointer location information input device 105b for composing a right hand text input or pointing location information input area 108b.

Alternatively, it may have a pointer location information input device 105a for composing a left hand text input or pointing location information input area 108a.

The text input area for the right hand or the pointing location information input area 108b may include an area for a J button of a standard English keyboard.

The text input area for the left hand or the pointing location information input area 108a may include an area of an F button of a standard English keyboard.

The pointer location information input device may be characterized in that it includes both areas of the J (J) and F (F) buttons of the English standard keyboard.

When the pointing device-integrated text input device is connected to a plurality of digital devices having a display unit, the pointing location information input area may move a pointer position on the plurality of display units. there is.

For example, the pointer location information input area may be divided into regions to match each display unit, or a separate button indicating the display unit may be operated to transmit pointer location information from the corresponding display unit, or a plurality of display units may be configured as a single virtual unit. Recognized as a display unit, pointer location information may be transmitted so that the pointer can be moved on a single virtual display unit.

A pointing device-integrated text input device includes a pointing location information input device that configures a pointing input area and receives pointer location information from a user, and includes a button or image or space or icon or button where a pointer moved by the pointing location information input device is located. It may have pointer execution command units 101 and 102 for executing at least one function on the text input window.

The pointer execution command unit may be composed of one or two buttons, each responsible for the first function and the second function, and may be located on the left side, right side, or center of the housing.

The first function may function as, for example, a left click of a computer mouse, and the second function may function as a right click of a computer mouse, for example.

The pointer execution command unit composed of the one or two buttons may be configured to be conveniently used by both left-handed and right-handed people by being configured on both the left and right sides of the housing.

The pointer execution command unit may be configured to be operated by recognizing a touch of a part of the user's body, blocking light, interference of ultrasonic waves, or a shadow of a part of the user's body using the above-described touch technology.

The pointer execution command unit may be composed of a physical button having elasticity.

The pointer execution command unit may operate using at least one button of text buttons located in a text input area other than the pointing location information input area.

The pointer execution command unit may operate by selecting a physical or virtual text button on the pointing location information input area.

For example, if a virtual input device is used as a pointing location information input device and a physical button is used as a text input device, the location information of the pointer is entered on the virtual pointing location information input area in the pointing location information input mode and the physical location located at the corresponding location is entered. A pointer execution command can be generated by pressing the text button.

The pointer execution command unit may receive pointer location information from a user's first gesture within the pointing location information input area and generate a pointer execution command by a user's second gesture at the same location.

The pointer execution command unit may be configured to execute the first function by a first gesture or a first voice of the user's body, a first blink of an eye, or a first mouth movement.

The pointer execution command unit may be configured such that the second function is executed by a second gesture of the user's body, a second voice, a second blink of an eye, a second mouth, or the like.

The pointing device-integrated text input device may include a text input mode in which text information is input through the text input device and a pointing location information input mode in which the pointing location information is input through the pointing location information input device.

The text input mode and the pointing location information input mode may be switched by the mode switching unit 103 .

The mode conversion unit 103 may be composed of a switch separately located on the housing.

The mode switching unit 103 may detect that at least one text input button included in the text input device or a plurality of text inputs are simultaneously received to perform mode switching.

The mode switching unit 103 may perform mode conversion by receiving control information from a digital device connected to the pointing device-integrated text input device by wire or wirelessly.

The mode conversion unit 103 may be configured integrally with the pointer execution command unit 102 .

For example, a first gesture such as a contact of a part of the user's body on the pointer execution command unit 102 that responds primarily to a first touch or first pressure and secondarily responds to a second touch or second pressure It can be configured to detect a first touch or first pressure, switch modes, and generate a pointer execution command in response to a second touch or second pressure by a second gesture such as pressing a button.

The mode switching unit 103 may be composed of a temporary mode switching mode and a permanent mode switching mode.

For example, a temporary conversion mode may be set to switch from a text input mode to a pointing location information input mode in response to a first touch or first pressure and return to the text input mode when the first touch or first pressure is removed. there is.

Alternatively, in response to the first touch or first pressure, switching from the pointing location information input mode to the text input mode and returning to the pointing location information input mode when the first touch or first pressure is removed can be set as a temporary mode. .

In response to the second touch, second pressure, or push switch, the text input mode is switched from the text input mode to the pointing location information input mode, and a permanent switching mode is configured to maintain the pointing location information input mode even when the second touch or second pressure is removed. can

Temporary mode switching may be performed based on first control information received from a digital device connected to the pointing device-integrated text input device by wire or wirelessly.

The permanent mode may be switched by second control information received from a digital device connected to the pointing device-integrated text input device by wire or wirelessly.

The mode conversion unit 103 may be integrated with the pointer execution command unit.

For example, when a first touch or a first pressure is detected on the pointer execution command unit, a temporary mode is switched from a text input mode to a pointer location information input mode, and when a second touch or second pressure is detected, a pointer execution command is executed. and when the third touch or third pressure is applied, it can be set to a permanent conversion mode to operate in the pointer location information input mode even if the third touch or third pressure is removed.

At this time, it can be configured so that a pointer execution command can be input even during the permanent conversion mode.

The mode switching unit may be configured on the left or right side of the housing (106a, 106b)

The mode switching units 106a and 106b configured on the left or right side of the housing or on the left and right sides may be configured as virtual buttons or physical buttons to detect and operate a user's touch input or pressure.

The mode switching units 106a and 106b formed on the left or right side of the housing or on the left and right sides of the housing may be configured to have an input area of 3 cm or more and less than 15 cm along the side of the housing.

The pointing device-integrated text input device may have a transmission unit 104 that transmits data wired or wirelessly to an external or digital device including the pointing device-integrated text input device.

The digital device may receive text input or receive pointer location information.

2 is a flowchart illustrating an example of an operation sequence according to mode switching of a pointing device and a text device.

The pointing device-integrated text input device may have a separate power supply, receive power from the outside in a wired or wireless manner, and may have a separate switch for controlling the power supply.

When power is supplied to the pointing device-integrated text input device by the switch controlling the power supply unit, it is possible to determine whether the pointing device-integrated text input device is currently in a text input mode or a pointing location information input mode (200).

As a result of the determination, in the case of the text input mode, the text input device may be activated and text input may be received from the user (201).

The user's text input may be transmitted to a wired or wirelessly connected digital device (202).

When the mode is switched to the pointing location information input mode during the text input mode, the text input mode can be switched to the pointing location information input mode.

Alternatively, it may be configured so that pointing location information can be input simultaneously with text input.

When the mode is switched to the pointing location information input mode, pointing location information may be received by a user's input (204).

The received pointer location information may be transmitted to a digital device connected by wire or wirelessly (205).

When the pointing device-integrated text input device receives the pointer first execution command (206), it can transmit the pointer first execution command to a digital device connected by wire or wirelessly (207).

When the pointing device-integrated text input device receives the pointer second execution command (208), it can transmit the pointer first execution command to a digital device connected by wire or wirelessly (209).

When the temporary mode switch is released or the permanent mode switch is released, the pointing device-integrated text input device may switch to the text input mode.

When the power of the pointing device-integrated text input device to the power switch of the power supply unit is cut off, there is no connected digital device or the connection is disconnected, or when there is no user input for a certain period of time, or when there is no user input for a certain period of time, or when the control of a wired or wirelessly connected digital device is terminated. can

3 is an exemplary embodiment of the configuration of a text input device and a pointing device.

The pointing device-integrated text input device may include a first housing 301 including a power supply unit, a control unit, or a communication unit, and a second housing 302 configured to configure a text input area and a pointing location information input area.

A text input device integrated with a pointing device may have a text input device receiving a text input from a user and a text input area 303 .

At this time, the text input area 303 may be composed of virtual buttons or physical buttons.

A pointing location information input device may be configured in the form of a pressure sensitive or capacitive touch pad and positioned on a physical button of the text input device (304).

At this time, if the text input device is configured in the form of a physical touch pad such as a pressure-sensitive or capacitive type, the touch pad can be used as a text input device and a pointing location information input device, and the mode can be switched by the mode switching unit.

In this case, a large-area touchpad-type pointing device-integrated text input device 300 composed of a touchpad 304 including a plurality of text button areas of a text input unit may be configured as a physical touchpad such as a pressure-sensitive or capacitive touchpad.

Alternatively, a multi-touch pad type pointing device-integrated text input device 310 composed of a plurality of touch pads 311 including a text button area of a text input unit may be configured as a physical touch pad such as a pressure-sensitive or capacitive type.

Alternatively, an upper camera-type pointing device-integrated text input device 320 may receive (321) input of pointing location information by an infrared camera or an RGB camera 222 located at the upper portion of the pointing location information input area. there is.

In this case, the top camera-type pointing device integrated text input device 320 may configure the virtual text input button 303 using the top camera.

The camera may be configured as a bottom camera 332-type pointing device-integrated text input device 330 configured to receive 331 input of pointing location information by being located at the bottom of the second housing.

In this case, the lower camera-type pointing device-integrated text input device 330 may configure a virtual text input button 303 that replaces a physical text button by using a lower camera.

Alternatively, a virtual pointing location information input area consisting of a pair of infrared receivers or ultrasonic receivers receiving information in which infrared rays or ultrasonic waves transmitted by an infrared transmitter or ultrasonic transmitter for inputting pointing location information are blocked or interfered with by a part of the user's body ( 341) can be configured as a transceiver-type pointing device-integrated text input device 340 receiving data.

At this time, the paired virtual pointing location information input area may be used as a virtual text button input means instead of a physical text button by the mode switching unit.

4 is an example of a pointer execution command unit-integrated mode conversion unit.

Pointer execution command In the button-type pointer execution command unit having switches 404 and 405 that generate a touch input, a mode switching unit 401 for switching between text mode and pointing location information input mode by detecting a user's touch input at the top of the button is located. Pointer execution command unit integrated mode conversion unit 400 using can be configured.

When the elastic body 403, which moves in position by the user's pressure and returns to its original position when the pressure is removed, and the button 402 that receives the user's pressure and moves in position by the user's first pressure, the pointer In the button-type pointer execution command unit having the first switches 404 and 405 for generating an execution command, the second switch unit 411 generates a mode switching execution command by being joined by a second user pressure smaller than the user's first pressure, 412) may be configured as a pressure differential pointer execution command unit integrated mode conversion unit 410.

In the mode conversion unit 410 integrated with the pressure-sensitive pointer execution command unit, the button unit 402 may be moved and fixed so that it does not return to its original position by the elastic body 403.

At this time, the position at which the button is fixed is set to a position where the second switches 411 and 412 are connected and the first switches 404 and 405 are not connected so that the button is fixed and operated in a permanent mode switching mode. .

In the mode switching unit 400 integrated with the pointer execution command unit using touch input, the permanent mode switching switch 414 can be operated by moving the position such as sliding the button unit, and the permanent mode switching switch 414 When additional pressure is applied in the operated state, the pointer execution command switches 404 and 405 may operate.

The mode switching unit 410 integrated with the pointer execution command unit is composed of a touch pad 421 and operates as a mode switching unit when the contact area of a part of the user's body in contact with the touch pad is within a first predetermined range, and operates as a mode switching unit within a second predetermined range. It can be made to work as a pointer execution command.

5 is an example of displaying a pointer location information input area.

The human interface device of the present invention may be designed to further include pointer location information input area display units 701 and 702 that visually display the pointer location information input area in the pointer location information input mode.

The mode switching unit of the present invention is provided separately from the button of the text input unit and recognizes that a part of the user's body is touched to a part of the human interface body and switches the text input mode and the pointer position information input mode. It can be designed to operate in the pointer location information input mode and operate in the text input mode when non-touch.

At this time, if the part of the body used for mode switching is the right hand (106b), the hand inputting the pointer location information 108a can be designed to be the left hand.

In this case, it is preferable to design the pointer location information input area closer to the corner opposite to the corner where the mode switching unit is located, and the same principle can be used when using the left and right hands in reverse. (106a, 108b)

On the other hand, it can be designed so that the part of the body used for mode switching is the right hand and the hand inputting the pointer location information is also the right hand.

In this case, it is preferable to design the pointer position information input area to be closer to the corner where the mode switching unit is located than to the corner opposite to the corner where the mode switching unit is located, and the left hand can be designed in the same principle.

The mode switching unit may determine the text input mode and the pointer location information input mode based on the number of user fingers recognized by the pointer location information input unit.

The number of the user's fingers recognized when determining the pointer location information input mode is smaller than the number of recognized user's fingers when determining the text input mode.

For example, while controlling the mode switching unit with the left hand, the finger of the left hand may not be touched from the text input button and the index finger of the right hand may be touched to input pointer location information. At this time, the recognized user's finger the number of is one.

On the other hand, when the fingers of the left hand and the right hand are touched on the keyboard for text input, the number of the recognized user's fingers from 2 to 8 is recognized.

The pointer location information input mode display unit temporarily displays the pointer location information input mode when the mode switching unit switches to the pointer location information input mode, or displays the pointer location information input area from the point of time when the mode is switched to the pointer location information input mode to the point of release. can be displayed visually.

The pointer location information input mode display unit may be displayed by a visible ray generator as reflected light from the text input button or by the text input button, or through a gap between the text input buttons.

The pointer location information input mode display unit is composed of invisible ray generators 701a and 701b and surfaces 702a and 702b coated with a dye that emits visible light in response to the invisible ray, and the dye is used to display the text. It may be applied to an input button or a space between the text input buttons.

The mode switching unit may further include a handside determination unit that determines whether the user inputs the pointer location information with a left hand or a right hand.

A display area of the pointer location information input display unit may be flexibly displayed according to the handside determination unit.

Button arrangement and operation of the pointer execution command unit may be flexibly switched according to the handside determination unit.

For example, when the pointer execution command unit includes the right-click and left-click of a mouse, buttons for performing the right-click and left-click of the mouse may be switched according to the judgment of the handside determination unit.

The pointer location information input area display unit may display different pointer location information input areas 702a and 702b according to the determination result of the handside determination unit.

The mode switching unit may be designed to automatically switch to the text input mode when pointer location information is not input from the user for a certain period of time or when an input is received through a text input button in the pointer location information input mode.

The pointer location information input area display unit may apply dye to the text input button or a part of the text input area so as to be visually displayed regardless of the mode of the mode switching unit, so that the pointer input area can be recognized even during the text input mode. .

6 is an example of a pointer execution command unit-integrated mode conversion unit.

During the input work in which the text input mode and the pointer location information input mode are frequently switched, the number of times to input mode switching and pointer execution commands increases.

For example, in the case of a right-handed person, if you want to input pointer position information during text input in text input mode, you must switch the mode with your left or right hand, input the pointer position information, and then input it into the pointer real name command section with your left hand. do.

In general, during quick work, the user inputs text and pointer location information and pointer execution commands while keeping their eyes on the monitor. If the mode conversion unit and pointer execution command input unit are separately provided, hand movements occur frequently. This can make it difficult to perform functions properly or to look at the keyboard with your eyes because you cannot find the exact location.

To solve this problem, for example, in the case of a right-handed person, when text is input in the text input mode and the hand is placed on the mode change unit with the left hand, a mode change command is generated and the pointer input mode is changed. Further, when the pointer position information is input with the right hand while the hand is placed on the mode switching unit, and pressure is applied to the mode switching unit, the pointer execution command unit receives the user's input.

Thus, the user can share the location of the mode conversion unit for mode conversion and the location of the pointer execution command unit for pointer execution commands.

As an example for this, the mode switching unit is composed of a touch switch capable of accepting a touch input from a user's hand, and the pointer execution command unit is composed of a switch that responds to pressure such as a tact switch and is located below the mode conversion unit.

At this time, the first pointer execution command unit 1104 and the second pointer execution command unit 1105 are connected to each other with a conductive material capable of recognizing a touch from the user's hand or are commonly connected to the mode change unit 1201. Therefore, whether the user touches the first pointer execution command unit or the second pointer execution command unit, the mode conversion is performed identically.

At this time, the mode conversion operates in the pointer location information input mode while the touch is being made, and operates in the text input mode when the touch is released.

Mode conversion by touch can be configured with another switch that operates with a pressure smaller than that for a pointer execution command or a sensor that can sense the position of a user's finger.

At this time, the mode conversion and pointer execution command unit is located in an area distinct from the text input area. Preferably, in the case of a right-handed person, it is located in an area outside the left side of the text input area. If the mode conversion unit and the pointer execution command unit are located outside the text input area, the possibility of confusing the pointer location information input unit with the pointer location information input disappears and the pointer location information input area can be expanded.

The complex human interface device of the present invention may include a second mode switching unit 1202. The second mode switching unit is a switch that operates like a toggle switch and is switched between a text input mode and a pointer location information input mode whenever an input is received from the user. Accordingly, even if the user does not touch the mode switching unit with the left hand, it is possible to input pointer location information with only the right hand.

In this case, when the second mode switching unit receives a mode switching command by touch when the complex human interface device is in the text mode, the complex human interface device of the present invention operates in the pointer location information input mode. In addition, when a mode change command by touch is received when the complex human interface device by the second mode change unit is in the pointer location information input mode, the pointer location information input mode is maintained, but the mode change command by touch is released or When a text input is received through the text input unit, the text input mode is switched.

At this time, when the text input mode is switched to the text input mode, at least the first text input is ignored, and when at least two text inputs are received, the text input mode is switched.

At this time, when at least two or more text inputs are received and the text input mode is switched, the complex human interface device transmits the text input including at least the first text that has been ignored to the digital device, and then transmits the newly input text input information to the digital device send to

7 is an example using a cover of a complex human interface device.

The complex human interface device requires a space of at least 1 to 2 millimeters on the top of the plane of the text input device composed of physical devices to form a pointer location information input area, and an absorber for absorbing or reflecting optical signals. Alternatively, a border for locating the reflector may be needed on at least three corners surrounding the text input area.

At this time, a difference of at least 1 to 2 millimeters occurs between the heights of the edges of the at least three sides and the height of the text input area plane, and a rectangular parallelepiped type space is substantially formed.

The complex human interface device of the present invention may further include a multipurpose cover 1322 for protecting the text input area from external impact in the substantially rectangular parallelepiped type space (1310).

The multipurpose cover 1322 is separated from the complex human interface device (1320) and can be combined and separated by a magnet or a physical structure.

The multipurpose cover 1322 may have a structure that is folded several times. Preferably, a width of at least one region of the divided region of the multipurpose cover may be smaller than a width of another region in a structure that is folded twice (1341).

This can further reduce the inclination of the complex human interface device when the multi-purpose cover is mounted on the bottom to adjust the inclination of the complex human interface device after being folded.

When the multi-purpose cover is folded and mounted on the lower surface of the complex human interface device, a part of the folded surface contacting the ground may have an inclined surface 1342 so that the contact area with the ground can be widened.

The tilt of the complex human interface device desired by the user can be adjusted by the number of times the multipurpose cover 1322 is folded.

The multipurpose cover may contain a rechargeable battery 1323 inside the cover.

The power source of the rechargeable battery 1323 may be an electrode located in a part of an area protruding from the portion covering the text input area covering the edge of the portion covering the text input area at the lower end of the multi-purpose cover (1331), and the multi-purpose cover When the cover covers the text input device (1310), it is connected to the electrode provided on the top of the complex human interface device.

In addition, when the multipurpose cover is folded and mounted on the lower end to adjust the inclination of the complex human interface device, it may be connected to the electrode provided on the bottom of the complex human interface device.

The complex human interface device may be connected to an external power source to supply power to the rechargeable battery 1323 inside the multipurpose cover or separately charge the multipurpose cover.

At this time, the bottom of the complex human interface device is a magnet or a physical coupling device or a magnet or a physical coupling device so that the protruding border area where the electrode 1331 is located and the area 1332 covering the text input area having a height difference therefrom can be attached at an accurate position. A groove into which the cover is inserted may be provided.

The rim of the multi-purpose cover is coated with a material that can remove fine dust, oil stains, moisture, etc., so that whenever it is attached to or detached from the complex human interface device, foreign substances on the front of the absorber or reflector, optical emitter, or camera can be removed. there is.

When the multi-purpose cover covers the text input area, power to the complex human interface device may be turned off by detecting this.

When the multipurpose cover is mounted on the lower surface of the complex human interface device, power of the complex human interface device may be turned on.

In addition, if there is no user input for a certain period of time after the power is turned on, the power may be cut off or converted to a standby mode.

When the multipurpose cover covers the text input area (1310), the composite human interface device (1321) has a rectangular parallelepiped shape substantially in the form of a thin plate, and is designed not to have an inclination when placed on the ground to maximize the aesthetic effect. and increase portability.

On the other hand, if the multi-purpose cover is folded and mounted on several under the complex human interface device, it can be tilted like a general keyboard.

The multipurpose cover may be configured as a detachable type, but may be designed in such a way that it is folded from the upper surface to the lower surface of the complex human interface device by a hinge.

8 is an example of a human interface device applied to a portable notebook.

The human interface device 1420 of the present invention can be used as an input device for a portable notebook computer.

In the portable notebook with the human interface device of the present invention, a display unit composed of a display panel 1411 and a frame 1410 supporting the display panel is bound to the human interface device of the present invention by a hinge 1427 and covered. It can be designed as a high-open structure.

At this time, the display unit is inserted inside the wall formed by the reflector or absorber 1424 of the human interface device of the present invention. Then, the thickness of the portable notebook using the human interface device of the present invention can be minimized.

To this end, the display unit of the portable notebook should be designed to have a width smaller than the width of the human interface device 1420 by at least twice the thickness of the reflector or absorber plates 1423 and 1424.

In other words, in FIG. 13, the display unit should be designed so that the multi-purpose cover can fit therein.

The display unit has a feature 1413 in which both corners are rounded or cut diagonally.

The pointer location information input devices 1421 and 1422 are characterized by being located toward the outer edge of the rounded or obliquely cut portion when the display unit is folded.

This is to fold the portable notebook to maintain a thin thickness without being hindered by the pointer position information input devices 1421 and 1422 when folded.

At this time, the mode conversion unit and the pointer execution command unit may be located outside the side of the human interface device.

In addition, more preferably, it can be positioned outside the text input area at the bottom. (1425, 1426)

At this time, it is preferable to configure the mode conversion unit and the pointer execution command unit integrally as shown in FIG. 12, but it is also possible to separately position them separately.

At this time, if the mode conversion unit or pointer execution command unit is located outside the lower part of the text input area, and the user places a finger to control the mode phone unit or pointer execution command unit, the pointer location information input devices 1421 and 1422 are To prevent malfunction by inputting pointer location information, the pointer location information input area should be set except for the area where the mode conversion unit or pointer execution command unit is located.

To this end, it may be designed to prevent the optical signal from reaching the mode conversion unit or the pointer execution command unit by adjusting the area covered by the optical signal generated from the pointer location information input device.

Alternatively, the optical signal reception angle of the camera is adjusted so that the camera does not receive the optical signal generated by reflection, interference, or blocking between the user's finger and the optical signal located in the mode conversion unit or the pointer execution command unit, or Optical signals can be ignored.

The portable notebook computer is designed to have absorption plates or reflectors for absorbing or reflecting the light source generated by the pointer position information input device at at least three corners.

At this time, two surfaces are located on the sides of the human interface device (1423, 1424), and one side is the surface where the display unit is in contact with the human interface device. When the display unit is open within a certain angle, the pointer location information input device (1421 , 1422), a reflector or an absorber is positioned in a certain area 1412 so that the light source generated by the light source is sufficiently reflected or absorbed.

9 is an embodiment in which a lower position type pointer position information input device and a lower position type pointer execution command unit are applied.

The human interface device includes a text input unit 1501 composed of a plurality of physical buttons, a pointer location information input unit that receives information related to the location of the pointer from the user, and a pointer that receives commands from the user to perform at least one function at the location where the pointer is located. A pointer execution command receiving unit for receiving signals from the execution command units 1505 and 1506, a mode switching command receiving unit for receiving signals from the mode switching unit for switching to the pointer location information input mode, and related to the pointer position input to the pointer location information input unit. A pointer location information transmitter for transmitting information to a digital device connected to the human interface device by wire or wirelessly, and the pointer location information input area of the pointer location information input unit is at least a part of the text input area of the text input unit composed of the plurality of physical buttons. located parallel to the upper end of the pointer location information input unit, the optical signal reflector or absorber (1503a, 1503b, 1503a, 1503b, 1503c), and the fourth surface 1502d surrounding the text input unit is formed lower than the height of the first to third surfaces, and the fourth surface may include the pointer execution command units 1505 and 1506. The first surface and the third surface may be located on the left and right sides of the text input unit, the second surface may be located above the text input unit, and the fourth surface may be located below the text input unit.

The pointer location information input unit may include at least two sensor modules, and the two sensor modules may be located at lower left and lower right corners of the text input unit, respectively.

The mode switching unit may be operated by a user's first input input to the first button, and the pointer execution command receiving unit may be operated by a user's second input input to the first button.

The first button is made of a material capable of detecting an electrical signal generated by a finger touch, and the first input can be generated by recognizing the electrical signal.

While the first input is maintained, it operates in the pointer location information input mode, and when the first input is released, the pointer location information input mode is released, and the first input may be generated by physical pressure.

The mode switching unit can be operated by a second input of a user input to a second button, and when the second input is input once, the pointer location information input mode is activated when it is released, and the pointer location information input mode is activated. If activated, it can be turned off.

At this time, it is preferable that the light source generated by the pointer location information input devices 1421 and 1422 and the image receiving device face the central part of the keyboard.

However, in order to ensure a small keyboard or a wider pointer location information input area, the absorber or reflector (1423, 1424) located on the side of the human interface device is used as a reflector rather than an absorber, and the pointer location information Light sources and image receiving devices of the input devices 1421 and 1422 may be installed to face the reflectors 1423 and 1424 .

That is, the pointer position information input device 1421 can receive the pointer position information reflected by the reflector 1423 and received.

In addition, the pointer location information input device 1422 can receive pointer location information that is reflected by the reflector 1424 and received.

In this way, the installation position of the pointer location information input devices 1423 and 1424 can be obtained by placing the left and right outer portions of the actual complex human interface device, so that a wider mouse pointer location information input area can be obtained.

At this time, the angle of the reflector may be installed so as to open a certain angle from 1 degree to 15 degrees. That is, the lower ends of the reflectors 1423 and 1424 may be wider than the upper ends.

In this case, the installation position of the pointer position information input devices 1423 and 1424 is located to the left and right outer parts of the actual complex human interface device, and at the same time, it is not disturbed by the pointer execution command input device located at the lower part of the keyboard. You can get the effect of moving to the top of a certain distance so that it doesn't.

The complex human interface device includes a reflector for reflecting a light source generated from the pointer position information input unit, and at least two pointer position information input units are installed on the left and right sides of the human interface device, respectively, It is installed on the left and right sides of the interface device, respectively, and the left pointer location information input unit is installed toward the left reflector to receive a light source input through the left reflector, and the right pointer location information input unit is installed toward the left reflector. It is installed toward the reflector and can receive a light source input through the right reflector.

The left and right reflectors may not be parallel and may be installed to widen toward a portion where the left and right pointer location information input units are located.

The pointer location information input area may be divided into a first area and a second area. That is, for example, a pointer location information input signal input from the right hand is received from the first area, and a pointer location information input signal input from the left hand is received from the second area.

In general, in the multi-touch control, after receiving a plurality of touch input signals, a control command is determined according to a future movement aspect of the plurality of touch input signals.

However, in this embodiment, the first pointer location information input signal received from the first pointer location information input area can be used to determine the number of touch inputs.

Also, the second pointer location information input signal received from the second pointer location information input area may be used to receive a movement signal of a touch input.

That is, for example, when a vertical sliding touch input is input with one finger of the right hand while a two-finger touch is input and maintained with the left hand, this signal is used as two touch signals of a general multi-touch function for vertical touch input. can be replaced In general, when an up and down sliding touch input is performed with two touches on Apple's MacBook, an example of performing an up and down scroll input of an Internet browser is exemplified. At this time, when the tap is performed with one finger of the right hand, since there are two touch inputs of the left hand, the function can be performed in the same way as when the tap is performed with two fingers.

As another example, when left and right sliding touch input is input with the right hand while maintaining three touch inputs with the left hand, this signal is replaced with the case of performing left and right sliding touch input with three touch signals of a general multi-touch function. can do. In general, when sliding touch input is performed from side to side with three touches on Apple's MacBook, functions such as swiping a full-screen app or dragging with three fingers can be taken as an example. In this case, when the tap is performed with one finger of the right hand, the same function can be performed as when the tap is performed with three fingers because the left hand is performing three touch inputs. The example of the left hand and the right hand may be replaced with the example of the right hand and the left hand, and the number of input signals determining the number of touches is not limited to the above two and three, but may include one, four, or five touches. can

The information related to the pointer location received by the pointer location information input unit includes first pointer location information for moving the pointer location and second pointer location information for switching the human interface device from a text input mode to a pointer location information input mode. It may consist of location-related information.

For example, when a pointer location information input signal higher than a preset threshold is generated during text input mode, the pointer location information input mode can be switched.

10 is a configuration diagram of a complex function input button.

The complex function input button includes a character input unit 303 for inputting at least one character in a human interface such as a keyboard, and a capacitive type for inputting pointing location information for moving a mouse pointer or a user's touch or 3D gesture input on the screen. It may be one button for configuring the pointing device-integrated text input device 310 configured with the physical touch pad 311 .

In this embodiment, only the capacitive touch method is used as the pointing location information input unit, and the mode switching unit, pointer execution command input unit, special function key, and mode of the complex human interface device described using the pointing location information input unit in the optical method are described. The contents such as the location of the conversion unit and the pointer execution command unit, connection to the inside or display unit, battery embedding method using the cover unit, angle adjustment function of the human interface device, text character input area and mouse pointing location information input area are equally applicable. can

The pointing device integrated text input device 310 may be composed of a plurality of multi-function input buttons.

The complex function input button includes a cover part 1010 that is touched by a user's finger, an electrode part 1020 including a transmitter and a receiver for forming an electric field, and a base part for protecting the electro part and securing connectivity with the elastic part. (1030).

The elastic part may be composed of an elastic body 1050, an upper support part 1040, and a lower support part 1060.

The upper support part and the lower support part may be configured in a cylindrical shape or a polygonal cylinder shape with angles.

The upper support part may be fixed to the cover part, the electrode part, and the base part.

The lower support portion may serve as a guide for reciprocating the upper support portion.

The upper support part and the lower support part connect an upper structure including an electro part and a lower structure including an elastic part in a pantograph structure, and may guide movement of the upper structure.

The elastic body may be a dome-shaped elastic material having a restoring force, a plate-shaped elastic material having passed a restoring force, an elastic material having a spring shape, or a plurality of magnets having different polarities facing each other, or a combination thereof. can

The elastic part may be moved to a third height by receiving the second pressure from the cover part, and may be restored to the first height when the second pressure of the cover part is released. Moving to the third height means that the position is physically moved, the object is bent by pressure, or the second pressure is sensed by software or the like.

When the first pressure is sensed, a pointer execution command may be generated, and when the second pressure is sensed, an additional pointer execution command may be generated.

For example, a first pressure may indicate an application execution command at a location where a pointer is located, and a second pressure may execute an additional option or a preview of the application.

The electrical signal representing the input of the predetermined character generated through the switch of the first to fifth multi-function input buttons is an electrical signal representing the input of a different character, and the electric signal of the first to fifth multi-function input buttons The contact position or change of the contact position of the user's finger determined from the signal received through the DEBU may be for controlling the position of one pointer in a connected manner.

The human interface device may further include a mode switching unit for switching between a text input mode and a pointing location information input mode.

The mode conversion unit may be operated by the complex function input button, a separate physical switch unit, a touch switch unit, or a predefined touch pattern.

The human interface device includes a character input device composed of a plurality of combinations of complex function input buttons capable of inputting a single character and pointing location information for continuously controlling one pointing input device on the electrode of the plurality of complex function input buttons. can occur.

Apart from the plurality of multi-function input buttons, the human interface device may include a mode switching unit and a pointer execution command unit.

The mode conversion unit and pointer execution command unit are one button composed of an electrode and a switch that can recognize a user's touch, and after switching modes by touch, a pointer execution command is generated with a pressure signal without moving or lifting a finger. can

The complex function input button may include a light emitting unit 1070 .

The light emitting unit may illuminate characters indicating character input of the multi-function input button or illuminate the position of the multi-function input button itself.

The light emitting unit may be located on an upper structure including an electrode or on a lower structure including an elastic body.

The upper structure is a part that moves by a user's pressure, including the electro part, and may include a cover part, an electro part, a base part, and the like.

The lower structure may be a part that does not move when a user's pressure is applied, including a structure that guides the movement of the upper structure and transmits or receives an electrical signal to or from the electrode unit.

11 is an example of an electrode of a complex function input button.

The electrostatic touch type electrode unit is composed of a plurality of transmitters and receivers.

In the case of a general capacitive touch method, the electro-transmitter unit of 5 to 30 rows and the receiver unit of 5 to 30 rows are configured in a lattice shape to form a square surface of a certain size.

In this embodiment, the multi-function input button may be composed of an electrode part having the size of one character input button with a width of generally 10 to 20 millimeters.

The electrode unit can be used as a pointing location information input device by configuring a small touch pad independently, and can be used as a pointing location information input device with connectivity in a wider area together with a plurality of adjacent complex function input buttons.

The electrode unit may be composed of one to three transmitters and receivers.

In this embodiment, the electrode unit of one multi-function input button will be described as an example of a multi-function input button composed of three rows of transmitters with different drive signal cycles and two rows of receivers with different scan cycles.

Here, the period may mean a timing at which a signal is generated.

The present invention includes a part that can be easily modified by a person skilled in the art in the number and shape of the transmitter and receiver according to the size and shape of the button.

The first transmitter (1101, 1102, 1103) with the first drive cycle, the second transmitter (1104, 1105, 1106) with the second drive cycle, and the third transmitter (1107, 1108, 1109) with the third drive cycle can have

It may have first receivers 1110 and 1111 having a first scan period and second receivers 1112 and 1113 having a second scan period.

The first to third transmitters may be short-circuited on a circuit board or connected as one without a separate connection member.

The first and second receivers may be configured to be printed on a circuit board in a short-circuited state and connected by a separate connecting member, or to be independently scanned for electrical signals such as capacitance in the same scan period.

In this embodiment, the electrode unit recognizes the plurality of electrode units configured on the plurality of complex function input buttons as if they are one large area electrode unit, and the electrode unit moves up and down one by one. Part requires special design.

For example, the area of the second transmitter may be larger than the sum of the areas of the first and third transmitters.

The sum of the widths of the first to third transmitters may be smaller than the sum of the first and second receivers.

In the case of a general capacitive touchpad, receivers having one scan cycle are interconnected. However, in this embodiment, the first receiver having one scan period is composed of at least two receiver blocks 1110 and 1111, and the at least two receiver blocks transmit scan signals to the outside while being shorted to each other. can do.

The scan signal may be signal processed by summing the capacitance signals received from each receiver block.

In this embodiment, the transmitter is exemplified horizontally and the receiver vertically, but the receiver can be configured horizontally and the transmitter vertically on the same structure.

The transmitter and receiver may be electrically shorted to insulators 1114 and 1115.

The electrode unit may include a bridge 1120 that transmits and receives an external drive signal and a scan signal that are stacked or connected below.

The bridge may transmit a dry signal to the electrode unit and receive a capacitance signal from the receiver.

12 is an example of arrangement of multiple function input buttons.

In this embodiment, a complex human interface device composed of a plurality of multi-function input buttons may have at least five multi-function input buttons.

A second composite function input button 1220 and a third composite function input button 1230 are located to the left and right of the first composite function input button 1210, respectively, and the central point of the second composite function input button is the first composite function input button 1210. Arranged on a virtual X-axis line extending from the center point of the function input button to the left and right, and the center point of the third composite function input button is on the virtual X-axis line extending to the right from the center point of the first composite function input button. can be arranged in

A fourth composite function input button 1240 and a fifth composite function input button 1250 are further included, and the center point of the fourth composite function input button is a virtual Y extending upward from the center point of the first composite function input button. It is located on the left side of the axis and is located on the right side of a virtual Y axis extending upward from the center point of the second composite function input button, and the center point of the fifth composite function input button is downward from the center point of the first composite function input button. It is located on the right side of the extended virtual Y-axis and is located on the left side of the virtual Y-axis extended downward from the center point of the third composite function input button, and the fourth and fifth composite function input buttons are the first composite function input buttons. It may be positioned adjacent to the input button.

The distance at which the central point of the fourth multi-function input button is spaced to the left from the virtual Y-axis extending upward from the central point of the first multi-function input button is the distance from the central point of the fifth multi-function input button to the first multi-function input It may be shorter than the distance to the right from the virtual Y-axis extending downward from the center point of the button.

For example, in the case of the fifth composite function input button, it may be positioned by moving 40 to 60 percent of the width of the first composite function input button to the right from the Y axis.

In the case of the fourth composite function input button, it may be moved from 15 to 35 percent of the length of the width of the first composite function input button to the left from the Y axis.

The first transmitter of the first to third multi-function input buttons may have the same drive signal cycle as the third transmitter of the fourth multi-function input button.

The second receiver of the first multi-function input button may have the same scan period as the first receiver of the fifth multi-function input button.

The first receiver of the first multi-function input button and the second receiver of the fifth multi-function input button may have different scan periods.

The second receiver of the first composite function input button and the second receiver of the fourth composite function input button are not arranged in a line in the virtual Y-axis direction, but move to the left within the width of the first composite function input button. The second receiver of the first multi-function input button and the second receiver of the fourth multi-function input button may have the same scan period while being moved and positioned.

As a result, distortion of the pointing location information signal may occur, and a further step of correcting by software may be required.

The human interface device further includes a sixth multi-function input button 1560, and the center point of the sixth multi-function input button is located on a virtual Y-axis extending downward from the center point of the fifth multi-function input button. Complex human interface device, characterized in that.

Fig. 13 is an example of arrangement of electrodes of different patterns of complex function input buttons.

The first composite button input button and the fourth composite button input button may not be arranged in a line on the virtual Y-axis but may be moved to the left by a first distance.

Accordingly, signal distortion of the receiver of the first composite button input button and the fourth composite button input button may occur.

In order to prevent this or minimize distortion, the pattern of the fourth composite button input button may be modified and designed.

For example, the pattern of the electrode by the first distance from the left side of the electrode 1130 shown in FIG. 11 may be composed of a second electrode shape 1350 moved to the right side of the electrode. there is.

The shape of the second electrode has an effect of aligning the receivers of the first composite function input button and the fourth composite function input button along a virtual Y axis.

A seventh composite function input button 1360 configured in the shape of the second electrode may be located to the right of the fourth composite function input button.

In this case, the scan period of the receiver 1351 located at the most right of the fourth multi-function input button may be the same as the scan period of the receiver 1361 located at the most left of the 7th multi-function input button. At this time, the second receivers 1112 and 1113 of the first multifunction input button may also have the same scan period.

14 is an example of an electrical connection member of a multi-function input button.

Transmitters of the first, second, and third multi-function input buttons may be connected to each other through a first electrical connection member, and receivers of the first, fourth, and fifth multi-function input buttons may be connected to each other through a second electrical connection member. there is.

As a first embodiment of the connecting member, the connecting member actually moves from the first height to the second height by applying pressure to the complex function input button, and the first conductor that moves together by contacting or bonding to the electro part, the composite function input button It may be composed of a second conductor provided on a non-moving part of the function input button to receive an electrical signal from the first conductor, and a base PCB connected to the second conductor of a nearby complex function input button. there is.

The base PCB can transmit/receive drive signals or scan signals from the control unit to transmitters or receivers of a plurality of complex function input buttons at the same time.

The first conductor and the second conductor may contact each other in a sliding manner and move while maintaining the connection.

The first conductor and the second conductor maintain contact when no pressure is applied to the composite function input button or when pressure is applied below a predetermined threshold, and when pressure is applied above a predetermined threshold. In this case, it may be a structure that maintains contact and short circuits.

The first conductor and the second conductor may be formed in a non-contact method (1450). The first conductor and the second conductor may be provided in the form of a conductive plate having a predetermined area so as to come into contact with each other at regular intervals.

The predetermined gap may be filled with a non-conductor 1443 having a dielectric constant such as air, plastic, silicon, glass, or ceramic.

In this case, the electrical signal may be transmitted in the form of a radio signal having a frequency.

In this way, it is possible to reduce wear of the conductor or generation of noise in the signal due to friction between the first conductor and the second conductor, and to minimize the generation of friction that interferes with the pressure applied to the complex function input button. It has the advantage of simplifying the process.

At least one of the first and second electrical connection members may be printed as a conductor together with the electrode part on a flexible film, or may be an electrical connection member provided in the elastic part closely adhered to or bonded to the electrode part.

15 is an example of a switch for character input of a multifunction input button.

When pressure is applied to the multi-function input button to move it from the first position to the second position, the switches 1511, 1512, and 1513 generating electrical signals indicating input of predetermined characters may be operated.

When the switches 1512 and 1523 located on the base PCB or separately provided membrane are connected by the terminal 1511 located on the moving part of the complex function input button, an electrical signal for indicating the input of a predetermined character may be generated and transmitted to the control unit.

The switch may be generated by sensing a separate push switch or a change amount of magnetism or an electric field, intensity of light, or sound.

16 is an example of a human interface device having multiple function input buttons.

17 is an example of an Electrode keycap.

A plurality of the electrode keycaps 1700 may be positioned on a common plane to form the electrode keycap layer 1620.

For example, one Electrode keycap can accept one character input according to the mode and can detect a certain amount of change in touch position.

On the other hand, the Electrode keycap layer can accept a plurality of character inputs, and can detect a change in touch position in proportion to the number of the Electrode keycaps.

The complex human interface device includes a control unit, a cover unit 1010 in contact with a user's finger, a first conductor 1741, 1742, 1713, 1714, 1746, and 1748, and an electrode keycap including an electrode unit 1020, 1701. (1700), may include a second conductor.

The second conductor may be provided on the first circuit layer 1630 .

When a user's finger touches the cover part closely attached to the top of the electrode keycap, an electric field is affected between the transmitter and the receiver provided in the electrode, and capacitance is changed.

The first conductor may be provided in plural and may be provided in the transmitter and receiver of the electrode unit, respectively.

When a drive signal is applied at a constant signal period through the first conductor connected to the transmitter, capacitance is formed between the transmitter and the receiver, and the generated capacitance is connected to the receiver by the receiver. It is transmitted through the second conductor electrically connected to the first conductor through the first conductor, and the control unit detects a change in the transferred capacitance.

The electrode unit is electrically connected to the second conductor through the first conductor, and the electrode unit is located on the first surface 1702 of the electrode keycap, and the first conductor is connected to the first surface. It may be formed with a pre-defined area on the pillar formed perpendicular to.

At least two pillars formed perpendicular to the first surface may be formed, and the first conductor may be formed on each of the at least two pillars.

The electrode units 1020 and 1701 include a transmitter and a receiver, and the first conductors respectively formed on the at least two poles may be electrically connected to the transmitter and the receiver, respectively.

The first conductor may be formed surrounding the surface of the pillar.

The pillar may be formed in a tubular shape having a hole 1703 penetrating the pillar, and the hole penetrates the first surface 1702 together, and the electrode part and the first conductor are connected through the inner wall of the hole. can be electrically connected.

The electrode unit may have a plurality of pattern blocks 1701 having a specific shape on the first surface, and at least some of the pattern blocks may be electrically connected to each other through the second surface 1731 of the electrode keycap.

The plurality of pattern blocks 1704 electrically connected through the second surface may be electrically connected to the second conductor through a first conductor 1713 formed on one pillar.

For example, three uppermost triangular pattern blocks on the first surface 1702 may be electrically connected by a conductor provided on a side surface 1731 adjacent to the triangular pattern block.

In the same way, three lowermost triangular pattern blocks may be electrically connected due to a conductor provided on a side surface adjacent to the three lowermost triangular pattern blocks.

At this time, the uppermost or lowermost three triangular pattern blocks may be electrically connected to one pillar provided on the rear surface and a hole provided in the porcelain pillar.

In addition, the triangle, rhombus, and triangular pattern blocks horizontally in the middle are electrically connected on the first surface, and similarly electrically connected to the first conductor through one pillar on the rear surface and a hole provided in the pillar. The pillar used here is located in the center of the rear surface and can be used simultaneously for the purpose of transmitting pressure to the elastic part.

At this time, the uppermost and lowermost pattern blocks provided in the middle may transmit transmitter signals and may have different signal cycles.

In addition, the two pattern blocks of a rhombus shape arranged horizontally on the upper side and the two pattern blocks of a rhombus shape disposed horizontally on the lower side are electrically isolated from the first surface and each has a hole provided in a pillar provided on the rear surface. It can be electrically connected to the first conductor through.

The first conductor may be provided on a plurality of pillars on the rear surface of the electrode keycap.

The plurality of pattern blocks electrically connected through the second surface may be transmitters having the same signal period.

The electrode part has at least three pattern blocks 1704 having a specific shape on the first surface, and each of the three pattern blocks is electrically connected to the second conductor through a first conductor formed on one pillar. can

At least two of the plurality of pattern blocks may have a first signal period, and at least one pattern block may have a second signal period.

The at least three pattern blocks may be receivers.

The composite human interface device further includes an elastic part 1050, and the pillar transfers a user's pressure applied to the cover part to the elastic part, and the cover part and the electrode keycap are moved from the first position to the second position. When the user's pressure is released, pressure is transmitted from the elastic part so that the positions of the cover part and the electrode keycap can be restored from the second position to the first position.

The electrode part and the first conductor may be formed by plating a non-conductive shape composed of at least one flat plate and at least two pillars vertically connected to the flat plate and having a hole penetrating the flat plate and the pillar as a conductor.

The electrode part may have a plurality of pattern blocks having a specific shape on the first surface, and a plurality of pillars may be formed on the third surface 1710 located on the rear surface of the first surface.

The first conductors may be formed on the plurality of pillars, and the first conductors formed on the plurality of pillars may be electrically short-circuited by a third surface.

The electrode part has a plurality of pattern blocks having a specific shape on the first surface, and the plurality of pattern blocks are electrically connected to a fourth surface 1732 located on one side of the first surface. The plurality of pattern blocks may be electrically shorted to each other by the electrical short circuit 1733 formed in .

The pattern block is not limited to the contents exemplified in the drawings, and may include various patterns such as a rectangle and a comb pattern.

The complex human interface device is composed of a plurality of the electrorod keycaps, and the first conductor provided on the plurality of electrode keycaps transmits an electrical signal to the plurality of second conductors, and the plurality of second conductors may be configured in one first circuit layer 1630.

The human interface device further includes a light source at the bottom of the electrode cap, the pillar is made of a tubular shape having a hole penetrating the pillar, and the cover part is made of a light guide plate material through which light is diffused. It may receive light from a light source and emit light.

The hole may be essentially used to electrically connect the electrode part of the electrode keycap and the first conductor in a plating manner.

However, when plating, it is difficult to give a function to conveniently work in a dark place because the electrode keycap becomes opaque and the keyboard keyboard emits light.

However, since the light source can be transmitted through the hole, the hole can be used as an electrical connection passage and a passage of the light source.

The cover part may have characters guiding text input printed or engraved on the surface where the user contacts, or a film having holes formed in the shape of the characters may be attached.

The first conductor and the second conductor face a predetermined area in a non-contact manner, and high-frequency electrical signals can be transferred through the predetermined area in a non-contact manner.

For example, when the pillar has a cylindrical shape, surfaces facing the first conductor and the second conductor in a non-contact manner may have a band shape with a constant width, and when the pillar is a square pillar, a constant width It can be a square strip with Alternatively, a facing portion having a desired shape and area may be implemented by providing the first conductor only in a partial area of the pillar.

18 to 22 are examples of electrode patterns of a plurality of complex function input buttons.

Complex human interface devices can be used in various electronic devices, such as desktop input devices, tablet PC input devices, laptop input devices, home theater control input devices, multimedia control input devices for self-driving cars, and virtual reality or augmented reality input devices.

The electronic device equipped with the complex human interface may include first to fifth complex function input buttons.

The first to fifth complex function input buttons may receive different text inputs, and may also receive a touch input for controlling one pointer location information from a user.

The first to fifth complex function input buttons may be positioned without being arranged in a line along the X axis or the Y axis, respectively.

For example, the first to third composite function input buttons may be arranged in a line in the direction of the X axis, and the fourth to fifth composite function input buttons may be positioned above and below the X axis, respectively.

In addition, the fourth composite function input button 1240 may not be aligned with the first composite function input button on the Y axis, but may be positioned apart from each other by about 25 percent to the left.

The fifth multi-function input button 1250 may not be aligned with the first multi-function input button on the Y-axis, and may be spaced apart about 50 percent to the right.

In order for the first to fifth multi-function input buttons to control one pointer location information, the plurality of transmitters and the plurality of receivers must be aligned in a row with transmitters having the same drive signal and receivers having the same scan signal cycle. should be lined up in a row.

On the other hand, since the 1st to 5th complex function input buttons are not arranged in a line with respect to the X or Y axis, the complex function input buttons are provided with 2 to 4 receivers or transmitters parallel to the X and Y axes, It is possible to align the receiver or transmitter even though the function input buttons are not aligned on the X or Y axis.

Each of the complex function input buttons includes an electrode unit 1020a, 1020b, 1020c, 1020d, 1020e, 1020f, 1020g, 1020h, 1020i, 1020j, 1020k, 1020l).

The electrode unit may include a transmitter parallel to the X axis and a receiver parallel to the Y axis. (1020a, 1020c, 1020e, 1020g, 1020i,1020k)

In the following embodiment, the electrode unit basically describes the case of a transmitter parallel to the X axis and a receiver parallel to the Y axis, but even if not separately described, the transmitter and receiver are switched, that is, the X axis The same configuration is possible for a parallel receiver and a transmitter parallel to the Y axis.

The electrode unit may include a transmitter parallel to the Y axis and a receiver parallel to the X axis. (1020b, 1020d, 1020f, 1020h, 1020j, 1020l)

18 is an example of an electrode pattern of a plurality of multi-function input buttons, and the electrode unit may include four transmitters and four receivers.

The embodiment described below is based on an embodiment consisting of four transmitters parallel to the X axis and four receivers 1020a parallel to the Y axis, but four receivers parallel to the X axis and parallel to the Y axis. The same explanation is possible for one of the four transmitters 1020b.

The transmitter unit may have first to fourth transmitters having at least two driver signal periods, and the receiver unit may have first to fourth receivers R1, R2, R3, and R4 having at least two different scan signal periods.

The first receiver of the fourth multi-function input button 1240 may have the same scan signal cycle as the fourth receiver of the second multi-function input button 1220 .

The second receiver of the fourth multi-function input button 1240 may have the same scan signal cycle as the first receiver of the first multi-function input button.

The third receiver of the fourth multi-function input button may have the same scan signal cycle as the second receiver of the first multi-function input button.

The fourth receiver of the fourth composite function input button may have the same scan signal cycle as the third receiver of the first composite function input button and the first receiver of the fifth composite function input button 1250. .

The electronic device equipped with the complex human interface has a sixth complex function input button 1260, and the sixth complex function input button is aligned and adjacent to the fifth complex function input button 1260 in a Y-axis, and the sixth complex function input button 1260 The first to fourth receivers of the multi-function input button may have the same scan signal cycle as the first to fourth receivers of the fifth multi-function input button.

On the other hand, the fifth multi-function input button and the sixth multi-function input button may have different driver signal cycles.

The electronic device equipped with the complex human interface may have a seventh complex function input button 1270 .

The first receiver of the seventh composite function input button may have the same scan signal cycle as the fourth receiver of the first composite function input button and the second receiver of the fifth composite function input button.

The second receiver of the seventh composite function input button may have the same scan signal cycle as the first receiver of the third composite function input button and the third receiver of the fifth composite function input button.

The first transmitters of the first to third multi-function input buttons may have a first driver period, and the second transmitters of the first to third multi-function input buttons may have a second driver period.

The first transmitters of the fourth multi-function input button and the seventh multi-function input button have a third driver cycle, and the second transmitter of the fourth multi-function input button and the seventh multi-function input button may have a fourth driver cycle.

The first transmitter of the fifth multi-function input button may have a fifth driver cycle, and the second transmitter of the fifth multi-function input button may have a sixth driver cycle.

The first transmitter of the sixth multi-function input button may have a seventh driver cycle, and the second transmitter of the sixth multi-function input button may have an eighth driver cycle.

In at least two of the first to fifth multi-function input buttons, the first to second receivers have the same scan signal period, and the third to fourth receivers have the same scan signal period. ,

At least two of the first to fifth multi-function input buttons have the same scan signal period for the second to third receivers, and different scan signal periods for the first and fourth receivers. can have

For example, the first to second receivers of the first multifunction input button have a first scan signal period, and the third to fourth receivers have a second scan signal period;

The first to second receivers of the third multifunction input button have a third scan signal period, and the third to fourth receivers have a fourth scan signal period;

The first receiver of the fourth multi-function input button may have a fifth scan signal period, the second to third receivers may have a first scan signal period, and the fourth receiver may have a second scan signal period. there is.

The first receiver of the seventh multi-function input button may have a second scan signal period, the second to third receivers may have a third scan signal period, and the fourth receiver may have a fourth scan signal period. there is.

19 is an example of an electrode pattern of a plurality of complex function input buttons, and the electrode unit may include two transmitters parallel to the X axis and four receivers 1020c parallel to the Y axis.

Although the embodiment to be described next describes an example consisting of two transmitters parallel to the X axis and four receivers parallel to the Y axis, two receivers parallel to the X axis and four transmitters parallel to the Y axis (1020d ), the same explanation is possible.

The electronic device equipped with the complex human interface is composed of first to fifth complex function input buttons, and each of the complex function input buttons may be composed of an electrode unit composed of a transmitter unit and a receiver unit.

The transmitter unit may have first and second transmitters having different driver signal periods, and the receiver unit may have first and second receivers having different scan signal periods.

The second receiver of the first composite function input button has the same scan signal cycle as the first receiver of the fifth composite function input button, and the first receiver of the third composite function input button has the fifth composite function input button. It may have the same scan signal cycle as the second receiver of the input button.

The first transmitters of the first to third composite function input buttons have a first driver signal cycle, the second transmitters of the first to third composite function input buttons have a second driver signal cycle, and the fourth composite function input button has a second driver signal cycle. The first transmitter of the function input button has a third driver signal cycle, the second transmitter of the fourth composite function input button has a fourth driver signal cycle, and the first transmitter of the fifth composite function input button has a fifth driver signal cycle. The second transmitter of the fifth multi-function input button may have a sixth driver signal period.

The center point of the first to third complex function input buttons is on a virtual X-axis, the first to second transmitters of the first to fifth multi-function input buttons are substantially parallel to the virtual X-axis, and The first receiver and the second receiver of the 1 to 5 multi-function input buttons may be located substantially orthogonal to the virtual X-axis.

The second receiver of the first composite function input button, the first receiver of the fifth composite function, and the second receiver of the fourth composite function input button may have the same scan signal cycle.

Alternatively, the second receiver of the first composite function input button, the first receiver of the fifth composite function, and the first receiver of the seventh composite function input button may have the same scan signal cycle.

The second receiver of the first composite function input button and the first receiver of the fifth composite function are aligned in a line orthogonal to the X-axis, and the second receiver of the fourth composite function input button and the seventh composite function It may be spaced apart by a first distance (2010) between the first receivers of the function input buttons.

This may be necessary to unify the pattern in order to reduce the manufacturing cost of the multifunction input button. At this time, the software enemy of the user's touch input may need to be calibrated.

When a user's touch is continuously input from the first composite function input button to the fourth composite function input button orthogonal to the X axis, the coordinates of the user's input touch are set in the X-axis direction in response to the first distance. A control unit for correcting may be included.

The first to fifth multi-function input buttons include a control unit for continuously controlling the location of one pointer by detecting a user's touch continuously input occurring within an area including a surface of the first to fifth multi-function input buttons. can include

The first to fifth multi-function input buttons may include a control unit that senses a user's pressure signal and generates first to fifth character input signals, respectively.

That is, each of the plurality of composite function input buttons is in charge of one key of the keyboard to generate one character, and at the same time, continuous occurrence occurs across buttons within the touch surface area of the plurality of adjacent composite function input buttons. Pointer location information such as a single mouse pointer may be generated by a user's touch input, and the location movement of the pointer may be controlled.

When a plurality of touches are simultaneously made within the touch surface area of the plurality of adjacent multi-function input buttons, multi-touch functions such as zoom-in, zoom-out, scrolling, screen conversion, and the like can be performed.

To describe the case of the electrode 1020h in which the receiver is parallel to the X axis and the transmitter is parallel to the Y axis, the electronic device equipped with the complex human interface device is composed of first to fifth complex function input buttons, , Each of the multifunction input buttons is composed of an electrode part composed of a transmitter part and a receiver part, and the transmitter part has first and second transmitters having different drive signal cycles, and the receiver part has a first scan signal cycle having different cycles. to 2 receivers.

The second transmitter of the first multi-function input button has the same drive signal cycle as the first transmitter of the fifth multi-function input button, and the first transmitter of the third multi-function input button has the same drive signal cycle as the fifth multi-function input button. It may have the same drive signal cycle as the second transmitter of the input button.

The first receivers of the first to third composite function input buttons have a first scan signal cycle, the second receivers of the first to third composite function input buttons have a second scan signal cycle, and the fourth composite function input button has a second scan signal cycle. The first receiver of the function input button has a third scan signal cycle, the second receiver of the fourth composite function input button has a fourth scan signal cycle, and the first receiver of the fifth composite function input button has a fifth scan signal cycle. scan signal period, and the second receiver of the fifth multi-function input button may have a sixth scan signal period.

The center point of the first to third complex function input buttons is on a virtual X-axis, the first to second receivers of the first to fifth multi-function input buttons are substantially parallel to the virtual X-axis, and The first to second transmitters of the 1 to 5 complex function input buttons may be located substantially orthogonal to the virtual X-axis.

The second transmitter of the 1st composite function input button and the 1st transmitter of the 5th composite function are aligned in a line orthogonal to the X-axis, and the 2nd transmitter of the 4th composite function input button and the 7th composite function It can be located between the first transmitter of the function input button.

23 is a flowchart of a method for switching between a text input mode and a pointer location information input mode.

The electronic device equipped with the complex human interface may have a right-handed mode and a left-handed mode.

In the right-handed mode, a touch area may be set to easily receive a user's touch input from the user's right hand.

In the left-handed mode, a touch area may be set to easily receive a user's touch input from the user's left hand.

The right-handed mode and the left-handed mode are a separate switch on the electronic device equipped with the complex human interface device, at least two simultaneous text inputs, a predefined touch pattern, a combination of text input and touch input, and mode switching It can be set by an input through a part or the like.

In the electronic device equipped with the complex human interface, a first pointer execution command button and the second pointer execution command button are operated by a user's pressure, and the first pointer execution command button and the second pointer execution command button are A sensor capable of detecting a user's touch input is further provided, and the electronic device equipped with the complex human interface is in a temporary touch mode when a touch input is received by the first pointer execution command button and the second pointer execution command button. can be converted to

In the temporary touch mode, when the user's touch to the first pointer execution command button or the second pointer execution command button is released, the temporary touch mode can be canceled and the text input mode can be switched.

The first pointer execution command button may be positioned to the left of the second pointer execution command button and be adjacent to the user's left thumb, and the second pointer execution command button may be provided adjacent to the user's right thumb.

When switched to the temporary touch mode through a touch sensor provided in the first pointer execution command button, the electronic device having the complex human interface may be switched to a right-handed mode.

In the case of the right-handed mode, the right-hand touch area 108b for receiving pointer location information can be set so that touch input is easily performed with the right hand.

The right hand touch area 108b can be set except for the area where the user's left hand places a finger for text input.

For example, in the case of a general keyboard type complex human interface, the left side of the Y axis including the text F key can be set as a touch inactive area, and the right side of the Y axis including the text G key can be set as a touch active area.

When switched to the temporary touch mode through a touch sensor provided in the second pointer execution command button, the electronic device having the complex human interface can be switched to a left-handed mode.

In the case of the left-handed mode, the left-hand touch area 108a for receiving pointer position information can be set so that a touch input can be easily performed with the left hand.

The left hand touch area 108a can be set except for the area where the user's right hand places a finger for text input.

For example, in the case of a general keyboard type complex human interface, the right side of the Y axis including the text J key can be set as a touch inactive area, and the left side of the Y axis including the text H key can be set as a touch active area.

In addition, a left-handed or right-handed mode may be set in advance in an external device connected to an electronic device having the complex human interface.

The temporary touch mode is the right hand touch when a user's touch input is simultaneously generated from at least two of the plurality of complex function input buttons generating text input signals of characters Q, W, E, and R in the US international keyboard arrangement. mode and when the at least two user touch inputs are released, the right hand touch mode may be released and the text input mode may be switched.

The temporary touch mode is the right-hand touch when a user's touch input occurs simultaneously from at least two of the plurality of complex function input buttons generating text input signals of Z, X, C, and V in the character US international keyboard arrangement. mode and when the at least two user touch inputs are released, the right hand touch mode may be released and the text input mode may be switched.

The temporary touch mode is the left hand touch when the user's touch input is simultaneously generated from at least two of the plurality of multi-function input buttons generating text input signals of characters U, I, O, and P in the US international keyboard arrangement. mode and when the at least two user touch inputs are released, the left hand touch mode may be released and the text input mode may be switched.

The temporary touch mode corresponds to the characters M, <, >, ? in the US international keyboard layout. When a user's touch input occurs simultaneously from at least two of the plurality of complex function input buttons generating a text input signal, the left-hand touch mode is switched to and when the at least two user touch inputs are released, the left-hand touch mode can be released to switch to text input mode.

When a pressure signal is further received in a state in which the touch input is maintained, the multi-function input button in which the at least two touch inputs are simultaneously generated receives a first pointer execution command input or a second pointer execution command input of a pointer controlled while the temporary touch mode is being executed. It can function as a pointer execution command input.

When the temporary touch mode is activated, the text input mode may be deactivated.

When the text input mode is inactive, an exception may be made so that at least one text input is possible.

24 is a flowchart of a permanent touch mode switching method.

When the first pointer execution command button and the second pointer execution command button are simultaneously pressed for a predetermined time, the electronic device including the complex human interface device may be set to a permanent touch mode.

The electronic device equipped with the complex human interface is equipped with the complex human interface device by a separate switch, at least two simultaneous text inputs, a predefined touch pattern, a combination of text input and touch input, operation of a mode switching unit, etc. The device can be set to permanent touch mode.

The permanent touch mode is a mode in which a user's pointer location information input can be received without the need to maintain a separate user input for the pointer location information input.

For example, in the temporary touch mode, the electronic device equipped with the complex human interface is basically set to the text input mode, and while a separate user's input is maintained, it is switched to the temporary touch mode and the separate user's input is released. In this case, the temporary touch mode may be released and the text input mode may be switched.

On the other hand, in the permanent touch mode, the electronic device equipped with the complex human interface is basically set to the permanent touch mode and the text input mode may be deactivated.

The permanent touch mode may be released under a predefined condition.

For example, if there is no user touch input for a predetermined period of time while the permanent touch mode is set, the permanent touch mode may be released.

In the state where the permanent touch mode is set, when a predefined touch pattern or a predefined button is input, or a text input button with the exception of the inactivation, or a repetitive text input, or a plurality of text inputs are input at the same time The permanent touch mode may be released.

The permanent touch mode may include at least a part of the touch area in the right-hand touch mode and the touch area in the left-hand touch mode, and the touch area in the right-hand touch mode and the touch area in the left-hand touch mode. It may be wider than the touch area.

Preferably, the touch area in the right hand touch mode and the touch area in the left hand touch mode may be combined.

25 is a composite function input button module provided with a plurality of composite function input buttons in a plate shape.

The plate-shaped module equipped with a plurality of multi-function input buttons can be used as a multi-keyboard module used for a notebook computer, a portable keyboard, a desktop keyboard, and an Internet TV input device.

The module includes a plurality of cover parts 1010, a plurality of electrode parts 1020, an electrical connection member 2610, a plurality of base parts 1030, and a balance support part 2620 that helps the cover part move up and down in parallel. ), a plurality of elastic parts 1050 may be configured in order.

26 is an example of a detailed structure of the electrode unit 1020.

The plurality of electrode units may be manufactured by printing a transmitter unit and a receiver unit 1020b with conductive ink on a film 1020a cut to fit the size of the cover unit, or using a flexible printed circuit board (FPCB) method.

The electrical connection member 2610 may be manufactured in an FPCB method, and may have a contact point with at least one transmitter and at least one receiver of the electrode unit.

The electrical connection member 2610 and the electrode part 1020 may be bonded with a conductive adhesive 2611 so that electricity flows through the contact point.

The electrical connection member 2610 may be made of FPCB integrally with the electrode unit.

27 is an example of a bonding site of a conductive adhesive.

The conductive adhesive may bond a portion of the electrical connection member and a portion of the electrode portion to each other.

At this time, the portion 2712 excluded from the adhesive portion may have a structure 2711 that can move flexibly according to the movement of the cover unit while being connected to an electrical connection member of an adjacent complex function input button.

The flexible movable electrical connection member may be configured in the shape of a capital letter U together with the adjacent electrical connection members in the shape of a capital letter L of the alphabet.

This form shows optimal performance in maintaining the current state while minimizing physical resistance to the user even if the upper and lower positions of the electrical connection member and the adjacent composite function input button are changed when the cover part is moved up and down.

The electrical connection member may be connected to circuit layers positioned on the first and second surfaces while interconnecting the plurality of electrode units.

The circuit layer 2613 located on the first surface generates a drive signal that transmits drive signals to the transmitters of the first to fifth multi-function input buttons, and the circuit layer 2612 located on the second surface 5 Scan signals can be received from the receiver of the multi-function input button.

The circuit layer may be connected to the controller to generate a drive signal and receive a scan signal.

28 is an example of a complex function input button.

These are a development view 2810 of the complex function input button, an assembly view 2820 of the complex function input button, a cross-sectional view 2830 of the complex function input button, and a cross-sectional view 2840 of the complex function input button when the cover unit is moved.

The composite function input button includes the cover part 2811, the electrode part 2818, the first base part 2812, the balance maintaining part 2813, the elastic part 1050, the first circuit layer 2816, and the second circuit layer. 2815, a third circuit layer 2814, a second base portion 2803, and an electrical connection member 2819.

The complex function input button may further include a light emitting unit 2817, and the light emitting unit may be located in an electrode unit or a circuit layer.

The electrode part, the electrical connection member, and the circuit layer may be made of one FPCB.

The first circuit layer 2816 may receive both a pointer location information input signal and a text input signal.

The elastic part may be attached to the circuit layer. In this way, unnecessary layers can be removed and the thickness can be reduced.

The cover part and the base part may have binding members 2820 and 2821 to be mutually bound.

Alternatively, the column in the cover part and the hole 2801 in the base part may be provided so that they are bound to each other.

The electrode unit may be inserted between the cover unit and the base unit and connected to the circuit layer through an electrical connection member.

The circuit layer may be attached to the second base part.

The circuit layer is connected to an electrical connection member of one multi-function input button, and may be connected to the control unit through a separate circuit layer.

The circuit layer may be simultaneously connected to an electrical connection member of a plurality of complex function input buttons and connected to a control unit.

A width 2832 of the electrode part may be wider than a width 2831 of the circuit layer. Accordingly, when the position of the cover part is moved, movement of the electrical connecting member can be minimized and physical resistance to the user can be minimized.

The electrical connecting member 2819 may be made of a soft material so that its shape can be changed together when the position of the cover part is moved.

When the position of the cover part is moved, the shape of the electrical connection member 2891 may be deformed while moving to a lower position 2843 than the second base part.

29 is an embodiment of a wireless electrical connection member.

This is a part 2930 of the complex function input button excluding the elastic part and the equilibrium maintaining part of the complex function input button.

The composite function input button includes a cover part (2902), an electrode part (2901), a first electrical connection member (2903, 2904), a second electrical connection member (2933, 2934), a base part (2932), and a circuit layer (2931). may consist of

The first electrical connection member may include an electrical connection member 2903 connected to the transmitter and an electrical connection member 2904 connected to the receiver.

The second electrical connection member may include an electrical connection member 2933 corresponding to the electrical connection member 2903 connected to the transmitter and an electrical connection member 2934 corresponding to the electrical connection member 2904 connected to the receiver.

The first electrical connection member and the second electrical connection member may transmit electrical signals wirelessly in a state in which they are not physically bonded to each other.

The first electrical connection member and the second electrical connection member may transmit electrical signals wirelessly using high-frequency signals.

The first electrical connection member and the second electrical connection member may transmit electrical signals wirelessly using an electrostatic induction method.

The first electrical connection member and the second electrical connection member may be at least one of a coil method 2940 wound several times, a spiral method 2950, and a method wound around a non-conductor 2960.

An electronic device equipped with a complex human interface is composed of first to fifth complex function input buttons and a circuit layer that transmits a signal received from the input buttons to a control unit, and each of the complex function input buttons receives a user's touch input. It is composed of an electroload unit composed of a receiving transmitter unit and a receiver unit, an electrical connection member connected to the electro unit, and a switch that generates a text input signal in response to a user's physical pressure. The transmitter unit has different driver signal generation timings. 1 to 2 transmitters, and the receiver unit has first to second receivers having at least two different scan timings, and the electrical connection member changes relative positions of the electrode unit and the circuit layer by the user's physical pressure. Even if it changes to , it can be electrically connected.

The first receiver of the fourth composite function input button has the same scan timing as the second receiver of the second composite function input button, and the second receiver of the fourth composite function input button has the same scan timing as the second receiver of the second composite function input button. It may have the same scan timing as the first receiver of the input button.

The first transmitters of the first to third composite function input buttons have a first drive signal generation timing, and the second transmitters of the first to third composite function input buttons have a second drive signal generation timing, A timing of generating the first drive signal and a timing of generating the second drive signal may be different from each other.

The second transmitter of the fourth composite function input button has a third drive signal generation timing, the first transmitter of the fifth composite function input button has a fourth drive signal generation timing, and the third drive signal generation timing and The first drive signal generation timing, the second drive signal generation timing, and the fourth drive signal generation timing may be sequential.

The first receiver of the fifth composite function input button has the same scan timing as the second receiver of the first composite function input button, and the second receiver of the fifth composite function input button has the same scan timing as the third composite function input button. It may have the same scan timing as the first receiver of the input button.

The circuit layer, the electrode part of the first multi-function input button and the electrical connecting member of the first multi-function input button may have a complex human interface made of a single flexible printed circuit board (FPCB). .

The electrode part of the first to fifth composite function input buttons, the electrical connecting member of the first to fifth composite function input buttons, and the circuit layer are made of one flexible printed circuit board (FPCB) A complex human interface may be provided.

The electrical connection member is composed of a first lead connected to the electrode part and a second lead connected to the circuit layer, and the relative positions of the first lead and the second lead change when a user's pressure signal is received and electrically connected to each other. can stay connected.

The electrical connecting member is composed of a first lead connected to the electrode part and a second lead connected to the circuit layer, and the relative positions of the first lead and the second lead change when there is a user's pressure signal. The first lead and the second lead are spaced apart from each other at a predetermined interval or more and may transmit electrical signals through electromagnetic induction.

The electrical connecting member is composed of a first lead connected to the electrode part and a second lead connected to the circuit layer, and the relative positions of the first lead and the second lead change when there is a user's pressure signal. The first lead and the second lead are spaced apart from each other at a predetermined interval or more and may transmit an electrical signal using a high frequency signal.

The electrical connection member is made of an elastic material that electrically connects the electrode part and the circuit layer, and when the position of the electrode part is moved by a user's pressure signal, a force in the opposite direction to the user's pressure signal is applied. and when the user's pressure signal is removed, the electrode part can be returned to the previous position.

The first receiver of the fourth composite function input button has the same scan timing as the first receiver of the first composite function input button, and the second receiver of the fourth composite function input button has the same scan timing as the first receiver of the first composite function input button. The second receiver of the input button and the first receiver of the fifth complex function input button may have the same scan timing.

The first transmitter of the fourth multi-function input button has the same driver signal generation timing as the first transmitter of the first multi-function input button, and the second transmitter of the fourth multi-function input button has the same timing as the first transmitter of the first multi-function input button. The second transmitter of the first multi-function input button and the first transmitter of the fifth multi-function input button may have the same drive signal generation timing.

The first receivers of the first to third composite function input buttons have a first scan timing, the second receivers of the first to third composite function input buttons have a second scan timing, and the first scan timing The timing and the second scan timing may be different from each other.

The second receiver of the fourth composite function input button has a third scan timing, the first receiver of the fifth composite function input button has a fourth scan timing, and the third scan timing and the first scan timing The second scan timing and the fourth scan timing may be sequential.

The first transmitter of the fourth multi-function input button has the same driver signal generation timing as the second transmitter of the second multi-function input button, and the second transmitter of the fourth multi-function input button has the same timing as the second transmitter of the second multi-function input button. 1 It may have the same drive signal generation timing as the first transmitter of the multi-function input button.

The first transmitter of the third composite function input button may have the same driver signal generation timing as the second transmitter of the fifth composite function input button.

The multi-function input button may further include a first control unit, and the control unit may process the touch signal and the text input signal received from the multi-function input button and transmit them to a second control unit.

The circuit layer may include a drive signal generator for transmitting drive signals to the transmitters of the first to fifth multi-function input buttons and a scan signal receiver for receiving scan signals from the receivers for the first to fifth multi-function input buttons. there is.

The first to fifth composite function input buttons include a plurality of electrical connection members, and the first composite function input button is connected to the electrical connection members of the second, third, fourth, and fifth composite function input buttons. The second composite function input button is connected to an electrical connection member of the first and fourth composite function input buttons, and the third composite function input button is connected to an electrical connection member of the first composite function input button. The fourth composite function input button is connected to the electrical connection member of the first and second composite function input buttons, and the fifth composite function input button is connected to the electrical connection member of the first and third composite function input buttons. can

1 to 29 illustrate an example of a pointing device-integrated text input device as an electronic device equipped with a complex human interface device to be described in the present invention. It includes things that can be changed or replaced without changing the basic purpose.

30 is an example of a configuration diagram of a text input device 3000 integrated with a pointing device.

Referring to FIG. 30 , the pointing device-integrated text input device 3000 according to an embodiment of the present invention responds to a button 3100 that receives a push input or a touch input from a user and a descent of the button 3100 according to the push input. The switch 3200 that obtains the key value, the electrical connection member 3300 that forms the circuit 3400 that obtains the capacitance change according to the touch input of the electrode 3130 included in the button 3100, and the capacitance change It may include a controller 3500 that performs processing of various types of information and electrical signals, including calculation of based touch coordinate values.

Here, the push input is a user input that applies physical pressure to the button 3100, and induces the button 3100 to descend by a predetermined distance or more so that the button 3100 touches the switch 3200 or presses the switch 3200. This refers to a user input that causes the switch 3200 to output a key value assigned to the corresponding switch 3200. In this specification, push input can be mainly used as a user input for text input when the pointing device-integrated text input device 3000 is used as a keyboard interface.

Also, here, the touch input is a user input that touches the button 3100, and means a user input that induces a change in capacitance of the electrode 3130 built in the button 3100. In this case, a case in which the change in capacitance is equal to or greater than a predetermined touch threshold value may be understood as a touch input. In this specification, touch input may be mainly used as a user input for controlling the position of the pointer P when the pointing device-integrated text input device 3000 is used as a mouse interface or a digitizer interface.

The pointing device-integrated text input device 3000 may be provided in the form of a keyboard similar to that shown in FIG. 9 or in the form of a laptop computer in which a display and keyboard are combined as shown in FIG. 8 .

The pointing device-integrated text input device 3000 may include a plurality of buttons 3100 arranged according to a predetermined keyboard layout. Here, the button 3100 may correspond to a complex function input button described with reference to FIGS. 10, 14, 25, or 28 in this specification.

The button 3100 may include a keycap 3110, a button body 3120, and an electrode 3130. Here, the keycap 3110 and the button body 3120 are disposed at upper and lower portions, respectively, and the electrode 3130 may be interposed between the keycap 3110 and the button body 3120. That is, the button 3100 may be provided by sequentially stacking and combining the keycap 3110, the electrode 3130, and the button body 3120.

The keycap 3110 is disposed on the upper surface of the button 3100, that is, on the exposed surface of the keyboard layout. The keycap 3110 may directly contact a user's finger. That is, the user may press the keycap 3110 to perform a push input for typing or touch the keycap 3110 to perform a touch input for pointer manipulation (eg, movement of a mouse cursor). In addition, letters assigned to corresponding buttons may be printed on the keycap 3110 for convenience of typing.

The button body 3120 is disposed under the keycap 3110. The button body 3120 may move up and down, that is, move up and down when a push input in the up and down direction is input through the keycap 3110 . When the button body 3120 descends, the switch 3200 may be physically pressed or electrically contacted with the switch 3200 . As will be described later, the switch 3200 can obtain a key value assigned to the button 3100 by such an operation.

The electrode 3130 is interposed between the keycap 3110 and the button body 3120. When a touch input is input to the keycap 3100, the capacitance of the electrode 3130 changes, and thus the touch input can be sensed.

The electrode 3130 may be composed of a plurality of blocks 3130'. Some of these blocks 3130' may form a first block group 3131 electrically connected in a first direction, which is one of the length direction and the width direction of the keyboard layout. In addition, the remaining parts of the blocks 3130' may form a second block group 3132 electrically connected along a second direction, which is one direction different from the first direction, among the longitudinal and width directions of the keyboard layout. Here, the electrical connection between the first block group 3131 and the second block group 3132 means that the blocks 3130' constituting the block groups 3131 and 3132 are physically directly connected and electrically connected. In addition, it should be construed as including physically indirect connection through electrical connection means such as wires or conductors.

Specifically, the electrode 3130 may be provided similarly to the electrode unit 1130 shown in FIG. 11 .

Here, the electrode 3130 may be composed of a plurality of blocks 1101, 1102, 1103, 1104, 1105, 1106, 1107, 1108, 1109, 1110, 1111, 1112, and 1113, similarly to the electrode unit 1130. there is. Also, some blocks may be electrically connected in a horizontal or vertical direction to form a block group. For example, in FIG. 11, a block group connected in the horizontal direction - a block group formed by three blocks 1101, 1102, and 1103 and a block formed by three other blocks 1104, 1105, and 1106 A block group formed by the group and the other three blocks 1107, 1108, and 1109 - may be either the first block group 3131 or the second block group 3132. In addition, a block group connected in the vertical direction in FIG. 11 - a block group formed by two blocks 1110 and 1111 and a block group formed by two other blocks 1112 and 1113 - is a first block group 3131 or another one of the second block group 3132.

Meanwhile, the keycap 3110 may correspond to the above-described cover portion, the button body 3120 to the above-described base portion or upper support portion, and the electrode 3130 to the above-described electrode portion. For example, the keycap 3110 may be the cover parts 1010 and 2811 described with reference to FIGS. 10, 14, 25, and 28 . Also, for example, the button body 3120 may be the base parts 1030 and 2932 or the upper support part 1040 described with reference to FIGS. 10, 14, 25, and 28 . Also, for example, the electrode 3130 may be the electrode unit 1020 described with reference to FIGS. 10, 14, 25, and 28 .

In addition, since the structure of the button 3110 has already been sufficiently described with reference to FIGS. 10, 14, 25, and 28, a detailed description of the structure of the button 3110 will be omitted here. Likewise, since the shape of the electrode 3130 has already been sufficiently described with reference to FIGS. 11 to 13 and 18 to 22 , a more detailed description of the shape of the electrode 3130 will also be omitted here.

A switch 3200 is located below the button 3100. For example, the switch 3200 has a plurality of buttons 3100 on a substrate positioned below a button layer on which the buttons 3100 are arranged according to the keyboard layout to correspond to each of the plurality of buttons 3100 according to the keyboard layout. can be placed at the bottom of

The switch 3200 may come into contact with the button 3100 or be pressed by the button 3100 when the button 3100 descends according to a user's push input in the up and down directions. Accordingly, the switch 3200 may acquire or output a key value corresponding to the corresponding button 3100 .

Since the specific structure of the switch 3200 has already been described in detail with reference to FIGS. 4, 10, and 28, a detailed description thereof will be omitted.

The electrical connecting member 3300 may form a circuit 3400 by connecting the block groups 3131 and 3132 between the plurality of buttons 3100 . Here, the electrical connection member 3300 includes first conductors 1080 and 1441 attached to the upper support part 1040 and second conductors attached to the lower support part 1050 and 1060 (as shown in FIG. 10 or 14). 1090, 1442) may be provided in the form of pins. In addition, the electrical connection member 3300 may be provided in the form shown in FIGS. 10, 14, and 27 to 29. In summary, as a representative electrical connection member 3300, a form realized through a pattern printed on the FPCB or a conductor form installed on the board on which the switch 3200 is installed and the lifting button 3100, respectively can be heard

The electrical connection member 3300 is electrically connected between blocks 3130' that are not physically directly connected on the surface of the electrode 3130 among blocks 3130' of the electrode 3130 belonging to a single button 3100. connection can be established.

In addition, the electrical connection member 3300 connects the block groups 3131 and 3132 formed on the electrode 3130 of each button 3100 between adjacent buttons 3100, and is continuously connected to the plurality of buttons 3100. Block groups 3131 and 3132 can be connected with

For example, the electrical connecting member 3300 is a first block group of the electrodes 3130 belonging to the plurality of buttons 3100 arranged in a first direction, which is either a length direction or a width direction of the keyboard layout ( 3131) can be connected in series to form a drive line. As another example, the electrical connection member 3300 is a second block group of the electrodes 3130 belonging to the plurality of buttons 3100 arranged in a second direction, which is either a length direction or a width direction of the keyboard layout. A scan line may be formed by continuously connecting 3132.

Here, the first block group 3131 arranged on the drive line may correspond to the transmitter described above, and the second block group 3132 arranged on the scan line may correspond to the receiver described above.

A drive signal is applied to the drive line, and the drive signal is applied to the first block groups 3131 positioned on the drive line by the electrical connection member 3300 to induce capacitance in the electrode 3130. . Also, in the scan line, a scan signal reflecting a change in capacitance induced in the electrode 3130 by a drive signal by a user's touch input may be processed. The scan signal may be a signal for detecting a change in capacitance in the second block groups 3132 positioned on the scan line by the electrical connection member 3300 .

A detailed description of the configuration of the drive line and the scan line and the processing of the drive signal and the scan signal has already been described with reference to FIGS. 11 to 13 and 18 to 22, and thus will be omitted herein.

The controller 3500 may be implemented as a CPU or a similar device according to hardware or software or a combination thereof. The controller 3500 may be provided in the form of an electronic circuit that performs a control function by processing an electrical signal in terms of hardware. Also, the controller 3500 may be provided in the form of a program processed by the hardware controller 3500, an application, or firmware in terms of software.

The controller 3500 may perform electronic signal processing, information processing, and calculation. Accordingly, the controller 3500 may process overall operations of the pointing device integrated text input device 3000 or control each component of the pointing device integrated text input device 3000 . For example, the controller 3500 may obtain a scan signal from a scan line and calculate touch coordinate values based on the scan signal. For another example, the controller 3500 may perform a mode switching operation of the pointing device-integrated text input device 3000 .

In addition, the controller 3500 may process and perform various functions or operations of the pointing device integrated text input device 3000 . A more detailed description of this will be described later. Meanwhile, in this specification, functions or operations of the pointing device-integrated text input device 3000 may be interpreted as being performed under the control of the controller 3500 unless otherwise specified.

FIG. 31 is an example of text input signal processing of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 31 , in the pointing device-integrated text input device 3000, when a predetermined button 3100 receives a push input from a user, the button 3100 descends, and the descended button 3100 moves the corresponding button 3100 is contacted with the switch 3200 matched with or the switch 3200 is pressed, and as a result, the switch 3200 generates an electrical signal. The generated electrical signal may include identification information about the corresponding switch 3200, that is, a key identifier. The controller 3500 receives the electrical signal and outputs a key value corresponding to the button 3100 receiving the push input as a keyboard input based on the received electrical signal.

Here, the key value reflected or included in the keyboard input may be a character value. However, key values and character values are not always the same. For example, buttons 3100 corresponding to function keys ('F1' to 'F12' or 'END', 'SHIFT', 'Print Screen', 'ESC' keys, direction keys, etc.) display function values instead of text values. You can have it as a key value. However, in this specification, since there is no practical benefit in distinguishing between key values and text values in most cases, key values and text values are treated as concepts corresponding to each other, if necessary.

Meanwhile, a key value and a key identifier are different concepts. For example, two or more key values may be set for one button 3100 . For example, a button assigned with an uppercase letter 'A' may also be assigned with a lowercase letter 'a'. At this time, even if the controller 3500 receives the same key identifier from the switch 3200, the controller 3500 selects a key value from 'A' and 'a' depending on whether the pointing device-integrated text input device 3000 is in a capital letter input mode or a small letter input mode. can

FIG. 32 is an example of mouse input signal processing of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 32 , the pointing device-integrated text input device 3000 may apply and receive a drive signal and a scan signal to the electrode 3130 . The drive signal and the scan signal may be output from the controller 3500 and transmitted/received to the first block group 3131 and the second block group 3132 through the drive line and the scan line formed by the electrical connecting member 3300, respectively. there is. The capacitance induced in the electrode 3130 by the drive signal is changed by a user's touch input, and the controller 3500 receives a scan signal reflecting the amount of change.

The controller 3500 calculates touch coordinate values by considering drive signal cycles and scan signal cycles in multiple drive lines and multiple scan lines, capacitance change values reflected by scan signals for each scan signal cycle, and the like. It is possible to acquire and output touch information to be used. In general, the touch coordinate value may have an (x,y) form including an x coordinate value corresponding to a horizontal direction on the display and a y coordinate value corresponding to a vertical direction on the display. Also, the controller 3500 may obtain touch information obtained by adding time information to touch coordinate values. The touch information may have a form of (x, y, t) further including a touch input time t of a touch input that generated a corresponding touch coordinate value. However, in this specification, in most cases, there is no practical benefit to distinguish between touch coordinate values and touch information, so unless otherwise specified, it should be interpreted that touch coordinate values and touch information can be used interchangeably.

The controller 3500 may acquire and output a mouse input based on touch coordinate values (or touch information). Here, the mouse input may be slightly different from the touch coordinate value. Typically, mouse input can take the form of (x',y') or (x',y',t). A detailed description of the difference between mouse input and touch coordinate values will be described later.

Here, the mouse input may refer to an input mainly output from a mouse interface for controlling the position of the pointer P displayed on the display. For example, electronic devices such as personal computers (PCs), laptops, smart phones, and tablets may use mouse input to control the position of the pointer P displayed on the display. The controller 3500 of the pointing device-integrated text input device 3000 may generate a mouse input based on touch coordinate values or touch information and transmit it to the electronic device. When a mouse input is received, the electronic device may move the location of the pointer P displayed on the display according to the mouse input using an operating system or a mouse driver interface.

Of course, when the pointing device-integrated text input device 3000 is provided in the form of being embedded in the electronic device as shown in FIG. Alternatively, a mouse input may be transferred to a separate arithmetic unit that processes an operating system or a mouse driver interface to control the location of the pointer P.

The mouse input mentioned above can be generated through the following process.

When a user inputs a touch input to the touch area 3010 formed on the pointing device integrated text input device 3000, the controller 3500 reflects the change in capacitance detected by the electrode 3130 from the scan line. A scan signal may be received in real time, and touch coordinate values may be calculated based on the scan signal. Here, the touch area 3010 is an area formed in the pointing device-integrated text input device 1000, and means an area where a touch coordinate value can be calculated by detecting a user's touch input. In general, the touch area 3010 may be formed on the buttons 3100 provided with the electrode 3130 among the plurality of buttons 3100 .

Next, the controller 3500 may calculate a touch coordinate change value based on the touch coordinate value. Here, the touch coordinate value may correspond to the aforementioned (x, y) shape, and the touch coordinate change value may correspond to the (x′, y′) shape. Specifically, the controller 3500 may calculate the touch coordinate change value through a difference operation between the current touch coordinate value and the previous touch coordinate value. In this case, the current touch coordinate value is the touch coordinate value calculated from the scan signal obtained in the current scan signal period, and the previous touch coordinate value is calculated from the scan signal obtained in the scan signal period immediately before the current scan signal period. It may be a touch coordinate value.

Here, the touch coordinate change value may be referred to as a 'relative coordinate value' because it is a difference between a current touch coordinate value and a previous touch coordinate value.

The controller 3500 may acquire and output the touch coordinate change value as a mouse input. An electronic device, a separate internal calculation unit, or the controller 3500 that has obtained the mouse input may move the pointer P on the display or control the position of the pointer P according to the mouse input.

Meanwhile, unlike the above description, instead of acquiring and outputting the touch coordinate variation value as mouse input, the controller 3500 transmits identification information indicating that the touch information is mouse input together with touch information, It is also possible to induce an electronic device or a separate internal arithmetic unit to directly generate a mouse input to control the position of the pointer P.

33 and 34 are examples of the operation of the pointer P according to mouse input according to FIG. 32 .

Referring to FIG. 33 , the user may input a touch input in the form of a drag from the first position L1 to the second position L2 on the touch area 3010 . The controller 3500 may calculate a touch coordinate value according to such a touch input in real time, obtain a touch coordinate change value through a difference operation of the calculated coordinate value, and output it as a mouse input.

Referring to FIG. 34 , the pointer P on the screen 10 displayed by the mouse input may be processed to be moved along a path corresponding to the drag path, and finally to a first position on the touch area 3010. It may be moved from the first point D1 on the screen 10 corresponding to (L1) to the second point D2 corresponding to the second position L2.

35 and 36 are other examples of the operation of the pointer P according to mouse input according to FIG. 32 .

Referring to FIG. 35 , the user may input a touch input of touching the first location L1 on the touch area 3010 and input a touch input of touching the second location L2 without another touch input. For example, this is a case of touching the second location L2 after moving the finger in the air after touching the first location L1. When these two touch inputs occur, the controller 3500 does not generate a touch coordinate variation value because the two touch inputs are temporally separated by a predetermined time interval or more, and thus a difference in continuous touch coordinate values does not occur. That is, the controller 3500 may calculate the relative coordinate value, which is the mouse input, as '0'.

Therefore, referring to FIG. 36, the pointer P on the screen 10 displayed by the mouse input is the third point where the pointer P on the screen 10 is displayed at the time of touching the first location L1. It can be treated as not moving the pointer P on (D3).

FIG. 37 is an example of signal processing of a digitizer input of the pointing device-integrated text input device 3000 of FIG. 30 .

The touch information described with reference to FIG. 37 may be processed as a digitizer input slightly different from a mouse input.

The mouse input is used to move the position of the pointer P in the form of a difference value of a sensing point, that is, a relative coordinate value, generated according to the movement of the mouse or the movement of the touch on the touch screen. On the other hand, the digitizer input is an input in which the touch area 3010 and the displayed screen 10 correspond to each other. That is, in the digitizer input, touch coordinate values of the touch area 3010 correspond to specific points on the screen 10 . In general, since the touch area 3010 itself is matched to the screen 10 of the digitizer input, it has an advantage in drawing, designing, drawing, etc., so the conventional digitizer interface is used instead of a mouse in various industrial areas, art, design areas, etc. It often becomes

In the present specification, the controller 3500 of the pointing device-integrated text input device 3000 generates a digitizer input based on touch coordinate values or touch information and controls the position of the pointer P according to the digitizer input ( It can be transmitted to electronic devices such as PC (Personal Computer), laptop, smart phone, tablet, etc. When the digitizer input is received, the electronic device may control the position of the pointer P displayed on the display according to the digitizer input using an operating system or a digitizer driver interface. Of course, when the pointing device-integrated text input device 3000 is provided in the form of being embedded in the electronic device as shown in FIG. 8, the controller 3500 controls the position of the pointer P according to a digitizer input generated directly, or A separate arithmetic unit processing the operating system or digitizer driver interface may pass the digitizer input to the separate arithmetic unit to control the location of the pointer P.

The digitizer input mentioned above may be generated through the following process.

When a user inputs a touch input to the touch area 3010 formed on the pointing device integrated text input device 3000, the controller 3500 reflects the change in capacitance detected by the electrode 3130 from the scan line. A scan signal may be received in real time, and touch coordinate values may be calculated based on the scan signal.

Next, the controller 3500 may calculate a point value of the screen 10 corresponding to the touch coordinate value in consideration of the relationship between the touch area and the resolution of the screen 10, and may obtain and output it as a digitizer input. Here, the point value of the screen 10 may be a coordinate value on the screen 10 resolution.

The electronic device, calculation unit, or controller 3500 that has acquired the digitizer input may control the position of the pointer P on the display according to the digitizer input. Specifically, the position of the pointer P is set to a point value on the screen 10 .

Here, the digitizer input may be referred to as an 'absolute coordinate value' because touch coordinates within the touch area 10 are matched with points within the screen 10 on the display.

Meanwhile, unlike what has been described above, the controller 3500 converts the touch coordinate values into point values on the screen 10 in consideration of the resolution of the screen 10 and acquires them as digitizer inputs, instead of converting the touch coordinate values themselves into digitizer inputs. It is also possible to output and induce the electronic device or calculation unit to directly calculate a point value (resolution value) to perform position control of the pointer P.

FIG. 38 is an example of the operation of the pointer P according to the digitizer input of FIG. 37 .

Referring to FIG. 38 , the user may input a drag-type touch input from the first position L1 to the second position L2 on the touch area 10 . The controller 3500 may calculate touch coordinate values according to such a touch input in real time and output a digitizer input based on the calculated coordinate values.

The pointer P on the screen 10 being displayed by such a digitizer input may be processed to be moved along a path corresponding to the drag path, and finally, a pointer P corresponding to the first position L1 on the touch area 3010 may be processed. It may be moved from the first point D1 on the screen 10 to the second point D2 corresponding to the second position L2.

FIG. 39 is another example of the operation of the pointer P according to the digitizer input according to FIG. 37 .

Referring to FIG. 39 , the user may input a touch input of touching the first location L1 on the touch area 10 and directly input a touch input of touching the second location L2 without dragging. When such two touch inputs occur, in the controller 3500, the two touch inputs are temporally separated by a predetermined time interval or more. However, since the first position (L1) and the second position (L2) are matched to the first point (D1) and the second point (D2) on the screen 10, respectively, the digitizer input by the first position (L1) indicates the first point D1, and the digitizer input by the second position L2 may indicate the second point D2. Therefore, the pointer P on the screen 10 being displayed by the digitizer input is located at the first point D1 on the screen 10 at the time of touching the first location L1, and is located at the second location ( At the time of touching L2), it may be processed as jumping and moving from the first point D1 to the second point D2.

FIG. 40 is an example of mode conversion of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 40 , the pointing device-integrated text input device 3000 may perform a keyboard mode, a mouse mode, and a digitizer mode.

Here, in the keyboard mode, in the pointing device-integrated text input device 3000, the user performs a push input in the up and down direction on the buttons 3100 arranged in a keyboard layout, so that the button 3100 descends by the push input. This is a mode in which a keyboard input reflecting a key value assigned to a button 3100 to which a push input is applied is input as the switch 3200 is actuated. Meanwhile, since the keyboard mode is mainly used for text input, it can also be expressed as a 'text mode' or a 'text input mode'.

In addition, in the mouse mode, when the user of the pointing device-integrated text input device 3000 performs a touch input on the touch area 3010 formed by the electrode 3130, the pointer (P) uses the above-described mouse input. ) is a mode to control the movement of

In addition, in the digitizer mode, when the user of the pointing device-integrated text input device 3000 performs a touch input on the touch area 3010 formed by the electrode 3130, the pointer (P) uses the digitizer input described above. ) is a mode to control the position of

Meanwhile, since the mouse mode and the digitizer mode are mainly used to control the pointer P, they may be referred to as 'pointing modes'. In addition, since both mouse mode and digitalizer mode are based on touch input, they can also be expressed by the terms 'touch mode' or 'touch input mode'.

In the present embodiment, the controller 3500 in the pointing device integrated text input device 3000 may perform conversion between the above three modes. Since a mode switching method may be similar to the above-described mode switching unit or mode switching method, a detailed description thereof will be omitted. However, direct switching between the keyboard mode and the digitizer mode may not be allowed in switching the operating mode of the pointing device-integrated text input device 3000 . In this case, mode conversion between the text mode and the digitizer mode may be performed only through the mouse mode.

When the pointing device-integrated text input device 3000 enters the digitizer mode by mode conversion, the controller 3500 may process a touch input as a digitizer input.

To this end, the pointing device integrated text input device 3000 may set a touch area 3010 corresponding to the screen 10 .

FIG. 41 is an example of setting the touch area 3010 according to the digitizer mode of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 41 , a touch area 3010 may be formed by a button 3100 having an electrode 3130 for sensing a touch input. Typically, the touch area 3010 for digitizer input may be formed in a rectangular or similar shape on a keyboard layout. The rectangular touch area 3010 may match the screen 10 .

Meanwhile, it has been mentioned above that touch areas for mouse input may be implemented as right/left touch areas 108a and 108b as shown in FIG. 1 .

42 and 43 are examples of relationships between the touch area 3010 according to the digitizer mode of FIG. 41 and the touch area according to the mouse mode.

42 and 43, the entire touchable area 3010' provided in the pointing device integrated text input device 3000 is set as the touch area 3010 used in the digitizer mode. Since this touch area 3010 is matched with the screen 10, it can be set to include both right/left touch areas 108a and 108b.

For example, as shown in FIG. 42, when the pointing device-integrated text input device 3000 enters the digitizer mode from the right-hand mouse mode receiving a touch input from the user through the right-hand touch area 108b of FIG. The entire area where the left hand touch areas 108a and 108b are combined may be changed to the touch area 3010 . Of course, if the mode is switched back to the mouse mode in this state, the pointing device-integrated text input device 3000 may sense a touch input with the right hand touch area 108b again.

Conversely, for example, as shown in FIG. 43 , when the pointing device-integrated text input device 3000 enters the digitizer mode from the left-hand mouse mode receiving a touch input from the user through the left-hand touch area 108a of FIG. 1 , The entire area where the right/left touch areas 108a and 108b are combined may be changed to the touch area 3010 . Of course, if the mode is switched back to the mouse mode in this state, the pointing device-integrated text input device 3000 can sense a touch input with the left hand touch area 108a again.

Meanwhile, in the above, it has been described that the touch area 3010 matches the entire screen 10 in the digitizer mode. However, in the present specification, the pointing device-integrated text input device 3000 may set the touch area 3010 in the digitizer mode based on the position of the pointer P on the screen 10 when entering the digitizer mode.

44 and 45 are other examples of setting the touch area 3010 according to the digitizer mode of the pointing device-integrated text input device 3000 of FIG. 30 .

44 and 45, when the pointing device-integrated text input device 3000 enters the digitizer mode, the controller 3500 enters the digitizer mode and when a touch input occurs for the first time, the touch coordinate values of the corresponding touch input , and the touch area 3010 may be set so that the calculated touch coordinate values and the point value of the pointer P on the current screen 10 match each other. Accordingly, even if the digitizer mode is entered as shown in FIGS. 44 and 45 , if the first touch input is input at a different location after entering the mode, the matching relationship between the screen 10 and the touch area may be different.

That is, in FIG. 41 , the entire touch-sensable area 3010' on the pointing device-integrated text input device 3000 is set as the touch area 3010 in the digitizer mode, and the pointing device-integrated text input device 3000 is digitized. It has been described that the touch area 3010 in the low mode and the entire screen 10 are matched with each other, and thus the touch area 3010 always has a fixed shape to the screen 10 . Therefore, in the setting of the touch area 3010 as shown in FIG. 41 , since the touch coordinate value corresponding to the point where the pointer P is located in the touch area 3010 is not precisely known, the user can It may be difficult to perform a predetermined task directly at the point of the pointer P located on the image. For example, in the case where a user works in mouse mode and switches to digitizer mode to electronically sign a point where the pointer (P) is on the display, the user must use the pointer ( You have to go through the cumbersome task of finding the point where P) is located, that is, the starting point of the signature.

However, in this example, the point where the current pointer (P) is located is matched with the touch coordinate value of the first touch input after entering the mode, and the touch area 3010 is set accordingly, so that the first touch location is the current pointer ( P) becomes a point. Therefore, in the setting of the touch area 3010 as shown in FIGS. 44 and 45, the user enters the digitizer mode without the need to precisely know the touch coordinate values corresponding to the location of the pointer P in the entire touch area 3010. After entering, a predetermined operation can be performed immediately at the point where the pointer P is located on the current screen 10 . For example, when a user works in mouse mode and switches to digitizer mode to sign on the point where the pointer (P) is currently on the display, the user must use the pointer (P) before entering digitizer mode to start signing. ), it is possible to perform a signature operation from the point where the pointer (P) is located just by starting the signature at an arbitrary touch location without the cumbersome task of finding the point where the pointer (P) is located.

However, as shown in FIGS. 44 and 45, the touch area 3010 is set so that the touch coordinate value of the first touch input after entering the digitizer mode matches the point where the pointer P on the screen 10 is located when entering the digitizer mode. In this case, a problem in that the touch area 3010 covers only a part of the screen may occur in some cases.

FIG. 46 is an example in which the touch area 3010 is set outside the touchable area 3010′ when setting the touch area 3010 according to FIGS. 44 and 45 .

For example, as shown in FIG. 46, in a state where the pointer P is located at the lower right corner of the screen 10, the user enters the digitizer mode and then actually touches the pointing device-integrated text input device 3000. If the first touch input is performed on the upper left of the entire area 3010' where is possible, a part of the touch area 3010 to be set when trying to match the touch area 3010 of the digital Iza mode to the actual screen 10 may deviate from the entire area 3010 ′ where actual touch is possible.

In addition, when the touch area 3010 is set in this way, the rest of the touchable area 3010' of the pointing device-integrated text input device 3000, except for the portion overlapping with the touch area 3010, is the same as the screen 10. There may be a problem in that the touch area 3010 is not utilized in the digitizer mode because the matching is not possible.

Therefore, if the touch area 3010 in the digitizer mode is set by matching the touch coordinates of the first touch input after entering the digitizer mode with the coordinates of the pointer P on the screen 10, the user can conveniently Although there is an advantage in that the digitizer-type touch input can be started from the position where the digitizer input is desired, that is, the position where the pointer P is located on the screen 10 when entering the digitizer mode, the first touch on the entire touch area 3010' If the touch coordinates of the touch coordinates and the position of the pointer P on the screen 10 are significantly out of touch coordinates - For example, the pointer P is located on the left, right, top or bottom of the screen 10, respectively. , When the first touch coordinates after entering the mode are located at the right, left, bottom, or 0 top of the entire touch area 3010' - A part of the screen 10 does not match the touch area 3010 or the entire touch There may be a problem in that many parts of the area 3010' do not match the screen 10.

FIG. 47 is an example of resetting the touch area 3010 according to the digitizer mode of FIG. 46 , and FIG. 48 is another example of resetting the touch area 3010 according to the digitizer mode of FIG. 46 .

47 and 48, when entering the digitizer mode, the touch area 3010a corresponding to the screen 10 is the coordinate value of the pointer P positioned at the lower right corner of the screen 10 on the screen 10. and the touch coordinate values located at the upper left of the entire touchable area 3010' are matched with each other, and set based on this. In this state, as described above with reference to FIG. 46 , a part of the touch area 3010a is out of the touchable area 3010′. Accordingly, a touch input is disabled for an area on the screen 10 that matches the touch area 3010a out of the touchable area 3010'. Conversely, in this state, as described above with reference to FIG. 46 , a large portion of the touchable region 3010′ does not correspond to the screen 10, so utilization of the touchable region 3010′ is also low.

Therefore, it is necessary to move the touch area 3010a so that the touch area 3010a and the screen 10 can properly match each other.

Accordingly, the pointing device integrated text input device 3000 may reset the touch area 3010 in the digitizer mode to match the screen 10 .

According to an example, referring to FIG. 47 , when a multi-finger touch input (touch input using two fingers in FIG. 47) is received with respect to a preset touch area 3010a in the digitizer mode, a text input device integrated with a pointing device ( The touch area 3010 may be reset by changing the touch area 3010b so that 3000 corresponds to the movement of touch coordinates of the multi-finger touch input.

can do.

According to another example, referring to FIG. 48 , when a touch input is received in an external area not included in the preset touch area 3010a among the touchable area 3010' in the digitizer mode, the pointing device integrated text input device 3000 ) may reset the touch area 3010 by changing the touch area 3010b to correspond to the movement of touch coordinates of the corresponding touch input.

According to another example, in the pointing device-integrated text input device 3000, the touch area 3010 in the digitizer mode is matched with the screen 10 by a predetermined user input through the mode switching unit. It may enter a standby state for receiving an input for resetting. If a touch input is received in the standby state, the touch area 3010 may be reset by moving the touch area 3010 to correspond to the movement of the corresponding touch input.

In addition to the examples mentioned above, the pointing device-integrated text input device 3000 determines various conditions as a request for resetting the touch area, waits to receive an input for resetting the touch area when the request for resetting the touch area occurs, and touches that occur thereafter. The touch area 3010 in the digitizer mode may be moved by moving the touch area 3010 to correspond to the movement of the input.

Hereinafter, several methods for the pointing device-integrated text input device 3000 to perform a control operation related to the digitizer mode will be described.

FIG. 49 is a flowchart illustrating an example of a mode switching method of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 49 , the present method includes obtaining information on the input mode (S3110), determining the input mode (S3120), activating the switch 3200 and inactivating the electrode 3130 in the case of the keyboard mode. (S3131), obtaining a push input (S3132), moving the button body 3120 up and down (S3133), obtaining a key identifier (S3134), obtaining a key value (S3135), mouse mode If , inactivating the switch 3200 and activating the electrode 3130 (S3121), obtaining a touch input (S3122), changing the capacitance (S3123), obtaining touch coordinate values ( S3124), obtaining a mouse input (S3125), inactivating the switch 3200 and activating the electrode 3130 in case of digitizer mode (S3131), obtaining a touch input (S3132), the capacitance is A step of changing (S3133), obtaining a touch coordinate value (S3134), and acquiring a digitizer input (S3135) may be included.

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 may obtain information about the input mode (S3110) and determine the input mode according to the obtained information (S3120). Here, the input mode may include a keyboard mode, a mouse mode, and a digitizer mode, and switching between these modes in the pointing device-integrated text input device 3000 may be completely freely or limitedly permitted.

The pointing device-integrated text input device 3000 may output a key value as a keyboard input according to a user input in the form of a push input when in the keyboard mode.

First, the pointing device integrated text input device 3000 may activate the switch 3200 and deactivate the electrode 3130 (S3131).

Here, activation of the switch 3200 means that when the switch 3200 is touched or pressed by the button body 3120 according to a push input, the controller 3500 receives a key identifier from the switch 3200, and the key identifier This may mean a state in which a key value is obtained according to the key value and a keyboard input reflecting the key value can be transmitted to a device or unit using the pointing device-integrated text input device 3000 as an input interface.

Conversely, deactivation of the switch 3200 means that the pointing device-integrated text input device 3000 does not perform part or all of the process of finally transmitting keyboard input according to the user's push input in the activated state of the switch 3200 described above. This may mean a state in which keyboard input is not output in response to a push input.

Also, activation of the electrode 3130 means that when a user performs a touch input, a drive signal is applied to the electrode 3130 to generate capacitance in the electrode 3130, and the electrode ( 3130) detects the change in capacitance as a scan signal, the controller 3500 calculates touch coordinate values and touch information according to the scan signal, and obtains a mouse input or digitizer input based on the touch coordinate value and obtains a pointing device-integrated text input device This may mean a state in which a mouse input or a digitizer input can be transmitted to a device or unit using 3000 as an input interface.

Conversely, deactivation of the electrode 3130 refers to a process in which the pointing device-integrated text input device 3000 finally transmits a mouse or digitizer input according to a user's touch input in the activated state of the electrode 3130, or By not performing all of them, it may mean a state in which a mouse or digitizer input is not output in response to a touch input.

The pointing device-integrated text input device 3000 acquires a push input through the keycap 3110 (S3132), and accordingly, the button body 3120 descends (S3133), and the switch 3200 obtains a key identifier (S3132). S3134), the controller 3500 may receive the received key value and obtain a keyboard input including the key value (S3135).

The pointing device-integrated text input device 3000 can function as a keyboard by transmitting keyboard input to a subject using the pointing device-integrated text input device 3000 as an input interface.

In the mouse mode, the pointing device integrated text input device 3000 may output a mouse input according to a user input in the form of a touch input.

First, the pointing device integrated text input device 3000 may deactivate the switch 3200 and activate the electrode 3130 (S3141). However, at this time, if necessary, it is possible to deactivate only a part of the switch 3200, or it is possible to make all of the switches 3200 active.

In the pointing device-integrated text input device 3000, when a touch input is touched through the keycap 3110 (S3142), a change may occur in the capacitance of the electrode 3130 generated by the drive signal (S3143). The controller 3500 may receive a scan signal reflecting the change in capacitance and obtain touch coordinate values accordingly (S3144).

When the touch coordinate values are obtained, the controller 3500 may calculate a touch coordinate change value through a difference operation between the touch coordinate value obtained in the previous scan period and the current touch coordinate value, and generate a mouse input reflecting the touch coordinate value. (S3145).

The pointing device-integrated text input device 3000 may function as a mouse by transferring mouse input to a subject using the pointing device-integrated text input device 3000 as an input interface.

In the case of the digitizer mode, the pointing device integrated text input device 3000 may output a digitizer input according to a user input in the form of a touch input.

First, the pointing device integrated text input device 3000 may deactivate the switch 3200 and activate the electrode 3130 (S3151). However, at this time, if necessary, it is possible to deactivate only a part of the switch 3200, or it is possible to make all of the switches 3200 active.

In the pointing device-integrated text input device 3000, when a touch input is touched through the keycap 3110 (S3152), a change may occur in the capacitance of the electrode 3130 generated by the drive signal (S3153). The controller 3500 may receive a scan signal reflecting the change in capacitance and obtain touch coordinate values accordingly (S3154).

When the touch coordinate values are acquired, the controller 3500 generates a digitizer input indicating a specific point on the screen 10 from the touch coordinate values in consideration of the matching relationship between the screen 10 and the touch area 3010 in the digitizer mode. It can be done (S3145).

The pointing device-integrated text input device 3000 may function as a digitizer by transmitting a digitizer input to a subject using the pointing device-integrated text input device 3000 as an input interface.

FIG. 50 is a flowchart illustrating a touch input processing method of the pointing device-integrated text input device 3000 of FIG. 30 in mouse mode and digitizer mode.

Referring to FIG. 50 , the method includes obtaining a touch input (S3210), calculating touch coordinate values (S3220), determining a mode (S3230), and in case of mouse mode, previous touch coordinate values and current touch Calculating a relative coordinate value based on the coordinate value (S3240), outputting a mouse input according to the relative coordinate value (S3250), in case of digitizer mode, considering the touch area-screen area matching relationship, the absolute value of the touch coordinate value It may include calculating the coordinate values (S3260) and outputting the digitizer input according to the absolute coordinate values (S3270).

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 may obtain a touch input (S3210) and calculate touch coordinate values according to the touch input (S3220).

When the touch coordinate values are calculated, the controller 3500 can determine whether the current mode is a mouse mode or a digitizer mode (S3230).

In the mouse mode, the controller 3500 may calculate relative coordinate values based on the touch coordinate values of the previous scan period and the touch coordinate values of the current scan period (S3240), and output a mouse input reflecting the relative coordinate values (S3240). S3250).

On the other hand, in the case of the digitizer mode, the controller 3500 may calculate an absolute coordinate value from the touch coordinate value in consideration of the touch area-screen area matching relationship (S3260), and output a digitizer input according to the absolute coordinate value (S3270). .

Here, a process for the controller 3500 to obtain a digitizer input from touch coordinate values may be as follows.

For example, the matching relation may be a matching table or a matching function between coordinate values of the screen 10 resolution for each coordinate value of the touch area 3010 . In this case, the controller 3500 may change the touch coordinate values into coordinate values on the screen 10 using such a matching table or matching function, and obtain a digitizer input reflecting the coordinate values on the screen 10 .

As another example, the matching relationship may mean that the touch coordinate values of the first touch input upon entering the digitizer mode correspond to the coordinate values of the resolution of the pointer P on the screen 10 at the time of the first touch input. . In this case, the controller 3500 may obtain a difference between the touch coordinate values of the starting touch input and the touch coordinate values of the current touch input as a digitizer input. Technically, this method is substantially the same as setting a matching relationship between the screen 10 and the touch area 3010 according to the coordinate values of the first touch input and converting the touch coordinate values into absolute coordinate values according to the matching relationship. However, the signal/information processing/computation process may be slightly different.

FIG. 51 is a flowchart illustrating an example of a method of setting a touch area in the digitizer mode of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 51 , the method includes entering the mouse mode (S3310), determining right-handed mode/left-handed mode (S3320), setting a touch area based on whether it is a right-handed mode or a left-handed mode (S3330), Receiving a digitizer mode request (S3340), entering the digitizer mode (S3350), setting the entire touchable area as a touch area (S3360), matching the touch area and the screen area based on the screen resolution (S3370), obtaining a touch input and calculating touch coordinate values (S3380), and obtaining a digitizer input based on the touch coordinate values in consideration of a matching relationship between the screen resolution and the touch area (S3319).

Hereinafter, each step described above will be described in more detail.

First, the pointing device-integrated text input device 3000 enters the mouse mode (S3310). At this time, the pointing device-integrated text input device 3000 determines whether the right-handed mode/left-handed mode is selected (S3320), and may set the touch area differently according to the right-handed mode or the left-handed mode (S3330). Since the description of whether the mode is the right hand mode or the left hand mode and the corresponding touch area has been described above, a detailed description thereof will be omitted.

The pointing device-integrated text input device 3000 may receive a request for switching to the digitizer mode through a mode switching unit or the like in a mouse mode (S3340) and enter the digitizer mode (S3350).

Upon entering the digitizer mode, the pointing device-integrated text input device 3000 sets the entire touchable area as a touch area (S3360), and matches the touch area with the screen area based on the resolution of the screen 10 (S3360). S3370). Specifically, a matching table or matching function in which the four corners of the touch area 3010 coincide with the four corners of the screen 10 may be created.

The pointing device-integrated text input device 3000 may obtain a touch input, calculate touch coordinate values (S3380), and obtain a digitizer input based on the touch coordinate values in consideration of a matching relationship between a screen resolution and a touch area. (S3319). In this case, the dedigitizer input may indicate a predetermined point on the screen 10 . However, it is also possible that the pointing device-integrated text input device 3000 simply transmits touch coordinate values, and the device receiving the transmitted coordinate values converts the touch coordinate values into coordinate values of the screen 10 .

52 is a flowchart illustrating another example of a touch area setting method in the digitizer mode of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 52 , the method includes a step of switching from a mouse mode to a digitizer mode (S3410), obtaining an initial touch input (S3420), calculating coordinate values of the initial touch input (S3430), and calculating coordinates. It may include obtaining a touch area-screen matching relationship based on the value and the position of the pointer on the screen (S3440) and setting a touch area based on the matching relationship (S3450).

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 may switch from the mouse mode to the digitizer mode (S3410), obtain an initial touch input after entering the mode (S3420), and calculate the touch coordinate values (S3430).

The pointing device-integrated text input device 3000 may obtain a touch area-screen matching relationship based on the calculated coordinate values and the position of the pointer P on the screen 10 (S3440). That is, the controller 3500 may create a matching table or matching function so that the touch point of the first touch and the position of the pointer P on the screen 10 correspond to each other.

When a matching relationship is formed, the pointing device integrated text input device 3000 may set a touch area based on the matching relationship (S3450). The controller 3500 may set the touch area so that the touch coordinate value of the first touch and the point where the pointer is located at the time of the first touch of the touch area correspond to each other.

As a result, touch coordinate values on the touch area are matched with resolution values of the screen 10, and the touch area may be used in a form of receiving a digitizer input.

Meanwhile, instead of implementing a matching table or matching function forming a matching relationship, it is also possible to control the movement of the pointer on the screen based on the difference between the coordinate values of the first touch input and the coordinate values of subsequent touch inputs. In the mouse mode, it has been explained that the movement of the pointer is controlled by calculating the touch coordinate change value through the difference between the touch coordinate value of the current scan period and the touch coordinate value of the previous scan period. In the digitizer mode, even if a matching relationship is not formed, the point where the pointer is located at the time of the first touch input and the touch coordinate value of the first touch input on the touch area are matched, so that the movement of the pointer thereafter is performed with the touch coordinate value of the first touch input and the current touch input. It is also possible to control using the touch coordinate variation value calculated from the difference operation of the touch coordinate values of .

53 is a flowchart illustrating a method of resetting a touch area in the digitizer mode of the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 53 , the method includes receiving a touch area reset request in digitizer mode (S3510), resetting the touch area according to the reset request (S3520), obtaining a touch input (S3530), and touch coordinates. It may include calculating a value (S3540) and obtaining a digitizer input based on the touch coordinate values in consideration of a matching relationship between the screen resolution and the touch area (S3550).

Hereinafter, each step described above will be described in more detail.

The pointing device integrated text input device 3000 may receive a request for resetting the touch area in the digitizer mode (S3510). Since the specific aspect of the resetting request has already been described above, a detailed description thereof will be omitted.

When the reset request is received, the pointing device integrated text input device 3000 may reset the touch area (S3520). In detail, the controller 3500 may reset the touch area by moving the touch area in response to the movement of the touch input received after the reset request.

Specifically, the pointing device-integrated text input device 3000 obtains a touch input (S3530), calculates touch coordinate values of the acquired touch input (S3540), and then determines the touch coordinate values in consideration of the matching relationship between the screen resolution and the touch area. Based on this, it is possible to obtain a digitizer input (S3550).

Meanwhile, in the resetting of the touch area using the aforementioned multi-touch input or the resetting of the touch area using a touch input to a touchable area outside the touch area, a request for resetting the touch area and a command to move the touch area thereafter are merged. can be interpreted

In the above description, it has been mentioned that the pointing device-integrated text input device 3000 basically receives only key input and does not recognize touch input in the keyboard mode, and basically receives only touch input and does not recognize key input in the mouse mode. .

In fact, when the pointing device-integrated text input device 3000 senses a touch input in the keyboard mode, the pointer P on the screen 10 may move unintentionally due to typing, so in the keyboard mode, the touch input It can be advantageous not to recognize Furthermore, in order to sense a touch input, the pointing device-integrated text input device 3000 must periodically process a drive signal and a scan signal, resulting in unnecessary power consumption.

However, in a touch mode (mouse mode, digitizer mode, etc.), even if the pointing device-integrated text input device 3000 recognizes a key input, there is no great inconvenience in controlling the position of the pointer P.

Hereinafter, a method of utilizing a key input by the pointing device-integrated text input device 3000 in a touch mode will be described.

In a computing environment, etc., it may be necessary to adjust adjustable properties while driving an operating system or running an application. Hereinafter, these properties are referred to as properties to be adjusted.

54 is a diagram of some examples of attributes to be adjusted.

Representative examples of properties to be adjusted include a volume property (12a) related to the loudness of audio shown in FIG. ), and other properties to be adjusted.

In the past, various methods have been devised to adjust the property value of the property to be adjusted.

For example, the user may adjust the property to be adjusted by inputting a character value or a key value assigned to the property to be adjusted. Specifically, when the "+" key on the keyboard is input, the attribute value of the volume attribute may increase, and when the "-" key is input, the attribute value of the volume attribute may decrease.

As another example, an indicator positioned on a graphic object reflecting the attribute value of an attribute to be adjusted has been moved by dragging according to a mouse input.

However, when adjusting the property value of the property to be adjusted through key input, there is a frequent problem in that a large number of key inputs are repeatedly required. , First, the user has to move the pointer (P) to the indicator position of the graphic object and then perform drag input.

In the present specification, the pointing device-integrated text input device 3000 may adjust a property to be adjusted by utilizing a keyboard input while operating in a touch mode. Hereinafter, some implementations will be described.

55 is a diagram relating to a matching relationship between an adjustment target attribute and a button 3100 .

Referring to FIG. 55 , while the pointing device-integrated text input device 3000 operates in the touch mode, key input is basically disabled. However, here, some keys are set to a state in which key input can be recognized. In addition, adjustment target attributes may be assigned to key values of some buttons 3100 capable of recognizing key input.

That is, the controller 3500 may assign the property to be adjusted to a key value or key identifier corresponding to at least one specific button 3100 in the touch mode. Alternatively, when a key input of a specific button 3100 occurs in the touch mode, the controller 3500 may obtain and output the corresponding key input as a keyboard input indicating a shortcut key of an attribute to be adjusted. For example, 'A' button 3100a, 'P' button 3100b, and 'C' button 3100c correspond to audio volume properties, media player progressive bar properties, and picture application color space properties, respectively. There may be.

When a key input occurs in the touch mode, the controller 3500 determines whether a predetermined property to be adjusted or a key value having a predetermined property to be adjusted is allocated to the key identifier of the switch 3200 of the corresponding key. can do.

If a property to be adjusted is assigned to the corresponding button 3100, a subsequent touch input is recognized, and a mouse or digitizer input is acquired/transmitted according to the coordinate value of the touch, and the electronic device receiving the adjustment adjusts Attribute values of target attributes may be adjusted according to touch input.

To this end, the controller 3500 generates shortcut information instructing to call or activate the adjustment target property according to a key value generated by a key input for the button 3100 to which the adjustment target attribute is assigned, and provides the information to the electronic device. can be conveyed

For example, while the pointing device-integrated text input device 3000 operates in the touch mode, the user may perform a key input on the button 3100 to which the property to be adjusted is assigned. At this time, the controller 3500 may obtain a corresponding key identifier.

If the pointing device-integrated text input device 3000 is operating in the keyboard mode, the controller 3500 converts the key value to a character value or a value in a form used in an existing keyboard (eg, 'ESC' value, 'Caps Lock' value). 'value, etc.) can be acquired/output by keyboard input.

However, if the pointing device-integrated text input device 3000 operates in the touch mode, the controller 3500 first obtains a key identifier and determines whether an adjustment target property is assigned to the key identifier. If not assigned, key input is ignored.

However, if the property to be adjusted is assigned to the key identifier, subsequent touch input may be output in the form of a mouse/digitizer input used to adjust the property value of the property to be adjusted. Also, during this process, the controller 3500 may transmit/output information identifying the property to be adjusted or a signal instructing activation/call of the property to be adjusted.

Here, when certain properties to be adjusted are called or activated, a graphic object including a bar or plane displaying the adjustment range of the property to be adjusted and an indicator indicating the current property value may be output on the screen.

56 and 57 are diagrams related to an example of adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

A description of an example with reference to FIG. 56 is as follows.

In non-touch mode, when a key input for the “A” key occurs, the pointing device-integrated text input device 3000 may output a key value for the character “A”. In addition, when a key input for the “A” key occurs in the touch mode, the pointing device integrated text input device 3000 acquires a key value indicating the audio volume property from the “A” key input, and accordingly, the pointing device integrated text input device A subject using 3000 as an input interface may output a signal that activates or calls so that the corresponding audio volume property becomes adjustable.

Next, the controller 3500 may process a touch input after a key input associated with the property to be adjusted as a property adjustment value for adjusting the property value of the property to be adjusted. The property to be adjusted may be adjusted according to the property adjustment value.

Specifically, a touch input moving from the lower part to the upper part of the keyboard layout may increase the attribute value of the volume attribute. In addition, a touch input moving from an upper part to a lower part of the keyboard layout may decrease the attribute value of the volume attribute.

In this way, when the touch input is used as an input for adjusting the value of an attribute to be adjusted instead of a mouse input for moving the position of the pointer P, this will be referred to as an attribute adjustment input.

The attribute control input may be provided in a form similar to a mouse input or a digitizer input, in which an attribute to be adjusted is included. Alternatively, the attribute adjustment input may be provided in a form in which touch coordinate values correspond to attribute values.

That is, in FIG. 56, the pointing device-integrated text input device 3000 indicates mouse input or digitizer input according to movement from the first touch location A1 to the second touch location A2 and the audio volume property, which is a property to be adjusted. Information can be transmitted to electronic devices. The electronic device outputs a graphic object according to the audio volume attribute on the screen according to the information indicating the audio volume attribute, and changes the attribute value from the first attribute value a1 to the second attribute value according to a subsequent mouse input or digitizer input. (a2) can be adjusted. At this time, the electronic device may move the indicator 12a' indicating the attribute value.

A description of an example with reference to FIG. 57 is as follows.

In non-touch mode, when a key input for the “P” key occurs, the pointing device-integrated text input device 3000 may output a key value for the character “P”. Also, when a key input for the “P” key occurs in the touch mode, the pointing device-integrated text input device 3000 acquires a key value indicating the playback property of the media player from the “P” key input, and accordingly, the pointing device-integrated text input device 3000 A subject using the text input device 3000 as an input interface may output a signal that activates or calls a corresponding playback property to be in an adjustable state.

Then, when a touch input in the left and right direction is input between the third touch location B1 and the fourth touch location B2, the playback property may be adjusted between the third property value b1 and the fourth property value b2. .

Here, the property to be adjusted may generally have a one-dimensional property value. An attribute to be adjusted having a one-dimensional attribute value may be expressed as a graphic object including a bar corresponding to an adjustment range represented by a minimum value and a maximum value and an indicator displaying a current attribute value on a corresponding bar. In addition, the graphic object may be expressed as a dial-shaped graphic object in which property values are adjusted in a clockwise/counterclockwise direction according to circumstances.

However, attributes to be adjusted having all one-dimensional attribute values are not expressed as graphic objects.

Adjusting the attribute value of the attribute to be adjusted, which has the above-mentioned one-dimensional attribute value and is expressed as a graphic object including a bar and an indicator, can be mainly performed by moving a pointer in a vertical direction or a horizontal direction. In this way, the direction in which the pointer is moved to adjust the property value can be defined as the property control direction. For example, the aforementioned volume property has a vertical direction and the playback property has a horizontal direction.

Therefore, when the touch input of the pointing device-integrated text input device 3000 is used to adjust the property value of the property to be adjusted, when the touch input is made in two dimensions, the coordinate value perpendicular to the property control direction of the property to be adjusted is can be ignored In detail, the controller 3500 may correct the touch coordinate values in consideration of the property adjustment direction, and obtain/output a property adjustment input based on the corrected touch coordinate values.

FIG. 58 is a diagram related to another example of adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

Referring to FIG. 58 as an example, the volume attribute shown in FIG. 58 has a vertical property adjustment direction on the screen 10 . At this time, if a request for adjusting the volume property is received from the pointing device integrated text input device 3000 through the 'A' button 3100a, the controller 3500 may then generate a property adjusting input according to the touch input. . At this time, the controller 3500 may determine that the volume attribute is assigned to the 'A' button, and may also determine that the property control direction of the volume attribute is in the vertical direction. Afterwards, when a touch input occurs, the controller 3500 may correct the touch coordinate values according to the property adjustment direction. That is, in FIG. 58 , the fifth touch A1' and the sixth touch A2' are made in the diagonal direction, but the property control direction of the volume property is the first property value a1 and the second property value a2 Since is arranged in the vertical direction, the controller 3500 can process an attribute adjustment input for adjusting attribute values using only the touch coordinate values in the vertical direction where the horizontal direction is removed from the diagonal direction touch input.

FIG. 59 is a diagram related to another example of adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

Meanwhile, in the foregoing, it has been described that properties to be adjusted mainly have one-dimensional property values, but in some cases, properties to be adjusted that have two or more dimensional property values, such as color space or color coordinates, also exist.

59 shows a color plane 12c having two-dimensional attribute values. When the 'C' key 3100c to which the color plane is assigned is pressed, the pointing device-integrated text input device 3000 may process the subsequent two-dimensional touch coordinate values as property control inputs for adjusting the two-dimensional property values. there is.

In the above description, when there is a keyboard input of a button associated with a property to be adjusted in the touch mode, the touch mode for controlling the property value of the property to be adjusted in the general touch mode is entered, and the touch input in the corresponding touch mode It can be interpreted as adjusting the property value of the property to be adjusted accordingly.

As such, there may be various methods of processing a touch input as an input for adjusting the attribute value of an attribute to be adjusted. Some examples will be described below.

First, when the controller 3500 receives a key identifier assigned to the button 3100 indicating a property to be adjusted in the touch mode, the controller 3500 may enter the property adjusting mode.

Here, a method of entering the attribute adjustment mode may be as follows.

For example, when a key identifier of a button 3100 indicating a property to be adjusted in a general touch mode is received, a property adjustment mode may be entered. In addition, if the key identifier of the button 3100 indicating the property to be adjusted is received again in the property control mode state, the property control mode can be released. At this time, it is possible to return to the general touch mode again. The controller 3500 may process a property adjustment input for a touch input from entering an adjustment target property to releasing it. In addition, at this time, a key value indicating a property control mode may be universally assigned to the 'ESC' key or the like.

As another example, when a key identifier of a button 3100 indicating a property to be adjusted in a general touch mode is received, a property adjustment mode may be entered. In this state, the controller 3000 can process a property adjustment input for one touch input. When the one-time touch input ends, the property adjustment mode may be released and the normal touch mode may be returned.

As another example, when a key identifier of a button 3100 indicating a property to be adjusted in a general touch mode is received, the property adjustment mode may be maintained while the corresponding button 3100 is pressed. When the push of the corresponding button 3100 is released, the property adjustment mode can be released. The controller 3500 may process a property adjustment input for a touch input from entering an adjustment target property to releasing it. Property control mode can be canceled and normal touch mode can be returned.

Here, it has been described that the pointing device integrated text input device 3000 can enter the attribute control mode and processes a touch input in the attribute control mode as an attribute control input, but there is no separate mode called attribute control mode. , it is also possible to process a touch input under a specific condition as a property control input. The specific conditions here may be similar to the above example.

60 is a diagram relating to a first example of processing of a touch input for adjusting an adjustment target attribute of the pointing device-integrated text input device 3000. Referring to FIG.

According to the first example, referring to FIG. 60 , a touch input of the pointing device-integrated text input device 3000 in a property adjustment mode is processed similarly to the above-described mouse input. However, in this case, instead of calculating the mouse input from the touch coordinate value, it is also possible to calculate the mouse input using the touch coordinate value calibrated in consideration of the attribute control direction. The property value of the property to be adjusted may be increased or decreased according to the property control input processed similarly to the mouse input.

Specifically, in the case of the audio volume property 12a' whose property adjustment direction is in the up-down direction, the position of the indicator 13 displaying the volume property value and the property value can be adjusted by a touch input in the up-down direction.

61 is a diagram related to a second example of processing of a touch input for adjusting an adjustment target attribute of the pointing device-integrated text input device 3000. Referring to FIG.

According to the second example, referring to FIG. 61 , upon entering the attribute adjustment mode, the pointing device-integrated text input device 3000 may match a touch region with an adjustment range of an attribute value of an attribute to be adjusted for attribute adjustment. Thereafter, the touch input may be processed in a manner similar to that of the digitizer input to obtain an attribute adjustment input.

Specifically, for the audio volume property 12a' whose property control direction is in the vertical direction, touch for property control input such that the maximum volume value and the minimum volume value are matched with the uppermost and lowermost parts of the touchable area 3010', respectively. You can set the touch area for input. To this end, the controller 3500 may acquire a range of attribute values and set the touch area based on the obtained range. Thereafter, in the touch input for property adjustment, touch coordinate values of the touch area for the uppermost coordinate value and the lowermost tick value of the touch area may be determined as property values for the maximum and minimum property values.

FIG. 62 is a diagram related to a third example of touch input processing for adjusting an adjustment target property of the pointing device integrated text input device 3000. Referring to FIG.

According to the third example, referring to FIG. 62 , the first touch input upon entering the property adjustment mode (hereinafter, the first touch input after entering a specific mode is referred to as 'start touch input', the touch coordinate values of the start touch input) (referred to as a 'start touch coordinate value') may be matched with the current property value of the property to be adjusted. That is, the controller 3500 can generate an attribute adjustment input so that the starting coordinate touch value and the current attribute value correspond to each other, and then adjust the attribute value with a variation value of the starting coordinate touch value of the touch coordinate value.

63 is a diagram related to a fourth example of processing a touch input for adjusting an adjustment target attribute of the pointing device integrated text input device 3000. Referring to FIG.

According to a fourth example, referring to FIG. 63 , the pointing device-integrated text input device 3000 transmits a touch input continuously from a touch input performed by a push input to a button 3100 to which an adjustment target property is assigned as a property attribute. It can be processed as a touch input for adjustment.

Specifically, when the user pushes the 'P' button 3100b indicating the playback property 12b of the media player, the pointing device-integrated text input device 3000 simultaneously presses the corresponding push input from the 'P' button 3100b. A starting touch input may be acquired. The controller 3500 may process the touch coordinate values of the touch input performed until the touch input is released as a property adjustment input.

FIG. 64 is a diagram related to a fifth example of processing of a touch input for adjusting an adjustment target attribute of the pointing device integrated text input device 3000. Referring to FIG.

According to the fifth example, referring to FIG. 64 , on the other hand, the pointing device-integrated text input device 3000 is continuously connected from a touch input performed by a push input to a button 3100 to which an adjustment target attribute is assigned and a corresponding button A touch input on 3100 may be processed as a touch input for property adjustment.

Specifically, when the user pushes the 'P' button 3100b indicating the playback property 12b of the media player, the pointing device-integrated text input device 3000 simultaneously presses the corresponding push input from the 'P' button 3100b. A starting touch input may be obtained. The controller 3500 may then process the 'P' button 3100b as a property adjustment input according to the touch input sensed on the electrode 3130.

Meanwhile, at this time, the sensing area provided by a single button may not be wide enough. In this case, an attribute adjustment input may be processed based on a touch input drawing a clockwise rotation or a touch input drawing a counterclockwise rotation of the corresponding button. . For example, a clockwise touch input may be processed as an input for increasing an attribute value, and a counterclockwise touch input may be processed as an input for decreasing an attribute value. For a more specific example, a clockwise touch input is processed as an input that moves the indicator on the progressive bar to the right and moves the play point of the playback property 12b backward, and a counterclockwise touch input moves the indicator on the progressive bar to the left. , and can be processed as an input that moves the play point of the playback attribute 12b forward.

FIG. 65 is a diagram related to a sixth example of processing of a touch input for adjusting an adjustment target property of the pointing device integrated text input device 3000. Referring to FIG.

According to the sixth example, referring to FIG. 65 , in the case of a property to be adjusted having a 2D property value, a touch area for receiving a touch input for adjusting it may also be set in a 2D flat shape. That is, a touch area in the property adjustment mode that matches the area of the graphic object reflecting the 2D property value may be set. 65, the color plane 12c and the entire touchable area 3010' may match each other.

FIG. 66 is a diagram related to a seventh example of processing of a touch input for adjusting an adjustment target attribute of the pointing device integrated text input device 3000. Referring to FIG.

According to the seventh example, referring to FIG. 66 , in the case of a property to be adjusted having a 2D property value, a touch area for receiving a touch input for adjusting the property may also be set in a 2D flat shape. That is, a touch area in the property adjustment mode that matches the area of the graphic object reflecting the 2D property value may be set. In FIG. 66 , a touch area in which the touch coordinate value and the position of the pointer P on the color plane 12c are matched may be set for each individual touch.

In the above, several examples for processing a touch input as a property control input have been described. However, it should be noted that the method in which a touch input is processed as an attribute control input is not limited to the above example.

Hereinafter, several methods for the pointing device-integrated text input device 3000 to adjust attribute values of attributes to be adjusted will be described.

67 is a flowchart of an example of a method of adjusting the property to be adjusted of the pointing device integrated text input device 3000. Referring to FIG.

Referring to FIG. 67 , the present method includes entering a touch input mode (S3610), obtaining a push input indicating a property to be adjusted (S3620), activating a property to be adjusted (S3630), and using a touch input It may include acquiring (S3640) and adjusting a property to be adjusted based on the touch input (S3650).

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 enters a touch input mode (S3610). In this case, the touch input mode may correspond to the above-described mouse mode or digitizer mode. Also, the pointing device-integrated text input device 3000 may activate the electrode 3130 to detect a touch input. However, the pointing device-integrated text input device 3000 does not completely inactivate the switch 3200, but activates the switch 3200 at least for the buttons 3100 to which properties to be adjusted are assigned.

The pointing device-integrated text input device 3000 may obtain a push input indicating an attribute to be adjusted (S3620). When a push input is received on a button 3100 among the activated buttons 3100 to which a property to be adjusted is assigned to its key value or key identifier, the controller 3500 obtains the corresponding key value or key identifier, and adjusts the assigned property accordingly. Target attributes can be activated (S3630). Upon activation, a signal requesting the display of the graphic object of the corresponding adjustment target property or the corresponding adjustment target property may be transmitted to the electronic device.

When the property to be adjusted is activated by the pointing device-integrated text input device 3000 or when the pointing device-integrated text input device 3000 enters a property control mode for the corresponding property to be adjusted, a touch input is obtained (S3640). The property to be adjusted may be adjusted based on the touch input (S3650). The controller 3500 of the pointing device-integrated text input device 3000 may generate a property adjustment input based on the touch coordinate values and transmit it to a subject using the pointing device-integrated text input device 3000 as an input interface.

68 is a flowchart of another example of a method for adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

Referring to FIG. 68, the method includes obtaining a key identifier according to a push input (S3710), determining a mode (S3720), obtaining a character value corresponding to the key identifier (S3730), and adjusting target properties. It may include determining an assigned key value (S3740), obtaining a touch input (S3750), and adjusting a property to be adjusted based on the touch input (S3760).

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 may obtain a key identifier according to the push input (S3710). Specifically, the controller 3500 receives the key identifier from the switch 3200 receiving the push input.

Next, the pointing device integrated text input device 3000 may determine the mode (S3720). Specifically, the controller 3500 may determine whether the current mode is a touch mode or a keyboard mode.

If in the keyboard mode, the pointing device-integrated text input device 3000 may obtain a character value corresponding to a key identifier as a key value (S3730). This key value is delivered to the electronic device in the form of a keyboard input and can be used for text input.

If in the touch mode, the pointing device-integrated text input device 3000 may acquire the property to be adjusted assigned to the key identifier (S3740). The pointing device-integrated text input device 3000 may adjust the property value of the property to be adjusted based on the subsequently obtained touch input (S3750) (S3760). Adjustment of attribute values can be performed by the pointing device-integrated text input device 3000 generating an attribute adjustment input using the touch coordinate values of the touch input and transmitting it to the electronic device.

69 is a flowchart of another example of a method of adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

Referring to FIG. 69 , the method includes obtaining a push input indicating a property to be adjusted (S3810), obtaining a touch input (S3820), calculating touch coordinate values (S3830), and It may include correcting the touch coordinate values based on the adjustment direction (S3840) and adjusting the adjustment target property according to the corrected touch coordinate values (S3850).

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 obtains a push input indicating a property to be adjusted (S3810), then obtains a touch input (S3820), and the controller 3500 may calculate touch coordinate values (S3830). ).

Next, the pointing device integrated text input device 3000 may correct the touch coordinate values based on the adjustment direction of the property to be adjusted (S3840). In general, a touch input is expressed as a 2D touch coordinate value. In the case of an adjustment target property having a 1D attribute value, the controller 3500 corrects the touch coordinate value to the 1D coordinate value according to the property control direction of the target attribute. can do.

When the touch coordinate values are corrected, the pointing device-integrated text input device 3000 may adjust the property to be adjusted according to the corrected touch coordinate values (S3850). In order to adjust the property to be adjusted, when the controller 3500 generates a property control input according to the corrected touch coordinate value and transmits it to the electronic device, the electronic device adjusts the property value of the property to be adjusted according to the property control input. It can be done by doing

70 is a flowchart of yet another example of a method of adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

Referring to FIG. 70 , the present method includes obtaining a push input indicating a property to be adjusted (S3910), calculating touch coordinate values of a start touch input (S3920), and a current property value of the property to be adjusted and the start touch. It may include obtaining a matching relationship between touch coordinate values of the input (S3930) and adjusting the property value of the property to be adjusted according to the touch input in consideration of the matching relationship (S3940).

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 may obtain a push input indicating a property to be adjusted (S3910) and obtain a start touch input.

When the starting touch input is obtained, the pointing device-integrated text input device 3000 may calculate starting touch coordinate values (S3920).

Next, the pointing device-integrated text input device 3000 may create a matching relationship between the current property value of the property to be adjusted and the touch coordinate value of the starting touch input (S3930). The controller 3500 may obtain a current attribute value and create a matching table or matching function matching the start touch coordinate value with the current attribute value.

When the matching relationship is determined, the pointing device-integrated text input device 3000 may adjust the property value of the property to be adjusted according to the touch input in consideration of the matching relationship (S3940).

Meanwhile, here, a matching relationship does not necessarily have to be established. Instead of forming a matching relationship, the pointing device-integrated text input device 3000 may generate a property adjustment input based on a difference between touch coordinate values of a first touch input and subsequent touch coordinate values. This is because the touch coordinate change value is calculated according to the difference between the current touch coordinate value and the start touch coordinate value instead of performing the difference operation of the touch coordinate value for each period of the scan signal. The effect may be the same as matching a value to an attribute value.

71 is a flowchart of yet another example of a method of adjusting the property to be adjusted of the pointing device-integrated text input device 3000. Referring to FIG.

Referring to FIG. 71 , the present method includes obtaining a push input indicating a property to be adjusted (S4010), obtaining a matching relationship between a range of the property to be adjusted and a touch area (S4020), and a touch in consideration of the matching relationship. A step of adjusting the property value of the property to be adjusted according to the input (S4030) may be included.

Hereinafter, each step described above will be described in more detail.

When the pointing device-integrated text input device 3000 obtains a push input indicating a property to be adjusted (S4010), it can set a touch area.

In this case, the pointing device-integrated text input device 3000 may obtain a matching relationship between the range of the property to be adjusted and the touch area (S4020). For example, in the case of an attribute to be adjusted having a one-dimensional attribute value, the controller 3500 creates a matching relationship so that the maximum/minimum value of the attribute value is matched with the top/bottom or left/right ends of the touch area, respectively. can be set. For another example, in the case of a property to be adjusted having a two-dimensional property value, the controller 3500 matches the maximum/minimum value of one of the two property values to the top/bottom of the touch area, respectively, and matches the maximum/minimum value of the other property to the top/bottom of the touch area. The minimum value may be matched to the left/right ends of the touch area. Of course, here, it should be noted that the touch area does not have to be set to the entire touchable area.

The pointing device-integrated text input device 3000 may adjust the property value of the property to be adjusted according to the touch input in consideration of the matching relationship (S4030). Since this has already been described above, a detailed description thereof will be omitted.

In this specification, the pointing device-integrated text input device 3000 may detect a hovering input in addition to a key input and a touch input. Here, the hovering input may refer to an input in which a user positions a finger or a body part near the top of the button 3100, unlike a touch input in which the button 3100 is directly touched. In addition, hereinafter, a touch input and a hovering input will be collectively referred to as a gesture input.

FIG. 72 is an example of a hovering input of the pointing device-integrated text input device 3000 of FIG. 30 .

In the present specification, the pointing device-integrated text input device 3000 may detect a touch input through a change in capacitance of the electrode 3130 included in the button 3100 according to a user's touch input. Here, when a user's body part (eg, a finger) is placed on the button 3100, the capacitance of the electrode 3130 provided on the button 3100 may change, although the amount of change is smaller than that of a touch input. The controller 3500 can process this as a hovering input by acquiring it through the scan signal.

Referring to FIG. 72 , although it is smaller than the change in capacitance caused by a touch input, it can be seen that a change in capacitance significantly occurs even when a hovering input occurs.

Particularly, in some cases, in addition to the location of the hovering input on a plane, the distance from the keyboard surface to the user's body part in a direction perpendicular to the keyboard layout may be sensed according to the size of the change in capacitance.

That is, the controller 3500 calculates the (x,y) values based on the scan signal reflecting the change in capacitance as in the touch input, and in addition, the size of the change in capacitance is the capacitance generated during the touch input. If the magnitude of the change in is smaller than a predetermined threshold value or more, it may be determined as a hovering input. Additionally, when determining that a hovering input is input, the controller 3500 may calculate a z value (a hovering coordinate value perpendicular to the keyboard layout) based on the magnitude of change in capacitance.

Specifically, the controller 3500 detects a touch input when the change in capacitance is greater than the touch input threshold, and detects the hovering input when the change in capacitance is equal to or less than the threshold of the touch input and greater than or equal to the threshold of the hovering input. can do.

As shown in FIG. 72 , when the finger touches the electrode 3130, since the change in capacitance exceeds the touch threshold, the pointing device-integrated text input device 3000 can detect this as a touch input. In addition, in the case of the second hand and the third hand in FIG. 72 where the finger and the electrode 3130 are placed at a certain distance, the change in capacitance is greater than the hovering threshold, so the pointing device-integrated text input device 3000 hovers It can be detected as an input.

In addition, when the distance between the finger and the electrode 3130 is large and a change in capacitance below the hovering threshold is detected, the pointing device-integrated text input device 3000 may process this as no input.

In this specification, the pointing device integrated text input device 3000 may control a plurality of electronic devices 20 .

FIG. 73 is an example of a multi-device environment using the pointing device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 73 , the pointing device integrated text input device 3000 may control the first electronic device 21 , the second electronic device 22 , and the third electronic device 23 . Here, the first to third electronic devices control the display independently of each other, and thus, are electronic devices that control the independently operated pointer P on the screen 10 . Meanwhile, although all of the plurality of electronic devices 20 may be separate electronic devices from the pointing device integrated text input device 3000, one of the plurality of electronic devices 20 is the pointing device integrated text input device 3000. ) may be an embedded electronic device. In the following description, for convenience of description, the first electronic device 21 and the third electronic device 23 are components separate from the pointing device-integrated text input device 3000, and the second electronic device 22 is a pointing device. It will be described as being integrally provided with the integrated text input device 3000. However, it should be noted that the multi-device environment in this specification is not limited thereto.

Referring back to FIG. 73 , the pointing device-integrated text input device 3000 may operate as an input interface for any one of a plurality of electronic devices 20 . For example, the pointing device-integrated text input device 3000 may operate as an input interface for an electronic device to which a communication connection is first made with the pointing device-integrated text input device 3000 among the plurality of electronic devices 20 . If the second electronic device 22 is a laptop in which the pointing device integrated text input device 3000 is embedded, the pointing device integrated text input device 3000 may basically operate as an input interface for the second electronic device 22. there is.

In this state, the pointing device-integrated text input device 3000 acquires mouse input, digitizer input, or keyboard input input in touch mode or keyboard mode, and transmits it to the second electronic device 22 . The second electronic device moves the pointer P or inputs text on the screen 10 provided by the display connected to the second electronic device 22 based on data transmitted from the pointing device integrated text input device 3000. can be performed. That is, the pointing device-integrated text input device 3000 functions as an input interface for the second electronic device.

In this case, the pointing device-integrated text input device 3000 may detect a hovering input.

FIG. 74 is a diagram related to an example of selecting a control target device using a hovering input in the multi-device environment of FIG. 70 .

Referring to FIG. 74 , the pointing device-integrated text input device 3000 may input a hovering input in a touch mode. However, when recognizing a hovering input in the touch mode, inconvenience may be caused to touch manipulation. Therefore, the pointing device-integrated text input device 3000 may additionally have a hovering mode as its operation mode, if necessary. When entering the mode, a hovering input may be recognized.

When entering the hovering mode, the pointing device-integrated text input device 3000 receives a hovering input, detects whether or not a hovering input is received based on a change in capacitance generated in the electrode 3130, and responds according to the hovering input. (x,y) hovering plane coordinate values can be obtained. Of course, at this time, it is also possible to obtain more hovering height coordinate values in the z-axis direction.

When the hovering coordinate values are obtained, the pointing device-integrated text input device 3000 may calculate the position of the virtual 3D pointer P according to the hovering coordinates. While the touch coordinate value of the touch input indicates the movement of the pointer P within the screen 10 provided by the display of the electronic device coupled with the pointing device integrated text input device 3000, the hovering coordinate of the hovering input The value may be used to select a plurality of electronic devices 20 connectable to the pointing device integrated text input device 3000 .

Specifically, referring again to FIG. 74 , the pointing device-integrated text input device 3000 operates as an input interface of the second electronic device 22 . At this time, the touch input between the seventh touch input L5 and the eighth touch input L6 is used as an input to control the pointer P of the second electronic device 22, and thus the pointer of the second electronic device 22. may be moved from the seventh position (D5) to the eighth position (D6) on the screen of the corresponding device.

In this situation, a hovering input may be performed after the eighth touch input L6. The hovering input may be formed from the eighth hovering input L6 to the ninth hovering input L7. The pointing device-integrated text input device 3000 senses such a hovering input, and accordingly, from a position in space corresponding to the eighth position D6 in the 3D space to a position in virtual space corresponding to the ninth position D7 in the 3D space. can be moved to

Here, the position in space corresponding to the eighth position D6 indicates the second electronic device 22, and the position in space corresponding to the ninth position D7 indicates the third electronic device 23. It is a position to

When a touch input occurs while the 3D pointer is at a position pointing to the third electronic device 23, the pointing device-integrated text input device 3000 controls the electronic device currently pointed by the 3D pointer, that is, the third electronic device 23. It can be changed to the electronic device 23.

Accordingly, the pointing device integrated text input device 3000 operates as an input interface of the third electronic device 23 . Accordingly, touch inputs generated later, that is, touch inputs from the ninth touch input L7 to the tenth touch input L10 are used for manipulating the pointer of the third electronic device 23, and the pointer is moved to the third electronic device 23. It can be used to move from the ninth position (D7) to the tenth position (D8) on the screen of (23).

Meanwhile, the hovering area 3020 may be divided into a plurality of sub areas. At this time, the controller 3500 determines the number of nearby electronic devices that can be connected to the pointing device-integrated text input device 3000 wired or wirelessly, and the hovering area ( 3020) can be divided. In addition, each sub-region may correspond to each of a plurality of electronic devices 20 .

FIG. 75 is a diagram related to another example of selecting a control target device using a hovering input in the multi-device environment of FIG. 70 .

Referring to FIG. 75 , for example, in a multi-device environment with two devices, the hovering area of the pointing device-integrated text input device 3000 consists of a first area 3010a' and a second area 3010a''. ) may be included. Here, the first area 3010a' may be an area indicating the first electronic device 21, and the second area 3010a'' may be an area indicating the second electronic device 22.

When the pointing device-integrated text input device 3000 enters the hovering mode (or control electronic device selection mode), the controller 3500 may detect the hovering input and calculate hovering coordinate values. If the hovering input moves within the hovering area 3020, the controller 3500 can track it in real time. During the hovering input, when the user's body contacts the touch area to generate a touch input, the electronic device 20 allocated to the hovering area 3020 corresponding to the touch area where the touch input occurred can be selected as the electronic device 20 and the controlled device.

Afterwards, the pointing device-integrated text input device 3000 operates as an input interface for an electronic device selected as a control target device. That is, when the pointing device-integrated text input device 3000 recognizes a keyboard input or a touch input, it may transmit the corresponding key value or character value, or mouse input or touch information to the controlling device.

Meanwhile, additionally, in the present specification, the pointing device integrated text input device 3000 is connected to an augmented reality or virtual reality device, and obtains a hovering input for controlling a pointer P' in 3D space displayed in augmented reality or virtual reality. can do.

FIG. 76 is a diagram related to another example of selecting a control target device using a hovering input in the multi-device environment of FIG. 70 .

In this example, a hovering area is set in the pointing device-integrated text input device 3000, and this hovering area 3020 matches a 3D space of virtual or augmented reality provided by an HMD or the like.

The pointing device-integrated text input device 3000 may calculate a hovering coordinate value according to a hovering input and transmit it to an HMD or an electronic device that controls the HMD. The electronic device may control the position of the pointer P in the 3D space using the hovering coordinate values.

Here, in a state where the pointer P is positioned at a position indicating one of a plurality of electronic devices 20 connectable to the pointing device-integrated text input device 3000, the pointing device-integrated text input device 3000 When a touch input or a pointer execution command for a touch area is received, the electronic device 20 corresponding to the corresponding location is selected as a control target device and can operate as an input interface for the control target device.

Meanwhile, a VR or AR providing device such as an HMD may provide a virtual graphic object on a virtual space or an augmented space.

In FIG. 76, the AR object 24 may be displayed by the HMD. In this state, when the virtual pointer (P') is moved to the position where the AR/VR object is located through the hovering input of the pointing device integrated text input device 3000 and a touch input is received, the pointing device integrated text input device 3000 may select an object indicated by the virtual pointer P' as a control target object.

The subsequent touch input or keyboard input may be used to move a cursor or pointer included in the object to be controlled or to transmit a keyboard input to the object to be controlled.

77 is a flowchart of an example of a multi-device control method of the pointing device-integrated text input device 3000.

Referring to FIG. 77 , the method includes obtaining a hovering input (S4110), calculating hovering coordinates (S4120), controlling a position of a virtual pointer in a 3D space according to the hovering coordinates (S4130), and hovering Upon completion, selecting a controlling device based on the location of the virtual pointer (S4140), acquiring a touch input (S4150), and controlling the location of the pointer on the screen of the controlling device according to the touch input (S4160) can include

Hereinafter, each step described above will be described in more detail.

The pointing device-integrated text input device 3000 may obtain a hovering input (S4110). At this time, when a capacitance change of the electrode 3130 occurs due to a user input, the controller 3500 may determine whether the user input is a touch input or a hovering input according to the capacitance change amount.

When the hovering input is acquired, the pointing device-integrated text input device 3000 may calculate hovering coordinates (S4120). Among the hovering coordinate values, the (x,y) coordinate values may be calculated similarly to the touch coordinate values. Also, among the hovering coordinate values, the z-coordinate value may be calculated based on the magnitude of change in capacitance. However, among the hovering coordinate values, the z coordinate value does not necessarily have to be calculated.

The pointing device-integrated text input device 3000 may control the position of the virtual pointer in the 3D space according to the hovering coordinates (S4130). Here, a plurality of devices may be disposed in the virtual space.

The pointing device-integrated text input device 3000 may select a controlling device based on the position of the virtual pointer when the hovering ends (S4130). Here, the end of hovering may mean a case where a touch input occurs or a case where a finger sufficiently moves away from the pointing device-integrated text input device 3000 so that a change in capacitance becomes less than or equal to a hovering threshold. However, selection of the controlling device may be a UI that is more in line with the user's intention if the selection is determined by a touch input.

When hovering ends in this way, the controller 3500 can select the device pointed by the virtual pointer at the end of hovering as the controlling device. When a device to be controlled is selected, the pointing device-integrated text input device 3000 may operate as an input interface for the device to be controlled.

Here, if hovering ends while the virtual pointer points to a VR/AR object, the pointing device-integrated text input device 3000 can also operate as an input interface for the object.

Thereafter, the pointing device-integrated text input device 3000 obtains touch input or keyboard input (S4140), and accordingly controls the position of the pointer on the screen of the controlling device or inputs text on the screen (S4150). .

The methods according to the embodiments of the present invention described above may be used alone or in combination with each other. Since each step described in the method according to the embodiment of the present invention is not essential, it is possible that each method includes all of the steps as well as some of them. In addition, since the order in which each step is described is only for convenience of explanation, the steps in the method described in the present invention do not necessarily have to be performed in the order in which they are described.

The above description is merely an example of the technical idea of the present invention, and various modifications and variations can be made to those skilled in the art without departing from the essential characteristics of the present invention. Accordingly, the embodiments of the present invention described above may be implemented separately or in combination.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed according to the claims below, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

3000: Pointing integrated text input device
3100: button
3110: Keycap
3120: button body
3130: Electrode
3200: switch
3300: electrical connection member
3400: circuit
3500: controller

Claims (8)

An electronic device having a complex human interface with a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment,
a keycap that receives a push input from a user in a vertical direction; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode that receives a gesture input including touch or hovering from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the length direction and the width direction; a plurality of buttons each including a plurality of buttons arranged according to the keyboard layout;
a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body;
A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the gesture input. an electrical connection member electrically connecting the electrode; and
A key value assigned to a button corresponding to a switch from which the key input was obtained is acquired, and when the change in capacitance is greater than a touch threshold, the gesture input is determined as a touch input, and the capacitance of the capacitance according to the touch input is determined. A touch coordinate value is calculated from the change, and a first signal instructing movement of a pointer on a screen of a control target, which is one of the plurality of output devices, is output based on the calculated touch coordinate value, and the capacitance change amount is calculated. If is less than the touch threshold and is greater than the hovering threshold, the gesture input is determined as a hovering input, a hovering coordinate value is calculated from the change in capacitance according to the hovering input, and based on the calculated hovering coordinate value A controller outputting a second signal instructing movement of the virtual pointer in virtual space, real space, or augmented space;
Electronics.
According to claim 1,
The controller sets the one output device as a control target when the touch input is obtained in a state where the virtual pointer according to the second signal is at a position corresponding to one of the output devices.
Electronics.
According to claim 1,
The multi-device environment further includes a virtual or augmented object,
The controller sets the object as a control target when the touch input is obtained in a state where the virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object.
Electronics.
According to claim 1,
The multi-device environment further includes an HMD that processes virtual reality or augmented reality,
The second signal indicates the position of the virtual pointer displayed by the HMD.
Electronics.

A control method of an electronic device having a complex human interface with a keyboard layout and used as an input interface for a plurality of output devices in a multi-device environment, comprising:
The electronic device may include a keycap that receives a push input in a vertical direction from a user; a button body coupled to a lower portion of the keycap and moved up and down by the push input; and a first block group formed by blocks interposed between the keycap and the button body and electrically connected in a first direction, which is one of a longitudinal direction and a width direction of the keyboard layout, and the keyboard layout. An electrode receiving a touch input from a user using a second block group formed by blocks electrically connected along a second direction different from the first direction among the longitudinal direction and the width direction; a plurality of buttons arranged according to the keyboard layout;
a plurality of switches arranged under the plurality of buttons according to the keyboard layout and acquiring key inputs according to the descent of the button body; and
A drive line for applying a drive signal for inducing capacitance to the electrode is formed by electrically connecting the first block group between buttons arranged along the first direction, and buttons arranged along the second direction. The second block group is electrically connected between the buttons to form a scan line for receiving a scan signal for detecting a change in capacitance induced in the electrode by the drive signal by the touch input. Including; an electrical connection member electrically connecting the electrode,
obtaining a key value assigned to a button corresponding to a switch from which the key input was acquired and outputting a keyboard input reflecting the key value;
determining that the gesture input is a touch input when the change in capacitance is greater than a touch threshold;
calculating a touch coordinate value from a change in capacitance according to the touch input;
outputting a first signal instructing movement of a pointer on a screen of a control target that is one of the plurality of output devices based on the calculated touch coordinate values;
determining that the gesture input is a hovering input when the change in capacitance is smaller than the touch threshold and larger than the hovering threshold; and
calculating a hovering coordinate value from a change in the capacitance according to the hovering input;
Outputting a second signal instructing movement of a virtual pointer in virtual space, real space, or augmented space based on the calculated hovering coordinate value;
How to control electronic devices.
According to claim 5,
obtaining the touch input in a state where the virtual pointer according to the second signal is at a position corresponding to one of the output devices; and
Setting the one output device as a control target; further comprising
How to control electronic devices.
According to claim 5,
The multi-device environment further includes a virtual or augmented object,
obtaining the touch input in a state where the virtual pointer according to the second signal is at a position corresponding to the virtual or augmented object; and
Right, setting the object as a control target; further comprising
How to control electronic devices.
According to claim 5,
The multi-device environment further includes an HMD that processes virtual reality or augmented reality,
The second signal indicates the position of the virtual pointer displayed by the HMD.
How to control electronic devices.

Images