WO2015194712A1

WO2015194712A1 - Computing apparatus and method for controlling same

Info

Publication number: WO2015194712A1
Application number: PCT/KR2014/010748
Authority: WO
Inventors: 윤재선; 박영준; 홍석현
Original assignee: 엘지전자 주식회사
Priority date: 2014-06-19
Filing date: 2014-11-10
Publication date: 2015-12-23

Abstract

Disclosed are a computing apparatus and a method for controlling the same. The computing apparatus according to an embodiment of the present invention comprises: a keyboard having a plurality of keys, at least some of which have touch sensors; a display unit; and a control unit, wherein the control unit at least recognizes, among the plurality of keys, a first finger touching a first key, a second finger touching a second key, and a third finger touching a third key, and controls the display unit so as to display an indicator in a first area on a screen on the basis of the recognition result, and wherein the first key is located on the left of the second key and the third key is located on the right of the second key on the keyboard, and the second key is located collinearly with at least one of the first key and the third key or located above the first key and the third key on the keyboard.

Description

Computing device and control method thereof

The present invention relates to a computing device and a control method thereof.

Portable computing devices, such as laptops or netbooks, are being developed in a way that emphasizes user convenience. In particular, in the case of a portable computing device, a portable computing device having a touch pad has also been generalized to improve the inconvenience of separately carrying an accessory input device such as a mouse. However, when the touch pad is provided, the size of the computing device is inevitably increased and there is a problem in that user convenience is limited because the user input through the touch is limited to the area of the touch pad.

It is an object of the present invention to solve the above and other problems.

An object of the present invention is to provide a computing device with a user convenience and a control method thereof by proposing a keyboard with a touch sensor.

Another object of the present invention is to provide a computing device capable of providing an intuitive user environment using a keyboard having a touch sensor and a control method thereof.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.

A computing device according to an embodiment of the present invention includes a keyboard including a plurality of keys and a touch sensor provided on at least one of the plurality of keys, a display unit, and a controller, wherein the controller is a preset condition Detect a first touch input of touching a first key in the keyboard, detect a screen output on the display unit when the first touch input is detected, and based on the detected screen, The display unit is controlled to execute a function corresponding to the first key and to output a result of the function execution.

According to an embodiment of the present disclosure, a method of controlling a computing device may include detecting a first touch input of touching a first key in a keyboard including a touch sensor according to a preset condition, and detecting the first touch. According to an input, the step of executing a function corresponding to the first key, and outputting a result of the execution of the function to the display, and the step of executing a function corresponding to the first key, Executing a specific program mapped to a first key, executing a specific file mapped to the first key, and executing a specific function mapped to the first key among functions that may be implemented in the computing device It may include any one of the steps.

In addition, the computing device according to an embodiment of the present invention includes a keyboard including a plurality of keys and a touch sensor provided on at least a portion of the plurality of keys, a display unit, and a control unit. Recognizing at least a first finger touching a first key, a second finger touching a second key, and a third finger touching a third key, wherein the first key is the second key on the keyboard. And the third key is located to the right of the second key, and the second key on the keyboard is on the same line as at least one of the first key and the third key, or the first key and The display unit is positioned above the third key and controls the display unit to display an indicator in the first area on the screen based on the recognition result.

According to an embodiment of the present invention, by providing a keyboard with a touch sensor, it is possible to provide a computing device with emphasis on user convenience and a control method thereof.

In addition, according to an embodiment of the present invention, it is possible to provide a computing device and a control method thereof that can provide an intuitive user environment using a keyboard having a touch sensor.

Further scope of the applicability of the present invention will become apparent from the following detailed description. However, various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, and therefore, specific embodiments, such as the detailed description and the preferred embodiments of the present invention, should be understood as given by way of example only.

1 is a block diagram of a computing device of the present invention.

2 illustrates an appearance of a computing device related to the present invention.

3 is a flowchart illustrating an example of a method of controlling a computing device according to an embodiment of the present invention.

4 is a diagram illustrating an example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present invention.

5 is a diagram illustrating an example of a database stored in a memory of a computing device according to an embodiment of the present invention.

FIG. 6 illustrates an example of a GUI that is output to a display unit of a computing device according to an embodiment of the present disclosure.

FIG. 7 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

FIG. 8 illustrates an example of a preset condition for sensing a first touch input in a computing device according to an embodiment of the present disclosure.

FIG. 9 is a diagram for describing another example of a preset condition for sensing a first touch input in a computing device according to an embodiment of the present disclosure.

FIG. 10 is a diagram for describing another example of a preset condition for sensing a first touch input in a computing device according to an embodiment of the present disclosure.

11 is a flowchart illustrating another example of a method for controlling a computing device according to an embodiment of the present invention.

FIG. 12 illustrates an example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

FIG. 13 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

14 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present invention.

FIG. 15 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

FIG. 16 illustrates another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

17 is a diagram for describing an example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present invention.

FIG. 18 is a diagram for describing an example that may appear after FIG. 17.

FIG. 19 illustrates another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

20 is a diagram for describing an example that may appear after FIG. 19.

FIG. 21 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure.

22 is a flowchart illustrating an example of a control method of a computing device according to an embodiment of the present invention.

23 is a diagram illustrating an example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

24 illustrates another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

25 is a diagram illustrating an example of a screen displayed on a display unit in a computing device according to an embodiment of the present invention.

FIG. 26 illustrates an example of a screen displayed on a display unit of a computing device according to an embodiment of the present disclosure.

27 illustrates another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

FIG. 28 is a diagram illustrating still another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

29 is a diagram illustrating still another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

30 is a flowchart for explaining another example of a control method of a computing device according to an exemplary embodiment.

FIG. 31 illustrates an example of a screen displayed on a display unit of a computing device according to an embodiment of the present disclosure.

32 is a diagram illustrating an example of a screen displayed on a display unit in a computing device according to an embodiment of the present invention.

33 is a flowchart illustrating still another example of a control method of a computing device according to an embodiment of the present invention.

34 is a diagram illustrating an example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

35 illustrates another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

36 is a diagram illustrating still another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

37 illustrates an example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

38 is a diagram illustrating an example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention.

39 is a flowchart illustrating still another example of a method for controlling a computing device according to an embodiment of the present invention.

40 is a diagram illustrating an example of a screen displayed on a display unit of a computing device according to one embodiment of the present invention.

FIG. 41 is a diagram illustrating another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention. FIG.

42 is a diagram illustrating an example of a screen displayed on a display unit of a computing device according to one embodiment of the present invention.

43 is a diagram illustrating an example of a screen displayed on a display unit in a computing device according to an embodiment of the present invention.

44 is a diagram illustrating an example of a screen displayed on a display unit in the computing device according to an embodiment of the present invention.

45 is a diagram illustrating an example of a screen displayed on a display unit in the computing device according to one embodiment of the present invention.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, and the same or similar components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other. In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, the accompanying drawings are intended to facilitate understanding of the embodiments disclosed herein, but are not limited to the technical spirit disclosed herein by the accompanying drawings, all changes included in the spirit and scope of the present invention. It should be understood to include equivalents and substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprises" or "having" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

The computing device described herein includes a desktop computer, a laptop computer, an ultrabook, a netbook, a tablet PC, a digital signage, and the like, and includes a display including a keyboard as a user input unit. It may mean a device.

1 is a block diagram of a computing device of the present invention.

The computing device 100 may include a communication unit 110, a user input unit 120, an external device interface unit 130, a sensing unit 140, an output unit 150, a memory 160, a power supply unit 170, and a control unit ( 180) and the like. However, the components shown in FIG. 1 are not essential to the implementation of the computing device, so that the computing device 100 having more or fewer components may be implemented.

More specifically, the communication unit 110 of the components, between the computing device 100 and a wired / wireless communication system, between the computing device 100 and another computing device, or between the computing device 100 and an external server. It may include one or more modules that enable communication between them. In addition, the communication unit 110 may include one or more modules that connect the computing device 100 to one or more networks.

The communication unit 110 may include at least one of the broadcast receiving unit 111, the network interface unit 112, and the mobile communication unit 113.

The broadcast receiving unit 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the computing device 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards (or broadcast methods, for example, ISO, IEC, DVB, ATSC, etc.) for transmitting and receiving digital broadcast signals, and the broadcast receiving unit 111 may The digital broadcast signal may be received using a method suitable for the technical standard set by the standards.

The broadcast associated information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, the broadcast related information may be received by the mobile communication unit 113.

The network interface unit 112 provides an interface for connecting the computing device 100 to a wired / wireless network including an internet network. The network interface unit 112 may be a concept including a local area communication unit that may communicate with another computing device 100, an external server, or an external device using local area networks.

The network interface unit 112 may include, for example, an Ethernet terminal for connection with a wired network, and for connection with a wireless network, for example, a wireless LAN (WLAN), a Wi-Fi network. (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, Digital Living Network Alliance (DLNA), Wireless Broadband (WiBro), World Interoperability for Microwave Access (WiMAX), High Speed Downlink Packet Access (HSDPA), HSUPA (High) Speed Uplink Packet Access (LTE), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Bluetooth ™ (Bluetooth ™), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra) Wideband, ZigBee, Near Field Communication (NFC), Wireless Universal Serial Bus (USB) communication standards, and the like may be used. The network interface unit 112 may transmit or receive data with another user or another electronic device through the connected network or another network linked to the connected network.

The mobile communication unit 113 may include technical standards or communication schemes for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), and EV-DO). (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSPA), Long Term Evolution (LTE), Long LTE-A (Long-A) Term Evolution-Advanced) and transmits and receives a wireless signal with at least one of a base station, an external terminal, a server. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

In view of the fact that the wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the network interface unit 112 for performing a wireless Internet access through the mobile communication network May be understood as a kind of mobile communication unit 113.

The user input unit 120 is for receiving information from a user. When information is input through the user input unit 120, the controller 180 may control an operation of the computing device 100 to correspond to the input information. .

The user input unit 120 may be a mechanical input means (or a mechanical key, eg, a button, a dome switch, a jog wheel, a jog switch, located at the front or rear or side of the computing device 100). Etc.) and touch input means.

The user input unit 120 may include a keyboard 121, and may further include at least one of the touch pad 122 and the mouse 123. In addition, although not shown, the user input unit 120 may include buttons, dome switches, jog wheels, jog switches, and the like located on the front and rear or side surfaces of the housing 124 of the computing device 100. It may further include a touch ball (touch ball) and the like. According to an embodiment, when a touch sensor is provided at a portion of the housing 124 surrounding the keyboard 121, the housing 124 may also be understood as a kind of the user input unit 120.

The keyboard 121 includes a plurality of keys, and a touch sensor is provided on at least some of the plurality of keys or all of the plurality of keys. The keyboard 121 may be configured in a form in which a plurality of keys are combined with each key protruding upward, similar to a keyboard in a general computing device. In this case, the keyboard 121 may receive a user input signal when the user presses each key by a predetermined degree or more, or may receive a user input signal when the user touches each key. In addition, the keyboard 121 may be configured to have a flat shape like the touch pad 122 without the plurality of keys protruding upward. In this case, the keyboard 121 may include a touch sensor on all of the plurality of keys, and may receive a user input signal when the user touches each key.

The touch pad 122 may include a touch sensor and may be disposed on one surface of the housing 124 facing the display unit 151. The mouse 123 may be connected to the computing device 100 through an external device interface unit 130, which will be described later. Since the touch pad 122 and the mouse 123 as the user input unit 120 are components well known to those skilled in the art, a detailed description thereof will be omitted.

The external device interface unit 130 is an interface that enables data communication between the external device and the computing device 100. The external device interface unit 130 may include a wired / wireless headset port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, and audio. It may include at least one of an input / output (I / O) port, a video input / output (I / O) port, and an earphone port. The external device interface unit 130 may be connected to an external device such as an external memory, an external computing device, a separate user input unit, an earphone, a camera, a game device, or the like by wire / wireless. The external device interface unit 130 transmits an image, audio, or data signal input from the outside to the controller 180 through a connected external device. In addition, the external device interface unit 130 may output a video, audio or data signal processed by the controller 180 to an external device.

The sensing unit 140 senses at least one of opening and closing information of a cover of the computing device, information in the computing device, surrounding environment information, and user information surrounding the computing device, and generates a sensing signal corresponding thereto. The controller 180 may control driving or operation of the computing device 100 or perform data processing, function, or operation related to an application program installed in the computing device 100 based on the sensing signal.

The output unit 150 is used to generate an output related to vision, hearing, and the like, and may include at least one of the display unit 151, the sound output unit 152, and the light output unit 153. According to an exemplary embodiment, the display unit 151 may form a layer structure or an integrated structure with the touch sensor, thereby implementing a touch screen. Such a touch screen may provide an output interface between the computing device 100 and the user while functioning as a user input unit 120 that provides an input interface between the computing device 100 and the user.

The display unit 151 may display an image signal, a data signal, a GUI signal, an image signal received from the communication unit 110 or the external device interface unit 130, R, G, and the like processed by the controller 180, respectively. The drive signal is generated by converting into a B signal. The display unit 151 may be a PDP, an LCD, an OLED, a flexible display, a 3D display, or the like.

The sound output unit 152 may include a signal processed by the controller 180, a voice signal received from the communication unit 110, a voice signal stored in the memory 160, and a voice signal received through the external device interface unit 130. You can output The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The memory 160 stores data supporting various functions of the computing device 100. The memory 160 may store a plurality of application programs or applications that are driven by the computing device 100, data for operating the mobile terminal 100, and instructions.

The memory 160 may be a flash memory type, a hard disk type, a solid state disk type, an SSD type, a silicon disk drive type, or a multimedia card micro type. ), Card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read It may include at least one type of storage medium of -only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk.

The power supply unit 170 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component. The power supply unit 170 may include a rechargeable battery.

The controller 180 controls operations related to application programs and the first half of the mobile terminal 100. The controller 180 may include a central processing unit (CPU) 181 and a main chipset 182.

The central processing unit 181 controls the overall operation of the computing device 100. The main chipset 182 performs a function similar to a chipset provided on a main board of a general computing device. More specifically, the main chipset 182 may mean a core controller chip that connects and controls each component. The main chipset 182 refers to a south bridge that controls peripheral devices such as a north bridge and an interface that controls memory and graphics, and each bridge may be implemented as a separate element or as a single element. It may be implemented as a module. In this case, the north bridge may perform a function of controlling a graphics processing unit (GPU) or a graphics card including the same, which is provided separately. Seen to be.

Referring to FIG. 2, the computing device 100 includes a display unit 151, a keyboard 121, and a housing 124. The housing 124 may be referred to as a case, and a portion surrounding the display unit 151 may be divided into a front case 124a and a portion surrounding the keyboard 121 facing the display unit 151 as a rear case 124b. have. In the present specification, for convenience of description, when referring to the housing 124 without distinguishing the front case 124a and the rear case 124b, it is assumed that it refers to the rear case 124b surrounding the keyboard 121. . According to an embodiment, the touch pad 122 may be provided on one surface of the housing 124 facing the display unit 151, but is not limited thereto.

According to an embodiment, the housing 124 may include a touch sensor. In this case, the touch sensor may be provided at one side of the housing 124 facing the display unit 151 and at the periphery of the keyboard 121.

In FIG. 2, the computing device 100 according to the present invention is illustrated in the form of a notebook computer having a touch pad 122, but this is merely an example, and includes another keyboard 121 having a touch sensor. Computing device 100 in a form also falls within the scope of the present invention.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition (S201). The first key is, among a plurality of keys provided on the keyboard 121, a letter key, a numeric key, or a special key (for example, "Ctrl key" and "Alt key as keys other than the letter key or numeric key). "," Esc key "," Shift key ", and the like.

The preset condition may be a condition of touching the first key for a preset time, a condition of touching the first key while touching a second key of the keyboard 121, and a second key of the keyboard 121. A condition of touching the first key in a state in which a pressure equal to or greater than a preset degree is applied, a condition of simultaneously touching the first key and a second key in the keyboard 121, and before touching the first key. 121) a condition of touching at least two keys in the keyboard, a second key located at the outermost side of the keyboard 121 before touching the first key, and the first key and the second key in the keyboard 121; It may be at least one of a condition of touching at least one key located between the keys, and a condition of touching the first key while touching the touch pad 122.

According to an embodiment, when detecting the first touch input, the controller 180 may also detect whether the keyboard 121 is set to a Korean input mode or an English input mode.

The controller 180 executes a function corresponding to the first key according to the first touch input (S202). The memory 160 may store in advance mapping data of a specific key and a predetermined function in the keyboard 121. Functions corresponding to specific keys in the keyboard 121 may be set at the time of manufacture of the computing device 100, may be set at the time of operating system or firmware update of the computing device 100, or the computing device 100 is in use. It may be set or changed by the user. When the first touch input is detected, the controller 180 may access the memory 160 to detect a function corresponding to the first key, and execute the detected function.

The controller 180 controls the display unit 151 to output a result of executing the function (S203). For example, the controller 180 may output an execution screen of a specific program to the display unit 151 or output a GUI including a result of executing the function to the display unit 151.

Hereinafter, a method of controlling the computing device 100 described with reference to FIG. 3 will be described in more detail with reference to FIGS. 4 to 10.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. In the present embodiment, it is assumed that the preset condition is a condition of touching the first key for a preset time. For example, when a user touches a letter key (“N key”) in the keyboard 121 for a predetermined time or more, the controller 180 may detect the first touch input.

When the first touch input is detected, the controller 180 may access the memory 160 and detect a function corresponding to the “N key”. The memory 160 may store in advance mapping data of a specific key and a predetermined function in the keyboard 121.

The memory 160 may store in advance mapping data of a specific key and a predetermined function in the keyboard 121. For example, a function corresponding to a specific key of the keyboard 121 means execution of a specific program mapped to the specific key, execution of a specific file mapped to the specific key, or a function that may be implemented in the computing device 100. It may be at least one of execution of a specific function mapped to the specific key among these.

For example, when a function corresponding to "N key" in the keyboard 121 is "Internet execution", the controller 180 detects a first touch input of touching the "N key" according to a preset condition. In this case, you can run a program for Internet use. According to an embodiment, when there are a plurality of programs for using the Internet in the memory 160, the controller 180 may execute a program having the highest number of times of use of the user among the various programs, or may be selected by a user. You can also run the program. As another example, when the function corresponding to the "W key" in the keyboard 121 is "execution of the document work program", the controller 180 touches the "W key" according to a preset condition. If an input is detected, you can run a program for working with documents. According to an embodiment, when there are a plurality of programs for working with documents in the memory 160, the controller 180 may execute a program having the highest number of times of use of the user among the various programs, or may be selected by a user. You can also run the program.

Although not shown, the function mapped to a specific key may vary depending on whether the input mode of the keyboard 121 is a Korean input mode or an English input mode. For example, the memory 160 maps and stores the "Internet execution" function on the "Q key" in the keyboard 121 and maps the "execution of a document work program" function to the "key" in the keyboard 121. Can be stored. Here, it is assumed that the "Q key" and the "ㅂ key" correspond to physically the same key in the keyboard 121. The controller 180 detects an input mode of the keyboard 121 when the first touch input is detected, and executes a document work program if the keyboard 121 is a Korean input mode, and if the keyboard 121 is an English input mode. You can run a program to use the Internet.

According to an embodiment, when the user selects a specific key selected for the help menu in the keyboard 121 or selects the help menu using the touch pad 122 or the mouse 123, the controller 180 may use the keyboard ( 121. The display unit 151 includes a GUI including a list of a specific key and corresponding functions (for example, execution of a specific program, execution of a specific file, or execution of a specific function that can be implemented in the computing device 100). You can also print

Referring back to FIG. 4, when a first touch input of touching the “N key” is detected according to a preset condition, the controller 180 may perform a function corresponding to the “N key” (for example, executing the Internet). ) And output the first screen 210, which is the result of the function execution, to the display unit 151. The first screen 210 may be an execution screen of a specific program selected from a program for use of the Internet stored in the memory 160 or selected by a user.

Meanwhile, according to the present invention, when the first touch input is detected, a GUI for confirming whether the function corresponding to the first key is executed may be output to the display unit 151 to check whether the user's intention is correct. . This will be described with reference to FIG. 6.

When a first touch input of touching a first key in the keyboard 121 is detected according to a preset condition, the controller 180 determines whether to execute a function corresponding to the first key. The display unit 151 may be controlled to output the display.

The GUI 220 may include information about a first key touched by a user according to a preset condition (for example, "N key"), information about a function corresponding to the first key (for example, "Internet execution") and a guide message asking whether to execute the function corresponding to the first key. This is to prevent a malfunction that is different from the intention of the user when the user unintentionally touches the first key.

When the confirmation menu 221 in the GUI 220 is selected, the controller 180 performs an Internet execution function as a function corresponding to the first key, and when the cancel menu 222 in the GUI 220 is selected. The GUI 220 may be removed from the display unit 151 without performing a function corresponding to the first key.

The user may select a desired menu by placing the icon I displayed on the display unit 151 on a desired menu (confirmation menu 221 or cancellation menu 222) in the GUI 220. For example, the user may input a position movement and menu selection command of the icon I using the mouse 123, or move the position and the menu of the icon I by touching the touch pad 122 by hand. The selection command may be input or the position movement of the icon I and the menu selection command may be input by touching the keyboard 121 or the housing 124 with the touch sensor by hand.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. In the present embodiment, it is assumed that the preset condition is a condition of touching the first key for a preset time. For example, when a user touches a letter key (“F key”) in the keyboard 121 for a predetermined time or more, the controller 180 may detect the first touch input.

When the first touch input is detected, the controller 180 may access the memory 160 and detect a function corresponding to the “F key”. The memory 160 may store in advance mapping data of a specific key and a predetermined function in the keyboard 121. An example of mapping data of a specific key and a predetermined function in the keyboard 121 stored in the memory 160 is similar to that described above with reference to FIG. 5, and thus a detailed description thereof will be omitted.

If a first touch input of touching the “F key” is detected according to a preset condition, the controller 180 executes a function corresponding to the “F key” (for example, system shutdown), and executes a function. The second screen 230 that is the result of the output may be output to the display unit 151. According to an embodiment, when a first touch input of touching the “F key” is detected according to a preset condition, the controller 180 includes a second screen 230 including a GUI 231 for terminating the system. After outputting a system shutdown command is input separately from the user through the GUI 231, the system may be terminated, or after outputting a second screen 230 including a GUI 231 for system shutdown After a time passes, the system may be automatically shut down, or the system may be immediately shut down without outputting the GUI 231 for shutting down the system.

In addition, according to an embodiment, as described above with reference to FIG. 6, before outputting the second screen 230 to the display unit 151, a GUI for checking whether to execute the function corresponding to the “F key”. May be output to the display unit 151.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. In the present exemplary embodiment, the preset condition is a condition in which the first key is touched while the second key in the keyboard 121 is touched or a state in which pressure or more than a preset degree is applied to the second key in the keyboard 121. It may be a condition of touching the first key in a state where the second key is pressed. For example, when a user touches a letter key (eg, “F key”) in the keyboard 121 while pressing or touching a special key (“Alt key”) in the keyboard 121, the controller may be used. 180 may detect the first touch input.

Alternatively, although not shown, in the present embodiment, the preset condition may be a condition of touching the first key while touching the touch pad 122. For example, when the user touches a letter key (eg, “F key”) in the keyboard 122 while touching a certain area in the touch pad 122, the controller 180 may control the first key. A touch input can be detected. In particular, in the case of a notebook computer having a touch pad 122, a portion of the user's hand using the keyboard 121 (particularly, the portion of the palm leading from the wrist) is placed on the touch pad 122 with the keyboard ( 121) may be common.

Since the example after the first touch input is detected is similar to that described above with reference to FIGS. 4 to 7, a detailed description thereof will be omitted.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. In the present exemplary embodiment, the preset condition may be a condition of touching at least two keys in the keyboard 121 before touching the first key. Here, the first key and the at least two keys may be continuously located in the keyboard 121. In one example, the first key and the at least two keys are located consecutively on a straight line (vertical line, horizontal line, or diagonal line) in the keyboard 121 or in any curved (structured or atypical) form on the keyboard 121. Can be positioned consecutively. According to an embodiment, the controller 180 may touch at least two keys consecutively positioned in the keyboard 122, and then a specific key adjacent to the last touched key among the at least two keys is greater than or equal to a preset level. When touched, the specific key may be recognized as the first key, and when at least three keys consecutively positioned in the keyboard 122 are touched, the last touched key among the at least three keys is touched. It can also be recognized as a key. For example, a user touches three consecutive letter keys (for example, "A key", "S key", and "D key") in the keyboard 121, and then touches the "D key". When a letter key (for example, "F key") is touched, the controller 180 can detect the first touch input.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. In the present exemplary embodiment, the preset condition means a second key located at the outermost side of the keyboard 121 before touching the first key and between the first key and the second key in the keyboard 121. It may be a condition of touching at least one key located at. Here, the first key, the at least one key, and the second key may be continuously located in the keyboard 121.

Alternatively, in the present embodiment, the preset condition is a housing 124 including a touch sensor and at least one positioned between the housing 124 and the first key before touching the first key. It may be a condition of touching a key. Here, the housing 124 may be a portion surrounding the keyboard 121 facing the display unit 151 and having a touch sensor. In addition, the at least one key located between the housing 124 and the first key may include a key located at the outermost portion of the keyboard 121. In addition, at least one key and the first key positioned between the housing 124 and the first key may be continuously located in the keyboard 121.

Alternatively, in the present embodiment, the preset condition may be a condition of touching the first key while touching the housing 124.

For example, when a user touches a letter key (eg, “F key”) in the keyboard 121 by dragging a hand while touching a region of the housing 124 surrounding the keyboard 121, The controller 180 can detect the first touch input.

Meanwhile, according to the present invention, based on the screen output to the display unit 151 when the first touch input is detected, even if the same first touch input is detected, the function executed by the controller 180 may vary. This will be described with reference to FIGS. 11 to 21.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition (S301). The first key may be a letter key, numeric key or special key (for example, Ctrl key, Alt key, Esc key, etc.) among a plurality of keys provided in the keyboard 121.

The controller 180 detects the screen output on the display unit 151 when the first touch input is detected (S302). When the first touch input is detected, the screen output to the display unit 151 may be a screen corresponding to a specific program that is being executed when the first touch input is detected, or when the first touch input is detected. If there is no specific program running, it may be the desktop (or home screen). Here, the specific program may mean a program created for the purpose of solving a specific task, unlike a basic software program such as an operating system (OS) or a utility program. According to an embodiment, even if there is a specific program running when the first touch input is detected, if the execution screen of the specific program is minimized, a background screen (or a home screen) is displayed when the first touch input is detected. The screen may be output to the unit 151.

According to an embodiment, when there are a plurality of specific programs being executed when the first touch input is detected, the screens displayed on the display unit 151 when the first touch input is detected are the plurality of specific programs. May be an execution screen of a specific program displayed on a main area of the screen of the display unit 151 without being minimized. Here, the main area of the screen of the display unit 151 refers to an area excluding a task bar for displaying the current state of the computing device 100 and information about a running program. According to an embodiment, when there are a plurality of execution screens of a specific program displayed on the main area of the screen of the display unit 151 without being minimized among the execution screens of the plurality of specific programs, the first touch input is detected. When the screen output to the display unit 151 is not minimized, the specific program executed first, the last program executed most, among the execution screens of the specific program displayed on the main area of the screen of the display unit 151. It may be an execution screen of a specific program satisfying a set condition or a specific program selected by a user.

The controller 180 executes a function corresponding to the first key based on the detected screen (S303). The memory 160 may store in advance mapping data of a specific key and a predetermined function in the keyboard 121.

For example, a function corresponding to the first key may include a file and a program stored in the memory 160 of the computing device 100 and the computing device 100 when the first key corresponds to a specific character. Among functions that may be searched, at least one of a file name, a program name, and a function name starting with the specific character may be searched, and the search function may be based on the detected screen. For example, when the detected screen is an execution screen of a program for a document task, the controller 180 is a file name, a program name, and a function name starting with the specific character as related to the program for the document task. At least one of the can be searched. According to an embodiment, when the input mode of the keyboard 121 is set to the Hangul input mode and the first key corresponds to a specific consonant of the Korean language, the controller 180 may start a file name or a program starting with the specific consonant. At least one of a name and a function name can be searched, and if the input mode of the keyboard 121 is set to the English input mode, among the file name, program name, and function name starting with an alphabet corresponding to the first key, You can search for at least one.

In another example, the function corresponding to the first key is an output of a GUI for controlling a specific function related to a specific program corresponding to the detected screen or a specific function related to the specific program corresponding to the detected screen. Can be the execution of.

In another example, the function corresponding to the first key means that the first key corresponds to a special key (for example, a "Ctrl key", an "Alt key", or a "Shift key"). It may be a function of detecting a list of shortcut keys including the first key from a list of shortcut keys related to a function of a specific program corresponding to the displayed screen. Here, the shortcut key may mean at least two keys in the keyboard 121 when at least two keys in the keyboard 121 are set to be executed in advance when a specific function of the specific program is executed. The memory 160 may store a list of shortcut keys related to the function of the specific program in advance.

The controller 180 controls the display unit 151 to output a result of executing the function (S304). For example, the controller 180 may output a GUI including a result of executing the function to the display unit 151.

Hereinafter, a method of controlling the computing device 100 described with reference to FIG. 11 will be described in more detail with reference to FIGS. 12 to 21.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. The preset condition may be a condition of touching the first key for a preset time, a condition of touching the first key while touching a second key of the keyboard 121, and a second key of the keyboard 121. A condition of touching the first key in a state in which a pressure equal to or greater than a preset degree is applied, a condition of simultaneously touching the first key and a second key in the keyboard 121, and before touching the first key. 121) a condition of touching at least two keys in the keyboard, a second key located at the outermost side of the keyboard 121 before touching the first key, and the first key and the second key in the keyboard 121; It may be at least one of a condition of touching at least one key located between the keys, and a condition of touching the first key while touching the touch pad 122. Since the preset condition is similar to that described above with reference to FIGS. 4 and 7 to 10, a detailed description thereof will be omitted. In the present embodiment, it is assumed that the first key is a character key corresponding to a specific character.

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present embodiment, it is assumed that the detected screen is a background screen (or a home screen).

The controller 180 executes a function corresponding to the first key based on the detected screen. That is, the controller 180 based on the detected screen, the specific character from among files and programs stored in the memory 160 of the computing device 100 and functions that may be implemented in the computing device 100. At least one of a file name, a program name, and a function name beginning with the search may be searched. When the detected screen is a background screen, a file name, a program name, and a function name starting with the specific character to be searched may not be related to each other. According to an exemplary embodiment, the controller 180 may search for a file name, a program name, and a function name starting with an alphabet corresponding to the first key, regardless of the input mode of the keyboard 121, or the keyboard 121. If the input mode of is set to the Hangul input mode and the first key corresponds to a specific consonant of the Hangul, at least one of a file name, a program name, and a function name starting with the specific consonant is searched and the keyboard 121 When the input mode is set to the English input mode, at least one of a file name, a program name, and a function name starting with an alphabet corresponding to the first key may be searched for.

According to an embodiment, the controller 180 may include a file name, a program name, and a function having a history used recently (within a preset period from the present) among the file name, program name, and function name starting with the specific character. You can also search for people.

The controller 180 controls the display unit 151 to output the first GUI 310 including the result of the function execution. For example, the controller 180 may control the display unit 151 to separately output the search result by file, program, and function in the first GUI 310. In another example, the controller 180 outputs the search results separately by file, program, and function in the first GUI 310, but includes a file name, a program name, and a function name having a most recently used history. The display unit 151 may be controlled to output in order. In another example, the controller 180 outputs the search results by file, program, and function in the first GUI 310, and the history used in the recent (within a predetermined period from the present) is displayed. The display unit 151 may be controlled to separately output a file name, a program name, and a function name.

The user may select a desired menu from among a file name, a program name, and a function name included in the first GUI 310 to execute the file, the program, or the function. For example, the user may input a position movement and menu selection command of the icon I using the mouse 123, or move the position and the menu of the icon I by touching the touch pad 122 by hand. The selection command may be input or the position movement of the icon I and the menu selection command may be input by touching the keyboard 121 or the housing 124 with the touch sensor by hand.

FIG. 13 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure. The content overlapping with FIG. 12 will not be described again, and the following description will focus on differences.

The controller 180 may control the display unit 151 to output a thumbnail image 311 corresponding to at least some of the searched file names on the first GUI 310. For example, when a file name corresponding to an image file or a video file exists among the searched file names, the controller 180 displays a thumbnail image 311 corresponding to each of the corresponding file names on the first GUI 310. Can be displayed. The thumbnail image 311 may be located in parallel with the corresponding file name in the first GUI 310. When the searched file name is a video file, the thumbnail image 311 may be a reduced size of the representative image representing the video file.

14 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present invention. 12 and 13 will not be described again, and the following description will focus on differences.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. Since the preset condition is similar to that described above with reference to FIGS. 4 and 7 to 10, a detailed description thereof will be omitted. In the present embodiment, it is assumed that the first key is a character key corresponding to a specific character.

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present embodiment, the detected screen is an execution screen of a playback program for listening to a video or music, and when the first touch input is detected, the display unit 151 displays a first screen which is an execution screen of the playback program. Assume 320 is displayed.

The controller 180 executes a function corresponding to the first key based on the detected screen. That is, the controller 180 based on the detected screen, the specific character from among files and programs stored in the memory 160 of the computing device 100 and functions that may be implemented in the computing device 100. At least one of a file name, a program name, and a function name beginning with the search may be searched. According to an embodiment, the controller 180 may include a file name, a program name, and a function having a history used recently (within a preset period from the present) among the file name, program name, and function name starting with the specific character. You can also search for people.

In addition, the controller 180 may search only the file name, program name and function name starting with the specific character related to the playback program, and may search for all of the file name, program name and function name starting with the specific character. When searching, but outputting the search results to the display unit 151, the one related to the playback program may be displayed first.

The controller 180 controls the display unit 151 to output the first GUI 310 including the result of the function execution. The first GUI 310 may be displayed on the first screen 320 which is an execution screen of the playback program. The controller 180 may display only the file name, program name, and function name related to the playback program in the first GUI 310 among the file name, program name, and function name starting with the specific character. A name, a program name, and a function name are all displayed on the first GUI 310, but a file name, a program name, and a function name related to the playback program may be displayed on the first GUI 310 first. Here, a file name, a program name, and a function name associated with the playback program are a file name that can be played back with the playback program, a file name with a history played through the playback program, a program name that can be linked with the playback program, and the playback. The name of a program having a transmission history of a file playable through a program, a function name associated with functions of the play program, and the like.

FIG. 15 is a diagram for describing another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure. 12 and 14 will not be described again, and the following description will focus on differences.

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present exemplary embodiment, the detected screen is an execution screen of a document work program for a document work, and when the first touch input is detected, the display unit 151 displays a second screen (executed screen of the document work program). Assume 330 is displayed.

The controller 180 executes a function corresponding to the first key based on the detected screen. That is, the controller 180 based on the detected screen, the specific character from among files and programs stored in the memory 160 of the computing device 100 and functions that may be implemented in the computing device 100. At least one of a file name, a program name, and a function name beginning with the search may be searched.

In addition, the controller 180 may search only a file name, a program name, and a function name beginning with the specific character and related to the document work program, and may search for a file name, program name, and function name beginning with the specific character. When all of the documents are searched, the information related to the document work program may be preferentially displayed when the search results are output to the display unit 151.

The controller 180 controls the display unit 151 to output the first GUI 310 including the result of the function execution. The first GUI 310 may be displayed on the second screen 330 which is an execution screen of the document work program. The controller 180 may display only the file name, program name, and function name related to the document work program among the file name, program name, and function name starting with the specific character to be displayed on the first GUI 310. A file name, a program name, and a function name are all displayed on the first GUI 310, but a file name, a program name, and a function name related to the document work program may be preferentially displayed on the first GUI 310. Here, a file name, a program name, and a function name associated with the document work program may include a file name of a document worked using the document work program, a file name of a document that can be viewed through the document work program, and the document work program. It may be a program name that can be linked, a program name having a transmission history of a document file viewable through the document work program, a function name associated with functions of the document work program, and the like.

FIG. 16 illustrates another example of a screen output to a display unit according to a first touch input in a computing device according to an embodiment of the present disclosure. The contents overlapping with those of FIGS. 12 to 15 will not be described again, and the following description will focus on differences.

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present embodiment, the detected screen is an execution screen of a web service program for using the Internet, and when the first touch input is detected, the display unit 151 displays a third screen which is an execution screen of the web service program. Assume 340 is displayed.

The controller 180 executes a function corresponding to the first key based on the detected screen. That is, the controller 180 is based on the detected screen, among the file name, program name, web page name, URL address, and functions that can be implemented in the computing device 100 associated with the web service program. At least one of a file name, a program name, a web page name, a URL address, and a function name starting with the specific character may be searched. In addition, according to an embodiment, the controller 180 may have a history used recently (within a preset period from the present) among file names, program names, web page names, URL addresses, and function names starting with the specific character. You can also search for file names, program names, web page names, URL addresses, and function names. For example, the controller 180 may include a file name downloaded through the web service program, a program name downloaded through the web service program, a program name interoperable with the web service program, and a visited through the web service program. Web page name with history, URL address with history visited through the web service program, Web page name or URL address added by user to the web service program as a favorite, functions related to the functions of the web service program Persons and the like.

In addition, according to an embodiment, the controller 180 may store a history of a file name, a program name, a web page name, a URL address, and a function name that have been used recently (within a predetermined period from the present) of the file name beginning with the specific character. You can also search for names, program names, web page names, URL addresses, and function names.

The controller 180 controls the display unit 151 to output the first GUI 310 including the result of the function execution. The first GUI 310 may be displayed on the third screen 340 which is an execution screen of the web service program.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. Since the preset condition is similar to that described above with reference to FIGS. 4 and 7 to 10, a detailed description thereof will be omitted. In this embodiment, it is assumed that the first key is a space bar.

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present embodiment, the detected screen is an execution screen of a playback program for listening to a video or music, and when the first touch input is detected, the display unit 151 plays the specific video file being played through the playback program. Assume that a fourth screen 350 associated with is displayed.

The controller 180 executes a function corresponding to the first key based on the detected screen. The function corresponding to the first key may be an output of a GUI for controlling a specific function related to the playback program or execution of a specific function related to the playback program. For example, the controller 180 controls the display unit 151 to output a second GUI 360 for controlling a play related function of the play program based on the detected screen, and accordingly, The second GUI 360 is displayed on the display unit 151. The second GUI 360 may be displayed on the fourth screen 350 which is an execution screen of the playback program.

The second GUI 360 may include a progress bar 361a for adjusting a playback point of the specific file, an indicator 361b indicating a playback point of the specific file on the progress bar 361a, and the specific file. A playback menu 362 for selecting whether or not to play back, a pause menu 363 for selecting to stop playing the specific file, and a previous file for selecting playback of a file immediately preceding the specific file in a playlist The play menu 364 and the next file play menu 365 for selecting a play of the file immediately following the specific file in the play list may be included.

FIG. 18 is a diagram for describing an example that may appear after FIG. 17.

When the second GUI 360 including the progress bar 361a and the indicator 361b is output to the display unit 151, the controller 180 touches the first key in the keyboard 121. A second touch input of dragging left or right may be sensed.

The controller 180 may control the display unit 151 to move the indicator 361b to the left or right on the progress bar 361a according to the second touch input. The display unit 151 may output a playback screen corresponding to the position of the indicator 361b moved on the progress bar 361a according to the second touch input. In this way, the user can select a playback point of the specific program by taking an intuitive operation of touching the long space bar from side to side in the horizontal direction, thereby enhancing user convenience.

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present embodiment, the detected screen is an execution screen of a web service program for using the Internet, and when the first touch input is detected, the display unit 151 displays a fifth screen which is an execution screen of the web service program. Assume 370 is displayed.

The controller 180 executes a function corresponding to the first key based on the detected screen. The function corresponding to the first key may be an output of a GUI for controlling a specific function related to the web service program or execution of a specific function related to the web service program. For example, the controller 180 may output a third GUI 380 including images corresponding to a web page having a history of access through the web service program based on the detected screen. 151 is controlled, and accordingly, the third GUI 380 is displayed on the display unit 151. The third GUI 380 may be displayed on the fifth screen 370 which is an execution screen of the web service program.

The third GUI 380 includes images 381 corresponding to a web page having a history of access through the web service program within a preset period from the present. In some cases, when the images 381 are difficult to be output to the display unit 151 at one time, an arrow 382 indicating that there are more images to be included in the third GUI 380 is displayed in the third GUI 380. It may be included in the output. For example, when the third GUI 380 includes three

images

381a, 381b, and 381c, the rightmost image 381c may correspond to the most recently visited web page. According to an exemplary embodiment, when the third GUI 380 is output to the display unit 151, the indicator 383 may be displayed to indicate an image 381c corresponding to the most recently visited web page. For example, the indicator 383 may be in the form of highlighting the edge of the image 381c.

20 is a diagram for describing an example that may appear after FIG. 19.

When the third GUI 380 is output to the display unit 151, the controller 180 may detect a second touch input of dragging left or right while touching the first key in the keyboard 121. have.

For example, when the second touch input of dragging to the left while detecting the first key in the keyboard 121 is detected, the controller 180 is an image adjacent to the image 381c to the left of the image 381c. The display unit 151 may be controlled to indicate 381b. Thereafter, when the second touch input of dragging the right side while touching the first key in the keyboard 121 is detected, the controller 180 is an image adjacent to the image 381b to the right. The display unit 151 may be controlled to point 381c again. In this way, the user can browse the web pages with the recently accessed history by taking an intuitive operation of touching the long space bar from side to side in the horizontal direction, thereby enhancing user convenience.

According to an embodiment, when the user selects any image 381 in the third GUI 380 or any image 381 indicated by the indicator 383, the web corresponding to the selected image 381 is selected. The screen of the page may be output to the display unit 151.

The controller 180 detects a first touch input of touching a first key in the keyboard 121 according to a preset condition. Since the preset condition is similar to that described above with reference to FIGS. 4 and 7 to 10, a detailed description thereof will be omitted. In the present embodiment, it is assumed that the first key is a "Ctrl key" of a special key (for example, "Ctrl key", "Alt key", "Shift key", etc.).

The controller 180 detects a screen output on the display unit 151 when the first touch input is detected. In the present embodiment, the detected screen is an execution screen of a document work program for a document work, and when the first touch input is detected, the display unit 151 displays a sixth screen (executed screen of the document work program). Assume that the screen is displayed.

The controller 180 executes a function corresponding to the first key based on the detected screen. That is, the controller 180 may detect a list of shortcut keys including the first key from a list of shortcut keys associated with a function of a document work program corresponding to the detected screen, based on the detected screen. Can be. Here, the shortcut key may mean at least two keys in the keyboard 121 when at least two keys in the keyboard 121 are set to be executed in advance when a specific function of the specific program is executed. The memory 160 may store a list of shortcut keys related to the function of the specific program in advance.

The controller 180 may output the fourth GUI 391 including the result of executing the function to the display unit 151. The fourth GUI 391 may be displayed on the sixth screen 390 which is an execution screen of the document work program.

According to an embodiment of the present invention, the user may use the keyboard 121 provided with the touch sensor as a mouse. This will be described with reference to FIGS. 22 to 29.

The controller 180 may include a first finger touching a first key, a second finger touching a second key, and a third finger touching a third key among a plurality of keys included in the keyboard 121. At least it is recognized (S401). The user may be in a position to put his hand on the keyboard 121 similar to using the mouse 123.

On the keyboard 121, the first key is located to the left of the second key, and the third key is located to the right of the second key. In addition, the second key on the keyboard 121 may be located on the same line as at least one of the first key and the third key, or may be positioned above the first key and the third key. Among the plurality of keys included in 121, a touch input may be positioned at the top of the detected keys. In addition, the first key and the third key on the keyboard 121 may be located adjacent to the second key, respectively. Here, the meaning that two keys are adjacent to each other on the keyboard 121 may mean that the two keys are adjacent to each other in a straight line, diagonal line, or diagonal line on the keyboard 121. The first to third fingers correspond to the fingers of a user who uses the keyboard 121. According to an embodiment, when one finger touches two adjacent keys simultaneously, at least one of the first key, the second key, and the third key may mean two adjacent keys.

The controller 180 recognizes a first finger touching the first key and touches the second key when a touch input of touching the first key, the second key, and the third key is detected. A second finger may be recognized and a third finger touching the third key may be recognized. The controller 180 may detect a touch input even with keys other than the first to third keys, but recognition of the first to third fingers may be performed only through the first to third keys.

The controller 180 controls the display unit 151 to display the first indicator in the first area on the screen based on the recognition result of the first finger, the second finger, and the third finger (S402).

The memory 160 may include first coordinate value data related to at least a partial area on the keyboard 121, second coordinate value data related to an entire area of the screen of the display unit 151, and the first coordinate value data and the first coordinate value data. 2 may store mapping data of coordinate data.

The first indicator may be displayed on the preset first area on the screen of the display unit 151 when the first finger, the second finger and the third finger are recognized, and the first key and the second indicator on the keyboard 121. The display apparatus may be displayed on the first area of the screen of the display unit 151 based on the first coordinate value data associated with at least one of the key and the third key and the mapping data.

The controller 180 recognizes dragging of the first finger, the second pigger, and the third finger on the keyboard 121 (S403). For example, the controller 180 detects a touch input on a first key, simultaneously detects a touch input on a first key and a key adjacent to the first key, and detects a touch input on a key adjacent to the first key. In this case, dragging of the first finger may be recognized. Similarly, the controller 180 can recognize dragging of the second finger and the third finger. The memory 160 may previously store a program or an application necessary for recognizing dragging of the finger.

The controller 180 calculates a change amount of first coordinate value data associated with at least one of the first finger, the second finger, and the third finger by the dragging (S404). For example, the controller 180 may include first coordinate value data, a first finger, a second finger, and a first coordinate value data of the first finger on the keyboard 121 before dragging the first finger, the second finger, and the third finger. After dragging the three fingers, the change amount of the first coordinate value data associated with the first finger may be calculated using the first coordinate value data of the first finger on the keyboard 121.

The controller 180 may control the display unit 151 to move and display the first indicator from the first area to the second area on the screen based on the calculated change amount (S405). For example, the controller 180 may display the first indicator on the screen in the first area based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount. The display unit 151 may be controlled to move to the second area. Alternatively, the controller 180 may move the first indicator from the first area to the second area on the screen based on the dragging direction of the first finger, the second finger, and the third finger and the calculated change amount. The display unit 151 may be controlled.

Referring to FIG. 23A, the controller 180 may include a first finger touching a first key, a second finger touching a second key, and a third key among a plurality of keys included in the keyboard 121. Recognize at least the third finger that touches.

Referring to FIG. 23B, which shows an enlarged view of the keyboard 121 in which a touch input is received, the controller 180 recognizes a first finger that touches the “T key”, which is the first key, and recognizes the second key. A second finger touching "Y key" and "U key" may be recognized, and a third finger touching "J key" which is a third key may be recognized. Since the second finger is touching two adjacent keys, the second key may correspond to the two adjacent keys "Y key" and "U key". The controller 180 may include keys other than the first key, the second key, and the third key (for example, “T key”, “Y key”, “U key”, and “J key”), and the touch pad 122. ) And / or the touch input may be sensed through the housing 124, but the touch input detected at a portion other than the first key, the second key, and the third key satisfying the conditions described above with reference to FIG. 22 is ignored. (ignore)

When the first finger, the second finger, and the third finger are recognized, the controller 180 outputs the first indicator I1 similarly to the case where there is a user input by the mouse 123. ) Can be controlled. The first indicator I1 may be displayed on the preset first area on the screen. For example, the first area may be a center area on the screen of the display unit 151.

The controller 180 recognizes at least a first finger touching a first key, a second finger touching a second key, and a third finger touching a third key among a plurality of keys included in the keyboard 121, The display unit 151 is controlled to display the first indicator I1 in the first area on the screen based on the recognition result.

The controller 180 detects first coordinate value data associated with at least one of a first key, a second key, and a third key on the keyboard 121, and detects the first coordinate value data and the memory 160. The display unit 151 may be controlled to display the first indicator I1 in the first area on the screen based on the stored mapping data of the first coordinate value data and the second coordinate value data. The first area may be an area corresponding to the second coordinate value data on the screen of the display unit 151 mapped to the detected first coordinate value data on the keyboard 121. That is, when the user places his hand in the upper left area of the keyboard 121, the first indicator I1 may be displayed in the upper left area on the screen of the display unit 151.

According to the exemplary embodiment of the present invention, when the user moves the hand on the keyboard 121, the first indicator I1 on the screen of the display unit 151 may be moved accordingly. This will be described with reference to FIG. 25.

Referring to FIG. 25A, the controller 180 may include a first finger touching a first key, a second finger touching a second key, and a third key among a plurality of keys included in the keyboard 121. The display unit 151 is controlled to recognize at least the third finger touching and display the first indicator I1 in the first area on the screen based on the recognition result.

The controller 180 recognizes dragging of the first finger, the second pigger, and the third finger on the keyboard 121, and based on the recognition result, the first controller as shown in FIG. 25B. The display unit 151 may be controlled to move the indicator I1 from the first area on the screen to the second area.

The controller 180 may calculate a change amount of first coordinate value data associated with at least one of the first finger, the second finger, and the third finger by the dragging. The amount of change in the first coordinate value data of each of the at least two fingers of the first, second and third fingers may be the same as or different from each other. For example, the controller 180 may include first coordinate value data, a first finger, a second finger, and a first coordinate value data of the first finger on the keyboard 121 before dragging the first finger, the second finger, and the third finger. After dragging the three fingers, the change amount of the first coordinate value data associated with the first finger may be calculated using the first coordinate value data of the first finger on the keyboard 121.

The controller 180 may display the first indicator I1 on the screen in the first area based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount. The display unit 151 may be controlled to move to two areas. Alternatively, the controller 180 may move the first indicator I1 from the first area to the second area on the screen based on the dragging direction of the first finger, the second finger, and the third finger and the calculated change amount. The display unit 151 may be controlled to move.

For example, the distance that the finger, which is the target of the change amount of the first coordinate value data, moved on the keyboard 121 is changed from the first area on the screen of the display unit 151 to the second area by the first indicator I1. It may be shorter than the distance traveled.

Meanwhile, according to an exemplary embodiment of the present invention, the user may input a predetermined user command by tapping the keyboard 121 with the index finger while the hand is positioned on the keyboard 121. This will be described with reference to FIGS. 26 to 29. 26 to 29 show recognition of the finger and display of the first indicator I1 as described above with reference to FIGS. 23 and 24, and dragging recognition and the first indicator of the finger as described above with reference to FIG. 25. It may be an example after the movement of. Also, as an example, FIGS. 26 and 27 show examples similar to when the left button of the mouse 123 is clicked, and FIGS. 28 and 29 show examples similar to when the right button of the mouse 123 is clicked. It is shown.

The controller 180 may include a first finger on the keyboard 121 in a first area on the keyboard 121 where the first finger is positioned by dragging the first, second, and third fingers. A first touch input of tapping an area once is detected. In addition, the controller 180 may display the screen on the screen of the display unit 151 on which the first indicator I1 is located by dragging the first finger, the second finger, and the third finger according to the detected first touch input. The specific function corresponding to the second area may be executed. For example, the execution of a specific function means that an execution screen of a specific program is displayed on an area of the screen of the display unit 151 except for a task bar, and the first indicator I1 is displayed on the execution screen of the specific program. When located on a menu option may mean execution of the specific function, or when the first indicator I1 is located on a menu option of a specific function included in the task bar area on the screen of the display unit 151. It may mean execution of the specific function, or when the first indicator I1 is located on a menu icon corresponding to a specific file displayed on the desktop of the display unit 151, it may mean a function of highlighting the menu icon. It may be.

For example, referring to FIG. 26A, the user moves his hand on the keyboard 121 to place the first indicator I1 at the “Start” menu option 211 on the desktop 410. The keyboard 121 can be tapped once with the index finger (first finger). The controller 180 may include a first finger on the keyboard 121 in a first area on the keyboard 121 where the first finger is positioned by dragging the first, second, and third fingers. A first touch input of tapping an area once is detected.

And, as shown in (b) of FIG. 26, on the desktop 410 of the display unit 151 on which the first indicator (I1) is located by dragging the first finger, the second finger and the third finger. A function corresponding to the "start" menu option 411 may be executed. The controller 180 may control the display unit 151 to display the GUI 412 that is a result of executing the function corresponding to the “start” menu option 411.

The controller 180 may include a first finger on the keyboard 121 in a first area on the keyboard 121 where the first finger is positioned by dragging the first, second, and third fingers. A second touch input of tapping the area twice within a preset time is sensed. In addition, the controller 180 may display a screen on the screen of the display unit 151 in which the first indicator I1 is located by dragging the first finger, the second finger, and the third finger according to the detected second touch input. The specific function corresponding to the second area may be executed. For example, execution of a specific function may mean execution of the specific file when the first indicator I1 is located on a specific file displayed on the desktop of the display unit 151, or the execution of the display unit 151. When the execution screen of the document work program is displayed in an area except the task bar on the screen and the first indicator I1 is located on the text included in the execution screen of the document work program, the first indicator I1 is positioned. This may mean a function of highlighting a part of the text.

For example, referring to FIG. 27A, the user moves his or her hand on the keyboard 121 to position the first indicator I1 on the menu icon 421 corresponding to a specific file on the desktop 410. After tapping, the keyboard 121 can be quickly tapped twice with the index finger (first finger). The controller 180 may include a first finger on the keyboard 121 in a first area on the keyboard 121 where the first finger is positioned by dragging the first, second, and third fingers. A second touch input of tapping the area twice within a preset time is sensed.

And, as shown in (b) of FIG. 27, on the desktop 410 of the display unit 151 on which the first indicator (I1) is located by dragging the first, second and third fingers. The specific file corresponding to the menu icon 421 may be executed. The controller 180 may control the display unit 151 to display the screen 422 corresponding to the execution result of the specific file.

The controller 180 may include a second finger on the keyboard 121 in a second area on the keyboard 121 where the second finger is located by dragging the first finger, the second finger, and the third finger. A third touch input of tapping the area once is detected. The controller 180 may detect a screen output on the display unit 151 when the third touch input is detected, and execute a specific function corresponding to the third touch input based on the detected screen. For example, execution of a specific function may mean an output of a GUI including a list of functions related to the desktop when the first indicator I1 is located in an empty space of the desktop of the display unit 151, When the first indicator I1 is located on a specific file displayed on the desktop of the display unit 151, the first indicator I1 may mean an output of a GUI including a list of functions related to the specific file. When an execution screen of a specific program is displayed in an area except the task bar on the screen and the first indicator I1 is located on the execution screen of the specific program, it means an output of a GUI including a list of functions related to the specific program. You may.

For example, referring to FIG. 28A, the user moves his hand on the keyboard 121 to place the first indicator I1 in an empty space of the desktop 410 and then stops (second finger). Can tap the keyboard 121 once. The controller 180 may include a second finger on the keyboard 121 in a second area on the keyboard 121 where the second finger is located by dragging the first finger, the second finger, and the third finger. A third touch input of tapping the area once is detected.

When the third touch input is detected, the controller 180 detects that the screen output on the display unit 151 is the desktop screen 410, and as shown in FIG. 28B, the first finger And a list of functions related to the desktop 410 in an empty space of the desktop 410 of the display unit 151 where the first indicator I1 is located by dragging the second finger and the third finger. The display unit 151 may be controlled to output the GUI 431.

29 is a diagram illustrating still another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention. Contents overlapping with those described above with reference to FIG. 28 will not be described again.

Referring to FIG. 29A, the user moves his or her hand on the keyboard 121 to place the first indicator I1 in a predetermined area on the screen of the display unit 151 and then with the middle finger (second finger). The keyboard 121 can be tapped once. The controller 180 may include a second finger on the keyboard 121 in a second area on the keyboard 121 where the second finger is located by dragging the first finger, the second finger, and the third finger. A third touch input of tapping the area once is detected.

When the third touch input is detected, the controller 180 detects that the screen output on the display unit 151 is the execution screen 440 of a specific program, and as shown in FIG. 29B, In a predetermined area of the display unit 151 where the first indicator I1 is located by dragging the first finger, the second finger, and the third finger, a GUI 441 including a list of functions related to the specific program is provided. The display unit 151 may be controlled to output.

Meanwhile, according to one embodiment of the present invention, the user may use the keyboard 121 provided with the touch sensor as the touch pad 122. This will be described with reference to FIGS. 30 to 32.

The controller 180 recognizes a first finger touching a first key among a plurality of keys included in the keyboard 121 (S501). The user may take a posture of placing one finger on the keyboard 121 similarly to using the touch pad 122. The first key may be any key among a plurality of keys included in the keyboard 121. According to an embodiment, when one finger touches two adjacent keys simultaneously, the first key may mean two adjacent keys. If a touch input of touching the first key is detected, the controller 180 may recognize a first finger touching the first key.

The controller 180 controls the display unit 151 to display the second indicator in the first area on the screen based on the recognition result of the first finger (S502).

The second indicator may be displayed on the preset first area on the screen of the display unit 151 when the first finger is recognized, and the first coordinate value data and the mapping associated with the first key on the keyboard 121. It may be displayed in the first area on the screen of the display unit 151 based on the data.

The controller 180 recognizes dragging of the first finger on the keyboard 121 (S503). For example, the controller 180 detects a touch input on a first key, simultaneously detects a touch input on a first key and a key adjacent to the first key, and detects a touch input on a key adjacent to the first key. In this case, dragging of the first finger may be recognized. The memory 160 may previously store a program or an application necessary for recognizing dragging of the finger.

The controller 180 calculates an amount of change of the first coordinate value data related to the first finger by the dragging (S504). For example, the controller 180 may include the first coordinate value data of the first finger on the keyboard 121 before dragging the first finger and the first of the first finger on the keyboard 121 after dragging the first finger. By using the coordinate value data, a change amount of the first coordinate value data related to the first finger may be calculated.

The controller 180 may control the display unit 151 to move and display the second indicator from the first area to the second area on the screen based on the calculated change amount (S505). For example, based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount, the second indicator is moved from the first area to the second area on the screen. The display unit 151 may be controlled. Alternatively, the controller 180 may control the display unit 151 to move the second indicator from the first area to the second area on the screen based on the dragging direction of the first finger and the calculated change amount. Can be.

The controller 180 recognizes a first finger touching a first key among a plurality of keys included in the keyboard 121. The controller 180 may control the display unit 151 to output the second indicator I2 similarly to the case where the user input by the touch pad 122 is performed.

The second indicator I2 may be displayed on the preset first area on the screen. For example, the first area may be a center area on the screen of the display unit 151.

Alternatively, although not illustrated, the controller 180 detects first coordinate value data related to the first key on the keyboard 121, and detects the detected first coordinate value data and the first coordinate value stored in the memory 160. The display unit 151 may be controlled to display the second indicator I2 in the first area on the screen based on the mapping data of the data and the second coordinate value data. The first area may be an area corresponding to the second coordinate value data on the screen of the display unit 151 mapped to the detected first coordinate value data on the keyboard 121. That is, when the user places a finger on the upper left area of the keyboard 121, the second indicator I2 may be displayed on the upper left area of the screen of the display unit 151.

At least one of the shape, size, color, and transparency of the second indicator I2 may be different from that of the first indicator I1.

According to the exemplary embodiment of the present invention, when the user moves a finger on the keyboard 121, the second indicator I2 on the screen of the display unit 151 may be moved accordingly. This will be described with reference to FIG. 32.

Referring to FIG. 32A, the controller 180 recognizes a first finger touching a first key among a plurality of keys included in the keyboard 121 and based on the recognition result, the second indicator I2. ) Is displayed on the screen to control the display unit 151.

The controller 180 recognizes the dragging of the first finger on the keyboard 121, and based on the recognition result, the controller 180 displays the second indicator I2 in the first area on the screen as shown in FIG. 32B. The display unit 151 may be controlled to move to the second area.

The controller 180 may calculate a change amount of first coordinate value data related to the first finger by the dragging. For example, the controller 180 may include the first coordinate value data of the first finger on the keyboard 121 before dragging the first finger and the first of the first finger on the keyboard 121 after dragging the first finger. By using the coordinate value data, a change amount of the first coordinate value data related to the first finger may be calculated.

The controller 180 may display the second indicator I2 on the screen in the first area based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount. The display unit 151 may be controlled to move to two areas. Alternatively, the controller 180 may move the second indicator I2 from the first area to the second area on the screen based on the dragging direction of the first finger and the calculated change amount. ) Can be controlled.

For example, the distance that the first finger moves on the keyboard 121 may be shorter than the distance that the second indicator I2 moves from the first area on the screen of the display unit 151 to the second area.

According to the present exemplary embodiment, the user may input a predetermined user command by tapping the keyboard 121 with the first finger while the finger is positioned on the keyboard 121. Since this is similar to that described above with reference to FIGS. 26 and 27, a detailed description thereof will be omitted.

Meanwhile, according to an exemplary embodiment of the present invention, the user may virtually divide the screen of the display unit 151 or scroll the screen using the keyboard 121 provided with the touch sensor. This will be described with reference to FIGS. 33 to 38.

The controller 180 recognizes a first finger touching a first key and a second finger touching a second key among a plurality of keys included in the keyboard 121 (S601).

The first key and the second key may be located adjacent to each other on the keyboard 121, and the first key may be located on the same line as the second key or be lower than the second key. Here, the meaning that two keys are adjacent to each other on the keyboard 121 may mean that the two keys are adjacent to each other in a straight line, diagonal line, or diagonal line on the keyboard 121. According to an embodiment, when one finger simultaneously touches two adjacent keys, at least one of the first key and the second key may mean two adjacent keys.

The controller 180 recognizes a first finger that touches the first key and recognizes a second finger that touches the second key when a touch input of touching the first key and the second key, respectively, is detected. can do.

The controller 180 recognizes dragging of the first finger and the second finger on the keyboard 121 (S602). For example, the controller 180 detects a touch input on a first key, simultaneously detects a touch input on a first key and a key adjacent to the first key, and detects a touch input on a key adjacent to the first key. In this case, dragging of the first finger may be recognized. Similarly, the controller 180 can recognize dragging of the second finger. The memory 160 may previously store a program or an application necessary for recognizing dragging of the finger.

In the first embodiment, the controller 180 may recognize dragging of the first finger and the second finger in the downward direction of the first key and the second key on the keyboard 121.

In the second embodiment, the controller 180 may recognize dragging of the first finger and the second finger in a right or left direction of the first key and the second key on the keyboard 121.

In the third embodiment, dragging of the first finger and the second finger may be recognized in the up / down direction or the left / right direction of the first and second keys on the keyboard 121.

The controller 180 may execute a specific function among functions that may be implemented in the computing device 100 based on the recognition result of the dragging (S603).

In the first embodiment, the last touched key of the first finger and the second finger by dragging the first finger and the second finger, respectively, is the outermost (eg, the lower edge) on the keyboard 121. In the case of a key located at, the controller 180 may divide the screen of the display unit 151 into a first area and a second area located to the right of the first area based on the dragging recognition result. . Here, the controller 180 detects first coordinate value data associated with at least one of the first key and the second key, and maps the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160. By using the display unit to detect second coordinate value data corresponding to the detected first coordinate value data, wherein the detected second coordinate value data corresponds to a part of a boundary between the first area and the second area. The screen of 151 may be divided.

In the second embodiment, the last touched key of the first finger and the second finger by dragging the first finger and the second finger, respectively, is the outermost (eg, left edge or In the case of a key located at the right edge), the controller 180 divides the screen of the display unit 151 into a first area and a second area located below the first area based on a result of the dragging recognition. can do. Here, the controller 180 detects first coordinate value data associated with at least one of the first key and the second key, and maps the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160. By using the display unit to detect second coordinate value data corresponding to the detected first coordinate value data, wherein the detected second coordinate value data corresponds to a part of a boundary between the first area and the second area. The screen of 151 may be divided.

In the third embodiment, when the first touched by the first finger and the second finger by the dragging of the first finger and the second finger, respectively, is not the outermost key on the keyboard 121, The controller 180 may scroll the screen of the display unit 151 up / down or scroll the left / right directions based on the recognition result of the dragging.

According to the present embodiment, the user has an advantage of inputting a desired user command by intuitively moving his or her hand on the keyboard 121.

Referring to FIG. 34A, the controller 180 recognizes a first finger touching a first key and a second finger touching a second key among a plurality of keys included in the keyboard 121. The first key and the second key may be located adjacent to each other on the keyboard 121. In addition, the first key and the second key may be located on the keyboard 121 to the upper side.

The controller 180 may recognize dragging of the first finger and the second finger in the downward direction of the first key and the second key on the keyboard 121. Here, the last touched key of the first finger and the second finger by dragging the first finger and the second finger is a key located at the outermost part (eg, the lower edge) on the keyboard 121. Assume

Referring to FIG. 34B, the controller 180 displays the screen of the display unit 151 on the right side of the first area 611 and the first area 611 based on the dragging recognition result. It may be divided into the second region 612 located. For example, when the dragging of the first finger and the second finger is recognized, the controller 180 may recognize each of the first area 611 and the second area 612 located on the right side of the first area 611. The screen of the display unit 151 may be divided to have the same width. As another example, when the dragging of the first finger and the second finger is recognized, the controller 180 detects first coordinate value data associated with at least one of the first key and the second key, and the memory 160. Second coordinate value data corresponding to the detected first coordinate value data is detected using mapping data of the first coordinate value data and the second coordinate value data stored in the second coordinate value data, and the detected second coordinate value data is The screen of the display unit 151 may be divided to correspond to a part of a boundary line between the first area 611 and the second area 612.

35 illustrates another example of a screen displayed on a display unit of a computing device according to an embodiment of the present invention. Duplicates to those described above with reference to FIG. 34 will not be described again.

The controller 180 divides the screen of the display unit 151 into a first area 611 and a second area 612 located on the right side of the first area 611 based on the recognition result of the dragging. can do. Here, when dragging of the first finger and the second finger is recognized, the controller 180 detects first coordinate value data associated with at least one of the first key and the second key, and stores the first coordinate value data in the memory 160. The second coordinate value data corresponding to the detected first coordinate value data is detected using mapping data of the first coordinate value data and the second coordinate value data, and the detected second coordinate value data is the first coordinate value. The screen of the display unit 151 may be divided to correspond to a part of the boundary line between the area 611 and the second area 612. That is, when the user places a finger on the left side of the keyboard 121 and drags it downward, the boundary line between the first area 611 and the second area 612 of the display unit 151 is located on the left side of the entire screen. Can be located.

Referring to FIG. 36A, the controller 180 recognizes a first finger touching a first key and a second finger touching a second key among a plurality of keys included in the keyboard 121. The first key and the second key may be located adjacent to each other on the keyboard 121. In addition, the first key and the second key may be located on the keyboard 121 to the left or right side.

The controller 180 may recognize dragging of the first finger and the second finger in a right or left direction of the first key and the second key on the keyboard 121. Here, the last touched key of the first finger and the second finger by dragging the first finger and the second finger, respectively, is located at the outermost (eg, right edge or left edge) on the keyboard 121. Assume that it is a key.

Referring to FIG. 36B, the controller 180 may display the screen of the display unit 151 under the first area 611 and the first area 611 based on the dragging recognition result. It may be divided into the second region 612 located. For example, when the dragging of the first finger and the second finger is recognized, the controller 180 may recognize each of the first area 611 and the second area 612 located below the first area 611. The screen of the display unit 151 may be divided to have the same vertical width. As another example, when the dragging of the first finger and the second finger is recognized, the controller 180 detects first coordinate value data associated with at least one of the first key and the second key, and the memory 160. Second coordinate value data corresponding to the detected first coordinate value data is detected using mapping data of the first coordinate value data and the second coordinate value data stored in the second coordinate value data, and the detected second coordinate value data is The screen of the display unit 151 may be divided to correspond to a part of a boundary line between the first area 611 and the second area 612.

Referring to FIG. 37A, an execution screen 620 of a specific program is output to the display unit 151. The scroll bar 621 and the indicator 622 positioned on the scroll bar 621 are displayed on the right side of the execution screen 620. The indicator 622 may indicate where a portion of the page displayed on the current execution screen 620 is displayed among all pages that may be displayed through the execution screen 620.

The controller 180 recognizes a first finger touching a first key and a second finger touching a second key among a plurality of keys included in the keyboard 121. The first key and the second key may be located adjacent to each other on the keyboard 121.

The controller 180 may recognize dragging of the first finger and the second finger in the lower or upper direction of the first key and the second key on the keyboard 121. Here, the last touched key of the first finger and the second finger by dragging the first finger and the second finger, respectively, is located at the outermost portion (eg, the lower edge or the upper edge) on the keyboard 121. Assume that this is not a key.

Referring to FIG. 37B, the controller 180 may scroll the screen of the display unit 151 in a lower or upper direction (not shown) based on the recognition result of the dragging. Referring to the execution screen 620 output to the display unit 151, it may be confirmed that the position of the indicator 622 is moved from the top to the bottom on the scroll bar 621 based on the recognition result of the dragging.

Referring to FIG. 38A, an execution screen 620 of a specific program is output to the display unit 151. A scroll bar 621 and an indicator 622 positioned on the scroll bar 621 are displayed below the execution screen 620. The indicator 622 may indicate where a portion of the page displayed on the current execution screen 620 is displayed among all pages that may be displayed through the execution screen 620.

The controller 180 may recognize dragging of the first finger and the second finger in a right or left direction of the first key and the second key on the keyboard 121. Here, the last touched key of the first finger and the second finger by dragging the first finger and the second finger, respectively, is located at the outermost (eg, right edge or left edge) on the keyboard 121. Assume that this is not a key.

Referring to FIG. 38B, the controller 180 may scroll the screen of the display unit 151 in the right or left direction (not shown) based on the recognition result of the dragging. Referring to the execution screen 620 output to the display unit 151, it may be confirmed that the position of the indicator 622 is moved from left to right on the scroll bar 621 based on the recognition result of the dragging.

The controller 180 recognizes, on the keyboard 121, a first finger touching a first key and a second finger touching a second key (S701). The first key and the second key are spaced apart from each other on the keyboard 121, and the first key may be a special key (eg, a "Shift key", a "Ctrl key", an "Alt key", etc.).

The controller 180 recognizes dragging of the second finger on the keyboard 121 (S702). The controller 180 may recognize dragging of the second finger while the first finger touches the first key.

The controller 180 may execute a specific function among functions that may be implemented in the computing device 100 based on the recognition result of the dragging (S703).

In the first embodiment, the controller 180 may control the display unit 151 to display a trajectory corresponding to the dragging of the second finger on the screen. For example, the controller 180 detects first coordinate value data related to the second finger on the keyboard 121 before dragging the second finger, and changes the amount of change of the first coordinate value data according to dragging of the second finger. Calculates and outputs a trace corresponding to the dragging of the second finger to the display unit 151 based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount. Can be.

In the second embodiment, the controller 180 outputs a trajectory corresponding to the dragging of the second finger to the display unit 151, performs handwriting recognition based on the trajectory displayed on the display unit 151, and performs the handwriting. Based on the recognition result, the trajectory may be converted into a letter, a number, or a symbol and output to the display unit 151. The memory 160 may store a program or an application required for handwriting recognition in advance.

In the third embodiment, the controller 180 may control the display unit 151 to highlight and display a part of the text displayed on the screen of the display unit 151 based on the dragging of the second finger. For example, the controller 180 detects first coordinate value data related to the second finger on the keyboard 121 before dragging the second finger, and changes the amount of change of the first coordinate value data according to dragging of the second finger. The display unit 151 may be controlled to highlight a portion of the text based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount. According to an embodiment, the controller 180 detects the number of keys touched by the second finger by dragging the second finger, and detects the number of characters (including letters, numbers, and symbol modes) included in the text. The display unit 151 may be controlled to highlight and display the same number of characters (including letters, numbers, and symbol modes) as the number of keys.

Referring to FIG. 40A, the controller 180 recognizes, on the keyboard 121, a first finger touching a first key and a second finger touching a second key. The first key and the second key are spaced apart from each other on the keyboard 121, and the first key may be a special key (eg, a "Shift key", a "Ctrl key", an "Alt key", etc.). For example, the execution screen 710 of the paint program may be output to the display unit 151.

The controller 180 recognizes dragging of the second finger while the first finger touches the first key.

Referring to FIG. 40B, the controller 180 may control the display unit 151 to display the trajectory 711 corresponding to the dragging of the second finger on the execution screen 710. For example, the controller 180 detects first coordinate value data related to the second finger on the keyboard 121 before dragging the second finger, and changes the amount of change of the first coordinate value data according to dragging of the second finger. The display unit 151 calculates a trace 711 corresponding to the dragging of the second finger based on the mapping data of the first coordinate value data and the second coordinate value data stored in the memory 160 and the calculated change amount. Can be output to

Referring to FIG. 41A, the controller 180 recognizes, on the keyboard 121, a first finger touching a first key and a second finger touching a second key. The first key and the second key are spaced apart from each other on the keyboard 121, and the first key may be a special key (eg, a "Shift key", a "Ctrl key", an "Alt key", etc.). For example, the execution screen 720 of the document work program may be output to the display unit 151.

Referring to FIG. 41B, the controller 180 may control the display unit 151 to display the trajectory 721 corresponding to the dragging of the second finger on the execution screen 720.

41 (c), the controller 180 performs handwriting recognition based on the trajectory 721 displayed on the execution screen 720, and based on the result of the handwriting recognition, the trajectory. The display unit 151 may be controlled to convert 721 into letters, numbers, or symbols and output the converted characters.

Referring to FIG. 42A, the controller 180 recognizes, on the keyboard 121, a first finger touching a first key and a second finger touching a second key. The first key and the second key are spaced apart from each other on the keyboard 121, and the first key may be a special key (eg, a "Shift key", a "Ctrl key", an "Alt key", etc.). For example, it is assumed that the execution screen 730 of the document work program is output to the display unit 151, and the text 731 is included in the execution screen 730.

Referring to FIG. 42B, the controller 180 displays the portion 732 of the text displayed on the execution screen of the display unit 151 by highlighting the display unit 151 based on the dragging of the second finger. ) Can be controlled.

For example, when the dragging of the second finger is recognized while the first finger touches the first key, the controller 180 may include a first associated with the second finger on the keyboard 121 before dragging the second finger. Detect coordinate value data, calculate a change amount of the first coordinate value data according to the dragging of the second finger, map data of the first coordinate value data and the second coordinate value data stored in the memory 160, and the calculated change amount Based on the above, the display unit 151 may be controlled to highlight a portion of the text 731.

In addition, according to an embodiment, the controller 180 detects the number of keys touched by the second finger by dragging the second finger, and includes a character (letter, number, symbol mode) included in the text 731. The display unit 151 may be controlled to highlight and display the same number of characters (including letters, numbers, and symbol modes) among the detected keys.

On the other hand, according to an embodiment of the present invention, the user, using the keyboard 121 with a touch sensor to turn over the page of the screen output to the display unit 151, or the screen output to the display unit 151 You can zoom in and out. This will be described with reference to FIGS. 43 and 44.

Referring to FIG. 43A, the controller 180 recognizes a first finger touching a first key among a plurality of keys on the keyboard 121. In this case, the controller 180 may recognize the first finger that touches the first key more than a preset value, or recognize the first finger that touches the first key while applying a pressure equal to or greater than a preset degree to the first key. Can be.

The controller 180 recognizes dragging of the first finger on the keyboard 121.

Referring to FIG. 43B, the controller 180 may turn over the page of the screen output to the display unit 151 based on the recognition result of dragging the first finger. For example, when the controller 180 recognizes dragging the first finger in the right direction of the first key, the controller 180 can turn the screen output on the display unit 151 from the current page to the next page. When the dragging of the first finger is recognized in the left direction, the screen output to the display unit 151 may be turned from the current page to the previous page.

Referring to FIG. 44A, the controller 180 recognizes five fingers that touch at least five keys on the keyboard 121, and the first finger of the five fingers in a direction away from each other. Dragging can be recognized. According to an embodiment, the controller 180 may recognize at least four fingers at least touching four keys on the keyboard 121, and recognize the first dragging of the four fingers in a direction in which the four fingers are far from each other. It may be.

Referring to FIG. 44B, the controller 180 may zoom in (enlarge) a specific screen output to the display unit 151 based on the recognized first dragging.

In addition, in FIG. 44B, the controller 180 may recognize the second dragging of the five fingers in a direction in which the five fingers are close to each other. According to an embodiment, the controller 180 may recognize the second dragging of the four fingers in a direction in which at least four fingers are close to each other.

Referring to FIG. 44C, the controller 180 may zoom out (reduce) a specific screen output to the display unit 151 based on the recognized second dragging.

The zoom in (magnification) degree of the specific screen output to the display unit 151 is proportional to the extent to which the five fingers are separated from each other, and the zoom out (reduction) degree of the specific screen output to the display unit 151 is the five degree. It can be proportional to the degree to which the two fingers are close to each other.

Meanwhile, according to an embodiment of the present invention, the user may set or input a password using the keyboard 121 provided with the touch sensor. This will be described with reference to FIG. 45.

For example, the keyboard 121 may have a fingerprint receiving function, and the controller 180 may recognize a fingerprint received through the keyboard 121. The memory 160 may store a program or an application required for fingerprint recognition in advance. The user can register his fingerprint. According to an embodiment, the user may register a fingerprint of each of at least two fingers of ten fingers. The controller 180 may output the first screen 610 to guide the input of the user password to the display unit 151 after the booting of the computing device 100 is completed. The user may place a finger corresponding to the registered fingerprint on the keyboard 121, and the controller 180 recognizes the fingerprint detected through the keyboard 121, and if the recognized fingerprint matches the registered fingerprint, You can unlock it.

As another example, the user may set a touch input for touching a key of some of the plurality of keys included in the keyboard 121 as a user password. The controller 180 may output the first screen 610 to guide the input of the user password to the display unit 151 after the booting of the computing device 100 is completed. The user may place his or her finger on a specific key on the keyboard 121 according to the set user password, and the controller 180 may determine whether to unlock the lock based on a touch input through a specific key on the keyboard 121. have.

As another example, the user may set a touch input for touching a part of a plurality of keys included in the keyboard 121 and a password combining numbers, letters, and symbols as a user input. The controller 180 may output the first screen 610 to guide the input of the user password to the display unit 151 after the booting of the computing device 100 is completed. A user may input the password in a state where his / her finger is placed on a specific key on the keyboard 121 according to the set user password, and the controller 180 may input a touch through the specific key on the keyboard 121 and the password. It may determine whether to unlock based on the.

According to the embodiments described above, by providing a keyboard with a touch sensor can provide a computing device and a control method thereof with emphasis on user convenience.

The present invention described above can be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like. This also includes implementations in the form of carrier waves (eg, transmission over the Internet). In addition, the computer may include the controller 180 of the terminal. Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

TECHNICAL FIELD The present invention relates to a computing device and a control method thereof, and has industrial applications.

Claims

A keyboard including a plurality of keys and provided with a touch sensor on at least one of the plurality of keys;

A display unit; And

A control unit;

The control unit,

Detect a first touch input of touching a first key in the keyboard according to a preset condition;

Detects a screen output on the display unit when the first touch input is detected;

Based on the detected screen, executes a function corresponding to the first key,

And control the display unit to output a result of the function execution.
The method of claim 1,

The preset condition may be a condition of touching the first key for a predetermined time or more, a condition of touching the first key in a state of touching a second key of the keyboard, or more than a preset level of the second key of the keyboard. A condition of touching the first key under pressure, a condition of simultaneously touching the first key and a second key in the keyboard, a condition of touching at least two keys in the keyboard before touching the first key At least one of a second key located at the outermost side of the keyboard and at least one key located between the first key and the second key in the keyboard before touching the first key. A computing device comprising one.
The method of claim 1,

If the first key corresponds to a specific character, the control unit,

Search for at least one of a file name, a program name, and a function name starting with the specific character among files and programs stored in a memory of the computing device, and functions that can be implemented in the computing device,

And control the display unit to output a GUI including the search result.
The method of claim 3, wherein

And the retrieved file name, program name, and function name are associated with a program corresponding to the detected screen.
The method of claim 3, wherein

The control unit controls the display unit to output the search results in the GUI, at least classified by file, program and function.
The method of claim 3, wherein

If the keyboard is set to the Hangul input mode and the first key corresponds to a specific consonant of the Hangul,

And the control unit searches for at least one of a file name, a program name, and a function name starting with the specific consonant.
The method of claim 3, wherein

The control unit,

And control the display unit to output a thumbnail image corresponding to each of at least some of the retrieved file names on the GUI.
The method of claim 1,

When the first key is a space bar and the detected screen corresponds to a first program for playing a video or music,

The controller controls the display unit to output a GUI including a progress bar for controlling a playback related function of the first program when the first touch input is detected.
The method of claim 8,

The control unit,

When the progress bar is output to the display unit, a second touch input for dragging left or right while touching the first key is detected.

And the display unit controls the display unit to move to the left or right on the progress bar an indicator indicating a playback point of the video or music included in the GUI according to the detected second touch input.
The method of claim 1,

If the first key is a space bar and the detected screen corresponds to a second program for internet use,

The control unit, when the first touch input is detected, controls the display unit to output a GUI including images corresponding to a web page having a history connected through the second program.
The method of claim 1,

If the first key is any one of a Ctrl key, an Alt key, or a Shift key, and the detected screen corresponds to a third program,

When the first touch input is detected, the controller controls the display unit to output a list of shortcut keys including the first key from a list of shortcut keys associated with a function of the third program.

The shortcut key means at least two keys in the keyboard when a predetermined function of the third program is preset to be executed when at least two keys in the keyboard are selected together.
In the control method of a computing device,

Detecting a first touch input of touching a first key in a keyboard including a touch sensor according to a preset condition;

Executing a function corresponding to the first key according to the sensed first touch input; And

Outputting a result of executing the function to a display unit;

Executing a function corresponding to the first key may include:

Executing a specific program mapped to the first key, executing a specific file mapped to the first key, and executing a specific function mapped to the first key among functions that can be implemented in the computing device And any one of the steps.
The method of claim 12,

The preset condition may be a condition of touching the first key for a predetermined time or more, a condition of touching the first key in a state of touching a second key of the keyboard, or more than a preset level of the second key of the keyboard. A condition of touching the first key under pressure, a condition of simultaneously touching the first key and a second key in the keyboard, a condition of touching at least two keys in the keyboard before touching the first key At least one of a second key located at the outermost side of the keyboard and at least one key located between the first key and the second key in the keyboard before touching the first key. A method of controlling a computing device, comprising one.
The method of claim 12,

And outputting a GUI for confirming whether to execute the function corresponding to the first key to a display unit before executing the function corresponding to the first key.
A keyboard including a plurality of keys and provided with a touch sensor on at least some of the plurality of keys;

A display unit; And

A control unit;

The controller recognizes at least a first finger that touches a first key, a second finger that touches a second key, and a third finger that touches a third key, and recognizes the first key on the keyboard. Is located on the left side of the second key and the third key is located on the right side of the second key, and the second key on the keyboard is on the same line as at least one of the first key and the third key, or Located above the first key and the third key,

And control the display unit to display an indicator in a first area on a screen based on the recognition result.
The method of claim 15,

On the keyboard, the first key and the third key are located adjacent to the second key.
The method of claim 15,

A memory configured to store first coordinate value data related to at least a partial area on the keyboard, second coordinate value data related to an entire area of a screen of the display unit, and mapping data of the first coordinate value data and the second coordinate value data; Computing device further comprising.
The method of claim 17,

The control unit,

Recognize dragging of the first finger, the second finger and the third finger on the keyboard;

Calculating the amount of change of first coordinate value data associated with at least one of the first finger, the second finger, and the third finger by the dragging,

Controlling the display unit to display the indicator by moving the indicator from the first area to a second area on the screen based on the mapping data of the first coordinate value data and the second coordinate value data and the calculated change amount; Computing device.
The method of claim 18,

The control unit,

In a first region on the keyboard where the first finger is located by dragging the first finger, the second finger, and the third finger, the first finger twice within the predetermined time within the preset time. Detect the first touch input to tap,

And executes a specific function corresponding to a second area on a screen of the display unit in which the indicator is located according to the detected first touch input.
The method of claim 18,

The control unit,

A second region in which the second finger taps the second region once in a second region on the keyboard where the second finger is positioned by dragging the first finger, the second finger, and the third finger; Detect touch input,

When the second touch input is detected, detects the screen output to the display unit,

And executing a specific function corresponding to the second touch input based on the sensed screen.