KR101811552B1 - Input device for terminal and input method using the same, and computer readable recording medium - Google Patents

Abstract

The present invention relates to a keypad touch unit coupled to a terminal and configured to selectively move toward a user input unit of the terminal, A vision unit coupled to the keypad touch unit and collecting image information output from a display unit of the terminal; And a control unit for controlling the keypad touch unit when the input information generated by referring to the image information is received. The present invention also relates to a terminal input method and a computer readable recording medium.

Description

TECHNICAL FIELD [0001] The present invention relates to a terminal input device, a terminal input method, and a computer readable recording medium. BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

The present invention relates to a terminal input device, a terminal input method, and a computer-readable recording medium.

In general, terminals such as computers and smart phones can implement various functions such as business, personalization and entertainment through various data processing processes.

Such a terminal can be driven accordingly when an input signal is transmitted through its own input unit. Therefore, there is a space restriction that the user must be in close proximity to the terminal to directly touch the user input unit to operate the terminal.

In order to solve this problem, recently, the target terminal is remotely controlled from the outside through the remote service method.

However, the remote control method directly transmits a communication signal to a corresponding terminal and drives a program of the terminal according to the corresponding signal. In this remote control method, an error is generated by judging the data as an abnormal access, exist.

An object of the present invention is to provide a terminal input device, a terminal input method, and a computer-readable recording medium that prevent a risk of hacking and enable a normal access to a metabolic program.

A terminal input device for realizing the above object includes a keypad touch part coupled to a terminal and configured to selectively move toward a user input part of the terminal; A vision unit coupled to the keypad touch unit and collecting image information output from a display unit of the terminal; And a controller for controlling the keypad touch unit when input information generated by referring to the image information is received.

Here, the keypad touch unit may include: a housing disposed to face the user input unit; A key input unit corresponding to the user input unit in the housing; And a key driver for moving the key input unit toward the user input unit.

Here, the housing may be detachable from the user input unit, and the key input unit may include a plurality of key buttons that are individually detachable and can be adjusted in spacing between the keys.

Here, the apparatus may further include a mouse driver configured to drive the mouse, and the controller may control the mouse driver based on the input information.

Here, the mouse driver may include a sub housing installed to be detachable from the housing, and configured to receive the mouse; And a mouse executing unit installed on the sub housing and formed to be detachable from the mouse, and configured to selectively move the mouse and the button of the mouse.

Here, the power button touch unit may be configured to selectively contact the power button of the terminal, and the controller may control the power button touch unit based on the input information.

The display unit may further include a display touch unit configured to selectively contact the display unit of the terminal, and the controller may control the display touch unit based on the input information.

Here, the communication unit may further include a communication unit configured to receive the input information from an external terminal.

Here, the memory unit may further include a memory unit for storing the input information.

Here, the non-conductive portion may be formed to be changeable in position and direction.

The control unit may further include a memory unit for storing the input information and the image information, wherein the controller transmits the image information to an external terminal, and when response information for the image information is received from the external terminal, Information.

Here, the keypad touch unit may be driven by the control unit in an automatic mode and may be driven by an external force in a manual mode.

According to another aspect of the present invention, there is provided a terminal input method comprising the steps of: collecting image information output from a display unit of a terminal through a vision unit coupled to a keypad touch unit; Determining whether the input information generated based on the image information is received; And controlling, when the input information is received, a keypad touch unit coupled to the terminal based on the input information and configured to be selectively moved toward the user input unit of the terminal.

The step of controlling the keypad touch unit, which is formed to be selectively moved toward the user input unit of the terminal, when the input information is received, is combined with the terminal based on the input information, And controlling the mouse driver configured to allow the user to operate the mouse.

The step of controlling the keypad touch unit, which is formed to be selectively moved toward the user input unit of the terminal, when the input information is received, is combined with the terminal based on the input information, And controlling the power button touch unit formed to selectively contact the power button.

The step of controlling the keypad touch unit, which is formed to be selectively moved toward the user input unit of the terminal, when the input information is received, is combined with the terminal based on the input information to selectively touch the display unit of the terminal And controlling the display touch unit to be formed.

Transmitting the image information to an external terminal through a communication unit provided in the keypad touch unit; Receiving response information for the image information from the external terminal; And converting the response information into the input information.

delete

delete

According to another aspect of the present invention, there is provided a computer-readable recording medium for recording image information output from a display unit of a terminal through a vision unit coupled to a keypad touch unit. Determining whether the input information generated based on the image information is received; Controlling a keypad touch unit coupled to the terminal based on the input information and configured to selectively move toward a user input unit of the terminal when the input information is received; Controlling a mouse driver configured to drive a mouse based on the input information; Controlling a power button touch unit configured to selectively contact a power button of the terminal based on the input information; Controlling a display touch unit formed to selectively contact the display unit of the terminal; Transmitting the image information to an external terminal through a communication unit provided in the keypad touch unit; Receiving response information for the image information from the external terminal; And converting the response information into the input information; The terminal inputting method can be performed.

According to the terminal input device, the terminal input method, and the computer readable recording medium configured as described above, the user can input normal information by inputting the input information by hitting the user input portion of the terminal.

In addition, since the terminal input device is configured to communicate with an external terminal, a normal input signal can be remotely provided to the terminal through the external terminal.

Also, the convenience of use can be improved by automatically generating input information according to the image information output to the terminal through the vision unit and inputting the corresponding input information to the user input unit.

In addition, not only the user input unit but also the display unit such as the power button, the mouse, and the touch screen can be directly brought into physical contact with each other, thereby further improving the applicability.

1 is a conceptual diagram illustrating a method of using a terminal input device 100 according to an embodiment of the present invention.
FIG. 2 is a view for explaining a structure of a keypad touch unit 110 according to an embodiment of the present invention.
FIG. 3 is a view for explaining a structure of a mouse mouth part 140 according to an embodiment of the present invention.
4 is a view for explaining a structure of a power button touch unit 150 according to an embodiment of the present invention.
5 is a block diagram illustrating a configuration of a terminal input device 100 according to an embodiment of the present invention.
6 is a view for explaining a keypad touch unit 210 having a manual key input unit 117 according to another embodiment of the present invention.
7 is a flowchart illustrating a terminal input method and a recording medium using the terminal input method according to another embodiment of the present invention.

Hereinafter, a terminal input device, a terminal input method, and a computer readable recording medium according to preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification, the same or similar reference numerals are given to different embodiments in the same or similar configurations.

FIG. 1 is a conceptual diagram for explaining a method of using the terminal input device 100 according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating a structure of a keypad touch unit 110 according to an embodiment of the present invention. FIG. 3 is a view for explaining a structure of a mouse M according to an embodiment of the present invention. FIG. 4 illustrates a structure of a power button touch unit 150 according to an embodiment of the present invention FIG. 5 is a block diagram illustrating a configuration of a terminal input device 100 according to an embodiment of the present invention. Referring to FIG.

1, the terminal input apparatus 100 may be installed in a user input unit K of the terminal T and may be moved toward the user input unit K according to input information.

The terminal T relates to an electronic device for driving a program, and may be a desktop computer, a tablet computer, a smart phone, or the like. In the present embodiment, a desktop computer will be described as a target for the terminal T for ease of explanation.

Such a terminal may include a user input section K such as a keyboard K, a main body O including a mouse M, a display section D, and various electronic components. In particular, in the case of a smartphone or a tablet computer in which the keyboard K is not provided, the user input unit K can be defined as a partial area of the touch screen where the keyboard is formed.

The terminal input apparatus 100 installed in the user input unit K of the terminal T may be provided with input information stored in the memory unit 170 provided therein or input information transmitted from the external terminal S, And may be driven based on input information generated by collecting image information of the display unit D through the vision unit 130 provided in the terminal input device 100. [

Accordingly, when the user inputs the input information related to the input to the web site or the specific program intended by the user to the terminal input device 100, the terminal input device 100 displays the user input K corresponding to the input information, Can be touched. Thus, the terminal T may actually operate according to the information input through its user input K. The terminal input device 100 may include not only the keyboard K but also the mouse M including the mouse driver 140 according to the method described above. The power button touch unit 150 may be disposed on the power button PB of the display unit 150 to control power operation of each apparatus. Further, the terminal input device 100 may include a vision unit 130 to collect image information output from the display unit D, automatically generate and drive corresponding input information, And may be driven by receiving input information therefrom.

The detailed configuration of the terminal input device 100 is as follows.

2, the terminal input device 100 includes a keypad touch unit 110, a display touch unit 120, a vision unit 130, a mouse driver 140, a power button touch unit 150, A memory unit 170, a power supply unit 180,

The keypad touch unit 110 includes a housing 111, a key input unit 113, and a key drive unit 115 as means for physically moving toward the user input unit K of the terminal T .

The housing 111 may form an appearance of the keypad touch part 110 and may be arranged to face the user input part K. [ In the present embodiment, the housing 111 is formed to be detachable to the user input unit K, but not limited thereto. Alternatively, the housing 111 may be disposed on the user input unit K. In this case, the housing 111 may have a plurality of support portions extending toward the bottom surface, and may be separated from the bottom surface through the support portion, and the user input portion K may be disposed in the spaced apart spaces. On the other hand, when the housing 111 is formed to be detachable from the user input unit K, the housing 111 can be coupled with the user input unit K through a housing coupling unit (not shown) for detachment. In this case, the housing coupling part may be formed along the rim of the housing 111. When the housing coupling part is coupled with the user input part K through the housing coupling part, the housing 111 is separated from the user input part by a predetermined distance State. In addition, the housing 111 may have an internal space for accommodating the key input unit 113, which will be described later.

The key input unit 113 may be installed in the housing 111 to correspond to the user input unit K when the housing 111 and the user input unit K are coupled to each other as means for contacting the user input unit K. [ Accordingly, the key input unit 113 may be formed of a plurality of key buttons corresponding to individual input buttons of the user input unit K. [ In addition, although not shown in the present embodiment, the key buttons may be formed so as to allow individual detachment and adjustment of the spacing therebetween. In other words, a plurality of connecting rods connecting sidewalls of the inner space of the housing 111 are provided, The key buttons can be detachably mounted on the respective connecting rods. At this time, the area of the key button may be smaller than the input button of the corresponding user input unit K, and thus, a space may be formed between the plurality of key buttons. Accordingly, when the key input unit 113 is applied to different types of user input units K, the position and number of the key buttons can be adjusted according to the input button interval of the corresponding user input unit K. [

The key driver 115 may be provided on one side of the housing 111 and may be connected to the key input unit 113 as a means for moving the key input unit 113 toward the user input unit K. [ The key driving unit 115 may be driven by a driver such as a motor so that the key connecting unit connected to the key input unit 113 is extended toward the user input unit or returned to the original position. The present invention is not limited to this. The key input unit 113 and the key connection unit may be formed of a single key driving unit 115, Lt; / RTI >

The display touch unit 120 is a means for selectively making contact with the display unit D and is capable of contacting a display unit D such as a touch screen to implement a function of turning on a screen or moving a cursor have. For this, the display touch unit 120 may include a display moving unit 121 and a display input unit 123.

The display moving unit 121 can be formed to be movable in the keypad touch unit 110. [ In other words, the display moving unit 121 includes a driving unit that is electrically rotated and moved up and down, and one side can be coupled with one side of the keypad touch unit 110. Accordingly, the display moving unit 121 can be moved leftward or rightward or up and down with respect to the coupling part with the keypad touch unit 110 as an axis.

The display input unit 123 may be provided at an end of the display moving unit 121 to selectively contact the display unit D of the terminal T. [ At this time, the display input unit 123 may be an electrostatic material static pressure material or the like depending on the sensing method of the touch screen. In addition, when the touch screen is the infrared touch method (IR Touch), the touch screen may be moved only by a predetermined distance without touching the display portion D.

The vision unit 130 may include a camera coupled to the keypad touch unit 110 via the non-coupling unit 131 as a means for collecting image information output from the display unit D of the terminal T have. At this time, the non-coupling portion 131 may be formed of an elastic body which is adjustable in length and can change posture in multiple directions. Further, the non-coupling portion 131 may include a driving portion such as the display moving portion 121, and may be adjusted in position and direction under the control of a control portion 190 described later.

As the vision unit 130 is configured by a camera, the image information such as an image, text, and moving images output from the display unit D of the terminal T can be photographed from the outside by the corresponding camera. In addition, the vision unit 130 may be replaced with an electronic device such as a smart phone. In this case, a structure for detaching the smartphone is formed at the end of the non-coupling portion 131, and the smart phone may be attached to the structure to collect image information through the camera of the smart phone. The image information thus collected may be transmitted to the control unit 190 or may be provided to the control unit 190 by generating input information corresponding to the image information through an application provided in the smart phone.

3, the mouse driver 140 includes a sub housing 141, a first moving part 143, and a second moving part 143 as means for moving the mouse M and clicking a mouse button. And may include a portion 145.

The sub housing 141 may have an internal space for accommodating the mouse M therein.

The first moving part 143 may be formed to connect one side of the sub housing 141 and the opposite side to each other. In other words, the first moving part 143 is formed to connect one surface and the other surface of the sub housing 141, on which the pair of guide parts 141a are formed, and can be moved along the guide part 141a.

The second moving part 145 may be means for moving along the first moving part 143 in combination with the mouse M. In other words, the second moving part 145 is detachably formed on one side of the housing facing the bottom surface of the inner space, and can be coupled with the second moving part 145 through the other surface. The second moving part 145 is provided with a guide part (not shown) along one side thereof facing the first moving part 143 so that the second moving part 145 can move along the guide part.

In addition, the second moving unit 145 may include a mouse button driving unit (not shown) for selectively contacting the button of the mouse M as well as the mouse M. The mouse button drive unit is formed so as to correspond to a button provided on the mouse M, and can be selectively pressed and pressed. In addition, when the mouse M is provided with a wheel button, the wheel button may be rotated in different directions.

The first moving part 143 may be moved in a first direction in the inner space and the second moving part 145 may be moved in a second direction that is a direction intersecting the first direction. Therefore, the mouse M can be moved along the entire inner space of the sub housing 141 by the movement of the first moving part 143 and the second moving part 145, respectively. In order to move the mouse M in a state of being in contact with the bottom surface of the inner space, the height of the first moving part 143 may be arranged at a corresponding height.

4, the power button touch unit 150 is a means for selectively contacting the display unit D of the terminal T or the power button PB of the main body O. In this embodiment, For ease of explanation, the power button touch unit 150 that targets the main body O will be described as an example.

The power button touch unit 150 may include a button housing 151, a button input unit 153, a button driving unit 155, and a manual button unit 157.

The button housing 151 is a means for engaging with the power button of the main body O. The button housing 151 may have an inner space and an opening facing the power button PB. The button housing 151 may include a magnetic body or a coupling portion that can be coupled to the outer surface of the body O to contact the body O to be coupled to the outer surface of the body O,

The button input unit 153 is disposed in the inner space of the button housing 151 as a means for selectively contacting the power button PB when the button housing 151 is coupled to surround the power button PB .

The button driving unit 155 is a means for moving the button input unit 153 in the direction of the power button PB or returning the button input unit 153 to the initial position through a driving force of a motor or the like, 153, respectively.

The manual button unit 157 is a means for moving the button input unit 153 in the direction of the power button PB by an external force and is coupled to the button housing 151 so as to be exposed to the outside from the opposite side of the button input unit 153 . The manual button unit 157 may be connected to the button input unit 153 to move the button input unit 153 by an external force. At this time, the button input unit 153 is provided with an elastic body such as a spring or a spring, and is moved by an external force and then elastically returned to its original position when the external force disappears.

The communication unit 160, the memory unit 170, the power source unit 180, and the control unit 190 shown in FIGS. 1 and 5 may be installed on one side of the housing 111. Since the configurations are electrical components or parts, they are shown as being integrated with each other for ease of explanation, but they are not all integrated.

The communication unit 160 may be means for receiving input information from the external terminal S or transmitting image information collected from the vision unit 130 to the external terminal S. [

The memory unit 170 may be means for storing input information, image information, and pattern table information. As described above, the input information may be information generated in the external terminal S and transmitted, and may be information generated by the controller 190, which will be described later. Since the image information has been described above, it is omitted. The pattern table information may be information in which the comparison values of the image information are aggregated. In other words, it may be table information for calculating input information corresponding to input image information.

The power supply unit 180 may be applied in various manners as a means for supplying power to the terminal input apparatus 100. For example, it can be configured as a replaceable battery, and can be connected to an external outlet through a power cable, or can be connected to a USB terminal of the main body O by a UBS cable to receive power.

The control unit 190 is a means for controlling the above-described components. When the input information is received, the control unit 190 controls the keypad touch unit 110, the display touch unit 120, the mouse driver 140, The touch unit 150 can be controlled to be driven.

The control unit 190 may also control the memory unit 170 to transmit the image information to the external terminal S when the image information is received from the vision unit 130. [

A concrete control method of the control unit 190 will be described later with reference to FIG.

The structure and the configuration of the terminal input device 100 have been described above. 6 illustrates a keypad touch unit 210 (FIG. 6) including a manual key input unit 117 (FIG. 6) according to another embodiment of the present invention.

6 is a view for explaining a keypad touch unit 210 having a manual key input unit 117 according to another embodiment of the present invention. For ease of explanation, the same reference numerals as in Figs. 1 to 5 are applied to the same components.

As shown in FIG. 6, the keypad touch unit 210 is substantially the same as the keypad touch unit 110 (not shown in FIG. 2) of FIG. 2 but includes a manual key input unit 117.

The manual key input unit 117 may be disposed so as to correspond to the respective key buttons on the opposite side of the existing key input unit 113 (not shown in FIG. 2), and may be connected to each other. Accordingly, the user can input the input information to the user input unit through the operation of the manual key input unit 117 even when the keypad touch unit 210 is coupled with the user input unit.

In other words, in the automatic mode, the keypad touch unit 210 can automatically touch the user input unit through the existing key input unit. In the manual mode, the user can touch the user input unit by the manual key input unit that is selectively pressed by the external force . Here, the keypad touch unit 210 may include a changeover switch for selectively changing the automatic mode and the manual mode, and may change the mode according to ON / OFF of the corresponding switch.

The keypad touch unit 210 having the manual input unit 117 has been described above. 7, a terminal input method and a recording medium using the method will be described.

7 is a flowchart illustrating a terminal input method and a recording medium using the terminal input method according to another embodiment of the present invention. The reference numerals of the structures shown in Fig. 7 will be omitted in place of the reference numerals of Figs. 1 to 6.

The input method using the terminal input device may be performed differently depending on the subject of generation of the input information. In this embodiment, a situation in which a terminal located in a room is powered off by an external terminal will first be described.

At first, the above-mentioned terminal input device may be in a state where the power is turned off in a state where it is installed in the user input unit, the display unit, the mouse, and the main body of the terminal, respectively. However, since the terminal input device is supplied with power through a power source, the terminal input device may be in a state of self-operation and communication. At this time, the communication unit of the terminal input device can communicate through a wired communication cable or a wireless network.

In this state, the user can drive the related application to drive the terminal input device through the external terminal (S11). The application may be constituted by a program such as an application. When the application is operated, the input information input to the application may be transmitted to the terminal input device through the server. When the input information input through the external terminal is transmitted to the terminal input device through the server (S13), the control unit of the terminal input device determines reception of the input information (S15), and based on the input information, A mouse driver, a power button touch unit, and the like (S17). First, since the power of the terminal is turned off, the controller can turn on the power of the terminal by controlling the power button touch unit according to the transmitted input information. When power is supplied to the terminal, the control unit can receive image information output from the display unit of the terminal from the vision unit (S19). When the image information is received, the control unit can cope with the image information in various ways.

As shown in the figure, the controller analyzes the image information and determines whether the image information has an error (S21). If it is determined that the image information is normal, the controller may generate the input information corresponding to the image information using the pattern table information stored in the memory unit, and may automatically operate the touch unit or the driving unit (S23). In addition, when the image information is received, the control unit transmits the image information to the server, matches the database of the server with the image information, receives the server input information, and drives the touch unit or the driving unit as input information. In the same manner, the control unit may transmit the image information to the external terminal, receive the input information generated by the external terminal by the user, and may drive the touch unit or the driving unit accordingly.

On the other hand, if the manual input information of the user is requested, such as an image requesting authentication of the user by analyzing the image information, the control unit transmits the manual input information to the external terminal of the user (S25) (27), and can drive the touch part or the driving part (S29).

May be stored and used in a terminal input device, a server, an external terminal, or the like through a computer-readable recording medium having the above-described operation method.

According to such a terminal input device, the control of the terminal can be accomplished by physical contact with the devices provided in the terminal itself, rather than by transmitting and receiving data with the terminal as in the existing remote control. Accordingly, the same information as that used by the user to perform typing, mouse movement, or the like can be provided to the programs driven by the terminal. In addition, the image information of the display unit is received through the non-volatile memory, and is compared with the memory unit or the database of the server, and corresponding input information is generated by itself, so that the operation of the program intended by the user can be automatically performed.

The terminal input device, the terminal input method, and the computer-readable recording medium are not limited to the configuration and operation of the embodiments described above. The embodiments may be configured so that all or some of the embodiments may be selectively combined so that various modifications may be made.

100: terminal input device 150: power button touch part
110: keypad touch part 160: communication part
120: display touch unit 170: memory unit
130: Vision part 180: Power part
140: Mouse driver 190:

Claims (19)

A keypad touch unit coupled to the terminal and configured to selectively move toward a user input of the terminal;
A vision unit coupled to the keypad touch unit and collecting image information output from a display unit of the terminal; And
And a controller for controlling the keypad touch unit when input information generated by referring to the image information is received.
The method according to claim 1,
Wherein the keypad-
A housing disposed to face the user input;
A key input unit corresponding to the user input unit in the housing; And
And a key driver for moving the key input unit toward the user input unit.
3. The method of claim 2,
The housing includes:
A user input unit,
The key input unit,
And a plurality of key buttons formed so as to be individually detachable and capable of adjusting the spacing therebetween.
The method according to claim 1,
And a mouse driver configured to drive the mouse,
Wherein,
And controls the mouse driver based on the input information.
5. The method of claim 4,
The mouse driver includes:
A sub-housing formed to receive the mouse; And
And a mouse execution unit installed in the sub housing and formed to be detachable from the mouse, and configured to selectively move the mouse and the button of the mouse.
The method according to claim 1,
Further comprising a power button touch unit configured to selectively contact a power button of the terminal,
Wherein,
And controls the power button touch unit based on the input information.
The method according to claim 1,
And a display touch unit formed to selectively contact the display unit of the terminal,
Wherein,
And controls the display touch unit based on the input information.
The method according to claim 1,
And a communication unit configured to receive the input information from an external terminal.
The method according to claim 1,
The non-
The position and the direction being changeably formed.
The method according to claim 1,
Further comprising a memory for storing the input information and the image information,
Wherein,
And transmits the image information to an external terminal and converts response information for the image information from the external terminal into the input information.
The method according to claim 1,
Wherein the keypad-
Is driven by the control unit in an automatic mode and is configured to be driven by an external force in a manual mode.
Collecting image information output from a display unit of a terminal through a vision unit coupled to a keypad touch unit;
Determining whether the input information generated based on the image information is received; And
And controlling the keypad touch unit to be selectively moved toward the user input unit of the terminal when the input information is received, the keypad touch unit being associated with the terminal based on the input information.
13. The method of claim 12,
And controlling the keypad touch unit to be selectively moved toward the user input unit of the terminal when the input information is received,
And controlling a mouse driver configured to drive the mouse based on the input information.
13. The method of claim 12,
And controlling the keypad touch unit to be selectively moved toward the user input unit of the terminal when the input information is received,
And controlling the power button touch unit to selectively contact the power button of the terminal based on the input information.
13. The method of claim 12,
And controlling the keypad touch unit to be selectively moved toward the user input unit of the terminal when the input information is received,
And controlling a display touch unit formed to selectively contact the display unit of the terminal.
delete 13. The method of claim 12,
Transmitting the image information to an external terminal through a communication unit provided in the keypad touch unit;
Receiving response information for the image information from the external terminal; And
And converting the response information into the input information.
delete A computer-readable recording medium on which a program for performing the terminal input method according to any one of claims 12 to 15 and 17 is recorded.

Images