KR20110081736A - Method for controlling screen using different kind of input devices and terminal unit thereof - Google Patents

Abstract

PURPOSE: A method for controlling a screen using heterogeneous input devices and a terminal thereof are provided to perform various screen control functions using the heterogeneous input device having different input modes. CONSTITUTION: A terminal detects a first input signal(S101). The terminal detects a second input signal(S103). In case the second input signal is detected in the state that the first input signal is detected or after the detection of the first input signal, the terminal performs a defined screen control function(S105,S107). The defined screen control function includes one of the expansion and reduction of a screen and the movement and rotation of the screen.

Description

Method of controlling screen using heterogeneous input device and terminal device {METHOD FOR CONTROLLING SCREEN USING DIFFERENT KIND OF INPUT DEVICES AND TERMINAL UNIT THEREOF}

The present invention relates to a method for controlling a screen using heterogeneous input devices and a terminal device thereof.

In general, various electronic devices are being produced through the development of electronic communication technology, and these devices are increasingly emphasizing the user's convenience and the beautifulness of the design. Highlighted by this trend is the diversification of input devices represented by keyboards or keypads.

BACKGROUND OF THE INVENTION In the case of a mobile terminal such as a mobile terminal or a personal digital assistant (PDA), a user interface by a touch screen or a pointing device is adopted.

In particular, in recent years, such a touch screen and a pointing device have tended to be mounted on one terminal.

Here, the touch screen is an input device in which a sensor is embedded in a screen and a user input is made by a method in which a sensor detects this when a specific object on the screen is touched using a hand or a touch pen. When the pointing device moves a finger, the cursor (or pointer) moves on the screen according to the moving direction. Such pointing devices include an optical joystick, a touchpad, a hall sensor, a fingerprint sensor, a pressure sensor, and the like.

Meanwhile, as various functions of the portable electronic device are integrated into one device, various menu settings for using the portable electronic device are required according to the operation mode of the portable electronic device. For example, searching and selecting the other party's phone number or file to be transmitted in the communication mode, searching for multimedia files in the multimedia mode, playing / stopping, pausing, etc. Is required. In addition, a function for basic setting or menu call of the portable electronic device itself is required.

Therefore, there is a need for an improvement plan that can simplify and efficiently perform such various screen control operations.

On the other hand, the terminal provided with a touch screen conventionally provides a multi-touch technology. In the case of the multi-touch technology, the screen is enlarged when the two fingers are touched on the touch screen, and the screen is enlarged when the two fingers are touched.

However, this multi-touch technology is limited to two-dimensional (2D) because the movement is implemented based on the X-axis and Y-axis.

However, as the trend of web services is becoming virtualized, it is changing from 2D to 3D. The services that represent this trend include Google's goggles service and i-phone's Layer service.

Google's Goggles service lets you take pictures of your surroundings with your phone and tell you information about buildings and objects in them. In addition, i-phone's Layer service shows the front view on the iPhone as the camera opens when any information is retrieved while holding the iPhone.

However, conventional input devices generally detect only two-dimensional movements. That is, the motion in three-dimensional space is not considered. Therefore, given the situation that a three-dimensional user interface is required in accordance with the development of future technology, such a two-dimensional input device can not be used as a three-dimensional user input device.

Accordingly, an aspect of the present invention is to provide a method for executing various screen control functions using heterogeneous input devices and a terminal device thereof.

Another object of the present invention is to provide a method for executing a screen control function in a multi-dimensional space using heterogeneous input devices and a terminal device thereof.

According to one aspect of the invention there is provided a screen control method. The method includes controlling a screen using a heterogeneous input device, the method comprising: detecting a first input signal for controlling the screen from a first input device; Detecting a second input signal for controlling the screen from a second input device, wherein the second input device is a separate input device different from the first input device; And if the first input signal and the second input signal are detected, executing a predefined screen control function.

According to another feature of the invention there is provided a terminal device. The apparatus includes a first input device for sensing a first input signal for controlling a screen; A second input device different from an input method of the first input device, mounted on a different position from the first input device, and configured to sense a second input signal for controlling the screen; And a controller configured to execute a predefined screen control function when the first input signal and the second input signal are detected.

According to an embodiment of the present invention, various screen control operations can be simplified and efficiently by using heterogeneous input devices of different input methods, and screen control in a three-dimensional space is possible.

1 is a block diagram showing the configuration of a terminal apparatus according to an embodiment of the present invention.
2 is a flowchart illustrating a screen control method according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating a screen control method according to another exemplary embodiment of the present invention.
4 shows an example of a three-dimensional screen to which the screen control function according to an embodiment of the present invention is applied.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise.

Hereinafter, a method and a terminal device for controlling a screen using heterogeneous input devices according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of a terminal apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a terminal device 100 is an electronic device having heterogeneous input devices having different input methods, capable of wired / wireless communication, and executing multimedia content. For example, it may include a laptop, an Internet Prototol TV (IPTV), a portable telephone, a smart phone, an Ultra Mobile PC (UMPC), a Personal Digital Assistance (PDA), and the like.

The terminal device 100 includes a first input device 101, a second input device 103, a display unit 105, a communication unit 107, a memory 109, and a control unit 111.

The first input device 101 detects a first input signal for screen control by a preset input method.

The second input device 103 detects a second input signal for screen control by a preset input method.

Here, the input methods of the first input device 101 and the second input device 103 are different from each other, and the positions mounted on the terminal device 100 are also different.

In this case, the first input device 101 and the second input device 103 may be mounted on a small electronic device such as a portable terminal.

Here, according to an exemplary embodiment, the first input device 101 may be a touch panel coupled to the display unit 105, and the second input device 103 may be a pointing device.

In this case, the first input device 101 and the display unit 105 constitute a touch screen. The first input device 101 is mounted on the display unit 105 and detects a first input signal according to a user's touch operation and transmits it to the control unit 111. The first input device 101 may detect a first input signal according to a user's touch position, touch intensity, and touch direction on the display unit 105, and may be implemented in various forms such as a current sensing method and a pressure sensing method. Do. In addition, depending on the applied method, the operation state may be detected only by the user's proximity rather than in direct contact.

In addition, when the second input device 103 is a pointing device, a cursor or a pointer on the display unit 105 may be generated and moved through the movement of a subject to provide the same pointing technique as that of a personal computer (PC). Implement For example, when the finger (subject) is placed on the second input device 103 and the finger is moved, the cursor (or the pointer) moves on the screen according to the moving direction.

In this case, the second input device 103 may detect physical contact of the subject or light reflected by the subject and generate a second input signal accordingly. The second input device 103 may be implemented in various forms including an optical joystick, a touch pad, a hall sensor, a fingerprint sensor, a pressure sensor, and the like.

Here, the subject may be generally understood as a user's body part such as a finger, but may be any other replaceable object that can make the second input device 103 detect the movement even if it is not the body.

The display unit 105 displays a screen including data output from the controller 111, an image that can be selected by a user, an icon, a menu item, and the like. In addition, various screens according to functions implemented by the terminal device 100 may be displayed. For example, full browsing, VOD (Vedio on Demand), map, MP3 playback, mail, etc. Print the (Mail) service screen.

In addition, the display unit 105 displays a screen composed of a plurality of different axes. That is, a map image or a web page displayed on the 3D stereoscopic space may be displayed. In addition, widgets and idle screens may be implemented in three dimensions.

The communication unit 107 provides an interface for web access through a wired / wireless network to support the terminal device 100 to implement a full browsing service for viewing documents and videos in the same form as a general Internet site.

The memory 109 stores information for controlling the operation of the terminal device 100 and information related to a screen control function.

The control unit 111 is connected to the first input device 101, the second input device 103, the display unit 105, the communication unit 107, and the memory 109 to control organic operations between the components.

The controller 111 executes a predefined screen control function according to the first input signal and the second input signal detected from each of the first input device 101 and the second input device 103. This will be described in detail with reference to FIGS. 2 and 3.

2 and 3, the same reference numerals are used to describe the same components as those of FIG. 1.

First, FIG. 2 is a flowchart illustrating a screen control method according to an exemplary embodiment of the present invention.

Referring to FIG. 2, the controller 111 detects a first input signal from the first input device 101 (S101), and detects a second input signal from the second input device 103 (S103).

At this time, the control unit 111 is the first input signal and the second input signal when the first input signal is detected in the second input signal is detected or after the first input signal is detected after the second input signal is detected It is determined whether it corresponds (S105).

As a result of the determination in step S105, if it is applicable to execute the predefined screen control function (S107). Here, the predefined screen control function may include any one of enlargement of the screen, reduction of the screen, movement of the screen, and rotation of the screen. In this case, the screen may mean the entire screen output by the display unit 105 or may include some images displayed on the screen.

3 is a flowchart illustrating a screen control method according to another embodiment of the present invention.

Referring to FIG. 3, the control unit 111 displays a screen on a multi-dimensional space through the display unit 105 (S201).

Here, the screen on the multi-dimensional space means a screen that is multi-dimensionally displayed and variable on the multi-dimensional space. For example, the 3D screen refers to a screen in which an image displayed on the 3D screen may be 'moved' or 'changed while moving' according to an X-axis, a Y-axis, a Z-axis, or a synthesized axis thereof. In this case, 'change as moving' includes content change in addition to size change. The image displayed on the 3D screen includes an icon, a menu, a list, a pointer (cursor), an image, and the like.

For example, a map image may be displayed on a three-dimensional space or an image photographed through a camera (not shown) may be displayed in a three-dimensional three-dimensional space.

The control unit 111 detects the second input signal from the second input device 103 in the state in which the first input signal is detected from the first input device 101 or receives the second input signal after the first input signal is detected. It detects (S203, S205, S207).

In this case, the control unit 111 calculates the first input signal as first coordinates in at least two different axial directions (S209). In operation S211, the second input signal may be calculated as the second coordinate in one axis direction except for the axis of the first coordinate.

The controller 111 controls the change of the screen according to the second coordinate based on the first coordinate (S213).

In addition, the controller 111 may detect a plurality of first input signals from the first input device 101. In this case, if the first input device 101 is a touch screen, it corresponds to multi-touch. If a second input signal is detected from the second input device 103 in a state where a plurality of first input signals are detected, the controller 111 may control the change of the screen according to the second input signal. For example, when the multi-touch is detected, the screen may be rotated in the z-axis direction based on the x and y axes.

4 illustrates an example of a 3D screen to which a screen control function is applied according to an embodiment of the present invention. That is, in one embodiment, it is a case of controlling a screen on a three-dimensional space.

Referring to FIG. 4, the terminal device 100 includes a touch screen in which a first input device 101 and a display unit 105 are combined, and a second input device 103 in the form of a pointing device.

At this time, the display unit 105 of the touch screen displays a screen on a three-dimensional space. Here, the screen of the three-dimensional space is composed of three different axes. That is, it is composed of the X axis, the Y axis perpendicular to the X axis in the plane, and the X axis, and the Z axis perpendicular to the X axis and the space respectively.

Here, the first input device 101 detects the first input signal in the X-axis direction and the Y-axis direction, and the second input device 103 detects the second input signal in the Z-axis direction. Then, the control unit 111 calculates the first input signal in (x, y) coordinates on the two-dimensional plane. The coordinates of the second input signal in the Z-axis direction are calculated to calculate (x, y, z) coordinates on the 3D plane.

At this time, while the (x, y) coordinates on the two-dimensional plane are fixed, the coordinates in the Z-axis direction continue to change. That is, the first input signal is detected at a fixed position on the screen while the second input signal is continuously changed according to the movement of the subject.

Then, the control unit 111 displays the change of the screen according to the coordinates in the Z-axis direction based on the position corresponding to the (x, y) coordinates on the two-dimensional plane. That is, the screen can be rotated, reduced or enlarged in the Z-axis direction.

In this way, unlike the conventional method, the operation of the Z axis in addition to the X axis and the Y axis is possible, thereby enabling the ultimate three-dimensional operation.

In addition, the implementation of an application effect such as adjusting the movement or the size of the image by combining the first input signal and the second input signal sensed by the first input device 101 and the second input device 103 on the screen. This is possible.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

100: terminal 101: first input device
103: second input device 105: display unit
107: communication unit 109: memory
111: control unit

Claims (15)

In the method of controlling the screen using a heterogeneous input device,
Detecting a first input signal for controlling the screen from a first input device;
Detecting a second input signal for controlling the screen from a second input device, wherein the second input device is a separate input device different from the first input device; And
Executing a predefined screen control function when the first input signal and the second input signal are detected;
Screen control method comprising a. The method of claim 1,
The step of performing,
And when the second input signal is detected while the first input signal is detected, executing the screen control function. The method of claim 1,
The step of performing,
And if the second input signal is detected after the first input signal is detected, executing the screen control function. The method of claim 1,
The step of performing,
And executing a screen control function including any one of enlargement of the screen, reduction of the screen, movement of the screen, and rotation of the screen. The method according to any one of claims 1 to 4,
Before the step of detecting the first input signal,
Further comprising displaying a screen implemented on a plurality of different axes,
The step of performing,
Calculating the first input signal with first coordinates in at least two different axial directions defined in advance;
Calculating the second input signal with second coordinates in one predefined axial direction except for the two or more different axial directions; And
Controlling a change in a screen according to the second coordinates based on the first coordinates
Screen control method comprising a. The method of claim 5,
The controlling step,
And changing an image displayed on the screen corresponding to the first coordinate according to the second coordinate. The method of claim 5,
The controlling step,
And changing the entire image displayed on the screen according to the second coordinate by using the image displayed on the screen corresponding to the first coordinate as a reference point. The method according to any one of claims 1 to 4,
The first input device is a touch screen, the second input device is a pointing device, where the pointing device generates and moves a cursor or pointer on the screen through the movement of the subject,
Detecting the first input signal,
Detecting the first input signal generated according to the contact of the subject from the first input device,
Detecting the second input signal,
Detecting the second input signal generated according to the movement of the subject from the second input device,
The step of performing,
And executing a screen control function set for each movement direction of the subject based on the position on the screen selected according to the contact of the subject. A first input device sensing a first input signal for controlling a screen;
A second input device different from an input method of the first input device, mounted on a different position from the first input device, and configured to sense a second input signal for controlling the screen; And
Control unit for executing a predefined screen control function when the first input signal and the second input signal is detected
Terminal device comprising a. 10. The method of claim 9,
The control unit,
And determining whether to execute the screen control function by determining whether the second input signal is detected while the first input signal is detected. 10. The method of claim 9,
The control unit,
And determining whether to execute the screen control function by determining whether the second input signal is detected after the first input signal is detected. 12. The method according to any one of claims 9 to 11,
Display unit for displaying a screen composed of a plurality of different axes
Terminal device further comprising. The method of claim 12,
The control unit,
When the first input signal according to the input in two or more different axial directions defined and the second input signal according to the input in one predefined axial direction except the two or more different axial directions, Terminal device for controlling the change of the screen according to the input of the predefined one axis direction based on the two or more different axis direction. The method of claim 13,
The control unit,
A first coordinate on the screen according to the input of the two or more different axial directions and a second coordinate on the screen according to the input of the predefined one axial direction, and calculate a position corresponding to the first coordinate The terminal device changes the image displayed on the screen according to the second coordinates or the entire image displayed on the screen based on the image displayed on the first coordinates based on the second coordinates. The method of claim 12,
The first input device is a touch panel coupled to the display unit, the second input device is a pointing device, where the pointing device generates and moves a cursor or a pointer on the screen through the movement of a subject.
The control unit,
And a screen control function set differently according to a movement direction of the subject based on the position on the screen selected according to the contact of the subject.

Images