KR101658489B1 - Method for controlling screen using pointing device - Google Patents

Abstract

According to the screen control method using the pointing device according to the embodiment of the present invention, the movement detection signal according to the movement of the user's finger is analyzed to calculate the movement displacement. When the moving displacement is included in the predefined edge area of the screen, it operates in the Easy Edge Moving mode in which the area displayed on the screen is moved in a specific direction to display the invisible area. In addition, when the user operates the easy free moving mode by selection, the area displayed on the screen is moved according to the movement displacement. Also, when the cursor (or pointer) is moved according to the movement displacement and then is in the stop state, the operation is performed in the easy trigger moving mode in which the search operation of the list displayed on the screen is continued.

Pointing device, screen, menu, cursor (or pointer), pointer, full browser

Description

[0001] The present invention relates to a method for controlling a screen using a pointing device,

The present invention relates to a method of controlling a screen using a pointing device. And more particularly, to a method of controlling a screen using a pointing device that controls a screen by moving a cursor or a pointer on the screen through a finger movement of a user.

2. Description of the Related Art [0002] In recent years, as a full browser has been introduced in a mobile communication terminal, it is possible to display a web page screen provided by a PC. Here, the full browser is a browser capable of directly viewing a web site created exclusively for a PC, and enables display of a PC-dedicated site using a Java program execution function of the mobile communication terminal.

However, although the size of the screen mounted on the portable terminal is limited, it is possible to display the PC web site on the mobile terminal or the like, but it is not easy to implement it, and only a limited amount of visual information is provided using the limited screen size.

At this time, in order to display the screen as it is on the screen of the portable terminal without reducing the screen, it is divided or displayed only to a degree that can be displayed on the screen, or only the portion is displayed. To view the entire screen, it is necessary to perform a screen control operation such as moving the screen.

Therefore, there is a need for an improvement method capable of performing such screen control operations simply and efficiently.

Conventionally, in order to retrieve a plurality of data from a portable terminal, for example, when retrieving a music file list, music file items are moved one by one in a list at a time of one operation, so that a large amount of operation time is required and reaction time is slow .

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method for efficiently controlling a screen according to movement of a user's finger.

According to an embodiment of the present invention, a screen control method is provided. This method is a method of controlling a screen of a terminal device having a pointing device for generating and moving a cursor (or a pointer) on the screen through a finger movement of a user, the method comprising: Displaying a full browser screen; Analyzing the movement detection signal to calculate a movement displacement when a movement detection signal is generated from the pointing device according to movement of a user's finger; Determining whether the position of the cursor (or pointer) moved according to the movement displacement is a predefined edge area; And in the case of the edge region, operating in an Easy Edge Moving mode to move a partial area of the full browser screen in a specific direction related to the edge area to display an area that is not visible in the entire area of the full browser screen .

According to another embodiment of the present invention, a screen control method is provided. In this method, a pointing device for generating and moving a cursor (or a pointer) on a screen through a finger movement of a user is provided. The screen control method includes the steps of: Displaying a full browser screen; Analyzing a movement detection signal according to a movement of a user's finger inputted from the pointing device to calculate a movement displacement when an easy free moving mode operation according to a user's selection is requested; And moving an area displayed on the full browser screen according to the movement displacement to display an area that is not visible in the entire area of the full browser screen.

According to another embodiment of the present invention, a screen control method is provided. This method is a method of controlling a screen of a terminal device having a pointing device for generating and moving a cursor (or a pointer) on the screen through a finger movement of a user, comprising the steps of sequentially displaying a list screen composed of a plurality of pages Displaying; Analyzing the movement detection signal to calculate a movement displacement when a movement detection signal is generated from the pointing device according to movement of a user's finger; And continuing the sequential search of the list or the page when the cursor (or pointer) is moved according to the movement displacement and then stopped.

According to an embodiment of the present invention, the display area of the screen is moved according to the movement of the cursor (or the pointer) according to the finger movement, or the list search is continued, thereby increasing the convenience of screen control.

Unlike the conventional touch pad, which uses the absolute coordinates to read the coordinates of the point of contact with the object, the pointing function is realized by deriving various displacement displacements according to the finger movement, thereby improving the accuracy of pointing .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar drawing sequences are attached to similar parts throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

Now, a method of controlling a screen using a pointing device according to an embodiment of the present invention will be described in detail with reference to the drawings.

1 is a block diagram showing a configuration of a terminal device for controlling a screen using a pointing device according to an embodiment of the present invention.

Referring to FIG. 1, a terminal device 100 includes a pointing device 110, a display unit 130, a communication unit 150, a controller 170, and a memory 190.

Here, the terminal device 100 refers to an electronic device capable of performing wired / wireless communication including a pointing device 110, a display unit 130, and a communication unit 150 and capable of executing multimedia contents. For example, a laptop, an IPTV (Internet Procotol TV), a portable phone, a smart phone, an UMPC (Ultra Mobile PC), a PDA (Personal Digital Assistance)

The pointing device 110 generates and moves a cursor or a pointer on the screen through a finger movement to implement the same pointing technology as that of a PC (Personal Computer). That is, when the user moves his or her finger up, down, left, or right after pointing the finger on the pointing device 110, the cursor (or pointer) moves along the direction.

For example, the optical joystick may be configured such that light emitted from an LED (Luminescent Diode) 201 is used to transmit motion information of a finger through an optical system to a sensor This is a technique to convert this to a coordinate value and to implement it on the screen as much as moving displacement.

The pointing device 110 includes a touch pad, a hall sensor, a fingerprint recognition sensor, a pressure sensor, and the like in addition to the optical joystick.

The pointing device 110 senses the movement of the user's finger and outputs a sensing signal. At this time, the pointing device 110 may sense the physical contact of the user's finger or may sense the light reflected on the user's finger.

Here, the "finger" may be understood as other parts of the body in addition to a general finger, and may be another replaceable object that allows the pointing device 110 to grasp the movement even if it is not a body.

The display unit 130 is provided outside the terminal device 100 and displays a cursor on the screen according to the finger motion sensed by the pointing device 110 and displays information on the operation of the terminal device 100 And outputs it on the screen. That is, the display unit 130 displays a screen according to the terminal device 100 implementing full browsing, VOD (Video on Demand), Map, MP3 playback, and mail service Output.

At this time, the display unit 130 may be a commercially available LCD (Liquid Crystal Display) or the like.

The communication unit 150 provides an interface for web access through a wired / wireless network, and supports a full browsing service in the terminal device 100 so that documents and videos can be viewed in the same form as a general Internet site.

The control unit 170 is connected to the pointing device 110, the display unit 130, and the communication unit 150 to control the organic operation between the components.

In particular, when the sensing signal is transmitted from the pointing device 110, the controller 170 analyzes the sensed signal to determine whether the sensed signal is a valid user interface operation. Here, the operation of the valid user interface is stored in the memory 190 in advance.

The memory 190 stores the operation of the valid user interface according to the result of the detection signal analysis and the corresponding control information, and provides the controller 170 with the control information.

If the operation of the user interface is valid, the control unit 170 controls the screen so that the corresponding function is executed according to the detection signal analysis result, and outputs the determined screen through the display unit 130.

At this time, when the sensing signal is transmitted from the pointing device 110, the controller 170 determines whether the finger is a movement sensing signal generated by moving the finger. There are various embodiments of a method for determining whether or not the signal is a movement detection signal, but two embodiments will be described in this specification.

According to one embodiment, the control unit 170 receives the detection signal generated by the pointing device 110 sensing the physical contact of the user's finger. When the detection signal is received, the controller 170 counts the contact time, and determines that the contact time is a movement detection signal if the contact time is equal to or greater than a predetermined threshold value.

According to another embodiment, the pointing device 110 irradiates light of a nearby user's finger to generate and output a detection signal when light reflected on the user's finger is collected. Upon receiving the detection signal, the controller 170 calculates the amount of the collected light, that is, the amount of light (amount of light). If the light amount is greater than or equal to the predefined threshold value, it is determined to be a movement detection signal.

 In this case, both of the thresholds are defined as two thresholds. If the threshold value is above the first threshold value or below the second threshold value, it is determined as a movement detection signal. If the threshold value is above the second threshold value, it can be determined as a click signal for function selection.

On the other hand, if it is determined that the movement detection signal is a signal, the controller 170 detects movement, speed, and direction of the finger based on the movement detection signal to calculate the movement displacement. That is, how much the movement of the finger moves per unit time is calculated as the X and Y displacement values, and the cursor (or the pointer) is moved on the screen according to the X and Y displacement values.

At this time, the controller 170 sets the motion of the finger as a multi-level displacement value. Then, the speed of the finger motion is multiplied by the predetermined speed multiplied by the displacement value of the corresponding step, and the calculated displacement displacement value is calculated and output. Then, the pointer is moved in accordance with the speed and direction of the finger movement according to the accelerated displacement value.

If the control unit 170 determines that the motion detection signal is a motion detection signal, the following screen control functions may be used: an Easy Edge Moving mode, an Easy Free Moving mode, an Easy Trigger Moving mode .

In the case of operating in the edge-edge moving mode and the free-moving mode, the controller 170 moves the area displayed on the screen according to the control signal corresponding to the finger movement while the full browser screen is displayed.

At this time, in the full browser screen, only a partial area corresponding to the size of the screen is displayed among the areas constituting one page such as a web page and a map.

Hereinafter, 'moving an area displayed on the screen' means that when some areas of the entire full browser screen are displayed on the screen and the area displayed on the current screen moves in a specific direction, the area of the full browser screen It is defined as being displayed.

Here, when operating in the edge-edge moving mode, the controller 170 sets the edge area to the hidden mode on the full browser screen. When the cursor (or pointer) moves in this state and is located in the edge area, the edge area hidden at the position is displayed on the screen. Then, the area displayed on the screen is shifted by a predetermined interval in the direction opposite to the position of the edge area, and an area that is not shown is displayed on the screen.

Also, in the case of operating in the free moving mode, the controller 170 moves an area displayed on the screen according to the movement of the user's finger in a state in which the full browser screen is displayed. That is, the area displayed on the screen can be freely moved in the same manner as the moving direction and speed of the finger movement.

In the case of operating in the easy trigger moving mode, the control unit 170 sequentially executes the list or page search continuously in accordance with the control signal corresponding to the finger movement while the list screen is displayed, do.

Here, the list screen is defined as a screen in which a sequentially listed list is moved in a specific direction according to the movement of a cursor (or a pointer), or a screen in which a plurality of pages are viewed one page on the screen in accordance with movement of a cursor (or a pointer).

At this time, in the easy trigger moving mode, the controller 170 may set the list or page search speed according to the speed of the finger movement, and control the list or page search speed using the speed of the finger movement.

Hereinafter, a screen control method of the control unit 170 will be described in detail in connection with the configuration of FIG.

First, a screen control method according to the edge edge moving mode operation will be described with reference to FIGS. 2, 3, and 4. FIG.

FIG. 2 is a flowchart illustrating a screen control method when the mobile terminal is operated in an edge moving mode according to an embodiment of the present invention, and FIGS. 3 and 4 show a screen configuration according to an edge moving mode according to an embodiment of the present invention . Here, the same reference numerals are assigned to the same components as those in FIG.

Referring to FIG. 2, the controller 170 displays a full browser screen in which an edge region is set to a hidden mode (S101). At this time, one or more edge areas are set in a predetermined position in the predefined full browser screen. Referring to FIG. 3, the edge region 203 can be set to left, right, up, down, and four diagonal lines.

The control unit 170 determines whether the sensing signal transmitted from the pointing device 110 is a movement sensing signal (S103).

If it is not a movement detection signal, it returns to the previous step.

In the case of the movement detection signal, the finger movement and direction are detected based on the movement detection signal (S105), and the movement displacement is calculated based on the detected content (S107). Then, the cursor (or pointer) is moved according to the computed displacement (S109).

The controller 170 determines whether the cursor (or pointer) moved in step S109 is an edge area (S111). Referring to FIG. 3, it is determined whether the edge areas 203 are set to left, right, top, bottom, and four diagonal lines.

If it is not the edge area, the process returns to step S103.

In the case of the edge area, an edge area set to the hidden mode is displayed on the screen (S113). Referring to FIG. 3, an icon 203 indicating an edge area is displayed at a specific position on the full browser screen output from the display unit 130. FIG.

Then, an area displayed on the screen is moved in a direction opposite to the position of the edge area (S115). Referring to FIG. 4, when the cursor (or pointer) 201 moves and is positioned in the edge area set on the diagonal line on the upper right side, the area displayed on the screen is shifted in the direction of the dotted arrow, Is displayed.

Although not shown in the drawing, when the cursor (or pointer) 201 moves and is located in the edge area set on the upper left side diagonal, the area displayed on the screen moves in the diagonal direction on the lower right side and the area that is not seen in the upper left side diagonal direction It is displayed on the screen.

When the cursor (or pointer) 201 moves and is positioned in the edge area set on the diagonal line on the lower right side, the area displayed on the screen moves in the upper left diagonal direction and the area that is not seen in the lower right diagonal direction is displayed on the screen.

When the cursor (or pointer) 201 moves and is positioned in the edge area set to the lower left side diagonal, the area displayed on the screen moves in the diagonal direction on the upper right side and the area that is not seen in the lower left side diagonal direction is displayed on the screen.

When the cursor (or pointer) 201 moves and is positioned in the edge area set to the left, the area displayed on the screen moves to the right, and an area not shown on the left is displayed on the screen.

When the cursor (or pointer) 201 moves and is positioned in the edge area set on the right side, the area displayed on the screen moves in the left direction, and the area that is not seen on the right side is displayed on the screen.

When the cursor (or pointer) 201 moves and is positioned in the edge area set on the upper side, the area displayed on the screen moves downward and the area that is not seen on the upper side is displayed on the screen.

When the cursor (or pointer) 201 moves and is positioned in the edge area set to the lower side, the area displayed on the screen moves upward and the area that is not seen on the lower side is displayed on the screen.

At this time, the moving range of the area displayed on the screen may be set in a predetermined interval section set in advance. For example, the entire area to be displayed on the screen is divided into a plurality of specific sections by an area displayed on the screen, and then the specific area is moved.

Next, a screen control method according to the easy pre-moving mode operation will be described with reference to FIG.

FIG. 5 is a flowchart illustrating a screen control method when operating in an easy pre-moving mode according to an embodiment of the present invention.

Referring to FIG. 5, the controller 170 displays a full browser screen (S201).

Thereafter, the control unit 170 determines whether the user requests the easy freezing mode through menu selection (S203).

When the free motion mode is requested, the controller 170 determines whether a motion detection signal is input from the pointing device 110 (S205).

If the movement detection signal is not input, the process returns to the previous step.

When the movement detection signal is inputted, the controller 170 detects the finger movement, speed and direction based on the movement detection signal (S207), and calculates the movement displacement based on the detected content (S209).

The controller 170 moves the area displayed on the screen according to the movement displacement (S211).

Next, a screen control method according to the easy trigger moving mode operation will be described with reference to FIG.

FIG. 6 is a flowchart illustrating a screen control method when operating in an easy trigger moving mode according to an embodiment of the present invention.

Referring to FIG. 6, the controller 170 sequentially displays a list or a list screen including a plurality of pages (S301).

Thereafter, it is determined whether the sensing signal transmitted from the pointing device 110 is a movement sensing signal (S303).

If it is not a movement detection signal, it returns to the previous step.

In the case of the movement detection signal, the controller 170 detects the finger movement, speed and direction based on the movement detection signal (S305), and calculates the movement displacement based on the detected content (S307). Then, the cursor (or pointer) is moved according to the computed displacement (S309).

The control unit 170 determines whether a movement detection signal is input even after the cursor (or pointer) is moved (S311).

If no movement detection signal is input, the process returns to step S303.

When the movement detection signal is inputted, the finger, the movement and the velocity direction detection (S313) and the movement displacement corresponding thereto are calculated (S315) based on the movement detection signal, and then it is determined whether the movement displacement is equal to or less than a specified threshold value (S317). Here, the threshold value is defined in advance as a value indicating a state where the movement is stopped.

In other words, the controller 170 moves the cursor (or the pointer) and then performs steps S311 through S317 to determine whether the movement is stopped, which corresponds to the movement detection signal because it is not a pushing operation for selecting a function .

If the calculated displacement in step S315 exceeds the predetermined threshold value, the controller 170 performs step S309. In this case, the controller 170 moves the cursor (or pointer) according to the displacement detected in step S315.

If it is less than the specified threshold, the controller 170 extracts the search speed corresponding to the detected speed in step S305 (S319). Here, the control unit 170 maps the search speed in advance according to the speed of the finger movement.

The controller 170 continues the list search, i.e., the list or page search, in the same direction as the direction detected in step S305 at the extracted search speed (S321). In other words, unlike the ordinary scroll function which stops after a search, the search continues at a constant speed unless there is a separate operation.

Then, the controller 170 determines whether or not the movement detection signal is inputted (S323) and continues the operation of S321 as long as the movement detection signal is inputted. However, if the movement detection signal disappears, the step ends.

FIGS. 7, 8, and 9 show a screen configuration of an easy trigger moving mode according to an embodiment of the present invention. Here, the same reference numerals are assigned to the same components as those in FIG.

Referring to FIG. 7, the display unit 130 outputs a mail list. The mail list can be sequentially retrieved in the arrow direction (207).

When the cursor moves up and down according to the finger movement of the pointing device 110, the control unit 170 continuously executes the sequential search from the top to the bottom of the mail list. That is, when the currently displayed mail item is moved downward one by one, the display unit 130 repeatedly performs the operation in which the mail item which is not shown is moved downward from the top.

Also, referring to FIG. 8, the display unit 130 outputs a multimedia file list. The multimedia file list can be sequentially retrieved in the direction of the arrow 209.

When the cursor moves from the left to the right according to the finger movement of the pointing device 110 and then stops, the controller 170 continuously searches for the multimedia file list from left to right and executes the search sequentially. That is, in the display unit 130, the currently displayed multimedia files move to the right one by one and disappear, and a multimedia file which is not shown is displayed from left to right is repeatedly executed.

9, the display unit 130 outputs one page 211 of the mobile book. At this time, when the cursor moves from left to right according to the finger movement of the pointing device 110, the control unit 170 continues the page turning from left to right. That is, continues the page turning from the current page 211 to the previous page 211.

The embodiments of the present invention are not limited to the above-described apparatuses and / or methods, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded It is possible.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

1 is a block diagram showing a configuration of a terminal device for controlling a screen using a pointing device according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a method of controlling a screen when operating in an edge-edge moving mode according to an embodiment of the present invention.

FIG. 3 and FIG. 4 show a configuration of an easy-to-see moving mode according to an embodiment of the present invention.

FIG. 5 is a flowchart illustrating a screen control method when operating in an easy pre-moving mode according to an embodiment of the present invention.

FIG. 6 is a flowchart illustrating a screen control method when operating in an easy trigger moving mode according to an embodiment of the present invention.

FIGS. 7, 8, and 9 show an easy trigger moving mode screen configuration according to an embodiment of the present invention.

Claims (10)

A method of controlling a screen of a terminal device having a pointing device for generating and moving a cursor or a pointer on a screen through a finger movement of a user, Displaying a full browser screen in which a partial area corresponding to a screen size of the terminal device is exposed; Analyzing the movement detection signal to calculate a movement displacement when a movement detection signal is generated from the pointing device according to movement of a user's finger; Determining whether the position of the cursor or the pointer moved according to the movement displacement is a predefined edge area; And In the case of the edge area, an easy edge moving mode is operated to move a partial area of the full browser screen in a specific direction related to the edge area to display an area that is not visible in the entire area of the full browser screen step And a screen control method. The method according to claim 1, Wherein the step of exposing comprises: Displaying the edge area set in the hidden mode on the full browser screen; And A step of moving a part of the full browser screen in a direction opposite to the position of the edge area by a predetermined period and displaying an area that is not visible at the edge area And a screen control method. 3. The method of claim 2, Further comprising the step of dividing and setting the entire area of the full browser screen in units of areas corresponding to the screen size of the terminal device, Wherein the step of exposing an area that is not visible at a position of the edge area comprises: And moving a partial area of the full browser screen in units of the set area. A method of controlling a screen of a terminal device having a pointing device for generating and moving a cursor or a pointer on a screen through a finger movement of a user, Displaying a full browser screen in which only a partial area corresponding to a screen size of the terminal device is exposed; Analyzing a movement detection signal according to a movement of a user's finger inputted from the pointing device to calculate a movement displacement when an easy free moving mode operation according to a user's selection is requested; And A step of moving an area displayed on the full browser screen according to the movement displacement and displaying an area which is not seen in the entire area of the full browser screen And a screen control method. A method of controlling a screen of a terminal device having a pointing device for generating and moving a cursor (or a pointer) on a screen through a finger movement of a user, Displaying a list screen in which a list is sequentially listed or composed of a plurality of pages; Analyzing the movement detection signal to calculate a movement displacement when a movement detection signal is generated from the pointing device according to movement of a user's finger; Determining whether the moving displacement is less than or equal to a predefined threshold; Determining that the cursor (or pointer) is moved and then stopped when the predetermined threshold is not exceeded; And Continuing the sequential search of the list or the page according to the movement displacement if it is determined to be in the stopped state And a screen control method. 6. The method of claim 5, After said successive steps, Determining whether the movement detection signal is generated; If the movement detection signal is not generated, terminating the continuous step; And When the movement detection signal is generated, continuing the sequential step Further comprising the steps of: The method according to claim 5 or 6, Determining whether the predetermined threshold value is less than or equal to the predefined threshold value, Moving the cursor (or pointer) according to the movement displacement when the predefined threshold is exceeded Further comprising the steps of: 6. The method of claim 5, Before the step of displaying the list screen, Further comprising the step of setting a corresponding search speed for each speed of the finger movement, Wherein the successive steps comprise: Extracting a search speed corresponding to a speed of the finger movement according to the movement displacement; And Performing the sequential search at an extracted search speed Further comprising the steps of: The method according to any one of claims 1, 4, and 5, The step of calculating the displacement includes: Receiving a detection signal from the pointing device according to contact of a user's finger; Analyzing the sensed signal and determining the sensed signal as a movement sensing signal if the contact time is greater than or equal to a predefined threshold; And Detecting movement, speed and direction of a finger based on the movement detection signal to calculate a movement displacement And a screen control method. The method according to any one of claims 1, 4, and 5, The step of calculating the displacement includes: Receiving a sensing signal by light reflected from a user's finger from the pointing device; Analyzing the detection signal and determining the light amount as a movement detection signal if the light amount is equal to or greater than a predefined threshold; And Detecting movement, speed and direction of a finger based on the movement detection signal to calculate a movement displacement And a screen control method.

Images