WO2012064128A2

WO2012064128A2 - Touch screen apparatus and method for controlling same

Info

Publication number: WO2012064128A2
Application number: PCT/KR2011/008568
Authority: WO
Inventors: 채상우
Original assignee: Chae Sang-Woo
Priority date: 2010-11-10
Filing date: 2011-11-10
Publication date: 2012-05-18
Also published as: WO2012064128A3; KR101095851B1

Abstract

Disclosed is a method for controlling a touch screen. The method of the present invention involves displaying a pointer on a display panel which is spaced apart from a finger touch position on a touch panel by a predetermined distance and which is not visually covered by a finger, moving and displaying the pointer in accordance with the movement of the finger while maintaining a predetermined distance between the pointer and the finger when the finger moves while touching the touch position, enabling an object to be on standby for selection when the finger is removed from the touch panel while the display position of the pointer is set on the object to be selected, and selecting the standby object when a selection command is inputted before the display of the pointer is suppressed. Accordingly, an erroneous selection caused by an erroneous operation can be prevented during touch dragging on a touch screen.

Description

Touch screen device and control method

The present invention relates to a touch screen device and a control method thereof, and more particularly, to an apparatus and method for displaying a user interface graphic object at a position different from a touch position in response to a finger touch and controlling the displayed GUI object.

Recently, due to the development of wireless communication technology, a touch screen using a touch sensing device has been widely used as a control method of a graphic user interface in wired and wireless electronic devices of mobile devices and ubiquitous environments.

When operating electronic devices using software in electronic devices using a touch screen, the multi-network environment of the user may be richer and more diverse, and a more convenient graphical user interface may be provided.

In order for a user to utilize a program well and to select and use a GUI object in an electronic device equipped with a touch screen, the user should be able to easily select, enlarge or reduce the displayed GUI object by using an auxiliary device corresponding thereto. As a related art, there is a multi-touch method for a multi-touch disclosed in US Patent Publication No. 2008/0122796.

It was difficult to directly target small objects displayed on the screen with a blunt finger in an environment using a user graphic interface.

Therefore, there is a need to provide a method that enables a user to hover the cursor using only their finger on a touch-sensitive display.

In Patent Publication Nos. 2006-0072082 (Microsoft) and U.S. Patent Publication No. 2009/0288043 (Purple Labs), a cursor is first displayed on a screen, and when a touch is detected within a predetermined area around the cursor display position, the touch position and the cursor are displayed. When the display position is interlocked and the touch position is moved, the cursor display position follows the same interval while maintaining the same distance, and when the touch position is touched, the tapping operation recognition initiates a cursor control technique that recognizes that the tapping operation occurs at the cursor display position.

In Patent Publication No. 2008-0070226 (Samsung), a first touch and a second touch are detected, a pointer is displayed at a first touch position, and the movement of the second touch is controlled by the position movement of the pointer displayed at the first touch position.

By displaying and tapping the cursor near the touch position, the cursor display direction is set clockwise around the touch position to facilitate selection in the rectangular area.

In Patent Publication No. 2009-0094360 (Microsoft), while maintaining a finger in contact with the screen, the user guides the position of the pointer based on visual feedback provided by the callout, and the user guides the screen to the screen. You can precisely move and fine-tune the pointer position by moving your finger on the surface of the screen until it is over a copy of the desired target displayed in the non-occluded area of the screen.

In Japanese Patent Laid-Open No. 1944-51908 (Sony), a pointer is displayed at a position spaced a predetermined distance from a touch position in a predetermined direction.

That is, in the prior arts, when the touch position and the selection position are the same, it is impossible to determine whether the correct selection position is selected by a finger, so that the correct selection is made by displaying a pointer or a selection position at a position different from the touch position to confirm this.

These devices typically perform a selection command of a selection position by moving the pointer to a desired selection position (drag) and then releasing the touch while holding the pointer at the selection position while maintaining the touch state after the touch screen device. .

However, if the touch is undesirably dropped during the movement, the selection command is performed at the touched location, which causes an unwanted object to be selected and executed.

In other words, the existing multi-screen method uses a finger as a pointer itself, which causes a lot of mistake in clicking confirmation and frequent errors, making it difficult for users to search the Internet or perform tasks. If not, you can select a small link area after zooming out and zooming out using two fingers in selecting a small area displayed on the GUI object. This method has a problem that it is not easy to select GUI objects with a more natural touch method in the existing web environment, and seriously, a new app needs to be made to fit the area of the average finger's finger to operate the gesture-based control. It causes difficulties.

SUMMARY OF THE INVENTION An object of the present invention is to provide a touch screen device and a method of controlling the same, which can achieve convenience of a touch input in order to solve the problems of the related art.

Another object of the present invention is to provide a touch screen device and a control method thereof capable of accurately controlling an object.

Another object of the present invention is to provide a touch screen device and a control method capable of controlling a display position of a pointer adaptively to a physical environment of a screen when a touch is moved.

Still another object of the present invention is to provide a touch screen device and a control method having a zoom in and zoom out function associated with a pointer.

Another object of the present invention to provide a touch screen device and a control method having a virtual indicator bar function associated with the pointer.

Another object of the present invention is to provide a touch screen device and a control method having a virtual touch ball function associated with a pointer.

Another object of the present invention to provide a touch screen device and a control method capable of multi-touch multi-pointer control.

In order to achieve the above object of the present invention, the control method of the present invention is a touch screen device having a display panel and a touch panel, the touch position corresponding to the finger touch (or touch down) on the touch panel, and recognized The pointer is displayed on an area of the display panel which is a certain distance away from the touch position and is not visually obscured by the finger, and when the finger is moved while the finger is touched at the touch position, the pointer is maintained while maintaining a certain distance in conjunction with the finger movement. When the display is moved and the display position of the pointer is positioned on the object to be selected, when the finger is released (or touched up), the object is waited for selection, and when the selection command is input in the selection waiting step, the object waiting for selection is selected. It is characterized by activating.

In the present invention, the selection wait step is limited to a certain time after the touch release and if there is no input of a selection command until the predetermined time elapses, it is preferable to erase the displayed pointer display.

In addition, the selection command may be generated by at least one of a touch operation for displaying a pointer and another touch operation (touch down, touch click, double touch click), or key input.

In the present invention, the pointer operation mode is activated by touching the pointer mode selection button displayed on the touch screen, which is convenient for use in parallel with the existing gesture operation mode.

In the present invention, the pointer movement display step may variably control any one of a distance or a direction between the touch point and the pointer display point in conjunction with the distance at which the touch movement enters the rectangular area set near the edge of the touch screen.

In addition, the pointer movement display step may variably control any one of a distance or a direction between the touch point and the pointer display point corresponding to the distance between the lower edge of the touch screen and the touch point. In addition, the pointer movement display step may variably control the distance between the touch point and the pointer display point corresponding to the distance between the center point and the touch point of the touch screen.

In the present invention, the distance between the reference point and the touch point in the indicator bar control zone in the virtual indicator bar mode, and variably control at least one of the distance or direction between the touch point and the display point of the indicator bar corresponding to the calculated reference point distance A virtual indicator bar mode may be performed.

According to the present invention, in a touch screen device displaying a pointer at a setting position spaced a predetermined distance away from a first touch point, the pointer display area is displayed on the other hand while one hand is touched at the first touch point. Detects the touch with the other hand, moves and displays the pointer in association with the touch movement by the other hand, and between the second touch point and the first touch point where the touch-up is generated in conjunction with the touch-up of the other hand. Updating the distance and direction to a new setting position of the pointer makes setting the display direction and distance of the pointer very easy.

In the present invention, a touch screen device for displaying a pointer at a setting position spaced apart by a set distance in a set direction from a touch point, wherein an enlarged symbol or a reduced symbol is displayed in a display area of the pointer, and a touch of the display area of the pointer is detected. In response to the touch detection, the enlargement or reduction corresponding to the enlarged or reduced symbol is executed, the enlarged or reduced symbol in the display area of the pointer is displayed as a reduced or enlarged symbol, and the touch detection step is performed in response to the touch detection. Iteratively repeating the inverted display steps makes the zoom in and zoom out interface very convenient.

In the present invention, the virtual touch ball is displayed on the touch screen, the direction and rotation speed of rotating the touch ball by touch in the virtual touch ball display area are detected, and the image is displayed by moving in response to the detected rotation direction and rotation speed. In addition, when the touch-up is detected in the image movement display step, it is very convenient to move the image on the touch screen by gradually decelerating and stopping the image movement speed in the movement direction of the touch-up moment.

In the present invention, it detects the multi-touch, infers the longitudinal direction of the touched fingers from the detected multi-touch points, and displays the pointers corresponding to a certain distance extending from each of the touch points in the inferred finger length direction, respectively, In addition, the display screen is conveniently controlled by interlocking the multiple pointers linked to the multiple touch points in a group.

Here, the inferring step calculates a bisector that bisects a straight line between two farthest touch points among the detected multiple touch points, and extends a vertical extension line having a certain length in one direction from the bisector to meet the horizontal line. It is preferable to calculate the reference point, calculate the azimuth angle of each touch point counterclockwise from the horizontal line around the reference point, and determine extension lines passing through the touch points from the reference point in the longitudinal direction of the finger corresponding to each touch point. .

In the touch screen device including the display panel and the touch panel in the present invention, when the pointer mode is selected, the pointer is displayed at an arbitrary first position of the touch screen, and the touch position corresponding to the finger touch (or touch down) on the touch panel is displayed. Recognizes and jumps the pointer displayed at the first position to a specific second position of the display panel region which is separated by a predetermined distance from the recognized touch position and is not visually covered by the finger, and the finger is touched at the touch position. When moving, the pointer is moved and displayed while maintaining a certain distance in conjunction with the movement of the finger, and the object is selected when the finger is released (or touched up) while the display position of the pointer is positioned on the object to be selected. When the selection command is entered in the selection wait phase, the object waiting for selection is activated. It is also possible.

The apparatus of the present invention includes a touch panel or a sensor unit, a display panel disposed below the touch panel, an input / output unit for inputting user key commands, a memory in which a touch screen control program is stored, and a touch screen control program stored in the memory. It includes a control unit for performing. The touch screen control program recognizes a touch position corresponding to a finger touch (or touch down) on the touch panel, displays a pointer in an area of the display panel which is separated from the recognized touch position by a distance and is not visually obscured by the finger. When moving a finger while touching a finger on a position, the pointer is moved and displayed while maintaining a certain distance in conjunction with finger movement, and the finger is released when the display position of the pointer is positioned on an object to be selected. Or touch-up) to wait for selection of an object and to activate an object that is waiting for selection when a selection command is input in the selection waiting step.

The apparatus of the present invention may be implemented in any one of software, hardware or a combination thereof.

By using the electronic device using the method and method of the present invention, it is possible to easily click and confirm the image object which is the target object by using the pointer to the data and the web environment created in the existing computing environment. It can be used as a means of connecting the web environment and the app environment in a more familiar way, and the information provided on the screen can be checked more quickly and easily by performing the functions of zoom in and zoom out or zoom in and zoom out provided by the pointer. The automatic direction setting of the pointer using a touch position group of five or less fingers of a user enables a user to select and click a single finger on a large touch screen using a large number of pointers even in a large touch sensing device. Easy GUI objects within the scope of By using the pointer direction program, users can work together to provide users with fast internet search, work and various functions of the pointer, and give users a sense of convenience and efficiency in using multi-network communication and electronic information. It will be used as a means of improving the environment and connecting existing computer network infrastructure more efficiently.

1 is a block diagram of a touch screen control device according to an embodiment of the present invention.

2 is a screen state diagram for explaining the configuration of a single pointer according to the present invention;

3 is a flowchart illustrating a pointer mode selection process according to the present invention.

4 is a flowchart illustrating a pointer display and an object selection process linked to a touch operation in the pointer mode according to the present invention.

5 is a view for explaining a blind spot on the touch screen.

6 is a view for explaining the operation principle of the display position control of the pointer 150 in each area of the rectangular zone according to the present invention.

FIG. 7 is a flowchart illustrating a process of controlling a pointer display position in the blind spot of the embodiment of FIG. 6.

8A and 8B are photographs showing a state in which a distance between a touch position and a display position is changed as the lower edge of the touch screen is approached.

9 is a view for explaining an embodiment for variably controlling the display position of the pointer 150 in the entire screen area.

FIG. 10 is a flowchart for explaining a pointer display position control process in an entire region of one embodiment of FIG. 9; FIG.

11 is a view for explaining an embodiment of a virtual indicator rod using a variable control technique of the display position of the present invention.

12A to 12H are screen state diagrams for explaining the environment setting of a pointer according to the present invention;

13 is a view for explaining a method of setting the direction and distance of the pointer of the present invention in the touch state.

14 is a screen state diagram showing a state in which a point display area is touched according to the present invention;

Fig. 15 is a flowchart for explaining an enlargement / reduction processing program according to the present invention.

16 is a screen state diagram showing the virtual controller 170 according to the present invention.

17 is a screen state diagram for explaining a virtual touch ball according to the present invention.

18 is a flowchart illustrating a virtual touch ball control operation according to the present invention.

19 is a diagram for explaining a two-touch two pointer according to the present invention;

20 is a view for explaining a three touch three pointer according to the present invention.

21 is a view for explaining a five touch five pointer according to the present invention.

FIG. 22 is a flowchart illustrating a pointer display and an object selection process associated with a touch operation in a multi-touch multi-pointer mode according to the present invention; FIG.

23 is a view for explaining a modified embodiment of the multi-touch multi-pointer mode according to the present invention according to the present invention.

24 is a diagram for explaining the principle of calculating the display point azimuth angle in the modified embodiment.

25 is a screen state diagram of a modified embodiment for explaining the display operation of the pointer according to the present invention;

FIG. 26 is a flowchart illustrating a pointer display and an object selection process linked to a touch operation according to a modified embodiment; FIG.

In order to achieve the above object, the present invention will be described in detail with reference to the drawings, and the present invention is provided by way of example so that the spirit according to the embodiment can be sufficiently transmitted, and the present invention is not limited to the embodiments described below. It may also be embodied in the form.

In the present invention, the touch screen controller is an electronic device having a touch screen control function, for example, a smart phone having a touch function, a monitor having a touch function of a digital camera or camcorder, a navigation function having a touch function, a portable multimedia player having a touch function, It includes tablet computers such as iPads and Galaxy Tabs, touchscreen monitors for personal computers such as laptops and desktop computers, smart televisions with touch capabilities, and large wall-mounted displays with touch capabilities.

Definitions of terms used in connection with the touch operation in the present invention are as follows.

Touchdown --- Indicates an operation state in which a finger touches the touch panel, and the controller recognizes the touchdown state when the touch state is maintained for a predetermined time, for example, 300ms to 500ms without moving from the first touch position.

Touch release or touch up --- It means the operation state that the finger touches the touch panel.

Touch movement --- It refers to an operation state of moving on the touch panel while keeping a finger in a touch-down state.

Touch-tapping --- Defines an operation state in which touchdowns and touchups are sequentially performed and maintains a short time from the touchdown to the touchup within a predetermined time, rather than the recognition time of the touchdown described above. Set within a short time, such as 100 ms to 400 ms.

Double tapping --- A touch state where two touch clicks are performed in succession.

1 is a block diagram of a touch screen control device according to the present invention.

Referring to FIG. 1, the touch screen controller 100 includes a touch screen 110, a controller 120, an input / output unit 130, and a memory unit 140.

The touch screen 110 includes a touch panel 114 on the display panel 112. The display panel 112 is configured of a flat panel display such as an OLED or an LED and displays an image, a pointer image, an object, etc. for a user interface. The touch panel 114 detects a touch of a finger by a pressure-sensitive or electrostatic method by a sensor unit to recognize a touch position or a touch coordinate. The control unit 120 is composed of a microprocessor or microcomputer such as a central processing unit (CPU) and a digital signal processing unit (DSP), executes a touch screen control program, and displays display data corresponding to a recognized touch position in response to a given command. It is generated and provided to the display panel to control the operation of the entire touch screen. The input / output unit 130 includes a key input unit, a serial input / output unit, a parallel input / output unit, a wired / wireless communication module, etc., and receives a key command signal or an external data signal, etc., and provides the input to the controller 120 or data generated from the controller 120. Output to the outside. The memory unit 140 includes a cache memory, a DRAM, an SRAM, a flash memory, a magnetic disk storage device, an optical disk storage device, and the like, stores a touch screen control program, and stores data generated by the controller 120.

The controller 120 is operated by a graphical user interface (GUI) system to display and control GUI objects on the display panel 112. A GUI object or an image object refers to a unit in which displacement and deformation of an image may be involved and image processing may be performed. For example, the GUI object may be an icon, a desktop, or a window for an application (eg, Word, Excel, power point, internet explorer, etc.) and may be displayed in full or partial area on the screen of the touch screen 110. Objects selected by the user include images, videos, and music. A GUI object or an image object refers to a unit in which displacement and deformation of an image may be involved and image processing may be performed. For example, the GUI object may be an icon, a desktop, or a window for an application (eg, Word, Excel, power point, internet explorer, etc.) and may be displayed in full or partial area on the screen of the touch screen 110. Objects selected by the user include images, videos, and music. UI elements include icons, button boxes, pointers, virtual touch balls, and virtual indicator bars provided by GUI objects.

2 is a screen state diagram for explaining the structure of a pointer according to the present invention.

Referring to the drawings, the pointer 150 of the present invention has a "+" plus sign in a translucent circle, and the intersection point of the "+" plus sign is presented as the display position 152 (Px, Py).

The display position 152 of the pointer 150 is spaced apart from the touch position 154 (Tx, Ty) by a distance d, and the azimuth angle θ from the horizontal line is displayed at 90 ° or 12 o'clock.

The display position 152 of the pointer 150 is sufficient if the display area is not covered by the finger. The shape or shape of the pointer 150 is not limited to the illustrated circle, but various shapes and colors. Translucent or transparent can be transformed into, but includes "+" plus sign inside.

The pointer mode selection button 160 is displayed on the lower left of the display panel in a translucent or transparent manner. The pointer mode selection button 160 is marked with a letter "P" in a circle and is displayed in a different color in the normal mode and the pointer mode to indicate the selected mode.

The pointer mode selection button 160 is not fixed to the lower left side and may be positioned in an arbitrary area of the display panel by setting the environment. The pointer mode selection button 160 is for distinguishing the pointer mode to be used in parallel with the existing gesture control method. When the pointer mode selection button 160 is touched, the controller 120 switches from the normal mode to the pointer mode. In the point mode, other control schemes, such as gesture control schemes, are disabled.

In addition, a menu bar 162 may be displayed at the bottom of the screen. The menu bar 162 includes a single / multi mode button 162a, an environment setting button 162b, a virtual controller button 162c, a virtual indicator bar button 162d, and a virtual touch ball button 162e.

Referring to FIG. 3, in the normal mode standby state (S102), the control unit 120 checks whether the pointer mode selection button display is set, and at the time of setting, the pointer mode selection button ( 160 displays (S102 to S106). When the pointer mode selection button 160 is selected (S108), the controller 120 changes the color of the letter “P” to indicate that the pointer mode is present (S110). In the pointer mode, the erase or check of the set time is checked (S112 and S114). When the pointer is erased on the screen in step S112 or when the set time elapses in step S114, the pointer mode is released by restoring the color of the letter "P" to the original color to indicate that the pointer mode is in the normal mode (S116).

Referring to FIG. 4, first, when a user touches the pointer mode selection button 160, the controller 120 sets setting data (distance value, azimuth, size, transparency, shape, and color data) of the pointer stored in the memory unit 140. Take a to configure a pointer graphic image and switch the system to the pointer standby mode (S122). Subsequently, when a finger touchdown is detected on the touch panel 114 (S124), the controller 120 substitutes the distance value and the azimuth angle set from the touch position 154 (Tx0, Ty0) and displays the display position 152 (Px0, Py0). Calculate and display the prepared pointer graphic image in the calculated display position (S126). When the finger is moved while maintaining the touch-down state in step S104, the controller 120 calculates the display position value in real time in response to the change in the touch position value according to the movement, thereby maintaining the set distance and the set azimuth angle. Control the display. The finger movement is stopped and the touch-up operation state in which the finger contact falls on the touch panel is detected (S128). When the touch-up is detected in step S128, the controller 120 calculates the current position 156 (Px1, Py1) where the pointer 150 is located as the selection position, not the current touch position. The controller 120 waits for selection of the object 157 corresponding to the selection position (S130). Subsequently, the controller 120 checks whether a selection command such as a touchdown or a touch click is input in the selection standby state (S132), and checks whether the set selection waiting time has elapsed (S134). When a selection command such as a touchdown or a touch click is input in step S132, the object 157 that is waiting for selection is activated (S136) and the process returns to step S122. In step S134, the controller 120 automatically returns to step S122 when there is no input of a selection command until the set time elapses.

Here, the pointer mode selection button 160 may automatically disappear when the selection object is activated. This is because the selection operation is convenient for the pointer and the touch control is convenient for the screen operation unless the word writing mode is used.

In addition, when the pointer standby mode is executed, it is preferable to temporarily suspend a specific touch control operation command (for example, vertical movement control) so that the entire screen or the entire image area is fixed.

In the above-described embodiment, the touch position and the pointer display position are not fixed to the set value in the pointer display and movement process of step S126, but may be controlled to be automatically changed in the specific region.

FIG. 5 is a view for explaining a blind spot on the touch screen, and FIG. 6 is a view for explaining a preferred embodiment of display position control of the pointer 150 in each area of the blind spot.

In FIG. 5, since the entire blind spot 180 is a finger thick when a finger is touched, an area where an object of a size smaller than the finger thickness is not touched in an edge region of the touch screen 110.

The total square region 180 is set to the width D of the edge branches from the upper, lower, left and right boundary lines, and includes the upper side region 182, the lower side region 184, the left side region 186, the right side region 188, and the upper left corner region 181, The upper right corner area 183, the lower left corner area 185, and the lower right corner area 187 are divided.

When the touch position enters the blind spot 180 by the touch movement, it is controlled as follows at a distance do from the display position and the azimuth angle θ = 90 °.

The vertical distance d1 of the pointer 150 in the upper side region 182 is determined by the following equation.

d1 = d0-(C1 × S1)

Where C1 is the coefficient of the upper edge region and S1 represents the vertical distance from the rectangular boundary to the upper edge region. Therefore, in the upper side region 182, the azimuth angle maintains the set value and the vertical distance decreases in inverse proportion to the entry distance S1.

The vertical distance d1 of the pointer 150 in the lower side region 184 is determined by the following equation.

d1 = d0-(C2 × S2)

Where C2 is the coefficient of the lower edge region and S2 is the vertical distance from the rectangular boundary to the lower edge region. Therefore, in the same manner as the upper side region 182, in the lower side region 184, the vertical distance is reduced in inverse proportion to the entry distance S2.

The horizontal distance dL of the pointer 150 in the left side region 186 is determined by the following equation.

dL = C3 × S3

Where C3 is the coefficient of the left side region and S3 represents the horizontal distance from the rectangular boundary to the left side region. The vertical distance is maintained at d0, but the horizontal distance dL is variable.

Therefore, the azimuth angle θL is determined by the following equation.

θL = 90˚ + actan (dL / d0)

In the upper left corner region 181, since the vertical distance and the horizontal distance in the upper and left edge regions are respectively reduced in inverse proportion to the entry horizontal component and the entry vertical component, both the distance and the azimuth angle are variably controlled.

In the same manner, in the lower left corner region 185, the vertical distance and the horizontal distance in the lower side region and the left side region are reduced in inverse proportion to the entry horizontal component and the entrance vertical component, respectively, so that both the distance and the azimuth angle are variably controlled.

The horizontal distance dR of the pointer 150 in the right side region 188 is determined by the following equation.

dR = C4 × S4

Where C4 is the coefficient of the right side region and S4 represents the horizontal distance from the rectangular boundary to the right side region. The vertical distance is maintained at d0, but the horizontal distance dR is variable.

Therefore, the azimuth angle θR is determined by the following equation.

θR = 90˚- actan (dR / d0)

In the upper right corner region 183, since the vertical distance and the horizontal distance in the upper and lower right regions are respectively reduced in inverse proportion to the entry horizontal component and the entry vertical component, both the distance and the azimuth angle are variably controlled.

In the same manner, in the lower right corner region 187, the vertical distance and the horizontal distance in the lower side region and the right side region are reduced in inverse proportion to the entry horizontal component and the entrance vertical component, respectively, so that both the distance and the azimuth angle are variably controlled.

FIG. 7 is a flowchart illustrating a process of controlling a pointer display position in the rectangular area of the embodiment of FIG. 6.

Referring to FIG. 7, the controller 120 inputs a touch position value (S142) when the input touch position value enters the range of the set rectangular area 180 (S144). It is checked whether it is the left or right side area (S150) or the top, bottom, left and right corner areas (S154). In step S146, if the upper or lower side area is inversely proportional to the entry distance from the boundary line of the blind spot, the distance value is varied (S148). In step S150, the azimuth angle is changed in inverse proportion to the entry distance from the boundary line of the blind spot in the left or right side area (S152). In step S154, if any one of the upper, lower, left, and right corner regions is inversely proportional to the entry distance from the boundary line of the blind spot, the distance value and the azimuth angle are simultaneously changed (S156). The distance value or azimuth data calculated in each of steps S148 to S156 is transmitted from the control unit 120 to the pointer display position control program and reflected in the screen coordinate value of the pointer image.

As described above, in the blind spot 180, the distance and azimuth between the display position and the touch position of the pointer are automatically controlled adaptively to the entry distance, thereby making it easy to select an object in the blind spot.

In the above-described embodiment, the rectangular area is divided into four sides and four corners to control the distance value and the azimuth angle, but the present invention is not limited thereto, and any one or more of them may be used in combination. For example, in the simplest control method, the vertical area can be variably controlled by setting only the lower area to the rectangular area. 8A to 8C are photographs illustrating a state in which the distance between the touch position and the display position according to the present invention changes as the lower edge approaches.

In the above-described embodiment, only a single touch has been described. However, even when two or more touches exist at the same time, the rectangular area variable control of the display point for each touch point will be equally applied.

In addition, in the present invention, the pointer display position may not be variably controlled in the rectangular area but may be extended in a variable control method over the entire screen area.

In FIG. 9, the pointer display point corresponding to the touch point T0 (0, -T0) spaced by the set distance d0 in the -y axis direction from the center point TS0 of the touch screen 110 is the reference display point (0,0). It is done. If the radius r of the virtual circle 190 inscribed by the touch screen 110 is q and the distance between the origin point (0,0) and the touch point T1 is q, the ratio of the touch point distance to the radius r is δ = ( q / r), as summarized in the following Table 1, the distance and direction of the pointer display point from the touch point can be variably controlled by the ratio of the distance of the touch point branch from the origin (0,0). Here, the X-marked circles indicated by dotted lines in the drawings are touch points T1, T2, T3, and T4, and the plus-marked red circles indicate the pointer mark points P1, P2, P3, and P4, and the respective touch points (T1, T2, T3). , The counterclockwise azimuth from the horizontal line of T4) is θ_T1 _,θ_T2 _,θ_T3 _,θ_T4 Mark each as

That is, in the first and second upper limits, as the touch point moves away from the center point, the distance of the display point in the touch point azimuth direction increases to a value greater than the set distance d0 and converges to the set distance d0 when approaching the center point.

On the contrary, in the third upper limit, as the touch point moves away from the center point, the touch point T3 approaches the touch point _T3 in the azimuth angle (θ _T3 -90 °) with respect to the touch point and approaches the center point (0,0). As it approaches, it converges to the set distance d0.

In the fourth upper limit, as the touch point moves away from the center point, the touch point T4 approaches the touch point T4 in the azimuth angle θ _T4 -270 ° with respect to the touch point T4 and the center point (0,0). ), Converges to the set distance d0.

Therefore, in the third and fourth quadrants, the touch point and the pointer display point are closer to each other as the lower edge of the touch screen 110 approaches. Here, the shortest distance should be maintained at a minimum distance from the finger touch position so that the pointer mark is not hidden.

FIG. 10 is a flowchart illustrating a pointer display position control process in the entire area of the embodiment of FIG. 9.

Referring to FIG. 10, the controller 120 inputs a touch position value (S162) to calculate a distance value q and an azimuth angle between the input touch point and the center point (S164). It is checked at which upper limit of the first upper limit to the fourth upper limit the calculated azimuth angle of the touch point (S166 to S172). In operation S166, the azimuth angle of the display point P1 is calculated based on the first upper limit display point distance calculation formula of Table 1 and the touch point T1 (S167). If it is the second upper limit in operation S168, the azimuth angle of the display point P2 is calculated based on the second upper limit display point distance calculation formula of Table 1 and the touch point T2 (S169). If it is the third upper limit in operation S170, the azimuth angle of the display point P3 is calculated based on the third upper limit display point distance calculation formula of Table 1 and the touch point T3 (S171). If it is the fourth upper limit in step S172, the azimuth angle of the display point P4 is calculated based on the fourth upper limit display point distance calculation formula of Table 1 and the touch point T4 (S173).

The distance values or azimuth data of the display points P1 to P4 calculated in steps S167 to S173 are transmitted from the controller 120 to the pointer display position control program and reflected on the screen coordinate values of the pointer image.

In general, objects such as a selection menu or an icon button having a high frequency of use are mainly disposed on the top and left and right sides of the screen configuration on the Internet, and objects having a low frequency of use are disposed at the bottom of the screen. In addition, since objects of high importance are arranged on the top and left sides of ergonomic visual or behavioral habits, it is preferable to select the object area as a pointer while moving up from the bottom in the synchronous direction where important parts are not covered by the fingers.

Referring to FIG. 11, in the virtual indicator rod embodiment, the indicator rod zone 192 is set near the right edge of the touch screen 110 or near the lower right corner, and each touch position of the indicator rod 192 is determined by the touch screen 110. The distance from the touch point T to the display point P is variably controlled so as to correspond to the entire area, and the pointer image is displayed as the instruction image 194. For example, the horizontal distance 192b to the touch point T and the display point of the indication image 194 from the right edge 110a of the touch screen 110 based on the right edge 192a of the indicator bar control zone 192. Variable control is performed at the ratio of the horizontal distance 110b to (P). That is, the distance between the touch point T and the display point P increases as the distance from the right edge increases, and the distance between the touch point T and the display point P decreases as the right edge approaches. The azimuth angle of the display point based on the touch point may be fixed at a specific azimuth angle or variably controlled in a manner similar to the above-described rectangular area or the entire area.

When the environment setting button 162d of the menu bar 162 is selected, the controller 120 sets the distance variable control mode to the virtual indicator bar control mode.

The virtual indicator bar control technology of the present invention is very useful in the technical fields such as wall-mounted large touch screen device, touch television, touch screen electronic blackboard, touch screen large monitor.

12A to 12H are screen state diagrams for explaining an environment setting of a pointer according to the present invention.

When the configuration button 162b of the menu bar 162 is selected, the controller 120 executes the pointer configuration module to set various parameters of the pointer.

When the pointer configuration menu is selected on the display panel of the touch screen 110, a screen (Fig. 12A) showing a pull-down menu for setting the direction and distance of the pointer is displayed and the direction setting screen (Fig. 12A) is responded to in response to the pull-down menu selection of Fig. 12A. 12b) and the distance setting screen (Fig. 12c). Set the desired direction and distance on each setting screen. In the initial setting screen, the screen showing the pull-down menu for setting the pointer size, transparency, color, shape, etc. is displayed (Fig. 12D), and in response to the pull-down menu selection, the color setting screen 12e, the size setting screen (Fig. 12F), The transparency setting screen (Fig. 12G) and the appearance setting screen (Fig. 12H) are displayed. Set the desired pointer size, transparency, color and shape on each setting screen.

Referring to FIG. 13, when the touch screen 110 is touched with the right hand detection FR1, the pointer 150 is displayed by the distance and direction values set by the environment setting. As such, when the pointer 150 is touched with the left hand detection FL1 while the pointer 150 is displayed, the controller 120 recognizes another touch position. When another touch is recognized in the pointer display area while the pointer is displayed, the controller 120 automatically switches to the pointer distance and direction configuration mode to execute the pointer configuration module. In the pointer configuration module, the touch movement of the finger 172 is tracked, the pointer 151 is positioned at a desired position and direction, and when the finger 172 is touched up (released), the position and finger of the currently placed pointer are touched. The distance value between the touch positions of 170 is calculated and the set value is changed to the new distance value and the direction value.

Therefore, since the display position of the pointer can be changed at an arbitrary distance and direction from the touch position in the touch state without selecting the environment setting menu, convenience in use can be increased.

14 is a view showing a state in which a point display area is touched according to the present invention.

As shown in FIG. 14, when the display area of the pointer 150 is touched, the coordinates of the touch position 158 are provided to the controller 126, and the controller 126 executes an enlargement / reduction processing program to execute the inside of the pointer 150. The "+" sign is replaced by the "-" sign. If it is in the + sign state, it performs enlargement function in response to the touch action and inverts the + sign in the circle with-sign. On the contrary, in-sign state, it performs reduction function in response to touch action and inverts-sign in circle with + sign.

15 is a flowchart for explaining an enlargement / reduction processing program according to the present invention.

Referring to FIG. 15, the controller 120 checks whether a touchdown 154 is detected in a pointer standby state (S182) (S184). When the touchdown is detected in step S184, the pointer image 150 including the enlargement (+ sign) or the reduction (-sign) is displayed on the display position 152 away from the touch position 154 by a set distance as described above ( S186). Subsequently, the touch-up is detected (S188). If the touch-up is detected, it is detected whether a retouch is input, and it is checked whether the retouch position 158 is a pointer display area touchdown (S190) or a touch click (S198). If the touchdown in step S190, in response to the displayed enlargement or reduction symbol to enlarge or reduce continuously at a predetermined ratio (S192). For example, the + sign enlarges the screen image in steps of 10% from the original size. On the contrary,-sign scales the screen image by 10% from the original size. This reduction process is maintained until the touch up is detected. When the touch-up is detected in step S194, the enlargement or reduction symbol is inverted and returned to step S190 (S196). That is, if the + sign in step S190, after the step S196 is inverted to the-sign.

If the touch click is checked in step S198, only one-step magnification is executed at the set magnification or reduction ratio, for example, 200% (S199). After the basic enlargement in step S199, step S196 is performed to invert and display the pointer symbol from + to-and return to step S190. Therefore, if there is another touch click in step S198, this time the screen image which has already been enlarged 200% is restored to the original 100% screen image.

Therefore, in the present invention, the pointer display area is divided into touchdown or touchclick to enable continuous enlargement or reduction control during touchdown, and can be quickly controlled in two stages of 200% enlargement-100% reduction during touchdown. Done.

16 is a screen state diagram in which the virtual controller 170 according to the present invention is displayed.

Referring to FIG. 16, when the virtual controller button 162c of the menu bar 162 is selected, the controller 120 sets the system to the virtual controller operation mode and touches the virtual controller 170 with the pointer 150 at the touch point T. Mark). The virtual controller 170 may perform a right button function of a conventional mouse. Although the virtual controller 170 is displayed only on the right side of the touch point 170, another virtual controller corresponding to the left button of the mouse may be displayed on the left side of the touch point T. The virtual controller 170 may assign various functions such as a menu selection button as well as a left or right mouse button function.

FIG. 17 is a screen state diagram illustrating a virtual touch ball according to the present invention, and FIG. 18 is a flowchart illustrating a virtual touch ball control operation according to the present invention.

Referring to FIG. 17, the virtual touch ball 170 is displayed in a form similar to the existing track ball on the upper left of the touch screen 110. The virtual touch ball 170 is preferably displayed in a transparent or translucent. The virtual touch ball 170 includes an activation area 170a and an inactivation area 170b around the active touch ball 170. Here, the activation area 170a is an area for detecting the moving speed and the moving direction from touch detection in order to control the screen movement or scrolling in response to the touch operation. This is an area for detecting whether touch movement is started.

When the spherical image is rotated in the desired direction with the finger FL1 as the spherical image, the activation area 170a controls the screen to move the screen or the object in the direction in which the screen or the object is rotated in response thereto. When the virtual touch ball 170 is touched down from the outside of the inactive area 170b and touched inwards, the virtual touch ball 170 stops the function of the virtual touch ball 170 to maintain control by the touch movement of the pointer 150. When the virtual touch ball 170 is touched down from within the inactive area 170b and touched in the active area 170a, the virtual touch ball 170 recognizes the operation of the virtual touch ball 170 and performs a screen movement or screen scroll operation.

Referring to FIG. 18, when the virtual touch ball button 160d of the menu bar 160 is selected (S204) in the normal mode standby state (S202), the controller 120 displays the virtual touch ball 170 on the upper left of the screen. (S206). The touchdown and the touch movement are detected in the active area 170a and the deactivated area 170b of the virtual touch ball 170 (S208). When the touch ball operation is detected in step S208, the control unit 120 moves the screen or object in the corresponding direction in response to the direction and speed at which the virtual touch ball rolls (S210). When the touch-up is detected in the activation area 170a (S212), when the touch-up is detected, the screen is stopped while gradually decreasing the screen moving speed (S214). In operation S208, when a touch movement is detected from outside the inactive area 170b of the virtual touch ball 170 and a touch movement is detected in the area 170b (S216), the mode of the virtual touch ball is suspended (S218). If it is detected that the touch movement is moved out of the area or touched up, the suspend mode is released (S220) and the process returns to step S206.

If the touch is not detected in S216, it is detected whether the set time has elapsed (S224). If it has not elapsed, the virtual touch ball mode is maintained, and if it is not elapsed, it returns to the normal mode standby state (S224).

19 is a view for explaining the two touch 2 pointer according to the present invention.

Referring to FIG. 19, in order to display the pointers P1 and P2 corresponding to the two touch points T1 and T2 on the touch screen 110 at a predetermined distance and in a direction, the two touch points T1 and T2 may be separated. Find the azimuth.

First, the bisector 202 of the straight line distance S between two touch points T1 and T2 is calculated on the touch screen 110 to obtain the azimuth angle of the touch points. Point that draws a vertical line perpendicular to the distance S from the bisector 202 in one direction (usually the lower direction of the screen) and meets a horizontal line 208 (consistent with the screen horizontal) set at a distance from the bisector 202. (210) is calculated as a reference point. Here, the predetermined distance 212 between the bisector 202 and the reference point 210 is preferably proportional to the length from the stop end to the point where the palm meets the wrist. In particular, it is limited to the value between the palm vertical length (when the finger is raised to the maximum on the touch screen) and the hand length (when the hand is stretched out on touch).

The azimuth angles θ _T1 and θ _{T2 of} the

extension lines

214 and 216 are drawn from the reference point 210 by extending the

extension lines

214 and 216 passing through the touch points T1 and T2 and counterclockwise with respect to the horizontal line 208. )

Therefore, the pointer display points P1 and P2 are calculated as positions spaced apart from the reference point 210 through the touch points T1 and T2 by the set distance d, and the pointer images are rendered on the calculated pointer display points P1 and P2. Are displayed respectively. By the pointer display control as described above, the pointer can be displayed on an extension line of the finger length direction. In the drawing, 206 is a virtual circle having a radius RK, and two touch points T1 and T2 are located at the same distance from the center point 204 of the circle, that is, on the circumference.

20 is a view for explaining a three touch 3 pointer according to the present invention.

The three touch three pointer finds the two farthest touch points T1 and T2 among the touch points T1, T2 and T3 and has these two touch points T1 and T2, which is the same as the two touch two pointer described above. The azimuth angles θ _T1 _, θ _T2 _, θ _T3 of the respective touch points T1, T2, and T3 are calculated to calculate the pointer display points P1, P2, and P3. Here, the point that sets the direction reference in the direction opposite to the touch point T3 when drawing a vertical line perpendicular to the distance S from the bisector 202 is different from the two-touch method.

21 is a view for explaining a five touch 5 pointer according to the present invention.

The controller 120 recognizes that five fingers of the thumb F1, the index finger F2, the middle finger F3, the ring finger F4, and the finger F5 are touched, and responds to the multi-touch in response to the multi-touch. The coordinate values of T2, T3, T4, and T5) are calculated.

The controller 120 generates a multi-pointer by inputting coordinate values of the detected multi-touch positions. The distance between two touch points T1 and T5 that are farthest from each other by comparing the touch positions with each other, that is, the half point of the straight distance S connecting the thumb touch position with the touch position, that is, the bisector 202. Calculate the coordinate value of. Here, it is also possible to obtain the bisector of the longest side of the closed polygon connecting the multi-touch positions T1, T2, T3, T4, and T5.

When the bisector 202 is obtained, the reference point 210 is a point where the vertical extension line 212 is drawn in the opposite direction of the touch positions T2 to T4 and the vertical extension line 212 and the horizontal line 208 meet.

Extension lines passing through the respective touch points T1, T2, T3, T4, and T5 are drawn from the reference point 210 and the azimuth angles θ _T1 _, θ _T2 _, θ _T3 counterclockwise from the virtual horizontal line 208. _, θ _T4 _, θ _T5 ₎ are obtained, respectively. This is summarized by the following formula.

θ _Tn ₌ ∑θ _n

Where n is a positive integer and θ _n is the angle between touch points.

F1: θ _T1 ₌ θ ₁

F2: θ _T2 ₌ θ ₁ + θ ₂

F3: θ_T3 ₌θ_One + Θ₂+θ₃

F4: θ_T4 ₌θ_One + Θ₂+θ₃+θ₄

F5: θ_T5 ₌θ_One + Θ₂+θ₃+θ₄+θ₅

Even if some of the multi-touch points are temporarily lost by the relation, the azimuth of the missing touch points is calculated to maintain the distance, angle and azimuth between the touch points even if the multi-touch is moved and the coordinates change frequently. Can be. The longitudinal direction of each finger may be inferred from the azimuth of each touch point. A pointer display point corresponding to each finger touch is calculated on an extension line that is spaced a predetermined distance from each touch point and has an azimuth angle of each touch point.

22 is a flowchart illustrating a pointer display and an object selection process linked to a touch operation in a multi-touch multi-pointer mode according to the present invention.

Referring to FIG. 22, when a user touches the single and multi pointer buttons 160a, one of the single mode and the multi mode is selected. When the multi-mode is selected, the control unit 120 brings setting data (vertical extension line length value, distance setting value from the touch point to the display point, size, transparency, shape, and color data) stored in the memory unit 140. Configures the pointer graphic image and switches the system to the pointer standby mode (S232). Subsequently, when the multi-touchdown is sensed by the touch panel 114 (S234), the controller 120 performs the above-described algorithm from the touch positions T1 to T5 to calculate the azimuth angle of each touch point, thereby adjusting each display direction of the multi-pointers. Infer (S236). Subsequently, the pointer display points P1 to P5 are respectively calculated at positions spaced by a predetermined distance set in the direction inferred from the touch point, and the pointer images are rendered at the calculated display points P1 to P5 to display the multi-pointers on the screen. (S238). When the finger is moved while maintaining the touched down state (S240), the controller 120 calculates the display position value in real time in response to the change in the touch position value according to the movement, thereby maintaining the set distance and the set azimuth angle. Control the display. The movement of the finger is stopped and the touch-up operation state in which the finger touch falls on the touch panel is detected (S242). When the touch-up is detected in operation S242, the controller 120 calculates the current position where the pointer display point P is located as the selection position, not the current touch position. The controller 120 waits for selection of an object corresponding to the selection position (S244). Subsequently, the controller 120 checks whether a selection command such as a touchdown or a touch click is input in the selection waiting state (S246), and checks whether the set selection waiting time has elapsed (S250). If a selection command such as touchdown or touchclick is input in step S246, the object waiting for selection is activated (S248) and the process returns to step S232. In step S250, the controller 120 automatically returns to step S232 when there is no input of a selection command until the set time elapses.

FIG. 23 is a view for explaining a modified embodiment of the multi-touch multi-pointer mode according to the present invention, and FIG. 24 is a view for explaining the principle of calculating the display point azimuth angle in the modified embodiment.

In the modified embodiment of FIG. 23, the touch point T1 and the reference point 210 of the thumb are connected to each other through three joint points J11, J12, and J13. The touch point T2 and the reference point 210 of the index finger are connected to each other through three joint points J21, J22, and J23. The middle touch point T3 and the reference point 210 are connected to each other through three joint points J31, J32, and J33. The touch point T4 and the reference point 210 of the ring finger are connected to each other through three joint points J41, J42, and J43. The touch point T5 of the thumb and the reference point 210 are connected to each other through three joint points J51, J52, and J53.

The pointers P1 to P5 corresponding to each finger are disposed at a predetermined distance from the touch point on the extension line extending through the touch point from the joint points J11, J21, J31, J41, and J51, respectively.

Referring to FIG. 24, the controller 120 may determine the distance Di0 of the touch point Ti and the joint point Ji1 of the fingers, the distance Di1 between the joint point Ji1 and the joint point Ji2, and the joint point Ji2. Distance Di2 between joint point Ji3, Distance Di3 between joint point Ji3 and reference point 210 and angle between touch point Ti and joint point Ji1 θ _T31 , Joint point Ji1 and joint point The angle θ _T32 between (Ji2), the distance θ _T33 between the joint point (Ji2) and the joint point (Ji3), and the angle θ _T3 between the joint point (Ji3) and the reference point 210 are managed as parameters of the corresponding finger. When the finger parameter is released, all joint points are positioned on a straight line connecting the reference point and the touch point, and the distance between each point is the maximum length. The azimuth angles of the joint points and the distance between the points vary according to the degree of bending the finger.

Therefore, the position of each joint point is calculated and arranged as a ratio of the distance between the touch point and the reference point, and the azimuth angle between the reference point 210 and the third joint point J33 is obtained by the following equation.

θ_T3 ₌θ_One + Θ₂+θ₃

The azimuth angle of the second joint point (J32) is obtained by the following equation.

θ_J32 ₌θ_One + Θ₂+θ₃+θ_T33

The azimuth angle of the first joint point J31 is obtained by the following equation.

θ_J32 ₌θ_One + Θ₂+θ₃+θ_T33+ Θ_T32

Finally, the azimuth angle of the display point P3 is calculated at the same angle as the azimuth angle of the first joint point J31.

In the modified embodiment, the touch point and the reference point 210 are not simply connected in a straight line as described above, but connect the joint points of each finger to display the virtual hand structure as a whole, and pass the touch point from the first joint point. By positioning the display point on one extension line, the direction of the finger and the arrangement direction of the pointer can be controlled more precisely. In addition, the direction of the pointer can be controlled according to the degree of bending the finger. The method and method for implementing the direction of the pointer (s) using the program or data applied by analyzing the average angle and length of the ergonomic user and human hands and fingers in the present invention and the method As another embodiment may be embodied and other components may be utilized.

As described above, the present invention has been described in detail with reference to various embodiments, but a person having ordinary knowledge in the technical field to which the present invention belongs may modify and practice the present invention in various ways.

25 is a screen state diagram of a modified embodiment for explaining a display operation of a pointer according to the present invention, and FIG. 26 is a flowchart illustrating a pointer display and an object selection process linked to a touch operation according to a modified embodiment.

Referring to FIGS. 25 and 26, when the pointer mode selection button 160 is touched, a pointer is displayed and waits at an arbitrary position 152 on the screen (262). In this state, when an arbitrary position 154 of the touch screen 110 is touched (S264), the pointer is jumped and displayed from the position 152 to the 156 position as shown in FIG. 25 (S266). In operation S264, when the finger is moved, that is, the touch movement is detected while maintaining the touch-down state (S268), the controller 120 calculates the display position value in real time in response to the change in the touch position value according to the movement, and the pointer 150. ) Is controlled to be displayed while maintaining the set distance and the set azimuth (S270). The finger movement is stopped and the touch-up operation state in which the finger contact falls on the touch panel is detected (S272). When the touch-up is detected in step S272, the controller 120 calculates the current position 156 (Px1, Py1) where the pointer 150 is located as the selection position, not the current touch position. The controller 120 waits for selection of the object 157 corresponding to the selection position (S274). Subsequently, the controller 120 checks whether a selection command such as touchdown or touchclick is input in the selection standby state (S276). When a selection command such as a touchdown or a touch click is input in step S276, the object 157 that is waiting for selection is activated (S278), and the process returns to step S262 to maintain the pointer displayed.

As described above, the present invention may be implemented in software such as an application form of a smart phone, hardware in an electronic device having a touch screen, or a combination of firmware and hardware.

Claims

In the touch screen control method comprising a display panel and a touch panel,

Recognizing a touch position corresponding to a finger touch (or touchdown) on the touch panel;

Displaying a pointer on an area of the display panel which is spaced apart from the recognized touch position and which is not visually covered by a finger;

Moving and displaying the pointer while maintaining a predetermined distance in conjunction with the finger movement when the finger is moved while the finger is in touch with the touch position;

Waiting for selection of the object when the finger is released (or touched up) while the display position of the pointer is positioned on an object to be selected; And

If the selection command is input in the selection waiting step, and the step of activating the object waiting for selection, and

The moving display of the pointer

And variably controlling any one of a distance or a direction between a touch point and a pointer display point in association with a distance at which a touch movement is entered into a rectangular area set near an edge of the touch screen.
The method of claim 1, wherein the selecting wait step is limited to a predetermined time after the touch is released and if there is no input of the selection command until the predetermined time elapses, the displayed pointer display is erased. .
The touch screen as claimed in claim 1, wherein the selection command is generated by at least one of a touch operation (touch down, touch click, double touch click) or a key input different from a touch operation for displaying the pointer. Control method.
The method of claim 1, wherein the pointer operation mode is

And a pointer mode selection button displayed on the touch screen to activate the touch screen.
The method of claim 1, wherein a distance between a touch point and a display point is variably controlled in an upper region or a lower region of the rectangular zone.
The method of claim 1, wherein a direction between the touch point and the display point is variably controlled in the left area or the right area of the rectangular area.
The method of claim 1, wherein a distance and a direction between the touch point and the display point are simultaneously variably controlled in each of the upper left, lower left, upper right and lower right corner regions of the rectangular area.
Detecting multiple touches;

Inferring a longitudinal direction of touched fingers from the detected multiple touch points;

Displaying pointers corresponding to a predetermined distance extending from each of the touch points in the inferred finger length direction, respectively; And

And controlling the plurality of pointers linked to the multiple touch points to be displayed in a group by interlocking with each other based on a longitudinal inference result.
The method of claim 8, wherein the reasoning step

Calculating a bisector that bisects the longest side of a linear distance between two touch points spaced farthest from the detected multiple touch points or a closed polygon that connects the multiple touch points;

Calculating a reference point that meets a horizontal line by extending a vertical extension line having a predetermined length in one direction from the bisector;

Calculating azimuth angles of the touch points counterclockwise from the horizontal line with respect to the reference point; And

And determining extension lines passing through the touch points from the reference point in the longitudinal direction of the finger corresponding to each touch point.
10. The method of claim 9 wherein one direction from the bisector

The touch screen control method, characterized in that any one of the lower direction of the screen of the touch screen or the direction opposite to the direction in which the remaining touch points are located.
The method of claim 9 wherein the predetermined distance of the vertical extension line is

Touch screen control method, characterized in that any length within at least palm length to hand length range.
The method of claim 9 wherein the horizontal line

Touch screen control method, characterized in that the screen horizontally match the touch screen.
A sensor unit for sensing a touch of the touch screen; And

And a controller configured to execute a touch screen control program in response to the touch input sensed by the sensor unit.

The touch screen control program performed by the controller

Detecting multiple touches of the touch screen;

Inferring a longitudinal direction of touched fingers from the detected multiple touch points;

Displaying pointers corresponding to a predetermined distance extending from each of the touch points in the inferred finger length direction on the touch screen, respectively; And

And controlling display of the plurality of pointers linked to the plurality of touch points in a group by interworking the plurality of pointers based on a longitudinal inference result.
Detecting multiple touches;

Inferring a longitudinal direction of touched fingers from the detected multiple touch points;

Calculating display points of pointers corresponding to a predetermined distance extending from each of the touch points in the inferred finger length direction; And

And controlling the display of a single hand image by interlocking the plurality of pointers linked to the multiple touch points based on a longitudinal inference result.
The method of claim 14, wherein the reasoning step

Calculating a bisector that bisects a straight line between two touch points spaced farthest from the detected multiple touch points;

Calculating a reference point that meets a horizontal line by extending a vertical extension line having a predetermined length in one direction from the bisector;

Calculating azimuth angles of the touch points counterclockwise from the horizontal line with respect to the reference point;

Calculating display positions of joint points of the fingers in response to a length ratio of a line connecting the respective touch points from the reference point;

And determining extension lines passing through the touch points from the joint points closest to the touch points in the longitudinal direction of the finger corresponding to each touch point.
The method of claim 14, wherein the hand image is

Touch screen control method characterized in that the connection between the reference point and each touch point with a plurality of joint points arranged in the curved shape of each finger.