KR100942704B1 - Pointing apparatus possible haptic feedback, haptic interaction system and method using the same - Google Patents

Abstract

The present invention relates to an input device capable of haptic feedback, a tactile interaction system and method using the same, wherein the input device capable of tactile feedback according to the present invention receives an event including tactile output information through wireless communication with the outside. Wireless communication unit; A controller configured to generate a control signal for reproducing a tactile pattern corresponding to the tactile output information; And a tactile stimulator for reproducing the tactile pattern by the control signal, thereby increasing performance and usability of the user interface of the terminal including the touch screen.

Haptic, tactile, stylus, touch screen

Description

Input apparatus capable of haptic feedback, haptic interaction system and method using the same

The present invention relates to a device for improving the performance and usability of a user interface of various devices by using a tactile feedback function, and more particularly, by providing a tactile feedback function to a user interface of a touch screen in which only an image exists and an object cannot be felt. The present invention relates to an input device capable of tactile feedback that can improve usability, and a tactile interaction system and method using the same.

The present invention is derived from research conducted as part of the IT source technology development project of the Ministry of Information and Communication and the Ministry of Information and Communication Research and Development. ].

In general, the touch screen can manipulate the position and function of the pointer in the touch screen by directly touching the screen from the outside. In this case, the stylus is used as a tool for easily performing the touch screen touch.

Such a stylus may be implemented as a pen-type input device, and a built-in electric induction component may operate a pointer not only in direct contact with the touch screen but also in very close contact with the surface without contact.

The related patent is configured to sense a change in position while rubbing a surface using a stylus with a built-in position sensor at the end, and to output an appropriate tactile response to an output through a driver installed inside the stylus according to the sensed movement. .

Another conventional patent has a pressure sensor built into the tip of the stylus, an acceleration sensor inside, and a linear driver on the opposite end to output an appropriate tactile response according to the movement of the stylus.

These prior patents have the problem of attaching a position and pressure sensor to the stylus.

In addition, studies have been conducted to reproduce the tactile response by directly mounting the tactile feedback device in the existing touch screen.

Therefore, in order to solve the problem of having to perform a process for additionally providing a position sensor or a pressure sensor on the stylus and an additional process for directly mounting the tactile feedback device in the touch screen, the present invention provides a stylus with only contact or proximity. An object of the present invention is to provide an input device capable of tactile feedback that can be used for a touch screen having a sensor for recognizing a position of a.

In addition, the present invention is to place the linear vibrator in the handle portion so that the feeling of pressing the button even when the mass for generating the vibration is not large, it can be used as an independent system including a power supply and a wireless communication device therein An object of the present invention is to provide an input device capable of tactile feedback.

In addition, the present invention is to provide an input device capable of tactile feedback that can use a variety of tactile, auditory output devices (sound input and output devices) at the same time.

According to one embodiment of the present invention, an input device capable of tactile feedback includes a wireless communication unit configured to receive an event including tactile output information through wireless communication with an external device; A controller configured to generate a control signal for reproducing a tactile pattern corresponding to the tactile output information; And a tactile stimulus part which reproduces the tactile pattern by the control signal.

Preferably, the input device capable of tactile feedback comprises a battery which is a power supply; And a charging terminal for charging the battery.

Preferably, the input device capable of haptic feedback further includes a sound output unit for reproducing a sound effect corresponding to the tactile pattern.

Preferably, the input device capable of tactile feedback further comprises a microphone and a speaker having a sound input / output function for a voice call or a voice command.

Preferably, the control unit controls the sound output unit to output a warning or notification sound.

Preferably, the event is generated in response to the operation of the input device on a touch screen.

Preferably, the tactile stimulation part is impacted through a rotary vibrator for generating a vibration through the first mass rotated by the control signal or a second mass for vertical linear movement by a magnetic field in response to the digital signal. And one or both of the linear vibrators for generating vibrations.

Preferably, the first mass is eccentrically attached to the rotation axis of the rotary vibrator, and generates vibration through an eccentric rotational movement.

Preferably, when the object on the touch screen is selected or released, the control unit collides with a second mass of the linear vibrator with the upper contact surface, the sequential collision with the upper and lower contact surfaces, or the sequential with the lower and upper contact surfaces. Which causes one of the collisions.

Preferably, the control unit controls the tactile stimulation unit through the control signal to generate only a vibration of the first or second mass body that the object on the touch screen is selected or released to reproduce the tactile pattern.

Preferably, the controller increases the input period of the control signal in proportion to the moving speed of the pointer.

Preferably, the control unit increases the vibration intensity of the rotary vibrator in proportion to the moving speed of the pointer.

Preferably, when the pointer moves by the moving distance unit, the controller generates a short vibration of the rotary vibrator or a collision with the sequential lower and upper contact surfaces of the linear vibrator.

Advantageously, said control unit gradually increases the intensity of vibration while maximizing the size of said window.

Preferably, the control unit controls the tactile stimulation unit through the control signal to gradually reduce the intensity of vibration while minimizing the size of the window.

Preferably, the control unit controls the tactile stimulation unit through the control signal to increase the intensity of vibration in proportion to the departure distance outside the predetermined area.

Preferably, the control unit controls the control signal to reproduce the haptic pattern by gradually weakening vibration, short vibration, or collision with a sequential contact surface above or below the linear vibrator for a predetermined time when the window is closed. Through the tactile stimulation unit is controlled.

Preferably, the control unit controls the tactile stimulation unit through the control signal to reproduce the tactile pattern by one of short vibration, collision with the sequential contact surface above and below the linear vibrator for a predetermined time when a new pop-up menu occurs. do.

Preferably, the controller generates a sequential collision of the second mass of the linear vibrator with the upper and lower contact surfaces when the number of objects selected by the input device on the touch screen changes. In this case, an object selected by the input device on the touch screen may be selected from among letters, icons, folders, and files in one or more selectable documents.

Preferably, when the input device is located on a button having a predetermined purpose on the touch screen, the controller generates a repetitive collision of the second mass of the linear vibrator with either of the upper or lower contact surfaces. In this case, the control unit gradually moves the mass so as not to collide with the opposite side when the second mass of the linear vibrator collides with one side of the upper or lower contact surface and then moves to the opposite side.

Preferably, when the size or angle of the figure is changed by the reference unit by the input device on the touch screen, the controller generates a sequential collision of the second mass of the linear vibrator with the upper and lower contact surfaces.

On the other hand, the tactile interaction system using the input device capable of haptic feedback according to an embodiment of the present invention, touch the touch screen from the outside of the touch screen or operate the pointer on the touch screen in close proximity to the surface of the touch screen An input device for receiving an event including tactile output information corresponding to the manipulation of the pointer through wireless communication and reproducing a tactile pattern corresponding to the tactile output information; And a terminal for generating an event in the application program including the tactile output information corresponding to the manipulation of the pointer in the touch screen by the input device, and transmitting the event to the input device.

Preferably, the input device includes a wireless communication unit for receiving an event including the tactile output information through wireless communication with an external device, a controller for generating a control signal for reproducing a tactile pattern corresponding to the tactile output information; And a tactile stimulator including at least one of a linear vibrator mounted to generate mass motion in a direction perpendicular to the contact surface of the touch screen and a rotary vibrator for rotating the eccentric mass to reproduce the tactile pattern by a control signal. Preferably, the input device is pen-shaped.

On the other hand, the tactile interaction method using the haptic feedback capable input device according to an embodiment of the present invention, the tactile interaction method while pressing a button on the touch screen in the tactile interaction system using the input device capable of tactile feedback When the button on the touch screen is pressed by the input device, the step of generating a button press event by the application program of the terminal linked with the touch screen; The button press event being transmitted to the external input device, and the mass of the linear vibrator collides with the contact surface in a downward direction by a digital signal corresponding to the button press event; When the external input device is released from the button, generating a button press release event by an application program of a terminal interworking with the touch screen; The button press release event is transmitted to the external input device, the mass of the linear vibrator collides with the contact surface in the upward direction by a digital signal corresponding to the button press release event.

As described above, the present invention reduces the ambiguity of the operation occurring when using the touch screen through the haptic stylus tactile feedback, thereby making it possible to accurately operate the touch screen, thereby improving usability.

In addition, the present invention provides an haptic feedback function to the haptic stylus to solve the problem of having to intervene in the touch screen process to directly mount the tactile feedback device in the touch screen, thereby enabling the tactile feedback function without deformation of the touch screen terminal. .

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, in describing in detail the operating principle of the preferred embodiment of the present invention, if it is determined that the detailed description of the related known functions or configurations may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. The same reference numerals are used for parts having similar functions and functions throughout the drawings.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

In addition, the present invention includes all cases of manipulating a pointer on a screen through manipulation of a stylus. In addition, the stylus is not necessarily in the form of a pen, but is intended for all types of devices that can touch the outside of the screen or are very close to the surface of the screen, so that the pointers on the screen can be manipulated through plane movement.

1 is a block diagram illustrating a tactile interaction system using a haptic stylus according to an embodiment of the present invention.

As shown in FIG. 1, when the user 201 contacts the terminal 202 including the touch screen 203 using the haptic stylus 100, the application 205 running on the terminal 202 may Tactile output information corresponding to the contact is generated.

The generated tactile output information is transmitted to the wireless communication unit 105 of the haptic stylus 100 through the wireless communication module 204.

The wireless communication unit 105 transmits the transmitted output tactile information to the controller 103, and the controller 103 generates a control signal for reproducing the tactile pattern corresponding to the tactile output information.

Then, the controller 103 controls the tactile stimulators 101 and 102 inside the haptic stylus 100 held by the user 201 with the control signal to reproduce a suitable tactile pattern.

Here, the tactile output information is information on a tactile pattern reproduced by the tactile stimulators 101 and 102, and the tactile pattern refers to a form reproduced by the period of vibration or the intensity of vibration. And the control signal means a digital signal.

For example, when the user 201 holds the haptic stylus 100 and presses a button on the touch screen 202, the tactile output information bonded according to an event related to a button generated in the application 205 of the terminal 202 is displayed. It communicates to the haptic stylus 100 via the wireless communication module 204.

The haptic stylus 100 reproduces the tactile pattern according to the transmitted tactile output information so that the user 201 feels as if the user presses a button.

The haptic stylus 100 also incorporates a sound output, such as speaker 106, to reproduce the associated sound effect, ie sound, while reproducing the tactile pattern.

That is, the application 205 delivers the appropriate sound information associated with the tactile output to the haptic stylus 100, and the haptic stylus 100 reproduces the appropriate sound while reproducing the tactile sensation through the speaker 106.

In addition, the haptic stylus 100 may include a sound input / output device such as a speaker 106 and a microphone 107 to enable a voice call or a voice command while the user is using the terminal 202 having the touch screen 203. have.

2 is a perspective view of the implementation of the haptic stylus 100 according to an embodiment of the present invention shown in FIG.

As shown in FIG. 2, the haptic stylus 100 is a pen-shaped pointing device used in a touch screen and has a function of generating tactile feedback.

The haptic stylus 100 is a rotary vibrator 101 that generates vibration through the rotation of the mass body, a linear vibrator 102 that generates shock and vibration through the linear motion of the mass body, each component built in the haptic stylus 100 Control unit 103 for controlling the elements, a battery 104 which is an internal power supply, and a wireless communication unit 105 for wireless communication with the outside.

In addition, the haptic stylus 100 may further include a charging terminal 108 for charging, a microphone 107 and a speaker 106 for a sound input / output function.

FIG. 3 is a detailed view for explaining the operation of the rotary vibrator 101 shown in FIG. 2.

As shown in Fig. 3 (a), the rotary vibrator 101 generally generates vibration by eccentric rotation of the mass body 301 attached to the rotary shaft eccentrically.

As shown in FIG. 3 (b), the rotary vibrator 101 has a time to reach the maximum intensity of the vibration when the power is supplied (HIGH) due to the influence of the inertia of the mass body 301. If the power supply is stopped, the rotation of the mass body 301 does not stop immediately, but rotates for a predetermined time (A).

When the power is supplied for a short time but the supply cycle is increased, the supply time of the power is short so that the vibration does not reach the maximum intensity, but the strength of the vibration is effective because the power is supplied again before the rotation of the mass 301 stops. Although weak, it can generate vibration continuously (B, C).

Since vibration is one of the tactile stimuli that a person feels most sensitively, the vibrator has an advantage that can be well utilized for the tactile feedback device, but the rotary vibrator does not stop exactly at a desired time.

4 is a detailed view for explaining the operation of the linear vibrator 102 shown in FIG.

As shown in FIG. 4A, the linear vibrator 102 linearly moves the mass 402 using a magnetic field to generate shock or vibration.

In the case of controlling the linear vibrator 102 using digital signals HIGH and LOW as in the case of A in FIG. 4B, when the HIGH signal is supplied, the mass body 402 moves to one side, and the LOW signal is transmitted. When supplied, the mass body 402 moves to the opposite side.

 At this time, in the case of a digital signal, since a momentary change of the signal occurs, the mass 402 strikes one side and generates an impact. And since the linear vibrator 102 is less affected by inertia, even if the period of the signal is short, as in the case of B, the interference between the current signal and the previous signal is relatively small. When the period of signal generation is shortened as in C, the mass body 402 vibrates without colliding with the wall surface.

5 is a conceptual diagram illustrating a principle of changing a period of vibration while drawing or writing on a touch screen using the haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 5 (a), in order to reproduce the tactile feeling while drawing or writing on the touch screen 203 with the haptic stylus 100, the speed of rubbing the surface of the touch screen 203 is shown. As is increased, the period of the digital signal is increased within a period range in which the rotary vibrator 101 does not continuously operate (that is, a period range in which a situation such as C of FIG. 3 does not occur).

That is, when the surface is rubbed with the haptic stylus 100 on the touch screen 203, the pointer moves together with the movement of the haptic stylus 100. At this time, the higher the step speed of the pointer, the input signal of the rotary vibrator 101 is. Increase the cycle of

For example, as shown in Fig. 5 (b), when the speed is one step, the vibration occurs once in one second, but occurs five times in the fifth step. That is, the faster the movement speed of the haptic stylus 100, the more frequent stimulation occurs to generate a tactile feeling as if the stroke is drawn quickly. In this case, the period of the stimulus may be determined within a predetermined step, and it may be set in a continuous functional relationship with the period of the stimulus.

6 is a conceptual diagram illustrating a principle of changing the intensity of vibration while drawing or writing on the touch screen 203 using the haptic stylus 100 according to an embodiment of the present invention.

As another way to feel a realistic stroke on the surface of the touch screen 203 while drawing or writing with the haptic stylus 100, the vibration intensity of the rotary vibrator 101 increases as the speed of rubbing increases. There is a way to harden.

As shown in FIG. 6, in the case where the vibration intensity of the rotary vibrator 101 is changed according to the speed of drawing a stroke, the period in which the vibrator continuously operates (that is, the period range in which the situation as shown in FIG. 3C occurs). The control signal. At this time, the time corresponding to the HIGH in one period (601) is adjusted.

For example, in the case of the speed 1 stage, the ratio of HIGH and LOW is 1: 1, but in the case of the speed 5 stage, the period of the signal is the same as the stage 1 but the ratio of HIGH is very high compared to LOW. In such a high frequency signal, a method of controlling the ratio of the HIGH and LOW signals in one period is called PWM (Pulse Width Modulation). At this time, the ratio of the HIGH signal in the entire period is called Duty Ratio.

As shown in FIG. 6, as the duty ratio increases, the digital signal is supplied analog, and vibrations of higher intensity can be generated.

Accordingly, the speed of the pointer moving with the movement of the haptic stylus 100 may be determined within a predetermined step, and may be set to a continuous function relationship with the HIGH duration of the stimulus in a single period.

7 illustrates a principle of changing the period of vibration with the linear vibrator 102 while drawing or writing on the touch screen 203 using the haptic stylus 100 according to an embodiment of the present invention. Conceptual diagram.

By drawing feedback or feeling strokes on the surface of the touch screen 303 while drawing or writing with the haptic stylus 100, the stimulation period of the rotary vibrator 101 is increased as the speed of rubbing increases. The method has been described in FIG. 5. This principle may be implemented with the linear vibrator 102 as well as the rotary vibrator 101.

As shown in FIG. 7, the haptic stylus 100 on the touch screen 203 within the signal frequency range where the linear vibrator 102 collides up and down (frequency range where a phenomenon such as C of FIG. 4 does not occur). When the surface is rubbed with), the pointer moves with the movement of the haptic stylus 100. At this time, the higher the speed of the pointer, the higher the period of the input signal of the linear vibrator 102. For example, when the speed of the pointer is 1 step, vibration occurs once in 1 second, but 5 times when the pointer speed is 5 steps.

At this time, when the signal becomes HIGH and then becomes LOW, the mass body 402 in the linear vibrator 102 hits the upper and lower surfaces one by one, and feels like rubbing the surface of the doltic stylus 100 to the user. Reproduce.

In particular, the linear vibrator 102 has a clear start and end of the signal, so that the user rubs the surface faster, the faster the rubbing pattern of the rubbing surface can be felt.

As described with reference to FIG. 7, the speed of the pointer moving with the movement of the haptic stylus 100 may be determined within a predetermined step, or may be set in a continuous functional relationship with the period of the stimulus.

FIG. 8 is a conceptual view illustrating a principle of generating vibration in response to a pointer position change while drawing or writing on the touch screen 203 using the haptic stylus 100 according to an embodiment of the present invention.

A simple method of determining the period of the vibrating stimulation in proportion to the moving speed of the pointer 802 is to use the moving position of the pointer 802. That is, as shown in FIG. 8, whenever a change occurs by a certain amount of position of the pointer, an input signal 801 for generating vibration of the rotary vibrator 101 or double-sided collision of the linear vibrator 102 is input. .

The input signal 801 of the vibrator is used as a signal of a device for generating vibration, such as a rotary vibrator, a linear vibrator, and according to the method described above, the faster the movement, the greater the change in position, and thus the tactile stimulation proportional to the moving speed. I can reproduce it.

At this time, the operating system of the terminal 202, that is, the application program generates an event whenever the movement of the pointer 802 occurs, and while drawing or writing using the haptic stylus 100, the pointer 802 Each time a movement event of the terminal 202 may generate a vibration of the rotary vibrator 101 or a two-sided collision of the linear vibrator 102.

FIG. 9 illustrates a method of informing a tactile feedback of a phenomenon that a pointer leaves a predetermined area while drawing or writing on a touch screen 203 using a haptic stylus 100 according to an embodiment of the present invention. This is a conceptual diagram.

As illustrated in FIG. 9A, when the spatial range of a picture, a text, or a region 901 to be worked on is defined while being in contact with the touch screen 203, the moving position of the pointer 802 is determined. From the moment 902 is out of the predetermined region 901, it can be known that the strong vibration stimulation of the vibrator (101, 102) is out of the region.

In this case, the vibrators 101 and 102 may be replaced with various vibrators capable of producing a strong output. In addition, the longer the deviation distance may increase the strength of the vibration.

In particular, when the principle of FIG. 9 is applied in the case of drawing along the picture, when the pointer 802 is moved to draw along the picture within a predetermined area, the movement as described with reference to FIGS. 5, 6, 7 and 8 is performed. A tactile stimulation method proportional to speed can be applied.

10 is a conceptual diagram schematically illustrating a process of pressing a general button.

As shown in FIG. 10 (a), generally, the process of pressing the button 1001 is performed at the moment when the button starts to be pressed, such as A, the moment when the button is pressed, such as B, and the maximum displacement occurs, as in C. It can be categorized as a moment of releasing.

The user must continue to apply more and more force 1002 as soon as the user goes from state A to state B to press button 1001. The moment the force exceeds a certain amount, the button goes down with a sudden displacement change. At this point, the user feels a momentary decrease in force 1003 at point B. After the button is pressed to its limit, the user presses the button with a certain amount of force and experiences the state of C where the button feels momentarily pushing the hand (1004) while releasing the button to release it. Done. After all, when the button is pressed, the momentary impact of B's momentum and the momentary impact of C's momentum are important tactile sensations.

11 is a conceptual diagram illustrating a process of pressing a button on the touch screen 203 using the haptic stylus 100 according to an embodiment of the present invention.

As shown in Fig. 11 (a), the haptic stylus 100 has a built-in linear vibrator 102 configured to parallel the longitudinal direction of the device and the axis of motion of the mass body 402. That is, the linear vibrator 102 is built to generate a shock to the upper and lower surfaces to the user holding the haptic stylus 100, in the present invention, the mass body 402 is initialized apart from the lower surface to realize the feeling of a button. To be possible.

As shown in FIG. 11A, the process of pressing the button 1101 on the touch screen 203 is performed by pressing the button 1102 as shown in B, and displacing the button 1102 as shown in FIG. May be divided into the moment of maximal occurrence and the moment of releasing button 1103 as shown in C. FIG.

As shown in Figs. 10 and 11, the user 201 needs to apply more and more force continuously as it goes from A to B state in order to press the button 1101. This portion naturally occurs on the touch screen 203. At the moment when the magnitude of the force exceeds a certain amount, the button enters downward, as shown by B, with a sudden change of displacement, and shows the pressed button 1102.

At this time, the user can reproduce the impact felt with the instantaneous decrease of force 1003 at the time point B while colliding the mass 402 of the linear vibrator 102 embedded in the haptic stylus 100 downward.

After the button is pressed to the limit, the user 201 is holding the button with a force of a certain amount or more, and at some moment while the power is released to release the button, the user feels the force 1004 to push the hand momentarily. The state of can be reproduced while colliding upward with the linear vibrator 102 built in the haptic stylus 100.

FIG. 12 is a detailed conceptual diagram illustrating a process of moving an object on a touch screen 203 using a haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 12, the screen of the terminal 202 is selected through an operation of a pointer 1102 such as an icon 1201 representing a file, a shortcut key, a folder, or the like, an open window 1204, or the like, to adjust a position. There are a number of objects that can be selected and given tactile feedback to the moving process after selecting an object.

When moving an object on the touch screen 203, most users have difficulty determining whether an object has been selected, and it is very difficult to finely adjust and adjust the change in the position of the object. However, with tactile feedback, it is possible to intuitively tell the user whether an object is selected or whether the object is moving.

As shown in FIG. 12A, the mass body of the linear vibrator 102 built in the haptic stylus 100 to reproduce the feeling that the icon is attached to the pointer 1202 at the moment of selecting the icon 1201 ( 402 is crashed upwards. While moving the selected icon 1203, one of the methods described with reference to FIGS. 5, 6, 7, and 8 regarding the tactile stimulation method proportional to the moving speed of the pointer 1202 is applied to output the tactile feedback signal. In this case, the vibrator outputting the tactile stimulus may use the linear vibrator 102 or select one of the rotary vibrators 101.

Then, after moving the icon to the desired position, the mass 402 of the built-in linear vibrator 102 is collided downward to reproduce the feeling that the icon is falling off the moment the haptic stylus 100 is released from the touch screen 203. Let's do it. The same principle can also be reproduced when the window 1204 is selected and moved (1105).

In addition, when the mass 402 needs to be moved upward after the operation is completed, the mass is gradually moved 1207 upward so that the user does not feel any tactile shock.

FIG. 13 is a graph for explaining a method of moving the mass body 402 of the linear vibrator 102 without impact in accordance with an embodiment of the present invention.

The initial position of the mass 402 of the linear vibrator 102 is very important in terms of tactile feedback. For example, if it is necessary to impact down, if the mass 402 is already down, it is impossible to crash downward. Therefore, it is sometimes necessary to move the mass 402 up or down without impact. Therefore, there is a need for a method of gradually moving the mass 402 of the linear vibrator 102 to a desired position without impact.

That is, a method using the PWM (Pulse Width Modulation) described with reference to FIG. 6 is possible for the gradual movement of the mass body 402. In order for the mass body 402 of the linear vibrator 102 to move without impact, if the duty ratio is gradually increased from 0 through several steps, the mass body 402 also gradually moves upward.

As shown in FIG. 13, when the Duty Ratio is increased with time, the mass moves slowly and moves to the end without impact. If mass 402 was initially down, it would move up, and using the opposite algorithm, mass 402 would move down without impact even if it was up.

14 is a detailed view illustrating tactile feedback of a process of increasing and decreasing a window on the touch screen 103 using the haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 14, when the pointer 1202 is positioned using the haptic stylus 100 at the corner vertex of the window 1204 or the outer boundary position 1401 of the window, selection of a window size change is made. At that moment, the mass 402 of the linear vibrator 102 embedded in the haptic stylus 100 is hit below and crashed upward to reproduce the feeling that the window is stuck to the haptic stylus 100. At this time, it is also possible to apply a gradual movement for a short time to eliminate the lower impact.

While changing the size of the selected window, one of the methods described with reference to FIGS. 5, 6, 7, and 8 related to the tactile stimulation method proportional to the moving speed of the pointer is applied to output the tactile stimulus. In this case, the vibrator outputting the tactile stimulus may be reproduced by using both collisions of the linear vibrator or by using the rotary vibrator.

Then, after changing the size of the window as desired, as soon as the haptic stylus 100 is released from the touch screen 203, the mass 402 of the built-in linear vibrator 102 is lowered to reproduce the feeling that the window is falling out. To crash.

After the operation is finished, the mass body 402 is gradually moved upward, so that the user does not feel any tactile shock.

15 is a detailed view illustrating a process of manipulating a scroll bar of a window on the touch screen 103 using the haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 15, when the pointer is positioned on the scroll bar 1501 of the window 1204 using the haptic stylus 100, the movement of the scroll bar 1501 is selected. At that moment, the mass 402 of the linear vibrator 102 embedded in the haptic stylus 100 is hit by the bottom and collided upward to reproduce the feeling of being attached to the pointer. At this time, it is also possible to apply a gradual movement for a short time to eliminate the lower impact.

While the selected scroll bar 1501 is moved, one of the methods described with reference to FIGS. 5, 6, 7, and 8 regarding the tactile stimulation method proportional to the moving speed of the pointer is applied to output the tactile feedback. At this time, the vibrator outputting the tactile stimulus may be reproduced using the linear vibrator 102 or the rotary vibrator 101.

Then, when the scroll bar 1501 reaches a limit that can move upward or downward, it is possible to tactilely confirm that the scroll bar has reached the block by instantaneously generating a short and strong vibration using a vibrator. After changing the position of the scroll bar 1501 as desired, the mass of the built-in linear vibrator 102 is reproduced to reproduce the feeling that the scroll bar 1501 falls off the moment the haptic stylus 100 is released from the touch screen 203. 402 is crashed downward. After the movement, the mass is gradually moved upwards so that the user does not feel any tactile shock.

FIG. 16 is a detailed view illustrating a method of controlling a window size manipulation button on a touch screen 103 using a haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 16, when a specific icon 1501 is selected and executed using the haptic stylus 100, the user moves the mass 402 of the linear vibrator 102 to reproduce the feeling of clicking the icon. Collision down and up to match.

That is, in order to reproduce the feeling of opening of the window 1204 as it rises upward, the mass 402 of the linear vibrator 102 built in the haptic stylus 100 collides downwards and then collides upwards, and a rotary vibrator or The linear vibrator is used to provide short and weak vibrations and short and strong vibrations sequentially.

In addition, when the minimize (or maximize) button located on the title bar 1602 of the window 1204 is pressed, the mass body 402 of the linear vibrator 102 embedded in the haptic stylus 100 is reproduced to reproduce the feeling of pressing the button. It sequentially collides downwards and upwards, and then decreases (or increases) the vibration intensity of the vibrator step by step to convey the feeling of minimizing (or maximizing) the window.

In addition, when the close button located in the title bar 1602 of the window is pressed, the mass body 402 of the linear vibrator 102 built in the haptic stylus 100 collides downward and upward in order to reproduce the feeling of pressing the button. Then, using the rotary vibrator 101 or the linear vibrator 102 so as to be opposite to the feeling that is reproduced while the window is opened, it is sequentially provided with short and strong vibrations and short and weak vibrations. The sequential steps can be arbitrarily increased or decreased, and can be replaced by successive reductions or weakenings instead of sequential methods.

FIG. 17 is a detailed view illustrating a process of moving a menu and operating a pop-up menu on the touch screen 103 using the haptic stylus 100 according to an embodiment of the present invention.

As illustrated in FIG. 17, when the pointer moves through a menu or a menu list by using the haptic stylus 100, tactile feedback may be used to accurately know whether the menu is changed or in which menu.

In detail, when implementing using only the linear vibrator 102, the mass 402 may be collided up and down sequentially for a short time so that the specific menu is selected. In addition, by using the linear vibrator 102 in a vibration mode with low impact, or by operating the rotary vibrator 101 at the moment when the menu changes, the user can intuitively feel the menu change.

The tactile feedback is the same level when the first start menu 1701 is selected, when a new menu list pop-up menu 1702 is executed, and when moving to a new menu 1703 within the new pop-up menu 1702. When moving to the menu, all of the new pop-up menu 1704 is executed in the selected menu is generated.

At this time, the user can know the movement of the menu selected by the user through the tactile feedback very accurately.

FIG. 18 is a conceptual view illustrating a principle of generating vibration in accordance with a change in the number of selected letters when a plurality of letters in a document are scraped and selected on a touch screen using the haptic stylus 100 according to an embodiment of the present invention. .

As shown in FIG. 18, the user may touch and move the haptic stylus 100 within the document 1801 on the touch screen 203 of the terminal 202 to select some contents 1802. In this case, the second mass 402 of the linear vibrator 102 may collide in the opposite direction as the number of the selected letters changes, thereby providing tactile feedback according to the change in the number of the selected letters.

The tactile feedback according to the change in the number of selected items may be equally applied to selecting an icon, a folder, a file, or the like that can be selected on the touch screen 203.

FIG. 19 illustrates a method of inducing a user input by providing tactile feedback according to an operational intention of a button when a cursor is positioned on a specific button on a touch screen using a haptic stylus according to an embodiment of the present invention. This is a conceptual diagram.

Specifically, as shown in FIG. 19, a case in which there is a button 1901 having an intention of work progress and a button 1902 having an intention of work backward is described by way of example on the touch screen 203.

When the user performs a task on the touch screen 203, moving the haptic stylus 100 over a button 1901 with the intention of proceeding with the task to proceed to the next task (A), the application 205 causes the user to The user is prompted to click on the button 1901 by repeating the collision of the mass 402 of the linear vibrator 102 downward to induce the progress of the operation.

At this time, when the mass 402 is collided downward and then moved upward again, the mass 402 is gradually moved upward to prevent the user from recognizing the impact. As a result, the user feels a shock only in the downward direction, that is, the direction in which the button 1901 is pressed, thereby inducing the click of the button 1901.

On the other hand, if the user moves the haptic stylus 100 over the button 1902 with the intent of task backing to return to the previous task (B), the application 205 may alert the user of the task backing Repeating the collision of the mass 402 of the linear vibrator 102 upward to induce avoidance induces button 1902 click avoidance.

In this case as well, when the mass 402 is collided upward and moved downward again, the mass 402 is gradually moved downward so that the user does not recognize the impact.

FIG. 20 is a conceptual view illustrating a method of providing tactile feedback as a size or an angle value of a figure is changed when a figure is edited on a touch screen using a haptic stylus according to the present invention.

As shown in FIG. 20, when the user edits the size or angle of the figure 2001 on the touch screen 203, the size or angle is changed by selecting and moving the control handles 2002 and 2005 of the selected figure. .

Specifically, when the user grabs and moves the control handle 2002 for editing the size of the figure using the haptic stylus 100, the position of the selected control handle 2004 on the unit coordinate 2003 in which the actual size of the figure is determined. ) Changes. In this case, the mass 402 of the linear vibrator 102 may be collided to the opposite side to provide a tactile feedback about a unit change in position, thereby helping the user to precisely change the size of the figure.

Similarly, when the user grabs and moves the control handle 2005 for editing the angle of the figure using the haptic stylus 100, the angle 2007 is changed based on the rotation center. At this time, as the unit angle 2006 changes, the mass 402 of the linear vibrator 102 may collide to the opposite side to provide tactile feedback so that the user may precisely rotate the figure.

21 is a schematic view for explaining a method of charging the haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 21, the terminal 202 has a charging portion 2101 and a charging terminal 2102 having a hole or groove that may correspond to the charging terminal 108 of the haptic stylus 100.

The charging terminal 2102 of the terminal 202 is a terminal contact portion that has passed through a charging power supply circuit using the internal power supply of the terminal 202. The rechargeable battery 104 inside the haptic stylus 100 is charged while the haptic stylus 100 is inserted into the charging unit 2101 in the groove or hole shape.

22 is a flowchart illustrating a tactile interaction process according to a button selection on a touch screen using the linear vibrator 102 of the haptic stylus 100 according to an embodiment of the present invention.

As shown in FIG. 22, when a user presses a button on the touch screen 203 of the terminal 202 using the haptic stylus 100 (S2200), an application of the terminal 202 interlocking with the touch screen 203 is performed. An event of pressing a button is generated by the program 205, and the event is transmitted to the wireless communication unit 105 of the haptic stylus 100 through the wireless communication module 204 (S2201).

The mass body 402 of the linear vibrator 102 received the button press event impacts downward (S2202) to implement the feeling of pressing the button.

Thereafter, when the haptic stylus 100 is released from the button on the touch screen 203 (S2203), an event in which the button is released by the application program 205 of the terminal 202 linked with the touch screen 203 occurs. The event is transmitted to the wireless communication unit 105 of the haptic stylus 100 through the wireless communication module 204 (S2204).

The mass body 402 of the linear vibrator 102 received the button press release event impacts upward (S2205) to implement the feeling that the button returns.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and it is common in the art that various substitutions, modifications, and changes can be made without departing from the technical spirit of the present invention. It will be apparent to those skilled in the art.

1 is a block diagram showing a detailed configuration of a tactile interaction system using a haptic stylus;

2 is a perspective view of implementing a haptic stylus according to an embodiment of the present invention shown in FIG.

3 is a conceptual diagram illustrating an operation principle of a rotary vibrator of a haptic stylus according to the present invention;

4 is a conceptual diagram illustrating the operation principle of the linear vibrator of the haptic stylus according to the present invention;

5 is a conceptual diagram illustrating a principle of changing a period of vibration while drawing or writing on a touch screen using a haptic stylus according to the present invention;

6 is a conceptual diagram illustrating a principle of changing the intensity of vibration while drawing or writing on a touch screen using a haptic stylus according to the present invention;

7 is a conceptual diagram illustrating a principle of changing the period of vibration with a linear vibrator while drawing or writing on a touch screen using a haptic stylus according to the present invention;

8 is a conceptual diagram for explaining the principle of generating a vibration in accordance with the pointer position changes while drawing or writing on the touch screen using a haptic stylus according to the present invention,

9 is a conceptual diagram illustrating a method of informing a tactile feedback of a phenomenon that a pointer leaves a predetermined area on a touch screen using a haptic stylus according to the present invention;

10 is a conceptual diagram schematically illustrating a process of pressing a general button;

11 is a conceptual diagram illustrating a process of pressing a button on a touch screen using a haptic stylus according to the present invention;

12 is a conceptual diagram illustrating a process of moving a position of an object on a touch screen using a haptic stylus according to the present invention;

13 is a graph illustrating a method of moving a mass of a linear vibrator of a haptic stylus without colliding with a contact surface according to the present invention;

14 is a conceptual diagram illustrating tactile feedback of a process of increasing and decreasing a window using a haptic stylus according to the present invention;

15 is a conceptual diagram illustrating a process of manipulating a scroll bar using a haptic stylus according to the present invention;

16 is a conceptual view illustrating a method of controlling a window size manipulation button using a haptic stylus according to the present invention;

17 is a conceptual diagram illustrating a process of operating a menu movement and a pop-up menu using a haptic stylus according to the present invention;

18 is a conceptual diagram illustrating a principle of generating vibration in accordance with a change in the number of selected letters when a plurality of letters in a document are selected by scraping on a touch screen using a haptic stylus according to the present invention;

19 is a conceptual diagram illustrating a method of inducing a user input by providing tactile feedback according to an operational intention of a button when a cursor is positioned on a specific button on a touch screen using a haptic stylus according to the present invention;

FIG. 20 is a conceptual view illustrating a method of providing tactile feedback as a size or angle value of a shape is changed when a shape is edited on a touch screen using a haptic stylus according to the present invention; FIG.

21 is a schematic diagram illustrating a method of filling a haptic stylus according to the present invention, and

22 is a flowchart illustrating a tactile interaction process during pressing a button on a touch screen using a linear vibrator of a haptic stylus according to the present invention.

Claims (28)

A wireless communication unit which receives an event including tactile output information through wireless communication with the outside; A controller configured to generate a control signal for reproducing a tactile pattern corresponding to the tactile output information; And And a tactile stimulator for reproducing the tactile pattern by the control signal. The method of claim 1, A battery that is a power supply; And And a charging terminal for charging the battery. The method of claim 1, And a sound output unit for reproducing a sound effect corresponding to the tactile pattern. The method of claim 1, And a microphone and a speaker having a sound input / output function for a voice call or a voice command. The method of claim 3, And the control unit controls the sound output unit to output a warning or notification sound. The method of claim 1, And the event is generated in response to the operation of the input device on the touch screen. The method of claim 1, wherein the tactile stimulation unit A rotary vibrator generating vibration through a first mass rotating by the control signal, or a linear vibrator generating shock and vibration through a second mass performing vertical linear motion by a magnetic field corresponding to the control signal. An haptic feedback capable input device comprising one or both. The method of claim 7, wherein The first mass is eccentrically attached to the rotating shaft of the rotary vibrator, the haptic feedback capable input device, characterized in that for generating vibration through the eccentric rotation movement. The method of claim 7, wherein When the object on the touch screen is selected or released, the controller is one of a collision that strikes the second mass of the linear vibrator with the upper contact surface, sequential collision with the upper and lower contact surfaces, or sequential collision with the lower and upper contact surfaces. Input device capable of tactile feedback, characterized in that to generate a. The method of claim 7, wherein And the control unit generates vibration of the first or second mass when the object on the touch screen is selected or released. The method of claim 7, wherein And the control unit increases the input period of the control signal in proportion to the moving speed of the pointer. The method of claim 7, wherein And the control unit increases the vibration intensity of the rotary vibrator in proportion to the moving speed of the pointer. The method of claim 7, wherein Wherein the control unit when the pointer moves by the moving distance unit, the input device capable of haptic feedback, characterized in that for generating a short vibration of the rotary vibrator or a collision with the sequential lower, upper contact surface of the linear vibrator. The method of claim 7, wherein And the control unit gradually increases the intensity of vibration while maximizing the size of the window on the touch screen. The method of claim 7, wherein And the control unit gradually reduces the intensity of vibration while minimizing the size of the window on the touch screen. The method of claim 7, wherein And the control unit increases the intensity of vibration in proportion to a departure distance outside the predetermined region of the pointer. The method of claim 7, wherein When the control unit closes the window on the touch screen, tactile feedback is possible, which generates one of progressively weakening vibration, short vibration, or collision with the sequential contact surface above and below the linear vibrator for a predetermined time. Input device. The method of claim 7, wherein Wherein the control unit when a new pop-up menu occurs on the touch screen, the input device capable of haptic feedback, characterized in that for generating a short vibration, or a collision with the sequential contact surface above the linear vibrator for a predetermined time. The method of claim 7, wherein When the number of objects selected by the input device is changed on the touch screen, the controller generates a sequential collision of the second mass of the linear vibrator with the upper and lower contact surfaces. . The method of claim 19, And the object selected by the input device on the touch screen is one of letters, icons, folders, and files in one or more selectable documents. The method of claim 7, wherein When the input device is located on a button having a predetermined purpose on the touch screen, the control unit generates a repetitive collision with one of the upper or lower contact surfaces of the second mass of the linear vibrator. Input device with tactile feedback. The method of claim 21, The control part gradually moves the mass body so as not to collide with the opposite side when the second mass of the linear vibrator collides with one of the upper or lower contact surfaces and then moves to the opposite side. Input device with feedback. The method of claim 7, wherein  The control unit generates a sequential collision of the second mass of the linear vibrator with the upper and lower contact surfaces when the size or angle of the figure is changed by the reference unit by the input device on the touch screen. 2 possible input devices. Manipulating a pointer on the touch screen in contact with the touch screen or near the surface of the touch screen outside of the touch screen, receiving an event including tactile output information corresponding to the manipulation of the pointer through wireless communication, An input device to reproduce the tactile pattern corresponding to the output information; And Tactile using the input device capable of haptic feedback, including; a terminal for generating an event in the application program including the tactile output information corresponding to the pointer operation in the touch screen by the input device, and delivers the event to the input device Interaction system. The device of claim 24, wherein the input device is A wireless communication unit for receiving an event including the tactile output information through wireless communication with an outside, and a controller configured to generate a control signal for reproducing a tactile pattern corresponding to the tactile output information; And at least one of a linear vibrator mounted to generate a motion of the mass in a direction perpendicular to the contact surface of the touch screen and a rotary vibrator for rotating the eccentric mass to reproduce the tactile pattern by the control signal. A tactile interaction system using an input device capable of tactile feedback, comprising a unit. The method of claim 24, The input device is a tactile interaction system using a haptic feedback capable input device, characterized in that the pen-shaped. The method of claim 24, And the input device is charged from the terminal. In a tactile interaction system using an input device capable of tactile feedback, a tactile interaction method during pressing a button on a touch screen, When a button on the touch screen is pressed by the input device, generating a button press event by an application program of a terminal interworking with the touch screen; The button press event being transmitted to an external input device, and the mass of the linear vibrator collides with the contact surface in a downward direction by a digital signal corresponding to the button press event; When the external input device is released from the button, generating a button press release event by an application program of a terminal interworking with the touch screen; And The button press release event is transmitted to the external input device, and the mass of the linear vibrator collides with the contact surface in an upward direction by a digital signal corresponding to the button press release event. Tactile interaction method using.

Images