WO2011118889A1

WO2011118889A1 - System for driving vibrating mouse and method therefor

Info

Publication number: WO2011118889A1
Application number: PCT/KR2010/006333
Authority: WO
Inventors: 임상수
Original assignee: (주)마이크로텍시스템
Priority date: 2010-03-26
Filing date: 2010-09-16
Publication date: 2011-09-29

Abstract

The present invention relates to a system for driving a vibrating mouse and a method therefor, and is to provide a mouse with a vibration effect in various patterns through the use of audio signals generated in a game application program according to a command input by a user, thereby increasing the user's immersion in the game and enabling the user to realistically enjoy the game. In addition, the present invention relates to a system for driving a vibrating mouse, and is to provide a mouse with a vibration effect in various patterns according to work situations generated while the user is working, thereby enabling the user to easily recognize the current work situation and thus making it possible to increase the efficiency of the work.

Description

Vibrating mouse drive system and method

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for driving a vibrating mouse, and more particularly to a technique for imparting various vibration effects to a mouse according to an audio signal generated from a game application program.

In addition, the present invention relates to a technique for driving a vibrating mouse, and relates to a technique for applying a vibration effect to the mouse in accordance with the movement of the mouse cursor moving on the OS or application program.

In general, entertainment software such as video games, movies, music, audio, and the like provide a variety of feedback in which video and audio work together. Some entertainment software provides additional sense feedback through the haptic controller. For example, the Playstation 2 controller, the input device for Sony's home game consoles, is haptic-enabled, allowing video games to signal a variable rumble effect to generate a variety of tactile sensations to enhance the gaming experience. Haptics include any technique that stimulates the sensing of tactile and / or kinesthetics, such as, for example, techniques that generate thermal feedback, force feedback, vibration, and the like. Although haptic control is powered by some gaming software, not all gaming software is haptic-enabled, and not all platforms running gaming software support haptic feedback.

On the other hand, in addition to the sound recently output from the game machine in advance to set the vibration pattern formulated on the game machine itself, if the user meets the preset conditions during the game, the user's hearing by vibrating the vibration device of the game machine in a predetermined predetermined pattern Game consoles that stimulate and touch at the same time appeared.

However, unlike a game machine that supports such vibration effects, a personal computer that can run a game program does not support vibration effects in an input device such as a mouse or a keyboard of the personal computer even if a user runs a game program. The game is played only through a limited feedback method called sound.

In addition, since a personal computer has a limited feedback method compared to a game machine, a problem arises in that the user's immersion in the game is less than that of a game machine and can cause boredom.

Accordingly, there is a need for a method for providing a user with various feedback effects in accordance with the driving of a game program in a personal computer like a game machine.

In addition, in general, an application running on the OS or OS supports a cursor indicating a location for inputting a preset command. A TUI type OS such as DOS or Linux supports a rectangular cursor and supports a window or a Mac. The GUI-like OS supports the arrow-shaped cursor.

Currently, an OS that supports a graphical GUI method that is easily accessible to the general public is widely used, compared to an OS that supports a text-based TUI method that was mainly used by existing experts.

The graphical GUI supports a separate input device called a mouse, and the user can easily input a command necessary for the user to use the program through the mouse instead of the text input method.

In general, an OS that supports a GUI provides an arrow-shaped mouse cursor that moves on a screen provided by the OS according to the movement of the mouse, and the mouse cursor changes its shape when it meets certain preset conditions. Indicates various situations that occur during the operation. For example, when the user moves the mouse, the arrow-shaped mouse cursor moves on the screen provided by the OS according to the direction of the mouse movement. When the user executes the application through the mouse, the application is finished executing. The mouse cursor is transformed into an hourglass, the mouse cursor turns into a vertical bar with a small bar at the top and bottom of the string that you can select and edit, and the user moves the mouse cursor to the hyperlinked character. The shape of the mouse cursor is transformed into a hand with a finger. Therefore, the user can easily know the current working situation through the change of the shape of the mouse cursor, and the user can easily know what to do next through the change of the shape of the mouse cursor.

However, when the user moves the mouse cursor to an object such as a button, an icon or a menu provided by an OS or an application and selects or activates the selected object, the user provides only a visual change of the object. If you're not used to it, you'll have a hard time figuring out what's going on.

Thus, there is a need for a method that allows a user unfamiliar with the mouse to easily recognize what is currently being done.

SUMMARY OF THE INVENTION An object of the present invention is to provide a technique for applying various vibration effects to a mouse by using an audio signal generated from a game application program, in particular according to a user's command input.

It is also an object of the present invention, in particular, to provide a technique for imparting a vibration effect to a mouse in accordance with a change in the image of a mouse cursor or an image near the mouse cursor.

In order to achieve the above technical problem, the present invention, in the system for driving a vibration mouse, the audio signal extraction function for extracting the audio signal generated when driving the application program in the central processing unit, and the extracted audio signal in advance A recording medium including an audio signal processing function for filtering based on a set signal band and a vibration drive data generation function for generating vibration drive data including vibration pattern information corresponding to the filtered audio signal; And a vibration mouse including a vibration drive controller for generating a vibration control signal corresponding to the vibration pattern information included in the vibration drive data received from the recording medium, and a vibration motor vibrating according to the vibration control signal.

The present invention also provides a method of driving a vibrating mouse, comprising: (a) extracting an audio signal generated when driving an application program in a central processing unit; (b) filtering the extracted audio signal based on a preset signal band; (c) generating vibration driving data including vibration pattern information corresponding to the filtered audio signal; And (d) driving the vibration motor provided in the mouse according to the vibration pattern information included in the vibration driving data.

In addition, in order to achieve the technical problem, the present invention, in a system for driving a vibrating mouse, a mouse cursor movement detection function for detecting whether the mouse cursor is moved and the direction of movement, and includes a point that the mouse cursor indicates The comparison area capture function which captures every preset period when the mouse cursor moves over the comparison area, which is a preset size area, and the most recently updated latest comparison area image captured by the comparison area capture function. The comparison area comparison function to compare the generated previous comparison area image, and the comparison area comparison function compares the latest comparison area image with the previous comparison area image and generates vibration driving data including a vibration pattern when there is a change in color or saturation. A recording medium including a control function for transmitting to a vibrating mouse; And a vibration mouse including a vibration drive controller generating a vibration control signal corresponding to the vibration pattern included in the vibration drive data received from the recording medium, and a vibration motor vibrating according to the vibration control signal generated by the vibration drive controller. It is configured to include.

In addition, the present invention provides a method for driving a vibrating mouse, the method comprising capturing a comparison area, which is a region of a preset size including a point indicated by the mouse cursor according to the movement of the vibrating mouse, at every predetermined period when the mouse cursor is moved ( Capturing; Comparing the most recently captured latest comparison area image with the immediately previous captured previous comparison area image in the capturing step; And driving the vibrating motor of the vibrating mouse when it is determined that the latest comparison region image has a change in color or saturation in comparison with the previous comparison region image.

The present invention also provides a method of driving a vibrating mouse, the method comprising: capturing a mouse cursor image region, which is a region of a preset size including a mouse cursor image, according to a movement of the vibrating mouse at predetermined intervals; ; Comparing the most recently captured latest mouse cursor image with the immediately previous captured mouse cursor image in the capturing step; And if it is determined that there is a change in the latest mouse cursor image compared with the previous mouse cursor image in the comparing step, driving the vibration motor of the vibrating mouse.

According to the present invention, by using the audio signal generated from the game application program according to the user's command input to give a vibration effect of various patterns with the mouse, to increase the immersion to the user's game and allow the user to enjoy a realistic game It is effective.

Further, according to the present invention, the user can easily recognize the current work situation by increasing the efficiency of the work by giving the mouse a vibration effect of various patterns according to the work situation occurring during the work.

1 is a view schematically showing the configuration of a vibration mouse driving system according to an embodiment of the present invention.

2 is a diagram illustrating an audio signal filtered by an audio signal processing module according to an embodiment of the present invention.

3 is an exemplary view showing a vibration mouse driven according to an embodiment of the present invention.

4 is a flowchart illustrating a process of driving a vibrating mouse according to an exemplary embodiment of the present invention.

5 is a view schematically showing the configuration of a vibration mouse driving apparatus according to an embodiment of the present invention.

6 is an exemplary view showing an event appearing on the OS according to a mouse cursor movement according to an embodiment of the present invention.

7 is an exemplary view showing an event appearing on a web browser according to a mouse cursor movement according to an embodiment of the present invention.

8 is an exemplary view showing an event appearing on a document creating program according to a mouse cursor movement according to an embodiment of the present invention.

9 is a flowchart illustrating a process of driving a vibrating mouse according to an embodiment of the present invention.

10 is a view schematically showing the configuration of a vibration mouse driving apparatus according to another embodiment of the present invention.

11 is an exemplary diagram illustrating an event that occurs when a mouse cursor moves to a menu area of an application according to another embodiment of the present invention.

12 is an enlarged view illustrating a process of moving a comparison area in the area 'D' of FIG. 7 according to another embodiment of the present invention.

FIG. 13 is a diagram illustrating a change of a mouse cursor when a mouse cursor moves to an object to which a link is set in a web browser according to another embodiment of the present invention.

14 is a flowchart illustrating a process of driving a vibrating mouse according to another embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

1 is a view schematically showing a configuration of a vibration mouse driving system according to an embodiment of the present invention, and FIG. 2 is a view showing an audio signal filtered by an audio signal processing module according to an embodiment of the present invention. , [FIG. 3] is an exemplary view showing how a vibration mouse is driven according to an embodiment of the present invention.

For convenience of description, the embodiment of the present invention will be described on the assumption that the vibrating mouse driving system operates in an environment driven by a game application program developed in accordance with the Windows standard on a Windows OS. In addition, the vibration mouse driving system may operate in an environment driven by various applications in which an audio signal is generated according to a user's input command.

Referring to FIG. 1, the vibration mouse driving system includes a vibration driving program 160 and a vibration mouse 180.

The vibration drive program 160 includes an audio signal extraction module 161, an audio signal processing module 163, and a vibration drive data generation module 165.

The audio signal extraction module 161 extracts an audio signal generated while loading and driving a game application stored in the application storage unit 110 in the central processing unit 120 according to a user's request. Here, the role of the virtual audio device driver 130 needs to be installed in order to separate the audio signal output from the central processing unit 120 into the sound input / output unit 140 and the vibration driving program 160 to both sides, The audio signal extraction module 161 preferably extracts an audio signal through the virtual audio device driver 130, and extracts an audio signal of a pulse code modulation (PCM) method processed by the CPU 120. Since it is extracted immediately, it is possible to reduce the processing time required to give the vibration effect to the vibration mouse 180. In this case, the other output audio signal output from the virtual audio device driver 130 is transmitted to the speaker 150 through the sound input / output unit 140 and output, so that the consumer hears the same sound.

The audio signal processing module 163 generates a filtered audio signal obtained by filtering an audio signal having a predetermined reference value or more from the audio signal extracted by the audio signal extraction module 161. Here, the audio signal processing module 163 extracts only the audio signal of the form of (b) of FIG. 2 by filtering only the signal above a predetermined reference value from the audio signal of the form of (a) of FIG. 2. In this case, the audio signal processing module 163 may adjust the reference value for filtering by software, and if the reference value is set too low in the audio signal processing module 163, the vibration effect may be applied to the audio signal that is not large in the vibration mouse 180. On the contrary, if the reference value is set too high, the vibration effect may occur only on the audio signal that is quite large in the vibration mouse 180, thereby lowering the vibration effect. Therefore, the reference value of the audio signal processing module 163 is preferably set according to the band of the audio signal supported by the game application program.

The vibration drive data generation module 165 generates vibration drive data including vibration pattern information corresponding to the filtered audio signal filtered by the audio signal processing module 163. Here, referring to (b) of FIG. 2, for example, the vibration driving data generation module 165 may gradually increase the intensity of vibration in the section A0 to A1 and gradually decrease the intensity of vibration in the section A1 to A2. In the A3 section is a constant intensity, the A3 to A4 section may generate a weaker vibration pattern, and does not give a vibration effect for the portion that does not exceed the reference value. In this case, the vibration driving data including the generated vibration pattern information is generated in real time as the audio signal is generated in the CPU 120. In addition, the vibration drive data generated by the vibration drive data generation module 165 is transmitted to the vibration mouse 180 in real time through the data input / output unit 170 supporting the USB bidirectional communication protocol.

Here, the vibration drive program 160 according to an embodiment of the present invention may further include a vibration pattern information storage unit (not shown) for storing the vibration pattern information matched to the various types of audio signal, respectively, In this case, the vibration drive data generation module 165 retrieves vibration pattern information corresponding to the filtered audio signal received from the audio signal processing module 163, and generates vibration drive data including the vibration pattern information to generate the vibration mouse 180. To send).

The vibration mouse 180 is an input device for generating a vibration effect according to the vibration drive data received from the vibration drive program 160, and includes a vibration drive controller 181, a vibration motor driver 183, and a vibration motor 185. do.

The vibration drive control unit 181 analyzes vibration drive data received from the vibration drive program 160 to check vibration pattern information included in the vibration drive data, and to provide a vibration effect to the vibration motor 185. Generates a vibration control signal corresponding to the transmission to the motor driver 183. Here, the vibration driving control unit 181 stores information about a plurality of vibration control signals matched with each vibration pattern.

The motor driving unit 183 is a device for adjusting the vibration intensity and the vibration time of the vibration motor 185 by adjusting the voltage and the current. The motor driving unit 183 adjusts the voltage and the current according to the vibration control signal received from the vibration driving control unit 181. The motor 185 controls to implement various vibration patterns.

The vibration motor 185 vibrates along the voltage and current input from the motor driver 183 to provide a vibration effect to the user. Here, the vibration motor 185 according to the embodiment of the present invention is preferably a vibration motor of a linear resonant actuator (LRA) method.

Thus, referring to FIG. 3, for example, when a user inputs a command for firing a gun from a game application through the vibrating mouse 180, the user may be provided at the personal computer 100 in which the vibration driving program 160 is installed. Processes the input command and outputs the sound effect to the speaker 150 and gives a vibration effect to the vibration mouse 180.

4 is a flowchart illustrating a process of driving a vibrating mouse according to an exemplary embodiment of the present invention. Here, in the embodiment of the present invention, for convenience of description, the central processing unit 120 loads and drives a game application program stored in the application program storage unit 110 according to a user's request, and relates to driving the game application program from the user. It will be described on the assumption that the command is input through the vibration mouse 180. In addition, the user may input a command through the keyboard device in addition to the vibrating mouse 180.

Referring to FIG. 4, first, a game application program is driven by the CPU 120 according to a user's request (S410). At this time, the central processing unit 120 processes the sound effect generated according to the user's input command while driving the game application program, and transmits the processed sound effect to the virtual audio device driver 130.

Subsequently, the audio signal extraction module 161 extracts one audio signal separated from the CPU 120 through the virtual audio device driver 130 (S420), and the audio signal processing module 163 may extract the audio signal. The audio signal extracted at 161 is applied to the audio signal extracted in step 161 to filter the audio signal having the reference value or more (S430).

Subsequently, the vibration drive data generation module 165 generates vibration drive data including vibration pattern information corresponding to the filtered audio signal filtered by the audio signal processing module 163 (S440), and the data input / output unit 170. The vibration is transmitted to the mouse 180. Here, in the embodiment of the present invention, the vibration drive data generation module 165 defines the vibration pattern corresponding to the filtering audio signal and describes that the vibration drive data including information on the defined vibration pattern is described. The vibration driving data generation module 165 retrieves the vibration pattern information corresponding to the filtering audio signal from the vibration pattern information storage unit (not shown) in which the matching vibration pattern information is stored for each of the various types of filtering audio signals. In addition, it is also possible to generate vibration drive data including the retrieved vibration pattern information and transmit it to the vibration mouse 180.

Subsequently, the vibration drive controller 181 analyzes vibration drive data received from the vibration drive program 160 to generate a vibration control signal according to the vibration pattern information included in the vibration drive data (S450). At this time, the vibration driving control unit 181 transmits the generated vibration control signal to the motor driving unit 183.

Subsequently, the motor driver 183 drives the vibration motor 185 by adjusting the voltage and the current according to the received vibration control signal to generate a vibration effect in the vibration mouse 180 (S460).

Therefore, the vibration mouse driving system gives the vibration effect of various patterns according to the work situation that occurs while the user works with the mouse, so that the user can easily recognize the current work situation.

5 is a view schematically showing the configuration of a vibration mouse driving apparatus according to an embodiment of the present invention, Figure 6 is an exemplary view showing an event appearing on the OS according to the mouse cursor movement according to an embodiment of the present invention. 7 is an exemplary view illustrating an event appearing on a web browser according to a mouse cursor movement according to an embodiment of the present invention, and FIG. 8 is a document creating program according to a mouse cursor movement according to an embodiment of the present invention. This is an example of the events that appear on the screen.

Here, in the embodiment of the present invention, for convenience of description, it is assumed that the vibrating mouse driving device is driven in an application program developed according to a window OS or a Windows standard standard.

Referring to FIG. 5, the vibration mouse driving apparatus includes a vibration driving program 533 including an event monitoring module 533a, a vibration pattern storing module 533b, an event analysis module 533c, and a control module 533d. A vibration mouse 550 including a vibration drive controller 551, a motor driver 553, and a vibration motor 555 is included.

The event monitoring module 533a monitors whether a preset event is generated according to a movement command or an execution command input from a mouse in the OS 531a or the application program 531b running in the OS. Here, a detailed description of the event will be described in detail with reference to the accompanying drawings.

Referring to FIG. 6, when the mouse cursor 6a shown in (a) of FIG. 6 moves to the area A where the quick launch icon is located or the area B where the task display button is located, the (b) of FIG. As shown in FIG. 2, an event occurs in which the color of the icon of the area A indicated by the mouse cursor or the color of the task display button of the area B changes. In addition, when the mouse cursor 6b positioned on the menu moves to the C region as shown in (a) of FIG. 6, the menu of the C region indicated by the mouse cursor as shown in (b) of FIG. 6 is moved. An event that changes color occurs. Here, although not shown in the drawing, if an execution command such as a mouse click is input from the vibrating mouse 550 after moving the mouse cursor to an icon of an area A or an operation B button of an area B, a program matched to the icon or an operation display button is displayed. An event is activated.

Referring to FIG. 7, when the mouse cursor 7a shown in (a) of FIG. 7 is moved to an area A or a region B having a tool icon, which is a 'move' menu of a menu bar provided by a web browser, As shown in (b) of FIG. 7, an event occurs in which the color of the 'move' menu of the area A indicated by the mouse cursor 7a or the color of the tool icon of the area B changes. In addition, when the mouse cursor 7b located on the web page moves to the C region, which is the link-set text, as shown in (a) of FIG. 7, the mouse cursor as shown in (b) of FIG. 7. As the text shape and color of the C area indicated by 7b changes, the mouse cursor turns into a finger. In addition, as shown in (a) of FIG. 7, when the mouse cursor 7b moves to the scroll button D region and an execution command such as a mouse click is input from the vibrating mouse 550, an event in which the web page moves up and down is generated. Occurs.

Referring to FIG. 8, the mouse cursor 8a shown in (a) of FIG. 8 is a region A or 'paste' tool icon, which is a 'page layout' menu of a menu bar provided by an office program. When moving to the area, as shown in (b) of FIG. 8, an event in which the color of the 'Page Layout' menu of the area A indicated by the mouse cursor 8a or the color of the 'paste' tool icon of the area B changes. Occurs. In addition, as shown in (a) of FIG. 8, when an execution command such as a mouse click is input from the vibrating mouse 550 after the mouse cursor 8b positioned on the document page is moved to a specific cell C region, [FIG. 8] As shown in (b) of FIG. 3, an event of changing the color of the cell indicated by the mouse cursor 8b occurs.

As described above with reference to FIGS. 6 and 8, an OS or an application generates an event by a mouse movement command or an execution command.

The vibration pattern storage module 533b stores various vibration patterns set in advance for each event occurring in an OS or an application program according to a command input from the vibration mouse 550. Here, the vibration pattern refers to a vibration method made up of various combinations of vibration intensity and vibration time, such as a vibration pattern for repeatedly generating the vibration strongly for 1 second, and a vibration pattern for repeatedly generating the vibration several times for 2 seconds. Means vibration method. For example, the vibration pattern storage module 533b stores a vibration pattern in which the vibration of the mouse is generated several times for 0.5 seconds when the user moves the mouse cursor to the execution icon to change the color of the execution icon. When the mouse cursor is pointing to the execution icon and inputs an execution command such as a click, the vibration pattern that is consistently generated for one second is stored.

The event analysis module 533c analyzes event information generated according to a movement command or an execution command input from the vibrating mouse 550 in an OS or an application program. For example, the event analysis module 533c may react when an mouse cursor indicates an object such as a button, an icon, or a menu that is represented in an OS or an application, or an object generated by the OS or an application may vibrate. It is analyzed whether the reaction occurs in an OS or an application program when activated by an execution command such as a click or a double click input from the mouse 550. For example, the event analysis module 533c changes the shape of the mouse cursor when the object is activated when the mouse cursor is pointing to the object or whether the event is a change of shape or color of the object when the mouse cursor is pointing to the object. Analyze if the event.

The control module 533d checks whether a vibration pattern preset for the event analyzed by the event analysis module 533c is stored in the vibration pattern storage module 533b, and checks the event analyzed by the event analysis module 533c. If it is determined that the preset vibration pattern is stored in the vibration pattern storage module 533b, the vibration driving data including the vibration pattern matched with respect to the analyzed event is generated to generate the vibration drive data through the input / output unit 539. Transmission to the vibration drive control unit 551. Here, the control module 533d transmits vibration drive data to the vibration drive control unit 551 using a USB bidirectional communication protocol.

The vibration drive controller 551 analyzes vibration drive data received from the control module 533d to check the vibration pattern included in the vibration drive data, and includes the vibration drive data in the vibration drive data to give a vibration effect to the vibration motor 555. A vibration control signal corresponding to the generated vibration pattern is generated and transmitted to the motor driver 553. Here, the vibration drive control unit 551 preferably stores information on a plurality of vibration control signals matched to each vibration pattern received from the control module 533d.

The motor driver 553 is a device for controlling the vibration intensity and the vibration time of the vibration motor 555 by adjusting voltage and current. The motor driver 553 adjusts the voltage and current according to the vibration control signal received from the vibration drive controller 551 to vibrate. The motor 555 controls to implement various vibration patterns.

The vibration motor 555 vibrates along the voltage and current input from the motor driver 553 to provide a vibration effect to the user.

9 is a flowchart illustrating a process of driving a vibrating mouse according to an embodiment of the present invention. Here, in the embodiment of the present invention, for the convenience of explanation, it will be described on the assumption that the vibration effect is generated in the vibration mouse according to an event generated while the mouse cursor moves.

First, the event monitoring unit 533a monitors whether an event occurs according to a movement of a mouse cursor in an OS or an application program (S910), and determines whether an event occurs in the OS or an application program (S920).

If it is determined in step S920 that the event occurs, the event analyzer 533c analyzes an event occurring in the OS or an application (S930), and matches the event generated in the OS or the application to the vibration pattern storage unit 533b. It is determined whether there is a vibration pattern (S940).

If it is determined in step S940 that there is a matched vibration pattern, the control module 533d generates vibration drive data including the vibration pattern matched to an event generated in the OS or an application program in operation S950. At this time, the control module 533d transmits the vibration drive data to the vibration drive controller 551 of the vibration mouse 550.

Subsequently, the vibration drive controller 551 analyzes the vibration drive data received from the control module 533d to generate a vibration control signal according to the vibration pattern included in the vibration drive data (S960). At this time, the vibration drive controller 551 transmits the generated vibration control signal to the motor driver 553.

Subsequently, the motor driver 555 drives the vibration motor 555 by adjusting the voltage and the current according to the received vibration control signal to generate a vibration effect in accordance with the vibration pattern in the vibration mouse 550.

Therefore, the vibrating mouse driving device gives the vibration effect of various patterns according to the working situation that occurs while the user works with the mouse, so that the user can easily recognize the current working situation.

FIG. 10 is a view schematically showing a configuration of a vibration mouse driving apparatus according to another embodiment of the present invention, and FIG. 11 is generated when a mouse cursor moves to a menu area of an application according to another embodiment of the present invention. 12 is an exemplary view illustrating an event, and FIG. 12 is an enlarged view illustrating a process of moving a comparison area in the area 'D' of FIG. 11 according to another embodiment of the present invention. In the web browser according to another embodiment of the present invention is a view showing the change of the mouse cursor when the mouse cursor moves to the link-set object.

Referring to FIG. 10, the vibration mouse driving apparatus includes a mouse cursor movement detection module 1033a, a vibration pattern storage module 1033b, a comparison area capture module 1033c, a comparison area comparison module 1033d, and a control module 1033e. And a vibration mouse 1050 including the vibration driving program 1033, the vibration driving control unit 1051, the motor driving unit 1053, and the vibration motor 1055. Here, for the convenience of description, a detailed description of the vibration mouse 1050 in which the embodiment and the description of the present invention are duplicated will be omitted.

The mouse cursor movement detection module 1033a detects whether the mouse cursor moves and the direction of movement according to the movement of the vibrating mouse 1050 by the user.

The vibration pattern storage module 1033b stores various vibration patterns set in advance for various events generated by the movement of the vibration mouse 1050. Here, the vibration pattern refers to a vibration method made of various combinations of vibration intensity and vibration time.

The comparison area capture module 1033c captures a comparison area, which is an area of a preset size including a point indicated by the mouse cursor, at predetermined intervals. In this case, the comparison area capturing module 1033c will be described on the assumption that the comparison area is captured at 0.1 second intervals, and the comparison area capturing module 1033c may be configured to capture the comparison area at various time periods according to a user's setting. Here, it will be described on the assumption that the size of the comparison area according to an embodiment of the present invention is 20 X 20 pixels, and the size of the comparison area may be set by the user in various sizes.

In addition, the comparison region capture module 1033c captures a mouse cursor image region, which is a region of a preset size including a mouse cursor image, at predetermined intervals. Here, the comparison area capturing module 1033c captures the mouse cursor image area when the mouse cursor is located on a web browser such as Explorer, Chrome, or Firefox.

The comparison area comparison module 1033d compares the latest comparison area image most recently captured by the comparison area capture module 1033c with the previous comparison area image captured immediately before.

In addition, the comparison area comparison module 1033d may include a mouse that has previously been captured the most recently captured mouse cursor image when the mouse cursor is positioned on the web browser and the mouse cursor image is captured by the comparison area capture module 1033c. Compare with the cursor image.

When the control module 1033e compares the latest comparison area image with the previous comparison area image by the comparison area comparison module 1033d and determines that there is a change in color or saturation, the control module 1033e generates the vibration driving data including the vibration pattern and generates an input / output unit ( 1039) is transmitted to the vibrating mouse. Here, the principle for generating the vibration drive data in the control module 1033e will be described in detail with reference to [11] and [12] below.

In addition, if it is determined that the most recently captured mouse cursor image is different from the immediately captured mouse cursor image in the comparison area comparison module 1033d, the control module 1033e generates and outputs vibration driving data including a vibration pattern. The part 1069 transmits the vibration to the mouse. Here, the principle for generating the vibration drive data in the control module 1033e will be described in detail with reference to FIG. 13 below.

An operation process of the control module 1033e will be described in detail with reference to FIG. 13 below.

Referring to FIG. 11, as shown in area D of FIG. 11, a comparison area for capturing a rectangular area around a point indicated by the mouse cursor E is defined. Here, in the embodiment of the present invention, the comparison area is defined as a rectangle, but in addition to the rectangle, various shapes that may include an area indicated by the mouse cursor are possible. When the mouse cursor E enters the menu area (between L1 and L2) from the normal area, the menu area (between L1 and L2) changes color or saturation, and the mouse cursor E changes the menu area L1 and L2. When exiting to the general area, the menu area (between L1 and L2) is restored to its initial state.

A process of capturing a comparison area and a process of generating a vibration in a vibrating mouse will be described in more detail with reference to FIGS. 11 and 12. For convenience of explanation, the mouse cursor E is used in a general area. It is assumed that the comparison area F is captured 6 times (<P1> to <P6>) in the process of entering the menu area (between L1 and L2) and then returning to the normal area. For convenience of explanation, the center indicated by the cross-shaped mouse cursor E will be displayed at the center of the comparison area F. FIG.

11 and 12, when the comparison area F moves from the <P1> point to the <P2> point, the mouse cursor E of the comparison area F captured at the <P2> point is moved. A front region R2 having a color or saturation different from the comparison region F captured at the point <P1> is generated in a partial region on the moving direction side. Here, the region where there is no change in hue or saturation becomes the rear region R1.

Subsequently, when the comparison area F moves from the <P2> point to the <P3> point, the center of the mouse cursor E enters the menu area (between L1 and L2) from the general area, and at the <P3> point. If the front area R2 of the captured comparison area F on the moving direction side of the mouse cursor E is compared with the front area R2 of the comparison area F captured in <P2>, the hue or saturation is changed. Vibration effect occurs in the vibrating mouse 1050.

Subsequently, when the comparison area F moves from the <P3> point to the <P4> point, the front area R2 on the side of the moving direction of the mouse cursor E among the comparison areas F captured at the <P4> point is < The hue or saturation is changed in comparison with the front region R2 of the comparison region F captured at P3>.

Subsequently, when the comparison area F moves from the <P4> point to the <P5> point, the center of the mouse cursor E enters the general area from the menu area (between L1 and L2), and at the <P5> point. In the captured comparison area F, the front area R2 on the side of the mouse cursor E moving direction is compared with the front area R2 of the comparison area F captured in <P4>, whereby a change in color or saturation is achieved. Since the vibration does not occur, the vibration effect does not occur in the vibration mouse 1050.

When the comparison area F moves from the <P5> point to the <P6> point, the center of the mouse cursor E completely enters the general area with no change in color or saturation, thereby causing a vibration effect in the vibrating mouse 1050. Keep it off.

Referring to FIG. 13, a mouse cursor image region F ′ that defines a rectangular region around the mouse cursor E ′ is defined as illustrated in region D ′ of FIG. 13. Here, in another embodiment of the present invention, for convenience of description, it will be assumed that the mouse cursor E 'moves to an object to which a link is set in an area without a link.

While the mouse cursor E 'moves from the unlinked area to the linked object, it periodically captures the mouse cursor image area F' containing the mouse cursor image, and directly with the most recently captured mouse cursor image. A vibrating effect occurs on the vibrating mouse 1050 when the most recently captured mouse cursor image changes by comparing previously captured mouse cursor images.

14 is a flowchart illustrating a process of driving a vibrating mouse according to another embodiment of the present invention. Here, in another embodiment of the present invention, for convenience of description, it is assumed that the mouse cursor moves from the general area to the menu area so that a vibration effect is generated in the vibration mouse.

First, the control module 1033e detects the movement of the mouse cursor through the mouse cursor movement detection module 1033a (S1410), and the mouse cursor at a predetermined period according to the movement of the mouse cursor through the comparison area capture module 1033c. A comparison region of the is captured (S1420).

Subsequently, the control module 1033e compares the latest comparison area image with the previous comparison area image through the comparison area capture module 1033c to check whether there is a change (S1430), and the front area of the latest comparison area image is changed to the previous comparison area image. It is determined whether there is a change in color or saturation of the front area of the latest comparison area image by comparing with the front area (S1440).

If it is determined in step S1440 that there is a change in color or saturation of the front area of the latest comparison area image, the control module 1033e generates vibration drive data including a preset vibration pattern (S1450). At this time, the control module 1033e transmits the vibration drive data to the vibration drive controller 1051 of the vibration mouse 1050.

Subsequently, the vibration drive control unit 1051 analyzes the vibration drive data received from the control module 1033e and generates a vibration control signal according to the vibration pattern included in the vibration drive data (S1460). At this time, the vibration driving controller 1051 transmits the generated vibration control signal to the motor driving unit 1053.

Subsequently, the motor driver 1055 drives the vibration motor 1055 by adjusting the voltage and the current according to the received vibration control signal to generate a vibration effect according to the vibration pattern in the vibration mouse 1050 (S1460).

Although the present invention has been described in more detail with reference to the examples, the present invention is not necessarily limited to these embodiments, and various modifications can be made without departing from the spirit of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

Claims

In a system for driving a vibrating mouse,

An audio signal extraction function for extracting an audio signal generated when an application program is executed in a central processing unit, an audio signal processing function for filtering based on a predetermined band of signals from the extracted audio signal, and the filtered audio signal A recording medium including a vibration drive data generation function for generating vibration drive data including vibration pattern information corresponding to the vibration drive data; And

A vibration mouse including a vibration drive controller for generating a vibration control signal corresponding to the vibration pattern information included in the vibration drive data received from the recording medium, and a vibration motor vibrating according to the vibration control signal;

Vibration mouse drive system comprising a.
The method according to claim 1,

The recording medium,

Further comprising a vibration pattern information storage function for storing the vibration pattern information matched to each audio signal,

The vibration drive data generation function,

Vibration mouse drive, characterized in that for retrieving the vibration pattern information corresponding to the filtered audio signal received from the audio signal processing function in the vibration pattern information storage function, and generates vibration drive data including the retrieved vibration pattern information system.
The method according to claim 1 or 2,

The audio signal extraction function,

And an audio signal generated while driving the application program in the central processing unit according to a user's input command.
The method according to claim 3,

The audio signal extraction function,

And a pulse code modulation (PCM) type audio signal processed by the CPU.
The method according to claim 4,

The application program,

Vibration mouse drive system, characterized in that the game application program that generates a sound effect according to the user's command input.
The method according to claim 5,

The vibration motor,

Vibration mouse drive system, characterized in that the motor of the linear resonant actuator (LRA).
In the method of driving a vibrating mouse,

(a) extracting an audio signal generated when the application program is executed in the central processing unit;

(b) filtering the extracted audio signal based on a predetermined signal band;

(c) generating vibration driving data including vibration pattern information corresponding to the filtered audio signal; And

(d) driving the vibration motor provided in the mouse according to the vibration pattern information included in the vibration drive data;

Vibration mouse driving method comprising a.
The method according to claim 7,

Step (d) is,

(d-1) generating a vibration control signal according to a vibration pattern included in the vibration driving data;

(d-2) driving the vibration motor by controlling electricity and current according to the vibration control signal;

Vibration mouse driving method characterized in that it further comprises.
The method according to claim 8,

Step (a) is,

And extracting an audio signal generated while driving the application program in the CPU according to a user's input command.
The method according to claim 9,

Step (a) is,

And extracting an audio signal of a pulse code modulation (PCM) format processed by the CPU.
The method according to claim 10,

The application program,

Vibration mouse driving method characterized in that the game application program that generates a sound effect according to the user's command input.
In a system for driving a vibrating mouse,

A mouse cursor movement detection function for detecting whether the mouse cursor is moved and a direction of movement, and a comparison area, which is a region of a preset size including a point indicated by the mouse cursor, is captured at a predetermined period when the mouse cursor is moved. A comparison area capture function, a comparison area comparison function for comparing the most recently updated latest comparison area image captured by the comparison area capture function with a previous comparison area image generated just before, and the comparison area comparison function. A recording medium including a control function for comparing the latest comparison area image with the previous comparison area image to generate vibration driving data including a vibration pattern and to transmit the vibration driving data to the vibration mouse when there is a change in color or saturation; And

A vibration including a vibration drive control unit generating a vibration control signal corresponding to the vibration pattern included in the vibration drive data received from the recording medium, and a vibration motor vibrating according to the vibration control signal generated by the vibration drive control unit. mouse;

Vibration mouse drive system comprising a.
The method according to claim 12,

The vibration mouse driving device,

The apparatus may further include a vibration pattern storing function that compares the latest comparison area image with the previous comparison area image and stores various preset vibration patterns for each event of a change in color or saturation or an event in which the mouse cursor image changes. Vibrating mouse drive system.
The method according to claim 13,

The control function,

When there is a change in the image by comparing the most recently captured mouse cursor image with the comparison area comparison function, the vibration pattern storage function loads the vibration pattern and vibrates with the vibration pattern. Vibration mouse drive system, characterized in that for generating drive data to transmit to the vibrating mouse.
The method according to claim 12 or 14,

The control function,

The comparison area comparison function allows a specific area located on the moving direction side of the mouse cursor in the recent comparison area image to be changed in color or saturation compared to a predetermined area located on the moving direction side of the mouse cursor in the previous comparison area image. And if it is determined that the vibration drive data is generated.
The method according to claim 15,

The comparison area capture function,

Vibrating mouse driving system for capturing the comparison area or the mouse cursor image every 0.1 seconds.
The method according to claim 16,

The comparison area capture function,

Vibrating mouse drive system, characterized in that for capturing by setting the comparison area to 20 X 20 pixels.
In the method of driving a vibrating mouse,

Capturing a comparison area, which is an area of a preset size including a point indicated by a mouse cursor according to the movement of the vibrating mouse, at a predetermined period when the mouse cursor is moved;

Comparing the latest comparison area image most recently captured in the capturing step with a previous comparison area image captured immediately before; And

Driving the vibrating motor of the vibrating mouse when it is determined that the latest comparison region image has a change in color or saturation in comparison with the previous comparison region image;

Vibration mouse driving method comprising a.
The method according to claim 18,

The driving step,

Generating vibration driving data including a preset vibration pattern when it is determined that the latest comparison area image has a change in color or saturation in comparison with the previous comparison area image;

Generating a vibration control signal according to a vibration pattern included in the vibration drive data;

Driving the vibration motor according to the vibration control signal;

Vibration mouse driving method characterized in that it further comprises.
In the method of driving a vibrating mouse,

Capturing a mouse cursor image region, which is a region having a preset size, including a mouse cursor image according to the movement of the vibrating mouse at predetermined intervals;

Comparing the most recently captured latest mouse cursor image with the previously captured previous mouse cursor image in the capturing step; And

Driving the vibrating motor of the vibrating mouse when it is determined that there is a change in the latest mouse cursor image in comparison with the previous mouse cursor image;

Vibration mouse driving method comprising a.
The method of claim 20,

The driving step,

Generating vibration driving data including a preset vibration pattern when it is determined that there is a change in the mouse cursor image compared to the previous mouse cursor image in the comparing step;

Generating a vibration control signal according to a vibration pattern included in the vibration drive data;

Driving the vibration motor according to the vibration control signal;

Vibration mouse driving method characterized in that it further comprises.