KR20170071167A - Presentation image controlling apparatus using sensor and presentation image controlling method using the same - Google Patents
Presentation image controlling apparatus using sensor and presentation image controlling method using the same Download PDFInfo
- Publication number
- KR20170071167A KR20170071167A KR1020150179169A KR20150179169A KR20170071167A KR 20170071167 A KR20170071167 A KR 20170071167A KR 1020150179169 A KR1020150179169 A KR 1020150179169A KR 20150179169 A KR20150179169 A KR 20150179169A KR 20170071167 A KR20170071167 A KR 20170071167A
- Authority
- KR
- South Korea
- Prior art keywords
- signal
- presentation image
- mode
- threshold value
- value
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Dermatology (AREA)
- General Health & Medical Sciences (AREA)
- Neurology (AREA)
- Neurosurgery (AREA)
- Position Input By Displaying (AREA)
Abstract
The present invention relates to a presentation image control apparatus using a sensor and a presentation image control method using the same.
According to the present invention, there is provided a method of controlling a presentation image using a presentation image control device, the method comprising: receiving a measured gyro signal, an acceleration signal, and an EMG signal using a sensor attached to a body part of a user; Calculating at least one of power and entropy values of the electromyogram signal, changing a current control mode using at least one of power and entropy values of the calculated electromyogram signal, and outputting the gyro signal, , And controlling the presentation image according to the changed control mode using at least one of power and entropy values of the calculated electromyogram signal
As described above, according to the present invention, not only the presentation image can be controlled by the intuitive movement of the user, but also the mouse mode and the slide mode can be used as a single device. In addition, there is an advantage that a higher control accuracy can be realized than in the conventional technology.
Description
The present invention relates to a presentation image control apparatus using a sensor and a presentation image control method using the same, and more particularly, to a presentation image control apparatus that controls a presentation image using a signal including human operation information and a presentation image And a control method.
Recently, research on interaction between human and computer has progressed actively according to the development of engineering technology. In this research, a research for replacing the interface of the computer used by the user, for example, Research is under way to control the process of controlling a computer program by recognizing a person's chess piece.
One of the researches for replacing the PC interface is to research the control interface of the presentation image by recognizing the gesture of the person, and it is being actually commercialized and sold.
However, the control methods of presentation images using conventional human gestures are designed to control recognition through a camera or voice recognition, thereby reducing the recognition rate or controlling only a specific function of the interface, resulting in inconvenience in use .
The technology of the background of the present invention is disclosed in Korean Patent Laid-Open No. 10-2013-0003484 (published on Mar. 01, 2013).
According to an aspect of the present invention, there is provided a presentation image control apparatus for controlling a presentation image using a signal including motion information of a person and a presentation image control method using the same.
According to an aspect of the present invention, there is provided a method of controlling a presentation image using a presentation image control device, the method comprising: sensing a gyro signal, acceleration Receiving at least one of a power and an entropy value of the electromyogram signal and a power and an entropy value of the electromyogram signal to change the current control mode And controlling the presentation image according to the modified control mode using at least one of the gyro signal, the acceleration signal, the calculated power of the EMG signal, and the entropy value.
Wherein the step of changing the control mode comprises the steps of: comparing the calculated power of the electromyogram signal with a first threshold value; if the calculated power of the electromyogram signal is greater than the first threshold value, Calculating a likelihood with the probability density models and changing the current control mode if the likelihood with the probability density model corresponding to the operation result mode change is greatest. have.
The control mode may include a slide mode for controlling the presentation image to be moved to the previous slide screen or the next slide screen on the current slide screen, and a mouse mode for controlling the operation of the cursor displayed on the presentation image.
The step of controlling the presentation image may include calculating a first angle value using the gyro signal when the changed control mode is the slide mode, Comparing the first angle value with a second threshold value, and comparing the first angle value with a third threshold value, and when the first angle value is greater than a second threshold value, And controlling the current slide screen to move to the previous slide screen if the current slide screen is smaller than the predetermined value.
Wherein the step of controlling the presentation image comprises the steps of: comparing the calculated power of the electromyogram signal with a first threshold value when the changed control mode is the mouse mode; comparing the power of the electromyogram signal with a first threshold value Calculating a second angular value using at least one of the acceleration signal and the angular velocity signal and controlling the movement of the cursor according to the second angular value when the power of the electromyogram signal is lower than a first threshold value Calculating a likelihood between the entropy and the pre-stored probability density models, and if the likelihood with the probability density model corresponding to the click of the cursor is greatest, So that it can be controlled.
The step of controlling the movement of the cursor may calculate the second angle value by inputting the angle value acquired from the gyro signal and the acceleration signal to the complementary filter.
According to another aspect of the present invention, there is provided a presentation image control apparatus including an input unit for receiving a gyro signal, an acceleration signal, and an EMG signal measured using a sensor attached to a part of a user's body, at least one of power and entropy values of the EMG signal A change unit for changing a current control mode using at least one of a power and an entropy value of the calculated EMG signal, and a controller for changing the gyro signal, the acceleration signal, the power of the calculated EMG signal and the entropy value And a control unit controlling the presentation image according to the changed control mode using at least one of the control modes.
As described above, according to the present invention, not only the presentation image can be controlled by the intuitive movement of the user, but also the mouse mode and the slide mode can be used as a single device. In addition, there is an advantage that a higher control accuracy can be realized than in the conventional technology.
1 is a view for explaining a presentation image control apparatus according to an embodiment of the present invention.
2 is a flowchart of a method of controlling a presentation image according to an embodiment of the present invention.
3 is a diagram for explaining an EMG signal according to an embodiment of the present invention.
4 is a diagram illustrating a histogram for modeling a probability density model according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating a continuous probability density function for each operation according to an embodiment of the present invention.
6 is a flowchart illustrating a method of controlling a presentation image in a slide mode according to an embodiment of the present invention.
7 is a flowchart illustrating a method of controlling a presentation image in a mouse mode according to an embodiment of the present invention.
8 is a graph showing the angular value output of the gyro signal and the acceleration signal.
9 is a graph showing an output of an angle value when a complementary filter is used.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.
Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.
First, a configuration of a presentation image control apparatus 100 using a
As shown in FIG. 1, a presentation image control system using a presentation image control apparatus 100 includes a presentation image control apparatus 100 and a
First, the
According to an embodiment of the present invention, the
The presentation image control apparatus 100 receives a measurement signal from the
First, the input unit 110 receives an acceleration signal, a gyro signal, and an EMG signal from the
The number of signals can be determined according to the number of channels of the EMG signal. For example, when the electromyogram measuring sensor is composed of four channels, an electromyogram signal composed of four signals can be inputted.
Then, the operation unit 120 calculates at least one of the power and the entropy value of the EMG signal by using the EMG signal. The power of the EMG signal may mean the magnitude of the EMG signal, and the entropy means the information entropy of the EMG signal.
Next, the changing unit 130 changes the current control mode using at least one of the calculated power and the entropy value of the EMG signal. At this time, the control mode includes a slide mode and a mouse mode. For example, the changing unit 130 can change the mode to the mouse mode when the current control mode is the slide mode, and to the slide mode when the current control mode is the mouse mode.
On the other hand, the control mode is not limited to the mouse mode and the slide mode, and a mode having a different function can be additionally designed by an ordinary technician.
Specifically, the changing unit 130 compares the calculated power of the electromyogram signal with the first threshold value. As a result of the comparison, when the calculated power of the EMG signal is greater than the first threshold value, the changing unit 130 calculates a likelihood between the entropy and the stored probability density models. When the likelihood with the probability density model corresponding to the mode change is greatest among the computed likelihoods, the changing unit 130 changes the current control mode.
If the power of the electromyogram signal is less than or equal to the first threshold value or the model with the greatest likelihood is not the probability density model corresponding to the mode change, the changing unit 130 does not change the current control mode, The image control device 100 controls the presentation image according to the current control mode using the input signal.
Next, the control unit 140 controls the presentation image according to the changed control mode using at least one of the gyro signal, the acceleration signal, the calculated power of the EMG signal, and the entropy value.
In this case, the control mode includes a slide mode for controlling the presentation image to be moved to the previous slide screen or the next slide screen on the current slide screen, and a mouse mode for controlling the operation of the cursor displayed on the presentation image.
When the changed control mode is the slide mode, the controller 140 calculates the first angle value using the gyro signal, and compares the calculated first angle value with the previously stored second threshold value and the third threshold value.
If the first angle value is greater than the second threshold value, the controller 140 controls to move from the current slide screen to the next slide screen. On the other hand, if the first angle value is smaller than the third threshold value, the controller 140 controls the current slide screen to move to the previous slide screen.
On the other hand, when the changed control mode is the mouse mode, the controller 140 compares the calculated power of the EMG signal with the first threshold value.
If the power of the electromyogram signal is less than or equal to the first threshold value, the controller 140 calculates the second angle value using at least one of the acceleration signal and the angular velocity signal. The controller 140 controls the movement of the cursor on the screen according to the second angle value.
At this time, the controller 140 may calculate the second angle value by inputting the angle value acquired from the gyro signal and the acceleration signal to the complementary filter.
On the other hand, when the power of the electromyogram signal is greater than the first threshold value, the controller 140 calculates a likelihood between entropy and pre-stored probability density models. If the likelihood with the probability density model corresponding to the click of the cursor is greatest, the control unit 140 controls the cursor to be clicked.
Next, a method of controlling a presentation image using the presentation image control apparatus 100 according to an embodiment of the present invention will be described with reference to FIG. 2 through FIG. 2 is a flowchart of a method of controlling a presentation image according to an embodiment of the present invention.
First, the presentation image control apparatus 100 receives a gyro signal, an acceleration signal, and an EMG signal from the sensor 200 (S210). At this time, the gyro signal, the acceleration signal, and the EMG signal include information on the movement of the user measured through the
Then, the presentation image control device 100 calculates the power and entropy value of the EMG signal using the received EMG signal (S220).
First, the presentation image control device 100 calculates the power value of the electromyogram signal, that is, the magnitude of the signal. Here, the power value of the electromyogram signal may be an average value of magnitudes of the electromyogram signal during a period in which the user has performed the operation.
FIG. 3 is a view for explaining an EMG signal according to an embodiment of the present invention, and is an example of an EMG signal acquired when a user takes a fist-gripping operation and a bending operation. The EMG signal may appear as a signal having a different form depending on the user's operation.
For example, as shown in FIG. 3, when the user performs a fist-grabbing operation or a bending operation of the index finger in a period from 0.3 seconds to 0.5 seconds, the EMG signal is greatly changed. 100) can calculate the average magnitude value of the EMG signal in the interval between 0.3 seconds and 0.5 seconds.
In addition, the presentation image control apparatus 100 may calculate the maximum magnitude or the maximum amplitude of the EMG signal as a power value of the EMG signal in a user's operation section. When the EMG signal is input through a plurality of channels, The average of the signals input from the channel may be used or any one of the signals may be used.
In addition, the presentation image control device 100 calculates the entropy value of the EMG signal. Here, entropy means information entropy, which is an average of the self-information value of a random variable in an event, which is an estimate of the uncertainty of the event. That is, the present invention refers to an average of information values of a random variable with respect to an EMG signal generated after a user takes an action.
A probability value for an EMG signal generated after a specific hand operation is performed to calculate an entropy of the EMG signal (
Here, I m denotes a set of EMG signals belonging to the m-th section of each section obtained by dividing the maximum value and the minimum value of the EMG signal magnitude that the
Then, the presentation image control apparatus 100 can calculate the entropy of the EMG signal through the following equation (2).
Here, k denotes the index number of the operation taken by the user, c denotes the index number of the channel,
In step S220, the power of the EMG signal and entropy are calculated. Then, the presentation image control apparatus 100 compares the calculated power value of the EMG signal with the first threshold value in step S230.
As a result of comparison, if the power of the EMG signal is less than or equal to the first threshold value, the presentation image control device 100 analyzes the input measurement signal while controlling the current control mode to control the presentation image. At this time, the first threshold value can be changed by an ordinary technician.
On the other hand, if the power of the EMG signal is greater than the first threshold value, the presentation image control apparatus 100 calculates a likelihood between the entropy of the EMG signal and the previously stored probability density models (S240).
Here, the probability density models can be modeled using the EMG signals measured according to the hand movements of the subject. Hereinafter, the modeling process of the probability density model will be described with reference to FIGS. 4 and 5. FIG.
First, modeling of the probability density model may be performed by using a terminal including an operation processing device or the like, and the presentation image control device 100 may be used. For convenience of description, it is assumed that probability density models are modeled using a terminal.
In order to model the probability density models, the terminal receives the measured EMG signals by repeatedly performing a specific operation by the user. At this time, the measured person may be plural, and the specific operation includes the operation of the user corresponding to the mode change or the click of the cursor, and the specific operations for each control can be changed by the ordinary technician.
According to the embodiment of the present invention, the operation of gripping the fist may be set to an operation corresponding to the mode change, and the operation of bending the index may be set to an operation corresponding to the click of the cursor.
Then, the terminal computes the entropy of the input EMG signal, and generates a histogram of the computed entropy.
FIG. 4 is a histogram for modeling a probability density model according to an embodiment of the present invention. As shown in FIG. 4, the terminal can display the calculated entropy as a histogram for each operation and each channel.
In the case of FIG. 4, the entropy of the measured four-channel electromyogram signals is shown by a histogram, in which the subject performs two specific operations (an operation of bending the fist and a bending of the detection) 30 times.
Next, the terminal models the probability density models with the continuous probability density function that follows the Gaussian characteristic using the information of the generated histogram, which can be expressed by Equation (3).
here,
The probability density models modeled through Equation (3) can be represented as a continuous probability density function as shown in FIG. FIG. 5 is a diagram illustrating a continuous probability density function for each operation according to an embodiment of the present invention. The continuous probability density functions of each channel show a distinct probability distribution characteristic for each operation.
The presentation image control apparatus 100 may use Bayes Theorem to calculate the likelihood. In case of an electromyogram signal composed of four channels, the likelihood (L (k)) may be calculated by Equation (4) Can be calculated.
Here, k denotes a user operation, and c denotes a channel index.
If the likelihood with the probability density model corresponding to the mode change of the calculation result mode of S240 is greatest, the presentation image control device 100 changes the current control mode (S250). On the other hand, if the likelihood with the probability density model corresponding to the mode change is not the largest, the current control mode is maintained.
Specifically, in step S250, it is possible to determine whether the likelihood with the probability density model corresponding to the mode change becomes maximum by using the maximum likelihood estimation method. Maximum Likelihood Estimation is a method for estimating the event that has the greatest likelihood of occurrence by determining the parameter that maximizes the likelihood.
In step S250, the presentation image control apparatus 100 may use Equation (5) to determine whether the likelihood with the probability density model corresponding to the mode change is greatest.
here,
In other words,
If the current control mode is changed in step S250, the presentation image control device 100 controls the presentation image according to the changed control mode (S260).
The process of controlling the presentation image in each control mode (slide mode and mouse mode) will be described in detail with reference to FIGS. 6 to 9. FIG.
First, a process of controlling a presentation image in a slide mode will be described with reference to FIG. 6 is a flowchart illustrating a method of controlling a presentation image in a slide mode according to an embodiment of the present invention.
First, in the case of the slide mode, the presentation image control device 100 calculates the first angle value using the gyro signal (S261). For example, when the
On the other hand, in the case of the slide mode, since the control can be performed by only one-dimensional operation, the first angle value can be calculated using only the Y-axis gyro signal among the gyro signals. According to the embodiment of the present invention, when the user moves his or her hand to the left, it moves to the next slide screen, and when the user moves to the right, it moves to the previous slide screen.
Then, the presentation image control device 100 compares the first angle value and the second threshold value (S262). At this time, the second threshold value can be changed by an ordinary technician.
If the first angle value is greater than the second threshold value in step S262, the presentation image control apparatus 100 controls the presentation image to move to the next slide screen on the current slide screen (S263).
On the other hand, if the first angle value is less than or equal to the second threshold value in step S262, the first angle value calculated in step S261 is compared with the third threshold value in step S264. At this time, the third angle value can be changed by an ordinary technician.
If it is determined in step S264 that the first angle value is larger than the third threshold value, the presentation image control apparatus 100 controls the presentation image to be moved to the previous slide screen on the current slide screen (S265).
In FIG. 6, the first angle value is compared with the second threshold value and then compared with the third threshold value. However, steps S262 to S263 and steps S264 to S265 may be changed. That is, after comparing the first angle value and the third threshold value, when the first angle value is less than or equal to the third threshold value, the first angle value and the third threshold value may be compared. In addition, the first angle value and the third threshold value may be simultaneously compared to control the movement of the presentation image.
Next, a process of controlling the presentation image in the mouse mode will be described with reference to FIG. 7 is a flowchart illustrating a method of controlling a presentation image in a mouse mode according to an embodiment of the present invention.
First, the presentation image control device 100 compares the power value of the EMG signal with the first threshold value (S266). At this time, the first threshold value can be changed by an ordinary technician.
If it is determined in step S266 that the power value is greater than the first threshold value, the presentation image control apparatus 100 calculates a likelihood between the entropy and the stored probability density models (S267). Here, the calculation of likelihood is the same as that in step S240, and a detailed description thereof will be omitted.
If the likelihood between the probability density model corresponding to the click of the cursor and the entropy is greatest, the presentation image control apparatus 100 controls the presentation image so that the cursor of the screen is clicked (S268). Here, the method of determining whether the likelihood between the probability density model corresponding to the click of the cursor and the entropy is the largest and clicking the cursor on the screen is the same as in step S250, and a detailed description will be omitted.
On the other hand, if it is determined in step S266 that the power value is less than or equal to the first threshold value, the presentation image control apparatus 100 calculates the second angle value using at least one of the input acceleration signal and the gyro signal (S269).
At this time, since the movement of the cursor on the screen is a movement on the two-dimensional plane, the presentation image control apparatus 100 can calculate the second angular values of the X and Y axes using the gyro signals of the vertical axis X axis and the horizontal axis Y axis .
When the second angle value is calculated using the acceleration signal, the presentation image control device 100 calculates the second angle value of the X-axis using the Y-axis and Z-axis acceleration signals, and the X- Axis can be used to calculate the second angular value of the Y-axis.
On the other hand, the presentation image control apparatus 100 may calculate the second angle value by inputting the angle value acquired from the gyro signal and the acceleration signal to the complementary filter.
Specifically, the presentation image control apparatus 100 passes the angle obtained using the acceleration signal to the low-pass filter, passes the angle obtained using the gyro signal to the high-pass filter, and adds the angle to calculate the second angle value can do.
More specifically, when calculating the second angle value using the complementary filter, it is possible to calculate an accurate angle value more than using only the gyro signal or the acceleration signal. This is due to the characteristics of the gyro signal with good output in the stop section and good characteristics in the motion section.
FIG. 8 is a graph showing the angular value output of the gyro signal and the acceleration signal, showing the advantages and disadvantages of the gyro signal and the acceleration signal described above. As shown in FIG. 8, while the acceleration signal maintains a constant angular value in the stop section, the gyro signal exhibits a good output characteristic in the motion section while the angle value falls in the stop section, have.
Therefore, when the advantages of the two signals are combined using the complementary filter, stable and accurate angular values can be output in the motion section and the stop section as shown in FIG. 9 is a graph showing an output of an angle value when a complementary filter is used.
Then, the presentation image control device 100 controls the presentation image so that the cursor of the screen moves according to the second angle value (S270). That is, the movement of the cursor displayed on the screen is controlled corresponding to the second angle value.
Hereinafter, results of control accuracy of a presentation image control method according to an embodiment of the present invention will be described.
Table 1 shows the control accuracy of the slide mode. It shows the accuracy of recognition after 10 repetitions of the control movements to the previous slide and the next slide respectively.
Actual operation
As shown in Table 1, the control operation from the slide mode to the previous slide screen and the next slide screen shows a recognition accuracy of 100%.
Table 2 shows the movement trajectory of the cursor in the mouse mode, and it can be confirmed that the cursor moves in the same direction as the actual operation.
Table 3 shows the recognition accuracy of the control mode change and left click operation using the entropy of the EMG signal.
Actual operation
As shown in Table 3, the recognition accuracy of the mode switching and the left click operation is 96.72% and 99.81%, respectively, and it is confirmed that the accuracy is high.
According to the embodiment of the present invention, not only the presentation image can be controlled by the intuitive movement of the user, but also the mouse mode and the slide mode can be used as one device, which is convenient. In addition, there is an advantage that a higher control accuracy can be realized than in the conventional technology.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.
100: Presentation image control device 110: Input unit
120: Operation unit 130:
140: controller 200: sensor
Claims (12)
Receiving a measured gyro signal, an acceleration signal, and an EMG signal using a sensor attached to a part of a user's body,
Calculating at least one of power and entropy of the EMG signal,
Changing the current control mode using at least one of the calculated power and entropy value of the electromyogram signal, and
And controlling the presentation image according to the changed control mode using at least one of the gyro signal, the acceleration signal, the calculated power of the EMG signal, and the entropy value.
Wherein the step of changing the control mode comprises:
Comparing the calculated power of the electromyogram signal with a first threshold value,
Calculating a likelihood between the entropy and pre-stored probability density models when the calculated power of the electromyogram signal is greater than the first threshold value; and
And changing the current control mode when a likelihood with a probability density model corresponding to a mode change result is greatest.
Wherein the control mode comprises:
A slide mode in which the presentation image is moved to a previous slide screen or a next slide screen in a current slide screen, and a mouse mode in which an operation of a cursor displayed on the presentation image is controlled.
Wherein the step of controlling the presentation image comprises:
When the changed control mode is the slide mode,
Calculating a first angle value using the gyro signal,
Comparing the calculated first angle value with a previously stored second threshold value and a third threshold value, and
The control unit controls to move from the current slide screen to the next slide screen when the first angle value is larger than the second threshold value, And controlling the moving to the previous slide screen.
Wherein the step of controlling the presentation image comprises:
When the changed control mode is the mouse mode,
Comparing the calculated power of the electromyogram signal with a first threshold value,
Calculating a second angular value using at least one of the acceleration signal and the angular velocity signal when the power of the electromyogram signal is less than or equal to the first threshold value and controlling the movement of the cursor according to the second angular value, ,
Calculating a likelihood between the entropy and pre-stored probability density models when the power of the EMG signal is greater than a first threshold value, and
And controlling the cursor to be clicked when a likelihood with a probability density model corresponding to a click of the cursor is greatest.
Wherein controlling the movement of the cursor comprises:
And inputting the angle value acquired from the gyro signal and the acceleration signal to a complementary filter to calculate the second angle value.
A computing unit for computing at least one of power and entropy of the EMG signal,
A changing unit for changing a current control mode by using at least one of power and entropy values of the calculated EMG signal, and
And a control unit for controlling the presentation image according to the changed control mode using at least one of the gyro signal, the acceleration signal, the calculated power of the EMG signal, and the entropy value.
The changing unit may change,
Comparing the calculated power of the electromyogram signal with a first threshold value and comparing the entropy with a previously stored probability density model if the calculated power of the electromyogram signal is greater than the first threshold value; And changes the current control mode when the likelihood with the probability density model corresponding to the mode change of the calculation result is greatest.
Wherein the control mode comprises:
A slide mode in which the presentation image is moved to a previous slide screen or a next slide screen in a current slide screen, and a mouse mode in which an operation of a cursor displayed on the presentation image is controlled.
Wherein,
The first angle value is calculated using the gyro signal when the changed control mode is the slide mode, the first angle value is compared with the second threshold value and the third threshold value, If the first angle value is greater than a second threshold value, control to move from the current slide screen to the next slide screen, and if the first angle value is smaller than a third threshold value, To the screen.
Wherein,
When the changed control mode is the mouse mode, compares the calculated power of the electromyogram signal with the first threshold value, and when the power of the electromyogram signal is less than or equal to the first threshold value, And controlling the movement of the cursor in accordance with the second angle value. When the power of the EMG signal is greater than the first threshold value, the entropy and the pre-stored probability density Calculates a likelihood with the models and controls the cursor to be clicked when a likelihood with a probability density model corresponding to a click of the cursor is greatest.
Wherein,
Wherein the angle value obtained from the gyro signal and the acceleration signal is input to a complementary filter to calculate the second angle value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020150179169A KR20170071167A (en) | 2015-12-15 | 2015-12-15 | Presentation image controlling apparatus using sensor and presentation image controlling method using the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020150179169A KR20170071167A (en) | 2015-12-15 | 2015-12-15 | Presentation image controlling apparatus using sensor and presentation image controlling method using the same |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR20170071167A true KR20170071167A (en) | 2017-06-23 |
Family
ID=59283780
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020150179169A KR20170071167A (en) | 2015-12-15 | 2015-12-15 | Presentation image controlling apparatus using sensor and presentation image controlling method using the same |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR20170071167A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20180005644A (en) * | 2017-12-27 | 2018-01-16 | 주식회사 인투씨앤씨 | Control of the electronic blackboard program of desktop PC using smart phone with gyro sensor and acceleration sensor |
-
2015
- 2015-12-15 KR KR1020150179169A patent/KR20170071167A/en active Search and Examination
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20180005644A (en) * | 2017-12-27 | 2018-01-16 | 주식회사 인투씨앤씨 | Control of the electronic blackboard program of desktop PC using smart phone with gyro sensor and acceleration sensor |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109891491B (en) | Method and apparatus for controlling interactive display | |
| US20190126484A1 (en) | Dynamic Multi-Sensor and Multi-Robot Interface System | |
| CN103970264B (en) | Gesture recognition and control method and device | |
| US10368784B2 (en) | Sensor data damping | |
| CN106484098B (en) | The real time interactive operation system and method for user interface | |
| CN105589553A (en) | Gesture control method and system for intelligent equipment | |
| KR20120045667A (en) | Apparatus and method for generating screen for transmitting call using collage | |
| TWI567592B (en) | Gesture recognition method and wearable apparatus | |
| CN110045829B (en) | Apparatus and method for event using user interface | |
| CN110928432A (en) | Ring mouse, mouse control device and mouse control system | |
| CN111160088A (en) | VR (virtual reality) somatosensory data detection method and device, computer equipment and storage medium | |
| TW201415376A (en) | Gesture identification with natural images | |
| KR101654311B1 (en) | User motion perception method and apparatus | |
| US8749488B2 (en) | Apparatus and method for providing contactless graphic user interface | |
| Prasad et al. | A wireless dynamic gesture user interface for HCI using hand data glove | |
| KR20170071167A (en) | Presentation image controlling apparatus using sensor and presentation image controlling method using the same | |
| KR102227494B1 (en) | Apparatus and method for processing an user input using movement of an object | |
| Siam et al. | Human computer interaction using marker based hand gesture recognition | |
| KR101909326B1 (en) | User interface control method and system using triangular mesh model according to the change in facial motion | |
| CN107256089B (en) | Gesture recognition method by natural image | |
| CN113918013A (en) | Gesture directional interaction system and method based on AR glasses | |
| CN113160295A (en) | Method and device for correcting joint point position | |
| KR102107182B1 (en) | Hand Gesture Recognition System and Method | |
| KR101993257B1 (en) | Apparatus of correcting touch input based on compensation hand vibration | |
| KR101370830B1 (en) | System and Method for Implementing User Interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| E902 | Notification of reason for refusal | ||
| AMND | Amendment | ||
| AMND | Amendment |