KR20170089685A - Finger language recognition system and method - Google Patents

Finger language recognition system and method Download PDF

Info

Publication number
KR20170089685A
KR20170089685A KR1020160010230A KR20160010230A KR20170089685A KR 20170089685 A KR20170089685 A KR 20170089685A KR 1020160010230 A KR1020160010230 A KR 1020160010230A KR 20160010230 A KR20160010230 A KR 20160010230A KR 20170089685 A KR20170089685 A KR 20170089685A
Authority
KR
South Korea
Prior art keywords
unit
signal
user
electrode
electrode channels
Prior art date
Application number
KR1020160010230A
Other languages
Korean (ko)
Inventor
김영호
김성중
이한수
안순재
김종만
조민
최은경
Original Assignee
연세대학교 원주산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 연세대학교 원주산학협력단 filed Critical 연세대학교 원주산학협력단
Priority to KR1020160010230A priority Critical patent/KR20170089685A/en
Priority to US16/073,441 priority patent/US10685219B2/en
Priority to PCT/KR2016/011650 priority patent/WO2017131318A1/en
Publication of KR20170089685A publication Critical patent/KR20170089685A/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/009—Teaching or communicating with deaf persons
    • A61B5/04012—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G06K9/00355—
    • G06K9/00885—

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Neurosurgery (AREA)
  • Neurology (AREA)
  • Dermatology (AREA)
  • Biomedical Technology (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

The present invention relates to a finger language recognition system which can rapidly and precisely transfer ideas through finger language gestures. The finger language recognition system comprises: an obtaining unit obtaining an electromyogram signal from a sensor measuring device worn on upper arms of a user; an extracting unit extracting a muscle active section from the electromyogram signal; a calculating unit calculating property vector of a finger language gesture of the user by performing signal processing in the muscle active section; a searching unit searching a signal corresponding to the property vector in database; and an output unit outputting a text corresponding to the searched signal.

Description

FIELD RECOGNITION SYSTEM AND METHOD FIELD OF THE INVENTION [0001]

The present invention relates to a geotechnical recognition system and method.

Sign language or finger language is a method of communication in which the hearing impaired and the speech impaired are represented by gestures or hand gestures on behalf of speech, Communication is performed through facial expressions or lip movements.

The conventional sign recognition system or the land recognition system has a problem that it takes a lot of time and is inconvenient to carry because it captures a hydration or an earthquake operation using a camera and analyzes the operation.

In recent years, there has been proposed a technique of recognizing hydration or hydration using hydration gloves. However, this technique is limited in that it can be worn for a long period of time due to reasons such as sweat on the hands, and there is a possibility that foreign matter When performing routine operations, there is a need to remove the hydration gloves.

The background technology of the present application is disclosed in Korean Patent Registration No. 10-1551424 (Registered on Feb. 25, 2015).

It is an object of the present invention to provide a geotechnical recognition system and method which are easy to carry without being restricted by the daily life operation.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a geo-recognition system and method capable of clearly identifying geo-motion operations in a short time.

It is to be understood, however, that the technical scope of the embodiments of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided an apparatus for recognizing an earthquake according to an embodiment of the present invention includes an acquisition unit for acquiring an EMG signal of a user from a sensor measurement device worn on a user's upper arm, An extracting unit for extracting a muscle activity period from the EMG signal to detect an operation; a calculating unit for calculating a feature vector of the fatigating operation taken by the user by performing signal processing on the muscle activity period; A search unit for searching for a signal corresponding to the vector, and an output unit for outputting a text corresponding to the searched signal.

The acquiring unit may include a receiving unit that receives an EMG signal corresponding to an operation of waving the user's wrist through a plurality of electrode channels included in the sensor measuring device, A channel identification unit for identifying an electrode channel having a maximum effective output value among the plurality of electrode channels; and a control unit for controlling the plurality of electrode measurement units based on the position of the identified electrode channel in the sensor measurement unit, And an alignment unit for re-aligning the electrode channels.

In addition, the extraction unit may extract the muscle activity period by applying Teaker-Kaiser Energy Operator (TKEO) technique to the EMG signals received from each of the plurality of electrode channels.

Also, the extracting unit may extract, as the muscle activity period, an interval that is equal to or greater than a preset muscle activity threshold value in the EMG signal.

The calculating unit may calculate the effective output value of the electromyogram signal for each of the plurality of electrode channels included in the sensor measuring device based on the electromyogram signal included in the muscle active period to calculate the characteristic vector have.

In addition, the feature vector may be resampled by normalizing the time data.

In addition, the search unit may perform the search using a neural network formed through learning of a specific artifact operation.

The sensor measuring device may include an armband worn to surround the upper arm and a plurality of electrodes spaced apart to face the upper arm along the inner circumference of the armband.

According to another aspect of the present invention, there is provided a method for recognizing an artificial tooth, comprising the steps of: acquiring an EMG signal of a user from a sensor measuring instrument worn on a user's upper arm; Extracting an active period, calculating a feature vector of the action taken by the user by performing signal processing on the active period, retrieving a signal corresponding to the feature vector in the database, And outputting a text corresponding to the signal.

The acquiring step may include receiving an EMG signal according to an operation of waving the wrist of the user through a plurality of electrode channels included in the sensor measuring device and receiving the EMG signal received from each of the plurality of electrode channels A plurality of electrode channels, each electrode channel having a maximum effective output value among the plurality of electrode channels, based on the position of the electrode channel in the sensor measuring device, Lt; / RTI >

In the extracting step, the muscle activation section may be extracted by applying Teaker-Kaiser Energy Operator (TKEO) technique to the EMG signal received from each of the plurality of electrode channels.

Also, the extracting step may extract, as the muscle activity period, an interval that is equal to or greater than a preset muscle activity threshold value in the EMG signal.

The calculating step calculates the effective output value of the electromyogram signal for each of the plurality of electrode channels included in the sensor measuring device based on the electromyogram signal included in the muscle active section to calculate the characteristic vector can do.

In addition, the feature vector may be resampled by normalizing the time data.

In addition, the searching step may perform the searching using a neural network formed through learning of a specific geographical operation.

The sensor measuring device may include an armband worn to surround the upper arm and a plurality of electrodes spaced apart to face the upper arm along the inner circumference of the armband.

The above-described task solution is merely exemplary and should not be construed as limiting the present disclosure. In addition to the exemplary embodiments described above, there may be additional embodiments in the drawings and the detailed description of the invention.

According to one aspect of the present invention, there is provided a method for measuring an EMG signal, comprising the steps of: obtaining an EMG signal of a user from a sensor measuring instrument worn on a user's upper arm region; calculating a characteristic vector of an EMG operation based on the EMG signal; By outputting a text corresponding to the feature vector retrieved from the feature vector, it is possible to deliver the intention through the feature operation more quickly and accurately.

According to the above-mentioned problem solving means of the present invention, the present invention measures a user's electromyogram signal through a sensor measuring instrument including an armband and a plurality of electrodes, and identifies a user's action based on the measured electromyogram signal. It is possible to provide a geotechnical recognition system and method which are easy to carry without being restricted by the operation.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram schematically showing an overall configuration of a geotechnical recognition system according to an embodiment of the present invention; Fig.
2 is a diagram illustrating the configuration of an acquiring unit in the geo-recognition system according to an embodiment of the present invention.
3 is a diagram illustrating a sensor measurement apparatus used in a geo-recognition system according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating an example of a TKEO technique used in a geo-recognition system according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating an example of detection of a muscle activity period in the geo-recognition system according to an embodiment of the present invention.
6 is a diagram illustrating an example of a neural network used in the geo-recognition system according to an embodiment of the present invention.
7 is a diagram illustrating an example of detecting a signal corresponding to a feature vector in the geo-recognition system according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating an example of the geo-operation that can be recognized by the geo-recognition system according to an embodiment of the present invention.
9 is a flowchart illustrating an operation of the geo-recognition method according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. It should be understood, however, that the present invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, the same reference numbers are used throughout the specification to refer to the same or like parts.

Throughout this specification, when an element is referred to as being "connected" to another element, it is intended to be understood that it is not only "directly connected" but also "electrically connected" or "indirectly connected" "Is included.

It will be appreciated that throughout the specification it will be understood that when a member is located on another member "top", "top", "under", "bottom" But also the case where there is another member between the two members as well as the case where they are in contact with each other.

Throughout this specification, when an element is referred to as "including " an element, it is understood that the element may include other elements as well, without departing from the other elements unless specifically stated otherwise.

The present invention relates to a geo-recognition system and method for recognizing geo-motion using an EMG signal.

FIG. 1 is a schematic diagram illustrating an overall configuration of a geo-recognition system according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a configuration of an acquisition unit in a geo-recognition system according to an embodiment of the present invention.

Referring to FIG. 1, a geo-recognition system 100 according to an embodiment of the present invention includes an acquisition unit 110, an extraction unit 120, a calculation unit 130, a search unit 140, and an output unit 150 .

The acquiring unit 110 may acquire the user's EMG signal from the sensor measuring device worn on the upper arm region of the user. A sensor measuring instrument used for obtaining an EMG signal in the present application can be more easily understood with reference to Fig.

3 is a diagram illustrating a sensor measurement apparatus used in a geo-recognition system according to an embodiment of the present invention.

Referring to FIG. 3, the sensor measuring instrument 10 according to an embodiment of the present invention may be worn on the upper arm portion of the user.

The sensor measuring device 10 may be worn on the forearm portion between the elbow and the elbow in addition to the upper arm portion between the elbow and the shoulder.

The sensor measuring instrument 10 may include an armband 11 and a plurality of electrodes (for example, a first electrode 1, a second electrode 2, a third electrode 3, ...). The armband 11 may be a band worn to surround the upper arm region of the user. The armband 11 may be a material that can expand or contract depending on the thickness of the body part of the user to which the sensor measuring device 10 is worn. The plurality of electrodes 1, 2, 3, ... may be spaced apart along the inner circumference of the armband 11 so as to face the upper arm region of the user. The plurality of electrodes 1, 2, 3, ... may be electromyogram electrodes.

In addition, the sensor measuring instrument 10 may include a control unit (not shown). The sensor measuring instrument 10 can measure the user's electromyogram signal through the plurality of electrodes 1, 2, 3, ... based on the control signal of the controller. The control unit can transmit the electromyogram signal measured through the plurality of electrodes to the geo recognition system 100 through wireless communication such as Bluetooth and near field communication (NFC). In this way, the acquisition unit 110 of the geo-recognition system 100 can acquire the user's EMG signal from the sensor-measuring device 10.

2, the obtaining unit 110 may include a receiving unit 111, a channel identifying unit 112, and an arranging unit 113.

The geo-recognition system 100 according to an embodiment of the present invention can acquire the value of the EMG signal measured from the sensor measuring instrument 10 through the receiving unit 111, the channel identifying unit 112 and the aligning unit 113 Calibration can be done. Calibration refers to a process of adjusting an EMG signal measured through an electrode to a predetermined standard in accordance with a characteristic (or scale) of a subject (i.e., a user). Accordingly, the geo-recognition system 100 according to an embodiment of the present invention can more accurately analyze the EMG signal measured through the sensor measuring device 10 in consideration of the characteristics of the user.

The receiving unit 111 can receive an EMG signal according to a user's wrist swinging operation through a plurality of electrode channels included in the sensor measuring instrument 10. [ The plurality of electrode channels means channels corresponding to the plurality of electrodes 1, 2, 3, ..., respectively.

The channel identification unit 112 can identify an electrode channel having a maximum effective power (RMS) value among a plurality of electrode channels, based on the electromyogram signal received from each of the plurality of electrode channels.

The channel identification unit 112 can identify the position of the electrode channel where the maximum effective output value among the plurality of electrode channels appears by comparing the EMG signals received from each of the plurality of electrode channels.

The position of the electrode channel having the maximum effective output value may be the position of a wrist extensor bundle. Accordingly, the channel identifying unit 112 can detect the position of the wrist extensor bundle by identifying the position of the electrode channel where the maximum effective output value appears.

The position of the electrode channel identified in the channel identification unit 112 may be stored in a database (not shown).

The aligning unit 113 may rearrange a plurality of electrode channels included in the sensor measuring device 10 in consideration of the position of the electrode channel identified through the channel identifying unit 112 for the measurement of a constant EMG signal . The user wears the sensor measuring instrument and then performs the initial calibration of the electrode channel through this reordering to set the acquiring unit 110 to acquire the EMG signal corresponding to the wrist extensor muscle associated with the wrist motion of the wrist with high accuracy .

The extraction unit 120 may extract the muscle activity period from the electromyogram signal obtained by the acquisition unit 110 to sense the fatigue operation taken by the user.

The extraction unit 120 may apply a band-pass filter to the electromyogram signal acquired by the acquisition unit 110 before extracting the muscle activity period. For example, the extraction unit 120 may apply a band pass filter of 10 to 450 Hz to the acquired electromyogram signal. The extraction unit 120 may apply an analog-to-digital converter (ADC) to the acquired EMG signal.

The extraction unit 120 may extract a muscle activity period by applying a Teeter-Kaiser Energy Operator (TKEO) technique to the EMG signals received from each of the plurality of electrode channels. In addition, the extracting unit 120 may extract, as a muscle activity period, an interval that is equal to or greater than a preset muscle activity threshold value in the EMG signal acquired by the acquisition unit 110. [ A more detailed description follows.

The Teaker-Kaiser Energy Operator (TKEO) technique is a signal processing technique that extracts muscle activity in very small movements such as finger movements. It uses a muscle activity of finger movements with a low signal-to-noise ratio (SNR) Can be detected.

The TKEO technique can be defined as Equation (1) below, which is well known to those skilled in the art. Therefore, rather than describing the TKEO technique itself, An example applied to the geo-recognition system according to the example will be mainly described.

Figure pat00001

FIG. 4 is a diagram illustrating an example of a TKEO technique used in a geo-recognition system according to an embodiment of the present invention.

Referring to FIG. 4, for example, FIG. 4A shows a graph of a signal to which the TKEO technique is not applied, and FIG. 4B shows a graph of a signal to which the TKEO technique is applied to the signal of FIG. . A graph in which a low pass filter of 50 Hz is applied is shown in Fig. 4 (a ') and a graph in which a low pass filter of 50 Hz is applied in Fig. 4 (b) 4 (b ').

In the case of FIG. 4 (b '), it can be seen that the probability of false detection in the active section is reduced by significantly increasing the signal-to-noise ratio (SNR) compared to FIG. 4 (a').

The extraction unit 120 may apply the TKEO technique to each of the EMG signals received through the plurality of electrode channels in order to extract the muscle activity period. The extraction unit 120 can then synthesize data (electromyogram signals) of all channels (i.e., a plurality of electrode channels) to which the TKEO technique is applied. Then, the extractor 120 may calculate an effective output (RMS) value for the combined data in which the data of all the channels are combined. The effective output value (U RMS ) for the composite data can be expressed by the following equation (2).

Figure pat00002

In this case, N represents the window width, and u (n) represents the composite data of the electromyogram signal to which the TKEO technique (i.e., Equation 2) is applied.

The extraction unit 120 may perform a rectification process, which is a process of obtaining the absolute value of the EMG signal after calculating the effective output value for the combined data.

The extracting unit 120 adds a band pass filter, a low pass filter, a TKEO technique (using Equation 1), rectification, an effective value output of the synthesized data (using Equation 2), and the like to the electromyogram signal obtained by the acquiring unit 110 A linear envelope signal in which the EMG signal is simplified can be obtained. Then, the extracting unit 120 can extract the muscle active section based on the linear envelope signal. An example of extracting the muscle active section can be more easily understood with reference to FIG.

FIG. 5 is a diagram illustrating an example of detection of a muscle activity period in the geo-recognition system according to an embodiment of the present invention.

First, a threshold value for detecting a muscle active section may be preset by user input. The threshold value can be defined as 'Baseline average + J * standard deviation'. In this case, the baseline means an electromyogram signal measured when the user is not giving a force, and j means a constant value.

The threshold value is a measure for determining whether or not the muscles of the subject are muscular active. If the measured value of the electromyogram signal is greater than or equal to the threshold value, the threshold value is determined to be the muscle active state. , It can be judged as a muscle active off state.

Referring to FIG. 5, a point indicates a point where muscle activity is ON, and point b indicates a point where muscle activity is OFF. ST represents a signal waveform corresponding to a preset threshold value. S1 represents synthetic data obtained by synthesizing electromyogram signals of all channels to which the TKEO technique is applied. The interval between point a and point b may be referred to as a muscle activity interval, and S2 represents an EMG signal included in the muscle activity interval in the synthesis data S1.

The extracting unit 120 sets a point at which the EMG signal obtained by the acquiring unit 110 rises above the threshold value to a muscle active ON point (for example, a point), and falls to a point below the threshold value By setting it to the muscle active OFF point (for example, the b point), the muscle activity period can be extracted.

The extraction unit 120 may determine that the user has performed the firing operation when the muscle activity period is detected in the electromyogram signal acquired by the acquisition unit 110, and stop the measurement of the electromyogram signal. The extraction unit 120 may deactivate the acquisition unit 110 and activate the calculation unit 130 when a muscle active period is detected. In addition, the EMG signal measurement from the sensor measuring device 10 can be stopped by user input.

The extraction unit 120 may deactivate the calculation unit 130 and activate the acquisition unit 110 when the muscle active period is not detected.

The calculating unit 130 may calculate the feature vector of the geomorphic operation taken by the user by performing signal processing on the muscle active period extracted by the extracting unit 120. [

The calculating unit 130 may calculate the feature vector of the geomorphic operation taken by the user in consideration of the position of the electrode channel identified by the channel identifying unit 112. [

The calculation unit 130 calculates the effective value of the electromyogram signal for each of the plurality of electrode channels included in the sensor measurement device 10 based on the electromyogram signal (for example, the signal S2 in FIG. 5) By calculating the output value FRMS C , the characteristic vector can be calculated.

The calculating unit 130 can calculate the effective output value (FRMS C ) of the electromyogram signal for each channel in the muscle activity section based on the following equation (3).

Figure pat00003

At this time, C represents the channel number of the electrode and τ represents the muscle active period. For example, the channel number of the first electrode 1 may be 1, and the channel number of the second electrode 2 may be 2.

The calculating unit 130 may calculate the characteristic vector by normalizing the time data based on the effective output value FRMS C calculated through Equation (3). The feature vector may be resampled by normalizing the time data.

The calculating unit 130 may calculate the characteristic vector for the geomorphic operation taken by the user by integrating the effective output values of the respective channels calculated through Equation (3) as shown in Equation (4).

Figure pat00004

FRMS 1 represents the effective output value of the electromyogram signal obtained through the channel of the first electrode 1 in the muscle active section and FRMS 2 represents the effective output value of the heart muscle in the muscle activity section 2 represents the effective output value of the electromyogram signal obtained through the channel of the two-electrode 2. For example, the characteristic vector of the firing operation taken by the user through the calculation unit 130 may be the same as the graph 70 shown in FIG. 7 (a), which will be described later.

The searching unit 140 can search for a signal corresponding to the characteristic vector calculated by the calculating unit 130 in a database (not shown).

 The search unit 140 may perform a search using a neural network formed through learning of a specific geographical operation. An example of a neural network is shown in Fig.

6 is a diagram illustrating an example of a neural network used in the geo-recognition system according to an embodiment of the present invention.

Referring to FIG. 6, the searching unit 140 can search for a signal corresponding to the characteristic vector calculated by the calculating unit 130 in a database (not shown) more quickly and accurately through a pattern recognition method based on a neural network . For this, the searching unit 140 can determine the parameters (W, bias) of the neural network that maximizes the pattern classification probability through learning of the specific artifact operation.

The search unit 140 can search for and extract a signal having the highest similarity to the characteristic vector among the signals included in the database. This can be more easily understood with reference to FIG.

7 is a diagram illustrating an example of detecting a signal corresponding to a feature vector in the geo-recognition system according to an embodiment of the present invention.

Referring to Fig. 7, Fig. 7 (a) shows a graph 70 of the characteristic vector calculated through the calculation unit 130. Fig.

FIG. 7 (b) shows an example of signals stored in the database, which will be described in more detail as follows. The waveform graph of the EMG signal corresponding to each text may be stored in the database by text (e.g., alphabets, letters, numbers, consonants, vowels, etc.). For example, the EMG signal graph of the ground motion 71 'representing the text' A 'may be the same as the first graph 71. The graph of the electromyogram signal of the ground motion 72 'indicating the text' B 'may be the same as the second graph 72. The graph of the EMG signal of the ground motion 73 'representing the text' C 'may be the same as the third graph 73. The graph of the EMG signal of the ground motion 74 'representing the text' D 'may be the same as the fourth graph 74. The graph of the EMG signal of the petitioning operation 75 'indicating the text' E 'may be the same as the fifth graph 75. The graph of the EMG signal of the ground motion 76 'representing the text' F 'may be the same as the sixth graph 76.

The search unit 140 can search for the signal corresponding to the graph 70 shown in FIG. 7 (a) in the data shown in FIG. 7 (b). The search unit 140 can extract the second graph 72 in the database as the search result of the signal corresponding to the characteristic vector.

Thereafter, the output unit 150 may output text corresponding to the result retrieved by the retrieval unit 140 (i.e., text 'B').

The output unit 150 may output the text corresponding to the signal retrieved by the retrieval unit 140 to a display screen or a speaker.

The geo-recognition system 100 according to one embodiment of the present invention can be performed in a portable terminal, a smart phone, a personal digital assistant (PDA), a tablet, a notebook PC, a desktop PC, and the like.

The output unit 150 may output the text corresponding to the signal retrieved from the retrieval unit 140 to a display screen of a user terminal such as a portable terminal, a smart phone, a desktop PC, or the like.

FIG. 8 is a diagram illustrating an example of the geo-operation that can be recognized by the geo-recognition system according to an embodiment of the present invention.

In Fig. 8, as an example of the firing operation, the firing operations from alphabet A to Z are shown. In the database (not shown) of the geo-recognition system 100 according to an embodiment of the present invention, an EMG signal corresponding to each geocoding operation May be stored.

Hereinafter, the operation flow of the present invention will be briefly described based on the details described above.

9 is a flowchart illustrating an operation of the geo-recognition method according to an embodiment of the present invention. The geo-recognition method shown in FIG. 9 can be performed by the geo-recognition system 100 described above with reference to FIGS. 1 to 8. FIG. Therefore, even if omitted below, the contents described with respect to the geo-recognition system 100 through Figs. 1 to 8 can also be applied to Fig.

Referring to FIG. 9, in step S910, the user's electromyogram signal can be obtained from the sensor measuring instrument 10 worn on the user's upper arm through the acquiring unit 110. [

In step S910, the obtaining unit 110 can receive the EMG signal according to the user's wrist swinging operation through the plurality of electrode channels included in the sensor measuring instrument 10. [ The acquiring unit 110 can identify the electrode channel having the maximum effective output value among the plurality of electrode channels based on the electromyogram signal received from each of the plurality of electrode channels. The acquisition unit 110 may then reorder the plurality of electrode channels included in the sensor measurement device 10, taking into consideration the position of the electrode channel identified in the sensor measurement device 10, for constant sensor metering.

In step S920, the extraction unit 120 may extract the muscle activity period from the EMG signal in order to sense the petrifugation action taken by the user.

In step S920, the extraction unit 120 may extract a muscle activity period by applying a teaser-Kaiser energy operator (TKEO) technique to the EMG signals received from each of the plurality of electrode channels.

In addition, in step S920, the extracting unit 120 may extract, as the muscle activity period, a section that is equal to or greater than the muscle activity threshold value set in advance in the EMG signal.

In step S930, the feature vector of the petition operation taken by the user can be calculated by performing the signal processing on the muscle active section extracted in step S920 through the calculating section 130. [

In step S930, the calculating unit 130 calculates an effective output value of the electromyogram signal for each of the plurality of electrode channels included in the sensor measuring instrument 10, based on the electromyogram signal included in the muscle active period, Can be calculated. The feature vector may be resampled by normalizing the time data.

In step S940, the search unit 140 can search for a signal corresponding to the characteristic vector in the database.

In step S940, the search unit 140 may perform a search using the neural network formed through the learning of the specific geographical operation.

In step S950, the text corresponding to the signal searched in step S940 may be output through the output unit 150. [

In the above description, steps S910 to S950 may be further divided into further steps or combined into fewer steps, according to embodiments of the present disclosure. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

The geo-recognition method according to an embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Further, the above-described geo-recognition method may be implemented in the form of a computer program or an application executed by a computer stored in a recording medium.

It will be understood by those of ordinary skill in the art that the foregoing description of the embodiments is for illustrative purposes and that those skilled in the art can easily modify the invention without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included within the scope of the present invention.

100: Geotechnical Recognition System
110: Acquiring unit 120:
130: Calculator 140: Search unit
150:

Claims (17)

An acquiring unit for acquiring an EMG signal of the user from a sensor measuring instrument worn on a user's upper arm;
An extracting unit for extracting a muscle activity period from the EMG signal to detect a fatigue motion taken by the user;
A calculating unit for calculating a feature vector of the geomorphic operation taken by the user by performing signal processing on the muscle active period;
A search unit for searching for a signal corresponding to the characteristic vector in the database; And
An output unit for outputting a text corresponding to the searched signal,
And a geographic recognition system. The method according to claim 1,
Wherein the obtaining unit comprises:
A receiving unit for receiving an EMG signal according to an operation of waving the wrist of the user through a plurality of electrode channels included in the sensor measuring device;
A channel identification unit for identifying an electrode channel having a maximum effective output value among the plurality of electrode channels based on the electromyogram signal received from each of the plurality of electrode channels;
An alignment unit for rearranging the plurality of electrode channels included in the sensor measurement device in consideration of the position of the identified electrode channel in the sensor measurement device,
Wherein the geographic recognition system comprises: The method according to claim 1,
The extracting unit
Wherein the muscle activation section extracts the muscle activity section by applying Teaker-Kaiser Energy Operator (TKEO) technique to the EMG signals received from each of the plurality of electrode channels included in the sensor measurement device. The method according to claim 1,
The extracting unit
And extracts, as the muscle activity section, a section having a muscle activity threshold value or more set in advance in the EMG signal. The method according to claim 1,
The calculating unit calculates,
And calculates an effective output value of the electromyogram signal for each of the plurality of electrode channels included in the sensor measurement device based on the electromyogram signal included in the muscle activity section to calculate the characteristic vector. 6. The method of claim 5,
Wherein the feature vector is resampled by normalizing the time data. The method according to claim 1,
The search unit may search,
Wherein the search is performed using a neural network formed through learning of a specific geomagnetism operation. The method according to claim 1,
The sensor measuring device includes:
An armband worn to surround the upper arm; And
A plurality of electrodes arranged at intervals so as to face the upper arm region along the inner periphery of the armband,
Wherein the geographical recognition system comprises: Obtaining an EMG signal of the user from a sensor measuring instrument worn on the upper arm of the user;
Extracting a muscle activity interval from the EMG signal to detect a fatigue motion taken by the user;
Calculating a feature vector of the geomorphic operation taken by the user by performing signal processing on the muscle active period;
Retrieving a signal corresponding to the characteristic vector in a database; And
Outputting a text corresponding to the retrieved signal,
. 10. The method of claim 9,
Wherein the acquiring comprises:
Receiving an EMG signal according to an operation of waving the wrist of the user through a plurality of electrode channels included in the sensor measurement device,
An electrode channel having a maximum effective output value among the plurality of electrode channels based on the EMG signal received from each of the plurality of electrode channels,
And reorder the plurality of electrode channels included in the sensor measurement device, taking into account the position of the identified electrode channel in the sensor measurement device. 10. The method of claim 9,
The extracting step
Wherein the muscle activation section extracts the muscle activity section by applying Teaker-Kaiser Energy Operator (TKEO) technique to the EMG signal received from each of the plurality of electrode channels. 10. The method of claim 9,
The extracting step
And extracts, as the muscle activity section, an interval that is equal to or greater than a preset muscle activity threshold value in the EMG signal. 10. The method of claim 9,
Wherein the calculating step comprises:
Wherein an effective output value of the electromyogram signal for each of the plurality of electrode channels included in the sensor measuring device is calculated based on the electromyogram signal included in the muscle active section to calculate the characteristic vector. 14. The method of claim 13,
Wherein the feature vector is resampled by normalizing the time data. 10. The method of claim 9,
Wherein the searching comprises:
Wherein the search is performed using a neural network formed through learning of a specific artifact motion. 10. The method of claim 9,
The sensor measuring device includes:
An armband worn to surround the upper arm; And
A plurality of electrodes arranged at intervals so as to face the upper arm region along the inner periphery of the armband,
Wherein the geographic recognition method comprises: A computer-readable recording medium on which a program for executing the method of any one of claims 9 to 16 is recorded.
KR1020160010230A 2016-01-27 2016-01-27 Finger language recognition system and method KR20170089685A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020160010230A KR20170089685A (en) 2016-01-27 2016-01-27 Finger language recognition system and method
US16/073,441 US10685219B2 (en) 2016-01-27 2016-10-17 Sign language recognition system and method
PCT/KR2016/011650 WO2017131318A1 (en) 2016-01-27 2016-10-17 Sign language recognition system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160010230A KR20170089685A (en) 2016-01-27 2016-01-27 Finger language recognition system and method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020180025991A Division KR101875472B1 (en) 2018-03-05 2018-03-05 Finger language recognition system and method

Publications (1)

Publication Number Publication Date
KR20170089685A true KR20170089685A (en) 2017-08-04

Family

ID=59654584

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160010230A KR20170089685A (en) 2016-01-27 2016-01-27 Finger language recognition system and method

Country Status (1)

Country Link
KR (1) KR20170089685A (en)

Similar Documents

Publication Publication Date Title
Jiang et al. Memento: An emotion-driven lifelogging system with wearables
JP2021072136A (en) Methods and devices for combining muscle activity sensor signals and inertial sensor signals for gesture-based control
Pollreisz et al. A simple algorithm for emotion recognition, using physiological signals of a smart watch
KR101157073B1 (en) Method for finger language recognition using emg and gyro sensor and apparatus thereof
KR102588906B1 (en) Apparatus and method for assessment biological signal quality
CN107536599A (en) The System and method for of live signal segmentation and datum mark alignment framework is provided
US10685219B2 (en) Sign language recognition system and method
EP2839774B1 (en) Biosignal interface apparatus and operation method of biosignal interface apparatus
KR20120052610A (en) Apparatus and method for recognizing motion using neural network learning algorithm
Al-Ghannam et al. Prayer activity monitoring and recognition using acceleration features with mobile phone
KR101875472B1 (en) Finger language recognition system and method
Masnad et al. Human activity recognition using smartphone sensors with context filtering
Salvi et al. An optimised algorithm for accurate steps counting from smart-phone accelerometry
KR20150138559A (en) self-organized real-time authentication method using ECG signal
Park et al. Achieving real-time sign language translation using a smartphone's true depth images
WO2018036023A1 (en) Text input method and device for smart watch
US20220164029A1 (en) Classifying signals for movement control of an autonomous vehicle
CN113764099A (en) Psychological state analysis method, device, equipment and medium based on artificial intelligence
CN108962379B (en) Mobile phone auxiliary detection system for cranial nerve system diseases
Xie et al. Genetic programming based activity recognition on a smartphone sensory data benchmark
Li et al. Interpreting sign components from accelerometer and sEMG data for automatic sign language recognition
Mesanza et al. Machine learning based fall detector with a sensorized tip
KR20170089685A (en) Finger language recognition system and method
US10691218B2 (en) Gesture recognition apparatus and components thereof
Meng et al. Sentence-level sign language recognition using RF signals

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
E601 Decision to refuse application
E801 Decision on dismissal of amendment
A107 Divisional application of patent