CN110198665B

CN110198665B - Electronic device and control method thereof

Info

Publication number: CN110198665B
Application number: CN201780082139.7A
Authority: CN
Inventors: 姜赫; 刘宰蜂; 林京洙; 洪德基
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2016-11-16
Filing date: 2017-11-16
Publication date: 2022-03-29
Anticipated expiration: 2037-11-16
Also published as: CN110198665A

Abstract

An electronic device is disclosed. The electronic device includes: a biosignal input unit for receiving an input of a biosignal detected through the electrode; and a processor determining a bio-signal to be input based on a usage context of the electronic device, setting a state of a channel corresponding to the electrode according to the determined bio-signal, and determining a biological change by using the bio-signal input according to the set channel state.

Description

Electronic device and control method thereof

Technical Field

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to a wearable electronic device capable of sensing a bio-signal of a user and a control method thereof.

Background

In recent years, with the active progress of research on wearable devices, various wearable devices are being released. Wearable devices currently available or expected to be pushed out are smart watches, Head Mounted Display (HMD) devices, smart belts, and the like.

An HMD device is a wearable display device that may be worn while wearing glasses and may display images. HMD devices are also known as surface mounted displays (FMDs) because the display is positioned close to the wearer's eye. In addition to simple display functions, the HMD device may be combined with augmented reality technology, N-screen technology, and the like to provide various conveniences to a user.

In particular, the HMD device may provide ambient images to provide a more realistic and realistic virtual space to the user. The surrounding image may represent visual information that propagates in all directions around the HMD device. Accordingly, the HMD device may direct the direction in which the face of the user wearing the HMD device faces, and display an image corresponding to the direction in the surrounding image. Therefore, the user can feel that the user actually exists in the virtual space.

On the other hand, since the HMD device is an environment in which it is difficult to use a separate input device such as a keyboard or a mouse, techniques for sensing a bio-signal of a user, receiving the sensed bio-signal, and controlling the HMD device are emerging. To sense the bio-signals, a plurality of dry electrodes may be attached and used on the wearing surface of the HMD device. In the related art, since all biological signals of a user are input through a plurality of electrodes, it is inefficient in terms of the amount of calculation and the amount of power consumption for processing the signals.

Therefore, in order to solve such inefficiency, a solution of inputting and using only bio-signals required for each use case of the HMD apparatus is required.

Disclosure of Invention

Technical problem

The present disclosure provides an electronic device capable of selectively receiving a user's desired bio-signal in consideration of a context (context), and a control method thereof.

Technical scheme

According to an aspect of the present disclosure, an electronic device includes: a bio-signal input configured to receive a bio-signal sensed through the electrode; and a processor configured to determine a bio-signal to be input based on a context of the electronic device, set a state of a channel corresponding to the electrode according to the determined bio-signal, and determine a biological change using the bio-signal input according to the set state of the channel.

The processor may activate channels corresponding to the electrodes for sensing the determined bio-signal and deactivate channels other than the channels corresponding to the electrodes for sensing the determined bio-signal.

The processor may determine the biological change by a channel corresponding to at least one electrode corresponding to a particular body part according to a context of the electronic device.

The electrodes may include a first electrode for sensing a first bio-signal and a second electrode for sensing a second bio-signal, and when the determined bio-signal is the first bio-signal, the processor may select a channel corresponding to the first electrode as a channel for receiving the bio-signal and set a state of the channel corresponding to the first electrode based on a characteristic of the first bio-signal, and when the determined bio-signal is the second bio-signal, the processor may select a channel corresponding to the second electrode as a channel for receiving the bio-signal and set a state of the channel corresponding to the second electrode based on a characteristic of the second bio-signal.

The first electrode may be used to sense EOG signals on the left, right, and top sides of the user's eye, and the second electrode may be used to sense EMG signals on the bottom side of the user's eye.

The electrodes may include a common electrode for sensing any one of a plurality of bio-signals determined based on a context of the electronic device, and the processor may select a channel corresponding to the common electrode as a channel to receive the determined bio-signal and set a state of the channel corresponding to the common electrode based on a characteristic of the determined bio-signal.

The common electrode may be used to sense any one of an EOG signal and an EMG signal on the underside of the user's eye.

The bio-signal may include at least one of an Electromyography (EMG) signal, an Electrooculogram (EOG) signal, an electroencephalography (EEG) signal, an Electrocardiogram (ECG) signal, a Galvanic Skin Response (GSR) signal, and a Bioelectrical Impedance Analysis (BIA) signal.

The processor may set at least one of a sampling rate, an analog-to-digital converter (ADC) resolution, and a cutoff frequency of a channel corresponding to an electrode for sensing the determined bio-signal based on the determined characteristic of the bio-signal.

Further, the processor may measure a quality of the bio-signal input and determine the channel in which the determined bio-signal is input based on the measured quality of the bio-signal.

The electronic device may further comprise an outputter, wherein the processor may control the outputter to output the result in accordance with the determined biological change.

The output may include a display, and the processor may control a screen of the display according to the determined biological change.

The context of the electronic device may include a display state of the display, and when a screen of the display is a screen for requesting user authentication using a mouth shape when speaking, the processor may determine the EMG signal around the mouth of the user as a biological signal to be input, and may determine the biological change through a channel corresponding to the electrode for sensing the EMG signal.

Further, when the screen of the display is a screen operated by navigation, the processor may determine the EOG signal as a bio signal to be input, and determine the bio change through a channel corresponding to an electrode for sensing the EOG signal.

Further, when the screen of the display is a screen for performing facial recognition, the processor may determine the EMG signal and the EOG signal as biological signals to be input, and determine the biological change through channels corresponding to the electrodes for sensing the EMG signal and the EOG signal.

Furthermore, the EMG signal may be sensed by using a potential difference of a pair of electrodes adjacent to each other.

Further, the electronic device may further include a motion detection sensor, and the processor may selectively receive one of the EOG signal corresponding to the left eye and the EOG signal corresponding to the right eye according to a rotation direction of the head of the user by using the motion detection sensor.

Further, the processor may determine a wearing state of the electronic device based on a bio-signal sensed through an electrode for sensing a wearing state of the electronic device by the user, and control the output to output a result according to the determination.

Further, when a signal of a threshold value or less is detected from the at least one electrode for sensing wearing of the electronic device by the user, the processor may determine that the electronic device is in a non-wearing state, and deactivate electrodes other than the at least one electrode for sensing wearing of the electronic device.

Further, when the context of the electronic device requires identification of the mood of the user, the processor may determine a biological change of the user through a channel corresponding to an electrode for sensing at least one of an EEG signal indicative of a degree of concentration occurring in the forehead region, a skin conductivity signal indicative of a change in a degree of skin hydration on the face, and a bioelectrical resistance analysis signal on the face, and identify the mood of the user using the determined biological change.

According to another aspect of the present disclosure, a method of controlling an electronic device includes: determining a bio-signal to be input based on a context of the electronic device; setting a state of a channel corresponding to an electrode for sensing the determined bio-signal according to the determined bio-signal; and determining a biological change using the biological signal input according to the setting state of the channel.

At this time, the setting may include activating a channel corresponding to the electrode for sensing the determined bio-signal, and deactivating channels other than the channel corresponding to the electrode for sensing the determined bio-signal.

Further, the determining may include determining the biological change by a channel corresponding to at least one electrode corresponding to a particular body part according to a context of the electronic device.

Further, the electrodes may include a first electrode for sensing a first bio-signal and a second electrode for sensing a second bio-signal, and when the determined bio-signal is the first bio-signal, the setting may select a channel corresponding to the first electrode as a channel for receiving the bio-signal and set a state of the channel corresponding to the first electrode based on a characteristic of the first bio-signal, and when the determined bio-signal is the second bio-signal, the setting may select a channel corresponding to the second electrode as a channel for receiving the bio-signal and set a state of the channel corresponding to the second electrode based on a characteristic of the second bio-signal.

Further, the first electrode may be used for sensing EOG signals on the left, right and upper side of the user's eye, and the second electrode may be used for sensing EMG signals on the lower side of the user's eye.

Further, the electrodes may include a common electrode for sensing any one of a plurality of bio-signals determined based on a context of the electronic device, and the setting may select a channel corresponding to the common electrode as a channel to receive the determined bio-signal and set a state of the channel corresponding to the common electrode based on a characteristic of the determined bio-signal.

Further, the common electrode may be used to sense any one of an EOG signal and an EMG signal on the underside of the user's eye.

Further, the bio-signal may include at least one of an Electromyography (EMG) signal, an Electrocardiogram (EOG) signal, an electroencephalography (EEG) signal, an Electrocardiogram (ECG) signal, a Galvanic Skin Response (GSR) signal, and a Bioelectrical Impedance Analysis (BIA) signal.

Further, the setting may include setting at least one of a sampling rate, an analog-to-digital converter (ADC) resolution, and a cutoff frequency of a channel corresponding to an electrode for sensing the determined bio-signal based on the characteristic of the determined bio-signal.

Further, the control method may further include measuring a quality of the bio-signal sensed through the electrode, and determining a channel in which the bio-signal is input based on the measured quality of the bio-signal.

Further, the control method may further include changing the output result according to the determined creature.

Further, the outputting may include controlling a screen of a display included in the electronic device according to the determined biological change.

Further, the context of the electronic device may include a display state of the display, and wherein when the screen of the display is a screen for requesting user authentication using a mouth shape when speaking, the determining includes determining the EMG signal around the mouth of the user as the bio signal to be input.

Further, when the screen of the display is a screen operated by navigation, the determining may include determining the EOG signal as the bio signal to be input.

Further, the context of the electronic device may include a screen state of the display, and when the screen of the display is a screen for performing facial recognition, the determining may include determining the EMG signal and the EOG signal as bio signals to be input.

Further, the determining may include selectively determining one input of the EOG signal corresponding to the left eye and the EOG signal corresponding to the right eye according to a rotation direction of the head of the user sensed by using the motion detection sensor.

Further, the control method may further include determining a wearing state of the electronic device based on a bio-signal sensed through an electrode for sensing the wearing state of the electronic device by the user, and outputting a result according to the determination.

Further, when a signal of a threshold value or less is detected from the at least one electrode for sensing wearing of the electronic device by the user, the control method may further include deactivating electrodes other than the at least one electrode for sensing wearing of the electronic device.

Further, when the context of the electronic device requires recognition of the mood of the user, the determining may include determining at least one of an EEG signal indicating a degree of concentration occurring in the forehead region, a skin conductivity signal indicating a change in the degree of skin hydration on the face, and an on-face bioelectrical resistance analysis signal as the bio signal to be input.

Technical effects

According to various embodiments of the present disclosure, in an HMD device using bio-signal control, only necessary bio-signals may be received and used according to the context of the HMD device, and thus the amount of calculation and power consumption required to control the HMD device may be reduced, and the convenience of a user may be increased.

Drawings

Figures 1a and 1b are diagrams for explaining an implementation example of an electronic device according to an embodiment of the present disclosure,

figures 2a and 2b are block diagrams showing a brief configuration of an electronic device according to an implementation example of the present disclosure,

fig. 3 is a view for explaining each electrode for sensing a bio-signal according to an embodiment of the present disclosure,

fig. 4 is a view for explaining a common electrode for sensing bio-signals according to another embodiment of the present disclosure,

fig. 5 is a diagram for explaining a per-signal-flow process in an electronic device according to an embodiment of the present disclosure,

figure 6 is a graph for illustrating an EOG signal and an EMG signal according to an embodiment of the present disclosure,

figure 7 is a simplified flow diagram illustrating a process of operating an electronic device according to an embodiment of the present disclosure,

figure 8 is a detailed flowchart explaining a process of operating an electronic device according to an embodiment of the present disclosure,

fig. 9 to 12 are diagrams for explaining the operation of an electronic device according to various contexts according to an embodiment of the present disclosure,

fig. 13 is a block diagram showing a detailed configuration of an electronic apparatus according to another embodiment of the present disclosure, an

Fig. 14 is a flowchart for explaining a control method of an electronic device according to an embodiment of the present disclosure.

Detailed Description

Before describing the present disclosure in detail, methods that describe the specification and drawings will be described.

First, general terms used in the present specification and claims are selected in consideration of functions of various embodiments of the present disclosure. However, these general terms may be changed according to the intention of one of ordinary skill in the art, legal or technical explanation, emergence of new technology, and the like. Further, some terms used herein may be arbitrarily selected by the applicant. In this case, the terms may be construed as meaning as defined herein and may be interpreted based on the overall contents of the specification and the knowledge of the ordinary skill in the art, unless there is a specific term defined.

Further, the same reference numerals or symbols in the drawings attached to the present specification indicate components or elements performing substantially the same functions. For ease of explanation and understanding, the same reference numbers or symbols will be used to describe the different embodiments. In other words, even though all elements having the same reference number are shown in multiple figures, the multiple figures do not mean one embodiment.

Furthermore, in the description and claims, terms including an ordinal number, such as "first," "second," etc., may be used to distinguish one element from another. Such ordinals are used to distinguish the same or similar elements from each other, and the use of such ordinals should not be construed as limiting the meaning of the term. For example, elements associated with such ordinals should not be limited and interpreted in the order of their use or placement. Each ordinal number may be used interchangeably, if necessary.

As used herein, the singular forms "a", "an" and "the" include the plural forms unless the context clearly dictates otherwise. In this application, the terms "comprises" or "comprising," etc., specify the presence of stated features, integers, steps, operations, elements, components, or groups thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, components, groups, or groups thereof.

In an embodiment of the present disclosure, the terms "module," "unit," and/or "portion" refer to a term of an element that performs at least one function or operation, and may be implemented as hardware, software, or a combination of hardware and software. Furthermore, a plurality of "modules", a plurality of "units" and a plurality of "parts" may be implemented as at least one processor (not shown) integrated into at least one module or chip, except for "modules", "units" or "parts" which have to be implemented as specific hardware.

Further, in the embodiments of the present disclosure, when one portion is connected to another portion, this includes not only direct connection but also indirect connection through another medium. Further, a portion including an element means that it may further include other elements without excluding any other element unless specifically stated otherwise.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

Fig. 1a and 1b are diagrams for explaining an implementation example of an electronic device according to an embodiment of the present disclosure.

The electronic device 100 of the present disclosure may be implemented as an HMD (head mounted display) device that may be worn on the user's head or worn like glasses around the eyes to provide VR content. At this time, the electronic apparatus 100 may be implemented as an integrated HMD apparatus in which a band for wearing on the head of the user and various user interfaces and displays are integrally implemented, or may be implemented as a portable terminal apparatus including a display, such as a smart phone or the like, which may be detached and used in a removable HMD apparatus (housing) without a display.

Fig. 1a shows a user wearing an electronic device 100 implemented as an integrated HMD device 100A. Here, the electronic apparatus 100 may be worn in a form of fixing forehead and occipital regions of the user with a velcro (velcro) type band to block a view of an external environment of the user except for contents provided by the electronic apparatus 100.

Fig. 1B shows the appearance of the electronic apparatus 100 implemented as a portable terminal apparatus 100B attached to the removable HMD apparatus 200. As shown in fig. 1b, the electronic device 100 may be implemented as a smart phone to provide a display to a user, and may be detached from and attached to a body of the removable HMD device 200 secured to the forehead and occipital regions of the user.

The removable HMD device 200 may include electrodes capable of sensing bio-signals of the user, buttons capable of receiving user inputs, a communication module capable of performing wired/wireless communication with the electronic device 100. A specific configuration of the removable HMD apparatus 200 will be described later.

In the embodiment shown in FIG. 1b, the electronic device 100 is not limited to a smartphone. The electronic device 100 may be implemented as various devices including a display, such as a tablet PC, a mobile phone, a video phone, an e-book reader, a PDA (personal digital assistant), a PMP (portable multimedia player), an MP3 player, a navigation, a camera, and the like.

Fig. 2a and 2b are block diagrams showing a brief configuration of an electronic device according to an implementation example of the present disclosure.

According to fig. 2a, the electronic device 100 according to an embodiment of the present disclosure indispensably includes a bio-signal inputter 110 and a processor 120.

The bio-signal inputter 110 is a configuration for receiving a bio-signal of a user. Here, the user may refer to a wearer wearing the electronic device 100, and the bio-signal may be mainly obtained from a face of the user as a part wearing the electronic device 100. Here, the bio-signal mainly refers to a bio-electric signal generated by an electrochemical action of excitatory cells which are components of nerve, muscle and gland tissues. The electronic apparatus 100 measures a desired bio-signal using a sensor such as an electrode and then performs signal processing.

However, the bio-signal may be acquired through various parts of the user's body other than the user's face, and may include a signal sensed by physical movement of the user (hair rotation, nodding, etc.) other than the bio-signal in a broad sense.

The bio-signal as the bio-electric signal may be a signal including at least one of an Electromyogram (EMG) signal, an Electrooculogram (EOG) signal, an electroencephalogram (EEG) signal, an Electrocardiogram (ECG) signal, a Galvanic Skin Response (GSR) signal, and a bio-electrical impedance analysis (BIA) signal.

The EMG signal is a signal indicative of muscle movement and is an electrical signal generated by muscle movement of the user's face. The EMG signal is essentially measured from an electrical signal generated by physiological changes occurring in the sarcolemma. In the present disclosure, an EMG signal is an electrical signal generated primarily by muscle movements around the mouth, such as when the user speaks or bites. The bio-signal input 110 may receive electrical signals sensed from electrodes attached to the periphery of the eye (particularly below the eye) as EMG signals.

The EOG signal is an electrical signal generated by eye movement caused by a voltage difference between the user's cornea. There is a constant potential between the cornea (+) and the retina (-) of the eye, acting as a constant dipole. To measure this, the bio-signal inputter 110 may receive the electrical signals sensed from the electrodes attached to the left and right sides of the eye as an EOG signal. Specifically, when the user gazes ahead, a constant dipole is formed between the two electrodes, at which time the output becomes zero (0). When the user gazes to the left, the + component is output. When the user gazes right, a-component is output. Thus, the + and-components vary according to the polarity of the electrode and the direction of motion. The EOG signal may also be used to measure flicker of the user's eyes. Electrodes were attached to the upper and lower sides of one eye and then measurements were taken.

EEG signals are electrical signals that are generated when signals are sent between the nervous system and cranial nerves. EEG signals differ according to mental and physical states, and are the most important indicators for measuring the activity state of the brain. The EEG signal is typically sensed by electrodes attached to the scalp, and the bio-signal inputter 110 may receive the electrical signal sensed from the electrodes attached to the forehead as the EEG signal.

The ECG signal is an electrical signal generated by the contraction and relaxation of the heart and is the most representative biological signal that can be easily and quickly measured on the body surface. Cardiac motion is expressed in beats per minute (bpm) and changes in the autonomic nervous system can be observed by changes in heart rate. An ECG signal may also be measured on the face of the user, and the bio-signal inputter 110 may receive electrical signals sensed from electrodes attached to various sites as the ECG signal.

The GSR signal is a signal that is generally used as an indicator of emotional state, and is a biological signal for measuring the resistance of the skin. For example, in a general arousal state (arousal state), the resistance of the skin decreases, and the GSR signal may indicate the degree of resistance change of the skin according to such characteristics. That is, the GSR signal is related to the activity of sweat glands.

The BIA signal is a signal measured by using a method of flowing an alternating current to the extent that it does not harm the body, and is a biological signal that can measure the amount of water in the body. The basic principle of BIA is to estimate body composition using resistance measured when a weak alternating current flows through the body, using the characteristic that current flows along a portion having the highest conductivity. The body fat tissue containing a large amount of water has low electrical resistance and excellent electrical conductivity, while the body fat tissue containing a small amount of water has low electrical conductivity and high electrical resistance, which is reflected in the BIA signal.

However, the bio-signal may include various bio-signals other than the above-described signals.

In addition, the bio-signal inputter 110 may further include an electrostatic discharge (ESD) prevention circuit (not shown) for preventing an electrostatic discharge phenomenon.

In another aspect, the bio-signal may be sensed by an electrode. The bio-signal inputter 110 may receive the bio-signal sensed from the at least one electrode by wire or wirelessly. According to an embodiment, the electrode for sensing a bio-signal may be included in the electronic device 100 or may be configured separately from the electronic device 100.

In particular, in embodiments where the electronic device 100 of the present disclosure is implemented as an integrated HMD device 100A, at least one electrode may be included in the bio-signal input 110. In an embodiment in which the electronic apparatus 100 of the present disclosure is implemented as the removable HMD apparatus 200 and the separate portable terminal apparatus 100B, at least one electrode is included in the removable HMD apparatus 200, and the bio-signal inputter 110 may receive a bio-signal sensed from the electrode included in the removable HMD apparatus 200 by wire or wirelessly.

On the other hand, Ag/AgCl electrodes, which are generally used for measurement of biological signals, have good signal transmission, but cannot be reused, and may have various side effects. Thus, the electrodes of the present disclosure may not use an electrolyte between the skin and the electrode, but may use a dry electrode made of a metal such as stainless steel or copper. Dry electrodes convert biopotential signals generated by ions in the body into electrical signals.

On the other hand, the electrodes may include an electrode for sensing a specific single kind of bio-signal, an electrode for sensing a plurality of kinds of bio-signals (hereinafter, referred to as a common electrode), a reference electrode, a ground electrode, and the like. The reference electrode may be spaced apart from the ground electrode to contact the body. The reference electrode and the ground electrode may be configured as the same electrode configuration circuit. In the embodiments of the present disclosure, it is assumed that the reference electrode and the ground electrode are used as the same electrode for convenience. Each electrode needs to sense a biological signal around the user's eye (as a location where the electronic device 100 is fixedly mounted). Thus, the electronic device 100 implemented as the integrated HMD device 100A or the removable HMD device 200 may be disposed at contact locations around the eye, and may be disposed at different locations for each bio-signal to be sensed. The attachment position and function of each electrode will be described later with reference to fig. 3.

On the other hand, the processor 120 is a configuration for controlling the overall operation of the electronic apparatus 100.

In particular, the processor 120 may determine the bio-signal to be input based on the context of the electronic device 100. Here, the context of the electronic apparatus 100 refers to a current internal/external use condition of the electronic apparatus 100, and may specifically include contexts such as: a current geographical location or a relative location with respect to a specific object of the electronic device 100, a current time and a relative time based on a specific point in time, weather, a current operating state of the user, or biometric information of the user determined by a biometric signal, etc.

Further, the context may include a screen state and a usage history of the display 131 included in the electronic device 100. The screen state of the display 131 may include information on a currently running application or content being displayed, and information on a change of the screen. The usage history may include information about applications or displayed contents that have been run from the past to the present.

The electronic apparatus 100 may further include various sensors (an acceleration sensor, a gyro sensor, a geomagnetic sensor, a temperature sensor, and the like) for determining a context, and a communication module for receiving information from an external server through a network including the internet and the like.

The processor 120 may determine the type of bio-signal to be input based on the determined context. For example, when user authentication is required to use a specific application in the electronic apparatus 100, a screen requesting user authentication may be displayed on the display 131. User authentication may be required when unlocking the electronic device 100, logging into a particular website, viewing particular content, or using electronic payment, etc.

At this time, user authentication may be performed by muscular movement of the face (particularly, muscular movement around the mouth) corresponding to the utterance of a specific word or sentence, and in this case, it is necessary to sense the EMG signal. When the determined context is determined to be "user authentication", the processor 120 may determine the EMG signal around the mouth of the user as the bio-signal to be input.

Specifically, at this time, the processor 120 may determine the biological change through a channel corresponding to at least one electrode corresponding to a specific body part according to a context of the electronic device 100 among the electrodes for sensing the determined EMG signal. For example, in the context of sensing motion according to the shape of the mouth spoken by the user, the processor 120 may control sensing of EMG signals by electrodes attached around the mouth of the user.

Further, after user authentication is performed in the electronic apparatus 100, a navigation screen such as: a main screen for selecting a specific application, a selection screen for selecting a specific content, a screen for moving a cursor or a screen, and the like. At this time, navigation may be performed by the movement of the pupil moving up and down and left and right, and in this case, it is necessary to sense an EOG signal. When the determined context is determined to be "navigation", the processor 120 may determine the EOG signal as a bio-signal to be input.

On the other hand, when the type of bio-signal to be input is determined, a channel corresponding to an electrode (hereinafter, referred to as a target electrode) for sensing the determined type of bio-signal may be selected, a state of the channel corresponding to the selected electrode may be set according to the determined type of bio-signal, and a bio-change may be determined by using the bio-signal input according to the set state of the channel.

In particular, embodiments may be assumed in which the electrodes comprise a first electrode for sensing a first bio-signal and a second electrode for sensing a second bio-signal. At this time, when the determined bio-signal is the first bio-signal, the processor 120 may select the channel corresponding to the first electrode as a channel to receive the bio-signal, and set the state of the channel corresponding to the first electrode based on the characteristic of the first bio-signal. When the determined bio-signal is the second bio-signal, the processor 120 may select the channel corresponding to the second electrode as the channel to receive the bio-signal and set the state of the channel corresponding to the second electrode based on the characteristic of the second bio-signal.

In this case, the first electrode may be an electrode for sensing an EOG signal at the left, right, and upper sides of the user's eyes. Furthermore, the second electrode may be an electrode for sensing EMG signals on the underside of the user's eye.

For example, when the type of bio signal to be input is determined as the EOG signal, the processor 120 may set a sampling rate, an ADC (analog-to-digital converter) resolution, a cutoff frequency, and the like of a channel corresponding to a target electrode for sensing the EOG signal according to the characteristics of the EOG signal. Accordingly, other bio-signals (EMG signals, ECG signals, etc.) sensed by the target electrode for sensing the EOG signal may be removed.

The processor 120 may determine a biological change (movement of the pupil or movement of facial muscles) using a biological signal input from the target electrode according to the setting state of the channel.

Further, the processor 120 may control the screen of the display 131 according to the determined biological change. For example, when the determined biological change is a movement of a pupil or a blink of an eye using the EOG signal, the processor 120 may select a menu or an icon or perform a navigation operation according to the movement of the pupil or the blink of the eye. Further, when the determined biological change is a muscle movement using the EMG signal, the processor 120 may determine a mouth shape of the user, perform user authentication, or determine a face movement such as blinking of a eye according to the movement of the muscle.

Further, when the bio-signal to be input is determined, the processor 120 may activate only the channel corresponding to the electrode for sensing the determined bio-signal and deactivate the channels other than the channel corresponding to the electrode for sensing the determined bio-signal, and thus may reduce waste of power consumed by the unused electrode.

Fig. 2b is a detailed block diagram showing a configuration of the electronic apparatus 100 according to another embodiment of the present disclosure.

It is assumed that fig. 2B is an example in which the electronic apparatus 100 implemented as the portable terminal apparatus 100B is attached to the removable HMD apparatus 200 and implemented. In addition to the bio-signal input 110 and the processor 120, the electronic device 100 further includes an output 130, a memory 140, and a sensor unit 150. The description already provided in fig. 2a will be omitted.

The removable HMD device 200 includes a sensor unit 210 for sensing a bio-signal of a user, an inputter 220 for receiving a user input, a communicator 230 for communicating with the electronic device 100, and a memory 240.

The bio-signal inputter 110 of the electronic apparatus 100 is a configuration that receives the sensed bio-signal from the removable HMD apparatus 200. As shown in fig. 2B, when the electronic apparatus 100 is implemented as the portable terminal apparatus 100B attached to the removable HMD apparatus 200, the bio-signal inputter 110 may include a communication module for performing communication with the removable HMD apparatus 200 by wire and wirelessly. The communication with the removable HMD device 200 using the communication module may be performed in various ways. The communication between the electronic device 100 and the removable HMD device 200 may be performed in at least one of NFC, Wi-Fi direct, Zigbee, and bluetooth.

The outputter 130 is a configuration that outputs at least one of an image signal and a sound signal. The outputter 130 may include a display 131 for outputting an image signal, and may further include an audio outputter 132 for outputting a sound signal.

The display 131 is a configuration for providing a screen including various contents that can be reproduced by the electronic apparatus 100. Here, the content may include content in various formats such as text, images, moving images, GUI (graphical user interface), and the like. Specifically, the content may be implemented as VR (virtual reality) content for providing a 3D image.

The implementation method of the display 131 is not limited. For example, the display 131 may be implemented as various forms of displays such as an LCD (liquid crystal display), an OLED (organic light emitting diode) display, an AM-OLED (active matrix organic light emitting diode), a PDP (plasma display panel), and the like. Depending on its implementation, display 131 may additionally include additional configurations. For example, when the display 131 is a liquid crystal type, the display 131 includes an LCD display panel (not shown), a backlight unit (not shown) for supplying light thereto, and a panel driving substrate (not shown) for driving the panel (not shown).

The audio outputter 132 may be implemented as a speaker that outputs audio data (sound signals) processed by the electronic apparatus 100.

The processor 120 may control the display 131 or the audio outputter 132 to output the result according to the determined biological change. That is, the processor 120 may control the sound output through the screen of the display 131 or the audio outputter 132 according to the determined biological change.

Further, the processor 120 may determine the wearing state of the removable HMD apparatus 200 based on the bio-signal sensed by the user through the electrode for sensing the wearing state of the removable HMD apparatus 200, and control the outputter 130 to output the result according to the determination. For example, when the wearing state of the electronic device 100 is defective, the processor 120 may output a warning message or warning alarm for correctly wearing the removable HMD device 200.

At this time, when a signal of a threshold value or less is detected from at least one electrode for sensing a wearing state of the removable HMD apparatus 200 by the user, the processor 120 may determine that the removable HMD apparatus 200 is in a non-wearing state and disable channels corresponding to electrodes other than the at least one electrode for sensing wearing of the removable HMD apparatus 200.

The memory 140 may store an O/S (operating system) software module for driving the electronic apparatus 100, and various data such as various multimedia contents including VR contents.

The sensor unit 150 includes first to nth sensors 151-1 to 151-n for sensing various operations performed in the electronic device 100 and a sensor controller 152 for controlling the first to nth sensors 151-1 to 151-n. For example, the plurality of sensors 151-1 to 151-n included in the sensor unit 150 may include a motion sensor (not shown) for sensing a motion of the electronic apparatus 100, as a sensor for user authentication, an iris recognition sensor (not shown) for recognizing an iris of a user, a fingerprint recognition sensor (not shown) for recognizing a fingerprint, various sensors for sensing surrounding environments (atmospheric pressure, temperature, humidity, illumination), user gestures, and the like.

The motion sensor may include at least one of an acceleration sensor, a geomagnetic sensor, and a gyro sensor. Various sensors included in the motion sensor may sense three-dimensional (3D) motion of the electronic device 100 by one or a combination of two or more of the sensors.

The acceleration sensor is a sensor that measures spatial motion of the electronic device 100. That is, the acceleration sensor refers to a sensor that senses an acceleration change and/or an angular acceleration change occurring when the electronic apparatus 100 is moved. The acceleration sensor may sense acceleration in three-axis directions. In addition, the acceleration sensor may sense the tilt of the electronic device 100.

The geomagnetic sensor is a sensor that measures an azimuth angle. That is, the geomagnetic sensor refers to a sensor that measures an azimuth angle by sensing a magnetic field formed in a north-south direction of the earth. The geomagnetic sensor may sense geomagnetism in three-axis directions. The north direction measured by the geomagnetic sensor may be magnetic north. However, even if the geomagnetic sensor measures the direction of magnetic north, the direction of true north can be output by internal calculation.

The gyro sensor is an inertial sensor that measures a rotational angular velocity of the electronic apparatus 100. That is, the gyro sensor refers to a sensor that can recognize a current direction by using an inertial force of a rotating object. The gyro sensor can measure rotational angular velocities in the biaxial directions.

The motion sensor may sense the motion of the electronic device 100 and identify a direction, a rotational angular velocity, etc. of the motion of the electronic device 100.

The sensor controller 152 is a configuration that centrally controls the first to nth sensors 151-1 to 151-n, and serves as a sensor hub. According to the embodiment, when the electronic apparatus 100 operates in a sleep mode such as a standby mode or a power saving mode, power supplied to the controller 120 is limited, and a minimum amount of power may be supplied to the sensor unit 150, so that sensing may be continuously performed by the sensor module even in the sleep mode state. That is, the sensor controller 152 may determine the context of the electronic device 100 based on the signals sensed by the sensors 151-1 to 151-n and wake up the controller 120. When the controller 120 wakes up, the sensor controller 152 may send a control signal to the removable HMD device 200 to sense the determined bio-signal based on the determined context.

Meanwhile, the sensor unit 210 of the removable HMD apparatus 200 may include a plurality of electrodes for sensing a user bio-signal. As described with reference to fig. 2a, the plurality of electrodes may include electrodes for sensing various biological signals such as EMG signals, EOG signals, EEG signals, ECG signals, GSR signals, and BIA signals. A plurality of electrodes may be attached to a pad (pad) portion of the removable HMD device 200 that contacts the user's skin, and may be attached at appropriate locations depending on the type of bio-signal to be sensed by each electrode on the pad.

The inputter 220 is a configuration that receives various inputs of a user, and may include physically implemented buttons, a touch pad, and the like. For example, the inputter 220 may include a call button, a brightness control button, a volume control button, and the like, and may be associated with content displayed on the electronic device 100 to receive input of functions of reproducing the content, controlling the content, and the like.

The communicator 230 is a configuration to perform wired/wireless communication with the electronic apparatus 100. The structure and function of the communicator 230 are redundant with respect to the structure and function of the communication module included in the bio-signal inputter 110 of the electronic device 100, and thus a detailed description thereof is omitted.

The memory 240 is a configuration that stores the bio-signal sensed by the sensor unit 210. The processor 250 may control the memory 240 to store the bio-signals sensed through the electrodes so that a plurality of bio-signals are received through one electrode. The processor 250 may transfer the stored bio-signals to different filters and receive bio-signals corresponding to the respective filters.

The processor 250 is a configuration that generally controls the removable HMD apparatus 200. The processor 250 may remove noise by filtering the bio-signal sensed by the sensor unit 210 and determine whether the user wears the removable HMD apparatus 200 or whether the user properly wears the removable HMD apparatus 200 based on characteristics of the sensed bio-signal. Here, whether the user wears the HMD apparatus 200 may be determined based on the above-described various types of bio-signals, and is not particularly limited, but may be determined using EMG signals.

When it is determined that the user wears the removable HMD device 200, the processor 250 may send a wake-up signal to the electronic device 100 in the sleep mode. Alternatively, when it is determined that the wearing state of the removable HMD apparatus 200 of the user is defective, the processor 250 may transmit a signal notifying that the user is not wearing correctly (in this case, the removable HMD apparatus 200 may include an LED or a speaker that may provide a predetermined notification to the user), or transmit a signal to the electronic apparatus 100 to output a signal notifying that the user is not wearing correctly.

Further, the processor 250 may measure the signal quality of the bio-signal sensed by the sensor unit 210, and may transmit a control signal for outputting a warning indicating that the signal quality sensed by the specific electrode is defective to the electronic device 100 based on the measured signal quality. Alternatively, the processor 250 may output a warning indicating that the signal quality sensed by a particular electrode is defective by an LED or speaker provided to the removable HMD device 200.

Meanwhile, fig. 2B shows the configuration and operation of the electronic apparatus 100 and the removable HMD apparatus 200 when the electronic apparatus 100 is implemented as the portable terminal apparatus 100B. However, even when the electronic apparatus 100 is implemented as the integrated HMD apparatus 100A, a person skilled in the art can easily change the design to apply the above-described operation.

For example, when the electronic apparatus 100 is implemented as the integrated HMD apparatus 100A, the configuration and operation of the sensor unit 210 included in the removable HMD apparatus 200 may be integrated into the sensor unit 150 of the electronic apparatus 100, and the input/output module 220 will be included in the electronic apparatus 100. The memory 240 may be integrated into the memory 140 of the electronic device 100, and the communication module included in the communicator 230 and the bio-signal inputter 110 may be omitted. The operations of processor 250 may be integrated into the operations of processor 120 of electronic device 100.

Fig. 3 is a diagram for explaining each electrode for sensing a bio-signal according to an embodiment of the present disclosure.

Fig. 3 is a front view of the electronic apparatus 100 implemented as the integrated HMD apparatus 100A or the removable HMD apparatus 200, as viewed from the wearing side. As shown in fig. 3, electrodes 31-1, 31-2 and 32 for sensing EOG signals, electrodes 33-1 and 33-2 for sensing EMG signals, and a reference electrode 34 may be provided on the pad 30 in contact with the wearer's face around the eyes.

Basically, a pair of electrodes 31-1 and 31-2 may be attached to the left and right sides of the eye to sense an EOG signal. Since each of the electrodes 31-1 and 31-2 calculates one electrode change, the pair of electrodes 31-1 and 31-2 can specify only the left-right direction. Therefore, in order to set the direction of the eyeball, it is necessary to set up two directions of up and down and left and right. Thus, at least one electrode 32 may be additionally provided on the pad 30 to attach to the lower end of the eye. Thus, the processor 120 may specify the left-right direction of the eye using a pair of electrodes 31-1 and 31-2 attached to the left and right sides of the eye, and specify the up-down direction of the eye using a pair of electrodes 31-1 and 32 attached to the right and lower sides of the eye or a portion of the electrodes 31-2 and 32 attached to the left and lower sides of the eye. However, at least one electrode (not shown) may be additionally provided on the pad to be attached to the upper end of the eye, and the processor 120 may specify the up-down direction of the eye using a pair of electrodes 32 additionally provided on the upper end of the eye and the lower end of the eye.

On the other hand, a pair of electrodes 33-1 and 33-2 for sensing EMG signals may be attached to the lower ends of both eyes. One electrode was attached to one muscle and one value was calculated. The processor 120 may store the intensity of the movement of each muscle for each muscle based on the intensity of the electricity and convert the magnitude of the sensed EMG signal.

The electrodes 33-1 and 33-2 for sensing EMG signals may be annularly provided around the pad 30, and the electrodes 33-1 and 33-2 may sense the movement of muscles present in the entire face. Specifically, electrodes 33-1 and 33-2 for sensing EMG signals may be provided on the pad 30 attached to the lower ends of both eyes in order to sense the movement of muscles mainly changing the shape of the face around the eyes and around the cheekbones, respectively.

Meanwhile, in order to sense the EMG signal, a reference electrode 34 may be additionally provided, and a difference of a signal sensed through both electrodes 33-1 and 33-2 and a signal sensed through the reference electrode 34 may be used as the EMG signal. The reference electrode 34 may be located on a pad 30 attached to the central region of the upper portion of both eyes. However, when a pair of electrodes for sensing an EMG signal is additionally provided and a bipolar (bi-polar) for sensing an EMG signal using a potential difference of an adjacent electrode pair is used, the reference electrode 34 may not be needed.

Fig. 4 is a diagram for explaining a common electrode for sensing bio-signals according to another embodiment of the present disclosure.

The electrodes according to embodiments of the present disclosure may also include common electrodes 36-1 and 36-2 for sensing any one of the bio-signals in the EOG signal and the EMG signal that is determined based on the context of the electronic device 100. When the type of bio-signal to be sensed is determined, the processor 120 may select the channels corresponding to the common electrodes 36-1 and 36-2 as the channels receiving the determined bio-signal and set the state of the channels corresponding to the common electrodes 36-1 and 36-2 based on the characteristics of the determined bio-signal. Specifically, the processor 120 may adjust a sampling rate and an ADC resolution for sensing the bio-signal according to the determined bio-signal, and pass the signals sensed from the common electrodes 36-1 and 36-2 through any one of a filter for filtering the EOG signal and a filter for filtering the EMG signal to separate the EOG signal and the EMG signal.

The electronic device 100 implemented as the integrated HMD device 100A or the removable HMD device 200 may include at least one common electrode. Fig. 4 shows an example in which a pair of common electrodes 36-1 and 36-2 are provided at positions of the pad 30 attached to the lower ends of both eyes.

Each pair of electrodes 31-1, 31-2, 35-1 and 35-2 for sensing an EOG signal may be provided on the left and right sides of both eyes and the upper ends of both eyes.

The common electrodes 36-1 and 36-2 of fig. 4 may be used as electrodes for sensing EMG signals or electrodes for sensing EOG signals, depending on the context of the electronic device 100. For example, when the context of the electronic device 100 is determined to be "navigation," the processor 120 may determine that the type of bio-signal to be input is an EOG signal. At this time, the processor 120 may determine the left-right direction of the eyes by using the pair of common electrodes 36-1 and 36-2, and determine the up-down direction of the eyes by using any one of the pair of common electrodes 36-1 and 36-2 and any one of the electrodes 35-1 and 35-2 at the upper ends of both eyes.

Further, when the context of the electronic device 100 is determined to be "user authentication", the processor 120 may determine that the type of the bio-signal to be input is an EMG signal. At this time, the processor 120 may determine the movement of the facial muscles by using the pair of common electrodes 36-1 and 36-2 and the reference electrode 34.

That is, the common electrodes 36-1 and 36-2 are electrodes commonly used for sensing an EOG signal or sensing an EMG signal according to the context of the electronic apparatus 100. The common electrodes 36-1 and 36-2 may be used with the other electrodes 31-1, 31-2, 33-1, 33-2, 34, 35-1, and 35-2 to sense bio-signals, as the context dictates.

Meanwhile, the processor 120 may set the states of the channels corresponding to the common electrodes 36-1 and 36-2 according to the characteristics of the bio-signal. Specifically, as described above, the processor 120 may set the sampling rate, the cutoff frequency, the ADC resolution, etc. of the channels corresponding to the common electrodes 36-1 and 36-2 according to the characteristics of the determined bio-signals, and receive only the electrical signals with respect to the determined bio-signals.

A specific input process of the bio-signal will be described in detail with reference to fig. 5.

Fig. 5 is a diagram for explaining a per-signal-flow process in an electronic device according to an embodiment of the present disclosure.

The embodiment shown in fig. 5 illustrates a process of inputting and processing bio-signals sensed from a plurality of electrodes 211 provided in the removable HMD apparatus 200 to the electronic apparatus 100 mounted on the removable HMD apparatus 200.

The bio-signals sensed from the plurality of electrodes 211 are transmitted to the electronic device 100 through the channels 41-1 to 41-n corresponding to the respective electrodes 211. The EMG signal is converted to a digital signal via an analog-to-digital converter (ADC) 214. Accordingly, the removable HMD device 200 includes (i) an analog front end for processing the analog signal from the ADC214 and (ii) digital circuitry for processing the digital signal converted from the analog signal.

The analog front end includes the operation of the sensor unit 210. Specifically, the analog front end includes the operations of: an electrode 211 for sensing a bio-signal, an amplifier AMP 212 for amplifying the sensed bio-signal, an HPF (high pass filter)/LPF (low pass filter) 213 for removing noise of the amplified bio-signal, and an ADC214 for converting the noise-removed bio-signal into a digital signal. The digital circuit is a configuration for processing the bio-signal converted into the digital signal, and includes a processor 250 for performing filtering through an HPF (high pass filter)/LPF (low pass filter) 213 and a communicator 230 for transmitting the filtered digital bio-signal to the electronic device 100. In the embodiment shown in fig. 5, the processor 250 is implemented as an MCU (microcontroller unit).

For example, when the bio-signal is an EMG signal, in fig. 3, a potential difference between a voltage of the EMG signal sensed by the right facial muscle of the user and a reference voltage sensed by the reference electrode 34 may be detected by the electrodes 33-1 and 33-2 for sensing the EMG signal. The EMG signal including the detected potential difference may be amplified by an amplifier AMP 212 provided in the removable HMD device 200. The noise of the amplified EMG signal may be removed by the HPF/LPF213 provided in the removable HMD device 200. Here, the HPF may remove noise of the DC component from the amplified EMG signal, and the LPF may remove noise other than the DC component from the amplified EMG signal.

The noise-removed EMG signal is converted into a digital signal via the ADC214, subjected to high-pass and low-pass filtering in the MCU 250, transmitted to the communicator 230, and transmitted in real time to the communicatively connected electronic device 100.

The processor 120 may select a channel corresponding to the target electrode or the common electrode from among the plurality of channels 41-1 to 41-n as a channel to receive the determined bio-signal, and set a state of the channel corresponding to the target electrode or the common electrode based on a characteristic of the determined bio-signal.

Specifically, when a bio-signal to be input is determined based on the context of the electronic device 100, the processor 120 may transmit information about the determined bio-signal to the removable HMD device 100 through the communication module included in the bio-signal inputter 110. At this time, the communication methods of the bio-signal inputter 110 of the electronic apparatus 100 and the communicator 230 of the removable HMD apparatus 200 may be performed by wire or wirelessly.

In an embodiment in which the communication between the bio-signal inputter 110 of the electronic device 100 and the communicator 230 of the removable HMD device 200 is performed wirelessly, at least one method of NFC, Wi-Fi direct, Zigbee, and bluetooth may be implemented to perform the communication, and other various wireless communication methods may be implemented to perform the communication.

In an embodiment in which the communication between the bio-signal input 110 of the electronic device 100 and the communicator 230 of the removable HMD device 200 is performed by wire, various methods including a method of Universal Asynchronous Receiver/Transmitter (UART) may be implemented to perform the communication.

When the communicator 230 of the removable HMD apparatus 200 receives information on a bio-signal determined according to context from the bio-signal inputter 110 of the electronic apparatus 100, the MCU 250 determines whether a type of the determined bio-signal is determined, and selects a channel corresponding to the target electrode for sensing the corresponding bio-signal according to the determined type of the bio-signal. Then, the MCU 250 may control the HPF/LPF213, the ADC214, and the like such that at least one of a sampling rate, an ADC resolution, and a cutoff frequency for the bio-signal received through the selected channel is set according to the determined characteristics of the bio-signal. That is, the MCU 250 may control the sensor unit 210 to perform software filtering.

The ADC214 may transmit the bio-electric signal converted into the digital signal to the MCU 250 through only a selected channel according to the determined type of the bio-signal. Accordingly, the MCU 250 may selectively receive the sensed bio-signal through only a specific channel according to the context, not through all channels. That is, the MCU 250 may control the ADC214 to ignore signals received through channels other than the selected channel according to the context without processing the signals.

For example, when the bio-signal determined according to the context is the EOG signal, the processor 120 may control the bio-signal inputter 110 to transmit information that the determined bio-signal is the EOG signal to the communicator 230. When the communicator 230 receives the information, the MCU 250 may select a channel corresponding to a target electrode for sensing an EOG signal, and control the ADC214 to transmit only the EOG signal transmitted through the selected channel to the MCU 250. In addition, the MCU 250 may filter out the remaining signals except for the EOG signal from among the bio-signals transmitted through the selected channel by setting the sampling rate and the cutoff frequency of the bio-signal to be sensed to correspond to the amplitude and the period of the EOG signal.

In another embodiment, the MCU 250 may control power supplied to any one of the AMP 212, the HPF/LPF213, and the ADC214 such that the bio-signal is not transmitted through a channel other than the selected channel. That is, AMP 212, HPF/LPF213, and ADC214 may be powered on each channel.

That is, when a bio-signal to be input is determined, the MCU 250 may activate only a channel corresponding to an electrode for sensing the determined bio-signal and deactivate channels other than a channel corresponding to an electrode for sensing the determined bio-signal, thereby reducing waste of power consumed by an unused electrode.

Meanwhile, according to an embodiment of the present disclosure, the MCU 250 may measure an input state of a bio-signal, and may change a channel to which the bio-signal is to be input according to the measured input state of the bio-signal. Specifically, the MCU 250 may determine a contact state or an impedance value of the target electrode with respect to a site (site) where the bio-signal is to be sensed, and may change the target electrode to another electrode for measuring the same type of bio-signal when it is determined that the contact state of the target electrode is defective (e.g., when the magnitude of the bio-signal to be sensed is greatly greater than a predetermined value), or when the impedance value is measured to be higher than a predetermined value (e.g., when make-up is heavy on the face of the user). Even if there are a plurality of reference electrodes, the MCU 250 can change the reference electrode based on the contact state of the reference electrode or the impedance value of the BIA signal.

For example, referring to fig. 4, although a pair of electrodes 33-1 and 33-2 for sensing an EMG signal under the eye may be provided as target electrodes for sensing the EMG signal, when an input state of the EMG signal measured by any one of the electrodes 33-1 and 33-2 is in a defective state, the MCU 250 may change the target electrodes to receive the EMG signal from any one of the common electrodes 36-1 and 36-2 close to the defective electrode instead of the defective electrode. For example, the electrode at the lower end of the left eye of the pair of electrodes 33-1 and 33-2 and the common electrode at the lower end of the right eye of the pair of common electrodes 36-1 and 36-2 may be paired to receive the EMG signal according to the input state of the EMG signal.

Meanwhile, the input state of the bio-signal may be measured not only by using the impedance value of the bio-signal but also by using a signal-to-noise ratio (SNR), a Common Mode Rejection Ratio (CMRR), or the like.

Meanwhile, as described above, the embodiment shown in fig. 5 shows the electronic apparatus 100 and the removable HMD apparatus 200, and in an example in which the electronic apparatus 100 implemented as the portable terminal apparatus 100B is separated and implemented in the removable HMD apparatus 200, the above disclosure describes the operation of each of the electronic apparatus 100 and the removable HMD apparatus 200. However, even when the electronic apparatus 100 is implemented as the integrated HMD apparatus 100A, the technical idea shown in fig. 5 can be applied in the same manner. In this case, the operation of the MCU 250 of the removable HMD apparatus 200 of fig. 5 may be performed by the processor 120 of the electronic apparatus 100, and the communicator 230 of the removable HMD apparatus 200 for communicating with the electronic apparatus 100 may be omitted.

Hereinafter, an embodiment in which it is assumed that the electronic apparatus 100 of the present disclosure is an integrated HMD apparatus will be described unless otherwise specified. However, the technical ideas of the present disclosure described below can also be applied to a case where the electronic apparatus 100 of the present disclosure is implemented and realized as a removable HMD apparatus provided with a sensor and a separate portable terminal apparatus.

Fig. 6 is a diagram for illustrating an EOG signal and an EMG signal according to an embodiment of the present disclosure.

Fig. 6(a) shows a waveform of an EOG signal sensed in an electrode for sensing an EOG signal or a common electrode. Fig. 6(b) shows a waveform of an EMG signal sensed in an electrode for sensing an EMG signal or a common electrode.

Because the electrodes attached to the electronic device 100 are all located near the eye, the EMG signal shown in fig. 6(a) may comprise an EMG signal, and the EMG signal shown in fig. 6(b) may comprise an EOG signal.

At this time, the processor 120 may derive the waveform 62 of the EMG signal as shown in fig. 6(c) by subtracting the signal of (b) from the signal of (a). Meanwhile, the processor 120 may derive the waveform 61 of the EOG signal by subtracting the derived waveform 62 of the EMG signal from the signal of (a).

Fig. 7 is a flowchart briefly explaining a process of operating an electronic device according to an embodiment of the present disclosure.

The operation of the electronic device 100 may be largely divided into three steps. The method includes the steps of sensing a wearing state of the electronic device 100S 710, determining a signal quality of the sensed bio-signal S720, and processing the sensed bio-signal to perform an operation according to a biological change of the user S730.

In step S710, it is determined whether the electronic apparatus 100 is worn by the user and the wearing state is defective. The wearing state of the electronic device 100 may be determined from a bio signal sensed by an electrode of the electronic device 100 and input to the bio signal input 110, and in particular, may be determined using a BIA signal in the electrode. In order to sense the wearing state of the electronic device 100, the bio-signal inputter 110 may be supplied with a minimum amount of power for sensing a bio-signal. That is, the electronic apparatus 100 may operate in a sleep mode, and may switch to a normal mode (a state of normally supplying power) when a bio-signal is sensed.

In another embodiment, in a state where the electronic apparatus 100 is in the sleep mode, when a minimum amount of power is supplied to the sensor unit 150 and the motion of the electronic apparatus 100 is sensed by the sensor unit 150, power may be supplied to the bio-signal inputter 110 to receive the bio-signal.

On the other hand, the electronic device 100 may use characteristics of the bio-signals sensed from the electrodes of the specific location to determine whether the user wears the electronic device 100. When the user correctly wears the electronic device 100, the characteristics of the particular bio-signals sensed from the electrodes at the particular location may be stored in the memory 140. The characteristics of the specific bio-signal stored in the memory 140 and the characteristics of the currently sensed specific bio-signal may be compared to determine whether the electronic device 100 is worn and whether the wearing state of the electronic device 100 is defective.

When the wearing state of the electronic apparatus 100 is defective, the electronic apparatus 100 may output a warning message or warning alarm through the outputter 130 to correctly wear the electronic apparatus 100.

When the electronic device 100 is worn correctly, the quality of the bio-signal input through the bio-signal input 110 is determined in step S720. A state of a channel corresponding to each of the plurality of electrodes may be activated so that all bio-signals sensed from the plurality of electrodes included in the electronic device 100 may be received. Accordingly, the electronic device 100 may determine the quality of all signals sensed from the plurality of electrodes.

The electronic device 100 may compare the signals sensed from the plurality of electrodes with the normal signals sensed normally, and when the signal quality of a specific electrode is determined to be defective, output a warning to replace the electrode or sense a bio-signal through another electrode around the electrode whose signal quality is determined to be defective. In this case, the signal quality may be determined by an analysis of at least one of a signal-to-noise ratio (SNR), a magnitude of the amplitude of the signal current in the time domain, and a range of the signal current in the frequency domain.

On the other hand, in step S730, a bio-signal to be input is determined based on the current context of the electronic apparatus 100, and the determined bio-signal is received and processed. Specifically, the electronic apparatus 100 sets a state of a channel corresponding to an electrode for sensing the determined bio-signal according to the determined bio-signal, and determines a bio-change using the bio-signal input according to the set state of the channel. Various operations may be performed based on the determined biological change. The operation performed according to the biological change will be described in detail in the embodiment shown in fig. 9 to 12.

Fig. 8 is a detailed flowchart explaining a process of operating the electronic apparatus 100 according to an embodiment of the present disclosure.

First, in order to determine whether the electronic device 100 is worn, the electronic device 100 senses and receives a specific bio-signal through an electrode for sensing a wearing state of the electronic device 100 (S810). Here, the bio-signal to be sensed to determine whether the electronic apparatus 100 is worn may be an EMG signal, but is not necessarily limited thereto, and whether the electronic apparatus 100 is worn may be determined by various bio-signals. At this time, when the user lifts up the electronic device 100, the motion of the electronic device 100 may be sensed by the motion sensor 160 included in the electronic device 100 and a channel corresponding to an electrode capable of sensing EMG signals for determining whether the electronic device 100 is worn may be activated.

When it is determined that the electronic device 100 is worn (S820: Y), the electronic device 100 receives the bio-signals sensed from the electrodes and records the input bio-signals (S830). When it is determined that the electronic device 100 is not worn (S820: N), channels corresponding to some or all of the electrodes may be deactivated, thereby reducing power consumption due to activation of the electrodes.

Further, the electronic apparatus 100 may output a result of the determination regarding the wearing state of the electronic apparatus 100. When the wearing state is defective, the electronic apparatus 100 may output a message or a guidance voice indicating that the electronic apparatus 100 is not worn correctly. When the wearing state is good, the electronic apparatus 100 may output a message or a guidance voice indicating that the electronic apparatus 100 is worn correctly.

Thereafter, the electronic apparatus 100 measures the quality of the input bio-signal and determines whether the measured quality of the bio-signal is greater than or equal to an allowable level (S850). At this time, the measurement quality of the biosignal can be measured not only by using the impedance of the biosignal but also by using SNR, CMRR, or the like. When the measured value is greater than or equal to the predetermined threshold value, it may be determined that the quality is defective. Also, when the measured value is less than the predetermined threshold value, it can be determined that the quality is good.

When it is determined that the measured quality of the bio-signal is defective (S850: N), the electronic device 100 may output a warning message or a warning sound indicating that the electrode is defective through the outputter 130, or may replace a corresponding defective electrode of the bio-signal, of which the measured quality is defective, with another electrode in the vicinity to sense the bio-signal.

When it is determined that the measured quality of the bio-signal is good (S850: Y), the context of the electronic apparatus 100 is determined (S860). The electronic apparatus 100 determines a bio-signal to be input based on the determined context and activates a channel corresponding to an electrode for sensing the determined bio-signal (S880). The electronic apparatus 100 may process the bio-signal by setting a state of a channel corresponding to the electrode for sensing the determined bio-signal to a state suitable for receiving the determined bio-signal based on the context (S890). At this time, the electronic apparatus 100 may set a sampling rate, an ADC resolution, and a cutoff frequency of a channel corresponding to an electrode for sensing the determined bio signal.

Fig. 9 to 12 are diagrams for explaining the operation of the electronic device 100 according to various contexts according to an embodiment of the present disclosure.

Fig. 9 shows a case where the context of the electronic apparatus 100 is an environment in which a screen for user authentication is displayed.

According to the embodiment shown in fig. 9(a), electrodes 31-1, 31-2, and 35 for sensing an EOG signal, electrodes 33-1, 33-2, and 37 for sensing an EMG signal, a common electrode 36 for sensing both an EOG signal and an EMG signal, a reference electrode 34, and ground electrodes 38-1 and 38-2 may be provided on a pad 30 in contact with a face of the electronic device 100.

A pair of electrodes 31-1 and 31-2 attached around the left and right temples of both eyes, respectively, can sense the movement of the eyeball in the left and right directions.

Electrodes

35 and 36 attached to the upper and lower ends of the right eye, respectively, can sense the movement of the eyeball in the up-down direction. The common electrode 36 at the lower end of the right eye may sense both EMG and EOG signals, but the processor 120 may perform filtering to filter either EMG or EOG signals to selectively receive either EMG or EOG signals based on the context of the electronic device 100.

According to the embodiment shown in fig. 9(b), in the case where the electronic apparatus 100 is in the locked state, when the user wears the electronic apparatus 100 for the first time, a message "dock after unlock" is output. In the related art, there is an inconvenience that the user has to unlock the electronic device 100 and wear the electronic device 100 again according to such a message. However, in the present disclosure, the user may unlock the electronic device 100 by using the bio-signal of the user without removing the electronic device 100.

Specifically, the EOG signal and the EMG signal sensed from the plurality of electrodes, and a voice signal input through a microphone (not shown) included in the electronic apparatus 100 may be used to unlock the electronic apparatus 100. For example, as shown in fig. 9(b), the display 131 may display a message "say unlock" on the side of the screen requesting unlock. At this time, the processor 120 may control to unlock when the user says "unlock" while watching the message "say unlock".

Specifically, when a screen requesting user authentication (e.g., a lock screen, a payment screen, etc.) is displayed on the display 131, the processor 120 may determine an EOG signal for sensing the eyes of the user and an EMG signal for sensing the mouth shape of the user as bio-signals to be input based on the context of the electronic device 100 (user authentication). The processor 120 may activate channels corresponding to the electrodes 31-1, 31-2, 35, and 36 for receiving the EOG signal and channels corresponding to the electrodes 33-1, 33-2, and 37 for receiving the EMG signal according to the determined bio-signals and receive the bio-signals through the activated channels. The common electrode 36 may also be included as an electrode for receiving EMG signals. At this time, the EOG signal and the EMG signal sensed through the common electrode 36 may be separated from each other by filtering.

Thereafter, the processor 120 may unlock the screen when all of the following conditions are met: the user's eyes face a condition of "saying unlock" of a message displayed on one side of the screen by the EOG signal sensed from the electrodes 31-1, 31-2, 35, and 36 around both eyes (condition 1), a condition of "unlock" is recognized by the voice signal sensed by the microphone (condition 2), and a condition of "unlock" is spoken by the mouth shape matching the mouth shape of the user by the EMG signal sensed from the electrodes 33-1, 33-2, 36, and 37 around the mouth (condition 3).

Therefore, the screen can be unlocked only when the authenticated user wears the electronic device 100 and directly says "unlock". Accordingly, when the user reproduces the recorded voice without directly speaking, security can be enhanced by preventing the screen from being unlocked. Further, by sensing the EMG signal in a noisy environment and determining whether the user says "unlocked," the electronic device 100 may be utilized as an auxiliary device to a microphone for identifying the user.

Fig. 10 shows a case where the context of the electronic apparatus 100 is an environment in which a screen for recognizing a facial expression is displayed.

According to the embodiment shown in fig. 10(a), electrodes 33-1 and 33-2 for sensing EMG signals, common electrodes 36-1, 36-2, 39-1, 39-2, 40-1 and 40-2 for sensing both EOG signals and EMG signals, a reference electrode 34, and a ground electrode 38 may be provided on the pad 30 in contact with the face of the electronic device 100.

In a screen for recognizing a facial expression, a need for accurately recognizing a facial expression of a user increases. Therefore, each part of the face requires a large number of electrodes for sensing the EMG signal. Because the recognition of the facial expression includes recognition of the eyes of the user, common electrodes 36-1, 36-2, 39-1, 39-2, 40-1, and 40-2 for sensing both the EOG signal and the EMG signal may be provided on the locations of the pads 30 attached to the eyes.

Fig. 10(b) shows a screen displaying a facial expression recognition application for displaying a fish-tracking user facial expression by recognizing a change in the user's facial expression (eye direction and mouth movement). The expression of the fish including the pupil position or the mouth shape of the fish may be changed according to the change of the facial expression of the user. The change in the user's eyes may be sensed based on the movement of one eye or the movement of both eyes. When the change of the user's eyes is sensed according to the movement of one eye, the common electrodes 40-1 and 40-2 around the temple of both eyes and the common electrodes 36-1 and 39-2 or 36-2 and 39-2 attached to the upper and lower sides of any one of the eyes may be used to sense the change of the user's eyes.

Further, shortcut instructions based on the shape of the user's mouth may be stored in advance, and shortcut instructions corresponding to the shape of the user's mouth recognized through the electrodes 33-1, 33-2, 36-1 and 36-2 for sensing the EMG signal may be executed. That is, the user can use the electronic apparatus 100 in a hands free (hands free) manner. Here, the shortcut command may include "home" for displaying a home screen (basically a content selection screen displayed when an O/S of the electronic device 100 or a specific application is run), "return" for returning to a previous screen, "select" for selecting a specific menu or content, "volume" for adjusting volume, and the like. For example, the processor 120 may recognize a mouth shape that the user pronounces as "home" to display the home screen.

When a screen for performing recognition of a facial expression is displayed on the display 131 (e.g., running a facial expression recognition application, etc.), the processor 120 may determine an EMG signal for recognizing a facial expression of the user and an EOG signal for sensing eyes of the user as bio signals to be input based on a context of the electronic apparatus 100 (recognition of a facial expression). The processor 120 may activate a channel corresponding to an electrode for receiving the EOG signal and the EMG signal according to the determined bio-signal. In the embodiment shown in fig. 10(a), common electrodes 36-1, 36-2, 39-1, 39-2, 40-1 and 40-2 capable of sensing both EOG signals and EMG signals and electrodes for sensing a single kind of bio-signal, such as electrodes 33-1 and 33-2 for sensing EMG signals, may be utilized.

On the other hand, the processor 120 may track the user's head using a motion detection sensor included in the electronic device 100. When the head of the user rotates to the left, the EOG signal sensed from the motion of the left eye ball is greater than the EOG signal sensed from the motion of the right eye ball, and when the head of the user rotates to the right, the EOG signal sensed from the motion of the right eye ball is greater than the EOG signal sensed from the motion of the left eye ball.

Accordingly, the processor 120 may selectively receive the EOG signal corresponding to the left eye or the EOG signal corresponding to the right eye according to the rotation direction of the head of the user using the motion detection sensor. For example, when the user's head is turned left or right, the processor 120 may selectively activate the channels corresponding to the electrodes 36-1, 39-1, and 40-1 for sensing the EOG signal for the left eye or the channels corresponding to the electrodes 36-2, 39-2, and 40-2 for sensing the EOG signal for the right eye to determine the movement of the user's eyes by using only the EOG signal for one eye.

Meanwhile, according to the embodiment shown in fig. 11(a), the electrodes 32-1, 32-2, 33-1, 33-2, 41-1, 41-2, 42-1, and 42-2 for sensing EMG signals, the reference electrode 34, and the ground electrode 38 may be provided on the pad 30 in contact with the face of the electronic device 100.

As shown in fig. 11(b), when the facial expression recognition application is running on the display 131, the processor 120 may determine the EMG signal for recognizing the facial expression of the user as a bio-signal to be input based on the context of the electronic apparatus 100 (recognition of the facial expression). However, when it is necessary to sense the movement of the user's eyes during the recognition of the facial expression, the EOG signal may be additionally input using some electrodes around the eyes among the electrodes for sensing the EMG signal.

Specifically, even if the electronic apparatus 100 does not include the common electrode, when it is necessary to sense the movement of the user's eyes, the processor 120 may additionally receive the EOG signal by passing a signal input from any one of the electrodes for sensing the EMG signal through a filter corresponding to the EOG signal (a filter for passing only the EOG signal and filtering the remaining signals).

Here, when it is necessary to sense the movement of the user's eyes includes when it is necessary to accurately sense the movement of muscles around the user's eyes. For example, when a user blinks (an operation of closing one eye), a blink motion may not be accurately recognized using only an EMG signal. Therefore, in this case, by additionally receiving the EOG signal, the accuracy of recognition of the facial expression can be further improved. Further, when the user blinks both eyes, by using the additionally recognized EOG signal, it is possible to more accurately recognize whether the corresponding blink action is an unintentional blink or a conscious blink.

To this end, the processor 120 may separately store the signals (line data) sensed through the electrodes for sensing the EMG signals, pass the line data through a filter corresponding to the EOG signal, and additionally receive the EOG signal.

Meanwhile, fig. 11(a) shows an embodiment of sensing an EMG signal using the reference electrode 34 (an example of sensing a bio-signal by a unipolar (unipolar)), but the EMG signal may be sensed by using a potential difference of a pair of close electrode pairs (bio-signal by a bipolar sensing example) without the reference electrode 34. More specifically, for specific muscle sensing using a userMovement of the mouth (such as

Etc. the movement of the user's mouth when speaking), a method of sensing a bio-signal by a dipole may be used instead of a method of sensing a bio-signal by a monopole.

Meanwhile, according to the embodiment shown in fig. 12(a), electrodes 32-1, 32-2, 33-1, 33-2, 42-1, and 42-2 for sensing EMG signals, electrodes 43-1 and 43-2 for sensing EEG signals, a reference electrode 34, and ground electrodes 38-1 and 38-2 may be provided on the pad 30 in contact with the face of the electronic device 100.

The left electrode 43-1 for sensing the EEG signal and the right electrode 43-2 for sensing the EEG signal may sense the concentration/emotion signal occurring in the first front point of the forehead area (hereinafter referred to as fp1) and the second front point of the forehead area (hereinafter referred to as fp2), respectively.

When it is determined that the context of the electronic device 100 is currently a context requiring emotion recognition (e.g., a state in which an application capable of performing emotion recognition has been executed), the processor 120 may determine an EEG signal for recognizing the emotion of the user as a bio-signal to be input. The processor 120 may activate the channels corresponding to the electrodes 43-1 and 43-2 for sensing EEG signals and set the state of the activated channels to the appropriate state for receiving EEG signals.

Further, according to the embodiment shown in fig. 12(b), electrodes 44-1 and 44-2 for sensing a GSR signal, electrodes 45-1, 45-2, 46-1 and 46-2 for sensing a BIA signal, a reference electrode 48, and ground electrodes 38-1 and 38-2 may be provided on the pad 30 in contact with the face of the electronic device 100.

Further, when it is determined that the context of the electronic device 100 is currently a context requiring emotion recognition, the processor 120 may determine a GSR signal and a BIA signal for recognizing the emotion of the user as bio signals to be input. Processor 120 may measure changes in facial skin hydration level (hydration degree) via electrodes 44-1 and 44-2 for sensing GSR signals and measure the bioelectrical resistance of the facial skin via electrodes 45-1, 45-2, 46-1 and 46-2 for sensing BIA signals. To this end, processor 120 may activate channels corresponding to electrodes 44-1 and 44-2 for sensing the GSR signal and electrodes 45-1, 45-2, 46-1 and 46-2 for sensing the BIA signal, respectively, and set the state of each of the activated channels to the appropriate state for receiving the GSR signal and the BIA signal.

In addition, electrodes 47-1 and 47-2 for generating an Electrical Muscle Stimulation (EMS) signal may be additionally provided on the pad 30 in contact with the face of the electronic device 100 in order to apply electrical stimulation to the facial muscles. When it is determined that the context of the electronic device 100 is a context in which it is required to move a specific muscle of the face, the processor 120 may move the specific muscle of the face through the electrodes 47-1 and 47-2 for generating the EMS signal, thereby actively operating the electrodes.

Fig. 13 is a block diagram showing a detailed configuration of an electronic apparatus according to another embodiment of the present disclosure.

As shown in fig. 13, an electronic device 100' according to another embodiment of the present disclosure includes a bio-signal input 110, a processor 120, an output 130, a memory 140, a sensor unit 150, a communicator 160, an audio processor 170, a video processor 180, and a user interface 190. Hereinafter, a description overlapping with the description in fig. 2a will be omitted.

The processor 120 includes a ROM 121, a RAM 122, a CPU 123, a graphic processing unit 124, and first to nth interfaces 125-1 to 125-n. The ROM 121, the RAM 122, the CPU 123, the graphic processing unit 124, and the first to nth interfaces 125-1 to 125-n may be connected to each other via a bus 126.

The CPU 123 accesses the memory 140 and performs booting using the O/S stored in the memory 140. Then, the CPU 123 can perform various operations using various programs, contents, and data stored in the memory 140.

The ROM 121 stores a command set for starting the system and the like. When a turn-on command is input and power is supplied, the CPU 123 copies the O/S stored in the memory 140 to the ROM 122 according to instructions stored in the ROM 121, runs the O/S, and starts the system. When the startup is completed, the CPU 123 copies various application programs stored in the memory 140 to the RAM 122, runs the application programs copied to the RAM 122, and performs various operations.

The graphic processing unit 124 generates a screen including various objects such as icons, images, and texts using an operator (not shown) and a renderer (not shown). The operator calculates attribute values, such as coordinate values, shapes, sizes, colors, and the like, to be displayed by each object according to the screen layout. The renderer generates a screen including various layouts of the objects based on the attribute values calculated by the operator.

The first interface 125-1 through the nth interface 125-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device through a network.

Meanwhile, the above-described operation of the processor 120 may be performed by executing a program stored in the memory 140.

The display 131 is a configuration that provides a screen including various contents that can be reproduced in the electronic apparatus 100'. Here, the content may include content in various formats such as text, images, moving images, GUI (graphical user interface), and the like. In particular, the content may be implemented as VR content for providing 3D images.

The audio outputter 132 is a configuration that outputs audio processed by the audio processor 170.

The memory 140 may store O/S software modules for driving the electronic device 100' and various data such as various multimedia contents.

Specifically, the memory 140 may store a basic module for processing a signal transmitted from each hardware included in the electronic device 100', a storage module for managing a Database (DB) or a registry, a graphic processing module for generating a layout screen, a security module, and the like.

The sensor unit 150 is a configuration that senses various operations performed in the electronic device 100'. The specific configuration of the sensor unit 150 has already been described with reference to fig. 2b, and thus the description thereof is omitted below.

The communicator 160 is a configuration that performs communication with an external device according to various types of communication methods, and may be implemented separately from the bio-signal inputter 110. The communicator 160 may include a Wi-Fi chip, a bluetooth chip, a wireless communication chip, etc., and may perform communication with other electronic devices including a server.

The audio processor 170 is a configuration that performs processing on audio data, and the processed audio data is output through the audio outputter 132.

The video processor 180 is a configuration that performs various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the content.

The user interface 190 is a configuration that senses user interaction for controlling the overall operation of the electronic device 100'. The user interface 190 may include a microphone (not shown), a camera (not shown), and the like. The microphone is a configuration for receiving voice uttered from a user of the electronic apparatus 100 'or sound around the electronic apparatus 100'. The user interface 190 may perform an operation of voice recognition, or recording through a microphone.

First, a bio signal to be input is determined based on a context of the electronic device (S1410).

Thereafter, the state of the channel corresponding to the electrode for sensing the determined bio-signal is set according to the determined bio-signal (S1420). At this time, a channel corresponding to the electrode for sensing the determined bio-signal may be activated, and channels other than the channel corresponding to the electrode for sensing the determined bio-signal may be deactivated.

In another aspect, the electrodes may include a common electrode for sensing any one of a plurality of bio-signals determined based on a context of the electronic device. For example, the common electrode may be an electrode for sensing any one of an EOG signal and an EMG signal on the lower side of the user's eye. In this case, in step S1420, a channel corresponding to the common electrode may be selected as a channel to receive the determined bio-signal, and a state of the channel corresponding to the common electrode may be set based on the determined characteristic of the bio-signal.

In step S1420, based on the determined characteristics of the bio-signal, at least one of a sampling rate, an ADC resolution, and a cutoff frequency of a channel corresponding to the electrode for sensing the determined bio-signal may be set.

Further, the control method of the electronic device may measure the quality of the bio-signal first sensed through the electrodes, and determine the channel in which the bio-signal is input based on the measured quality of the bio-signal.

Then, a biological change is determined using a biological signal input according to a setting state of the channel (S1430). At this time, the biological change may be determined by a channel corresponding to at least one electrode corresponding to a specific body part according to a context of the electronic device.

Further, the control method of the electronic device may output the result according to the determined biological change. At this time, a screen of a display included in the electronic device may be controlled according to the determined biological change.

According to various embodiments of the present disclosure as described above, only channels of corresponding electrodes may be used to receive bio-signals that need to be sensed according to the context of an electronic device, and the states of the channels may be set according to the characteristics of the bio-signals that need to be sensed, and thus only desired bio-signals may be filtered, thereby reducing the amount of consumption and power consumption for sensing the desired bio-signals.

In addition, since various bio-signals can be sensed according to the context of the electronic device by using the common electrode, the number of necessary electrodes can be reduced, and thus the manufacturing cost can be reduced.

The control method according to the various embodiments described above may be implemented as a program and stored in various recording media. That is, a computer program that can be processed by various processors and can execute the various control methods described above can be stored and used in a recording medium.

For example, a non-transitory computer readable medium storing a program for performing the steps of: the method includes determining a bio-signal to be input based on a context of the electronic device, setting a state of a channel corresponding to an electrode for sensing the determined bio-signal according to the determined bio-signal, and determining a biological change using the bio-signal input according to the set state of the channel.

Non-transitory computer readable media are not media that store data for short periods of time, such as registers, caches, memory, and the like. But rather a medium that stores data semi-permanently and that can be read by a device. Specifically, the various applications or programs described above may be stored in a non-transitory computer readable medium, such as a CD, DVD, hard disk, blu-ray disc, USB, memory card, ROM, and the like.

Although embodiments of the present disclosure have been shown and described, the present disclosure is not limited to the specific embodiments described above, but various modifications may be made by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure as claimed in the claims. In addition, such modifications should also be understood to fall within the scope of the present disclosure.

Claims

1. An electronic device, comprising:

a bio-signal input configured to receive a bio-signal sensed through the electrode; and

a processor configured to:

determining a bio-signal to be received among a plurality of bio-signals based on a context of the electronic device,

activating a channel corresponding to an electrode for receiving the determined bio-signal,

deactivating channels corresponding to electrodes for receiving other than the determined bio-signals, an

Determining a biological change using a biological signal received through an activation channel corresponding to the electrode.

2. The electronic device of claim 1, wherein the electronic device,

wherein the electrodes comprise a common electrode for receiving first and second bio-signals of different kinds, the first and second bio-signals being determined based on a context of the electronic device;

wherein the processor is configured to set a state of a channel corresponding to a common electrode to a first state when the first bio-signal is determined and set a state of a channel corresponding to a common electrode to a second state when the second bio-signal is determined, based on the determined characteristic of the bio-signal;

wherein the difference between the first and second states relates to a sampling rate and an analog-to-digital converter, ADC, resolution for sensing the determined bio-signal.

3. The electronic device of claim 1, wherein the processor is configured to determine a biological change by a channel corresponding to at least one electrode corresponding to a particular body part according to a context of the electronic device.

4. The electronic device of claim 1, wherein the electronic device,

wherein the electrodes comprise a first electrode for sensing a first bio-signal and a second electrode for sensing a second bio-signal, an

Wherein the processor is configured to:

when the determined biosignal is a first biosignal, selecting a channel corresponding to the first electrode as a channel to receive the biosignal, and setting a state of the channel corresponding to the first electrode based on a characteristic of the first biosignal, an

When the determined bio-signal is a second bio-signal, a channel corresponding to the second electrode is selected as a channel to receive the bio-signal, and a state of the channel corresponding to the second electrode is set based on a characteristic of the second bio-signal.

5. The electronic device of claim 4, wherein the electronic device,

wherein the first electrode is used for sensing electrooculogram EOG signals of the left side, the right side and the upper side of the eyes of the user, and

wherein the second electrode is for sensing electromyographic EMG signals of a lower side of an eye of the user.

6. The electronic device of claim 1, wherein the electronic device,

wherein the electrodes comprise a common electrode for sensing any one of a plurality of bio-signals determined based on a context of the electronic device, an

Wherein the processor is configured to select a channel corresponding to the common electrode as a channel to receive the determined bio-signal, and set a state of the channel corresponding to the common electrode based on a characteristic of the determined bio-signal.

7. The electronic device of claim 6, wherein the common electrode is for sensing any one of an Electrooculogram (EOG) signal and an Electromyogram (EMG) signal of an underside of an eye of a user.

8. The electronic device of claim 1, wherein the bio-signal comprises at least one of an Electromyographic (EMG) signal, an Electrooculogram (EOG) signal, an electroencephalographic (EEG) signal, an Electrocardiographic (ECG) signal, a Galvanic Skin Response (GSR) signal, and a Bioelectrical Impedance Analysis (BIA) signal.

9. The electronic device of claim 1, wherein the processor is configured to set at least one of a sampling rate, an analog-to-digital converter (ADC) resolution, and a cutoff frequency of a channel corresponding to an electrode used to sense the determined bio-signal based on the determined characteristic of the bio-signal.

10. The electronic device of claim 1, further comprising: an output device for outputting the output signal of the display device,

wherein the processor is configured to control the output to output a result in accordance with the determined biological change.

11. The electronic device of claim 10, wherein the electronic device,

wherein the output includes a display, an

Wherein the processor is configured to control a screen of the display according to the determined biological change.

12. The electronic device of claim 11, wherein the electronic device,

wherein the context of the electronic device includes a display state of the display, an

Wherein the processor is configured to, when the screen of the display is a screen for requesting user authentication using a mouth shape when speaking, determine an electromyogram EMG signal around a mouth of the user as a bio-signal to be input, and determine a bio-change through a channel corresponding to an electrode for sensing the electromyogram EMG signal.

13. A control method for an electronic device for receiving bio-signals through electrodes, the control method comprising:

determining a bio-signal to be received among a plurality of bio-signals based on a context of the electronic device;

14. The control method according to claim 13, wherein,

wherein the control method includes setting a state of a channel corresponding to a common electrode to a first state when the first bio-signal is determined and setting a state of a channel corresponding to a common electrode to a second state when the second bio-signal is determined, based on the determined characteristic of the bio-signal;

15. The control method according to claim 13, wherein,

Wherein when the determined bio-signal is a first bio-signal, a channel corresponding to the first electrode is selected as a channel to receive the bio-signal and a state of the channel corresponding to the first electrode is set based on a characteristic of the first bio-signal, when the determined bio-signal is a second bio-signal, a channel corresponding to the second electrode is selected as a channel to receive the bio-signal and a state of the channel corresponding to the second electrode is set based on a characteristic of the second bio-signal.