WO2015159851A1 - Detection unit, eyewear, and ocular potential detection system - Google Patents

Abstract

In the present invention, a detection unit can be removably attached to an eyewear main body. The detection unit comprises: a pair of nose pads; a first electrode that is disposed on the surface of a first nose pad of the pair of nose pads and that detects the ocular potential of a wearer; a second electrode that is disposed at a position different from the first nose pad and that detects the ocular potential of the wearer; and a connector unit that attaches the detection unit to the eyewear main body and that outputs the ocular potential detected by the first electrode and by the second electrode to the eyewear main body.

Description

Detection unit, eyewear, and electrooculogram detection system

The present invention relates to a detection unit, eyewear, and an electrooculogram detection system.

An apparatus for measuring an electrooculogram or the like is known (see, for example, Patent Documents 1-3).
Patent Document 1 International Publication No. 2010/82496 Patent Document 2 Japanese Patent Publication No. Sho 61-166515 Patent Document 3 Japanese Patent Publication No. 2006-525829

If the electrode for detecting the electrooculogram or the like is not in close contact with the ocular potential detection target, the electrooculogram may not be measured accurately.

In the first aspect, the detection unit can be attached to and detached from the eyewear main body, provided on the surface of the first nose pad of the pair of nose pads and the pair of nose pads, and for detecting the electrooculogram of the wearer. The first electrode to be detected and the first nose pad are provided at different positions, the second electrode for detecting the electrooculogram of the wearer, the detection unit is attached to the eyewear body, the first electrode and the A connector unit that outputs the electrooculogram detected by the second electrode to the eyewear body.

The second electrode may be provided on the surface of the second nose pad of the pair of nose pads to detect the electrooculogram of the wearer.

A third electrode for detecting the electrooculogram of the wearer in contact with the wearer's eyebrow may be further provided.

The pair of nose pads, the third electrode, and the connector part may be provided so as to be positioned relative to each other on the face of the wearer according to the shape.

The second electrode may abut the wearer's eyebrow.

A nonvolatile storage unit that stores identification information for identifying a user of the detection unit may be further included, and the connector unit may further output the identification information stored in the storage unit to the eyewear body.

In the second aspect, the eyewear includes the detection unit described above and the eyewear body.

In the third aspect, the eyewear includes the detection unit described above and an eyewear body, and the eyewear body acquires the identification information stored in the storage unit from the detection unit, and performs the detection. A control unit configured to detect the electrooculogram by the first electrode and the second electrode when the identification information acquired from the unit matches predetermined identification information;

In a fourth aspect, the electrooculogram detection system receives the identification information through the detection unit and the eyewear main body, and based on the identification information received through the eyewear main body, the user of the detection unit And an electrooculogram information processing device for identifying.

Note that the above summary of the invention does not enumerate all the features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

An example of the utilization form of electrooculogram information processing system 10 in one embodiment is shown roughly. The glasses 100 and the smartphone 40 are schematically shown. A detection unit 102 is schematically shown. 3 is a cross-sectional view schematically showing a connection structure between a detection unit 102 and a bridge 124. FIG. The functional block configuration of the smart phone 40 and the functional block configuration of the processing unit 180 are schematically shown. The positional relationship between the electrooculogram detection electrode of the glasses 100 and the user 20 is schematically shown. 3 is a flowchart illustrating processing executed in the glasses main body 101.

Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

FIG. 1 schematically shows an example of a usage pattern of an electrooculogram information processing system 10 according to an embodiment. The electrooculogram information processing system 10 includes glasses 100 and a smartphone 40.

User 20 is a user of each of glasses 100 and smartphone 40. The user 20 is a wearer who wears the glasses 100. The smartphone 40 is an example of an information processing apparatus that processes information such as electrooculogram.

The glasses 100 are worn on the face of the user 20. The glasses 100 have a function of communicating with the smartphone 40. The glasses 100 detect the electrooculogram of the user 20 via the electrode that contacts the user 20, and transmit the detected electrooculogram information to the smartphone 40. Further, the glasses 100 detect the acceleration of the glasses 100 and transmit the detected acceleration information to the smartphone 40. Further, the glasses 100 detect the angular velocity of the glasses 100 and transmit information on the detected angular velocity to the smartphone 40.

The smartphone 40 analyzes the electrooculogram received from the glasses 100. The smartphone 40 analyzes the electrooculogram received from the glasses 100 together with at least one of acceleration and angular velocity received from the glasses 100. The smartphone 40 provides information to the user 20 based on analysis results such as electrooculogram, acceleration, and angular velocity.

For example, the smartphone 40 identifies the state of the user 20 by analyzing the electrooculogram, acceleration, angular velocity, and the like. Specifically, the smartphone 40 analyzes the electrooculogram and identifies the user's 20 line-of-sight direction, the blink state, and the like. For example, the smartphone 40 determines the state of the user 20 based on the line-of-sight direction and the blink state. Specifically, the smartphone 40 determines whether the user 20 is tired or painful based on the line-of-sight direction and the blink state. The smartphone 40 issues a warning to the user 20 when determining that the user 20 is tired, painful, or the like. For example, the smartphone 40 generates a warning sound when it is determined that the user 20 is tired or painful.

In the description of the present embodiment, various directions may be specified using the coordinate axes of the orthogonal coordinate system shown in FIG. The z-axis plus direction is defined as a direction along the front of the user 20. The z-axis plus direction is an acceleration in a direction from the face of the user 20 toward the front portion of the glasses 100 of the glasses 100 attached to the face of the user 20. Further, the negative y-axis direction is defined as the vertical direction, that is, vertically downward. The x-axis, y-axis, and z-axis are right-handed orthogonal coordinate systems. For convenience of explanation, the z-axis plus direction may be referred to as the front direction. In addition, the y-axis plus direction may be referred to as upward or the like. Also, the y-axis minus direction may be referred to as downward or the like. Further, the x-axis plus direction may be referred to as the left side or the like. Also, the x-axis minus direction may be referred to as the right side or the like.

FIG. 2 schematically shows the glasses 100 and the smartphone 40. The glasses 100 include a glasses main body 101 and a detection unit 102. The detection unit 102 is attached to the glasses main body 101. The detection unit 102 can be attached to and detached from the glasses main body 101.

The glasses main body 101 includes a lens 110 and a frame 120. Glasses 100 is an example of eyewear. The frame 120 and the detection unit 102 are examples of eyewear.

The frame 120 supports a pair of lenses 110. The frame 120 includes a rim 122, a bridge 124, an alloy 126, a temple 130, a modern 132, a ground electrode 154, a processing unit 180, and a power supply unit 190. The lens 110, the rim 122, the armor 126, the temple 130, and the modern 132 are each provided in a pair of left and right. Of the frame 120, the portions of the rim 122, the bridge 124, and the armor 126 are referred to as a front portion of the glasses 100.

The rim 122 holds the lens 110. The armor 126 is provided outside the rim 122 and holds the temple 130 movably. The temple 130 presses the upper part of the user's 20 ear and pinches the pressed part. The modern 132 is provided at the tip of the temple 130. The modern 132 contacts the upper part of the ear of the user 20.

FIG. 3 schematically shows the detection unit 102. The detection unit 102 includes a holding unit 150, a right nose pad 141, a left nose pad 142, a first electrode 151, a second electrode 152, a third electrode 153, a first support member 155, and a second support member 156. The right nose pad 141 and the left nose pad 142 form a pair of nose pads.

The right nose pad 141 is supported by the holding unit 150 by the first support member 155. The right nose pad 141 is substantially positioned with respect to the holding unit 150. The left nose pad 142 is supported by the holding unit 150 by the second support member 156. The left nose pad 142 is substantially positioned with respect to the holding unit 150.

The holding unit 150 is mounted and fixed to the bridge 124 of the glasses main body 101. When the holding unit 150 is fixed to the bridge 124 of the glasses main body 101, the detection unit 102 is fixed to the glasses main body 101 and used as the glasses 100.

FIG. 4 is a cross-sectional view schematically showing the connection structure of the detection unit 102 and the bridge 124. The detection unit 102 is attached to the bridge 124. The detection unit 102 can be attached to and detached from the bridge 124.

The holding part 150 is provided with a connector part 170. The bridge 124 is provided with a connector portion 125. By attaching the connector part 170 provided in the holding part 150 to the connector part 125 provided in the bridge 124, the detection unit 102 is attached to the bridge 124, and the detection unit 102 is fixed to the bridge 124. The That is, the detection unit 102 is fixed to the glasses main body 101.

A memory 157 is provided inside the holding unit 150. The memory 157 stores identification information for identifying the user 20. The memory 157 is an example of a nonvolatile storage unit that stores identification information for identifying the user of the detection unit 102.

The connector part 170 has a plurality of electrode parts 171. Each of the plurality of electrode portions 171 is electrically connected to any one of the first electrode 151, the second electrode 152, the third electrode 153, and the memory 157.

The connector part 125 has a plurality of electrode parts 172. The plurality of electrode portions 172 are provided at positions corresponding to the plurality of electrode portions 171. When the connector part 170 is attached to the connector part 125, each of the plurality of electrode parts 172 contacts and is electrically connected to a corresponding one of the plurality of electrode parts 171. Thus, the detection unit 102 and the bridge 124 are electrically connected via the connector part 170 and the connector part 125.

Information stored in the memory 157 is transmitted to the processing unit 180 via the electrode unit 171, the electrode unit 172, and the electric wire unit 160 described later. As described above, the connector unit 170 outputs the identification information stored in the memory 157 to the glasses main body 101.

The first electrode 151 is an example of an electrooculogram detection unit that detects electrooculogram. The first electrode 151 is provided on the surface of the right nose pad 141. The first electrode 151 is provided on the surface of the right nose pad 141 that faces the face of the user 20 when the user 20 wears the glasses 100. When the user 20 wears the glasses 100, the first electrode 151 contacts the skin of the user 20. For example, when the user 20 wears the glasses 100, the first electrode 151 contacts the right side of the user 20 nose. In the present embodiment, the first electrode 151 mainly detects the electrooculogram of the right eye of the user 20. The potential detected by the first electrode 151 is transmitted to the processing unit 180 through the electrode unit 171, the electrode unit 172, and the electric wire unit 160 described later.

The second electrode 152 is an example of an electrooculogram detection unit that detects electrooculogram. The second electrode 152 is provided on the surface of the left nose pad 142. The second electrode 152 is provided on the surface of the left nose pad 142 that faces the face of the user 20 when the user 20 wears the glasses 100. When the user 20 wears the glasses 100, the second electrode 152 contacts the skin of the user 20. For example, when the user 20 wears the glasses 100, the second electrode 152 contacts the left side of the user 20 nose. In the present embodiment, the second electrode 152 mainly detects the electrooculogram of the left eye of the user 20. The potential detected by the second electrode 152 is transmitted to the processing unit 180 through the electrode unit 171, the electrode unit 172, and the electric wire unit 160 described later.

The third electrode 153 is an example of an electrooculogram detection unit that detects electrooculogram. The third electrode 153 is provided on the surface of the holding unit 150. The third electrode 153 is provided on the surface of the holding unit 150 opposite to the surface on which the connector unit 170 is provided. The third electrode 153 is provided on the surface of the holding unit 150 that faces the face of the user 20 when the user 20 wears the glasses 100. When the user 20 wears the glasses 100, the third electrode 153 contacts the skin of the user 20. For example, when the user 20 wears the glasses 100, the third electrode 153 contacts the upper part of the eyebrow of the user 20. In the present embodiment, the electrooculogram detected by the third electrode 153 is used as a measurement reference for measuring the electrooculogram of the right eye and the electrooculogram of the left eye of the user 20. The potential detected by the third electrode 153 is transmitted to the processing unit 180 through the electrode unit 171, the electrode unit 172, and the electric wire unit 160 described later.

In the glasses main body 101, the ground electrode 154 is provided on the surface of the modern 132. The ground electrode 154 is provided on the surface of the modern 132 on the right side, for example. The ground electrode 154 is provided on the surface of the modern 132 that faces the face of the user 20 when the user 20 wears the glasses 100. When the user 20 wears the glasses 100, the ground electrode 154 contacts the user 20's skin. For example, when the user 20 wears the glasses 100, the ground electrode 154 contacts the upper part of the right ear of the user 20. In the present embodiment, the potential of the ground electrode 154 provides the ground potential of the electric circuit included in the glasses 100.

The processing unit 180 is provided inside the left temple 130. The electrooculogram of the user 20 detected by the first electrode 151, the second electrode 152, and the third electrode 153 is input to the processing unit 180. The processing unit 180 processes the input electrooculogram and transmits the processed potential to the smartphone 40.

The power supply unit 190 is provided inside the temple 130 on the left side. The power supply unit 190 includes a battery such as a secondary battery. The power supply unit 190 supplies the electrical energy stored in the battery included in the power supply unit 190 to the processing unit 180. Specifically, the power supply unit 190 generates DC power based on the potential of the ground electrode 154 from the electrical energy stored in the battery. The power supply unit 190 supplies DC power generated from the electrical energy stored in the battery to the processing unit 180.

The power supply unit 190 is provided inside the temple 130 on the side where the ground electrode 154 is provided. The potential of the ground electrode 154 provides a negative potential of DC power supplied from the power supply unit 190 to the processing unit 180. The right modern 132 has a charging port for charging the power supply unit 190. The battery included in the power supply unit 190 is charged through a charging port provided in the modern 132 on the right side.

As described above, the connector unit 170 attaches the detection unit 102 to the glasses body 101 and outputs the electrooculogram detected by the first electrode 151, the second electrode 152, and the third electrode 153 to the glasses body 101. . The detection unit 102 may have two electrodes for detecting the electrooculogram. For example, the detection unit 102 may include a first electrode 151 and a second electrode 152. The detection unit 102 may include any one of the first electrode 151 and the second electrode 152 and the third electrode 153. The second electrode 152 is an example of an electrode that is provided at a position different from the right nose pad 141 and detects the electrooculogram of the user 20. The electrode that is provided at a position different from the right nose pad 141 and detects the electrooculogram of the user 20 may be the third electrode 153.

The right nose pad 141, the left nose pad 142, and the third electrode 153 are provided to be positioned with respect to the face of the user 20 according to the shape. In this way, the detection unit 102 can be designed to fit the user 20. For example, when the user 20 wears the glasses 100, the detection unit 102 may be adjusted such that the first electrode 151, the second electrode 152, and the third electrode 153 are in sufficient contact with the user 20. Specifically, in the detection unit 102, the length of the third electrode 153 in the z-axis direction, the surface shape of the third electrode 153, and the lengths of the first support member 155 and the second support member 156 included in the detection unit 102, respectively. A plurality of parameters such as the sheath shape, the mounting angle of the right nose pad 141, and the mounting angle of the left nose pad 142 may be adjusted.

Note that multiple patterns of adjusted parameter combinations may be provided. The user 20 may be able to select and purchase the detection unit 102 having parameters suitable for the shape of his / her eye, eyebrow and nose. These parameters may be individually adjusted for each user who uses the detection unit 102. A so-called tailored detection unit 102 may be provided to the user 20.

In addition, it is preferable that the surface shape of the 3rd electrode 153 has a surface shape along the surface shape of the user's 20 eyebrow part. The third electrode 153 may have a curved surface shape along the surface of the portion between the eyebrows of the user 20.

In the glasses 100, the detection unit 102 can be attached to and detached from the glasses body 101. Therefore, the detection unit 102 in which the first electrode 151, the second electrode 152, and the third electrode 153 come into contact with the user 20 can be provided to the user 20. Therefore, it is possible to detect ocular potential more accurately. In addition, the user 20 can select a favorite glasses body from among a plurality of glasses bodies that he / she owns, and can attach and use the detection unit 102 to the selected glasses body.

FIG. 5 schematically shows a functional block configuration of the smartphone 40 and a functional block configuration of the processing unit 180. The processing unit 180 includes a processing unit 200, an angular velocity detection unit 260, an acceleration detection unit 270, a transmission / reception unit 280, and a substrate unit 290. The processing unit 200 includes a detection processing unit 210 and a control unit 220. The smartphone 40 includes a processing unit 300, a storage unit 360, a UI unit 370, a transmission / reception unit 380, and a power supply unit 390.

In the processing unit 180, the processing unit 200, the angular velocity detection unit 260, the acceleration detection unit 270, and the transmission / reception unit 280 are mounted on the substrate unit 290. The processing unit 200 is realized by a processor such as an MPU. Each unit of the smartphone 40 is mainly controlled by the processing unit 300. The transmission / reception unit 280 has a function of performing wireless communication with the smartphone 40. The transmission / reception unit 280 is realized by a communication processor. For example, the transmission / reception unit 280 is realized by a communication processor having a short-range wireless communication function such as Bluetooth (registered trademark).

Inside the frame 120, an electric wire part 160 is provided. The electric wire part 160 electrically connects the first electrode 151, the second electrode 152, the third electrode 153, the ground electrode 154, the memory 157, the power supply unit 190, and the processing unit 180. The electric wire part 160 electrically connects the first electrode 151 and the processing unit 180 via the electrode part 171 and the electrode part 172, and outputs an electrooculogram detected by the first electrode 151 to the processing unit 180. And an electric wire that electrically connects the second electrode 152 and the processing unit 180 via the electrode unit 171 and the electrode unit 172, and outputs the ocular potential detected by the second electrode 152 to the processing unit 180, and an electrode An electric wire that electrically connects the third electrode 153 and the processing unit 180 via the unit 171 and the electrode unit 172 and outputs the electrooculogram detected by the third electrode 153 to the processing unit 180; A signal for electrically connecting the memory 157 and the processing unit 180 via the electrode unit 172 and reading / writing data from / to the memory 157 with the processing unit 180 It has a wire to transmit, and a wire for supplying electric power from the power supply unit 190 to the processing unit 180.

In the glasses 100, the processing unit 200 acquires the electrooculogram of the user 20, and processes the acquired electrooculogram. Specifically, the detection processing unit 210 acquires the first electrooculogram that is the electrooculogram detected by the first electrode 151, and processes the acquired first electrooculogram. In addition, the detection processing unit 210 acquires a second ocular potential that is an ocular potential detected by the second electrode 152, and processes the acquired second ocular potential. Further, the detection processing unit 210 acquires a third ocular potential that is an ocular potential detected by the third electrode 153, and processes the acquired third ocular potential.

For example, the detection processing unit 210 processes the first ocular potential based on the third ocular potential. In the present embodiment, the first electrooculogram based on the third electrooculogram is referred to as V1. The detection processing unit 210 samples V1 at a predetermined cycle and generates time series data of V1. The detection processing unit 210 outputs the generated time series data of V1 to the transmission / reception unit 280.

Also, the detection processing unit 210 processes the second electrooculogram based on the third electrooculogram. In the present embodiment, the second ocular potential based on the third ocular potential is referred to as V2. The detection processing unit 210 samples V2 at a predetermined cycle, and generates time-series data of V2. The detection processing unit 210 outputs the generated V2 time-series data to the transmission / reception unit 280.

The acceleration detection unit 270 detects the acceleration of the glasses 100. The acceleration detection unit 270 is, for example, a triaxial acceleration sensor. The acceleration detection unit 270 detects the acceleration of the center of gravity of the glasses 100. When the glasses 100 are worn on the user 20, the acceleration of the center of gravity of the glasses 100 corresponds to the acceleration of the head of the user 20. The acceleration detected by the acceleration detection unit 270 is input to the detection processing unit 210.

The angular velocity detection unit 260 detects the angular velocity of the glasses 100. The angular velocity detection unit 260 is, for example, a triaxial angular velocity sensor. The angular velocity detected by the angular velocity detector 260 is input to the detection processing unit 210.

The detection processing unit 210 acquires the acceleration detected by the acceleration detection unit 270 and processes the acquired acceleration. The detection processing unit 210 samples acceleration at a predetermined cycle, and generates time-series acceleration data. The detection processing unit 210 outputs the time series data of the generated acceleration to the transmission / reception unit 280. The acceleration data output to the transmission / reception unit 280 includes time-series data of acceleration in each direction of the three axes.

The detection processing unit 210 acquires the angular velocity detected by the angular velocity detection unit 260 and processes the acquired angular velocity. The detection processing unit 210 samples the angular velocity at a predetermined cycle, and generates time-series angular velocity data. The detection processing unit 210 outputs the generated time-series data of the angular velocity to the transmission / reception unit 280. The angular velocity data output to the transmission / reception unit 280 includes time-series data of angular velocities in the directions of the three axes.

The transmission / reception unit 280 transmits the V1 time series data, the V2 time series data, the acceleration time series data, and the angular velocity time series data acquired from the detection processing unit 210 to the transmission / reception unit 380 by radio signals. As described above, the transmission / reception unit 280 transmits the electrooculogram information, the acceleration information, and the angular velocity information that are continuously detected to the smartphone 40.

Note that the processing in the detection processing unit 210 includes amplification processing for amplifying the input electro-oculogram, acceleration and angular velocity signals, and digitization processing for digitizing the input electro-oculogram, acceleration and angular velocity signals. The detection processing unit 210 may include an amplifier circuit that amplifies analog signals of input electrooculogram, acceleration, and angular velocity. The detection processing unit 210 may include an analog-to-digital conversion circuit that digitizes an analog signal of input ocular potential, acceleration, and angular velocity or an analog signal amplified by an amplifier circuit.

The control unit 220 controls the detection of the electrooculogram, acceleration, and angular velocity by the detection processing unit 210. Further, the control unit 220 is responsible for connection processing between the detection unit 102 and the processing unit 180. For example, the control unit 220 acquires the identification information stored in the memory 157 from the detection unit 102, and the identification information acquired from the detection unit 102 matches the predetermined identification information. The ocular potential is detected by the first electrode 151, the second electrode 152, and the third electrode 153. Specifically, the control unit 220 acquires the identification information of the user 20 from the smartphone 40 with which the transmission / reception unit 280 connection is established. Then, when the identification information acquired from the memory 157 matches the identification information acquired from the smartphone 40, the electrooculogram is detected by the first electrode 151, the second electrode 152, and the third electrode 153.

In the smartphone 40, the power supply unit 390 includes a battery such as a secondary battery. The power supply unit 390 supplies power to each unit of the smartphone 40 including the processing unit 300, the transmission / reception unit 380, and the UI unit 370.

The UI unit 370 provides a user interface (UI) with the user 20. For example, the UI unit 370 includes a touch panel, operation keys, a sound generation device, and the like.

The storage unit 360 is realized by a storage medium. Examples of the recording medium include a volatile storage medium and a nonvolatile storage medium. The storage unit 360 stores various parameters necessary for the operation of the processing unit 300. The storage unit 360 stores various types of information generated by the processing unit 300.

The transmission / reception unit 380 has a function of performing wireless communication with the glasses 100. The transmission / reception unit 380 is realized by a communication processor having a short-range wireless communication function such as Bluetooth (registered trademark). The transmission / reception unit 380 and the transmission / reception unit 280 perform wireless communication in accordance with the Bluetooth (registered trademark) standard. Note that communication between the transmission / reception unit 280 and the transmission / reception unit 380 is not limited to Bluetooth (registered trademark) communication. Communication between the transmission / reception unit 280 and the transmission / reception unit 380 can be realized by various types of wireless communication including, for example, a wireless LAN. Communication between the transmission / reception unit 280 and the transmission / reception unit 380 can be realized by various types of wired communication including USB.

The transmission / reception unit 380 receives information indicating the electrooculogram transmitted from the glasses 100. In addition, the transmission / reception unit 380 receives information indicating the acceleration transmitted from the glasses 100. In addition, the transmission / reception unit 380 receives information indicating the angular velocity transmitted from the glasses 100. Specifically, the transmission / reception unit 380 receives the radio signal received from the transmission / reception unit 280, demodulates the received radio signal, and performs time series data of V1, time series data of V2, time series data of acceleration, and Receive data including time-series data of angular velocity is generated. The transmission / reception unit 380 outputs the generated reception data to the processing unit 300.

The processing unit 300 includes an electrooculogram acquisition unit 310, an acceleration acquisition unit 320, an angular velocity acquisition unit 322, and an analysis unit 350.

The electrooculogram acquisition unit 310 acquires the electrooculogram of the user 20 detected by the electrooculogram detection unit attached to the user 20. Specifically, the electrooculogram acquisition unit 310 acquires the electrooculogram of the user 20 detected by the first electrode 151, the second electrode 152, and the third electrode 153 provided in the glasses 100 worn by the user 20. To do. More specifically, the electrooculogram acquisition unit 310 acquires the electrooculogram detected by the glasses 100 by extracting the time series data of V1 and the time series data of V2 from the reception data output from the transmission / reception unit 380. To do.

The acceleration acquisition unit 320 acquires the acceleration of the glasses 100 detected by the glasses 100. Specifically, the acceleration acquisition unit 320 acquires the acceleration detected by the glasses 100 based on the information received by the transmission / reception unit 380. More specifically, the acceleration acquisition unit 320 acquires the acceleration detected by the glasses 100 by extracting the acceleration data from the reception data output from the transmission / reception unit 380.

The angular velocity acquisition unit 322 acquires the angular velocity of the glasses 100 detected by the glasses 100. Specifically, the angular velocity acquisition unit 322 acquires the angular velocity detected by the glasses 100 based on the information received by the transmission / reception unit 380. More specifically, the angular velocity acquisition unit 322 acquires the angular velocity detected by the glasses 100 by extracting the angular velocity data from the reception data output from the transmission / reception unit 380.

The analysis unit 350 analyzes the electrooculogram acquired by the electrooculogram acquisition unit 310. Specifically, the analysis unit 350 uses the continuous electrooculogram information acquired by the electrooculogram acquisition unit 310 to specify the state of the user 20 at a plurality of timings. For example, the analysis unit 350 specifies the state of the user 20 at a plurality of timings using information on the continuous first and second electrooculograms acquired by the electrooculogram acquisition unit 310. Examples of the state of the user 20 include the user's 20 line-of-sight direction and the blink state.

The analysis unit 350 analyzes the identified line-of-sight direction of the user 20 and identifies the state of the user 20. Moreover, the analysis part 350 specifies the presence or absence of a blink based on a 1st ocular potential or a 2nd ocular potential. The analysis unit 350 also analyzes the line-of-sight direction and the blink state of the user 20 to identify the state of the user 20. For example, the analysis unit 350 determines whether the user 20 is tired or painful as the state of the user 20. The analysis unit 350 issues a warning to the user 20 through the UI unit 370 when it is determined that the user 20 is tired or painful.

Further, the analysis unit 350 analyzes the information of at least one of the acceleration acquired by the acceleration acquisition unit 320 and the angular velocity acquired by the angular velocity acquisition unit 322, and identifies the movement of the user 20. For example, the analysis unit 350 specifies the running form of the body part of the user 20 based on at least one of acceleration and angular velocity. The storage unit 360 causes the storage unit 360 to store the electrooculogram information analysis result described above and the information indicating the identified movement of the user 20 in association with each other. The UI unit 370 may present information representing the total running posture based on the running form and the line-of-sight direction stored in the storage unit 360 to the user 20 using a video or the like. For example, the UI unit 370 may present an icon such as an arrow indicating the viewing direction of the user 20 to the user 20 together with an icon representing the running form.

The storage unit 360 may store identification information for identifying the user 20 who is the owner of the smartphone 40. The processing unit 300 may transmit the identification information stored in the storage unit 360 to the glasses main body 101 by controlling the transmission / reception unit 380. For example, the processing unit 300 transmits the identification information stored in the storage unit 360 in response to a request from the glasses main body 101.

Note that the processing unit 300 may receive the identification information stored in the memory 157 through the glasses body 101 through the glasses body 101, the transmission / reception unit 280, and the transmission / reception unit 380. The processing unit 300 identifies the user 20 of the detection unit 102 based on the identification information received through the glasses main body 101. For example, the processing unit 300 may authenticate the user 20 when the identification information stored in the storage unit 360 matches the identification information acquired from the glasses main body 101. The processing unit 300 may process the time series data of the electrooculogram, acceleration, and angular velocity received from the transmission / reception unit 380 on condition that the user 20 is authenticated. Further, on the condition that the user 20 is authenticated, the processing unit 300 outputs the time series data of the electro-oculogram, acceleration, and angular velocity received from the transmission / reception unit 380 and the analysis result by the analysis unit 350 to an external server or the like. You can do it.

FIG. 6 schematically shows the positional relationship between the electrooculogram detection electrode of the glasses 100 and the user 20. FIG. 4 shows a contact position where the electrooculogram detection electrode contacts the user 20 when the user 20 is wearing the glasses 100.

The first contact position 451 represents a position where the first electrode 151 contacts the user 20. The second contact position 452 represents a position where the second electrode 152 contacts the user 20. The third contact position 453 represents a position where the third electrode 153 contacts the user 20.

The first contact position 451 and the second contact position 452 are located below the center of the cornea 411 of the right eyeball 401 and the center of the cornea 412 of the left eyeball 402.

The first contact position 451 and the second contact position 452 may be at positions where the distance between the first contact position 451 and the eyeball 401 and the distance between the second contact position 452 and the eyeball 402 are substantially equal. desirable. Further, it is desirable that the first contact position 451 and the second contact position 452 are separated from each other by a certain distance or more.

The third contact position 453 is located above the center of the cornea 411 of the right eyeball 401 and the center of the cornea 412 of the left eyeball 402. The position of the third contact position 453 is a position where the distance between the third contact position 453 and the first contact position 451 and the distance between the third contact position 453 and the second contact position 452 are substantially equal. It may be. The third contact position 453 is such that the distance between the third contact position 453 and the eyeball 401 is separated from the distance between the eyeball 401 and the first contact position 451, and the third contact position 453 and the eyeball 402 are separated from each other. May be at a position that is separated from the distance between the eyeball 402 and the second contact position 452.

In the eyeball, the cornea side is positively charged and the retina side is negatively charged. Therefore, when the line-of-sight direction of the user 20 changes upward, V1 that is the potential of the first electrode 151 with respect to the third electrode 153 and V2 that is the potential of the second electrode 152 with respect to the third electrode 153 are Both will decline. When the line-of-sight direction of the user 20 changes downward, both the potentials V1 and V2 rise. When the line-of-sight direction of the user 20 changes to the right, V1 decreases and V2 increases. When the line-of-sight direction of the user 20 changes to the left, V1 increases and V2 decreases. The analysis unit 350 identifies the direction in which the line-of-sight direction has changed based on the change in V1 and the change in V2.

Note that the detection processing unit 210 measures the right eye and left eye potential by detecting V1 and V2. Therefore, the influence of noise applied to the electrooculogram can be reduced.

If the head of the user 20 is fixed, the line-of-sight direction of the user 20 is determined by the direction of the eyeball 401 and the direction of the eyeball 402. Since the line-of-sight direction of the user 20 also changes depending on the direction of the head of the user 20, the global line-of-sight direction of the user 20 is determined by the direction of the eyeball 401, the direction of the eyeball 401 and the head of the user 20. In the description of the present embodiment, the line-of-sight direction determined by the direction of the eyeball 401 and the direction of the eyeball 401 may be simply referred to as the line-of-sight direction.

Here, the line-of-sight direction of the user 20 will be described. When the position of the cornea 411 changes as the eyeball 401 rotates in the xz plane, V1 changes according to the position of the cornea 411. The analysis unit 350 specifies an angle change amount that is a change amount of the angle of the eyeball 401 in the rotation direction based on the change amount of V1. The analysis unit 350 identifies the angle of the eyeball 401 after the rotation based on the angle of the eyeball 401 before the change and the specified angle change amount. As described above, the analysis unit 350 specifies the orientation of the eyeball 401 based on the temporal change of V1.

The analysis unit 350 identifies the rotation angle in the other plane as well as the angle in the xy plane. For example, the analysis unit 350 identifies the angle of the eyeball 402 by a process similar to the process related to the angle of the eyeball 401. Specifically, the analysis unit 350 specifies the direction of the eyeball 402 based on the time change of V2.

The analysis unit 350 identifies the line-of-sight direction of the user 20 based on the orientation of the eyeball 401 and the orientation of the eyeball 402. For example, the analysis unit 350 may specify a direction in which a vector obtained by combining a vector of the direction of the eyeball 401 and a vector of the direction of the eyeball 402 faces as the line-of-sight direction of the user 20.

Note that the orientation of the eyeball 401 and the orientation of the eyeball 402 are an example of an index that represents the visual line direction of the user 20. The line-of-sight direction of the user 20 may be one line-of-sight direction determined from a vector of the direction of the eyeball 401, a vector of the direction of the eyeball 402, and the like. That is, the analysis unit 350 may specify the one line-of-sight direction from V1 and V2. In this case, the analysis unit 350 specifies one gaze direction by performing a predetermined calculation based on the change amount of V1 and the change amount of V2 without specifying the direction of the eyeball 401 and the direction of the eyeball 402. You can do it. For example, the analysis unit 350 may specify one gaze direction by performing a predetermined calculation that associates the variation amount of V1 and the variation amount of V2 with the variation amount of one gaze direction.

Here, the case where the line-of-sight direction is specified has been described, but the direction of the eyeball 401 can be rephrased as the position of the cornea 411. Further, the direction of the eyeball 402 can be rephrased as the position of the cornea 412. Further, the change in the direction of the eyeball 401 can be rephrased as the eyeball movement of the eyeball 401. Further, a change in the direction of the eyeball 402 can be rephrased as eyeball movement. That is, the analysis unit 350 may specify the eye movement of the user 20 based on the electrooculogram detected by the glasses 100.

FIG. 7 is a flowchart showing processing executed in the glasses main body 101. The processing shown in this flowchart is started when a task responsible for connection processing with the detection unit 102 is started in the processing unit 200. For example, the processing shown in this flowchart is started when the detection unit 102 is attached to the glasses main body 101.

In step S <b> 702, the control unit 220 controls the transmission / reception unit 280 to establish a connection with the smartphone 40. Subsequently, in step S <b> 704, the identification information of the user 20 is acquired from the smartphone 40.

Subsequently, in step S <b> 706, the control unit 220 accesses the memory 157 of the detection unit 102 and reads identification information from the memory 157.

Subsequently, in step S <b> 710, the control unit 220 determines whether the identification information read from the memory 157 matches the identification information acquired from the smartphone 40. When the identification information read from the memory 157 and the identification information acquired from the smartphone 40 do not match, the process of this flowchart is terminated. If the identification information read from the memory 157 matches the identification information acquired from the smartphone 40, the process proceeds to step S712.

In step S712, the control unit 220 controls the detection processing unit 210 to start detection of electrooculogram, acceleration, and angular velocity. Further, the control unit 220 controls the transmission / reception unit 280 to start transmission of the detected time series data of the electro-oculogram, acceleration, and angular velocity to the smartphone 40.

Subsequently, in step S720, the connection state with the smartphone 40 is determined. If the connection is being established with the smartphone 40 that has established a connection in step S702, the determination in step S720 is repeated. If the connection with the smartphone 40 that established the connection in step S702 is disconnected, the process proceeds to step S730. When connected to another smartphone different from the smartphone 40 that established the connection in step S702, the process proceeds to step S722.

In step S730, the control unit 220 controls the detection processing unit 210 to stop detecting the electrooculogram, acceleration, and angular velocity. Moreover, the control part 220 controls the transmission / reception part 280, and stops transmission to the smart phone 40 of each time series data. Then, the process of this flowchart is complete | finished.

In step S722, the control unit 220 controls the detection processing unit 210 to stop detecting the electrooculogram, acceleration, and angular velocity. Moreover, the control part 220 controls the transmission / reception part 280, and stops transmission to the smart phone 40 of each time series data. Subsequently, in step S724, the control unit 220 acquires the identification information of the user 20 from another smartphone, and shifts the processing to step S710.

According to the control of the processing unit 200 described above, data such as detected electrooculogram is transmitted to the smartphone 40 when the identification information acquired from the detection unit 102 matches the smartphone 40. Therefore, data security can be increased.

In the electrooculogram information processing system 10 described above, the processing unit 200 performs processing for calculating V1 and V2. It replaces with this and the analysis part 350 of the smart phone 40 may perform the process which calculates V1 and V2. In this case, the processing unit 200 generates time series data of the first ocular potential, the second ocular potential, and the third ocular potential, and the transmission / reception unit 280 causes the first ocular potential, the second ocular potential, and the third ocular potential. Each of the time series data may be transmitted to the smartphone 40.

In the electrooculogram information processing system 10 described above, the analysis unit 350 uses V1 and V2 to specify the state of the user 20 such as the line-of-sight direction of the user 20. In addition, the analysis unit 350 may specify the state of the user 20 using an arbitrary linear combination of V1 and V2. For example, the analysis unit 350 may specify the state of the user 20 using V1 + V2 and V1-V2. Moreover, the analysis part 350 may specify the state of the user 20 using the time differentiation of V1 and the time differentiation of V2. In addition, the analysis unit 350 uses the first eye based on a predetermined reference potential such as the potential of the ground electrode 154 instead of the above-described V1 and V2 as the eye potential for specifying the line-of-sight direction. The potential and the second ocular potential based on the potential of the ground electrode 154 may be applied.

Note that the smartphone 40 may have a function of a detection unit that detects acceleration. In addition, the smartphone 40 may have a function of a detection unit that detects the angular velocity.

In the above description, the processing described as operations of the processing unit 300 and the transmission / reception unit 380 in the smartphone 40 is realized by a processor such as the processing unit 300 and the transmission / reception unit 380 controlling each hardware included in the smartphone 40 according to a program. The As described above, at least a part of the processing of the smartphone 40 described in relation to the smartphone 40 of the present embodiment includes a processor, a memory, and the like by the processor operating according to the program and controlling each hardware. This can be realized by the hardware and the program operating in cooperation. That is, the process can be realized by a so-called computer. The computer may load a program for controlling execution of the above-described processing, operate according to the read program, and execute the processing. The computer can load the program from a computer-readable recording medium storing the program. Similarly, the processing described as the operations of the processing unit 200 and the transmission / reception unit 280 in the glasses 100 can be realized by a so-called computer.

The electrooculogram information processing system 10 is an example of an information processing system. The smartphone 40 may process various information without being limited to the electrooculogram. The smartphone 40 is an example of an information processing apparatus that processes information such as electrooculogram detected by the glasses 100. The information processing apparatus may be various electronic devices having a communication function. The information processing apparatus may be a portable electronic device such as a mobile phone, a portable information terminal, a portable music player, etc. possessed by the user 20.

The eyeglasses 100 as an example of eyewear can be used for the purpose of correcting the refractive error of the eyes of the user 20, protecting the eyes of the user 20, or dressing up. However, eyewear is not limited to glasses. The eyewear may be a face wearing device such as sunglasses, goggles, a head mounted display, or a head wearing device. The eyewear may be a frame of a face wearing device or a head wearing device or a part of the frame. Eyewear is an example of a wearing tool that can be worn by a user. The wearing tool is not limited to a wearing tool related to the eye such as eyewear. Various members such as a hat, a helmet, headphones, and a hearing aid can be applied as the wearing tool.

As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

The execution order of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior”. It should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for the sake of convenience, it means that it is essential to carry out in this order. is not.

DESCRIPTION OF SYMBOLS 10 Ocular potential information processing system 100 Glasses 20 User 40 Smartphone 101 Glasses main body 102 Detection unit 110 Lens 120 Frame 122 Rim 124 Bridge 125 Connector part 126 Yoroi 130 Temple 132 Modern 141 Right nose pad 142 Left nose pad 150 Holding part 151 1st electrode 152 2nd electrode 153 3rd electrode 155 1st support member 156 2nd support member 157 Memory 154 Ground electrode 170 Connector part 171, 172 Electrode part 160 Electric wire part 180 Processing unit 190 Power supply unit 200 Processing part 210 Detection processing part 220 Control part 260 Angular velocity detection unit 270 Acceleration detection unit 280 Transmission / reception unit 290 Substrate unit 300 Processing unit 310 Ocular potential acquisition unit 320 Acceleration acquisition unit 322 Angular velocity acquisition unit 350 Analysis unit 360 Storage unit 3 0 UI unit 380 transceiver 390 power supply unit 401 and 402 the eyeball 411, 412 cornea 451 first contact position 452 the second contact position 453 third contact position

Claims (9)

1. A detection unit that can be attached to and detached from the eyewear body,
   A pair of nose pads;
   A first electrode that is provided on a surface of the first nose pad of the pair of nose pads and detects an electrooculogram of the wearer;
   A second electrode provided at a position different from the first nose pad and detecting the electrooculogram of the wearer;
   A detection unit comprising: a connector portion that attaches the detection unit to the eyewear body and outputs an electrooculogram detected by the first electrode and the second electrode to the eyewear body.
2. 2. The detection unit according to claim 1, wherein the second electrode is provided on a surface of a second nose pad of the pair of nose pads and detects an electrooculogram of the wearer.
3. The detection unit according to claim 2, further comprising a third electrode that contacts an eyebrow portion of the wearer and detects an electrooculogram of the wearer.
4. 4. The detection unit according to claim 3, wherein the pair of nose pads, the third electrode, and the connector portion are provided to be positioned relative to each other on the face of the wearer according to the shape.
5. The detection unit according to claim 1, wherein the second electrode is in contact with an eyebrow portion of the wearer.
6. A non-volatile storage unit that stores identification information for identifying a user of the detection unit;
   The detection unit according to any one of claims 1 to 5, wherein the connector unit further outputs the identification information stored in the storage unit to the eyewear main body.
7. The detection unit according to any one of claims 1 to 6,
   Eyewear comprising the eyewear body.
8. A detection unit according to claim 6;
   Comprising the eyewear body,
   The eyewear body is
   When the identification information stored in the storage unit is acquired from the detection unit, and the identification information acquired from the detection unit matches the predetermined identification information, the first electrode and Eyewear having a control unit for detecting the electrooculogram by the second electrode.
9. A detection unit according to claim 6;
   An electrooculogram detection system comprising: an electrooculogram information processing apparatus that receives the identification information through the eyewear body and identifies a user of the detection unit based on the identification information received through the eyewear body.

Images