JP2002236096A - Optical topographic apparatus and data generation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To control an object to be operated by catching a change in the activity of the brain due to invoking. SOLUTION: A fixture 18 is mounted on the head part 26 of an operator. The head part 26 is irradiated with near-infrared light. The reflected light of light transmitted through blood in the brain from among the light shone at the head part 26, is condensed by an optical fiber 24. The condensed light is converted by a photoelectric converter 22 into an electrical signal according to its intensity. On the basis of the electrical signal, the movement of a character 34 is controlled by a controller 10. That is to say, when the invoking intensity of the operator is large, the character 34 is moved up to the position of a hole 36, and when the invoking intensity is small, the character 34 is moved up to a position deviated from the hole 36. Thereby, without using hand or foot, the movement of the character 34 can be controlled merely by the activity of the brain of the operator.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an optical topography apparatus and a data generation apparatus, and more particularly, to detecting a signal reflecting activity of a brain function using light or near-infrared light, and utilizing the detected signal. The present invention relates to an optical topography device and a data generation device suitable for controlling a control target or an operation target.

[0002]

2. Description of the Related Art Conventionally, a joystick, a steering wheel, a keyboard, and the like have been used for operating a game apparatus, a computer, and the like. These operating means generate signals in response to an operation by an operator. ing.

On the other hand, as a device for operating a game device using an electroencephalogram without requiring an operator's operation, for example, Japanese Patent Application Laid-Open Nos. Hei 6-296557 and Hei 7-124
331 is disclosed. When using brain waves, the operation of the operator is unnecessary, but when using brain waves, the brain waves must be converted into electric signals, and since this electric signal is detected as a weak electric signal, It is susceptible to electrical noise and extraneous nozzles generated when muscles are moved.

To compensate for this drawback, for example, as described in Japanese Patent Application Laid-Open No. 9-149894, the activity of the brain is measured by an optical method, and the measured value is used for input to various devices. Something to do is suggested.

However, when the brain function signal is used for data input or control signal, it is difficult to immediately confirm whether the input data or control signal itself has the contents intended by the operator. In particular, since various electrical signals overlap in brain waves, signal processing such as removing unnecessary signals from measured signals must be performed. for that reason,
It is difficult to immediately check what the current brain function signal of the operator is, and it is difficult to correct immediately when erroneous data is input.

In view of the above, there has been proposed an apparatus that detects a brain function signal associated with an operation of an operator's hand using near-infrared light and controls a device in accordance with the detected brain function signal (Japanese Patent Application Laid-Open (JP-A) no. 2000-172407).

[0007]

In the prior art,
Using near-infrared light to detect brain function signals associated with the operation of the operator's hand, and controlling the device according to the detected brain function signal, it is possible to control the device according to the operation state of the hand it can.

However, the operator must operate his / her hand to control the equipment, and the brain activity itself is detected.
That is, no consideration is given to controlling a device or the like by detecting a change in brain activity without operating a hand or foot.

[0009] A first object of the present invention is to provide an optical topography apparatus capable of controlling a control object or an operation object by capturing changes in brain activity associated therewith.

A second object of the present invention is to provide an optical topography apparatus capable of displaying a state of a change in brain activity accompanying a remembrance.

A third object of the present invention is to provide a data generation device capable of generating data relating to a change in brain activity accompanying a remembrance, and a database storing data generated by the data generation device. .

[0012] A fourth object of the present invention is to provide a method of using a database in which data relating to a change in brain activity accompanying a remembrance is stored.

[0013]

In order to solve the first problem, a light irradiation means for irradiating light to a head including a brain;
Light collecting means for collecting the reflected light of the light transmitted through the blood in the head among the light irradiated on the head from the light irradiation means, and the intensity of the light collected by the light collecting means And a control means for controlling a control target based on the control signal.

Further, in order to solve the second problem,
The present invention is a light irradiation means for irradiating light to the head including the brain,
Light collecting means for collecting the reflected light of the light transmitted through the blood in the head among the light irradiated on the head from the light irradiation means, and the intensity of the light collected by the light collecting means And a display means for displaying on a screen an image corresponding to the level of the electric signal based on the output of the photoelectric conversion means on a screen. .

When configuring the optical topography apparatus, the following elements can be added instead of the display means.

(1) Operation signal output means for comparing the level of an electric signal output from the photoelectric conversion means with a set value and outputting an operation signal according to the comparison result, and displaying an image corresponding to the operation signal on a screen Display means for displaying the information on the display.

(2) An operation signal output means for comparing the level of the electric signal output from the photoelectric conversion means with a set value and outputting an operation signal in accordance with the comparison result, and an image including an operation target on a screen. Display means for displaying; and image control means for controlling movement of an operation target on the screen in response to the operation signal.

(3) Operation signal output means for comparing the level of an electric signal output from the photoelectric conversion means with a set value and outputting an operation signal according to the comparison result, and displaying an image including a character on a screen Display means for controlling the movement of the character on the screen in response to the operation signal.

In constructing each of the optical topography apparatuses, near-infrared light can be used as light.

In order to solve the third problem, the present invention provides:
Light irradiating means for irradiating light to the head including the brain, light condensing means for condensing reflected light of light transmitted through the blood in the head among the light irradiated to the head, and the light condensing means Photoelectric conversion means for converting light condensed by the means into an electric signal corresponding to the intensity thereof, and generating data indicating a change in the blood based on the electric signal obtained by the photoelectric conversion means in association with a time axis. And a data generating device comprising a data generating means for performing the above.

In configuring the data generation means, the following elements can be added.

(1) The change in blood is a change in the amount of blood or hemoglobin concentration in blood.

(2) Stimulating means for stimulating the brain in association with a plurality of parameters for data to be generated.

(3) The light is near-infrared light.

[0025] Further, a database storing data generated by any of the data generation devices can be configured.

In order to solve the fourth problem, the present invention provides:
When using a database storing data generated by any one of the data generation devices via a network, the database is opened only for an access including a preset registration number. It adopts a database usage method.

According to the above means, the head including the brain is irradiated with light, the reflected light of the light transmitted through the blood in the head is collected, and the intensity of the collected light is detected. The intensity of this light varies with the amount of blood or hemoglobin concentration in the head of the user as the user (operator) remembers,
This change appears as a change in the light transmittance, and the change in the light transmittance is reflected on the light intensity, so that the control target can be controlled based on the light intensity. In other words, the user (operator) can control the control target according to the degree of the recollection by making a recollection without using his / her hands or feet.

Further, when the light intensity is converted into an electric signal and an image based on the electric signal is displayed, an image corresponding to the way of thinking of the user (operator) is displayed, and an operation target or an object according to the way of thinking is displayed. The movement of the garbage can be controlled.

When the level of the electric signal according to the light intensity and the set value are compared, and an image based on the operation signal according to the comparison result is displayed on the screen, the image on the screen is viewed. It can be used for understanding and diagnosis of the experienced person.

[0030]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram of an optical topography apparatus including a data generation apparatus according to an embodiment of the present invention. In FIG. 1, the optical topography apparatus includes a controller 10 constituted by, for example, a personal computer. The controller 10 is connected to a fixture 18 via a switch (control line) 12, a light source 14, and an optical fiber 16. A / D (analog / digital) converter 20, photoelectric converter 22,
It is connected to the fixture 18 via an optical fiber 24.
The switch 12 opens and closes the circuit in accordance with a command from the controller 10, and when the circuit is closed, power is supplied to the light source 14. This light source 14
For example, it is composed of a semiconductor laser whose oscillation wavelength is in the near infrared region, and near infrared light generated from the light source 14 is transmitted to the fixture 18 via the optical fiber 16.

The fixture 18 is formed in a belt shape and is mounted on the head 26 of the user. Then, one end of the optical fiber 16 is connected to one end of the fixture 18, and the fixture 1
The other end of the optical fiber 8 is connected to an end of an optical fiber 24. When the near-infrared light from the light source 14 irradiates the head 26 via the optical fiber 16 in a state where the fixture 18 is attached to the head 26, the near-infrared light irradiated on the head 26 is 26
After passing through the skull, the blood in the brain is transmitted, a part of the light transmitted through the blood is scattered, and a part of the light is collected on the optical fiber 24 as reflected light. That is, the light source 14 and the optical fiber 16 are configured as light irradiation means, and the optical fiber 24 is configured as light focusing means.

The light condensed by the optical fiber 24 is guided to the photoelectric converter 22, where the light is converted into an analog electric signal whose level (amplitude) changes according to the intensity. The photoelectric converter 22 is composed of, for example, an avalanche photodiode, and an electric signal obtained by the photoelectric converter 22 as a photoelectric conversion unit is output to the A / D converter 20. The A / D converter 20 converts an analog signal, which is an electric signal from the photoelectric converter 22, into a digital signal, and sequentially transmits the digital signal to the controller 10.

When the light condensed by the optical fiber 24 is converted into an electric signal corresponding to the intensity and input as a digital signal, the controller 10 displays an image corresponding to the level of the electric signal. An image signal is generated, and the image signal is displayed on a display 28 as display means.
And an image corresponding to the image signal is displayed on the screen of the display 28.

Further, the controller 10 has a function as control means, generates a control signal corresponding to the electric signal,
The drive of the device 30 is controlled according to the control signal.

Further, the controller 10 has a function as operation signal output means, compares the level of the input electric signal with a set value, outputs an operation signal according to the comparison result, and controls the image control means. In response to the operation signal, an image signal is generated in accordance with the operation signal, and the movement of the operation target or the character displayed on the screen of the display 28 is controlled.

The controller 10 has a function as a data generating means, and generates data indicating a change in blood in association with a time axis based on the input electric signal (digital signal), and generates the generated data. It is stored in the database 32.

When data is generated, data is collected by capturing changes in the brain activity of the user. That is, when the user is irradiating near infrared light, the blood contained in the brain of the user changes when the user remembers.

Specifically, the amount of blood in the brain or the hemoglobin concentration (reduced or oxidized hemoglobin concentration) in the blood changes according to the mind of the user. When the amount of blood or the hemoglobin concentration in the blood changes, the head 2 of the user
The transmittance of the near-infrared light radiated to 6 changes, and this change is reflected in the intensity of the light collected by the optical fiber 24. For this reason, by accumulating the data according to the electric signal corresponding to the intensity of the collected light, it is possible to collect data indicating the degree of mind of the user.

When collecting the data, when irradiating the near-infrared light to the head 26 of the user, a question for stimulating the brain of the user in relation to a plurality of parameters for the data to be generated is provided. By outputting a matter, for example, a question about the physical condition of the experience person by voice from a speaker (stimulating means) connected to the controller 10, it is possible to collect personal information indicating a degree of mindfulness for various parameters.

By storing the data obtained as personal information in the database 32, the data stored in the database 32 can be used as a rehabilitation education tool for voluntary rehabilitation training education such as pediatric paralysis.
It can also be used as an emergency evasion tool for automobiles when responding to epilepsy.

Next, the operation when the optical topography apparatus is used for a game will be described with reference to FIGS. First, when a program (game software) and image information relating to a game are input to the controller 10, an image according to the image information is displayed on the screen of the display 28. At this time, the head 2 of the operator (game user)
When the fixture 18 is attached to the head 6, near-infrared light from the light source 14 is applied to the head 26.

When the game is started by the operation of the operator, the character 34 is displayed on the screen of the display 28 with the progress of the game software (step S).
1). Thereafter, the moving direction of the character 34 is indicated by an arrow on the screen of the display 28 (step S2).
At this time, the operator places the character 34 in the target hole 3
6, the intensity of light according to the way of thinking is detected by the photoelectric converter 22 via the optical fiber 24 (step S3). When the light detected by the photoelectric converter 22 is converted into an electric signal, the electric signal is converted into a digital signal via the A / D converter 20 and output to the controller 10. The controller 10 digitizes the value of the input digital signal (step S4), and performs an operation for correcting the digitized data in association with the user (step S5).

Thereafter, the controller 10 generates an operation signal according to the corrected value, and moves the character 34 according to the operation signal (step S6). At this time, the character 34 moves based on the electric signal generated according to the degree of mind of the operator, and when the level of the input electric signal exceeds the set value, the character 3 moves.
4 will pass through the target hole 36.

On the other hand, when the level of the input electric signal is equal to or less than the set value or is out of the set value range, the character 34 does not pass through the hole 36 and moves to a position corresponding to the degree of mindfulness. .

When the character 34 has passed through the hole 36, the process returns to step S2, and the character 34
6 (step S6).
7), the detected value detected in step S4 and the character 3
4 are compared (step S8). After this,
According to the comparison result, an operation for changing the correction value used in step S5 is performed (step S9), a new correction value is obtained from the operation result (step S10), and the process returns to step S2.

In the subsequent processing, the processing in steps S2 to S10 is repeated, and the processing in steps S8 to S10 is repeated.
The correction value is sequentially updated each time the process proceeds to step. However, when the correction value is updated only once and the character 34 does not reach the target position, the correction value is not updated and the movement result of the character 34 is displayed. Just repeat the same game or
You can also move to another game.

As described above, according to the present embodiment, the character 34 can be moved according to the mind of the operator, and the character 34 can be moved by using the brain activity of the operator itself without using hands or feet. Can be moved.

In playing the game, before the game is started, in order to use the personal database of the operator as data for compatibility diagnosis, data indicating the degree of mind of the individual operator is collected and collected. Data can be incorporated into the game. In this case, it is possible to play a game that matches the skill and tendency of the operator.

For example, game scenes (scenes) such as game content, ease of use, and difficulty can be changed according to individual skills.

When the degree of mind of the operator is displayed as an image, the color of the character 34 is changed according to the mind.
For example, it can be changed in red, green, and blue.

In the above embodiment, the optical topography apparatus used for a game has been described. However, this apparatus can be used for education and the like. For example, it is possible to make each student wear the fixture 18 and determine whether or not he / she understands what the teacher has said, based on the degree of mind of each student.

Database 3 collected as personal information
For example, when the database 32 is connected to a network (Internet) and the data connected to the network is used by the database 32, the access including the registration number set in advance is used. Only the method of opening the database 32 can be adopted. In this case, the registration number can be configured by encryption.

[0053]

As described above, according to the present invention,
When the user (operator) makes a remembrance without using his / her hands or feet, the control target can be controlled in accordance with the degree of the remembrance.

Further, according to the present invention, an experienced person (operator)
It is possible to display an image in accordance with the way of thinking, or to control the movement of the operation target or the character in accordance with the way of thinking.

[Brief description of the drawings]

FIG. 1 is a block diagram of an optical topography apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram for explaining an operation method when the optical topography device is used for a game.

FIG. 3 is a flowchart illustrating an operation when the optical topography apparatus is used in a game.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Controller 12 Switch 14 Light source 16 Optical fiber 18 Fixture 20 A / D converter 22 Photoelectric converter 24 Optical fiber 26 Head 28 Display 30 Equipment 32 Database 34 Character 36 Hole

 ────────────────────────────────────────────────── ─── Continuing from the front page (72) Inventor Tsuyoshi Yamamoto 2520 Akanuma, Hatoyama-cho, Hiki-gun, Saitama F-term in Hitachi, Ltd. Basic Research Laboratory (Reference) 2C001 BB08 BC06 CA00 CA09 2G059 AA01 AA05 BB12 CC18 EE01 EE02 FF04 GG01 HH01 JJ17 KK02 MM01 MM05 MM09 MM10 PP04 4C038 KK00 KK01 KL05 KL07 KM00 KX01

Claims (12)

[Claims] 1. A light irradiation means for irradiating a head including a brain with light, and a reflected light of a light transmitted through the blood in the head among light irradiated on the head from the light irradiation means. An optical photography apparatus comprising: a light-collecting unit that emits light; and a control unit that controls a control target based on the intensity of light collected by the light-collecting unit. 2. A light irradiating means for irradiating a head including a brain with light, and a reflected light of light transmitted through blood in the head among light irradiating the head from the light irradiating means. A light condensing means, a photoelectric conversion means for converting the light condensed by the light condensing means into an electric signal corresponding to the intensity thereof, and a screen displaying an image corresponding to the level of the electric signal output from the photoelectric conversion means. An optical potography apparatus comprising: a display means for displaying the information on the top. 3. A light irradiating means for irradiating a head including a brain with light, and a reflected light of a light transmitted through blood in the head among light irradiating the head from the light irradiating means. A light-collecting unit that emits light, a photoelectric conversion unit that converts light collected by the light-collecting unit into an electric signal corresponding to the intensity thereof, and compares the level of an electric signal output from the photoelectric conversion unit with a set value. An optical photography apparatus comprising: an operation signal output unit that outputs an operation signal corresponding to the comparison result; and a display unit that displays an image corresponding to the operation signal on a screen. 4. A light irradiating means for irradiating a head including a brain with light, and a reflected light of light transmitted through blood in the head among light irradiating the head from the light irradiating means. A light-collecting unit that emits light, a photoelectric conversion unit that converts light collected by the light-collecting unit into an electric signal corresponding to the intensity thereof, and compares the level of an electric signal output from the photoelectric conversion unit with a set value. Operating signal output means for outputting an operation signal corresponding to the comparison result; display means for displaying an image including the operation target on the screen; and controlling movement of the operation target on the screen in response to the operation signal An optical potography apparatus comprising: 5. A light irradiating means for irradiating a head including a brain with light, and a reflected light of a light transmitted through blood in the head among light irradiating the head from the light irradiating means. A light-collecting unit that emits light, a photoelectric conversion unit that converts light collected by the light-collecting unit into an electric signal corresponding to the intensity thereof, and compares the level of an electric signal output from the photoelectric conversion unit with a set value. Operation signal output means for outputting an operation signal according to the comparison result; display means for displaying an image including a character on a screen; and an image for controlling movement of the character on the screen in response to the operation signal An optical potography apparatus comprising a control unit. 6. The optical photography apparatus according to claim 1, wherein said light is near-infrared light. 7. A light irradiating means for irradiating light to a head including a brain, and a light condensing means for condensing reflected light of light transmitted through blood in the head among the light irradiated to the head. And photoelectric conversion means for converting the light collected by the light collection means into an electric signal corresponding to the intensity thereof; and data indicating a change in the blood based on the electric signal obtained by the photoelectric conversion means. A data generation device comprising: a data generation unit that generates data in association with an axis. 8. The data generation device according to claim 7, wherein the change in blood is a change in the amount of blood or a change in hemoglobin concentration in blood. 9. The data generating apparatus according to claim 7, further comprising a stimulating means for stimulating said brain in association with a plurality of parameters for data to be generated. 10. The data generation device according to claim 7, wherein the light is near-infrared light. 11. A database storing data generated by the data generation device according to claim 7. Description: 12. When using a database storing data generated by the data generation device according to any one of claims 7, 8, 9 and 10 via a network, the database is set in advance. A method of using a database, wherein the database is opened only for an access including a registration number.