JPH09330159A - Data processor, game controller data processing method and game processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To change an operating method and a processing result according to the physiological state or metal state of an operator by detecting physiological information on the operator and changing a man-machine interface system such as the operating method according to sensitivity information detected from the physiological information. SOLUTION: A physiological information measurement part 3 measures the breathing rate, body temperature, brain wave, etc., of the operator. A physiological information selection part 4 selects physiological information which is useful in the physiological information measured by the physiological information measurement part 3 according to the physiological information to be selected which is indicated by a control part 2, and a physiological information detection part 5 performs noise removal and normalization for the physiological information and inputs the result to the control part 2. The control part 2 detects sensitivity information from the inputted physiological information and changes a man-machine interface such as the operating method according to the sensitivity information. For example, when the sensitivity information is larger than a threshold value, it is decided that the operator jacks himself or herself, and a large action (e.g. punch force) is set.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data processing device which detects kansei information of an operator and changes a man-machine interface such as an operating method or a conversion parameter when converting input data based on the kansei information. And a game control device.

[0002]

2. Description of the Related Art A general computer game, a video game or the like is a game played by moving a character or the like displayed on a screen by operating an operation section. As the operation unit, there is one including a joystick and a plurality of operation buttons, and one using a mouse as the operation unit.
There are various types of games. For example, in an action game, a player (operator) operates the operation unit to cause a character to jump or to perform a technique such as punching or kicking, and Dodging the attack
It is a game in which an enemy is attacked and the enemy is defeated. There are other types of games such as shooting games, role-playing games, and simulation games, but the description thereof is omitted here.

Recently, a device has been proposed in which the mental state of the player is also influenced to the progress of the game so that the player can enjoy the game in a more realistic manner (Japanese Patent Laid-Open No. Hei 6).
-296957).

[0004]

However, conventionally, whether or not a player can play a game well depends on whether or not his / her hands are dexterous. For example, in the case of an action game, the operation of the operation unit is complicated in order to make an attack that causes great damage to the enemy. For example, in order to take out a big technique called summer salt kick (a technique that causes a great deal of damage to an enemy), the following operations (1) to (3) had to be continuously performed. Note that the operation portion is provided with a joystick and four buttons A, B, C, and D (see FIG. 6A). Operate the A button with the joystick tilted to the left. Operate the B button. Operate the C and D buttons simultaneously. Operate the A button with the joystick tilted up. For this reason, there is a problem that a person having a handicap cannot enjoy the game because he / she cannot perform such a continuous operation and cannot use a great skill.

An object of the present invention is to change a man-machine interface such as an operating method or a conversion parameter for converting input data based on a physiological condition or a mental condition of the operator so as to change the physiological condition of the operator. It is to provide a data processing device in which an operation method and a processing result change according to a state or a mental state.

It is another object of the present invention to provide a game control device that enables even a person with handicap to play a game while enjoying it.

[0007]

According to a first aspect of the present invention, in a data processing device for processing data input from an operation section and outputting the processing result, physiological information for detecting physiological information of an operator. A detection means; and a change means for detecting the emotional information of the operator from the physiological information detected by the physiological information detecting means, and changing the man-machine interface method such as the operating method based on the emotional information. Is characterized by.

With this configuration, the sensitivity information of the operator is detected from the physiological information detected by the physiological information detecting means. Here, the kansei information is a feature amount obtained from the physiological information of the operator (human) or information about the operator (information expressing a physiological state or a mental state) obtained by processing a plurality of types of physiological information. To tell. The changing unit changes the man-machine interface such as the operating method based on the detected affective information. Therefore, since the man-machine interface such as the operating method is changed according to the physiological state or mental state, the operator can perform an operation adapted to the physiological state or mental state at that time.

According to a second aspect of the present invention, there is provided a data processing device which processes data input from the operation unit using a conversion parameter and outputs the processing result,
Physiological information detecting means for detecting the physiological information of the operator, and the emotional information of the operator is detected from the physiological information detected by the physiological information detecting means, and based on the emotional information, the input data is processed. And a conversion parameter changing means for changing the conversion parameter at the time.

In this configuration, the conversion parameter for processing the input data is changed based on the detected sensitivity information. That is, the processing result can be different depending on the physiological condition or mental condition of the operator even when the same input is made.

Further, the skin impedance (SIR) may be used as the physiological information, or the detecting section may be provided in the operating section.

According to a fifth aspect of the present invention, in a game control device having an operation section for operating a character displayed on a screen, physiological information detecting means for detecting physiological information of an operator, and the physiological information. Changing means for detecting the kansei information of the operator from the physiological information detected by the detecting means and changing the operation method of the character based on the kansei information.

In this configuration, since the character operation method is changed based on the detected affective information, for example,
If you change the operation when making a big skill that was complicated to operate with a simple operation depending on your mental state, you could not do it because you could not operate normally because your fingers were inconvenient. Can be easily accessible. As a result, even a person with a clumsy hand can entertain the game sufficiently. In addition, the character is an object that acts on the screen as a main character of the game or an enemy role in the game. A tank in a battle game, a player in a fighting game, or the like corresponds to this character.

According to a sixth aspect of the present invention, in a game control device having an operation section for operating a character displayed on a screen, physiological information detecting means for detecting physiological information of an operator, and the physiological information. Characteristic value changing means for detecting the emotional information of the operator from the physiological information detected by the detecting means and changing the characteristic value of the character based on the emotional information.

With this configuration, since the characteristic value of the character is changed based on the kansei information, the contents of the game can be made easy or difficult depending on the physiological state or mental state.

Further, if the parameter for determining the punching power of the character in the action game is changed, the enemy can be easily defeated.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a diagram showing the configuration of a game device provided with a data processing device (game control device) according to an embodiment of the present invention. The game device 1 includes a control unit 2
, Physiological information measuring unit 3, physiological information selecting unit 4, physiological information detecting unit 5, operating unit 6, operating device selecting unit 7, operating signal detecting unit 8, display unit 9, and game software read Part 10
And The physiological information measuring unit 3 includes a respiration measuring device 11 that measures the respiration rate of the player, a blood pressure measuring device 12 that measures blood pressure, and a body temperature measuring device 13 that measures body temperature.
An electroencephalogram measuring device 14 for measuring an electroencephalogram, a pulse wave measuring device 15 for measuring a pulse wave, and a skin impedance measuring device 16 for measuring skin impedance. Respiration measuring device 11, blood pressure measuring device 12, body temperature measuring device 1
3, the electroencephalogram measuring device 14, the pulse wave measuring device 15, and the skin impedance measuring device 16 are known devices. As shown in FIG. 2, the respiration measuring device 11 inserts a thermistor into the nostril to measure the temperature due to respiration. It detects changes. In addition, the skin impedance measuring apparatus attaches an electrode to the skin and then SIR (Skin Impedance Reflect).
x) Measure the waveform. Blood pressure, body temperature, EEG, pulse wave, etc. are also measured by known methods.

The physiological information selecting section 4 selects useful physiological information from the physiological information measured by the physiological information measuring section 3 and inputs the selected physiological information to the physiological information detecting section 5. The physiological information selection unit 4 is instructed by the control unit 2 of physiological information to be selected. The physiological information detecting unit 5 performs noise removal and normalization on the input physiological information, and inputs the result to the control unit 2. The operation unit 6 includes a joystick 21 and a mouse 22 as operation devices. The operation device selection unit 7 is the joystick 2
At least one of 1 and the mouse 22 is selected as an effective operation device (device for inputting data). The operation signal detection unit 8 detects an effective operation of the selected operation device and inputs it to the control unit 2. The game software reading unit 10 reads the game software stored in the CD-ROM 33 and inputs the game software to the control unit 2 and inputs the game software sent via the network 34 and the CD-ROM driver 31 to the control unit 2. It has a network control unit 32.

The relationship between physiological information and mental state will be briefly described below. Regarding the relationship between physiological information and mental state, "Electrical electrical activity (Ryozumi Niimi, Jiro Suzuki / Ebisu Publishing Co., Ltd.)" and "Quantification of alertness level by EEG alpha wave analysis" (5th Symposium on Biological and Physiological Engineering) (Matsushita Electric Works, Ltd. Central Research Center Akihiro Michimori, Kazunori Araki, Kei Hagiwara) and "Relationship between body temperature, heart rate and performance during night shift duty (7th Symposium on Biological and Physiological Engineering)" (Matsushita Electric Works Co., Ltd. ) Central Research Institute, Chisakiko Yamamoto, Kei Hagiwara, Kazunori Araki, Akihiro Michimori et al.)) And "Sleep Suppression Control System Based on Dermal Electrical Activity and Fuzzy Reasoning (The Institute of Electrical Engineers of Japan)" (Koichi Isshiki (Takuma Radio Technical College), Naotake Yamamoto) (Okayama Univ.) ”, Etc. For example, if skin impedance, pulse wave, heartbeat, etc. have large numerical values, peak intervals fluctuate, or peak frequency changes, psychological fluctuations are large. And Looking at the mental state of a person from the EEG, it is estimated that the α wave is in a concentrated state, the β wave is in an excited state, and the θ wave is in a relaxed state. It

The operation of the game device 1 according to this embodiment will be described in detail below. In the game device 1, the game software reading section 10 reads the game software. The game software read here is, for example, a CD-
It is stored in a storage medium such as the ROM 33 or is transmitted via the network 34. The control unit 2 executes the game software read by the game software reading unit 10.

The control unit 2 also instructs the physiological information selection unit 4 which of the various physiological information measured by the physiological information measuring unit 3 is useful physiological information. The physiological information selection unit 4 inputs only the physiological information instructed here to the physiological information detection unit 5. Here, the method for the control unit 2 to determine whether or not the physiological information is useful is to use physiological information in which the measured value hardly changes for a long time or physiological information that does not show a change as a characteristic of the physiological information. It is determined that the physiological information is not. In other words, the control unit 2 determines that the physiological information in which the measurement value changes drastically or the physiological information in which the characteristic change of the physiological information appears is useful physiological information. The physiological information detecting unit 5 performs a process of removing noise and normalizing the physiological information input from the physiological information selecting unit 4, and inputs this to the control unit 2.

The control unit 2 detects sensitivity information from the input physiological information. FIG. 3 is a flowchart showing this processing. The software shown in this flowchart is stored in a storage medium such as the above-described CD-ROM 33 or included in game software transmitted via the network 34. Here, an example will be described in which the input physiological information (physical information considered to be useful) is skin impedance. The electrodes for measuring the skin impedance are provided on the joystick, and are configured so that the skin impedance of the player who operates the joystick can be detected. Changes in the skin impedance (SIR) input to the control unit 2 are shown in FIG. Although not shown, the control unit 2 has an area for storing the maximum value (Max) and the average value (Ave) of the skin impedance. The control unit 2 determines whether or not it is the peak of SIR depending on whether or not the following conditions are satisfied (n1). SIR ≧ Th + Ave Th = (Max−Ave) × α / 100 (α is a preset value.) As described above, since the average value is used to determine whether or not it is the peak of SIR, It is possible to detect whether or not it is the peak time of SIR without being affected by the individual difference caused by the difference in the player.

If it is a peak, the control unit 2 resets a timer (not shown) (n2) and proceeds to n3. If it is not a peak, the process proceeds to n3 without performing the process of n2. That is, this timer measures the elapsed time since the peak was detected. The control unit 3 calculates and updates the average value of SIR in n3. Then, the control unit 2 calculates the size of the current affective information A (n4). As the sensitivity information A, for example, as shown in FIGS. 5B to 5D, a function that changes depending on the elapsed time from the peak of SIR is preset. FIG. 5A shows the SIR waveform. For example, in the example shown in FIG. 5B, the sensitivity information A increases as the elapsed time increases, and in the example shown in FIGS. 5C and 5D, the sensitivity information A decreases as the elapsed time increases. It is a setting. Note that this difference in setting is appropriately selected depending on the type of game.

The function in each figure is expressed by the following equation. 5 (B) Sensitivity information A = A1 * T FIG. 5 (C) Sensitivity information A = AMAX-A2 * T FIG. 5 (D) Sensitivity information A = AP + D-A3 * T where A1, A2, and A3 are constants. T is the elapsed time from the peak AMAX is a preset maximum value AP is the magnitude of the emotional information A immediately before the peak detection D is a preset constant Figure 5 (C) and Figure 5 (D) The difference is that in FIG. 5 (C), when the peak is detected, the size of the sensitivity information A is set to the maximum value (AMA
5C, on the other hand, in FIG. 5C, when the peak is detected, the size of the sensitivity information A is increased to the size of the sensitivity information immediately before that (AP) by a predetermined amount (D). This is the point to set.

The control unit 2 controls the sensitivity information A calculated here.
Is greater than a preset threshold value (n5), and setting is performed based on the result (n5).
6, n7). For example, in the case of an action game, the patterns as shown in FIGS. 5C and 5D are set so that the value calculated as the affective information A is a value indicating the degree of enthusiasm, and the affective information A is When the value is larger than the threshold value, it is easy to perform the technique (large technique) that determines that the operator is enthusiastic and causes great damage to the enemy, and the punching power is increased. A. On the contrary, when it is determined that the sensitivity information A is smaller than the threshold value and the operator is not enthusiastic, the normal setting B is set.

For example, in order to bring out a technique called a normal summer salt kick (a technique which causes a great deal of damage to an enemy), in the case of setting B, the following operations of ~ with the joystick 21 shown in FIG. You have to do this continuously, but operate the A button with the joystick tilted to the left. Operate the B button. Operate the C and D buttons simultaneously. Operate the A button with the joystick tilted up. When the degree of enthusiasm exceeds the threshold value (in the case of setting A), by operating the A button while the joystick is tilted upward, it is changed to be able to perform this technique. Further, in the setting B, the conversion parameter is changed such that if the damage given to the opponent by the punch is 5 points, in the case of the setting A, it is changed to 8 points. further,
As an example of changing the conversion parameter, various performances of the character can be changed such as increasing the jumping power. In this way, the man-machine interface method such as the operation method is changed by setting A or setting B,
Change the conversion parameters.

The magnitude of the affective information A is displayed as a level on the screen as shown in FIG. 7, so that the player can know his / her current mental state. Further, this level display is provided with an indicator (← in the figure) indicating a threshold value, and it is possible to easily determine whether or not the sensitivity information A exceeds the threshold value S. Note that FIG.
(A) is the case of setting B in this embodiment,
FIG. 7B shows the case of setting A.

As described above, in the case of an action game, when the spirit A increases and becomes larger than the threshold value S, the operation of the character can be simplified. Therefore, even for those who could not perform the operation to perform the above-mentioned technique of summer salt kick because their fingers were inconvenient,
You will be able to enjoy playing because you will be able to perform such moves depending on your mental state.

In the above example, the action game is described as an example, but the present invention can be applied to a game as shown in FIG. 8, for example. The game shown in FIG. 8 is a game of aiming at a ball with a different color out of five balls floating in space and shooting. When the player's spirit and agitation are detected, the speed of movement of the ball becomes faster and the size of the ball becomes smaller, making it difficult to shoot (Fig. 8 (A)).
(Setting B) On the other hand, if no enthusiasm or agitation is detected, all the balls will collect in the vicinity of the center and the balls will be easier to shoot (Setting A). If this game,
As shown in (A), the sensitivity information A may be set to increase as the elapsed time increases.

Further, in a normal case, the character is configured to be operated only by the joystick 21 (setting B), and when the sensitivity information A becomes larger than the threshold value S, the mouse 22 (see FIG. 6B) or the trackball. (Figure 6 (C)
The man-machine interface method may be changed so that the character can be operated (see A). By doing so, the game can be played while operating both the joystick 21 and the mouse 22, and the game can be further enjoyed. If the sensitivity information A> threshold value S, the mouse 22 can be freely operated and a special operation such as double-clicking can be performed.
In that case, the mouse 22 may be changed so that the character can be operated only up and down or a special operation such as double-click cannot be performed.

Further, the operation of the character may be switched from the joystick 21 to the mouse 22. Further, when the sensitivity information A is low, it can be set so that a specific operation cannot be performed.

In the above embodiment, the data processing device of the present invention is applied to the game device 1. However, the present invention is not limited to this. For example, a device for executing educational software. Can also be applied to. In this case, it is preferable to set such that a value indicating the degree of concentration is detected as the sensitivity information A from the physiological information. Then, it is possible to make learning so that the degree of concentration does not decrease, or to give attention when the degree of concentration decreases, so that the person who is learning can always be concentrated on learning.

[0033]

As described above, according to the present invention, the conversion parameters for switching the man-machine interface including the operation method and converting the input data depending on the physiological state or mental state of the operator. It can be changed, and the operator can perform an operation according to a physiological state or a mental state.

In particular, when used as a game control device, even if the operation of moving a character (operation of making a trick) is complicated at normal times, setting is made to simplify the operation when the mental state becomes high. By doing so, even a person who cannot keep up with the operation due to the clumsiness of the hand at normal times can easily perform the technique by raising the mental state. Therefore, even a person who is not dexterous can play the game well.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a game device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a method of detecting physiological information.

FIG. 3 is a flowchart showing a game device process according to the embodiment of the present invention.

FIG. 4 is a diagram showing changes in skin impedance.

FIG. 5 is a diagram showing a graph of a function used when calculating sensitivity information.

FIG. 6 is a diagram showing appearances of a joystick, a mouse, and a trackball.

FIG. 7 is a diagram showing a display screen of an action game.

FIG. 8 is a diagram showing a display screen of a shooting game.

[Explanation of symbols]

 1-Game device 2-Control unit 3-Physiological information measuring unit 4-Physiological information selecting unit 5-Physiological information detecting unit 6-Operating unit 7-Operating device selecting unit 8-Operating signal detecting unit 9-Marking unit 10-Game software Read-out unit 16-skin impedance measuring device

Claims (14)

[Claims] 1. Processing data input from the operation unit,
In the data processing device that outputs the processing result, the physiological information detecting means for detecting the physiological information of the operator, and the emotional information of the operator is detected from the physiological information detected by the physiological information detecting means. A data processing apparatus, comprising: a changing unit that changes a man-machine interface method such as an operating method based on the operation method. 2. A physiological information detecting means for detecting physiological information of an operator in a data processing device for processing data input from an operating section using a conversion parameter and outputting the processing result, and the physiological information detecting means. And a conversion parameter changing unit for changing the conversion parameter when processing the input data based on the sensitivity information of the operator detected from the physiological information detected by the means. A data processing device characterized by: 3. The data processing device according to claim 1, wherein the physiological information detecting means is a skin impedance detecting means for detecting a skin impedance (SIR). 4. The data processing apparatus according to claim 3, wherein the skin impedance detecting means is provided in the operation section. 5. A game control device having an operation section for operating a character displayed on a screen, comprising: physiological information detecting means for detecting physiological information of an operator; and the physiological information detected by the physiological information detecting means. A game control device comprising: a change unit that detects the kansei information of an operator and changes the character operation method based on the kansei information. 6. A game control device having an operation section for operating a character displayed on a screen, comprising: physiological information detecting means for detecting physiological information of an operator; and the physiological information detected by the physiological information detecting means. A game control device comprising: a characteristic value changing unit that detects the emotional information of the operator and changes the characteristic value of the character based on the emotional information. 7. The game control device according to claim 6, wherein the characteristic value changing means is means for changing a parameter that determines the punching power of the character. 8. Processing data input from the operation unit,
In a data processing method that outputs the processing result, it is possible to detect the physiological information of the operator and change the man-machine interface method such as the operating method based on the detected emotional information of the operator from the detected physiological information. Characterizing data processing method. 9. Processing data input from the operation unit,
In the data processing method for outputting the processing result, the conversion parameter when detecting the physiological information of the operator and processing the data input based on the detected emotional information of the operator from the detected physiological information A method for processing data, characterized by: 10. The data processing method according to claim 8, wherein skin impedance (SIR) is detected as the physiological information. 11. The data processing method according to claim 10, wherein the skin impedance is detected from a hand or the like of an operator who operates the operation unit. 12. A game control method in which an operation unit operates a character displayed on a screen, the physiological information of the operator is detected, and the character is detected based on the emotional information of the operator detected from the detected physiological information. And a changing means for changing the operating method of the game control method. 13. A game control method for operating a character displayed on a screen with an operation unit, wherein physiological information of an operator is detected, and a screen is displayed based on the sensed information of the operator detected from the detected physiological information. A game control method characterized by changing a characteristic value of a character displayed above. 14. The game control method according to claim 13, wherein a parameter for determining punching force is changed as a characteristic value of the character.