JP2008200115A - Input control system and its signal processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a game apparatus for monitoring techno-stress of a player during a game and making a player himself/herself have a consciousness of the techno-stress. <P>SOLUTION: An input control system controls processing of a game apparatus by wirelessly transmitting a signal to the game apparatus according to the content of operation by a player. The input control system includes: means for detecting a signal according to the content of the operation by the player (205-207); means for detecting the pulse of the player operating the input control system (209); means for analyzing the time domain about R-R interval of the detected pulse and calculating fluctuation of the pulse from the analysis result (204-1, 204-2); means for processing the detected signal from the fluctuation (204-4); and means for wirelessly transmitting the processed signal to the game apparatus (210). <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an input control device for a game device and an information processing method thereof.

Conventionally, a player's stress (technostress) caused by playing a game for a long time has been a problem. In particular, some experts point out the technostress as a cause of juvenile crime, which has increased significantly in recent years. For this reason, it has become important for game device manufacturers that provide game devices to develop game devices that take into account not only the fun of the game but also the problems of technostress.
JP-A-9-22314

  However, there are individual differences in technostress, and there is a difference in how technostress is applied depending on the content of the game even for the same person. For this reason, for example, simply monitoring the time spent by a player on a game is not sufficient for managing technostress, and it is desirable to directly monitor technostress.

  In addition, if the game is forcibly terminated when technostress is accumulated to a certain extent, the interest of the game is significantly impaired for the player. For this reason, it is desirable that the player be aware of his / her technostress and voluntarily end the game.

  The present invention has been made in view of the above-described problems, and realizes a game apparatus that can monitor a player's technostress during a game and can make the player aware of his / her technostress. .

In order to achieve the above object, an input control device for a game device according to the present invention has the following configuration. That is,
An input control device that controls processing in the game device by transmitting a signal corresponding to the operation content of the player to the game device,
Detection means for detecting a signal corresponding to the operation content of the player;
A pulse detecting means for detecting a pulse of a player who operates the input control device;
Analyzing means for performing time domain analysis on the pulse interval detected by the pulse detecting means,
Based on the analysis result by the analysis means, a calculation means for calculating the degree of fluctuation of the pulse,
Processing means for processing a signal detected by the detection means based on the degree of fluctuation;
Transmitting means for transmitting the signal processed by the processing means to the game device.

  According to the present invention, it is possible to monitor a player's technostress during a game and to make the player aware of his / her technostress.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings as necessary. In the game devices described in the following embodiments, the player's technostress is monitored by detecting and analyzing biological information related to the player's technostress during the game.

  Specifically, a pulse is detected as biological information related to the player's technostress. Then, the “fluctuation degree” calculated by using the geometric figure analysis method of time domain analysis for the detected pulse is extracted as the player's technostress.

In each of the following embodiments, when calculating the degree of fluctuation, the Lorentz plot is adopted as a geometric figure analysis method for time domain analysis, but as a time domain analysis method for calculating the degree of fluctuation, The invention is not particularly limited to this. As an index of the degree of fluctuation, a triangle index which is another geometric figure analysis method of time domain analysis, SDNN, SDANN, r-MSSD which is time / domain analysis, RR50 (NN50), pNN50 (φ ₀ NN50), CVRR or the like may be adopted.

  In each of the following embodiments, in order to make the player aware of technostress, the state of the player's technostress is reflected in the game content. Specifically, the output signal output from the input control device of the game device operated by the player is controlled according to technostress.

  As a control method at this time, the output signal output from the input control device is delayed with respect to the player's operation timing, or the output signal is weakened with respect to the player's operation amount. Conceivable. Among these, in the following embodiments, a case where an output signal for acceleration is controlled will be described by taking, as an example, a rod-like input control device that can detect a change in motion or posture as an input control device of a game device.

[First Embodiment]
1. Overview of Lorentz plot First, the Lorentz plot as an index representing the degree of fluctuation will be briefly described. The Lorentz plot is known as a method for evaluating the enhanced state of the sympathetic nerve and the parasympathetic nerve. In general, it is important that the sympathetic nerve and the parasympathetic nerve are balanced. If the balance between the sympathetic nerve and the parasympathetic nerve is disturbed by technostress or the like, the degree of fluctuation is affected.

  The Lorentz plot is a visualization of this degree of fluctuation based on biological information such as a pulse.

  7 and 8 are diagrams illustrating a method of generating a Lorentz plot based on a pulse waveform. When pulse waveforms as indicated by reference numeral 701 in FIG. 7 are collected, the position of the R wave is first identified, and the RR interval is calculated. The R wave refers to the peak portion of the pulse waveform, and the RR interval refers to the pulsation interval of the nth beat (n is an arbitrary integer) and the (n + 1) th beat of the R wave. In the example of FIG. 7, the positions of the R waves are identified as R1, R2, R3, and R4, respectively, and the RR intervals are calculated as T21, T32, and T43, respectively.

  Based on the calculated RR interval, T21 is plotted on the horizontal axis and T32 is plotted on the vertical axis in the two-dimensional graph region shown in FIG. Further, T32 is plotted on the horizontal axis and T43 is plotted on the vertical axis. A Lorentz plot is generated by sequentially performing such processing for successive RR intervals (position coordinates in the two-dimensional graph area of each plot at this time are referred to as Lorentz plot data).

  For reference, FIG. 9 shows an example of the generated Lorentz plot. (A) generally shows a good balanced state, (b) and (c) show an unbalanced state ((b) shows stress / disease patterns, (c) shows Each showing an arrhythmia pattern).

2. External Configuration of Game Device Next, an external configuration of a game device including the input control device according to the present embodiment will be described with reference to FIGS. 1A and 1B.

  FIG. 1A is a diagram illustrating a state in which a game device 100 including an input control device according to the present embodiment is connected to a television (TV) 103 serving as an image display unit.

  In the figure, reference numeral 101 denotes a controller that is an input control device of the game apparatus 100. The controller 101 includes a controller main body 111 that is a rod-shaped input control device capable of detecting movements and posture changes based on player operations, and pulse detection that is wound around the player's wrist and detects the player's pulse. The pulse signal detected by the pulse detector 112 is taken into the controller main body 111 via the cable 113.

  Reference numeral 102 denotes a game apparatus main body, which advances a game based on an instruction from the controller 101. For example, in the case of a game of fighting with a sword, a sword possessed by a character appearing in the game operates in response to the player swinging the controller 101. Reference numeral 103 denotes a television (TV), which displays game content based on processing in the game apparatus main body 102.

  FIG. 1B is a diagram illustrating an external configuration of the controller 101. As shown in the figure, in the state where the pulse detection unit 112 is wound around the wrist, the player grasps the controller main body 111 and performs an operation of swinging or turning the controller main body 111 according to the contents of the game. be able to.

  An operation button 121 is provided in the vicinity of the thumb or index finger when the player holds the controller main body 111, and an operation necessary for the progress of the game can be input. The lamp 123 is a measurement lamp that indicates whether or not the pulse of the player can be normally detected by the pulse detection unit 112. When the lamp is normally detected, the lamp 123 is lit in green, and is not normally detected. Lights up red.

  The lamp 122 is a fluctuation level display lamp that lights up in accordance with the fluctuation degree calculated based on the pulse detected by the pulse detection unit 112. When it is within the normal fluctuation range, all fluctuation level display lamps light up in green.When the fluctuation level is outside the normal fluctuation range, the fluctuation level display lamps gradually turn off according to the degree. To go.

  The pulse detection unit 112 detects the player's pulse by wrapping around the player's wrist. Here, the pulse is detected by the pressure method, but the detection method is not particularly limited to this, and an electrode method or the like may be used.

3. Functional configuration of game device
3.1 Functional Configuration of Controller 101 FIG. 2A is a diagram showing a functional configuration of the controller 101 according to the first embodiment of the present invention. In the figure, reference numeral 201 denotes a clock unit which oscillates a clock signal and supplies it to the CPU 202. Reference numeral 202 denotes a CPU which operates based on a clock signal oscillated from the clock unit 201. A RAM 203 functions as a work area for a program processed by the CPU 202 and also functions as a storage unit that temporarily stores data and the like during program processing. A ROM 204 stores a program to be processed by the CPU 202.

  Reference numeral 205 denotes an input device, which includes operation buttons 121 (FIG. 1B) for inputting operations necessary for the progress of the game, a power switch not shown in FIG. 1B, and the like.

  206 is a multi-axis acceleration sensor, which is built in the controller main body 111, and detects and outputs acceleration (direction and speed of three-axis movement) corresponding to one to three dimensions of the controller 101 operated by the player. It is.

  Reference numeral 207 denotes a multi-axis gyro sensor, which is built in the controller main body 111 and detects a tilt or twist corresponding to a one-dimensional to three-dimensional operation of the controller 101 operated by the player (front / rear / right / left tilt and rotation around the axis). Sensor.

  A lamp unit 208 includes various lamps such as a lamp (not shown) (for example, a power lamp) in FIG. 1B in addition to the fluctuation level display lamp 122 and the measurement lamp 123 shown in FIG. 1B.

  Reference numeral 209 denotes a pulse detector, which measures the player's pulse.

  A data transmission unit 210 wirelessly transmits an instruction signal corresponding to the operation performed by the player via the input device 205 to the game apparatus main body unit 102. Further, the detection is detected by the multi-axis acceleration sensor 206 or the multi-axis gyro sensor 207 by the player swinging or turning the controller 101 according to the content of the game, and processed by a sensor output processing unit 204-5 described later. A signal is wirelessly transmitted to the game apparatus main body 102.

  Functions realized by the program stored in the ROM 204 are shown in 204-1 to 205-6. 204-1 is a pulse detection processing unit that receives the pulse data output from the pulse detection unit 209, identifies an R wave of the pulse waveform based on the received pulse data, and calculates Lorentz plot data.

  Reference numeral 204-2 denotes a fluctuation degree calculation unit. When the Lorentz plot data calculated by the pulse detection processing unit 204-1 is normally received for a predetermined time, the fluctuation degree is calculated based on the Lorentz plot data.

  The fluctuation degree means the size of the distribution area of the two-dimensional graph area (in the input control device according to the present embodiment, the variation of Lorentz plot data).

  Reference numeral 204-3 denotes a lamp display processing unit that controls the lighting of the measurement lamp 123 according to the presence or absence of pulse detection in the pulse detection unit 209. Further, the lighting of the fluctuation level display lamp 122 is controlled according to the fluctuation calculated by the fluctuation calculation unit 204-2.

  A sensor output processing unit 204-4 receives the detection signal output from the multi-axis acceleration sensor, and processes the detection signal based on the fluctuation degree calculated by the fluctuation degree calculation unit 204-2.

Here, between the detection signal (input signal) input to the fluctuation degree calculation unit 204-2 and the detection signal (output signal) output after being processed in the fluctuation degree calculation unit 204-2, the following is performed. The relational expression holds.
(Formula 1)
Y (S) / X (S) = G × e ^−sT
X (S) represents the Laplace transform of the input signal, and Y (S) represents the Laplace transform of the output signal. G represents a gain element, e represents a natural logarithm base, and T represents a dead time element.

  The sensor output processing unit 204-4 changes the gain G and the dead time T based on the fluctuation degree calculated by the fluctuation degree calculation unit 204-2. For example, when the calculated fluctuation degree is out of the normal fluctuation degree range, the value of the gain G is decreased according to the degree. Further, the value of the dead time T is increased.

  As a result, when the calculated fluctuation degree is out of the normal fluctuation degree range (that is, when the player's technostress becomes large), the detection signal of the multi-axis acceleration sensor 206 has a delay of the dead time T. , The gain G is reduced and transmitted. As a result, for example, in a game where a player fights with a sword and the action of the sword that the character appearing in the game swings is determined in response to the operation of the controller 101, if the player's technostress increases, The sword possessed by the character operates with a delay of the dead time T with respect to the operation performed by the person. In addition, the operation speed at that time is slower than when the player's techno-stress is low.

  That is, the player's reaction to the operation of the controller 101 performed by the player becomes dull, and the player can recognize that his / her technostress is increasing.

  A data transmission processing unit 204-5 processes the instruction signal and the detection signal wirelessly transmitted from the data transmission unit 210 so as to be wirelessly transmitted.

3.2 Functional Configuration of Game Device Main Body 102 FIG. 2B is a diagram showing a functional configuration of the game device main body 102 according to the first embodiment of the present invention. In the figure, reference numeral 221 denotes a clock unit which oscillates a clock signal and supplies it to the CPU 222. A RAM 223 functions as a work area for a program processed by the CPU 222 and also functions as a storage unit that temporarily stores data and the like during program processing. Reference numeral 224 denotes an HDD, which stores a program processed by the CPU 222.

  A data receiving unit 225 performs wireless communication with the controller 101 and receives an instruction signal and a detection signal from the controller 101.

  An image output unit 226 outputs video data corresponding to the game content to the television 103. Reference numeral 227 denotes an audio output unit which outputs audio data corresponding to the game content to the television 103.

  Functions 231 to 234 realized by programs stored in the HDD 224 are shown. A game processing unit 231 executes a game based on an operation input from the controller 101 via the data reception processing unit 225. A data reception processing unit 232 receives an instruction signal and a detection signal transmitted from the controller 101.

  An image output processing unit 233 performs processing for outputting video to the television 103 in accordance with the processing content in the game processing unit 231. Reference numeral 234 denotes an audio output processing unit that performs processing for outputting audio to a speaker disposed on the television 103 in accordance with the processing content in the game processing unit 231.

4). Process flow in the controller 101
4.1 Overall Processing Flow Figure 3 is a flowchart showing the flow of overall processing in the controller 101 of the game device according to a first embodiment of the present invention. When the controller 101 is turned on in step S301, it is determined in step S302 whether or not a pulse is detected. If the pulse detection unit 209 is not wound around the player's wrist, or is wound around the player's wrist but is not worn correctly, the pulse is not detected, and the process proceeds to step S303. .

  In step S303, the gain G is set to zero. In this case, even if the controller 101 is operated, the character appearing in the game does not move. That is, unless the pulse is detected, the player cannot advance the game.

  On the other hand, if a pulse is detected in step S302, the process proceeds to step S304, and the measurement lamp 123 is turned on. In step S305, Lorentz plot data is obtained based on the detected pulse, and a measurement process for calculating the degree of fluctuation is executed. Details of the measurement process will be described later.

  In step S306, the fluctuation degree calculated in step S305 is normalized. In step S307, the fluctuation level display lamp 122 is turned on according to the normalized fluctuation degree.

  In step S308, the dead time T and the gain G are determined according to the normalized fluctuation degree. In step S309, the output value of the multi-axis acceleration sensor is adjusted using the dead time T and the gain G determined in step S308.

  In step S310, it is determined whether or not the power is off. If the power is not off, the process returns to step S302. On the other hand, if the power is off, the process is terminated.

4.2 Details of Measurement Process FIG. 6 is a flowchart showing a detailed flow of the measurement process (step S305).

  In step S601, a timer for measuring a predetermined time required to calculate the degree of fluctuation is started. In step S602, calculation of Lorentz plot data is started based on the received pulse waveform.

  In step S603, it is monitored whether Lorentz plot data is continuously calculated. Here, the case where it is determined that the Lorentz plot data cannot be calculated continuously can be broadly divided into two cases. The first is a case where the pulse cannot be detected by the pulse detector.

  The second case is a case where the pulse is detected by the pulse detector, but the calculated Lorentz plot data is not continuous. In the case of the controller 101 according to the present embodiment, the pulse detection unit 112 is mounted on the player's wrist, and the pulse waveform is detected in parallel while the player is operating the controller 101. ing. For this reason, the detection of the pulse waveform may be interrupted depending on the contact state between the player's wrist and the pulse detector 112. As a result, Lorentz plot data is not continuously calculated, and there may be a gap in the middle. In such a case, it is determined that the Lorentz plot data cannot be calculated continuously.

  In the main body 110, the Lorentz plot data necessary for calculating the degree of fluctuation is collected (that is, for a predetermined time after starting the timer, for example, regardless of the cause) If Lorentz plot data can be calculated continuously (until 1 to 5 minutes elapse), the fluctuation degree is calculated for the first time. If reception of Lorentz plot data is interrupted, the timer The Lorentz plot data collected from the start until the calculation is interrupted is deleted, the timer is reset, and the Lorentz plot data is collected again.

  Returning to FIG. 6, a specific description will be given. When calculation of Lorentz plot data is started in step S602, it is determined in step S603 whether Lorentz plot data is continuously received. If it is determined in step S603 that Lorentz plot data can be calculated continuously, the process proceeds to step S604.

  In step S604, it is determined whether or not a predetermined time (a sufficient time for collecting Lorentz plot data necessary for calculating the degree of fluctuation, for example, about 1 to 5 minutes) has elapsed, and the predetermined time has elapsed. Is determined, the timer is reset, and then the process proceeds to step S605 to calculate the degree of fluctuation. In step S606, the calculated degree of fluctuation is stored in a predetermined place in the memory (if the degree of fluctuation is already stored in the predetermined place in the memory, the fluctuation degree is newly calculated. Update in degrees).

  On the other hand, if it is determined that the predetermined time has not elapsed, the process returns to step S603 to determine whether or not the Lorentz plot data can be continuously calculated. Continue to import Lorentz plot data. On the other hand, if the calculation of Lorentz plot data is interrupted before the predetermined time elapses, the process proceeds to step S607, and after the timer is started, it is determined that the Lorentz plot data cannot be continuously calculated. The calculated Lorentz plot data is deleted, and the process proceeds to step S608. In step S608, the timer is reset.

  On the other hand, when the update of the fluctuation degree is completed in step S606, the Lorentz plot data used for the calculation of the fluctuation degree at this time is deleted, and the measurement process is ended.

4.3 Noise Removal in Measurement Process Next, details of the noise removal process in the measurement process (step S305) will be described with reference to FIGS.

  In the present embodiment, since the pulse waveform is detected while the player is operating the controller 101, the pulse waveform detection may be interrupted as described above. On the contrary, when the player moves, the movement of the player's hand may appear as myoelectric noise. Therefore, a function for removing such myoelectric noise is provided.

  FIG. 4 and FIG. 5 are diagrams (examples) that simply show the function of removing myoelectric noise included in the pulse data. FIG. 4 is a diagram showing changes in pulse data with time, with the horizontal axis representing time and the vertical axis representing pulse data.

  In FIG. 4, 404, 405, 407, and 408 indicate the R wave of the pulse waveform. On the other hand, 406 indicates myoelectric noise. FIG. 4 shows a case where the myoelectric noise 406 is removed by providing two kinds of threshold values 402 and 403 in the pulse data, paying attention to the characteristic that the myoelectric noise 406 is larger than the R wave. Is.

  That is, a portion of the pulse data that is smaller than the threshold 402 and larger than the threshold 403 is identified as an R wave.

  On the other hand, in FIG. 5, although there is some variation in the interval between the R waves, focusing on the fact that there is a certain limit, the portion that falls within the certain limit is defined as the R wave, exceeding the certain limit. This is a case in which a portion that is present is regarded as myoelectric noise and is removed.

  Specifically, when 504 is regarded as an R wave, the interval until the next R wave (RR interval) is assumed to be within the range of 503 variations from the time indicated by 502, and received during this time. The pulse data exceeding the predetermined threshold is regarded as an R wave. By repeating this process, the R waves 507 and 508 can be detected and the myoelectric noise 506 can be removed.

  As is clear from the above description, in the game device according to the present embodiment, by attaching a pulse detection unit to the controller of the game device, the pulse waveform of the player who plays the game is continuously detected, and the degree of fluctuation is calculated. It was set as the structure to do. Further, the player's technostress is reflected in the game by adjusting a detection signal of a sensor built in the controller 101 that detects the player's operation based on the calculated degree of fluctuation. Here, the game includes a game imitating sports such as a swing imitating a golf club and a swing imitating a tennis racket.

  As a result, the player can recognize through the game whether or not his / her technostress is increasing. In addition, when technostress becomes large, since the movement of the character appearing in the game is adjusted to be dull with respect to the player's operation on the controller, the game does not last long and the player is brought to the end of the game. It becomes possible to lead.

  In addition, by performing a sport simulation for a long time, such as a swing simulating a golf club or a swing simulating a tennis racket, the degree of heartbeat fluctuation before and after that can be confirmed and improved.

[Second Embodiment]
In the first embodiment, the detection signal output from the multi-axis acceleration sensor is adjusted. However, the present invention is not limited to this, and the detection signal output from another sensor is adjusted. It may be configured. Further, the instruction signal input from the input device may be adjusted.

  In the first embodiment, the dead time T and the gain G are adjusted. However, the present invention is not particularly limited to this, and only one of them may be adjusted. In particular, since the instruction signal input from the input device is an ON / OFF binary signal, only the dead time T is adjusted.

  In the first embodiment, the pressure type pulse detector is used to detect the pulse. However, the present invention is not particularly limited to this. For example, the pulse is detected by an optical method. You may make it detect.

It is a figure which shows a mode that the game device 100 provided with the input control apparatus (controller 101) concerning the 1st Embodiment of this invention is connected to television (TV) 103. 2 is a diagram illustrating an external configuration of a controller 101. FIG. 2 is a diagram illustrating a functional configuration of a controller 101. FIG. 3 is a diagram illustrating a functional configuration of a game apparatus main body 102. FIG. 3 is a flowchart showing the flow of overall processing in a controller 101. It is the figure (an example) which showed simply the function which removes myoelectric noise contained in pulse data. It is the figure (an example) which showed simply the function which removes myoelectric noise contained in pulse data. It is a flowchart which shows the detailed flow of the measurement process (step S305) in the controller 101. FIG. It is a figure for demonstrating the Lorentz plot method based on a pulse waveform. It is a figure for demonstrating the Lorentz plot method based on a pulse waveform. It is a figure which shows an example of a Lorenz plot.

Claims (8)

An input control device that controls processing in the game device by transmitting a signal corresponding to the operation content of the player to the game device,
Detection means for detecting a signal corresponding to the operation content of the player;
A pulse detecting means for detecting a pulse of a player who operates the input control device;
Analyzing means for performing time domain analysis on the pulse interval detected by the pulse detecting means,
Based on the analysis result by the analysis means, a calculation means for calculating the degree of fluctuation of the pulse,
Processing means for processing a signal detected by the detection means based on the degree of fluctuation;
An input control device comprising: a transmission unit configured to transmit the signal processed by the processing unit to the game device. The analysis unit analyzes each coordinate data when the pulse interval of the nth beat and the pulse interval of the (n + 1) th beat are sequentially plotted as the vertical axis or the horizontal axis of the two-dimensional graph region,
The input control apparatus according to claim 1, wherein the calculating unit calculates the degree of fluctuation by obtaining a degree of variation for the coordinate data analyzed within a predetermined time.   The processing means includes one or both of a time delay element that delays the signal detected by the detection means and a gain element that adjusts the gain of the signal, and is based on the degree of fluctuation calculated by the calculation means. The input control apparatus according to claim 1, wherein either or both of the dead time element and the gain element are adjusted.   The input control device according to claim 1, wherein the detection unit includes a sensor that detects a moving direction and a moving speed of the input control device.   The input control apparatus according to claim 1, wherein the detection unit includes a sensor that detects an inclination of the input control apparatus.   The input control apparatus according to claim 1, wherein the detection unit includes an ON / OFF sensor that detects ON / OFF of an operation switch included in the input control apparatus. A signal processing method in an input control device that controls processing in the game device by transmitting a signal according to the operation content of the player to the game device,
A detection step of detecting a signal according to the operation content of the player;
A pulse detection step of detecting a pulse of a player who operates the input control device;
An analysis step for performing a time domain analysis on the pulse interval detected in the pulse detection step,
Based on the analysis result in the analysis step, a calculation step for calculating the degree of fluctuation of the pulse,
A processing step of processing the signal detected in the detection step based on the degree of fluctuation;
A signal processing method comprising: a transmission step of wirelessly transmitting the signal processed in the processing step to the game device. A control program for causing a computer to execute the signal processing method according to claim 7.

Images