JP2003305278A - Information processor and method for information processing, storage medium, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make entertainment to a user in the middle of moving pleasant via the interaction of a character. <P>SOLUTION: The rhythm of the moving of the user is extracted from the moving, and the rhythm of the moving of the user is evaluated to calculate the rhythm and the state of moving of the character. Based on the rhythm and the state of moving of the character, the character is displayed. When the rhythm of walking of the character is pulled into that of the user and the two rhythms become nearly coincident with each other in a synchronous state, the character comes into a good humor and deep familiarity is grown between the user and the character, so that such entertainment as makes moving pleasant is realized. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and an information processing method for interacting with a user through a character, a storage medium, and a computer program, and more particularly to a character according to an internal state such as emotion. Processing apparatus, information processing method, storage medium, and computer program that realize entertainment by controlling the interaction of

More specifically, the present invention relates to an information processing apparatus and an information processing method, a storage medium, and a computer program, which realize entertainment for a moving user through character interaction, and more particularly to a moving user. Information processing apparatus and information processing method for realizing entertainment by controlling the interaction of characters according to the body rhythm of
The present invention relates to a storage medium and a computer program.

[0003]

2. Description of the Related Art With the development of information processing and information communication technology,
Computers have become widespread. For example, computers are actively used not only in advanced technical fields such as academic and research fields, but also in daily life support and entertainment.

In recent years, computer processing has come to be used also in the field of entertainment. For example, a character generated by computer graphics, a computer-controlled robot, etc.
Amusement is enhanced by autonomously performing dialogue behavior according to a command from the user and the surrounding environment.

[0005] Further, such entertainment is
Not only is it used by users who work in specific places such as offices and homes, but it is also required by users who are moving.

[0006] Conventional moving entertainment has the main purpose of "enjoying entertainment while moving", and by making entertainment devices that could not be carried during moving small and portable, it is possible to enjoy the same entertainment while moving. It was only done.

The present inventors need to realize "enjoy the movement itself as entertainment" in order to create completely new entertainment on the move. To this end, it is important to feed back the physical action of movement to entertainment.

Taking walking as an example of such movement,
The mutual entrainment phenomenon (entrainment) is known. Mutual retraction of walking is that two walking people unconsciously pull in the rhythm of the other's gait by capturing the other's gait with visual foot movements and auditory footsteps. Say

[0009] For example, a study on "walking assistance robot" by Yoshihiro Miyake (Hiroshi Shimizu et al., "Ba and co-creation", NTT Publishing,
In 2000, Chapter 4, "Communicability and Co-generation"), proposed a robot motion control using mutual entrainment phenomenon. "Walking robot"
Has attempted to support the walking of elderly people with physical disabilities and persons with physical disabilities by making artificial footsteps by utilizing the mutual entrainment phenomenon of walking rhythms.

From another point of view, such a mutual entrainment phenomenon is not only that the rhythms are simply attracted to each other, but also the unconsciousness between the two who are mutually attracted by sharing the rhythm. Over time, an intimacy similar to a kind of solidarity is fostered. If both parties know each other, a sense of intimacy is simply created. On the other hand, if the two do not know each other, for example, a young woman and an old man (or someone who is hard to remember empathy), the young woman rather hates the development of that intimacy and consciously changes the walking rhythm and runs away. Can also be considered.

[0011] The development of such intimacy is called "rapole (ra
It can be explained from the viewpoint of "pport)". Rapport is a close relationship between counselors (doctors) and clients (patients) in psychotherapy such as counseling, and construction of rapport is the first step of effective treatment. It is considered.

As a technique for constructing such a rapole, there is a "pacing (pacing) that matches breathing, posture, gesture, facial expression, voice tone, speaking tempo, etc.
cing) "is well known. If you can build a rapport with your opponent by pacing and unconsciously create an intimate feeling, you can use a technique called "leading" that gradually controls the opponent's state and shifts to another state.

It can be said that this pacing and reading utilize the above-mentioned pull-in phenomenon.

Taking walking as an example, a rapport is constructed by pacing in accordance with the walking rhythm of the other party, and by gradually reading the walking rhythm, the other party can be finally drawn into his or her walking rhythm.

In the above-mentioned research on "walking assistance robot" by Mr. Mihiro Miyake, the phenomenon of artificial footsteps and the attraction of walking rhythms between people is dealt with. On the other hand, the inventors of the present invention
If it is possible to generate the same phenomenon of walking rhythm between a character (hereinafter simply referred to as “character”) and a person, then enjoy the movement itself as entertainment by creating a sense of intimacy similar to Rapole. Is possible.

For example, Japanese Patent Application Laid-Open No. 11-110514 discloses a pedometer which is used by a user by attaching it to a part of the body and displaying the number of steps according to the walking of the user. Vibration detecting means for detecting the generated vibration, counting means for counting the output of the vibration detecting means to obtain a step count, step count displaying means for displaying the count value of the counting means as step count information, and a character for displaying a character for a game. A pedometer with a game function including display means, and at least character display control means for controlling the use of changing a display state of a character displayed on the character display means based on a count value of the counting means is disclosed. ing.

The pedometer with a game function described in the publication is:
By controlling the interaction of the character in accordance with the gait and obtaining the familiarity of the user who is moving, the user can use the character without feeling any pain in walking or running. However, this pedometer with a game function does not utilize the mutual pull-in phenomenon, because the change of the video simply depends on the number of steps per unit time. For this reason, the intimacy created unconsciously between the user and the character is not sufficient.

[0018]

SUMMARY OF THE INVENTION It is an object of the present invention to provide an excellent information processing apparatus and information processing method capable of realizing entertainment by controlling character interaction according to internal states such as instinct and emotions. , A storage medium, and a computer program.

A further object of the present invention is to provide an excellent information processing apparatus and information processing method, a storage medium, and a computer program, which can make the entertainment of a moving user enjoyable through character interaction. It is in.

A further object of the present invention is to obtain an intimate feeling of the user by controlling the interaction of the character according to the body rhythm of the moving user, and to enjoy the moving itself as entertainment. An object is to provide an apparatus, an information processing method, a storage medium, and a computer program.

[0021] A further object of the present invention is to unconsciously cultivate a sufficient sense of intimacy between the user and the character by utilizing the mutual attraction phenomenon of the body rhythm of the user and the body rhythm of the character during movement. And you can enjoy the movement itself as entertainment,
An object is to provide an excellent information processing apparatus and information processing method, a storage medium, and a computer program.

[0022]

The present invention has been made in consideration of the above problems, and a first aspect thereof is information for realizing entertainment for a moving user through character interaction. A processing device or an information processing method, comprising a movement detection unit or step for detecting movement of the user, a rhythm extraction unit or step for extracting the user's body rhythm based on the movement detection result of the user, and an emotion or body rhythm. A state storage unit or step that stores the state of the character, a rhythm evaluation unit or step that updates the state of the character based on the body rhythm of the user and the state of the character, and a character having a body rhythm corresponding to the state of the character. An information processing apparatus or an information processing method, comprising: a display control unit or step for displaying. It is.

Here, the movement detecting unit or step may detect the user's walking, and the rhythm extracting unit or step may extract the walking half cycle of the user as a body rhythm.

Alternatively, the movement detecting section or step detects the rotation of the crank of the bicycle on which the user rides, and the rhythm extracting section or step extracts the running half cycle of the bicycle on which the user rides as a body rhythm. Good.

The rhythm evaluation unit or step updates the body rhythm such as the walking half cycle of the character so that the body rhythm of the character is drawn into the body rhythm of the user. Furthermore, the rhythm evaluation section or step changes the ease with which the body rhythm of the character is drawn in with respect to the body rhythm of the user, according to the emotion of the character.

As a result, the display output of the character can be controlled by utilizing the mutual entrainment phenomenon between the user's body rhythm and the character's body rhythm.

For example, when the character is in a good mood, the rhythm may be strongly drawn in and the rhythm of the user's walking may be synchronized in a short time. On the contrary, when the character is in a bad mood, the rhythm may be weakly drawn so that the character may walk on its own without synchronizing with the rhythm of walking by the user. Therefore, when the rhythm of walking of the character is drawn into the rhythm of walking of the user and the two rhythms are in a synchronized state, the character is in a good mood and a deep intimacy is cultivated between the user and the character. Entertainment that allows people to move around happily is realized.

Further, the rhythm evaluation section or step is
By handling the synchronization between the user and the character, the mutual entrainment phenomenon can be preferably realized. For example, the rhythm evaluation unit or step can determine the synchronized state between the user and the character based on the difference between the physical rhythm of the user and the physical rhythm of the character.

The rhythm evaluation section or step can control the emotion of the character according to the synchronization time between the user and the character. For example, the emotion of the character may be enhanced in response to the synchronization time between the user and the character reaching a predetermined value.

As a result, when the user and the character are in tune with each other, the character's emotional characteristics can be obtained such that the character is gradually in a mood.

Further, the rhythm evaluation section or step is
By attenuating the character's emotions over time, the character's mood will get worse over time unless the user and the character are in tune, or the emotions that have risen over time will decay and gradually settle down. It is possible to obtain the character's emotional characteristics of going.

Further, the display control section or step prepares a plurality of display data for each state of the character in advance, and uses the display data corresponding to the state of the character determined by the rhythm evaluation section to display the character. You may make it express an action.

Further, the body rhythm may be displayed by utilizing the display control unit or the step, or periodical movement relating to the movement of the character.

For example, in a synchronized state with the user, the motion of the character having a moving half cycle that is an integral multiple or a fraction of the moving half cycle of the user may be expressed. The reason why the integer or the integer is divided is to synchronize the ground contact timing of the foot when the user walks or the rotation timing of the crank of the bicycle with the ground contact timing of the foot of the character.

In the case of a character of a large animal such as an elephant, it is unnatural in the same walking cycle as that of a human being, so it is multiplied by an integer, and in the case of a character of a small animal such as a rat, the value is a fraction of an integer. You can do it like this.

Alternatively, the display control section or step may display the body rhythm by utilizing periodic movements other than the movement of the character. For example,
In the case of a bird, flapping its wings, in the case of a fish, the movement of its tail fin, and in the case of a jellyfish, the movement of an umbrella can be expressed in correspondence with the walking cycle.

Alternatively, the display control section or step may display the body rhythm of the character as a voice or a vibration of the apparatus body. In the case of voice or vibration, footsteps or vibrations are reproduced at the timing of foot contact with the foot in a half cycle of walking, and in the case of birds, sounds or vibrations of flapping wings are reproduced in the walking cycle. Further, when the user and the character are in the synchronized state, a sound expressing the synchronized state may be reproduced.

Alternatively, the display control unit or step may output the body rhythm by using a medium that realizes empathy according to a visual, auditory, or tactile displacement amount.

The information processing apparatus for realizing entertainment may further include a communication unit for receiving the body rhythm of another user. In such a case, the rhythm evaluation unit or step can update the state of the character according to the body rhythm of the user and the body rhythm of another user who moves in parallel.

In such a case, the rhythm evaluation section or step raises the emotion of the character in response to the physical rhythm of the user and the physical rhythm of the other user reaching the synchronized state, so that the user can perform other operations. It is possible to obtain the emotional characteristics of the character that the character is gradually getting in a better mood when he is in tune with the user.

At this time, the rhythm evaluation unit or step determines the emotion of the character when the body rhythm when the user moves in parallel with another user is outside the predetermined range from the body rhythm when walking alone. You may not want to exalt.

In this case, the movement rhythm is certainly synchronized between the user and the other user, but it is largely deviated from the rhythm of the user's independent movement, and the user's movement rhythm of the other user. This is because it can be judged that they have been forced together, and intimacy with the user has not been fostered.

In a second aspect of the present invention, the computer software is in a computer readable format so as to execute a process for realizing entertainment for a moving user through the interaction of characters on the computer system. A storage medium physically stored, wherein the computer software includes a movement detection step of detecting the movement of the user, a rhythm extraction step of extracting the user's body rhythm based on the movement detection result of the user, emotions and A state storage step that stores the state of the character consisting of the body rhythm, a rhythm evaluation step that updates the state of the character based on the user's body rhythm and the state of the character, and a character having a body rhythm according to the state of the character is displayed. And a display control step for A storage medium characterized.

The storage medium according to the second aspect of the present invention is, for example, a medium for providing computer software in a computer-readable format to a general-purpose computer system capable of executing various program codes. Such a medium is, for example, a DVD (Digital Vers
atile Disc), CD (Compact Disc), FD (Flexible Disc)
Disk), MO (Magneto-Optical disc), and other removable storage media. Alternatively, it is technically possible to provide computer software to a specific computer system via a transmission medium such as a network (whether the network is wireless or wired).

Further, the storage medium according to the second aspect of the present invention is a computer system having a predetermined computer
A computer for realizing software functions
It defines a structural or functional collaborative relationship between software and a storage medium. In other words, the second aspect of the present invention
By installing the predetermined computer software in the computer system via the storage medium according to the first aspect, a cooperative action is exerted on the computer system and the information processing apparatus according to the first aspect of the present invention. The same effect as that of the information processing method can be obtained.

Further, a third aspect of the present invention is a computer written in a computer-readable format so as to execute a process for realizing entertainment for a moving user through a character interaction on a computer system. A program that is a movement detection step that detects the movement of the user, a rhythm extraction step that extracts the user's body rhythm based on the movement detection result of the user, and a state that stores the state of the character consisting of emotions and body rhythms. A storage step; a rhythm evaluation step for updating the character state based on the user's body rhythm and the character state; and a display control step for displaying a character having a body rhythm according to the character state. It is a characteristic computer program.

A computer according to the third aspect of the present invention.
The program defines a computer program written in a computer-readable format so as to realize a predetermined process on a computer system. In other words, by installing the computer program according to the third aspect of the present invention in the computer system, a cooperative action is exerted on the computer system, and the information processing according to the first aspect of the present invention is performed. It is possible to obtain the same effect as that of the device or the information processing method.

Still other objects, features and advantages of the present invention are as follows.
It will be apparent from the embodiments of the present invention described later and the more detailed description based on the accompanying drawings.

[0049]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below in detail with reference to the drawings.

A. Device Configuration FIG. 1 shows an external configuration of an entertainment device 11 according to an embodiment of the present invention. As shown in the figure, the entertainment device 11 is configured as a small portable device, and includes an image output unit 12 for displaying a character, a sound output unit 13 for outputting sound, a power switch 14, and the like. ing.

Further, FIG. 2 schematically shows the internal hardware configuration of the entertainment apparatus 11.
As shown in the figure, the entertainment device 11 includes a processor 21, a ROM 22, a RAM 23, an input unit 24,
The display unit 25 and the communication interface 26 are provided.

The processor 21 is a main controller for controlling the overall operation of the apparatus 11 and executes various application programs under the control of the operating system (OS). The applications referred to here include, for example, a software program that controls the display of characters on the display unit 25 based on information about the movement of the user input via the input unit 24.

A ROM (Read Only Memory) 22 is a read-only non-volatile memory in which data is permanently written during manufacturing. On the ROM 22, for example, a self-diagnostic test (POST: Power On Sel) that is executed when the power is turned on.
f Test) code group for executing programs and hardware input / output operations (BIOS: Basic Input / OutputSy)
stem) and other, program codes executed on the processor 21 are stored.

The RAM (Random Access Memory) 23 is
Used for loading program code executed by the processor 21 and for temporarily storing working data,
It is a writable memory. The RAM 23 is usually composed of a plurality of DRAM (Dynamic RAM) chips.

The input unit 24 is a device for inputting information regarding the movement of the user. The input unit 24 may be composed of, for example, a keyboard or a mouse, and may manually input the movement information of the user. Alternatively, the input unit 2
The movement detection device 4 may be a pedometer that captures the walking motion of the user, a tachometer that measures the rotation of the crank of the bicycle, or the like, which physically measures the movement work of the user and directly inputs it. Input data such as the number of steps and the number of rotations are passed to the processor 21.

The pedometer is of a mechanical type which detects an impact during walking with a pendulum or an electronic type which detects an impact with an acceleration detecting element. A bicycle tachometer (cadence sensor) has a coil (winding) on the frame,
It is configured by attaching a magnet (magnet) to the crank, and by counting the pulses of the current generated by electromagnetic induction when the magnet of the crank crosses the coil,
Measure the crank speed.

The display unit 25 is a device for externally outputting the body rhythm of the character generated by utilizing the mutual entrainment phenomenon. For example, in the case of visually outputting a character, the display unit 25 displays an LCD (Liquid Crystal Display).
play: Liquid crystal display) and other image display devices. Further, when the character is output by voice, the display unit 25 is composed of a voice display device such as a sound board and a speaker. Further, the display unit 25 may be configured by a device in which an eccentric member is rotated by a motor, and the body rhythm of the character is output as vibration of the main body of the apparatus 11.

The communication interface 26 is a device for the entertainment apparatus 11 to communicate with another entertainment apparatus via a wired or wireless communication medium. For example, when short-range wireless communication such as Bluetooth is used, the communication interface 26 includes a baseband unit and an RF (Radio Frequency) unit. The baseband unit adds various data to the transmission data from the processor 21 and sends it to the RF unit, or passes the reception data from the RF unit to the processor 21. Also, R
The F section up-converts the transmission data from the base band section to a radio frequency and radiates it as a radio wave, or down-converts the received radio wave and passes it to the base band section.

For example, information about the movement of the user such as the number of steps of the user during walking and the number of rotations of the crank of the bicycle operated by the user is input to the entertainment apparatus 11 from the external movement detection device via the communication interface 26. It can also be moved between devices.
In addition, the physical rhythm of the user extracted on the entertainment apparatus 11, the mutual entrainment phenomenon obtained by the evaluation of the physical rhythm, the character generated by utilizing the mutual entrainment phenomenon, or the body rhythm thereof is transmitted via the communication interface 26. It can also be moved to another device.
Further, a software program for controlling the display of the character by utilizing the mutual attraction phenomenon with the user's body rhythm can be introduced into the entertainment apparatus 11 via the communication interface 26.

B. Device Operation The entertainment device 11 according to the present embodiment acquires the body rhythm of the moving user and controls the display output of the character by utilizing the mutual entrainment phenomenon between the body rhythm of the user and the body rhythm of the character. As a result, a sense of intimacy is unknowingly created between the user and the character, and the movement itself can be enjoyed as entertainment.

In the following, the entertainment device 11 will be described.
Describes device operations for achieving entertainment while on the move.

B-1. Entertainment in Walking The user's walking motion is input to the entertainment device 11 via the input unit 24. Then, the walking rhythm of the character is drawn into the walking rhythm of the user, and 2
When the two rhythms are in a substantially synchronized state, the character is in a good mood, a deep feeling of intimacy is cultivated between the user and the character, and entertainment in which the user can move happily is realized.

FIG. 3 schematically shows a functional configuration of the entertainment apparatus 11 for realizing entertainment when the user walks. The configuration shown in the figure is actually realized by the processor 21 executing a software program that controls the display output of the character by utilizing the mutual entrainment phenomenon of the physical rhythm of the user and the physical rhythm of the character.

As shown, the entertainment device 11
Is composed of a user rhythm management unit 37 that manages the physical rhythm of the user and a character rhythm management unit 38 that manages the physical rhythm of the character, and utilizes the mutual entrainment phenomenon by the cooperative operation of both rhythm management units. .

The walking detection section 31 is composed of an acceleration detection element attached to the user's waist or the like, and when a change in acceleration is detected by a shock when the foot touches the ground, the user rhythm management section 37 is operated via the input section 24. To notify.

The user / rhythm management section 37 comprises a rhythm extraction section 32 and a rhythm storage section 33. The rhythm extraction unit 32 stores the time at which the foot contact is notified, calculates the walking half cycle of the user, which is the difference from the previous time, and uses this as the user's body rhythm.
Output to 3.

The rhythm storage unit 33 stores the walking half cycle calculated by the rhythm extraction unit 32, obtains the average and standard deviation of the recent several walking half cycles, and stores the average and standard deviation in the character rhythm management unit. 38 to the rhythm evaluation section 34.

On the other hand, the character / rhythm management section 38
A state storage unit 35 that manages the internal state of the character and a rhythm evaluation unit 34 that evaluates the physical rhythm of the character according to the physical rhythm of the user and the internal state of the character itself.

The state storage unit 35 stores the half-cycle of walking of the character, the number of tuning steps, and the emotional parameter, which are parameters of the ease of pulling in the body rhythm of the character.

The rhythm evaluation section 34 uses the average and standard deviation of the walking half cycle from the rhythm storage section 33, the walking half cycle of the character from the state storage section 35, the number of tuning steps, and the emotional parameter to update the new character. The walking half cycle and emotion parameters are calculated, and the calculation result is stored in the state storage unit 3.
Send to 5.

The display control unit 36 has the display data of the character, and controls the display of the character on the display unit 25 based on the walking half cycle of the character and the emotion parameter stored in the state storage unit 35.

Next, the operation of the rhythm evaluation section 34 in the character / rhythm management section 38 will be described in detail with reference to the flow chart shown in FIG.

First, whether the user's body rhythm has been extracted by the user / rhythm management unit 37, that is, the average T _u of the walking half cycle of the user and the standard deviation σ _u are stored in the rhythm storage unit 33 as walking data. It is checked whether or not there is (step S1). Here, if the body rhythm has not been extracted yet, the process proceeds to the process of temporal decay of emotion parameters, which will be described later (step S11).

If the walking data has already been extracted
Is the standard deviation σ of the walking half cycle of the user _uStandard deviation acceptable
Quantity σ₀Whether the rhythm of walking is stable compared to
It is further determined (step S2).

If σ _u <σ ₀ , it is determined that the walking rhythm of the user is stable, and the process proceeds to the next step. If not, it is determined that the rhythm of walking is not stable, and the process proceeds to the process of decaying emotional parameters, which will be described later (step S1).
1).

Next, the walking half cycle of the character is calculated (step S3). Considering that the walking rhythm of the character is drawn into the stable walking rhythm of the user, the walking half cycle of the character is calculated using the following equation.

[0077]

## EQU1 ## T _c '= T _c + (T _u −T _c ) / N (M)

Here, T _c 'is the next walking half cycle of the character, T _c is the current walking half cycle of the character, T _u is the average of the walking half cycle of the user, and N (M) is the ease of rhythm pull-in. The number of tuning steps, M, which is a parameter of Sa, is an emotional parameter of the character.

The emotional parameter M takes a value from a bad mood (0.0) to a good mood (1.0). The number of tuning steps N (M) is a function of the emotional parameter M of the character, and is set as follows, for example.

[0080]

[Equation 2] When 0.9 <= M <= 1.0, N (M) = 2 When 0.5 <= M <0.9, N (M) = 10 When 0.0 <= M <0.5, N (M) = 100

Therefore, when the character is in a good mood, the rhythm is strongly drawn, and the rhythm of the user's walking is synchronized in a short time. On the other hand, when the character is in a bad mood, the rhythm is weakly drawn in, and the player walks on his own without synchronizing with the rhythm of walking by the user. Then, the calculated next walking half cycle T _c ′ of the character is sent to the state storage unit 35 of the character / rhythm management unit 38.

Next, it is determined whether or not the character is in synchronization with the user by using the following formula (step S
4). However, δ _s is a constant for determining the tuning state.

[0083]

## EQU3 ## | T _u −T _c | / T _c <δ _s

If the tuning state satisfies the above equation, it is further checked whether the tuning flag is set (step S5). If the tuning flag is not set, the tuning flag is set (step S
6) Store the tuning start time t _s .

If the character is in sync with the user but the sync flag has already been set, it is determined using the following equation whether the sync time is sufficiently long (step S7). However, t is the present time, t _s is the tuning start time, and T _s is the tuning determination time.

[0086]

[Number 4] t-t _s> T _s

If the above equation is satisfied and it is judged that the tuning time is sufficiently long, the next emotion parameter M ′ is calculated from the current emotion parameter M and the emotion parameter increase m _s due to the tuning using the following equation. By calculating, the emotion parameter of the character is increased (step S8). However, when M ′> 1.0, M ′ = 1.0.

[0088]

[Equation 5] M ′ = M + _ms

Therefore, when the user and the character are in tune with each other, it is possible to obtain the emotional characteristic of the character that the character gradually becomes more in mood.

On the other hand, not in the synchronized state (step S4),
If the tuning flag is set (step S9),
The synchronization flag is cleared (step S10).

Finally, the next emotional parameter M'is calculated from the current emotional parameter M and the temporal decay m _a of the emotional parameter using the following equation (step S11). However,
When M '<0.0, M' = 0.0.

[0092]

[6] M '= M-m _a

Therefore, if the user and the character are not in tune with each other, the character's mood will become worse over time, or the emotions that have risen will be attenuated and gradually settled down with the passage of time. Can be obtained.

The next walking half cycle T _c ′ of the walking rhythm of the character and the next emotion parameter M ′ of the character are sent to the state storage unit 35.

Next, the display control operation of the character by the display control unit 36 will be described in detail.

The display control unit 36 has display data of the character for expressing each emotion, and displays the character based on the walking half cycle Tc of the character of the state storage unit 35 and the emotion parameter M. As the display data of the character for each value of the emotion parameter M, a plurality of videos as a set of images of the character walking are prepared as follows, for example.

[0097]

[Equation 7]   When 0.9 <= M <= 1.0, the image of walking happily   When 0.5 <= M <0.9, an image of walking normally   When 0.0 <= M <0.5, the image of walking moody

Each image has the length of the walking cycle of the character, and is reproduced repeatedly to generate an infinitely walking image.

The display control unit 36 displays the above-mentioned image corresponding to the current emotional parameter M at 2 of the current walking half cycle T _c .
Reproduction (that is, the display unit 2) at a walking cycle of k times (2 kT _c ).
(Display output from 5).

Here, k is a constant depending on each character. For example, a large animal character such as an elephant is unnatural in the same walking cycle as a human, so k takes an integer value larger than 1, and a small animal character such as a rat, conversely, is smaller than 1. Takes a value that is a whole number. An integer or an integer fraction is
This is to synchronize the timing of touching the foot of the user with the timing of touching the foot of the character.

For a character who does not walk, periodical movement using the body is used. For example,
In the case of a bird, flapping its wings, in the case of a fish, the movement of its tail fin, and in the case of a jellyfish, the movement of an umbrella can be expressed in correspondence with the walking cycle.

Further, the display data of the character output from the display unit 25 is not necessarily limited to the video as a set of images. For example, it may be animation generated by two-dimensional or three-dimensional computer graphics, or sound or vibration.

In the case of a two-dimensional or three-dimensional animation, an animation in which the character is walking is prepared for each of several ranges of emotion parameter values.
Play the animation in the walking cycle (2 kT _c ).

In the case of voice or vibration, footsteps or vibrations are reproduced at the timing of foot contact in a walking half cycle, and for birds, sounds or vibrations of flapping wings are reproduced in the walking cycle. Further, when the user and the character are in the synchronized state, a sound expressing the synchronized state is reproduced.

Further, the character is not necessarily limited to a person, an animal, or an anthropomorphized person similar to these, and a visual, auditory, or tactile movement is imparted so that the character can be empathized. Anything will do.

In addition, the user's movement is not limited to walking, and the same applies to running such as running, pseudo walking and running using a treadmill, and pseudo up and down stairs using a step machine. be able to.

B-2. Entertainment when riding a bicycle
The entertainment device 11 extracts the body rhythm of the user by detecting the rotation of the crank of the bicycle on which the user rides. Then, when the rhythm of walking of the character is drawn into the rhythm of running of the user's bicycle and the two rhythms are in a substantially synchronized state, the character is in a good mood and a deep sense of intimacy is cultivated between the user and the character. , It is possible to realize entertainment that makes moving fun.

FIG. 5 schematically shows a functional configuration of the entertainment apparatus 11 for realizing entertainment while the user is traveling on a bicycle. In the configuration shown in the figure, the software that the processor 21 actually controls the display output of the character by utilizing the mutual entrainment phenomenon of the physical rhythm of the user and the physical rhythm of the character.
It is realized by executing a program.

As shown, the entertainment device 11
Is composed of a user rhythm management unit 57 that manages the physical rhythm of the user and a character rhythm management unit 58 that manages the physical rhythm of the character, and utilizes the mutual entrainment phenomenon by the cooperative operation of both rhythm management units. .

The running detector 51 is composed of a device for mounting a coil on the frame of the bicycle and a magnet for the crank to detect the rotation of the crank of the bicycle on which the user rides. Then, the user rhythm management unit 57 is notified of the current pulse generated by electromagnetic induction when the crank magnet crosses the coil via the input unit 24.

The user / rhythm management section 57 comprises a rhythm extraction section 52 and a rhythm storage section 53. The rhythm extraction section 52 stores the time notified from the running detection section 51,
The half cycle of the user's bicycle, which is half the difference from the previous time, is calculated and output to the rhythm storage unit 53.

The rhythm storage section 53 stores the running half cycle of the user's bicycle, obtains the average and standard deviation of several recent running half cycles, and calculates the rhythm evaluation section 54 of the character / rhythm management section 58. Send to.

On the other hand, the character / rhythm management section 58
A state storage unit 55 that manages the internal state of the character and a rhythm evaluation unit 54 that evaluates the physical rhythm of the character according to the physical rhythm of the user and the internal state of the character itself.

The state storage unit 55 stores the walking half cycle of the character, the number of tuning steps, which is a parameter of the ease of pulling in the rhythm, and the emotional parameter.

The rhythm evaluation section 54 uses the average and standard deviation of the running half cycle from the rhythm storage section 53, the walking half cycle of the character from the state storage section 55, the number of tuning steps, and the emotional parameter to update the new character. The walking half cycle and emotion parameters are calculated and sent to the state storage unit 55.

The display control unit 56 has the display data of the character, and displays the character based on the walking half cycle of the character and the emotion parameter of the state storage unit 55.

Next, the operation of the rhythm evaluation section 54 in the character / rhythm management section 58 will be described in detail with reference to the flow chart shown in FIG.

First, whether or not the body rhythm of the user is extracted by the user / rhythm management unit 57, that is, the average T _u and standard deviation σ _u of the traveling half cycle of the bicycle on which the user rides are stored in the rhythm storage unit 53 as traveling data. It is checked whether or not it is stored (step S21). If the body rhythm has not been extracted yet, the process proceeds to the processing of time decay of emotional parameters, which will be described later (step S31).

When the walking data has already been extracted, the standard deviation σ _u of the traveling half cycle of the bicycle on which the user rides is compared with the standard deviation allowable amount σ ₀ to determine whether or not the rhythm of traveling is stable. Further determination is made (step S22).

If σ _u <σ ₀ , it is determined that the rhythm of the user's running is stable, and the process proceeds to the next process. If not, it is determined that the rhythm of running is not stable, and the process proceeds to the processing of time decay of emotional parameters described later (step S3).
1).

Then, the walking half cycle of the character is calculated (step S23). Considering that the walking rhythm of the character is drawn into the stable running rhythm of the user, the walking half cycle of the character is calculated using the following formula.

[0122]

## EQU8 ## T _c '= T _c + (T _u −T _c ) / N (M)

Here, T _c 'is the character's next walking half cycle, T _c is the character's current walking half cycle, T _u is the average of the running half cycle of the bicycle on which the user rides, and N (M) is the rhythm. The number of tuning steps, which is a parameter of the ease of being drawn in,
M is an emotional parameter of the character.

The emotion parameter M takes a value from a bad mood (0.0) to a good mood (1.0). The number of tuning steps N (M) is a function of the emotional parameter M of the character, and is set as follows, for example.

[0125]

[Equation 9] When 0.9 <= M <= 1.0, N (M) = 2 When 0.5 <= M <0.9, N (M) = 10 When 0.0 <= M <0.5, N (M) = 100

Therefore, when the character is in a good mood, the rhythm is strongly drawn, and the rhythm of the user's bicycle travel is synchronized with the rhythm in a short time. On the other hand, when the character is in a bad mood, the rhythm is weakly drawn in, and the player walks on his own without synchronizing with the rhythm of walking by the user. Then, the next walking half cycle T _c 'of the calculated character is
It is sent to the state storage unit 55 of the character / rhythm management unit 58.

Next, it is determined whether or not the character is in synchronization with the user by using the following formula (step S2).
4). However, δ _s is a constant for determining the tuning state.

[0128]

[Equation 10] | T _u −T _c | / T _c <δ _s

If the tuning state satisfies the above equation, it is further checked whether the tuning flag is set (step S25). If the tuning flag is not set, the tuning flag is set (step S2).
6) Store the tuning start time t _s .

If the character is in sync with the user, but the sync flag has already been set, it is determined using the following equation whether the sync time is sufficiently long (step S27). However, t is the present time, t _s is the tuning start time, and T _s is the tuning determination time.

[0131]

[Number 11] t-t _s> T _s

When the above equation is satisfied and it is determined that the tuning time is sufficiently long, the next emotion parameter M ′ is calculated using the following equation from the current emotion parameter M and the emotion parameter increase m _s due to the tuning. The emotional parameter of the character is increased by calculating (step S28). However, when M ′> 1.0, M ′ = 1.0.

[0133]

[Equation 12] M ′ = M + _ms

Therefore, when the user and the character are in tune with each other, it is possible to obtain the character's emotional characteristic that the character is gradually in a mood.

On the other hand, it is not in the synchronized state (step S2
4) and if the tuning flag is set (step S
29), the synchronization flag is cleared (step S30).

Finally, the next emotional parameter M'is calculated from the current emotional parameter M and the temporal decay m _a of the emotional parameter using the following equation (step S31). However,
When M '<0.0, M' = 0.0.

[0137]

[Equation 13] M ′ = M−m _a

Therefore, if the user and the character are not synchronized with each other, the character's mood will become worse over time, or the emotions that have risen will be attenuated and gradually settled down with the passage of time. Can be obtained.

The next walking half cycle T _c ′ of the walking rhythm of the character and the next emotion parameter M ′ of the character are sent to the state storage unit 55.

Next, the display control operation of the character by the display control unit 56 will be described in detail.

The display control unit 56 has display data of the character for expressing each emotion, and displays the character based on the walking half cycle T _c of the character of the state storage unit 55 and the emotion parameter M. As the display data of the character for each value of the emotion parameter M, a plurality of videos as a set of images of the character walking are prepared as follows, for example.

[0142]

[Equation 14]   When 0.9 <= M <= 1.0, the image of walking happily   When 0.5 <= M <0.9, an image of walking normally   When 0.0 <= M <0.5, the image of walking moody

Each image has the length of the walking cycle of the character, and is reproduced repeatedly to generate an infinitely walking image.

The display control unit 56 displays the above-mentioned image corresponding to the current emotional parameter M in 2 of the current walking half cycle Tc.
Reproduction (that is, the display unit 2) at a walking cycle of k times (2 kT _c ).
(Display output from 5).

Here, k is a constant depending on each character. For example, in order to synchronize the walking rhythm of a large animal character such as an elephant or a small animal character such as a mouse with the running rhythm of the user's bicycle, an integer value or a value divided by an integer is taken. The reason why the integer or the integer is divided is to synchronize the timing of rotation of the crank of the bicycle on which the user rides and the timing of ground contact of the foot of the character.

For a character who does not walk, periodical movement using the body is used. For example,
In the case of a bird, flapping its wings, in the case of a fish, the movement of its tail fin, and in the case of a jellyfish, the movement of an umbrella can be expressed in correspondence with the walking cycle.

The character display data output from the display unit 25 is not necessarily limited to the video as a set of images. For example, it may be animation generated by two-dimensional or three-dimensional computer graphics, or sound or vibration.

In the case of two-dimensional or three-dimensional animation, an animation of a character walking is prepared for each range of emotion parameter values.
Play the animation in the walking cycle (2 kT _c ).

In the case of voice or vibration, footsteps or vibrations are reproduced at the timing of foot contact in a walking half cycle, and in the case of birds, sounds or vibrations of flapping wings are reproduced in the walking cycle. Further, when the user and the character are in the synchronized state, a sound expressing the synchronized state is reproduced.

Further, the character is not necessarily limited to a person, an animal, or an anthropomorphic one similar to these, so that visual, auditory, and tactile movements are added so that empathy can be carried out. Anything will do.

Further, not only the traveling of the bicycle but also the traveling of the electric bicycle or the pseudo pedaling motion by the bicycle ergometer can be handled in the same manner.
As with a bicycle, a coil is attached to the boat and a magnet is attached to the oar. Then, by detecting the current pulse generated by electromagnetic induction when the all magnets cross the coil, the entertainment device 11 shown in FIG. 5 can be used for moving the boat by the boat or for quasi-boating motion by the rowing ergometer. It can be expanded and used.

B-3. Entertainment in parallel walking
The cement entertainment apparatus 11, the user of the walking motion is inputted through the input unit 24 or the communication interface 26. When the rhythm of the character's walking is drawn into the rhythm and the two rhythms are in a substantially synchronized state, the character is in a good mood and a deep intimacy is cultivated between the user and the character so that they can move happily. Entertainment is realized.

Furthermore, when two or more users are performing "parallel walking" in which they walk side by side, when a mutual pull-in phenomenon occurs between the walking rhythm of one user and the walking rhythm of another user, the character becomes Feels intimate between the user and the other user, and becomes even more in a good mood.

The parallel walking referred to here means that the users physically walk side by side, hold their hands, fold their arms or walk while holding their shoulders, and in addition, they are simulated through a communication medium. Walking in line with is also included.

FIG. 7 schematically shows a functional configuration of the entertainment apparatus 11 for realizing entertainment when the user walks in parallel. The configuration shown in the figure is actually realized by the processor 21 executing a software program that controls the display output of the character by utilizing the mutual entrainment phenomenon of the physical rhythm of the user and the physical rhythm of the character.

As shown, the entertainment device 11
Is composed of a user rhythm management unit 78 that manages the physical rhythm of the user and a character rhythm management unit 79 that manages the physical rhythm of the character, and utilizes the mutual entrainment phenomenon by the cooperative operation of both rhythm management units. .

The walking detection section 71 is composed of an acceleration detection element attached to the user's waist or the like, and when a change in acceleration is detected due to a shock when the foot touches the ground, the walking detection section 71 is operated via the input section 24 or the communication interface 26. The rhythm management section 78 is notified.

The user / rhythm management section 78 is composed of a rhythm extraction section 72 and a rhythm storage section 73. The rhythm extraction unit 72 stores the time at which the foot contact is notified, calculates the walking half cycle of the user, which is the difference from the previous time, and uses this as the user's body rhythm.
Output to 3.

The communication management unit 77 controls the data communication operation relating to the mutual entrainment phenomenon between the entertainment apparatus 11 and the entertainment apparatus of another user via the communication interface 26. The half walking cycle of the user read from the rhythm storage section 73 of the entertainment apparatus 11 is transmitted to the entertainment apparatus of another user through the communication management section 77, and the other half of the rhythm storage section of the entertainment apparatus of the other user is transmitted. The half walking cycle of the user can be received through the communication management unit 77 and sent to the rhythm storage unit 73.

The rhythm storage section 73 stores the walking half cycle of the user calculated by the rhythm extracting section 72 and the walking half cycle of another user obtained through the communication managing section 77, and the number of recent times. The average and standard deviation of the walking half cycle are calculated and sent to the rhythm evaluation section 74 of the character / rhythm management section 79.

On the other hand, the character / rhythm management section 79
A state storage unit 75 that manages the internal state of the character and a rhythm evaluation unit 74 that evaluates the physical rhythm of the character according to the physical rhythm of the user and the internal state of the character itself.

The state storage unit 75 stores the walking half cycle of the character, the number of tuning steps, which is a parameter of the ease of pulling in the body rhythm of the character, and the emotional parameter.

The rhythm evaluation section 74 calculates the average and standard deviation of the walking half cycle of the user from the rhythm storage section 73, and the average and standard deviation of the walking half cycle of other users acquired via the communication management section 77. A new walking half cycle of the character and an emotional parameter are calculated using the walking half cycle of the character, the number of tuning steps, and the emotional parameter from the state storage unit 75, and the calculation result is sent to the state storage unit 75.

The display control unit 76 has display data of the character, and controls the display of the character on the display unit 25 based on the walking half cycle of the character and the emotional parameters held in the state storage unit 75.

Next, the operation of the rhythm evaluation section 74 in the character / rhythm management section 79 will be described in detail with reference to the flowcharts shown in FIGS. However, here, for simplification of the description, there is only one other user.

FIG. 8 shows, in the form of a flow chart, a processing procedure for realizing the synchronization between the user who is walking in parallel with another user and the character by the mutual entrainment phenomenon.

In this case, first, the user / rhythm manager 7
8, the body rhythm of the user is extracted, that is, the average T of the walking half cycle of the user as the walking data.
It is checked whether _u and the standard deviation σ _u are stored in the rhythm storage unit 73 (step S41). If the body rhythm has not been extracted yet, the process proceeds to the process of decaying emotional parameters as described later (step S51).

When gait data has already been extracted
Is the standard deviation σ of the walking half cycle of the user _uStandard deviation acceptable
Quantity σ₀Whether the rhythm of walking is stable compared to
It is further determined (step S42).

If σ _u <σ ₀ , it is determined that the rhythm of walking of the user is stable, and the process proceeds to the next step. If not, it is determined that the rhythm of walking is not stable, and the process proceeds to the process of decaying the emotion parameter as described later (step S5).
1).

Then, the walking half cycle of the character is calculated (step S43). Thinking that the walking rhythm of the character is drawn into the stable walking rhythm of the user,
The calculation of the walking half cycle of the character is performed using the following formula.

[0171]

## EQU15 ## T _c '= T _c + (T _u −T _c ) / N (M)

Here, T _c 'is the next walking half cycle of the character, T _c is the current walking half cycle of the character, T _u is the average of the walking half cycle of the user, and N (M) is the ease with which the rhythm is drawn. The number of tuning steps, M, which is a parameter of Sa, is an emotional parameter of the character.

The emotion parameter M takes a value from a bad mood (0.0) to a good mood (1.0). The number of tuning steps N (M) is a function of the emotional parameter M of the character, and is set as follows, for example.

[0174]

[Equation 16] When 0.9 <= M <= 1.0, N (M) = 2 When 0.5 <= M <0.9, N (M) = 10 When 0.0 <= M <0.5, N (M) = 100

Therefore, when the character is in a good mood, the rhythm is strongly drawn, and the rhythm of the user's walking is synchronized in a short time. On the other hand, when the character is in a bad mood, the rhythm is weakly drawn in, and the player walks on his own without synchronizing with the rhythm of walking by the user. Then, the calculated next walking half cycle T _c ′ of the character is sent to the state storage unit 75 of the character / rhythm management unit 79.

Next, it is determined whether the character is in synchronization with the user using the following formula (step S4).
4). However, δ _s is a constant for determining the tuning state.

[0177]

[Equation 17] | T _u −T _c | / T _c <δ _s

If the tuning state satisfies the above equation, it is further checked whether the tuning flag is set (step S45). If the tuning flag is not set, the tuning flag is set (step S4).
6) Store the tuning start time t _s .

If the character is in tune with the user, but the tune flag has already been set, it is determined using the following equation whether the tune time is sufficiently long (step S47). However, t is the present time, t _s is the tuning start time, and T _s is the tuning determination time.

[0180]

[Number 18] t-t _s> T _s

When the above equation is satisfied and it is determined that the tuning time is sufficiently long, the next emotion parameter M ′ is calculated using the following equation from the current emotion parameter M and the emotion parameter increase m _s due to the tuning. The emotional parameter of the character is increased by calculating (step S48). However, when M ′> 1.0, M ′ = 1.0.

[0182]

## EQU19 ## M '= M + _ms

Therefore, when the user and the character are in tune with each other, it is possible to obtain the emotional characteristic of the character that the character gradually becomes more in mood.

On the other hand, it is not in the synchronized state (step S4
4) and if the tuning flag is set (step S
49), and clears the tuning flag (step S50).

Finally, the next emotional parameter M ′ is calculated from the current emotional parameter M and the temporal decay m _a of the emotional parameter using the following equation (step S51). However,
When M '<0.0, M' = 0.0.

[0186]

[Equation 20] M ′ = M−m _a

Therefore, if the user and the character are not synchronized with each other, the character's mood will become worse over time, or the emotions that have risen will be attenuated and gradually settled down with the passage of time. Can be obtained.

Further, FIG. 9 shows, in the form of a flowchart, a processing procedure for realizing the synchronization between the users walking in parallel by the mutual entrainment phenomenon.

In this case, first, the user / rhythm manager 7
8, whether the average T _u of the walking half cycle and the standard deviation σ _{u of the} user are stored in the rhythm storage unit 73.
At the same time, it is checked whether the average T _u2 and standard deviation σ _u2 of the walking half cycle of another user can be acquired via the communication management unit 77 (step S61). If the body rhythm has not been extracted yet, the entire processing routine ends.

When the walking data has already been extracted, the standard deviation σ _u2 of the other user's walking half cycle is compared with the standard deviation tolerance σ ₀ to determine whether the rhythm of the walking is stable. Further determination is made (step S62).

If σ _u2 <σ ₀ , it is determined that the rhythm of walking of the user is stable, and the process proceeds to the next process. If not, it is determined that the walking rhythm is not stable, and the entire processing routine is ended.

Then, it is determined whether or not the user and the other user are in the synchronized state by using the following formula (step S6).
3). However, δ _s is a constant for determining the tuning state.

[0193]

[ _Equation 21] | T _u −T _u2 | / T _u2 <δ _s

If the tuning state satisfies the above equation, it is further checked whether the tuning flag is set (step S64). If the tuning flag is not set, the tuning flag is set (step S6).
5) Store the tuning start time t _s .

If the character is in tune with the user but the tune flag has already been set, it is determined using the following formula whether the tune time is sufficiently long (step S66). Here, t is the current time, t _s2 is the synchronization start time of the user and another user, and T _s is the synchronization determination time.

[0196]

[Number 22] t-t _s2> T _s

If the above equation is satisfied and it is determined that the tuning time is sufficiently long, the following equation is used from the current emotion parameter M and the emotion parameter increase m _s2 due to the tuning of the user and other users. The emotion parameter of the character is increased by calculating the next emotion parameter M ′ (step S67). However, when M '> 1.0, M'
= 1.0.

[0198]

[Equation 23] M ′ = M + m _s2

Therefore, when the user is in tune with another user, the character's emotional characteristics can be obtained such that the character becomes more and more in a mood.

In addition to this, the average of walking half cycles obtained when there is no walking data of other users, that is, when walking independently instead of in parallel between users is stored as the basic walking half cycle T _u0 . When the following formula is established, it is possible not to increase the emotional parameter (δ0 is a constant for determining the deviation from the basic walking).

[0201]

| T _u −T _u0 | / T _u0 > δ ₀

In this case, the rhythm of walking is synchronized between the user and the other user, but it is largely deviated from the rhythm of walking alone of the user, and the rhythm of walking of the user by the other user. This is because it can be judged that they have been forced together, and intimacy with the user has not been fostered.

Further, it is not in the synchronized state (step S6
3) and if the tuning flag is set (step S
68) and clears the tuning flag (step S69).

The next walking half cycle T _c ′ of the walking rhythm of the character and the next emotion parameter M ′ of the character are sent to the state storage unit 75.

Next, the display control operation of the character by the display control unit 76 will be described in detail.

The display control unit 76 has display data of the character for expressing each emotion, and displays the character based on the walking half cycle Tc of the character and the emotion parameter M in the state storage unit 75. As the display data of the character for each value of the emotion parameter M, a plurality of videos as a set of images of the character walking are prepared as follows, for example.

[0207]

[Equation 25]   When 0.9 <= M <= 1.0, the image of walking happily   When 0.5 <= M <0.9, an image of walking normally   When 0.0 <= M <0.5, the image of walking moody

Each image has the length of the walking cycle of the character, and is reproduced repeatedly to generate an infinitely walking image.

The display control unit 76 displays the above-mentioned image corresponding to the current emotional parameter M at 2 in the current walking half cycle T _c .
Reproduction (that is, the display unit 2) at a walking cycle of k times (2 kT _c ).
(Display output from 5).

Here, k is a constant depending on each character. For example, a large animal character such as an elephant is unnatural in the same walking cycle as a human, so k takes an integer value larger than 1, and a small animal character such as a rat, conversely, is smaller than 1. Takes a value that is a whole number. An integer or an integer fraction is
This is to synchronize the timing of touching the foot of the user with the timing of touching the foot of the character.

For a character who does not walk, periodical movement using the body is used. For example,
In the case of a bird, flapping its wings, in the case of a fish, the movement of its tail fin, and in the case of a jellyfish, the movement of an umbrella can be expressed in correspondence with the walking cycle.

The display data of the character output from the display unit 25 is not necessarily limited to the video as a set of images. For example, it may be animation generated by two-dimensional or three-dimensional computer graphics, or sound or vibration.

In the case of a two-dimensional or three-dimensional animation, an animation of a character walking is prepared for each range of emotion parameter values.
Play the animation in the walking cycle (2 kT _c ).

Further, in the case of voice or vibration, footsteps or vibrations are reproduced at the timing of foot contact with the walking half cycle, and if it is a bird, sounds or vibrations of flapping wings are reproduced in the walking cycle. Further, when the user and the character are in the synchronized state, a sound expressing the synchronized state may be reproduced.

Further, the character is not necessarily limited to a person, an animal, or an anthropomorphic person similar to these, and a visual, auditory, or tactile movement is added so that empathy can be carried out. Anything will do.

Further, not only parallel walking but also parallel running such as running, pseudo parallel walking and parallel running using a treadmill, and parallel up and down stairs using a step machine are similarly performed. Can handle.

B-4. When running parallel bicycles
The entertainment device 11 extracts the body rhythm of the user by detecting the rotation of the crank of the bicycle on which the user rides. Then, when the rhythm of walking of the character is drawn into the rhythm of running of the bicycle on which the user is riding, and the two rhythms are in a substantially synchronized state, the character is in a good mood and a deep sense of intimacy is cultivated between the user and the character. Therefore, it is possible to realize entertainment that makes it possible to move happily.

Furthermore, when two or more users run "parallel running" in which the bicycles are run side by side, mutual pull-in phenomenon occurs between the running rhythms of the user and the running rhythms of other users, and synchronization occurs. In this state, the character feels intimate between the user and the other user and becomes more in a good mood.

The parallel running of bicycles means that two or more people run the bicycles side by side, and in addition to running the bicycles physically side by side, it also includes running the bicycles pseudo side by side by communication. .

FIG. 10 schematically shows a functional configuration of the entertainment apparatus 11 for realizing entertainment when the user runs the bicycles in parallel. The configuration shown in the figure is actually realized by the processor 21 executing a software program that controls the display output of the character by utilizing the mutual entrainment phenomenon of the physical rhythm of the user and the physical rhythm of the character.

As shown, the entertainment device 11
Is composed of a user rhythm management unit 98 that manages the physical rhythm of the user and a character rhythm management unit 99 that manages the physical rhythm of the character. The mutual pull-in phenomenon is utilized by the cooperative operation of both rhythm management units. .

The running detector 91 is a device for mounting a coil on the frame of the bicycle and a magnet for the crank to detect the rotation of the crank of the bicycle on which the user rides. Then, the user rhythm management unit 98 is notified of a current pulse generated by electromagnetic induction when the crank magnet crosses the coil via the input unit 24 or the communication interface 26.

The user / rhythm management section 98 comprises a rhythm extraction section 92 and a rhythm storage section 93. The rhythm extraction section 92 stores the time notified from the running detection section 91,
The half cycle of the user's bicycle, which is half the difference from the previous time, is calculated and output to the rhythm storage unit 93.

The communication management unit 97 controls the data communication operation relating to the mutual entrainment phenomenon between the entertainment apparatus 11 and the entertainment apparatus of another user via the communication interface 26. The half running cycle of the user read from the rhythm storage section 93 of the entertainment apparatus 11 is transmitted to the entertainment apparatus of another user through the communication management section 97, and the other half of the rhythm storage section of the entertainment apparatus of the other user is transmitted. The running half cycle of the user can be received through the communication management unit 97 and sent to the rhythm storage unit 93.

The rhythm storage section 93 stores the running half cycle of the user's bicycle, obtains the average and standard deviation of several recent running half cycles, and calculates the rhythm evaluation section 94 of the character / rhythm management section 99. Send to.

On the other hand, the character / rhythm management section 99
A state storage unit 95 that manages the internal state of the character, and a rhythm evaluation unit 94 that evaluates the physical rhythm of the character according to the physical rhythm of the user and the internal state of the character itself.

The state storage section 95 stores the half walking period of the character, the number of tuning steps which is a parameter of the ease of pulling in the rhythm, and the emotional parameter.

The rhythm evaluation section 94 determines the average and standard deviation of the running half cycle of the bicycle on which the user rides from the rhythm storage section 93, and the running half cycle of the bicycle of another user acquired via the communication management section 97. Average and standard deviation, status storage unit 9
A new walking half cycle and emotion parameter of the character are calculated using the walking half cycle of the character, the number of tuning steps, and the emotional parameter from 5, and the calculation result is sent to the state storage unit 95.

The display control unit 96 has the display data of the character, and displays the character based on the walking half cycle of the character and the emotion parameter of the state storage unit 95.

Next, the operation of the rhythm evaluation section 94 in the character / rhythm management section 99 will be described with reference to FIGS. 11 and 12.
Detailed description will be made with reference to the flowchart shown in FIG. However, here, for simplification of the description, there is only one other user.

FIG. 11 shows the mutual attraction phenomenon.
The processing procedure for realizing the synchronization between the user running in parallel with another user and the character is shown in the form of a flowchart.

In this case, first, the user / rhythm manager 9
8, the user's body rhythm is extracted, that is, the average T of the user's traveling half cycle as traveling data.
It is checked whether _u and the standard deviation σ _u are stored in the rhythm storage unit 93 (step S71). If the body rhythm has not been extracted yet, the process proceeds to the process of decaying emotional parameters as described later (step S81).

When gait data has already been extracted
Is the standard deviation σ of the user's driving half cycle _uStandard deviation acceptable
Quantity σ₀Whether the driving rhythm is stable compared to
It is further determined (step S72).

If σ _u <σ ₀ , it is determined that the rhythm of running of the user is stable, and the process proceeds to the next step. If not, it is determined that the rhythm of running is not stable, and the process proceeds to the process of time decay of emotional parameters described later (step S8).
1).

Next, the walking half cycle of the character is calculated (step S73). Thinking that the rhythm of walking of the character is drawn into the stable rhythm of running by the user,
The calculation of the walking half cycle of the character is performed using the following formula.

[0236]

T _c '= T _c + (T _u −T _c ) / N (M)

Here, T _c 'is the next walking half cycle of the character, T _c is the current walking half cycle of the character, T _u is the average of the running half cycle of the bicycle on which the user rides, and N (M) is the rhythm. The number of tuning steps, which is a parameter of the ease of being drawn in,
M is an emotional parameter of the character.

The emotion parameter M takes a value from a bad mood (0.0) to a good mood (1.0). The number of tuning steps N (M) is a function of the emotional parameter M of the character, and is set as follows, for example.

[0239]

[Equation 27] When 0.9 <= M <= 1.0, N (M) = 2 When 0.5 <= M <0.9, N (M) = 10 When 0.0 <= M <0.5, N (M) = 100

Therefore, when the character is in a good mood, the rhythm is strongly drawn, and the rhythm of the user's walking is synchronized in a short time. On the other hand, when the character is in a bad mood, the rhythm is weakly drawn in, and the player walks on his own without synchronizing with the rhythm of walking by the user. Then, the calculated walking half cycle T _c ′ of the next character is sent to the state storage unit 95 of the character / rhythm management unit 99.

Next, it is determined whether the character is in synchronization with the user using the following formula (step S7).
4). However, δ _s is a constant for determining the tuning state.

[0242]

[Equation 28] | T _u −T _c | / T _c <δ _s

If the tuning state satisfies the above expression, it is further checked whether the tuning flag is set (step S75). If the tuning flag is not set, the tuning flag is set (step S7).
6) Store the tuning start time t _s .

If the character is in tune with the user but the tune flag has already been set, it is determined using the following equation whether the tune time is sufficiently long (step S77). However, t is the present time, t _s is the tuning start time, and T _s is the tuning determination time.

[0245]

[Number 29] t-t _s> T _s

If the above equation is satisfied and it is determined that the tuning time is sufficiently long, the next emotion parameter M ′ is calculated using the following equation from the current emotion parameter M and the emotion parameter increase m _s due to the tuning. The emotion parameter of the character is increased by calculating (step S78). However, when M ′> 1.0, M ′ = 1.0.

[0247]

[Equation 30] M ′ = M + _ms

Therefore, when the user and the character are in tune with each other, it is possible to obtain the emotional characteristic of the character, in which the character is gradually in a mood.

On the other hand, it is not in the synchronized state (step S7
4) and if the tuning flag is set (step S
79), and clears the tuning flag (step S80).

Finally, the next emotional parameter M'is calculated from the current emotional parameter M and the temporal decay m _a of the emotional parameter using the following equation (step S81). However,
When M '<0.0, M' = 0.0.

[0251]

## EQU31 ## M '= M-m _a

Therefore, if the user and the character are not in tune with each other, the character's mood will become worse over time, or the emotions that have risen will decay and gradually settle down over time. Can be obtained.

Further, FIG. 12 shows, in the form of a flowchart, a processing procedure for realizing the synchronization between the users who run the bicycles in parallel by the mutual pull-in phenomenon.

In this case, first, the user / rhythm manager 9
8, whether the average T _u and the standard deviation σ _u of the traveling half cycle of the bicycle on which the user rides are stored in the rhythm storage unit 93, and the traveling half of the bicycle on which another user rides via the communication management unit 97. It is checked whether the average T _{u2 of the} period and the standard deviation σ _u2 have been acquired (step S9).
1). If the body rhythm has not been extracted yet, the entire processing routine ends.

When the traveling data has already been extracted, the standard deviation σ of the traveling half cycle of the bicycle on which another user rides.
_u2 is compared with the standard deviation allowable amount σ ₀ to further determine whether or not the rhythm of the running is stable (step S
92).

If σ _u2 <σ ₀ , it is determined that the rhythm of running of the bicycle on which the user is riding is stable, and the process proceeds to the next process. If not, it is determined that the walking rhythm is not stable, and the entire processing routine is ended.

Next, it is determined whether or not the user and the other user are in the synchronized state by using the following formula (step S9).
3). However, δ _s is a constant for determining the tuning state.

[0258]

[ _Equation 32] | T _u −T _u2 | / T _u2 <δ _s

If the tuning state satisfies the above equation, it is further checked whether or not the tuning flag is set (step S94). If the tuning flag is not set, the tuning flag is set (step S9).
5) Store the tuning start time t _s .

If the character is in tune with the user but the tune flag has already been set, it is determined using the following equation whether the tune time is sufficiently long (step S96). Here, t is the current time, t _s2 is the synchronization start time of the user and another user, and T _s is the synchronization determination time.

[0261]

[Number 33] t-t _s2> T _s

If the above equation is satisfied and it is determined that the tuning time is sufficiently long, the following equation is used from the current emotional parameter M and the emotional parameter increase m _s2 due to the tuning of the user and other users. The emotion parameter of the character is increased by calculating the next emotion parameter M '(step S97). However, when M '> 1.0, M'
= 1.0.

[0263]

[Equation 34] M ′ = M + m _s2

Therefore, when the user is in tune with another user, the character's emotional characteristics can be obtained such that the character becomes more and more in a mood.

In addition to this, there is no running data of other users, that is, the average of the running half cycles obtained when the user runs alone instead of walking in parallel running between the users, the basic running half cycle T _u0.
If the following equation is satisfied, it is possible not to increase the emotion parameter (δ ₀ is a constant for determining the deviation from the basic walking).

[0266]

[ _Equation 35] | T _u −T _u0 | / T _u0 > δ ₀

In this case, the running rhythm is certainly synchronized between the user and the other user, but it is greatly deviated from the rhythm of the user's independent running, and the user is walking rhythm of the other user. This is because it can be judged that they have been forced together, and intimacy with the user has not been fostered.

In addition, it is not in the synchronized state (step S9
3) and if the tuning flag is set (step S
98), the tuning flag is cleared (step S99).

The next walking half cycle T _c ′ of the walking rhythm of the character and the next emotion parameter M ′ of the character are sent to the state storage unit 95.

Subsequently, the display control operation of the character by the display control unit 96 will be described in detail.

The display control unit 96 has display data of the character for expressing each emotion, and displays the character based on the walking half cycle T _c of the character of the state storage unit 95 and the emotion parameter M. As the display data of the character for each value of the emotion parameter M, a plurality of videos as a set of images of the character walking are prepared as follows, for example.

[0272]

[Equation 36]   When 0.9 <= M <= 1.0, the image of walking happily   When 0.5 <= M <0.9, an image of walking normally   When 0.0 <= M <0.5, the image of walking moody

Each image has the length of the walking cycle of the character and is reproduced repeatedly to generate an infinitely walking image.

The display control unit 96 displays the above-mentioned image corresponding to the current emotional parameter M at 2 in the current walking half cycle T _c .
Reproduction (that is, the display unit 2) at a walking cycle of k times (2 kT _c ).
(Display output from 5).

Here, k is a constant depending on each character. For example, a large animal character such as an elephant is unnatural in the same cycle as a human bicycle, so k takes an integer value larger than 1, and a small animal character such as a mouse conversely has a value larger than 1. Also takes a value that is a small integer. The reason why the integer or the integer is divided is to synchronize the timing of rotation of the crank of the bicycle on which the user rides and the timing of ground contact of the foot of the character.

For a character who does not walk, periodical movement using the body is used. For example,
In the case of a bird, flapping its wings, in the case of a fish, the movement of its tail fin, and in the case of a jellyfish, the movement of an umbrella can be expressed in correspondence with the walking cycle.

The display data of the character output from the display unit 25 is not necessarily limited to the video as a set of images. For example, it may be animation generated by two-dimensional or three-dimensional computer graphics, or sound or vibration.

In the case of a two-dimensional or three-dimensional animation, an animation of a character walking is prepared for each range of emotion parameter values.
Play the animation in the walking cycle (2 kT _c ).

Further, in the case of voice or vibration, the footstep sound or vibration is reproduced at the timing of touching the foot in a walking half cycle, and in the case of a bird, the sound or vibration of flapping wings is reproduced in the walking cycle. Further, when the user and the character are in the synchronized state, a sound expressing the synchronized state may be reproduced.

Further, the character is not necessarily limited to a person, an animal, or an anthropomorphized person similar to these, and a visual, auditory, or tactile movement is added so that empathy can be carried out. Anything will do.

Further, not only the parallel running of the bicycles but also the parallel running of the electric bicycles or the parallel running of the simulated bicycle rowing by the bicycle ergometer can be handled in the same manner. As with a bicycle, a coil is attached to the boat and a magnet is attached to the oar. Then, by detecting the current pulse generated by the electromagnetic induction when the all magnets cross the coil, the entertainment device 11 shown in FIG. 10 is moved by the boat or moved in parallel by rowing ergometer to simulate the rowing of the boat. Can also be extended and used.

[0284] The above concept is based on walking and running.
(Running), movement of the physical world such as movement by bicycle, electric bicycle, boat, or simulated movement of the physical world such as treadmill, step machine, bicycle ergometer, rowing ergometer, etc. In the virtual world generated by graphics, it is possible to easily extend to the pseudo movement using the above-mentioned pseudo movement device in the physical world as an input device and the pseudo movement using a keyboard, a mouse, a joystick, or the like. it can.

Further, the parallel exercise is not limited to the similar exercises such as walking and walking, bicycle and bicycle, and can be easily extended to bicycle and running (running) or bicycle and bicycle ergometer. You can

[Supplement] The present invention has been described in detail with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the scope of the present invention. That is, the present invention has been disclosed in the form of exemplification, and the contents of this specification should not be construed in a limited manner. In order to determine the gist of the present invention, the section of the claims described at the beginning should be taken into consideration.

[0285]

As described above in detail, according to the present invention,
An excellent information processing apparatus and information processing method, a storage medium, which can make entertainment entertaining to a moving user through interaction of characters.
Also, a computer program can be provided.

Further, according to the present invention, by controlling the interaction of the character in accordance with the body rhythm of the user who is moving, the user can get a feeling of intimacy and enjoy the movement itself as entertainment. A processing device, an information processing method, a storage medium, and a computer program can be provided.

Further, according to the present invention, by utilizing the mutual entrainment phenomenon of the body rhythm of the moving user and the body rhythm of the character, a sufficient sense of intimacy is unknowingly created between the user and the character. Thus, it is possible to provide an excellent information processing apparatus and information processing method, a storage medium, and a computer program that allow the user to enjoy the movement itself as entertainment.

That is, the rhythm accompanying the movement of the user,
By creating a mutual entrainment phenomenon with the rhythm of the character's movement and changing the degree of entrainment depending on the character's state, a deep sense of intimacy is created between the user and the character, and entertainment by moving is provided. I can have fun.

[Brief description of drawings]

FIG. 1 is a diagram showing an external configuration of an entertainment apparatus 11 according to an embodiment of the present invention.

FIG. 2 is a diagram schematically showing an internal hardware configuration of the entertainment apparatus 11.

FIG. 3 is a diagram schematically showing a functional configuration of the entertainment device 11 for realizing entertainment when a user walks.

4 is a flowchart showing an operation procedure of a rhythm evaluation section 34 in a character / rhythm management section 38. FIG.

FIG. 5 is a diagram schematically showing a functional configuration of the entertainment device 11 for realizing entertainment when the user travels on a bicycle.

FIG. 6 is a flowchart showing an operation procedure of a rhythm evaluation section 54 in a character / rhythm management section 58.

FIG. 7 is a diagram schematically showing a functional configuration of the entertainment apparatus 11 for realizing entertainment when a user walks in parallel.

FIG. 8 is a flowchart showing an operation procedure of a rhythm evaluation section 74 in a character / rhythm management section 79.

9 is a flowchart showing an operation procedure of a rhythm evaluation section 74 in a character / rhythm management section 79. FIG.

FIG. 10 is a diagram schematically showing a functional configuration of the entertainment device 11 for realizing entertainment when the user runs the bicycles in parallel.

11 is a flowchart showing an operation procedure of a rhythm evaluation section 94 in a character / rhythm management section 99. FIG.

FIG. 12 is a flowchart showing an operation procedure of a rhythm evaluation section 94 in a character / rhythm management section 99.

[Explanation of symbols]

11 ... Entertainment device 21 ... Processor 22 ... ROM 23 ... RAM 24 ... Input section 25 ... Display 26 ... Communication interface 31 ... Walk detection unit 32 ... Rhythm extraction section 33 ... Rhythm storage section 34 ... Rhythm evaluation section 35 ... State storage unit 36 ... Display control unit 37 ... User Rhythm Management Department 38 ... Character / rhythm management section

Claims (38)

[Claims] 1. An information processing apparatus that realizes entertainment for a moving user through character interaction, a movement detection unit that detects the movement of the user, and a physical rhythm of the user based on the movement detection result of the user. A rhythm extraction unit that extracts the character state, a state storage unit that stores the state of the character consisting of emotions and body rhythms, a rhythm evaluation unit that updates the state of the character based on the user's body rhythm and the state of the character, and the state of the character An information processing device, comprising: a display control unit that displays a character having a body rhythm according to the above. 2. The information processing apparatus according to claim 1, wherein the movement detecting unit detects a user's walking, and the rhythm extracting unit extracts a half walking period of the user as a body rhythm. 3. The movement detection unit detects rotation of a crank of a bicycle on which the user rides, and the rhythm extraction unit extracts a half running cycle of the bicycle on which the user rides as a body rhythm.
The information processing device according to 1. 4. The information processing apparatus according to claim 1, wherein the rhythm evaluation unit updates the state of the character so that the body rhythm of the character is drawn into the body rhythm of the user. 5. The information processing apparatus according to claim 4, wherein the rhythm evaluation unit changes the ease with which the body rhythm of the character with respect to the body rhythm of the user is drawn in according to the emotion of the character. 6. The information processing apparatus according to claim 1, wherein the rhythm evaluation unit determines the synchronized state between the user and the character based on the difference between the body rhythm of the user and the body rhythm of the character. 7. The information processing apparatus according to claim 1, wherein the rhythm evaluation unit controls the emotion of the character according to the synchronization time between the user and the character. 8. The information processing apparatus according to claim 7, wherein the rhythm evaluation section raises the emotion of the character in response to the synchronization time between the user and the character reaching a predetermined value. 9. The information processing apparatus according to claim 1, wherein the rhythm evaluation section attenuates the emotion of the character over time. 10. The display control unit preliminarily prepares a plurality of types of display data for each state of the character, and uses the display data corresponding to the state of the character determined by the rhythm evaluation unit to perform the motion of the character. Express,
The information processing apparatus according to claim 1, wherein: 11. The display control unit displays a body rhythm by using a periodic movement related to the movement of the character,
The information processing apparatus according to claim 1, wherein: 12. The display control unit expresses a motion of a character having a moving half cycle which is an integral multiple or a fraction of a moving half cycle of the user in a synchronized state with the user. 11. The information processing device according to item 11. 13. The information processing apparatus according to claim 1, wherein the display control unit displays the body rhythm by using a periodic movement other than the movement of the character. 14. The information processing apparatus according to claim 1, wherein the display control unit displays the body rhythm of the character as a voice or a vibration of the apparatus body. 15. The display control unit outputs a body rhythm by using a medium that realizes empathy according to a visual, auditory, or tactile displacement amount.
The information processing device according to 1. 16. A communication unit for receiving the body rhythm of another user, wherein the rhythm evaluation unit updates the state of the character according to the body rhythm of the user and the body rhythm of another user who moves in parallel. The information processing apparatus according to claim 1, wherein: 17. The rhythm evaluation section enhances a character's emotions in response to a user's body rhythm and another user's body rhythm reaching a synchronized state. Information processing equipment. 18. The rhythm evaluation section does not elevate the emotion of the character when the user's body rhythm during parallel walking of another user is outside the predetermined range from the body rhythm during single walking. The information processing apparatus according to claim 17, wherein: 19. An information processing method for realizing entertainment for a user who is moving through character interaction, comprising a movement detecting step of detecting the movement of the user, and a body rhythm of the user based on the movement detection result of the user. Rhythm extraction step to extract the character, state storage step to store the state of the character consisting of emotion and body rhythm, rhythm evaluation step to update the state of the character based on the user's body rhythm and the state of the character, and the state of the character And a display control step of displaying a character having a body rhythm corresponding to the information processing method. 20. The information processing method according to claim 19, wherein the movement detecting step detects a user's walking, and the rhythm extracting step extracts a half walking cycle of the user as a body rhythm. 21. The movement detection step detects rotation of a crank of a bicycle on which the user rides, and the rhythm extraction step extracts a half cycle of running of the bicycle on which the user rides as a body rhythm. Information processing method described in. 22. The information processing method according to claim 19, wherein in the rhythm evaluation step, the state of the character is updated so that the body rhythm of the character is drawn into the body rhythm of the user. 23. The information processing method according to claim 22, wherein, in the rhythm evaluation step, the ease with which the body rhythm of the character with respect to the body rhythm of the user is changed according to the emotion of the character. 24. The information processing method according to claim 19, wherein in the rhythm evaluation step, the synchronized state between the user and the character is determined based on the difference between the body rhythm of the user and the body rhythm of the character. 25. The information processing method according to claim 19, wherein in the rhythm evaluation step, the emotion of the character is controlled according to the synchronization time between the user and the character. 26. The information processing method according to claim 25, wherein in the rhythm evaluation step, the emotion of the character is raised in response to the synchronization time between the user and the character reaching a predetermined value. 27. The information processing method according to claim 19, wherein in the rhythm evaluation step, the emotion of the character is attenuated with the passage of time. 28. In the display control step, a plurality of types of display data for each character state are prepared in advance, and the character motion is displayed using the corresponding display data according to the character state determined in the rhythm evaluation step. 20. The information processing method according to claim 19, which is expressed. 29. The information processing method according to claim 19, wherein, in the display control step, the body rhythm is displayed by utilizing a periodical movement relating to the movement of the character. 30. In the display control step, an action of a character having a moving half cycle that is an integral multiple or a fraction of a moving half cycle of the user is expressed in a synchronized state with the user. 29. The information processing method described in 29. 31. The information processing method according to claim 19, wherein, in the display control step, the body rhythm is displayed by utilizing a periodic movement other than the movement of the character. 32. The information processing method according to claim 19, wherein in the display control step, the body rhythm of the character is displayed as a voice or a vibration of the apparatus body. 33. The body rhythm is output in the display control step, using a medium that realizes empathy in accordance with a visual, auditory, or tactile displacement amount. Information processing method described. 34. A communication step of receiving a body rhythm of another user, wherein the rhythm evaluation step updates the state of the character according to the body rhythm of the user and the body rhythm of another user who moves in parallel. 20. The information processing method according to claim 19, wherein: 35. The rhythm evaluation step enhances a character's emotions in response to the user's body rhythm and another user's body rhythm reaching a synchronized state. Information processing method. 36. In the rhythm evaluation step, when the user's body rhythm during parallel walking of another user is outside the predetermined range from the body rhythm during single walking, the emotion of the character is not enhanced. 4. The method according to claim 3,
The information processing method according to item 5. 37. A storage medium in which computer software is physically stored in a computer-readable format so as to execute a process on a computer system for realizing entertainment for a moving user through character interaction. The computer software stores a movement detection step of detecting the movement of the user, a rhythm extraction step of extracting the body rhythm of the user based on the movement detection result of the user, and a state of the character consisting of emotions and body rhythms. State storage step, a rhythm evaluation step for updating the character state based on the user's body rhythm and the character state, and a display control step for displaying a character having a body rhythm according to the character state. Storage medium characterized by 38. A computer program written in a computer-readable format for performing on a computer system a process for realizing entertainment for a user who is moving through character interaction, the user moving. A movement detection step that detects the user's movement, a rhythm extraction step that extracts the user's body rhythm based on the movement detection result of the user, a state storage step that stores the state of the character consisting of emotions and body rhythms, and a user body rhythm A computer program comprising: a rhythm evaluation step of updating the character state based on the character state; and a display control step of displaying a character having a body rhythm according to the character state.